JP2600530B2 - Scenario presentation method and editing method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a scenario presentation method for presenting multimedia data based on a scenario including timing designation such as start / end of presentation of multimedia data, and presentation start / end of multimedia data. The present invention relates to a method for editing a scenario including a timing specification such as the above.

[0002]

2. Description of the Related Art Multimedia software used in electronic publishing, CAI, presentations, etc.
When presenting digitized multimedia information including moving images on a display screen, describe where and when to display and erase each media data on the screen (hereinafter referred to as a scenario). It is necessary to present data at a specified timing.
As a method of presenting data according to a scenario, there is a method of describing presentation timing of individual data in a simple language, registering the data, creating a time table based on this, and sequentially presenting data. This method is described, for example, in Japanese Patent Application No. 63-060908, entitled "Data Presentation Method and Apparatus". We also extend this method,
In addition to the data itself, the presentation timing of dialog buttons for interactively presenting data is described in the scenario,
There is a method of presenting interactive buttons at a predetermined timing based on a scenario, and presenting corresponding data when a user input occurs during the interactive button presentation. Conventional method 1
Call it. This method is described in detail in Japanese Patent Application No. 01-144901, entitled "Data Editing / Presentation Method and Apparatus".

On the other hand, as a method for editing the timing, particularly in the above-mentioned scenario, there is a method of displaying a time axis on a display screen and designating the presentation timing of each data and an interactive button on the time axis. This method is described, for example, in Japanese Patent Application No. 01-144901, entitled "Data Editing / Presentation Method and Apparatus", and in the document "I Triple E Software A Construction Set for Multimedia Applications", January 1989 (IEEE).
E Software, A Constructio
n Set for Multimedia Appl
ications, Vol. 6, No. 1, Ja
n. 1989, p. 37-43) ". Further, as a method for simultaneously editing the screen layout and the presentation timing in the above scenario, the window position and the presentation timing on the display screen are expressed in a three-dimensional coordinate space (x, y, t). There is a method in which the presentation position and size of each data window or dialog button and the coordinate value of the presentation timing are graphically represented as a solid, and the presentation layout and timing are edited by moving / enlarging / reducing the solid. This is called Conventional Method 2. This is disclosed in Japanese Patent Application No. 01-176675, “Data Editing Method and Apparatus”, and in the document “Hypertext: Concepts, Systems and Applications Scenario-Based Hypermedia:
Model and A System, November 1990 (H
hypertext: Concepts, System
sand Applications, Scenar
io-based Hypermedia: A Mod
el and a System, Cambridge
e University Press, Nov. 1
990, p. 38-51) ". FIG. 15 shows a scenario editing interface using a three-dimensional figure used in the conventional method 2. According to this interface, a coordinate value (x, y) representing a presentation position / size on the screen, and a three-dimensional space (x, y, t) representing coordinate values representing presentation start / end timing are defined. Each data can be expressed as a rectangular parallelepiped of size (dx, dy, dt). In the figure, a large rectangular solid (DX, DY, D
T) is a reference solid representing the size (DX, DY) of the display screen and the time DT required to present the entire scenario. The relative arrangement of each solid with respect to the reference solid is a graphic representation of the entire scenario, and the scenario can be graphically edited by changing the arrangement and size of each solid.

[0004]

First, as a problem of the conventional method 1, an interactive function provided by an interactive button is very simple, and is for receiving a variable user input such as a character string input from a keyboard. Does not consider the presentation of dialog buttons or windows. In addition, data presentation accompanying user input is always performed unconditionally, and corresponds to presentation of a scenario including a so-called conditional clause (if-then sentence) in which data is presented only when a user input satisfies a certain condition. Absent. For this purpose, use CAI software, etc.
There is a problem in that it is impossible to adaptively present data such that a user inputs an answer, presents certain data in the case of a correct answer, and presents another data in the case of an incorrect answer. In addition, using CAI software, etc.,
There is a problem in that a data display function such as providing a user monitor selection menu such as "expert" and allowing the user to select the menu, and for example, when the beginner mode is selected, always presents a help message cannot be provided.

The conventional method 1 does not provide a function of temporarily suspending data presentation based on a scenario while monitoring user input. Therefore, if the input monitor time is improperly set, there is a problem that the input monitor time ends when the user takes a long time for input.

Further, the conventional method 1 does not provide a function for describing an external program which is not directly related to data presentation in a scenario, activating the external program at a designated timing, and determining data to be presented according to the execution result. For this reason, for example, in a CAI teaching material, a problem answering process requiring special calculations and complicated inputs is separately created as an external program, which is incorporated into a scenario, or a program for examining the history of user input is started. The result cannot determine the next teaching material,
There is a problem.

The conventional method 2 provides a method for editing a dialog button or a window for receiving a variable user input such as a character string, and for editing a method of matching the received user input with a predetermined condition. Absent. Therefore, if-then statements and switch-ca
There is a problem that a scenario including a conditional clause corresponding to the se sentence cannot be edited. Further, in the conventional method 2, in order to represent the scenario as a three-dimensional object in the coordinate space (x, y, t), the presentation time is unlimited, for example, when data and dialog buttons are continuously displayed until there is a user input. When it is necessary to present, the corresponding solid is
There is a problem that it is expressed as a very rectangular parallelepiped in the t direction in the coordinate space, and editing is troublesome.

An object of the present invention is to provide a scenario presenting method and a scenario editing method which solve such a problem.

[0009]

A first aspect of the present invention is a scenario presentation method for presenting multimedia data based on a scenario including timing designation of start / end of presentation of multimedia data. An input monitor time (Ts,
Te) is described in the scenario, and from time Ts to Te
Monitor the user's input, and if there is an input, write the user input or a character string generated in response to the user input to the input memory as a collation character string, and write the collation character written in the input memory A collation processing time (Ta, Tb) indicating a start time and an end time of the collation processing of the column, a condition character string S to be compared in the collation processing, and a set of data D to be presented (Ta, Tb, S, D) are described in the scenario, and the collation character string and the condition character string are collated from time Ta to Tb, and if they match, the data D is presented immediately.

According to a second invention, in the scenario presentation method according to the first invention, the clock for measuring the passage of time is stopped at a user input monitor start time Ts, and the clock is set to a time when the input memory is updated by a user input. It is characterized by restarting from Ts.

According to a third invention, in the scenario presentation method according to the first invention, a default character string Sd is defined for a collation character string and a condition character string, and any one of the collation character string and the condition character string is determined. Is Sd, the data D is unconditionally presented.

According to a fourth aspect, in the scenario presentation method of the first aspect, an identifier of the external program and a start time Tp for starting the external program are described in the scenario, and the external program is started at a time Tp. And writing the execution result to an input memory.

According to a fifth aspect of the present invention, a three-dimensional reference solid (D) representing a display screen size (DX, DY) and a time interval DT from the start to the end of data presentation by a scenario.
X, DY, DT) is displayed graphically, one vertex of the reference solid is set as the origin of the (x, y, t) coordinates, the window size (dx1, dy1) for presenting the media data, and from the start to the end of the window display The media solid (dx1, dy1, dt1) representing the time interval dt1 is arranged inside the reference solid and displayed as a graphic, and the graphic is edited to provide presentation position information and presentation timing information of the media data on the screen. A scenario editing method for editing a key input window or an interactive button on a screen, accepting user input, and writing an input character string or an internally converted character string to an input memory.
The size (dx2, dy2) on the (x, y) plane is the size of the window or dialog button, and the size dt in the t-axis direction
2 is represented by an input monitor solid (dx2, dy2, dt2) such that the input monitor time is (Ts, Te), and this input monitor solid is arranged inside the above-mentioned reference solid and displayed as a graphic. The comparison character string and the condition character string S are compared, and if they match, the data set (Ta, Tb,
S, D), the process of presenting the data D, the size dt3 in the t-axis direction is determined by the collation processing time (Ta, T
b) is a collation processing solid (dx3, dy3, dt)
3), this collation-processed solid is arranged inside the reference solid and displayed as a graphic, and processing to be executed as an external program is performed by an external program solid (dx4, dy4, dt).
4), the external program solid is arranged inside the reference solid and displayed as a graphic, and the registration and deletion of the graphic displayed solid, a change in the arrangement in the standard solid, and a change in the size of the solid are performed. Is performed.

According to a sixth aspect, in the scenario editing method according to the fifth aspect, an input monitor solid and a matching solid displayed on the screen are selected, the selected solid group is erased from the screen, and these solids are deleted. It is characterized in that the group solids that are collectively represented are graphically displayed, and the arrangement of the displayed group solids in the reference solid is changed.

According to a seventh aspect, in the scenario editing method according to the fifth aspect, if the size of the solid displayed on the screen in the t-axis direction is sufficiently large and the presentation time can be regarded as unlimited, The size is set to 0, and a two-dimensional rectangle is displayed on the screen.

[0016]

The first to fourth inventions relate to a scenario presentation method. Among them, the second, third, and fourth inventions are inventions based on the first invention and added with new functions that provide different effects. The fifth to seventh inventions relate to a scenario editing method. Among them, the sixth and seventh inventions are inventions based on the fifth invention and added with new functions that provide different effects.

In the scenario targeted by the present invention, it is assumed that the timing such as the start / end of presentation of each data and the interactive button can be specifically designated. Also, in the present invention,
The scenarios targeted in the sixth and seventh inventions are based on the premise that, in addition to the above, the presentation position and size of each data and dialog buttons on the screen can be specifically specified.

According to the first invention, three kinds of processing of data presentation, monitoring of user input, and collation of user input with a condition written in a scenario are performed at timing designated in the scenario. By presenting the corresponding data only when the condition is satisfied, a scenario including a description corresponding to a so-called if-then sentence or a switch-case sentence is realized. In the present invention, in addition to ordinary data and dialog buttons, the following two types of processing units (hereinafter referred to as objects) are described in a scenario with identifiers similar to data and dialog buttons. (1) An input monitor object that monitors user input and records the input in an internal memory (referred to as input memory means). As attribute information of this object, an identifier W of a window or an interactive button to be displayed on the screen and an input monitor time (Ts, Te) indicating a start time and an end time of the user input monitor are described. (2) A collation processing object for collating the contents of the input memory means with a certain condition and presenting the specified data when the condition is met. As the attribute of this object, a collation processing time (Ta, T
b), a condition character string S to be collated and data D to be presented are described. This set of attribute data (T
a, Tb, S, D) are referred to as “collation data”.

In order to realize the data presentation based on the above-mentioned processing object, in the present invention, the input monitoring means for realizing the function of the input processing object, the input memory means for writing the input by the input monitoring means, and the function of the collation processing object are provided. Each means of a matching processing means to be realized, an input monitor means, a scenario presentation control means for activating the condition matching means at a timing defined in the scenario based on the time information, and a timing means for supplying time information to the scenario presentation control means Prepare In addition, data,
Data presentation means for presenting dialog buttons, etc., scenarios,
A database management means for recording data and attribute information of dialog buttons, a data recording means for recording data itself, and the like are provided.

The start / end of the data presentation, the start / end of the input monitor, and the start / end timing of the collation processing are determined by the scenario presentation control means based on the scenario and time information, and the start / end of each means is determined. Send the order of When the input monitor receives the monitor start command from the scenario presentation controller, the input monitor causes the data presenter to present an input window or a dialogue button, and monitors the input from the input device. If there is an input, the input itself is written in the case of a key input, and the character string for collation specified in the scenario is written in the input memory means in the case of an input with a mouse or the like. On the other hand, when the condition matching means receives the matching start command of the scenario presentation control means, the condition matching means refers to the character string in the input memory means,
This is compared with the condition character string S. If they match,
Immediately, the data presenting unit is caused to perform the process of presenting the corresponding data D.

In the present invention, since the start / end of the input monitor processing and the condition collation processing is designated in the same manner as the presentation of data and interactive buttons, consistency with the conventional scenario presentation method is ensured. Good. Also, by separating the input monitoring process and the condition matching process, the same matching process is applied to inputs from multiple input devices, or multiple matching processes are applied to one input at a time. Alternatively, various conditional clauses such as repetitive application over time (if-then statement, switch-cas
e) can be presented.

According to a second aspect of the present invention, when the input monitor process is started, the presentation of the scenario is temporarily suspended to wait for a user input, and after the input is accepted, the scenario presentation is resumed from the point of the suspension. It will be realized. According to the first aspect, when the scenario presentation control unit instructs the input monitoring unit to start input monitoring, the operation of the timing unit and the data presentation unit is temporarily stopped, and the operation waits until a user input is notified. It can be realized by restarting the timekeeping means and the data presenting means at the time when an input notification is received from the input monitoring means. As a result, it is possible to solve a problem relating to the restriction of the input monitor time, such as the end of the input monitor time while the user performs the key input again.

According to a third aspect of the present invention, a function of presenting the same data (default data) except for a specific input or presenting data irrespective of the result of the condition matching in the condition matching processing of the user input (conventionally, Fixed dialog button function). In the condition matching processing of the first invention, the condition character string S or the default value Sd of the character string for comparison I written in the input memory means is defined. If any one of the columns S is Sd, this is realized by unconditionally presenting data. Thereby, if-then-else, switch-cas
Condition clauses corresponding to "else" and "elsecase" of e-elsecase can be presented, and a more flexible scenario can be created. In addition, by defining a default value for the collation character string, a data presentation function adapted to user input and a data presentation function using conventional fixed dialog buttons can be simultaneously realized.

The fourth invention realizes a function of activating an external program during the presentation of a scenario, receiving an execution result, and presenting data according to the result. This is because the external program is regarded as an input monitor object or a collation processing object, and a time at which the external program is started during the scenario is specified. It is realized by storing. For this purpose, in the present invention, in addition to the means described in the first invention, an external program execution means for executing an external program in response to a start instruction from the scenario presentation control means, and an external program recording means for storing the external program are provided. prepare. The scenario presentation control means sends an execution command to the external program execution means based on the scenario and the time information from the time keeping means. Upon receiving this, the external program execution means reads out and executes the external program. The external program executing means receives the execution result and writes the result into the input memory means. Alternatively, the external program may directly write the result to the input memory means. Thereafter, the condition matching means performs the matching process, so that data presentation adapted to the execution result can be performed.

In the present invention, since the input monitor means and the condition matching means are separated from each other, it is very easy to use the input from the external program for the condition matching like the input monitor means. As a result, it is possible to easily realize a program for monitoring user input to determine data to be presented or a problem answering process requiring a special calculation or input method as an external program and incorporating it into a scenario.

In the scenarios targeted by the scenario editing methods according to the fifth, sixth, and seventh aspects, the data to be presented and the dialog buttons are the same variables as those used in the conventional method 2, that is, on the screen. It has a coordinate value (x, y) representing the presentation position / size and a coordinate value t representing the presentation start / end timing. Therefore, as shown in FIG. 15, a three-dimensional space (x, y, t) expressing these is defined, and each data can be expressed as a rectangular parallelepiped having a size (dx, dy, dt). In the figure, a large rectangular solid (DX, DY, D
T) is a reference solid representing the size (DX, DY) of the display screen and the time DT required to present the entire scenario. The relative arrangement of each solid with respect to the reference solid is a graphic representation of the entire scenario, and the scenario can be graphically edited by changing the arrangement and size of each solid.

According to a fifth aspect of the present invention, the above-mentioned conventional method uses data,
The same editing is applied to a scenario including processing objects such as an input monitor, a condition collation, and an external program introduced in the first to fourth inventions, while a scenario including only a mouse-compatible interactive button is targeted. It implements the method. For this purpose, in the present invention, input management means for receiving a user input relating to graphical scenario editing, attribute information such as a scenario, related data, and dialog buttons are read out and written to edited data recording means to be described later, and input from the input management means. Scenario editing control means for updating this according to the command and displaying the edited content as a graphic on the data presentation means described later, the scenario being edited, and related data,
Edit data recording means for recording the attribute information of the dialog buttons and coordinate information for drawing them as a three-dimensional figure, and figure presenting means for drawing each figure on the screen based on the drawing coordinate information are prepared. As auxiliary means, database management means for recording attribute information such as scenarios, data, dialog buttons, processing objects, etc., movement control means for moving a specific figure on the screen in accordance with mouse input, specific figure on the screen Size change control means for changing the size of the mouse according to mouse input is also provided.

In the present invention, the following commands are defined for the scenario editing control means in order to simultaneously graphically edit data, dialog buttons, processing objects, and external programs.

At the start of editing, at the start of editing, the scenario editing control means reads the corresponding scenario from the database management means and displays the described data, interactive buttons, etc. on the screen. At the end of editing, the scenario currently being edited is recorded in the database management means, and the editing is ended.

Object creation / deletion An object is a general term for data / interaction buttons / processing objects described in a scenario. In object generation, the scenario editing control means displays a new three-dimensional figure on a screen and adds a description of a new object to the scenario. In the object deletion, the designated figure is deleted from the screen, and the description of the corresponding object is deleted from the scenario.

Object selection A figure on the specified screen and a corresponding object are to be edited.

Movement This involves changing the position of the object (solid figure) being edited in the three-dimensional space (x, y, t), that is, changing the presentation position on the screen and the presentation start / end timing. means. Actually, the scenario editing control means activates the movement control means and moves the figure on the drawing while monitoring the user's mouse input.

Size change This means that the size of the object (solid figure) being edited on the screen and the length of the presentation time are changed. The scenario editing control unit activates the size change control unit, and changes the size of the figure on the drawing while monitoring the user's mouse input.

Attribute input The attribute information of the object being edited is input by a key. Thereby, it is possible to input, for example, the condition character string S and the presentation data D required for the condition matching object.

The above commands are presented to the user to be freely selected and sequentially processed by the scenario editing control means through the input management means, so that the input monitor object, the collation processing object, and the scenario including the external program can be made identical. It can be easily edited with a graphical interface.

The sixth invention provides a unitary if-th
An input monitor object representing an en statement or a switch-case statement and a collation processing object are grouped into one group, and instead of a group of figures of individual objects, one figure representing the group is displayed on the screen and edited. The function is realized. For this purpose, in the present invention, a grouping start command / grouping end command / grouping release command is newly defined as a command from the input management means in the fifth invention. The scenario editing control unit that has received the grouping start instruction causes the user to select a figure on the screen by clicking the mouse, and creates a group record describing an object corresponding to the selected figure. Subsequently, each grouped figure is deleted from the screen, and a figure (group figure) representing the group is displayed. As a result, a group of conditional clauses can be edited semantically as one figure, and in particular, the start time of the grouped processes can be set collectively. In addition, the editing interface is simplified because the number of displayed graphics is reduced, and the operation is facilitated. Further, the grouping can prevent erroneous editing in which objects related to each other are deleted or changed by mistake.

The group record is described in a scenario and recorded in the database management means. At this time, a backup of the scenario before the grouping is made to prepare for a grouping release instruction. The ungrouping instruction is an instruction used when it is desired to edit an object that has been once grouped again. Upon receiving the instruction, the scenario editing control unit reads the backup scenario and compares the read scenario with the scenario in which the current group record is written. The coordinates are updated, and this is displayed again on the screen as the current scenario. Thus, the objects that have been grouped can be individually edited again.

According to a seventh aspect of the present invention, when editing a window / interactive button / input monitor object / collation processing object whose display time (processing time) is extremely long or whose time is not desired to be limited, the size in the time direction is set to 0. By displaying a two-dimensional rectangle on the screen, the editing interface is easy to see and the operation is easy. Therefore, in the present invention, a time default value setting command is newly defined as a command from the input management means in the fifth invention. This is to set the size in the time direction of the object currently being edited to a predetermined time default value _tdef . If t _def = 0, the figure on the screen is displayed as a rectangle having a thickness of 0 in the t direction. This simplifies the editing interface for objects where you want unlimited presentation / processing time,
Editing is easy.

[0039]

Embodiments of the present invention will be described below with reference to the drawings. 1. Embodiment of First Invention A. First Embodiment Description of Device Configuration FIG. 1 shows a configuration example of a scenario presentation device that implements a scenario presentation method according to the present invention. The details of each device are as follows. [1] Input receiving unit 11 (part of input monitoring means) is configured by an input device such as a mouse / keyboard,
The input of the user is sent to the input monitor unit 12. [2] Input monitor unit 12 (part of input monitor means) In response to an instruction from scenario presentation control unit 16 described later, user input from input accepting unit 11 is monitored, and if there is an input, it is specified in advance. It is converted into a collation character string by the method, and this is written into the input memory 13. In the case of key input, the input character string can be directly written as a collation character string. [3] Input memory 13 (input memory means) Record a collation character string for collating an input with a condition.
The input memory 13 can be accessed in three types: (1) write (2) read (3) reset. In case of reset, a null code is written. [4] Condition Matching Unit 14 (Condition Matching Means) The instruction matching unit 14 receives an instruction from the scenario presentation control unit 16 described below, refers to the input memory 13, and matches the condition character string S if the content is updated. If they match, a media presentation unit 18 to be described later performs a process of presenting the corresponding data D. [5] Clock unit 15 (clock unit) The clock unit 15 has a clock and notifies the current time according to a command from the scenario presentation control unit 16. The clock unit 15 can be sent three types of commands: start, time setting, and time reading. [6] Scenario presentation control unit 16 (scenario presentation control unit) The scenario is read from the database management unit 17 described later, and the presentation start / end time of each data, the input monitor start /
A time table is created according to the end time and the collation processing start / end time. Subsequently, the time table is checked while monitoring the time information of the timer unit 15, and the processing described in the table is performed at the designated time. That is, the data presentation start / end process is sent to the data presentation control unit 18, the input monitor start / end process is sent to the input monitor unit 12, and the collation process start / end process is sent to the condition collation unit 14 to be executed. Here, the start instruction includes the following.

(1) To the data presentation control unit 18: Presentation start instruction Presentation start instruction of specified data / interaction button Presentation end instruction Presentation end (erase) instruction of specified data / interaction button (2) Input monitor For the part 12 ・ Monitor start instruction Display of specified data / interactive button and input monitor start instruction for it ・ Monitor end instruction Display of specified data / interactive button and input monitor end instruction for it (3) For the condition collating unit 14: a collation start instruction A collation start instruction for comparing the contents of the input memory 13 with the specified condition character string a collation end instruction A collation end instruction for comparing the contents of the input memory 13 with the specified condition character string [7] Database management unit 17 (database management means) Writes individual scenario data, media data, and attribute information of dialog buttons. Record. Scenario used in this embodiment, Scenario name DX, DY, DT Object name 1 x 1, y 1, t 1 Object name 2 x 2, y 2, t 2 · · Object name n x n, y n, t n It is described as follows. Where Scenario nam
e is an identifier of a scenario, and DX, DY, and DT are sizes of the display screen (D
X, DY) and the time DT until the presentation of all data in the scenario ends. Object name is an identifier of each media data, dialogue button or the like presented in the scenario, and (x, y) is a presentation position on the screen of each data / interaction button (for example, relative to the upper left vertex of the display screen). The position (x, y)) and t represent the presentation start time (for example, relative time from the scenario presentation start time when t = 0). On the other hand, the attribute information of each object (media data, dialog button) is similarly recorded in the database, and is written in the form of Object name dx, dy, dt, and information dependent on the object. . This description format is called a “record”. Here, (dx, dy) is the display size of this object on the screen, and dt is the display time of the object. To summarize this, the above scenarios Scenario name DX, DY, DT Object name 1 x 1, y 1, dx 1, dy 1, t 1, t 1 + dt 1, the object dependency information Object name ₂ x _2, y _{2 , dx 2, dy 2, t} 2, t 2 + dt 2, the object-dependent information _{· · object name n x n,} y n, dx n, dy n, t n, t n + dt n, also write object dependent information it can. Here, _{(x i, y i, dx} i, d
y _i ) indicates the presentation position and size of the i-th object on the screen, and (t _i , t _i + dt _i ) indicates the presentation start time and end time of the object. [8] Data presentation control unit 18 (part of the data presentation unit) Upon receiving a notification from the scenario presentation control unit 16 and the condition matching unit 14, the designated media data and the presentation of the interactive button
Perform erasure. The media data and the display data of the dialog buttons are recorded in the media recording unit 19, and the data presentation control unit 19 reads out the corresponding media data according to the presentation command, presents the media data to the data presentation unit 110, and presents the read media data according to the erase command. to erase. [9] Data recording unit 19 (data recording means) Records individual multimedia data, graphic data for displaying interactive buttons, and the like. Audio and moving images are recorded on a large-capacity optical disk, and text, graphics, and the like are recorded on a high-speed magnetic disk. [10] Data presenting unit 110 (part of data presenting means) A CRT display, an audio output speaker, and a frame buffer for outputting moving images are provided, and each media data excluding audio and interactive buttons are displayed on the display. B. Description of Scenario Description Method In the present invention, as objects to be described in a scenario, in addition to ordinary media data and dialog buttons, a processing object for writing a user input to an internal memory, and the contents of the input memory are compared with conditions. Processing objects to be included. For example, consider an object Input representing the former and an object Match representing the latter. Input is a text window I on the screen.
nput is displayed, the key input of the user is received from this window, and this is written in the input memory 13 as it is. Match is a condition string Str that matches the input.
ng and data to be presented are designated. Using this, an if-then statement if (Input = String) then show
Scenario Ifthen representing Data can be written as follows.

[0041] However, Input dx ⁱⁿ , dy ⁱⁿ , dt ⁱⁿ Match dx ^m , dy ^m , dt ^m , String, Data String, and Data are object-dependent information. Taken together, Ifthen DX, DY, DT Input x in, y in, dx in, dy in, t in, t in + dt in Match x m, y m, dx m, dy m, t m, t m + dt ^m , String, and Data can be written. Here, (t ⁱⁿ , t ⁱⁿ + d
t ⁱⁿ ) indicates the input monitor time (Ts, Te),
(T ^m , t ^m + dt ^m , String, Data) represent a set (Ta, Tb, S, D) of the matching processing time, the condition character string S, and the data D to be presented. Also, I
(x ⁱⁿ , y ⁱⁿ , dx ⁱⁿ , dy ⁱⁿ ) of ninput indicates the display position and size of the window Input on the screen for receiving input. Match's (x ^m , y ^m , dx ^m , d
y ^m ) is a dummy variable and can be any value. The input monitoring time (Ts, Te) and the matching processing time (Ta, Tb) may be the same in the simplest case, but may not be the same unless Tb> Ts. In the above, Inpu
Although t is considered a text window, Input may be an interactive button. However, in this case, since a mouse input is required, a character string for collation must be separately specified. Therefore, this character string is set as Mousestring, and the record of the dialog button Input is changed to Input dx ⁱⁿ , dy ⁱⁿ , dt ⁱⁿ , Mou
Write as sessling. When this button is selected with the mouse, Mo
usage is written in the input memory 13. C. Operation of Each Apparatus Based on the above apparatus configuration and scenario description method, a method of implementing the first invention according to the present embodiment will be described. First, the scenario presentation control unit 16 executes scenario presentation according to the flow shown in FIG. (1) Read a scenario and create a timetable. For example, in the above scenario If-then,
if it was ^{t in <t m <t in} + dt in <t m + dt m, for example, the time table as follows is created.

[0042] ^{Input on t in Match on t m} Input off t in + dt in Match off t m + dt m above on the start of the process, off indicates the end (step 21). (2) The pointer indicating the reference position of the time table to be compared with the current time is set in the first row (Input on) (step 22). (3) A start command is sent to the timer unit 15 to start measurement from time 0 (step 23). (4) The time measured by the timer 15 is read and compared with the time table (step 24). (5) When the current time matches or exceeds the value on the time table indicated by the pointer, the operations (6) to (9) are performed according to the description on the time table. Otherwise, return to (4) (step 25). (6) Input monitor on (Input on in the above example)
In the case of, the record of the corresponding object [in the above example, (Input dx ⁱⁿ , dy ⁱⁿ ,
dt ⁱⁿ )] is issued as an argument (steps 26 and 27). (7) Input monitor off (in the above example, Input of
In the case of (f), the record of the object corresponding to the input monitor unit 12 [(Input dx ⁱⁿ , d ^{in the} above example)
y ⁱⁿ , dt ⁱⁿ )] as an argument (steps 28 and 29). (8) When the matching process is on (Match on in the above example), the condition matching unit 14 sends the matching data [(M
^{atch t m, t m + dt} m, StringDat
a)] is issued as an argument (steps 210 and 211). (9) Collation processing off (Match off in the above example)
Time, the condition evaluation unit 14, the verification data [above example ^{(Match t m, t m +} dt m, StringDa
ta)], and issues a collation end instruction (steps 212 and 213). (10) Move the pointer to the next line (step 21)
4). (11) If there is an unprocessed scenario line, the process returns to (4). Otherwise, the process ends (step 215).

The basic operation of the scenario presentation control unit 16 has been described above. The above scenario does not include the presentation of data or interaction buttons, but if you do,
The steps of starting / ending data presentation and starting / ending dialogue button stop may be added to steps 26 to 213 described above, and a presentation start / end command may be sent to the data presentation control unit 18 at each branch.

On the other hand, the input monitor section 12 receiving the monitor start / end command operates as follows according to the flow shown in FIG. (1) Wait for a start command from the scenario presentation control unit 16 (step 31). (2) When a monitor start command is received, the arguments of the command (eg, Input dx ⁱⁿ , dy ⁱⁿ ,
dt ⁱⁿ ) (step 32). (3) Data presentation control unit 1 using written argument
A command to start presentation of a text window (for example, Input) or an interactive button is sent to 9 and displayed on the screen (step 33). (4) Monitor user input; if not, go to (8); if so, go to (5) (step 34). (5) When an input is made, a corresponding window / interactive button is determined based on the type of the input device, the input position on the screen, and the like with reference to the input table (step 35). (6) If the input is a key input, the input is directly written into the input memory 13 as a collation character string (step 3).
6, 37, 38). (7) If the input is a mouse input to an interactive button, a collation character string previously passed as an argument is written in the input memory 13 (steps 36 and 38). (8) Monitor the monitor end command, and when the command is received,
A presentation end command for erasing the corresponding text window or dialog button is sent to the data presentation controller 18, and the argument information of the corresponding window or dialog button is deleted from the input table, and the process ends. If not, the process returns to (4) (steps 39 and 310).

The condition collating unit 14 receiving the collation start / end commands operates as follows according to the flow shown in FIG. (1) A start command from the scenario presentation control unit 16 is monitored (step 41). (2) When the collation start command is received, the scenario presentation control unit 1 stores the collation table indicating the object currently being collated.
Arguments from 6 (e.g. Match t ^m, t ^m + d
t ^m, String, Data) writes (step 42). (3) The contents of the input memory 13 are read out, and the character string variable I
(Step 43). (4) If I is different from the last time read (5)
If it is the same as the previous time, go to (8) (step 44). (5) The condition character string S (String in the above example) written in the collation table is collated with the collation character string I (step 45). (6) When I and S match, a presentation start command is sent to the data presentation control unit 19 with the identifier D (Data in the above example) of the corresponding data as an argument (step 46). (7) If there is another condition character string in the collation table (5)
Otherwise, go to (8) (step 47). (8) The collation end instruction is monitored, and when the instruction is received, the corresponding argument is deleted from the collation table, and the process ends. Otherwise, return to (3) (steps 48 and 4).
9).

As described above, the process of presenting the scenario corresponding to the if-then sentence has been realized. In the above embodiment, since the input monitor section 12 uses the input table, it is possible to monitor a plurality of inputs at the same time. Thus, for example, a function can be provided in which the same instruction can be performed by either mouse input or key input, and the user can select this freely. Further, since the condition matching unit 14 also uses the matching table, the condition matching process with a plurality of pieces of argument information can be performed in parallel. Thus, an if-then-else statement such as if (Input = String) then show Data else show Anotherdata, or Such a scenario corresponding to a switch-case statement can be easily presented. This example Switchcase DX, DY, DT Input x in, y in, dx in, dy in t in, t ■ in + dt in Match1 x m, y m, dx m, dy m, t m1, t m1 + dt m1, String1 ^{, Data1 Match2 x m, y m} , dx m, dy m, t m2, t m2 + dt m2, String2, Data2 Match3 x m, y m, dx m, dy m, t m3, t m3 + dt m3, String3, Data3 Is represented by such a scenario.

In the above scenario, it is assumed that Input is an object for user mode input, and user modes such as "beginner" and "expert" are written in the input memory 13. Match1, Match2, Matchc
h3 specifies data to be presented first corresponding to each user mode. Thus, for example, when the “beginner mode” is selected first, help for beginners is always presented, so that data presentation adapted to the user level can be realized.

Although a case has been described above where one input is applied to the input memory 12 at a time, a plurality of user inputs can be simultaneously managed. 2. Embodiment of the Second Invention As an example of the configuration of a scenario presenting apparatus that implements the scenario presenting method according to the present invention, the same apparatus configuration as that of FIG. 1 is considered. The description method of the scenario is the same as that described in the first invention. However, in the present invention, the scenario presentation control unit 16 can issue a stop command to stop the clock of the clock unit 15 and store the read time at the current time variable T.
Have c. Further, it issues to the data presentation control unit 18 a presentation interruption instruction for interrupting processing such as presentation of a moving image and a presentation restart instruction for restarting. On the other hand, the input monitor unit 12 sends an input completion notification to the scenario presentation control unit 16 when the user input is written in the input memory 13. The operation of the scenario presentation control unit 16 corresponds to step 25 in the flow shown in FIG.
Are largely different from each other, and operate as follows according to the flow shown in FIG. (1) A scenario is read and a time table is created (step 51). (2) A pointer indicating the reference position of the time table to be compared with the current time is set in the first line of the time table (step 52). (3) A start command is sent to the timer unit 15 to start measurement from time 0 (step 53). (4) The time measured by the timer 15 is read and compared with the time table (step 54). (5) If the current time matches or exceeds the value on the time table indicated by the pointer, the operations (6) to (12) are performed according to the description on the time table. Otherwise, return to (4) (step 55). (6) When the input monitor is on, the timer 15 is stopped by the stop command, and the current time is recorded in the time variable Tc (steps 56, 57, 58). (7) A monitor start command is issued to the input monitor unit 12 using the record of the corresponding object as an argument (step 59). (8) A presentation interruption command is sent to the data presentation control unit 18 (step 510). (9) Wait for an input completion notification from the input monitor unit 12 (step 511). (10) When there is a notification, the timer unit 1 is issued by a time setting instruction.
5 is set to the time Tc at which the clock was interrupted, and the clocking is restarted by a start command (step 512). (11) A presentation restart command is sent to the data presentation control unit 18 (step 513). (12) When the input monitor is off, the input monitor 12
A monitor end command is issued using the record of the corresponding object as an argument (steps 514 and 515). (13) When the collation is on, a collation start command is issued to the condition collation unit 14 using the collation data (Ta, Tb, S, D) of the corresponding object as an argument (steps 516, 5).
17). (14) When the collation is off, a collation end instruction is issued to the condition collation unit 14 using the collation data (Ta, Tb, S, D) of the corresponding object as an argument (steps 518, 5).
19). (15) Move the pointer to the next line (step 52)
0). (16) If there are still unprocessed scenario lines, return to (4). Otherwise, the process ends (step 52).
1).

Of the above, (7) to (11) correspond to the processing accompanying the clock interruption. Input monitor 1 other than the above
2. The operation of the condition matching unit 14 is the same as that of the first invention.
As described above, the scenario presentation can be interrupted while the user input is being monitored, and the scenario presentation can be resumed from the point of interruption after the user input. 3. Embodiment of the Third Invention As a configuration example of a scenario presenting apparatus that implements the scenario presenting method according to the present invention, consider the same apparatus configuration as that of FIG. The description method of the scenario is the same as that described in the first invention. However, in the present invention, a character string Sd which is a default value for the condition character string S is defined.
For example, Sd may be a null code. In this embodiment, write to specify the default string Sd in scenario, for example, in the previous example scenario the If-then, collation processing object Match records ^{Match dx m, dy m, dt} m,, and Data, String The position of the operand to be written is blank. The condition matching unit 14 receiving this from the scenario presentation control unit 16 sets the default value S as the condition character string.
This shall be interpreted as taking d.

In the present invention, the character string for collation of the interactive button Input can be the default character string Sd. In this case, the input record description Input dx ⁱⁿ , dy ⁱⁿ , dt ⁱⁿ , and Mouses
In the string, the matching character string Mousestring is omitted. The input monitor unit 12 receiving this from the scenario presentation control unit 16 interprets it as a collation character string Sd,
If there is an input to Input, the input memory 13 stores Sd
write. If any of the user input character string I and the condition character string S includes the default character string Sd, the condition matching unit 14 unconditionally presents the data D. Thus, the dialog button Input can always present the data D, irrespective of the condition character string S of the condition matching unit 14, similarly to the conventional dialog button.

In the present invention, the condition matching unit 14 operates as follows according to the flow shown in FIG. Of the following, processes (7) to (8) are processes relating to the default character string Sd. (1) Monitor a collation start command from the scenario presentation control unit 16 (step 61). (2) When the collation start command is received, the scenario presentation control unit 1 stores the collation table indicating the object currently being collated.
Write the argument from step 6 (step 62). (3) The contents of the input memory 13 are read out, and the character string variable I
(Step 63). (4) If I is different from the last time read (5)
If it is the same as the previous time, go to (10) (step 64). (5) Match I with the condition character string S written in the matching table (step 65). (6) When I and S match, a presentation start command is sent to the data presentation control unit 19 using the identifier D of the corresponding data as an argument (step 66). (7) If S is Sd, the identifier D of the corresponding data
Is sent as an argument to the presentation control unit 19 (steps 67 and 66). (8) If I is Sd, the identifier D of the corresponding data
Is sent as an argument to the presentation control unit 19 (steps 68 and 66). (9) If there is another condition character string in the collation table (5)
If not, proceed to (10) (Step 6)
9). (10) Monitor the collation end instruction, and if there is an instruction, delete the corresponding argument from the collation table and end the processing.
If not, return to (3) (steps 610 and 61)
1).

Input monitor section 12, scenario presentation control section 1
The operation of No. 4 is the same as that of the first invention. By combining the above operations, if-then-else e
A conditional clause corresponding to 1se (others) can be described and presented in the scenario. Further, fixed dialog buttons used in the conventional method and dialog buttons corresponding to the variable input provided by the present invention can be described and presented in a scenario in exactly the same manner. 4. Fourth Embodiment FIG. 7 shows an example of the configuration of a scenario presentation device that implements a scenario presentation method according to the present invention. The following [1] to [12]
Of the devices, the devices [1] to [5] and [7] to [10] have the same functions as those described in the embodiment of the first invention (FIG. 1). [1] Input receiving unit 71 [2] Input monitoring unit 72 The operation is the same as that described in the first invention. [3] Input Memory 73 [4] Condition Matching Unit 74 The operation is the same as that described in the first invention. [5] Timekeeping unit 75 [6] Scenario presentation control unit 76 Compared with the scenario presentation control unit 16, when there is a description related to an external program in the scenario, the timing specified for the external program execution unit 711 described later It has an additional function of sending an external program execution instruction. [7] Database management unit 77 [8] Data presentation control unit 78 [9] Data recording unit 79 [10] Data presentation unit 710 [11] External program execution unit 711 Receiving an external program execution command from the scenario presentation control unit 76 Then, the external program is read from the external program recording unit 712 described later by using the specified identifier and executed. Here, the condition of the external program that can be started is “each program must return its execution result to the external program execution unit 711 as a character string, or write the execution result character string directly to the input memory 73”. .
When the execution result is returned, the external program execution unit 711
Writes this in the input memory 73. As a result, a matching process based on the execution result of the external program can be realized,
Adaptive data presentation becomes possible. [12] External Program Recording Unit 712 Stores a program that can be started as an external program.

The description method of the scenario is the same as that described in the first invention. However, in the present invention, an external program can be specified in a scenario. For example, an external program External that checks a user's input history
Is, media data, as well as interactive buttons, External dx ^e, dy ^e, written as dt ^e. Here the operand ^{(dx e, dy e, dt} e)
Is a dummy variable and has no specific meaning.

[0054] In a scenario, for example Scenario DX, DY, DT External x e, y e, t e Match1 x m, y m, t m Match2 x m, y m, t m proviso Match1 dx ^{m, dy m,} dt ^m , Good, Allright
^{t Match2 dx m, dy m,} dt m,, written as ^{Toobad (t e <t m)} . Above (x, y) is all operands about a dummy, ^{t e,} t ^m, respectively External, Match1, Match
2, which means the start time. In this scenario, the program External is executed at time t ^e, and the execution results are compared at time t ^m by Match1 and Match2. If the result is Good, the data Allri
ght, and the others indicate data Toobad. In the above scenario, Match2
Uses the default value expression (expression by blank) of the condition character string described in the third invention.

The scenario presentation control unit 76 operates as follows according to the flow shown in FIG. (1) A scenario is read and a time table is created (step 81). (2) A pointer indicating the reference position of the time table to be compared with the current time is set in the first row (step 82). (3) A start command is sent to the timer unit 75 to start measurement from time 0 (step 83). (4) The time measured by the timer 75 is read and compared with the time table (step 84). (5) When the current time matches or exceeds the value on the time table indicated by the pointer, the operations (6) to (9) are performed according to the description on the time table. Otherwise, return to (4) (step 85). (6) When the input monitor is ON, a monitor start command is issued to the input monitor 72 using the record of the corresponding object as an argument (steps 86 and 87). (7) When the input monitor is off, a monitor end command is issued to the input monitor 72 using the record of the corresponding object as an argument (steps 88 and 89). (8) When the collation processing is on, a collation start command is issued to the condition collation unit 74 using the collation data as an argument (step 8).
10, 811). (9) When the collation processing is off, a collation end instruction is issued to the condition collation unit 74 using the collation data as an argument (step 8).
12, 813). (10) When the program activation is on, a program execution instruction is issued with the identifier of the external program corresponding to the external program execution unit 711 as an argument (step 814,
815). (11) Move the pointer to the next line (step 81)
6). (12) If there is an unprocessed scenario line, the process returns to (4).
Otherwise, the process ends (step 817).

By the above operation and the operation of the condition matching unit 74, adaptive data presentation by executing an external program can be realized. In the above description, it is assumed that only one external program is started at one time.
It is easy to extend 11 and execute a plurality of external programs simultaneously. In this case, a plurality of programs may be managed using a table. 5. Fifth Embodiment FIG. 9 shows an example of the configuration of a scenario editing apparatus that performs a scenario editing method according to the present invention. Details of each device are as follows. In the following description, the above-described three-dimensional scenario coordinates (x, y, t) and two-dimensional drawing coordinates (u, v) related to drawing graphics on the screen appear. Hereinafter, unless otherwise specified, the expressions “position” or “size” and “size” are the former (x, y,
t). [1] Input receiving unit 91 (part of input management means) is configured by an input device such as a mouse / keyboard,
The mouse input and the key input are sent to an input conversion unit 92 described later. [2] Input conversion unit 92 (part of input management unit) Receives a mouse input and a key input from the input receiving unit 11, and a scenario editing control unit 93 and a movement control unit 9 described later.
5. Notify the size change control unit 96. Here, the input conversion unit 92 includes a table of commands related to editing, and can convert mouse coordinates and key inputs into commands related to editing and notify them. Also, mouse input (coordinate input, interactive button click information, etc.) can be notified as it is. In the present embodiment, the following are defined as commands related to editing. (1) Start editing scenario Starts editing the specified scenario. (2) Scenario editing end The editing process of the scenario being edited is ended. (3) Object creation A new object is added to the scenario being edited.
Here, "object" refers to media data / interaction button / interaction button as described in the first to fourth embodiments.
Generic term for input monitor object / condition matching object / external program. (4) Object selection A specific object of the scenario being edited is selected as an object to be edited. Actually, a figure on the screen is selected with a mouse or the like. (5) Delete object Deletes the selected object from the scenario. (6) Object position change The relative position information (x, y,
Change t). In practice, this is performed by a movement control unit 95 described later. (7) Object size change Size information (dx, dy, d) of the selected object
Change t). Actually, the size change control unit 9 described later
6 does. (8) Attribute input Attribute information of the selected object (for example, condition string S
Key). [2] Scenario edit control unit 93 (scenario edit control means) The scenario edit processing is performed based on the command sent from the input conversion unit 92 or the mouse coordinates. At the start of editing, scenario data and a record of a related object are read from the database management unit 99 described later, and are recorded in the edited data recording unit 14 described later. Further, the scenario editing control unit 93 creates a graphic table for drawing and displays it in the editing data recording unit 94 in order to display the scenario and each object on the screen as a rectangular parallelepiped.
The figure table has the following format, for example.

[0057] The scenario coordinates are the positions (x, y) of each object in the three-dimensional space (x, y, t) specified by the scenario.
y, t) and size (dx, dy, dt).
The drawing coordinates are, for example, when drawing an object represented by a rectangular parallelepiped on a VRAM based on scenario coordinates.
The coordinates (u ⁱ , v ⁱ ) of each vertex of the rectangular parallelepiped (i = 1,
2. . . ). The scenario editing control unit 93 sends a drawing command to the graphic presentation control unit 98 to be described later, and causes the graphic presentation unit 99 to display the drawing command on the display screen of the graphic presentation unit 99 to be described later based on the drawing coordinates on the graphic table. On the other hand, the input conversion unit 92
When an instruction to move the object or change the object size is received from the controller, the movement control unit 95 and the size change control unit 96 are activated to perform editing. [3] Edited Data Recorder 94 (Edited Data Recorder) Records scenario data being edited, records of each object described in the scenario, and a graphic table for storing their graphic drawing information. They are,
It is constantly updated by the scenario editing control unit 93, the movement control unit 95, and the size change control unit 96. [4] Movement Control Unit 95 (Movement Control Means) Receives the graphic table information of the object to be moved from the scenario editing control unit 93, monitors the mouse coordinate input (u, v) from the input conversion unit 92, and displays The drawing coordinates of the graphic table information and the corresponding scenario coordinates (x, y, t) are updated so that the corresponding three-dimensional figure moves on the screen in accordance therewith, and written to the edit data recording unit 94. The magnitude of the movement amount may be determined by, for example, using a change in mouse coordinates while the mouse button is being pressed as the movement amount, as is performed by conventional drawing software. [5] Size change control unit 96 (size change control means) Receives the graphic table information of the object whose size is to be changed from the scenario edit control unit 93 and monitors the mouse coordinate input (u, v) from the input conversion unit 92. Then, the drawing coordinates of the figure table information and the corresponding scenario coordinates (x, y, t) are updated so that the corresponding three-dimensional figure on the screen changes its size accordingly, and Write. The size can be changed by, for example, clicking a vertex of a display rectangular parallelepiped with a mouse, and then dragging (pulling) this vertex while holding down a mouse button, as is performed in conventional drawing software. . [6] Database management unit 97 (database management unit) Records individual scenario data, media data, and attribute information of dialog buttons. [7] Graphic presentation control section 98 (part of graphic presentation means) The VRAM is provided with a VRAM. Graphic presentation unit 9 to be drawn and described later
9 on the display screen. [8] Graphic presenting unit 99 (part of graphic presenting means) A CRT display is provided to display the rendered graphic data. Also, an edit menu for the user is displayed.

The scenario editing control unit 93 is shown in FIGS.
According to the flow shown in FIG. In addition,
Each command sent from the input conversion unit 92 is presented on a screen in advance, and the user can select the command in a free order. (1) Wait for a user input via the input conversion unit 92 (step 101). (2) In the case of a scenario edit start command, the corresponding scenario data and object record are read from the database management unit 97 and written to the edit data recording unit 94. Further, a figure table is created, and each figure is displayed on the figure presentation control section 98 (steps 102 and 103). (3) In the case of a scenario editing end command, the contents of the editing data recording unit 94 are written into the database management unit 97, and the editing process ends (steps 104 and 105). (4) In the case of an object generation command, a new object record and graphic table information are written in the edit data recording unit 94, and the graphic corresponding to the graphic presentation control unit 98 is displayed (steps 106 and 107). Here, a default value is defined and used for the size (dx @ new, dy ^new , dt ^new ) of the figure. (5) In the case of the object selection command, the coordinate values (u, v) on the screen at the time of the next mouse click are monitored (steps 108, 109). Here, for example, it is assumed that the user clicks a vertex or a side of a graphic to be selected on the screen. (6) The coordinate input when the mouse is clicked is compared with the graphic table, and the identifier of the selected object is set in the variable Curr.
ent (step 1010). (7) In the case of the object deletion command, the object record having the identifier stored in the Current and the graphic table information are deleted from the edit data recording unit 94. Along with this, a delete command is sent to the graphic presentation control unit 98 to delete the corresponding graphic on the screen (steps 1011 and 1012). (8) In the case of an object movement command, the movement control unit 95 is started with the identifier stored in Current as an argument (steps 1013 and 1014). (9) In the case of an object size change instruction, Curre
The size change control unit 96 is started using the identifier stored in the nt as an argument (steps 1015 and 101).
6). (10) In the case of an attribute input command, an object record having an identifier stored in Current is read from the edited data recording unit 94 (steps 1017 and 101)
8). (11) When the object is an input monitor object corresponding to a mouse, the user is caused to input a collation character string via the input conversion unit 93 (steps 1019 and 1010).
20). (12) When the object is a collation processing object,
The user inputs the condition collation character string S and the presentation data D via the input conversion unit 93 (steps 1021 and 1010).
22). (13) The record in which the attribute is written is recorded in the database management unit 97 (step 1023).

As described above, the graphic editing method performed only for the conventional media data and the interactive button corresponding to the fixed input is changed to the input monitor object,
It can be extended to a scenario including a collation processing object and an external program. In the case of an input monitor object, the position (x, y) and size (dx, dy,
dt) indicates the presentation position and size of the window or the interactive button. The position t and the size dt on the time axis represent the input monitor start time and the input monitor time, respectively.
In the case of the collation processing object, the position (x,
y), size (dx, dy) has no positive meaning,
Any value may be used, but it is desirable that it is easy to see on the editing screen. The position t and the size dt on the time axis represent the collation processing start time and the collation processing time, respectively. In the case of an external program, the position (x, y) and size (dx, d) on the screen
Although y) does not have a strict meaning, it is easy to understand, for example, where the window appears during execution of the program. Also, since the end of the program cannot be controlled from the scenario, the size dt has no strict meaning on the time axis. You can also edit the size with roughly a guide as to how many seconds it will take. The only thing that must be strictly edited is the execution start time t.

As described above, in addition to the presentation of data and interactive buttons, it is possible to easily edit a scenario including conditional clauses such as if-then and starting an external program using the same graphic interface as the conventional scenario. 6. Sixth Embodiment An example of the configuration of a scenario editing apparatus that performs a scenario editing method according to the present invention is the same as that of the fifth embodiment. However, the input conversion unit 92 newly sends a grouping start / end command and a grouping release command to the scenario editing control unit 93. In order to easily edit the if-then statement and the switch-case statement that are semantically grouped, the input monitor object and the collation processing object that are related to each other are grouped and displayed on the screen as a single graphic unit. This implements the editing function. This graphic is called a group graphic. With the creation of the group graphic, the scenario editing control unit 93 creates the following group record.

Group dx, dy, dt, an array of grouped object identifiers Group is a group identifier. (Dx, dy) is a variable only for determining the size of the group figure and has no positive meaning. On the other hand, dt is the overlap length when the grouped figures are arranged in time, and it is assumed that this cannot be changed without permission in editing the group figures. The significance of the group graphic editing is that the start time of the entire grouped processing can be determined collectively, and the change of the start time does not have to be repeated for each object. Also,
Since the relative arrangement of the grouped figures cannot be changed in editing the group figures, unnecessary erroneous editing can be prevented.

The scenario editing control unit 93 performs the operation described in FIGS. 10 and 11 of the fifth invention and, when receiving the grouping start command, according to the flow shown in FIG. Operate. (1) Create a group record on the edited data recording unit 94 (step 111). (2) The mouse coordinates (u, v) at the time of mouse click are received, and the figure on the screen selected by the click is determined with reference to the figure table on the edit data recording unit 94 (step 112). (3) If the selected graphic is an input monitor graphic or a collation processed graphic, the corresponding identifier on the graphic table is written in the group record. Otherwise, return to (2) (steps 113, 114, 115). (4) Monitor the grouping end instruction, and upon receiving the instruction, proceed to (5). Otherwise, return to (2) (step 116). (5) The information of the grouped figures is deleted from the figure table, and a command is sent to the figure presentation control unit 98 to delete the corresponding figure on the screen. However, the time size information and the position information are left for the creation of the group graphic (step 1).
17). (6) Create a group graphic and send an instruction to the graphic presentation control unit 98 to display it on the screen (step 118). (7) Edit data recording unit 94 for canceling grouping
Backup the scenario (Step 11
9). (8) The records of the grouped objects are deleted from the scenario, and a group record is added (step 1110). (9) The group record and the scenario are recorded in the database management unit 97 (step 1110).

On the other hand, in response to the grouping release instruction, the scenario editing control unit 93 operates as follows according to the flow shown in FIG. (1) A group record and a scenario are read out on the edited data recording unit 94 and displayed on the screen (step 111).
2). (2) Read backup scenario (step 11)
13). (3) The position on the t-axis in the scenario of the current group graphic is compared with the position on the t-axis of each object in the backup scenario, and the position coordinates of the objects in the backup scenario are updated with the offset ( Step 1114). (4) The group graphic is deleted from the screen, and the information of the group graphic is deleted from the graphic table (step 111).
5). (5) The drawing information of each object in the backup scenario is written in the graphic table and displayed on the screen (step 1116). (6) The backup scenario is copied to the current scenario on the edited data recording unit 94 and recorded in the database management unit 97 as a regular scenario (step 1117).

The objects grouped as described above are displayed again on the screen, and can be individually edited. When presenting a scenario in which a group record is written, the backup scenario is read, and offset correction on the time axis as in step 1114 may be performed.

By the above grouping, a semantically united if-then statement, switch-case
The input monitor object and the collation processing object representing a sentence are expressed as one group graphic, and editing can be performed more easily. In addition, it is possible to prevent a problem that any of the input monitor object and the collation processing object related to each other is mistakenly deleted or changed. The grouping method according to the present invention is not limited to the input monitor object and the collation processing object, and can be applied to grouping of any type of object. 7. Seventh Embodiment An example of the configuration of a scenario editing apparatus that performs a scenario editing method according to the present invention is the same as that of the fifth invention. However, the input conversion unit 92 sends a new time default value setting command to the scenario editing control unit 93. This is to force the size of the object being edited in the time direction to the default value t ^def , and t ^def is set when the time size is desired to be virtually unlimited. Here, for simplicity, t ^def = 0. Scenario editing controller 9 when receiving a time default value setting command
3 operates as follows according to the flow shown in FIG. (1) Variable Current indicating the object being edited
, The corresponding data is read from the graphic table on the edit data recording unit 94 (step 121). (2) The default value t ^def is substituted for the size dt in the time direction (step 122). (3) The corresponding drawing coordinates (u ⁱ ,
v ⁱ ) (i = 1, 2,...) is recalculated and updated (step 123). (4) Write the updated drawing data to the edit data recording unit 94 (step 124). (5) An instruction is sent to the graphic presentation control unit 98 and displayed on the screen (step 125).

Thus, the setting is completed. Windows / that have very long display times or do not want to limit the display time
By expressing the interactive button / input monitor object / collation processing object in a two-dimensional figure using the above-described default value setting instruction, the editing interface becomes easy to see and the operation can be further simplified.

When the scenario edited according to the present invention is presented by the scenario presenting method according to the first aspect of the present invention, the scenario presentation control unit 14 gives the operation corresponding to the time default value t ^def a time length = 0. For the object of, the presentation end time is not written when the time table is created. Thus, the scenario presentation created by the present invention can be easily presented by the first invention. The scenario in which the data is presented at the presentation time interval = 0 does not actually make sense, and there is no problem even if this is interpreted as unlimited presentation time. The effectiveness of the present invention is clear in the above aspects.

In this embodiment, the first to third aspects of the present invention are described.
The invention of FIG. 1 has been described with the apparatus configuration of FIG. 1, the fourth invention has been described with the apparatus configuration of FIG. 6, and the fifth to seventh inventions have been described with the apparatus configuration of FIG. It is also possible to adopt an apparatus configuration that simultaneously implements the inventions of the seventh to seventh aspects. Therefore, the first to seventh inventions can be freely combined. On the other hand, the description format of the scenario is the same from the first invention to the seventh embodiment, but the scenario is not always the position (x , Y) and size (dx, dy) may not be included. In the fifth to seventh embodiments of the present invention, the scenario is represented by a rectangular parallelepiped. However, an icon representing the type or attribute of each object may be added to the scenario. Alternatively, the type or attribute may be identified by a change in color or shape. Further, a multi-window type interface may be provided in which a front view, a side view, and the like of each figure are simultaneously displayed by a plurality of windows on a display screen, and are edited with a mouse or the like.

All of the above variations are included in the present invention.

[0070]

According to the first invention, in the presentation of a scenario based on time, an if-then statement, a switch-
Scenario presentation including a conditional clause corresponding to a case sentence can be realized. As a result, data can be adaptively presented to a user's question or answer using CAI software or the like. In addition, a function is realized in which, for example, when a user inputs a searched English word while learning an English conversation teaching material using a video / text, a matching processing object corresponding to the input is activated and a corresponding dictionary is presented. it can. Also,
For example, a selection menu such as "beginner" or "expert" is provided to the user, and a user mode is set by selecting the menu. For example, when the user mode is a beginner, data of help is sequentially presented. Function can be realized.

According to the second aspect of the present invention, the time-based scenario presentation is temporarily interrupted to accept user input, and after the input is completed, the data presentation is resumed from the point at which it was interrupted. Can be presented. As a result, it is possible to prevent a problem related to the restriction of the input monitor time, such as the end of the input mode time while the input is time-consuming due to re-input of the key. Further, it is possible to provide a function of temporarily suspending the presentation of a moving image, inputting a relevant data name or the like by a user through a key, and presenting the related data in parallel after restarting the presentation of the moving image.

According to the third invention, in the scenario presentation based on time, a function of accepting a variable user input such as a key input and always presenting the same data (default data) except for a specific input can be realized. Further, it is possible to simultaneously present a fixed user input interactive button used in the conventional method and an interactive button corresponding to a variable user input. Also, it is possible to cope with the presentation of a scenario that does not require any conditional clause.

According to the fourth invention, it is possible to realize a function of activating an external program at a timing designated in a scenario, receiving an execution result, and presenting corresponding data when the execution result satisfies a certain condition. In this way, a program for examining the history of the user's input is started with CIA software or the like, and the next teaching material to be presented is determined according to the result, or a problem answering process requiring complicated input or special calculation is performed by an external program. Functions such as describing and incorporating in a scenario can be realized.

According to the fifth invention, in addition to simple presentation of data and interactive buttons, if-then, switch-c
Scenarios including conditional clauses such as "ase" and starting of an external program can be easily edited with the same graphic interface as the conventional scenario.

According to the sixth invention, an input monitor object and a collation processing object representing a semantically united if-then statement and a switch-case statement are
It can be expressed as one group figure, and in particular, the start time of the entire process can be easily set. Further, it is possible to prevent erroneous editing in which one of the input monitor object and the collation processing object related to each other is deleted or changed by mistake.

According to the seventh aspect of the present invention, the editing interface can be realized by expressing a window / interactive button / input monitor object / collation processing object or the like having a very long display time or not wishing to limit the display time in a two-dimensional figure. It is easy to see and the operation can be made easier.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a scenario presentation device that implements a data presentation method according to a first invention.

FIG. 2 is a flowchart showing an operation of a data presentation control unit 16 of FIG.

FIG. 3 is a flowchart illustrating an operation of the input monitor unit 12 of FIG. 1;

FIG. 4 is a flowchart illustrating an operation of a condition matching unit 14 of FIG. 1;

FIG. 5 is a flowchart showing an operation of a scenario presentation control unit 16 when implementing the scenario presentation method according to the second invention.

FIG. 6 is a flowchart showing the operation of a condition matching unit 14 when implementing the scenario presentation method according to the third invention.

FIG. 7 is a block diagram showing a configuration example of a scenario presenting apparatus that implements a scenario presenting method according to a fourth invention.

8 is a flowchart showing the operation of the scenario presentation control unit 76 of FIG.

FIG. 9 is a block diagram illustrating a configuration example of a scenario editing apparatus that performs a scenario editing method according to a fifth invention.

10 is a flowchart showing the operation of the scenario editing control unit 93 of FIG.

11 is a flowchart showing the operation of the scenario editing control unit 93 of FIG.

FIG. 12 is a flowchart showing an operation of a scenario editing control unit 93 when executing a scenario editing method according to a sixth invention.

FIG. 13 is a flowchart showing the operation of the scenario editing control unit 93 when performing the scenario editing method according to the sixth invention.

FIG. 14 is a flowchart showing the operation of the scenario editing control unit 93 when the scenario editing method according to the seventh invention is performed.

FIG. 15 is a diagram showing a graphic scenario editing interface screen.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 Input reception part 12 Input monitoring part 13 Input memory 14 Condition collation part 15 Clocking part 16 Scenario presentation control part 17 Database management part 18 Data presentation control part 19 Data recording part 110 Data presentation part 71 Input reception part 72 Input monitoring part 73 Input Memory 74 Condition matching unit 75 Clock unit 76 Scenario presentation control unit 77 Database management unit 78 Data presentation control unit 79 Data recording unit 710 Data presentation unit 711 External program execution unit 712 External program recording unit 91 Input reception unit 92 Input conversion unit 93 Scenario Edit control unit 94 Edit data recording unit 95 Move control unit 96 Size change control unit 97 Database management unit 98 Graphic presentation control unit 99 Graphic presentation unit

Continuation of front page (56) References JP-A-1-233489 (JP, A) JP-A-3-9393 (JP, A) JP-A-3-41573 (JP, A) Tanaka, Harada, Ogawa “Multimedia Harada, Ogawa "Scenario Control Method in Authoring System" Video Book "," Proceedings of the 43rd National Convention of IPSJ Vol.3 (1991-9-24) PP.3-363 to 3-364. Ogawa, Harada, “Multimedia, Processor Concept-Level Scenario Creation Support Environment”, “Information Processing Society of Japan, Vol. 91, No. 65 (DBS-84-17) (1991-7-18), pp. 135-140. Data model for authoring scenario and authoring environment "IEICE Technical Report, Vol. 91, No. 30 (DE 91-3) (1991) PP. 17-24.

Claims (7)

(57) [Claims] 1. A scenario presentation method for presenting multimedia data based on a scenario including timing designation such as start / end of presentation of multimedia data, wherein a time at which a user input is monitored and a time at which the user input is ended are determined. The input monitor time (Ts, Te) shown is described in the scenario, and the input of the user is monitored from time Ts to Te, and when there is an input, the input is generated in response to the user input or the user input. The character string is written to the input memory as a collation character string, and the collation processing time (Ta, T) indicating the time at which the collation processing of the collation character string written in the input memory starts and ends.
b), the condition string S to be compared in the matching process,
And a set of data D to be presented (Ta, Tb,
S, D) are described in the scenario, and from time Ta to T
A scenario presentation method characterized by collating a collation character string with a condition character string up to b, and presenting the data D immediately if they match. 2. A clock for measuring the passage of time is stopped at a user input monitor start time Ts, and when the input memory is updated by a user input, the clock is restarted from the time Ts. Scenario presentation method. 3. A default character string Sd is defined for a collation character string and a condition character string, and when either the collation character string or the condition character string is Sd, the data D is unconditionally presented. 2. The scenario presentation method according to claim 1, wherein: 4. An external program identifier and an activation time Tp for activating the external program are described in a scenario, the external program is activated at a time Tp, and the execution result is written to an input memory. The scenario presentation method according to claim 1. 5. The size of a display screen (DX, DY)
And a three-dimensional reference solid (DX, DY, D) representing a time interval DT from the start to the end of data presentation by the scenario.
T) is displayed graphically, and one vertex of the reference solid is (x, y, t)
A media solid (dx1, dy1, dt1) representing the window size (dx1, dy1) for presenting the media data and a time interval dt1 from the start to the end of the display of the window as the origin of the coordinates is arranged inside the reference solid. This is a scenario editing method for editing presentation position information, presentation timing information, etc. of media data on the screen by editing the figure, and displaying a key input window or an interactive button on the screen. The process of accepting a user input and writing an input character string or an internally converted character string to an input memory is (x,
y) An input monitor solid (dx2, dy2, dt2) where the size (dx2, dy2) on the plane is the size of the window or dialog button, and the size dt2 in the t-axis direction is the input monitor time (Ts, Te). This input monitor solid is placed inside the reference solid and displayed as a graphic, and the comparison character string in the input memory is compared with the condition character string S.
If they match, the data set (Ta, Tb, S,
The process of presenting the data D defined by D) is represented by t
It is expressed by a collation solid (dx3, dy3, dt3) whose axial size dt3 is the collation processing time (Ta, Tb), and the collation solid is arranged inside the reference solid and displayed graphically. The processing to be executed as an external program is expressed by an external program solid (dx4, dy4, dt4), and the external program solid is arranged inside the reference solid and displayed as a graphic. A scenario editing method characterized by deleting, changing the arrangement in a reference solid, and changing the size of a solid. 6. An input monitor solid and a matching solid displayed on the screen are selected, and the selected solid group is erased from the screen.
6. The scenario editing method according to claim 5, wherein a group solid representing these solids collectively is graphically displayed, and the arrangement of the displayed group solid in the reference solid is changed. 7. When the size of the solid displayed on the screen in the t-axis direction is sufficiently large and the presentation time can be regarded as unlimited, the size in the t-axis direction is set to 0 and displayed on the screen as a two-dimensional rectangle. The scenario editing method according to claim 5, wherein the scenario editing is performed.