JP2565049B2 - Dynamic scenario presentation method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of presenting multimedia data based on timing designation such as start / end of presentation of multimedia data.

[0002]

2. Description of the Related Art In the fields of electronic publishing, CAI, and presentation, when multimedia information such as text, voice, still images, and moving images is presented on a display screen, it is presented at which position on the screen and at what timing. , It is necessary to describe whether to delete (hereinafter referred to as a scenario) and present the data according to the scenario.
As a method of realizing this, a method of creating a timetable from a file in which a presentation sequence is described and sequentially presenting data is described in (1) Japanese Patent Application Laid-Open No. 01-233489, "Data presenting method and its apparatus". There is. In addition, this method is expanded to describe the presentation timing of the interactive button that interactively presents the data in the scenario, and presents the linked data when there is an input from the user while presenting the interactive button. There is a way to do it. This method
(2) It is described in Japanese Patent Application No. 01-144901 "Data editing / presentation method and apparatus". Furthermore, there is a method of expanding these and adaptively determining data to be presented next by user input. In this method, the input from the user is recorded in the input memory, the contents of the input memory are compared with the conditional statements previously described in the scenario, and if the conditions are met, the specified data is presented. is there. This method is described in (3) Japanese Patent Application No. 03-212162, "Scenario presentation / editing method". Hereinafter, (3) “scenario presentation / editing method” is referred to as method 1.

[0003]

First, as a problem of Method 1, when it is desired to directly specify the data to be presented next by the user input, an option for directly describing the data to which the interactive button is linked in the scenario is selected. If the number is increased, it is necessary to describe a large number of interactive buttons in the scenario, and there is a problem that the description becomes complicated. There is also a problem that the external program that determines the data to be presented next is called and the data shown as a result of executing the external program cannot be presented.

An object of the present invention is to provide a dynamic scenario presentation method that solves such a problem.

[0005]

According to a first aspect of the present invention, there is provided a dynamic scenario presentation method for presenting multimedia data based on a scenario including timing specification such as start / end of presentation of multimedia data. Describe the input monitor start time for starting the monitor, the input monitor end time for ending the monitor, and the identifier indicating that the input result is written to the target memory in advance in the scenario,
When the input of the user is monitored from the input monitor start time to the input monitor end time and there is an input,
It is characterized in that the input data name or scenario name is written in the target memory, and data corresponding to the data name or scenario name described in the target memory is presented at the timing specified in the scenario.

According to a second aspect of the present invention, in the dynamic scenario presentation method of the first aspect, the identifier of the external program and the program start time for starting the external program are described in the scenario in advance, and the program is started at the program start time. The feature is that the data name or the scenario name which is the execution result of the program is written in the target memory.

A third invention is the dynamic scenario presenting method of the first invention, when there is no user input from the input monitor start time to the input monitor end time, or the data name or scenario name written in the target memory. If is not correct, the data name or scenario name previously described in the scenario is written to the target memory.

[0008]

In the scenario targeted by the present invention, the timing of starting / ending the presentation of each data or interactive button can be specifically specified.

According to the first aspect of the present invention, the presented data name is not directly described in the scenario, and the presented data name or the identifier representing the target memory for storing the scenario name (hereinafter collectively referred to as the target name) is used as the scenario. Describe,
By writing the target name in the target memory by user input, the data or scenario to be presented next can be determined directly by user input.

In the first invention, the target name is described in the target memory and the target memory means for referencing the memory, the input monitor means for monitoring the user's input, the input monitor means and the target memory means based on the time information are provided. A scenario presentation control means to be activated, a clock means for providing time to the scenario presentation control unit, and a data presentation means for controlling presentation of data and button icons are prepared. Further, as auxiliary means, a database management means for recording scenario, data, attribute information of the interactive button, a data recording means for recording the data body, etc. are prepared.

The scenario presentation control means determines the start / end of the data presentation, the start / end of the input monitor, and the writing / reading timing to / from the target memory based on the scenario and time information. Send the end command.

The scenario presentation control means issues a target name monitor start command to the input monitor means. Upon receiving the command, the input monitor means causes the data presenting means to present a window for input or a menu button whose data name can be selected with the mouse, and monitors the input from the input device. If there is an input, in the case of key input, the input itself is written to the target memory. In case of mouse input Write the target name corresponding to the selected item in the menu button to the target memory. On the other hand, when the target memory means receives the target memory read command of the scenario presentation control means, it reads the target name and sends it back to the scenario presentation control means. The scenario presentation control means reads the attribute information of the data from the database management means and causes the data presentation means to present the data. Alternatively, the specified scenario is read out and the data presenting means is caused to present a new scenario.

According to the first aspect of the present invention, since the start / end of processing is designated in the same manner as the presentation of data or interactive buttons, the consistency with the conventional scenario presenting method is good. Further, by presenting the data or the scenario indicated by the target memory, it is possible to dynamically change the data to be presented next with one dialogue window, and the scenario can be easily written.

A second aspect of the present invention realizes a function of presenting data according to an execution result of a program by starting an external program from a scenario and writing the execution result in a target memory. This is realized by describing the time when the external program is activated in the scenario, the scenario presentation control means activating the external program according to this timing, and storing the target name which is the execution result in the target memory means.

In the second invention, in addition to the means described in the first invention, a program starting means for executing an external program and a program recording means for storing the external program are prepared. The scenario presenting means sends an execution command to the program executing means based on the time information from the clock means. Upon receiving the execution instruction, the program execution means reads and executes the external program. The external program execution means is
Receives the target name that is the execution result and writes it in the target memory. After that, by presenting the data or the scenario indicated by the target memory, the data can be presented according to the result of the external program. This makes it possible to perform, for example, a keyword search of data or a scenario, create a program or the like for determining the searched data name by an external program, and incorporate this program into the scenario.

According to a third aspect of the present invention, if there is no input from the user between the input monitor start time and the end time in the user input, or if the target name input by the user is incorrect, a scenario is described in advance. It realizes a function of presenting certain data (conventional fixed dialogue button function). This is because in the first invention, when an error such as no data name (or scenario name) is returned when the data name from the target memory means is read out from the database management means and the attribute information of the data is returned, The data name (scenario name) described in the scenario will be presented. Thereby, the dynamic scenario presentation by the user input and the conventional fixed interactive button can be realized at the same time.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

First Embodiment of the Invention A Description of Device Configuration FIG. 1 shows the configuration of a scenario presentation device for implementing a scenario presentation method according to the first invention. This dynamic scenario presenting device is composed of an input device such as a mouse / keyboard and its control unit, monitors a user input, and writes an input result to a target memory 12 described later when an input is made, and an input monitor management unit 11 and , A data name that specifies the target is stored, and the target memory 12 has three clocks that can be accessed for writing, reading, and clearing, and an internal clock. The clock is an instruction of the scenario presentation control unit. Accordingly, the current time is notified, and the clock management unit is sent three commands to set the time, start, and read the time, and the scenario is read from the database management unit 16 described later, and each data is presented. According to the start / end time, input monitor start / end time, and target memory read start / end time. A timetable is created by using the timetable, and the process specified at the time described in the timetable is performed while monitoring the time information from the clock management unit 13. On the other hand, the data start / end process is performed by the data presenting unit 15 described later. The input monitor management unit 11 performs input monitor start / end processing, and the target memory read processing sends scenario start / end commands to the target memory 12 for execution. Upon receiving the notification, the designated media data and the dialogue button are presented / erased, each media data and the display data of the dialogue button are recorded in the data recording unit 17 described later, and the corresponding data is read from the data recording unit 17, Display on CRT display, frame buffer for video, amplifier for audio output, etc. A data presentation section, a database management section 16 for recording scenario information for managing the presentation start / end event information of each media data, media data, and attribute information of dialogue buttons, and for displaying each multimedia data and button icon The data recording unit 17 stores graphic data.

The scenario used in this embodiment is It is described as. Here, Scenerio na
me is a scenario identifier, and DX, DY, and DT are
The size (DX, DY) of the display screen on which this scenario is presented and the time DT until all the presentation data in the scenario are finished are shown. Object name indicates the identifier of each media data, dialogue button, etc. presented in the scenario, and (x, y) indicates each media /
The relative presentation position of the button, t represents the presentation start time (for example, the relative time when the scenario presentation start time is T = 0). On the other hand, the attribute information of each medium is recorded in the database as follows.

Object name dx, dy, d
t, it is assumed to be described in the form of a sequence of information depending on each object. This description format is called a record. Here, (dx, dy) is the screen presentation size of this object, and dt is the presentation time.

B Description of Scenario Description Method In the present invention, the objects to be described in the scenario are processing objects for writing user input to the target memory 12 and target memory 12 in addition to normal media data and interactive buttons. An object that reads the data name described in is included.
For example, an object Target_ that represents the former process
in, an object representing the latter Target_show
think of. Target_in displays a text window Target_in on the screen, receives a user's key input from this window, and writes it in the target memory 12 as it is. In the case of mouse input, a data name is acquired from the database management unit 16, a menu button containing all data names is created, and when the data name of the menu button is selected with the mouse, the data name is written in the target memory 12. . Also, Target
_Show presents the object described in the target memory 12. Using this, a scenario implementing the invention can be described as follows.

Input_jump Target_in x _in , y _in , t _in Target_show x x _s , y _s , t _s However, Target_in dx _in , dy _in , d
t _in Target_show dx _s , dy _s , dt _s .

Here, in Target_in, (x _in , y
_in ) is the presentation position of the window that accepts input, (dx
_in, dy in) the size of the window, t _in the input monitor start time, dt _in represents the monitor time. Also, T
of arget_show (x _s, y _s) is presented the position of the target data _{(dx s, dy s, dt} s) may be any value in the dummy variable (but dt _s> 0).

Further, these Target_in, Ta
Object Target that is a collection of rget_show
Considering t_in_show, input_jump2 Target_in_show x _is , y _is , t _is . However, Target_in_show dx
_is , dy _is , and dt _is . Where Target_i
In (n_show), (x _is , y _is , dx _is , dy _is ) indicates the position and size of the window, and (t _is , t _is + dt _is ) indicates the input monitor start time / end time. This Target
If the object of t_in_show is used, the target memory 1 is immediately output when the input from the user is completed.
The data shown in 2 can be presented.

On the other hand, the format of the data name (scenario name) described in the target memory 12 is as follows.

Targetname. Mediatype Targetname represents the data name itself, and M
The edittype identifies the type of data medium or the scenario. The data name written in this format will be called the target name.

Operation of Device C Assuming the device having the above configuration and the scenario description method,
A method for carrying out the first invention according to this embodiment will be described.
FIG. 2 is a flowchart showing the operation of the scenario presentation control unit 14 for executing the scenario presentation.

First, the above-mentioned scenario input_jum
The flow in p will be described. (1) Read a scenario and create a timetable. For example, in the above scenario Input_jump, if a _{t in <t in + dt in} <t s, to create a time table as follows.

Target_in ON t _in Target_in OFF t _in + dt _in Target_show ON t _{s In the} above, ON represents presentation start and OFF represents presentation end (step 21). (2) It is set in the first row (Target_in) of the pointer indicating the reference position of the time table to be compared with the current position (step 22). (3) A start command is sent to the clock management unit 13 to start measurement from time 0 (step 23). (4) The time measured by the clock management unit 13 is read and compared with the time table (step 24). (5) When the current time matches or exceeds the value on the timetable indicated by the pointer, the following operations (6) to (8) and (13) are performed according to the description on the timetable. Yes, otherwise return to (4) (Step 2
5). (6) Input monitor on (Target_in in the above
When it is ON, the corresponding object record [in the above example, (Target_in
dx _in , dy _in , dt _in )] as an argument to issue a monitor start command (steps 26 and 27). (7) Input monitor off (Target_in in the above
When it is OFF, the corresponding input object record [(Target_in
dx _in , dy _in , dt _in )] as an argument, and a monitor end command is issued (steps 28 and 29). (8) Target memory read on (in the above, Tar
target memory 1 when get_show ON)
A target name call command is issued to 2 to acquire the data name or scenario name written in the target memory (steps 210 and 211). Then the next (9)-
The operation of (12) is performed. (9) The target name (data name or scenario name) is received from the target memory 12, the media type is checked from the target name, and if it is a scenario, the scenario information is acquired from the database management unit 16 and a new timetable is created. Then, return to (2) (step 21)
2, 213, 217). If it is not a scenario,
The operations 0) to (12) are performed. (10) An object record acquisition command is issued to the database management unit 16 to acquire the attribute information of the target medium (step 214). (11) The object record sent from the database management unit 16 is added to the timetable and the timetable is updated (step 215). The timetable updated at this time is as follows.

Target_in ON t _in Target_in OFF t _in + dt _in Target_show ON t _s Object_txt OFF t _s + dt _x where Object_txt is an example of the object specified in the target memory and its form is Object.
t_txt dx _x , dy _x , dt _x , a list of object-dependent information. (12) A target data presentation command is sent to the data presentation unit 15 as an object record [in the above example, (Obje
ct_txt dx _x , dy _x , dt _x )] as an argument (step 216). (13) Presentation off of the data specified in the target memory (Target_in the scenario input_jump)
At the time of show OFF), the presentation end command is issued using the presentation data as an argument (steps 218 and 219). (14) Move the pointer to the next line (step 22)
0). (15) If there is an unprocessed scenario line, return to (4).
Otherwise, the process ends (step 220).

The above is the basic operation of the scenario presentation control unit 14. In this scenario, the data and the interactive button are not included. However, in order to deal with the case where they are included, the data presentation start / end and the interactive button presentation start / end branches are added to the above steps 26 to 218, respectively. The presentation start / end command may be sent to the data presentation unit 15 in a branch.

[0032] In addition, the time table is in input_show2 is described as _{Target_in_show ON t is Target_in_show OFF dt is} . As a flow, the processes of (6) and (8) are performed at the same time. That is, after issuing the input monitor start instruction in (6), the target name call instruction in (8) is issued, and the operations in (9) to (11) are performed.

On the other hand, FIG. 3 is a flow chart showing the operation of the input monitor management unit 11 which receives a monitor start / end command. (1) Wait for a start command from the scenario presentation control unit 14 (step 31). (2) When the monitor start command is received, the argument of the command is written in the input table showing the text window and the interactive button currently being monitored (step 32). (3) In the case of mouse input, a target name that can be specified is acquired from the database management unit 16, a menu table is created, and a menu button creation command is sent to the data presentation unit 15. In the case of key input, the data presenting unit 15 is made to create a text window by using the written argument (steps 33, 34, 35, 36). (4) The user input is monitored, and if not, go to (8), and if there is, go to (5) (step 37). (5) If there is an input, the input table and the menu table are referred to, and the corresponding window / menu button is determined from the type of input device, the input position on the screen, etc. (step 38). (6) If the input is a key input, the input is directly written in the target memory (steps 39 and 310). (7) In the case of mouse input, the selected target name is written in the target memory (steps 39 and 311). (8) If the monitor end command is monitored and received,
A presentation end command for erasing the corresponding text window and menu button is sent to the data presentation unit 15, the argument information such as the corresponding window is deleted from the input table, and the process ends. Otherwise, return to (4) (step 31)
2, 313).

As described above, the scenario presentation process of the first invention can be realized. In this embodiment, the input monitor management unit 1
In 2, the input table is used, so that it is possible to monitor a plurality of inputs at the same time. This makes it possible to provide a function of allowing the user to freely select the input method, for example, by allowing the same instruction to be made by either mouse input or key input.

Embodiment of the Second Invention A Description of Device Configuration FIG. 4 shows the configuration of a scenario presentation device for implementing the scenario presentation method according to the second invention. This scenario presenting apparatus is composed of an input device such as a mouse / keyboard and its control unit, monitors a user input, and writes an input result to a target memory 12 described later when an input is made, and an input monitor management unit 41 and a target. A target memory 42 that stores a data name that specifies the target memory, and can access the target memory in three ways of writing, reading, and clearing, and a clock internally, and the clock is according to the instruction of the scenario presentation control unit. , The current time is notified, and the clock management unit is compared with the clock management unit 43 to which three commands of time setting, start, and time reading are sent, and the scenario presentation execution unit 14. If there is, an external program execution unit 48, which will be described later, is executed at a specified timing. In response to the notification from the scenario presentation execution unit 44 having an additional function of sending a RAM execution command, the scenario presentation control unit 15 and the target memory 12, the designated media data and the interactive button are presented / erased, and each media is presented. The data and the display data of the interactive button are the data recording unit 1 described later.
Data presenting unit 45 which records the data in No. 7 and reads the corresponding data from the data recording unit 17 and displays it on a CRT display, a moving image frame buffer, an audio output amplifier, or the like.
And a database management unit 46 for recording scenario information for managing the presentation start / end event information of each media data, media data, and attribute information of the interactive button, and storing each multimedia data and graphic data for displaying each button icon. Has a data recording unit 47, an external program execution unit 48, and an external program recording unit 49 that stores a program that can be started as an external program. The external program execution unit 48 is a scenario presentation execution unit 44. In response to the external program execution command from the external program, the external program is read from the external program recording unit 49 to be described later and executed by the specified identifier. Here, the condition of the external program that can be started is that each program returns the execution result as a target name to the external program execution unit 48, or directly writes the target name of the execution result in the target memory 42. And When the execution result is returned to the external program execution unit 48, the result is written in the target memory 42.
Thereby, presentation of data and a scenario based on the execution result of the external program can be realized.

The scenario used in this embodiment is It is described as. Here, Scenerio na
me is a scenario identifier, and DX, DY, and DT are
The size (DX, DY) of the display screen on which this scenario is presented and the time DT until all the presentation data in the scenario are finished are shown. Object name indicates the identifier of each media data, dialogue button, etc. presented in the scenario, and (x, y) indicates each media /
The relative presentation position of the button, t represents the presentation start time (for example, the relative time when the scenario presentation start time is T = 0). On the other hand, the attribute information of each medium is recorded in the database as follows.

Object name dx, dy, d
t, it is assumed to be described in the form of a sequence of information depending on each object. This description format is called a record. Here, (dx, dy) is the screen presentation size of this object, and dt is the presentation time.

B Description of Scenario Description Method In the first invention, the object described in the scenario is a processing object for writing user input to the target memory 42, in addition to ordinary media data and interactive buttons, and a target. An object for reading the data name described in the memory 42 is included. For example, the object Target_i representing the former process
Consider an object Target_show representing n, the latter. Target_in displays a text window Target_in on the screen, receives a user's key input from this window, and writes it in the target memory 42 as it is. In the case of mouse input, a data name is acquired from the database management unit 46, a menu button containing all data names is created, and when the data name of the menu button is selected with the mouse, the data name is written in the target memory 42. . Also, Target_
Show presents the object described in the target memory 42. Using this, a scenario implementing the invention can be described as follows.

Input_jump Target_in x _in , y _in , t _in Target_show x x _s , y _s , t _s However, Target_in dx _in , dy _in , d
t _in Target_show dx _s , dy _s , dt _s .

Here, (x _in , y of Target_in
_in ) is the presentation position of the window that accepts input, (dx
_in, dy in) the size of the window, t _in the input monitor start time, dt _in represents the monitor time. Also, T
of arget_show (x _s, y _s) is presented the position of the target data _{(dx s, dy s, dt} s) may be any value in the dummy variable (but dt _s> 0).

Furthermore, these Target_in, Ta
Object Target that is a collection of rget_show
Considering t_in_show, input_jump2 Target_in_show x _is , y _is , t _is . However, Target_in_show dx
_is , dy _is , and dt _is . Where Target_i
In (n_show), (x _is , y _is , dx _is , dy _is ) indicates the position and size of the window, and (t _is , t _is + dt _is ) indicates the input monitor start time / end time. This Target
If the t_in_show object is used, the target memory 4 is immediately output when the input from the user is completed.
The data shown in 2 can be presented.

On the other hand, the format of the data name (scenario name) described in the target memory 42 is as follows.

Targetname. Mediatype Targetname represents the data name itself, and M
The edittype identifies the type of data medium or the scenario. The data name written in this format will be called the target name.

The scenario of the second invention is also described in this way. However, in the second invention, an external program can be specified in the scenario. For example, a program E for searching data containing a specific keyword from text data
xternal is, media data, interactive buttons as well as _{External dx e, dy e, dt} e, is the argument of the program. _{Here, (dx e, dy e,} dt e) is a dummy variable, no specific meaning. In the scenario,
For example, Scenerio DX, DY, DT External x _e , y _e , t _e Target_show x show x _s , y _s , t _s . However, Target_in_show dx
_is, dy is, is _{dt is (t e <t s} ). In the above, the operands for (x, y) are all dummy,
t _e and t _s represent respective start times.

Operation of Device C FIG. 5 is a flowchart showing the following operation of the scenario presentation control unit 44. (1) A scenario is read and a timetable is created (step 51). (2) The pointer indicating the reference position of the time table to be compared with the current time is set in the first row (step 52). (3) A start command is sent to the clock management unit 43 to start measurement from time 0 (step 53). (4) The time measured by the clock management unit 43 is read and compared with the time table (step 54). (5) If the current time matches or exceeds the value on the timetable indicated by the pointer, (6) to (8), (13) to (14) according to the description on the timetable.
Operation is performed, and otherwise returns to (4) (step 5
5). (6) When the input monitor is on, the input monitor management unit 41
Then, a monitor start command is issued using the corresponding object record as an argument (steps 56 and 57). (7) When the input monitor is off, the input monitor management unit 41
Then, a monitor end command is issued using the corresponding object record as an argument (steps 58 and 59). (8) When the target memory reading is on, a target name calling instruction is issued to the target memory 42 to acquire the data name or scenario name written in the target memory (steps 510 and 511). After that, the operations (9) to (12) are performed. (9) The target name is received from the target memory 42, the medium is checked from the medium identifier of the target name, and if it is a scenario, the scenario information is acquired from the database management unit 46, and new timetables are created (steps 512, 513, 517). Then, return to (2). If the media is not a scenario, (10)-(1
Perform operation 2). (10) An object record acquisition command is issued to the database management unit 46 to acquire the attribute information of the target medium (step 514). (11) The object record sent from the database management unit 46 is added to the timetable and the timetable is updated (step 515). (12) Issue a target data presentation command to the data presentation unit 45 using the object record as an argument (step 516). (13) When the presentation of the data designated in the target memory is off (Target_show OFF in the above), the presentation end command is issued using the presentation data as an argument (steps 518 and 519). (14) When the program is activated, the program execution instruction is issued to the external program recording unit 49 by using the identifier of the corresponding external program as an argument (step 520,
521). (15) Move the pointer to the next line (step 52)
2). (16) If there is an unprocessed scenario line, return to (4).
Otherwise, the process ends (step 523).

With the above operation, the scenario to be presented next can be determined from the execution result of the external program. In the above description, it is assumed that one external program is activated at a time, but it is easy to extend the external program execution unit and execute a plurality of programs simultaneously. In this case, a plurality of programs may be managed using a table.

Although the operations (6) and (7), which are the input monitor processing, are included in the above operation, they may be omitted.

Embodiment 3 of the Third Invention A Description of Device Configuration FIG. 1 shows the configuration of a scenario presentation device that implements the scenario presentation method according to the first invention. This dynamic scenario presenting device is composed of an input device such as a mouse / keyboard and its control unit, monitors a user input, and writes an input result to a target memory 12 described later when an input is made, and an input monitor management unit 11 and , A data name that specifies the target is stored, and the target memory 12 has three clocks that can be accessed for writing, reading, and clearing, and an internal clock. The clock is an instruction of the scenario presentation control unit. Accordingly, the current time is notified, the scenario is read from the clock management section 13 to which the three commands of time setting, start, and time reading are sent to the clock management section, and the database management section 16 described below is read to present each data. According to the start / end time, input monitor start / end time, and target memory read start / end time. A timetable is created by using the timetable, and the process specified at the time described in the timetable is performed while monitoring the time information from the clock management unit 13. On the other hand, the data start / end process is performed by the data presenting unit 15 described later. The input monitor management unit 11 performs input monitor start / end processing, and the target memory read processing sends scenario start / end commands to the target memory 12 for execution. Upon receiving the notification, the designated media data and the dialogue button are presented / erased, each media data and the display data of the dialogue button are recorded in the data recording unit 17 described later, and the corresponding data is read from the data recording unit 17, Display on CRT display, frame buffer for video, amplifier for audio output, etc. A data presentation section, a database management section 16 for recording scenario information for managing the presentation start / end event information of each media data, media data, and attribute information of dialogue buttons, and for displaying each multimedia data and button icon The data recording unit 17 stores graphic data.

The scenario used in this embodiment is It is described as. Here, Scenerio na
me is a scenario identifier, and DX, DY, and DT are
The size (DX, DY) of the display screen on which this scenario is presented and the time DT until all the presentation data in the scenario are finished are shown. Object name indicates the identifier of each media data, dialogue button, etc. presented in the scenario, and (x, y) indicates each media /
The relative presentation position of the button, t represents the presentation start time (for example, the relative time when the scenario presentation start time is T = 0). On the other hand, the attribute information of each medium is recorded in the database as follows.

Object name dx, dy, d
t, it is assumed to be described in the form of a sequence of information depending on each object. This description format is called a record. Here, (dx, dy) is the screen presentation size of this object, and dt is the presentation time.

B Description of Scenario Description Method In the present invention, the object to be described in the scenario is a processing object for writing user input to the target memory 12 in addition to normal media data and interactive buttons, and the target memory 12 An object that reads the data name described in is included.
For example, an object Target_ that represents the former process
in, an object representing the latter Target_show
think of. Target_in displays a text window Target_in on the screen, receives a user's key input from this window, and writes it in the target memory 12 as it is. In the case of mouse input, a data name is acquired from the database management unit 16, a menu button containing all data names is created, and when the data name of the menu button is selected with the mouse, the data name is written in the target memory 12. . Also, Target
_Show presents the object described in the target memory 12. Using this, a scenario implementing the invention can be described as follows.

Input_jump Target_in x _in , y _in , t _in Target_show x x _s , y _s , t _s However, Target_in dx _in , dy _in , d
t _in Target_show dx _s , dy _s , dt _s .

Here, (x _in , y of Target_in
_in ) is the presentation position of the window that accepts input, (dx
_in, dy in) the size of the window, t _in the input monitor start time, dt _in represents the monitor time. Also, T
of arget_show (x _s, y _s) is presented the position of the target data _{(dx s, dy s, dt} s) may be any value in the dummy variable (but dt _s> 0).

Further, these Target_in, Ta
Object Target that is a collection of rget_show
Considering t_in_show, input_jump2 Target_in_show x _is , y _is , t _is . However, Target_in_show dx
_is , dy _is , and dt _is . Where Target_i
In (n_show), (x _is , y _is , dx _is , dy _is ) indicates the position and size of the window, and (t _is , t _is + dt _is ) indicates the input monitor start time / end time. This Target
If the object of t_in_show is used, the target memory 1 is immediately output when the input from the user is completed.
The data shown in 2 can be presented.

On the other hand, the format of the data name (scenario name) described in the target memory 12 is as follows.

Targetname. Mediatype Targetname represents the data name itself, and M
The edittype identifies the type of data medium or the scenario. The data name written in this format will be called the target name.

The scenario description method is the same as that described in the first invention. However, in the present invention, it is necessary to describe the default data name or scenario name in the scenario. For example, the scenario input
In _jump, the target presentation object T
The record of target_show is written as Target_show x _s , y _s , t _s , Data. As a result, the database management unit inquires the target name acquired from the target memory, and when an error such as no target name is returned, the attribute information of Data in the operand is acquired and presented to the data presenting means.

C Device Operation In the third invention, the scenario presentation control unit 14 operates as follows according to the flow shown in FIG. (1) A scenario is read and a timetable is created (step 61). (2) The pointer indicating the reference position of the time table to be compared with the current position is set in the first row (step 62). (3) A start command is sent to the clock management unit 13 to start measurement from time 0 (step 63). (4) The time measured by the clock management unit 13 is read and compared with the time table (step 64). (5) If the current time matches or exceeds the value on the timetable indicated by the pointer, perform operations (6) to (8), (16) and thereafter according to the description on the timetable. Otherwise, the process returns to (4) (step 65). (6) When the input monitor is on, the input monitor management unit 11
A monitor start command is issued with the corresponding object record as an argument (steps 66 and 67). (7) When the input monitor is off, the input monitor management unit 11
Then, a monitor end command is issued using the corresponding object record as an argument (steps 68 and 69). (8) When the target memory reading is on, a target name calling instruction is issued to the target memory 12 to acquire the data name or scenario name written in the target memory (steps 610 and 611). After that, the operations (9) to (15) are performed. (9) The target name is received from the target memory 12, and a target name confirmation request for confirming the existence of the target is issued to the database management unit 16 (steps 612 and 6).
13). (10) When an error is returned from the database management unit 16, the data name described in the scenario is changed to the target (step 614). (11) The target name medium is checked from the target name identifier (step 615). (12) If the target name is a scenario, the scenario information is acquired from the database management unit 16 and a new timetable is created (steps 616 and 617). afterwards,
Return to (2). If the target name is not a scenario (1
3) to (15) are performed. (13) An object record acquisition command is issued to the database management unit 16 to acquire the attribute information of the target medium (step 618). (14) The object record sent from the database management unit 16 is added to the timetable, and the timetable is updated (step 619). (15) Issue a target data presentation command to the data presentation unit 15 (step 620). (16) When the data presentation designated in the target memory is off, the presentation end command is issued using the presentation data as an argument (steps 621 and 622). (17) Move the pointer to the next line (step 62)
3). (18) If there is an unprocessed scenario line, return to (4). Otherwise, the process ends (step 624).

On the other hand, FIG. 3 is a flowchart showing the operation of the input monitor management unit 11 which receives the monitor start / end command. (1) Wait for a start command from the scenario presentation control unit 14 (step 31). (2) When the monitor start command is received, the argument of the command is written in the input table showing the text window and the interactive button currently being monitored (step 32). (3) In the case of mouse input, a target name that can be specified is acquired from the database management unit 16, a menu table is created, and a menu button creation command is sent to the data presentation unit 15. In the case of key input, the data presenting unit 15 is made to create a text window by using the written argument (steps 33, 34, 35, 36). (4) The user input is monitored, and if not, go to (8), and if there is, go to (5) (step 37). (5) When there is an input, the input table and the menu table are referred to, and the corresponding window / menu button is determined from the type of input device, the input position on the screen, etc. (step 38). (6) If the input is a key input, the input is directly written in the target memory (steps 39 and 310). (7) In the case of mouse input, the selected target name is written in the target memory (steps 39 and 311). (8) If the monitor end command is monitored and received,
A presentation end command for erasing the corresponding text window and menu button is sent to the data presentation unit 15, the argument information such as the corresponding window is deleted from the input table, and the process ends. Otherwise, return to (4) (step 31)
2, 313).

As described above, the operation of the input monitor managing section 11 is similar to that of the first invention in FIG. By combining the above operations, it is possible to describe a dynamic scenario and a fixed interactive button as in the past by describing it in the scenario in exactly the same way and presenting it.

In the present embodiment, the first invention and the third invention have been described with the device configuration of FIG. 1 and the second invention with the device configuration of FIG. 4, but they can be combined to provide the first invention. It is possible to have an apparatus configuration for simultaneously carrying out the first to third inventions. Therefore, the first invention to the third invention can be freely combined. Further, in the embodiments of the first to third inventions, the scenario does not necessarily include designation of the position (x, y) on the screen and the size (dx, dy).

All of the above-described modes of change are included in the present invention.

[0063]

According to the first aspect of the present invention, it is possible to directly specify the data or scenario to be presented next by writing the target name in the target memory by user input without directly describing the data name to be presented in the scenario. it can. Further, since the data to be presented next can be dynamically changed with one dialogue window, the scenario can be written simply.

According to the second invention, it is possible to realize the function of presenting data according to the execution result of the program. As a result, for example, it is possible to perform a keyword search of data, create a program or the like for determining the searched data name by an external program, and incorporate the program into a scenario.

According to the third invention, in the user input, when there is no input from the user between the input monitor start time and the end time, or when there is no key-input data or scenario, It is possible to present the data described in the scenario in advance.
Thereby, the dynamic scenario presentation by the user and the conventional fixed interactive button can be realized at the same time.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a scenario presentation device that implements a dynamic scenario presentation method according to a first invention.

FIG. 2 is a flowchart showing an operation of a scenario presentation control unit 14 that implements the scenario presentation method according to the first invention.

FIG. 3 is a flowchart showing an operation of an input monitor management section 11 for implementing the scenario presentation method according to the first invention.

FIG. 4 is a block diagram showing a configuration of a scenario presentation device that implements a scenario presentation method according to a second invention.

FIG. 5 is a flowchart showing an operation of a scenario presentation control unit 44 for implementing the scenario presentation method according to the second invention.

FIG. 6 is a flowchart showing an operation of a scenario presentation control unit 14 that implements a scenario presentation method according to a third invention.

[Explanation of symbols]

 11, 41 Input monitor management unit 12, 42 Target memory 13, 43 Clock management unit 14, 44 Scenario presentation execution unit 15, 45 Data presentation unit 16, 46 Database management unit 17, 47 Data recording unit 48 External program execution unit 49 External Program recording section

Claims (3)

(57) [Claims] 1. In a scenario presentation method for presenting multimedia data based on a scenario including timing specification such as presentation start / end of multimedia data, an input monitor start time for starting monitoring of user input,
The input monitor end time for ending the monitor and the identifier indicating that the input result is written to the target memory are described in advance in the scenario, and the user's input is monitored between the input monitor start time and the input monitor end time. However, when there is an input, the input data name or scenario name is written to the target memory, and the data corresponding to the data name or scenario name described in the target memory is presented at the timing specified in the scenario. Dynamic scenario presentation method. 2. An identifier of an external program and a program start time for starting the external program are described in a scenario in advance, the program is started at the program start time, and a data name or a scenario name which is the execution result of the program is stored in a target memory. The method for presenting a dynamic scenario according to claim 1, wherein the method is written. 3. When there is no user input from the input monitor start time to the input monitor end time, or when the data name or scenario name written in the target memory is incorrect, the data name or scenario name described in the scenario in advance. The method for presenting a dynamic scenario according to claim 1, characterized in that: is written in a target memory.