JP3521728B2 - Multimedia data presentation method and system, and storage medium storing multimedia data presentation program - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia data presentation method and system and a storage medium storing a multimedia data presentation program, and more particularly, to a combination of multimedia data including video data, audio data and text data. Create a scenario that specifies the presentation timing and screen layout when presenting
The present invention relates to a multimedia data presentation method and system to be executed, and a storage medium storing a multimedia data presentation program.

More particularly, the present invention relates to a multimedia data presentation method and system for displaying the results of a program that returns a plurality of multimedia data including video data, audio data and text data, and a storage medium storing the multimedia data presentation program.

[0003]

2. Description of the Related Art When presenting a combination of multimedia data including video data, audio data and text data, a scenario for designating a presentation timing and a screen layout is created and executed without describing it by using a program. Many methods have been proposed.

For example, by creating a plurality of scenarios in which a set of continuously presented data is collected and designating the presentation order of the scenarios, it is possible to perform a desired procedure more easily than a description using a program. Multimedia data can be presented. However, in the conventional scenario description method, for example, there is a problem that proceeds by the execution result of the program, such as the result of searching the database can not create a variable Waru scenario. As an example of a conventional scenario editing method that solves this problem, there is a method of describing a timing to call an external program and a branch destination according to a character string output from the external program.
No. 53544.

[0005]

However, in the conventional method of describing the branch destination corresponding to the character string output by the external program, the scenario for presenting the data obtained as the result of the program output may be described. Have difficulty. In particular, when the number of data obtained as a result of the program changes, it is necessary to create a scenario for each number of data, which causes a problem that the load of creating the scenario increases.

Further, there is a problem that a scenario that can deal with the case where the upper limit of the number of data output by the program is not known in advance cannot be created. The present invention is
It was made in view of the above points, and the execution result of the program
Even if the number of data obtained as
If you know the upper limit of
By just describing the template and its expansion method,
Scenario with a small amount of description without creating a scenario
It is an object of the present invention to provide a multimedia data presentation method and system capable of creating a program, and a storage medium storing a multimedia data presentation program.

[0007]

FIG. 1 is a diagram for explaining the principle of the present invention. The present invention (claim 1) is a positive integer N (N is a natural number of 2 or more) There is, execution of the program to return the video data, including audio data and text data, N sets following the multimedia data set In a multimedia data presentation method in a multimedia data presentation device for presenting results, N or less sets of
Execution result of a program consisting of a set of media data
When the result is input to the multimedia data presentation device,
The opening means constitutes N sets of multimedia data
Relative temporal order of presenting multiple multimedia data
The pre-registered presentation scenario template that describes the order and relative spatial position relationship, and the pre-registered in the development information file.
The presentation scenario template is developed from one set to N sets.
And development information describing the temporal order and spatial position that, presenting Sina determined from the set of multimedia data of the execution result of the <br/> program, up to N of one by the development information
Number of sets of multimedia data at the development position of the Rio template
The presentation scenario template is developed only for (N or less) (step 1), and the presentation means sets the number of multimedia data sets (N or less).
Only below), the multimedia data of the execution result of the program is presented by applying the presentation scenario template expanded to each individual multimedia data set (step 2).

The present invention (Claim 2) includes n ( n exceeds N) including video data, audio data and text data.
Natural numbers, N is the presents the execution result of the program to return the natural number of 2 or more) sets of multimedia data sets multimeter
In the multimedia data presentation method in the media data presentation device, in the multimedia data presentation device,
A set of multimedia data sets of n or less
When program execution result is input, expansion means, a set of n sets of multimedia data, using a grouping function, divided into groups of a set of N sets following multimedia data, the deployment means , N sets of multimedia days
Present multiple sets of multimedia data that make up a set of data
Of the relative temporal order and relative spatial position
Registered presentation scenario template and deployment information file
One set of the presentation scenario template that is registered in advance
To N sets of temporal order and spatial position, and
Group selection scenario for selecting the group to be presented
And deployment information Oh is described, from the execution result of the program, the group to be presented is determined in correspondence to the set respective multimedia data belonging to the group to expand the presentation scenario template, indicating means but individual multimedia data set by applying the Hisage shows scenario template deployed, as well as presenting a group of multimedia data of the program execution result, selection for instructing the group to be presented The scenario is developed to execute the scenario so that the user can select and present a group other than the currently presented group of multimedia data.

The present invention (Claim 3) includes n ( n exceeds N) including video data, audio data and text data.
Natural numbers, N is the presents the execution result of the program to return the natural number of 2 or more) sets of multimedia data sets multimeter
In the multimedia data presentation method in the media data presentation device, in the multimedia data presentation device,
A set of multimedia data sets of n or less
When program execution result is input, expansion means, a set of n sets of multimedia data, using a grouping function
And divide it into groups of N or less sets of multimedia data, and the expanding means selects the groups according to the association.
And scenario generation function
Accordingly, associate between the groups of multimedia data, a plurality of which constitute a set of N sets of multimedia data
Relative temporal order and phase of presenting multimedia data
A pre-registered presentation scenario that describes the relative spatial position relationship
The template and the information registered in advance in the expansion information file
Temporal order of developing the presentation scenario template from 1 set to N sets
Presents a scenario for selecting ordinal and spatial position and group
And development information describing the temporal order and spatial position, from the execution result of the program, the group to be presented is determined, corresponding to the set <br/> each multimedia data belonging to the group Develop a presentation scenario template and present it
Of the program by applying the presentation scenario template developed to each multimedia data set .
While presenting one group of the multimedia data of the execution result, the scenario in which the scenario for selecting the generated group is expanded is executed, and the user selects a group other than the group of the multimedia data currently presented and selects the group. Make them present.

FIG. 2 is a block diagram showing the principle of the present invention. The present invention (Claim 4) provides a positive integer N (N is a natural number of 2 or more).
Number) There is, video data, including audio data and text data, a multimedia data presentation system for presenting a program execution result to return a set of N sets following multimedia data, N sets of multimedia data
The multiple multimedia data that make up the set of
Pre-description of relative temporal order and relative spatial position
Registered presentation scenario template 200 and presentation scenario template
Temporal order of expanding form 200 from set N to set N and empty
N sets of expansion information 100 describing inter-positions are registered in advance.
Expanded information file and multimedia files of N sets or less
The expansion based on the execution result of the program consisting of a set of data
Presentation scenario defined from 1 to N according to information 100
Number of sets of multimedia data at the development position of template 200
The expansion means 61 that expands the presentation scenario template 200 only (N or less) and the number of sets of multimedia data (N or less)
The means for expanding the individual multimedia data sets 300
The presentation means 62 presents the multimedia data of the execution result of the program by applying the presentation scenario template expanded by 61 .

The present invention (Claim 5) includes n ( n exceeds N) including video data, audio data and text data.
Natural numbers, N is the a multimedia data presentation system for presenting a program execution result that returns the natural number of 2 or more) sets of multimedia data sets, N sets of Multimedia Processors
Multimedia data that make up a data set
The relative temporal order and the relative spatial position relationship are presented.
The presentation scenario template registered in advance and the presentation scenario
E Temporal order and space for expanding the template from 1 set to N sets
User indicates target position and group to be presented
The deployment information that describes the selection scenario for
Expanded information file and multimedia files of n sets or less
The result of program execution, which consists of a set of
Then, the n sets of multimedia data are
N sets of multimedia data or less using the conversion function
Grouping method to divide the group into
When the group is decided, the group is grouped according to the expansion information.
Provided for each multimedia data set belonging to
A development means for developing the shown scenario template by applying the presented scenario template that is by Ri expand the expansion means to the individual multimedia data set, the multimedia data of the execution binding <br/> results of the program Presenting means for presenting one group and executing a scenario in which a selection scenario for instructing a group to be presented is executed, and a group of currently presented multimedia data selected by the user which is activated from the selection scenario. And a presentation control unit capable of presenting groups other than.

The present invention (claim 6) includes n ( n exceeds N) including video data, audio data and text data.
Natural numbers, N is the a multimedia data presentation system for presenting a program execution result that returns the natural number of 2 or more) sets of multimedia data sets, N sets of Multimedia Processors
Multimedia data that make up a data set
The relative temporal order and the relative spatial position relationship are presented.
The presentation scenario template registered in advance and the presentation scenario
O Temporal order and spatial expansion of the template from 1 set to N sets
Scenario for selecting groups according to position and relation
Described relative temporal order and relative position to be presented
The expansion information file in which the expansion information is registered in advance, and n or more pairs
The multiple multimedia that make up the multimedia data set below.
Execution result of the program composed of a set of media data
When the result is input, the n sets of multimedia data sets
And using the grouping feature, denoted related to group division means for dividing into groups of a set of N sets following multimedia data, a group of multimedia data,
Generate a scenario that selects groups according to association,
Association / selection scenario generation means and glue to be presented
Group is determined, the group belongs to the group according to the deployment information.
Expanding means and by applying the presented scenario template that is open exhibition to individual multimedia data sets, multimedia data of the program execution results to expand the presented scenario template for a set each of the multimedia data that group together presenting a group, that were generated and presenting means for executing a scenario developed a scenario for selecting the group, is launched from a group selection scenario, the multimedia data that is currently presented selected by the user Users to select and present groups other than
And a that Hisage示制your means.

The present invention (Claim 7) provides a positive integer N ( N
Be no more than a natural number), video data, including audio data and text data, a storage medium storing multimedia data presentation program for presenting a program execution result to return a set of N sets following multimedia data It consists of N or less sets of multimedia data.
When the execution result of the program
Multimedia that make up a set of multimedia data
Relative temporal order and relative spatial location of data presentation
The presentation scenario template that describes the person in charge and the expansion file in advance
Exhibition of registered presentation scenario templates from 1 set to N sets
Development information describing temporal order and spatial position of opening and
From 1 to N depending on the expansion information.
Number of sets of multimedia data at the development position of Nario template
A step <br/> of (N or less) only expand the presentation scenario template, the number of sets of multimedia data only (N or less), the individual multimedia data set, applying the presentation scenario template deployed by, circle and presenting the multimedia data of the program execution result, the
The program to be executed by the Chimedia data presentation device
Pay.

The present invention (Claim 8) includes video data, audio data and text data, n (n exceeds N)
A storage medium storing a multimedia data presentation program that presents the execution result of a program that returns a set of multimedia data of natural number, N is a natural number of 2 or more) , and is composed of n or less sets of multimedia data. Done
When the execution result of the program is input, the n sets of
Using a grouping function,
Divided into groups of N sets or less of multimedia data
The step of dividing and N sets of multimedia data
Relative to present multiple multimedia data to compose
Presentation scenario describing temporal order and relative spatial position
The template and the presentation screen registered in the development information file.
Temporal order and space to develop Rio template from 1 set to N sets
User indicates target position and group to be presented
To present from the deployment information that describes the selection scenario for
Once the power group is determined, the multi
The presentation scenario template corresponding to each set of media data
And a step to deploy, the individual multi-media data
Depending on applying the presented scenario template that has been developed in the set
And presenting one group of the multimedia data set resulting from the execution of the program and executing a scenario in which a selection scenario for indicating the group to be presented is executed, and the step is activated from the selection scenario. , and a step to be presented to select a group other than the group of multimedia data that is currently presented user, multi
Stores programs to be executed by the media data presentation device
To do.

The present invention (Claim 9) includes video data, audio data and text data, n (n exceeds N)
A storage medium storing a multimedia data presentation program that presents the execution result of a program that returns a set of multimedia data of natural number, N is a natural number of 2 or more) , and is composed of n or less sets of multimedia data. Done
When the execution result of the program is input, the n sets of
Using a grouping function,
A group consisting of N or less sets of multimedia data
And the multimedia data glue
Group to associate groups and select groups according to relationships.
Nario generation step and N sets of multimedia devices
Presents multiple multimedia data that make up a set of data
Described the relative temporal order and relative spatial position relationship
It is registered in advance in the development information file with the presentation scenario template.
The presentation scenario template is developed from one set to N sets.
According to the temporal order and spatial position of the
Temporal order and spatial position for presenting scenarios for selecting groups
Expansion information that describes the positional relationship and the execution result of the program
From the group to be presented is determined, comprising the steps of deploying Hisage shown scenario template corresponding to a set each of the multimedia data belonging to the group, number belonging to the group
By applying the present scenario template developed in the multimedia data s set, as well as presenting a group of multimedia data of the execution result of the program, executing the scenario development scenarios for selecting the generated group steps and is started from the scenario for selecting the group, is selected by a user a group other than a group of multimedia data being currently presented to
The steps for making the presentation
The program to be executed by the display device is stored.

As described above, according to the present invention, the temporal order for developing 1 to N presentation scenario templates describing the information on the relative temporal order and spatial position for presenting one set of multimedia data. By repeating the operation of displaying the multimedia data by the number of the multimedia data using the information on the spatial position and the spatial position, even if the number of the multimedia data is unknown in advance,
If the upper limit N of the number is known, it is possible to deal with one scenario.

Further, when the multimedia data exceeds N sets, the multimedia data is divided into some groups of N sets or less of data, and the above-mentioned multimedia data presentation method is applied to each group. By doing so, when the number of multimedia data is large,
Present for each group. Then, a selection scenario for instructing a group to be presented is prepared, and by executing this selection scenario, the user can perform an operation for switching presentations between groups. by this,
It can also be used when the upper limit of the number of data is unknown.

Furthermore, by associating groups of multimedia data and generating a selection scenario for selecting groups to be presented according to the association, various presentation methods can be used.

[0019]

FIG. 3 shows the configuration of the multimedia data presentation system of the present invention. The system shown in the figure includes a program 10 and a multimedia data presentation device 6.
0, the expansion information file 100, the presentation scenario template file 200, the multimedia data file 300, and the expansion scenario file 400.

The development information file 100 includes a presentation scenario template 20 for each of N or less sets of multimedia data.
It stores a description of the temporal order and the spatial position where 0 is expanded. The presentation scenario template file 200 stores information describing a relative temporal order and a relative spatial position relationship for presenting a set of multimedia data.

The multimedia data file 300 is
N sets or less of multimedia data which are execution results of the program 10 are stored. Deployment scenario file 400
Is a file in which the presentation scenario template is expanded corresponding to each of the multimedia data stored in the multimedia data file 300 according to the expansion information of the expansion information file 100.

The program 10 outputs multimedia data input to the multimedia data presentation device 60 as an execution result. Multimedia data presentation device 6
0 uses the presentation scenario template of the presentation scenario template file 200 and the expansion information of the expansion information file 100,
The presentation scenario template is expanded for each of the multimedia data output by the program 10 and stored in the expansion scenario file 400.

[0023]

Embodiments of the present invention will be described below with reference to the drawings. In the following example, in FIG.
Although each is described as a file, in the following figures, the same number as the file name in FIG. 3 is used as the in-file information for description.

[First Embodiment] FIG. 4 shows the configuration of a scenario according to the first embodiment of the present invention. The configuration shown in the figure includes a program 10, information 100 regarding the temporal order and spatial position of executing a presentation scenario template, a presentation scenario template 2
00, program result 300, deployed scenario 4
It consists of 00.

The presentation scenario template 200 corresponds to a scenario according to the conventional method except that a part of the presented multimedia data is blank.
It can be described as shown in FIG. The story and layout in FIG. 5A is an example using a story 610 that describes a temporal order in which multimedia data is presented and a layout 620 that describes a spatial positional relationship. In story 610, start 611, end 6
Link 6 nodes such as 14, video 612, and still image 613
Tie at 15 to specify the playback order. Layout 620
Then, the position and size of the screen on which the image is displayed are specified by the rectangular drawing areas 622 to 623.

In the spatial representation shown in FIG. 5B, the position and time at which an image is displayed in a three-dimensional space 700 composed of a two-dimensional x-axis 701 and a y-axis 702 and a time axis 703 on the screen are shown. Designation is performed using rectangular parallelepipeds 712 to 713. Nodes 612 to 613 of these description methods or a rectangular parallelepiped 7
Show blank 12 to 713 Scenario template 2
Used as 00.

[0027] development information 100 that describes the temporal order and spatial position to deploy presentation scenario template 200 Accordingly,
This presentation scenario template 200 is used as the result 3 of the program 10.
By creating a scenario 400 that is developed for each of 10 and applying the multimedia data set 310 to each of the developed presentation scenario templates 410, and executing the scenario 400,
Present the multimedia data resulting from the program.

FIG. 6 shows an example using the three-dimensional space notation of FIG. 5B as the development scenario template 200 and the expansion information 100 describing the temporal order and spatial position of expanding the presentation scenario template 200. . In FIG. 6, the position where the three-dimensional space 200 of the presentation scenario template is expanded is set to the three-dimensional space 10.
It is indicated by the coordinate 104 within 0. In this example, eight coordinate points are designated so that up to eight sets of multimedia data can be presented, and coordinate points 1 are used in order according to the number of sets of multimedia data as a result of the program 10. . In the example shown in the figure, since the number of sets of multimedia data is "5", the three-dimensional space 200 of the presentation scenario template is expanded and expanded at the positions of the coordinate points 1 to 5. the presentation scenario template 470 of each of the multi-media data
Set 310 applies.

FIG. 7 is a diagram for explaining the operation of the first embodiment of the present invention. This figure shows a presentation scenario template 20.
0 and the presentation scenario template 200 are expanded information 100 that describes the temporal order and spatial position of the expansion of the presentation scenario template 200 as shown in FIG.
This is an example of using a story 610 that describes the temporal order of presenting the multimedia data in (A) and a layout 620 that describes the spatial positional relationship.

In this example, as the information 110 relating to the temporal order in which the presentation scenario template 200 is expanded, an instruction is given to serially expand the temporal order 210 of the presentation scenario template 200, and the spatial position where the presentation scenario template 200 is expanded. As the information 160 about the presentation scenario template 200
It is instructed to expand the spatial positional relationship 220 of 1 to the same position on the screen.

In FIG. 7, since the number of multimedia data is "5", the temporal order 420 of the presentation scenario template 200 in which five temporal sequences 210 are developed in series,
A spatial positional relationship 430 in which the spatial positional relationship of the presentation scenario template 200 is expanded to a designated position is created, and each multimedia data 310 is applied. [Second Embodiment] Next, a second embodiment will be described.

FIG. 8 shows the configuration of a scenario according to the second embodiment of the present invention. In the configuration shown in the figure, the multimedia data presentation device 60 is provided with a grouping function 20. In this embodiment, the multimedia data 320 as a result of the program is divided into groups 330, 340, 350 of N sets (8 sets in FIG. 8) or less of multimedia data by using the grouping function 20. The multimedia data is presented to the group by using the scenario shown in FIG. 4, and the user executes the scenario 440 in which the selection scenario 500 for instructing the group to be presented is expanded by the user to execute an arbitrary group. To be able to select.

Thus, even if the upper limit of the number of data is unknown, the user can select all the data by selecting the scenario 400 that presents N or less sets of multimedia data using the expanded selection scenario 440. You can see. FIG. 9 is a diagram for explaining the operation of the second exemplary embodiment of the present invention. This figure shows a presentation scenario template 20.
5 and the multimedia data of FIG. 5A as the expansion information 100 describing the temporal order and spatial position of expanding the presentation scenario template 200, and the selection scenario for the user to indicate the group to be presented. This is an example in which a story 610 describing a temporal order to be presented and a layout 620 describing a spatial positional relationship are used.

In this example, as the information 110 on the temporal order of expanding the presentation scenario template 200, it is instructed to expand the temporal order 210 of the presentation scenario template 200 in parallel, and the spatial position where the presentation scenario template 200 is expanded. As information 120 about the presentation scenario template 200
It is instructed to develop the spatial positional relationship 220 of 8 in eight areas 121 on the screen. Further, the temporal order 501 of the group selection scenario is instructed to be developed in parallel with the presentation scenario template 200, and the spatial positional relationship 502 of the group selection scenario is defined. As the content of the group selection scenario, for example, a scenario in which the number of groups is displayed and the group number is input is used.

In FIG. 9, there are three groups of multimedia data 330, 340 and 350 as a result of the program, and the numbers of multimedia data are 8, 8 and 5, respectively. Therefore, in the first two groups 330 and 340, , A temporal order 420 in which the temporal order 210 of the presentation scenario template 200 is expanded in parallel, and the presentation scenario template 20
A spatial positional relationship 430 in which a spatial positional relationship of 0 is expanded to a specified position is created and applied to each data 310 of each multimedia data group 330, 340, and the temporal order 501 of the selected scenario is expanded. Then, the temporal order 441 of the expanded selected scenario becomes, and the spatial positional relationship 502 of the selected scenario becomes expanded to become 442. Further, in the last group 350, the temporal order 4 20 in which the temporal order 210 of the presentation scenario template 200 is expanded in parallel and the spatial position in which the spatial positional relationship of the presentation scenario template 200 is expanded to a specified position The relation 4 30 is created and applied to each data 310 of each multimedia data group 350, and the temporal order 501 of the selection scenarios is expanded to become the temporal order 441 of the expanded selection scenarios, resulting in the selection scenarios. Spatial relationship 50
2 is expanded to form a spatial positional relationship 442 of the expanded selected scenario.

The user can see all the groups by looking at the number of groups displayed in the selection scenarios 501 and 502 and designating the group number. Therefore, even if the upper limit of the number of data is unknown, all the groups can be seen. You can see the data. [Third Embodiment] Next, a third embodiment of the present invention will be described.

FIG. 10 is a configuration diagram of a scenario according to the third embodiment of the present invention. The configuration shown in the figure is provided with an association and selection scenario generation function 30 in addition to the configuration of FIG. 8 described above. Among the functions of the association and selection scenario generation function 30, the function for association includes, for example, an ordering function. In this embodiment, the multimedia data 320 resulting from the program is divided into groups (330, 340, 350) of N sets (8 sets in FIG. 10) or less of multimedia data by using the grouping function 20. , Association between groups is performed, a scenario for selecting a group according to the association is generated, association is performed using the association and selection scenario generation function 30, and the scenario of FIG. 4 of the above-described first embodiment is associated with each group. By presenting the multimedia data and executing the scenario 480 in which the selection scenario generated by the association and selection scenario generation function 30 is expanded according to the temporal order and the spatial positional relationship 530 of presenting the selection scenario. Allows any group to be selected.

FIG. 11 shows an example of using the ordering function as the association in the third embodiment of the present invention. In the figure, the ordering function 30 is used as a method of association, and as a method of generating a selection scenario, if the group being presented is the first group 330, the next group selection scenario 510, and the group is an intermediate group 340. If so, the next group selection scenario 510, the previous group selection scenario 520, and the last group 350
In that case, the previous group selection scenario 520 is generated, and the scenarios 450 and 460 that have expanded these are executed.

As a result, the user can see all the groups as many times as necessary while moving to the previous and next groups. FIG. 12 is a diagram showing a method of using a dictionary for grouping and data association according to the third embodiment of the present invention. In the figure, the multimedia data is grouped according to the group 51 defined in the dictionary 50, and the dictionary 5 is grouped into the grouped data 330, 340, 350, 360, 370.
Associations 38 according to associations 52 between groups defined in 0
This is an example of adding 0. As a method of generating the selected scenario, the scenario 500 for selecting another group is expanded like the scenario 440 expanded according to the expansion information 530 corresponding to each association 380.

For example, products are classified into groups 51 by type, each group is associated with a store, and routes between the stores are related to each other.
A dictionary is created as 2, and a scenario for shopping at a store is used as the presentation scenario template 200 and its development information 100.
When a scenario that moves between shops is used as the selection scenario 500, it is possible to create a virtual shopping mall scenario in which customers can stroll between shops and shop.

Further, a series of operations in each of the above-described embodiments is constructed as a program and stored in a disk device of a computer for presenting the multimedia data, or a portable storage medium such as a floppy disk or a CD-ROM. Incidentally, when the present invention is executed, it can be easily realized by installing it. The present invention is not limited to the above embodiments, and various modifications and applications are possible within the scope of the claims.

[0042]

As described above, according to the present invention, even when the number of data obtained as a result of a program is changed in the conventional scenario description with a large amount of description, the upper limit of the number of data is known. , By describing the presentation scenario template that displays individual data and its deployment method,
A scenario can be created with a small amount of description without creating a scenario for each number of data.

Further, even in a multimedia application for displaying the execution result of a program in which the upper limit of the number of data is not known in advance, which is difficult except for the program description, it is divided into groups of a certain number or less of data and one group is formed. A simple scenario description can be performed without a program description by only describing the scenario that presents and the scenario that selects a group.

By associating groups and creating a scenario for selecting a group according to the association, various displays can be performed. From the above, it is expected that the work efficiency of application production will be improved.

[Brief description of drawings]

FIG. 1 is a diagram for explaining the principle of the present invention.

FIG. 2 is a principle configuration diagram of the present invention.

FIG. 3 is a configuration diagram of a multimedia data presentation system of the present invention.

FIG. 4 is a configuration diagram of a scenario according to the first embodiment of this invention.

FIG. 5 is an example of a description method of a temporal order and a spatial positional relationship according to the first embodiment of this invention.

FIG. 6 is an example using the three-dimensional space notation of the first exemplary embodiment of the present invention.

FIG. 7 is a diagram for explaining the operation of the first exemplary embodiment of the present invention.

FIG. 8 is a configuration diagram of a scenario according to the second embodiment of this invention.

FIG. 9 is a diagram for explaining the operation of the second exemplary embodiment of the present invention.

FIG. 10 is a configuration diagram of a scenario according to the third embodiment of this invention.

FIG. 11 is an example in which an ordering function is used as an association in the third exemplary embodiment of the present invention.

FIG. 12 is a diagram showing a method of using a dictionary for grouping and association between data according to a third embodiment of this invention.

[Explanation of symbols]

10 program 20 grouping function 30 association and selection scenario generation function, ordering function 50 dictionary for association between data 51 group of data 52 association between data 60 multimedia data presentation device 61 expansion means 62 presentation means 100 presentation scenario template Expansion information describing the temporal order and spatial position of expansion, expansion information file, expansion information 101 x-axis 102 of the three-dimensional space for expanding the presentation scenario template y-axis 103 of the three-dimensional space for expanding the presentation scenario template Time axis 104 of the three-dimensional space in which the scenario template is developed 104 Coordinates in the three-dimensional space in which the presentation scenario template is developed 110 Information about the temporal order in which the presentation scenario template is developed 120 Information about the spatial position at which the presentation scenario template is developed 121 Presentation Area 200 for developing scenario templates Presentation scenario template, presentation scenario template file 201 Presentation scenario template x-axis 202 Presentation scenario template y-axis 203 Presentation scenario template time axis 204 Presentation scenario template video drawing area / time 205 Presentation scenario template still image drawing area -Time 210 Temporal order of presentation scenario template 220 Spatial positional relationship of presentation scenario template 300 Program result (N or less multimedia data), multimedia data file 310 Multimedia data set 311 Multimedia data 320 Program result (N (n> = 0) sets of multimedia data) 330 Program result (N (N> 0) sets or less multimedia data) 340 Program result (N (N> 0) sets or less multimedia data) 350 Program result (N (N > 0) less than multimedia data) 360 program result (N (N> 0) less multimedia data) 370 program result (N (N> 0) less multimedia data) 380 multimedia data Relationship 400 Expanded scenario, expanded scenario file 401 Expanded scenario x-axis 402 Expanded scenario y-axis 403 Expanded scenario time axis 410 Expanded presentation scenario template 420 Expanded temporal order 430 Expanded spatial relationship 440 Expanded selection scenario 441 Temporal order of expanded selection scenarios 442 Expanded selection scenario spatial relationship 450 Expanded selection scenario for selecting next group 460 Expansion Scenario 4 for selecting the previous group 0 Expanded drawing area / time 480 Generation / expanded selection scenario 500 Selection scenario 501 for instructing group to be presented by user 501 Temporal sequence 502 of selection scenario for user to instruct group to be presented Spatial positional relationship of selection scenario 510 for user to indicate group to be presented Selection scenario 520 for selection of next group 530 Selection scenario for selection of previous group 530 Temporal order and space for developing selection scenario Expanded information 610 that describes the physical position 610 Story 611 Start node 612 Movie node 613 Still image node 614 End node 615 Link 620 Layout 622 Movie drawing area 623 Still image drawing area 700 3D space 701 x axis 702 y axis 703 Time axis 712 Video drawing area And time 713 still images of the drawing area and time

─────────────────────────────────────────────────── ─── Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G06T 1/00 G06T 11/60-17/50 G06F 17/30 G06F 3/00 G09G 5/00-5 / 40

Claims (9)

(57) [Claims] 1. An execution result of a program that returns a set of N or less sets of multimedia data including a certain positive integer N ( N is a natural number of 2 or more ) and including video data, audio data, and text data is presented. Multimedia data presentation equipment
In location, in a multimedia data presentation method consists of N sets following the multimedia data set Pro
The execution result of the gram is the multimedia data presentation device.
Input to the N-type multimedia data
Presents multiple multimedia data that make up a set of data
Described the relative temporal order and relative spatial position relationship
The presentation scenario template registered in advance and the expansion information file
One set of the presentation scenario template that is registered in advance in the file
Describes the temporal order and spatial position of expansion from N to N sets
N number from and the expanded information, and a set of multimedia data of the execution result of the program, from one by the development information
In the deployment position of the presentation scenario template that is determined up to
The presentation scenario template is developed by the number of data data sets (N or less), and the presentation means is the number of multimedia data sets (N or less).
Only by applying the presentation scenario template deployed to individual multimedia data sets, multimedia data presentation method characterized by presenting multimedia data of the programming <br/> ram execution result . 2. n ( n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A natural number) sets the multimedia data presentation device that presents the execution result of the program to return a set of multimedia data
In the method for presenting multimedia data , the multimedia data presenting device may include n sets or less of
Execution of a program consisting of a set of media data
When result is input, expansion means, a set of n sets of multimedia data, using a grouping function, divided into groups of a set of N sets following of the multimedia data, wherein the expansion means, Construct N sets of multimedia data
Relative time to present multiple multimedia data
Pre-registered to describe the relative order and relative spatial position
The presentation scenario template that has
The presented scenario templates recorded from 1 set to N sets
The temporal order and spatial position of deployment and the presentation
A group selection scenario for selecting loops is described.
And development information, and a result of execution of the program, the group to be presented is determined in correspondence to the set respective multimedia data belonging to the group to expand the presentation scenario template, the presenting means, individual multimedia data sets, designated by applying Hisage shows scenario template deployed, as well as presenting a group of multimedia data of the execution result of the <br/> program, a group to be the presentation the selection scenario to execute the deployment scenario, a group other than a group of multimedia data currently presented, the multimedia data presentation the user, characterized in that to be able to present selected Method. 3. n ( n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A natural number) sets the multimedia data presentation device that presents the execution result of the program to return a set of multimedia data
In the method for presenting multimedia data , the multimedia data presenting device may include n sets or less of
Execution of a program consisting of a set of media data
When result is input, the group expansion means, a set of n sets of multimedia data, using a grouping function, divided into groups of N sets following multimedia data, the developing means, according to the relevant Scenarios to choose
The association with the selected scenario generation function of generating, associate between the groups of multimedia data, N sets of
Multiple multimedia devices that make up a multimedia data set
Temporal order and relative spatial position presenting ear data
A pre-registered presentation scenario template that describes the positional relationship,
It is registered in the pre-deployment information file, the presentation bending
E Temporal order and space for expanding the template from 1 set to N sets
Time to present the scenario to select the target position and group
And development information describing the manner order and spatial position, from the execution result of the programming <br/> ram, the groups to be presented is determined in correspondence to the set respective multimedia data belonging to the group expand presentation scenario template, presentation means, by applying the present scenario template deployed to individual multimedia data sets, presenting a group of multimedia data of the execution result of the <br/> program At the same time, execute the scenario that expands the scenario to select the generated group, and select a group other than the group of multimedia data currently presented ,
A method for presenting multimedia data, characterized by being selected and presented by a user. 4. An execution result of a program which returns a set of N or less sets of multimedia data including a positive integer N (N is a natural number of 2 or more) and including video data, audio data and text data is presented. A multimedia data presentation system comprising a plurality of multimedia data constituting N multimedia data sets.
Relative temporal order and relative to present timedia data
A pre-registered presentation scenario template describing the spatial positional relationship and the time for developing the presentation scenario template from one set to N sets
Of N sets of expansion information describing the physical order and spatial position in advance
A program consisting of registered expansion information files and N or less sets of multimedia data.
From the execution result of the program, from 1 to N depending on the expansion information.
At the deployment position of the presentation scenario template determined by
A developing means for Adeta set number only (N or less) to expand the presentation scenario template, the number of sets of multimedia data (N or less) only, presented scenario template deployed by the expansion means to the individual multimedia data set by applying the multimedia data, characterized by having a presentation means for presenting the multimedia data of the professional <br/> grams execution result
Data presentation system. 5. n ( n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A multimedia data presentation system for presenting a natural number) sets the execution result of a program that returns a set of multimedia data, a plurality of multi constituting a set of N sets of multimedia data
Relative temporal order and relative to present timedia data
Pre-registered presentation scenario chicks that describe the spatial relationship
Shape and time to develop the presentation scenario template from one set to N sets
The target order and spatial position, and the groups to be presented.
Deployment information that describes the selection scenarios for the user to direct
Information consisting of a pre-registered expansion information file and n or less sets of multimedia data.
When the execution result of the program is input, the n sets of multimedia
Use the grouping function to set the data set of N or more
Divide into groups of multimedia data below
When the grouping means and the group to be presented are decided, the expansion information is followed.
For each multimedia data set belonging to the group
And developing means for developing the presentation scenario template for, Ri due to the expansion means to the individual of multi-media data set
By applying the deployment has been presented scenario template,
1 of multimedia data of the execution result of the program
Presenting means for presenting a group and executing a scenario in which a selection scenario for instructing the group to be presented is developed, and multimedia data currently presented, which is activated from the selection scenario and selected by the user. A multimedia data presentation system, comprising: presentation control means for presenting a group other than a group. 6. n ( n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A multimedia data presentation system for presenting a natural number) sets the execution result of a program that returns a set of multimedia data, a plurality of multi constituting a set of N sets of multimedia data
Relative temporal order and relative to present timedia data
Pre-registered presentation scenario chicks that describe the spatial relationship
Shape and time to develop the presentation scenario template from one set to N sets
Groups according to relative order, spatial position and association
Relative temporal order and relative position for presenting scenarios
The expansion information file in which the expansion information describing the relationship is registered in advance.
Files and a plurality of multimedia data sets of n sets or less
A program consisting of a set of multimedia data
When the execution result is input, the n sets of multimedia data are input.
A set of data, using a grouping function, and group dividing means for dividing into groups of a set of N sets following multimedia data, denoted related groups of the multimedia data, selecting a group according to the relevant scenario generating a, the associated-selection scenario generation unit, the group to be presented is determined, follow the development information
Each multimedia data set belonging to a group
Presents a development means for developing the presentation scenario template by applying the presentation scenario template deployed to individual multimedia data set, a group of multimedia data of the execution result of the program against with raw made is a presentation means for executing the scenario developed a scenario for selecting the group was called from the scenario for selecting the groups, other than the group of multimedia data that is currently presented selected by the user multimedia data presentation system which is characterized in that it has a Hisage示制control means Ru is presenting the group. 7. An execution result of a program that returns a set of N or less sets of multimedia data including a certain positive integer N ( N is a natural number of 2 or more ) and including video data, audio data and text data is presented. A storage medium storing a multimedia data presentation program, which is a professional medium composed of N or less sets of multimedia data.
When the gram execution result is input, N sets of multimedia
A set of multimedia data
Describe the relative temporal order and relative spatial position relationship to be presented
The presentation scenario template that was created is registered in advance in the expanded file.
Also, when developing the presentation scenario template from one set to N sets
From the expansion information that describes the inter-sequential order and the spatial position,
Presentation scenario chicks that are defined from 1 to N depending on the expansion information
The number of multimedia data sets (N or less)
A step of developing the presentation scenario template just below), the number of sets of multimedia data only (N or less), the individual multimedia data set by applying the presented scenario template deployed, execution of the program program to execute the step of presenting the results of the multimedia data, the multimedia data presentation device
A storage medium storing multimedia data presentation program, wherein storing the beam. 8. n (n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A storage medium storing a multimedia data presenting program for presenting the execution result of a program that returns a number of sets of multimedia data , the program comprising n or less sets of multimedia data.
When the execution result of the program is input, the n sets of multimedia
Use the grouping function to set the data set of N or more
Divide into groups of multimedia data below
Steps and a plurality of multi-parameters that make up N sets of multimedia data.
Relative temporal order and relative to present timedia data
Presentation scenario template that describes the spatial relationship, and deployment information
From the set of the presentation scenario template registered in the file
Temporal order and spatial position to develop up to N sets and presentation
Selection scenario for user to indicate which group should be
The group to be presented is determined from the deployment information that describes
Then, the multimedia data set belonging to the group
Steps for developing the presentation scenario template corresponding to each
If, depending on applying the presentation scenario template deployed to individual multimedia data set, the program
Step in which while the present a group of sets of multimedia data of the execution result, to perform the scenario Expand selection scenario for indicating a group to be the presentation
And flop, is started from the selected scenario, a group other than a group of multimedia data being currently presented user
The steps to select and present
A storage medium storing a multimedia data presentation program, which stores a program to be executed by a data presentation device . 9. n (n is a natural number exceeding N, N is 2 or more) including video data, audio data and text data.
A storage medium storing a multimedia data presenting program for presenting the execution result of a program that returns a number of sets of multimedia data , the program comprising n or less sets of multimedia data.
When the execution result of the program is input, the n sets of multimedia
Use the grouping function to set the data set of N or more
Divided into groups of multimedia data sets below
Steps and associations between groups of multimedia data
Steps to generate a scenario for selecting groups according to
And a plurality of multi-layers that make up N sets of multimedia data.
Relative temporal order and relative to present timedia data
A presentation scenario template that describes the spatial and positional relationships and is developed in advance.
The presentation scenario template registered in the information file
Temporal order and spatial position from 1 set to N sets, and
And present a scenario for selecting groups according to association
Expansion information that describes the temporal order and spatial positional relationship
Group to be presented based on the execution result of the program
Stearyl deploying when but are determined in correspondence to the set respective multimedia data belonging to the group Hisage shown scenario template
And-up by applying the individual sets in the exhibition <br/> opened by presentation scenario template multimedia data belonging to the group, as well as present a group of multimedia data of the execution result of the program, product performing a scenario obtained by expanding a scenario for selecting the groups, is activated from the scenario for selecting the group, the step of presenting by the user selects a group other than a group of multimedia data being currently presented , The
The program to be executed by the multimedia data presentation device.
A storage medium storing multimedia data presentation program, characterized in that stored.