JP3706621B2 - Multimedia presentation method and system - Google Patents

Description

[0001]
【Technical field】
The present invention relates to a multimedia presentation method and system for generating multimedia composed of images (including character images) and sounds (including music and narration).
[0002]
[Background]
Still images, narration, and background music (referred to as BGM) are used in combination for the purpose of merchandise guidance at stores and exhibition guidance at museums and museums. In particular, since narration and BGM are both sounds, they are often output from a single speaker. In general, narration and BGM are recorded separately (or separately recorded), and the narration sound signal and BGM sound signal are reproduced, mixed at an appropriate timing, and recorded on a recording medium ( Recording).
[0003]
Once the narration and music are mixed, the combination of these signals is fixed, so in order to shift or correct the timing of either one, you must start over.
[0004]
Even in the case of images and sounds, if signals (data) representing them are fixedly arranged and recorded on the recording medium in the order of appearance, there is a problem that correction and change are similarly not easy.
[0005]
DISCLOSURE OF THE INVENTION
The present invention provides a multimedia presentation method and system in which a plurality of different media (narration, music, images, etc.) can be freely and easily combined, and the combination, timing, etc. can be easily corrected and changed. Is.
[0006]
In the multimedia presentation method according to the present invention, a first recording medium on which a plurality of image data is recorded in association with their identification information, and a second recording medium in which a plurality of first sound data are recorded in association with their identification information. An image cast including at least identification information indicating image data representing an image to be displayed and image display start time data, and a third recording medium on which a plurality of second sound data are recorded. A sound cast including identification information indicating at least first sound data representing a sound to be generated and sound generation start time data, a list of image casts and sound casts used for presentation, and a first used for presentation A table describing the access information and start time data of the second sound data is created in advance and the fourth The image cast and sound cast included in the list are read from the fourth recording medium and the table is read from the fourth recording medium, and the first table is read according to the identification information included in the read image cast and sound cast. The image data and the first sound data are read from the recording medium and the second recording medium, the second sound data is read from the third recording medium in accordance with the access information of the read table, and the image cast, the sound cast, and the above According to the start time described in the table, an image represented by the read image data is displayed on the display device, and the sound represented by the read first and second sound data is output from the speaker.
[0007]
A multimedia presentation system according to the present invention includes a first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of image data in association with the identification information. , A second reading device for reading the first sound data corresponding to the instructed identification information from the second recording medium in which the plurality of first sound data are stored in association with the identification information; A third reading device for reading the second sound data designated by the given access information from the third recording medium storing the sound data, and an image represented by the image data read from the first recording medium , A first sound generator for generating the first sound represented by the first sound data read from the second recording medium, and a third recording medium A second sound generation device for generating a second sound represented by the second sound data, and an image cast including at least identification information indicating image data representing an image to be displayed and image display start time data, at least Sound cast including identification information indicating first sound data representing sound to be generated and start time data of sound generation, list of image cast and sound cast used for presentation, and second used for presentation The image cast and the sound cast included in the list are read from the fourth recording medium storing the table describing the access information of the sound data and the start time data thereof, the table is read, and the read image cast and sound are read. The first recording medium and the second recording medium according to the identification information included in the cast The image data and the first sound data are read from the recording medium, the second sound data is read from the third recording medium according to the read access information of the table, the image cast, the sound cast and the start described in the table According to the time, an image represented by the read image data is displayed on the display device, and the first and second sounds represented by the read first and second sound data are generated as the first and second sounds. A control device is provided for controlling the output from the device.
[0008]
At least two of the first recording medium, the second recording medium, and the third recording medium may be the same recording medium. When the first recording medium and the second recording medium are the same, the first reading device and the second reading device are the same device.
[0009]
At least a part of the first sound generator and the second sound generator may be shared.
[0010]
For example, the image represented by the image data is a still image, the sound represented by the first sound data is narration, and the sound represented by the second sound data is BGM. Therefore, it is possible to display a still image while playing BGM and to output a description of the still image as sound (narration).
[0011]
Still images are managed by image casting. Narration (first sound) is managed by sound cast. BGM (second sound) is managed by the above table. Accordingly, since all media are managed independently, the creation, modification, and change are not affected by other media, and the work is facilitated. These media are combined by start time data. Therefore, it is possible to select the output timing of the media based only on the start time data. As the third recording medium for BGM (second sound), a dedicated BGM (for example, a commercially available compact disk, magneto-optical disk, etc.) can be used as it is (without any processing). Images and sound materials can also be saved as is (unprocessed).
[0012]
In a preferred embodiment, the resolution, position or enlargement / reduction ratio of the image to be displayed is described in advance in the image cast, and the image is displayed according to this description.
[0013]
If the effect to be executed at the first stage of image display and the time for the effect are described in advance in the image cast, the effect display according to this description can be performed.
[0014]
In another preferred embodiment, the time data representing the portion to be generated in the sound data is described in advance in the sound cast, so that the sound in the time zone defined by the time data can be generated.
[0015]
So-called combined image data can also be used. That is, a coalesced image file including a plurality of image data and data related to the synthesis of these image data is stored in advance in the first recording medium as the image data, and the identification information of the coalesced image file is included in the image cast. Is included. Thus, when a coalesced image file is instructed by image casting, at least two images defined in the coalesced image file can be combined and displayed.
[0016]
The format of the combined image data and the synthesizing method thereof are described in detail in the specification of a patent application (Docket No. 94086) filed on the same day as the present applicant.
[0017]
The present invention is also applicable to a combination of narration (first sound) and BGM (second sound) (without an image). In this specification, two types of sounds are also included in the concept of multimedia.
[0018]
The multimedia presentation method according to the present invention includes a first recording medium that records a plurality of first sound data in association with identification information thereof, a second recording medium that records a plurality of second sound data, and , A sound cast including at least identification information indicating first sound data representing a sound to be generated and sound generation start time data, a list of sound casts used for presentation, and a second used for presentation A table describing the access information of the sound data and its start time data is created in advance and stored in the third recording medium, and the sound cast included in the list is read from the third recording medium and The table is read, and the first sound data from the first recording medium according to the identification information included in the read sound cast The second sound data is read from the second recording medium in accordance with the read access information of the table, and is read by the first and second sound data read in accordance with the sound cast and the start time described in the table. The sound to be expressed is output from the speaker.
[0019]
The multimedia presentation system corresponding to the above-described method has a first sound medium corresponding to the instructed identification information from a first recording medium storing a plurality of first sound data in association with the identification information. A first reading device for reading data, a second reading device for reading second sound data designated by given access information, from a second recording medium storing second sound data; The first sound generator for generating the first sound represented by the first sound data read from the recording medium, and the second sound represented by the second sound data read from the second recording medium For a sound cast and presentation including identification information indicating at least first sound data representing sound to be generated and sound generation start time data The sound cast included in the list is read out from a third recording medium storing a list describing the access information of the second sound data used for the presentation and the start time data of the second sound data used for the presentation. The table is read, the first sound data is read from the first recording medium according to the identification information included in the read sound cast, and the second sound data is read from the second recording medium according to the read access information of the table. The first and second sounds represented by the read first and second sound data are output from the first and second sound generators according to the sound cast and the start time described in the table. A control device is provided for performing control.
[0020]
The present invention can also be applied to the case where a still image (image) and BGM (sound) are presented (no narration). This multimedia presentation method uses at least an image to be displayed using a first recording medium on which a plurality of image data is recorded in association with their identification information and a second recording medium on which a plurality of sound data is recorded. Describes an image cast including identification information indicating image data and image display start time data, a list of image casts used for presentation, and access information of sound data used for presentation and its start time data The table is created in advance and stored in the third recording medium, the image cast included in the list is read from the third recording medium, the table is read out, and the identification information included in the read image cast is Therefore, the image data is read from the first recording medium, and the read table is read. The sound data is read from the second recording medium according to the access information of the image, the image represented by the read image data is displayed on the display device according to the start time described in the image cast and the table, and the read sound data Is output from the speaker.
[0021]
A multimedia presentation system corresponding to this method reads out first image data corresponding to instructed identification information from a first recording medium storing a plurality of image data in association with the identification information. A reading device, a second reading device for reading sound data designated by given access information from a second recording medium storing sound data, and an image represented by image data read from the first recording medium A display device for displaying the sound, a sound generating device for generating sound represented by the sound data read from the second recording medium, identification information indicating image data representing at least an image to be displayed, and image display start time data, For image casts, lists of image casts used for presentations, and presentations The image cast included in the list is read out from the third recording medium storing the table describing the access information of the sound data to be used and the start time data, and the table is read out, and the identification information included in the read image cast The image data is read from the first recording medium according to the above, the sound data is read from the second recording medium according to the access information of the read table, and the read image is read according to the image cast and the start time described in the table. A control device is provided for controlling the image represented by the data to be displayed on the display device and to output the sound represented by the read sound data from the sound generating device.
[0022]
As described above, according to the present invention, a plurality of media can be freely and easily combined. It is not always necessary to add processing to the media material. It is easy to modify or change a plurality of media to be combined or a combination thereof.
[0023]
【Example】
FIG. 1 shows an overview of the overall configuration of the multimedia presentation system. This system can also be used for multimedia data creation.
[0024]
The computer system 10 may be dedicated to multimedia presentation (and multimedia data creation) or a general-purpose computer system programmed for multimedia presentation (and multimedia data creation) .
[0025]
The computer system 10 includes a CPU 11, a memory 12, an input device 13, and a display device 14. The memory 12 includes a semiconductor memory, a floppy disk, a hard disk, etc., and stores a program executed by the CPU 11 or is used as a work area. The input device 13 includes a keyboard, a mouse, etc., and gives commands, data, etc. to the CPU 11. The display device 14 is realized by a CRT display device, a liquid crystal display device or the like, for example.
[0026]
The computer system 10 is connected to a disk driver 15, an image system, and two sound systems via a SCSI (Small Computer System Interface) bus.
[0027]
The disk driver 15 writes data to a disk-shaped recording medium (optical disk, magneto-optical disk, magnetic disk, etc.) and reads data from this recording medium. The recording medium read / written by the disk driver 15 is referred to as a management recording medium in order to distinguish it from other recording media. On the management recording medium, a reproduction management file, a media description table, an image cast file, a sound cast file, etc., which will be described in detail later, are recorded or recorded.
[0028]
The image system includes a disk driver 21, an image reproduction device 22, and a display device 23. A disk-shaped recording medium read / written by the disk driver 21 is referred to as an image recording medium. An image recording medium is an image file (image data representing an image for one screen (including image data that has been compressed or encoded, character image data, and a combined image file described later) is called an image file. Is referred to as an album) or is recorded.
[0029]
Each image file stored in the image recording medium stores an album name, a header including the file name, detailed information for image reproduction, image data, and the like. For one picture or character image, image data having a plurality of types of resolutions may be stored in an image file.
[0030]
The image reproducing device 22 performs a process of displaying on the display device 23 the image data read from the image recording medium by the disk driver 21 or the image represented by the image data given from the computer system 10. , A D / A conversion circuit, an image processing circuit, a display control circuit, and the like.
[0031]
The display device 23 is realized by a CRT display device or a liquid crystal display device (including those used as part of a video projector). The multimedia presentation system may be provided with at least one of the display device 14 of the computer system 10 or the display device 23.
[0032]
The first sound system includes a disk driver 31, a sound reproduction device 32, and a speaker 33. A disk-shaped recording medium read / written by the disk driver 31 is referred to as a first sound recording medium. The first sound recording medium records digital data (including ADPCM: Adaptive Differential Pulse Code Modulation) representing sound such as narration. A unit of sound data, such as a single narration, is called a sound file. Music may be recorded on the first sound recording medium.
[0033]
The sound file stored in the first sound recording medium is also configured to include an album name, a header including the file name, information necessary for reproduction, and sound data. However, the album name, file name, and information may be stored in a directory.
[0034]
The sound reproducing device 32 converts sound data read from the first sound recording medium into a sound signal and drives the speaker 33, and includes an ADPCM decoding circuit, a D / A conversion circuit, and the like.
[0035]
The sound recording medium may store a part or all of MIDI (Musical Instrument Digital Interface) data. In this case, the sound reproducing device 32 includes an electronic musical instrument.
[0036]
The image file of the image recording medium and the sound file of the first sound recording medium may be stored in one recording medium. In this case, one driver is sufficient. The high-speed disk driver can read the image file and the sound file in a time-sharing manner, and can simultaneously display an image and generate (output) sound based on the read data. The image recording medium, the first sound recording medium, and the management recording medium can be realized by a single recording medium. In this case, the drivers 15, 21, and 31 can be realized by a single driver. In any case, at least two of the above three types of recording media can be realized by one recording medium.
[0037]
The second sound system includes a disk driver 41, a sound reproduction device 42, and a speaker 43. The configuration of the second sound system is basically the same as the configuration of the first sound system. The disk-shaped recording medium read / written by the disk driver 41 is referred to as a second sound recording medium. In this embodiment, the second sound recording medium records a BGM signal (data). As the second sound recording medium, a commercially available compact disk or magneto-optical disk can be used as it is. The speaker 33 of the first sound system can also be used as the speaker 43 of the second sound system.
[0038]
Preferably, the disk driver 41 of the second sound system is provided with a disk autochanger. Thus, a plurality of second sound recording media can be loaded in the disk driver 41.
[0039]
Instead of a disk-shaped recording medium, a semiconductor memory or a tape-shaped recording medium can be used.
[0040]
An image data input device, sound data input device, or the like may be connected to the multimedia presentation system (or multimedia data creation system). The image data input device may include, for example, a device for A / D converting an input video signal and compressing the data. The sound data input device may include a microphone, an A / D conversion circuit, a buffer memory, an ADPCM encoding circuit, and the like.
[0041]
FIG. 2 shows an example of a sequence of still images, narration and BGM generated in the multimedia presentation system of this embodiment.
[0042]
BGM is streamed throughout the presentation. After one BGM is completed, the next BGM may be played after a free time. Three types of BGM # 1 to BGM # 3 are shown. These BGM # 1 to BGM # 3 are described by event descriptors (1) to (3).
[0043]
While still images are displayed for an appropriate time, the images are sequentially switched. There may be a time zone in which nothing is displayed between one still image and the next still image. Five types of still images # 1 to # 5 are shown, and these still images are described by image casts (1) to (5), respectively.
[0044]
Narration is output corresponding to each still image. You can also start the next narration as soon as one narration ends. Five types of narrations # 1 to # 5 are shown, which are described by sound casts (1) to (5).
[0045]
The start time for generating these BGM, still image, and narration is described in the event descriptor, image cast, and sound cast, as will be described later. The start time is expressed in hours, minutes, and seconds, and is determined on the basis of the start time of the presentation (first time of BGM, still image or narration start time) (zero time, zero minute, zero second).
[0046]
FIG. 3 shows a recording structure in the management recording medium. The management recording medium is provided with a reproduction management file, a media description table, an image cast file, and a sound cast file.
[0047]
The playback management file manages event descriptors, image casts, and sound casts, and defines the flow (sequence) of multimedia presentation.
[0048]
The detailed structure of the playback management file is shown in FIG. The reproduction management file includes a reproduction management file header, a time control table (TCT), and a sequence table.
[0049]
The reproduction management file header describes a reproduction management file ID, a pointer of each data included in the file, the number of casts, and the like.
[0050]
The time control table stores event descriptors related to all GBMs that occur in one presentation. The event descriptor includes an ID of each BGM (data for identifying an audio track that generates the BGM, for example, a path for accessing a corresponding audio track described in a media description table described later), and a start time of each BGM. And data representing.
[0051]
In this example, two second sound recording media are used, one of which is No. 1 and the other is No. 2. BGM # 1 is recorded on the first track of the recording medium of No. 1, and is therefore expressed as an audio track No. 1-1. BGM # 2 is the third track (audio track No.1-3) of the recording medium No.1, and BGM # 3 is the fourth track (audio track No.2-4) of the recording medium of No.2. Each is reproduced based on the recorded data.
[0052]
The time control table also describes its header and data representing the number of event descriptors stored (number of events).
[0053]
The sequence table lists and describes the image casts and sound casts related to all still images and narration that are played back in one presentation. Preferably, they are arranged in order of their start times.
[0054]
As shown in FIG. 5, the media description table includes the identification number (disc No. or disc volume name) and track No. of the second sound recording medium on which the music data used to play each BGM is recorded. (ID indicating a track) is stored. The track to be reproduced on the second sound recording medium is accessed using the audio track ID described here. The contents of this media description table may be included in the event descriptor.
[0055]
The image cast file stores a number of already created image casts. An example of the structure of each image cast is shown in FIG.
[0056]
The image cast includes a header, album name, image file name, start time, image appearance effect, image appearance effect time, image resolution, position information, enlargement magnification, and the like.
[0057]
The header indicates an image cast.
[0058]
The album name and the image file name indicate the image file to be reproduced.
[0059]
As described above, the start time is the display start time of the still image.
[0060]
The effect of image appearance is to display the next image in such a way that the full screen is suddenly displayed (whether the full screen is switched instantaneously) or the double door (or curtain) is opened at the start of image display. Whether to display the next image while sweeping from right to left, whether to start displaying an image while sweeping from top to bottom, or whether to make the picture appear while gradually expanding the display area from the center Select the screen effect. The image appearance effect time is the time from the start of the appearance of a part of the image until the entire appearance.
[0061]
The image resolution is for selecting any image data when the image file includes image data of a plurality of types of resolutions. By designating this resolution, image data is selected as a result.
[0062]
The position information represents the position on the display screen of the image to be displayed. For example, it is expressed by the X and Y coordinates of the center of the image to be displayed.
[0063]
The enlargement magnification (including the reduction magnification) represents the magnification at which the displayed image is enlarged or reduced.
[0064]
In addition, the image cast includes compression information and rotation information as necessary. The compression information includes whether or not the image data included in the image file is data-compressed, and if it is compressed, the compression method (for example, JPEG method). The rotation information indicates how many times it should be rotated counterclockwise in order to display the image data of the image file correctly to the observer. For example, this information includes 0 degrees, 90 degrees, 180 degrees, and 270 degrees.
[0065]
If necessary, display time is described in the image cast. The display time indicates a time zone during which a still image is displayed. Control is performed so that the display of the still image disappears when the display time has elapsed after the start of the display of the still image.
[0066]
Many sound casts are stored in the sound cast file. A configuration example of the sound cast is shown in FIG.
[0067]
The sound cast includes a header, sound file name, track number, start time, attribute, start pointer, stop pointer, and the like.
[0068]
The header indicates a sound cast.
[0069]
The file name identifies the sound file to be played. The track number indicates the track number on the first sound recording medium where the sound file to be reproduced exists. When the track number is uniquely determined by the file name, the track number is not always necessary.
[0070]
The start time is the time at which the occurrence of narration should start as described above.
[0071]
The attribute indicates the nature of the sound, such as mono / stereo, number of channels, modulation method, and the like.
[0072]
For sounds, not all sounds (narration) in a sound file are played. For example, it may be required to play back only a specific part (this is called a clip) in a series of narrations (one sound file). The start pointer and stop pointer express the start position and end position of a clip to be reproduced in time with the position of the first sound in the sound file as a reference.
[0073]
8 and 9 show a processing procedure for generating (reproducing) multimedia in the multimedia presentation system. This process is mainly executed by the CPU 11 in the computer system 10.
[0074]
As described above, the reproduction management file, media description table, image cast file, and sound cast file shown in FIG. 3 are stored in the management recording medium accessed by the disk driver 15.
[0075]
The still image file is stored in an image recording medium accessed by the disk driver 21. The narration sound data file is stored in the first sound recording medium accessed by the disk driver 31. The BGM sound data is stored in the second sound recording medium (s) that is accessed by the disk driver 41.
[0076]
When an input designating a reproduction management file to be reproduced is given from the input device 13, the CPU 11 activates the disk driver 15 to read the designated reproduction management file from the management recording medium and to read the work Store in the area (step 51).
[0077]
Based on the event descriptor of the time control file of the reproduction management file, the CPU 11 reads the media description table of the management recording medium. Using the audio track ID described in this media description table, the disk driver 41 is made to access the second sound recording medium, and its volume label, table of contents, etc. are read out, and the medium is based on this. It is checked whether all the recording media and tracks described in the description table exist (step 52).
[0078]
When the CPU 11 finds that the predetermined second sound recording medium and track are present, the CPU 11 then transmits the image cast and sound cast described in the sequence table of the reproduction management file to the image cast file of the management recording medium. Then, it is read from the sound cast file and stored in the work area (step 53).
[0079]
Based on these read image and sound casts, it is checked whether there are all image and sound casts described in the sequence table. If it exists, the CPU 11 further activates the disk drivers 21 and 31, and all the image files and first sound files described in the previously read cast are stored in the image recording medium and the first sound file. It is checked whether it is recorded on the recording medium (step 54).
[0080]
If the second sound recording medium or track specified by the event descriptor of the time control table does not exist, at least one cast described in the sequence table does not exist in the management recording medium. If there is no file in the cast or in the first sound recording medium, an error occurs, and that fact is displayed on the display device 14 or other display device 23. The
[0081]
If there is no error, the reproduction operation is performed according to the reproduction management file stored in the read work area.
[0082]
Referring to FIG. 9, CPU 11 arranges all start times described in the time control table and start times included in all image casts and sound casts described in the sequence table in order of time. A time table is created (step 55). According to this time table, sequences of events (BGM) and casts (still images, narration) are managed.
[0083]
If there is time required for preprocessing such as decompression of compressed image data, other processing of image data, and image synthesis, this preprocessing time may be written in the time table. preferable. By doing so, pre-processing can be performed in advance before output processing (display, sound generation) according to the event cast.
[0084]
A timer for managing time is started (step 56), and the time counted by the timer (including time zero) is compared with the time listed in the time table. When both times coincide (step 57), an output process is performed for an event or cast whose start time is the time (step 59).
[0085]
In the case of an event (BGM), the audio track No. is acquired from the media description table, and the disk driver 41 is controlled based on this data. Therefore, the GBM represented by the second sound data recorded on the designated audio track No. is output from the speaker 43.
[0086]
In the case of an image cast, the image recording medium is accessed using the album name and file name included in the image cast, and the corresponding image file is read out and stored in the work area. When the read image data is compressed, an expansion process is performed. According to the image rotation information described in the image file, the image data in the work area is rotated as necessary. In accordance with the enlargement / reduction ratio described in the image cast, the image data is enlarged or reduced as necessary. If necessary, the image data is positioned and cut out according to the position information in the image cast.
[0087]
Preferably, the image reproducing device 22 is provided with two VRAMs. One is for the currently displayed image and the other is for the next image to be displayed. In such a case, the image data of the work area is transferred to the VRAM of the image reproducing device 22 and stored in advance. When the start time comes, an image appearance effect and an effect time are given to the image reproducing device 22 together with a display command, and an image represented by the image data on the VRAM is displayed on the display device 23 with the instructed effect. Will be displayed.
[0088]
When the image reproducing device 22 has only one VRAM, the image data is written into the VRAM at the start time and displayed immediately.
[0089]
In the case of sound cast, the start pointer and stop pointer (expressed in time) included in the sound cast are converted into physical addresses on the sound recording medium, respectively. A reproduction command including the data described in the sound cast and the physical address is given to the sound reproduction device 32. In response to this, the sound reproducing device 32 reproduces the instructed clip (narration) in the sound file instructed from the sound recording medium, and outputs the narration from the speaker 33.
[0090]
The time table preferably describes the time to end all sounds and images, and when this end time is reached (step 58), the presentation ends. When the sound (BGM or narration) is completed, a report to the effect that the sound reproduction has ended is received from the sound reproducing devices 32 and 42, and the end time can be determined by accepting this report. In the case of a still image, the processing ends when the display time of the still image elapses.
[0091]
As one mode of the image file, there is a combined image file. The combined image file includes a plurality of types of image data (for example, natural images and character images) and combined information. The merge information includes information (type of image to be merged) on which of the plurality of image data included in the merged image file is used, and a synthesis (merging) method. Information on the types of images to be merged includes information on whether to merge or not. In the case of combining, image data to be combined is specified. If they are not merged, it is described which image (natural image, character image) is used. The merge method includes OR, AND, NOR, and the like.
[0092]
When such a coalesced image file is designated by image casting, a plurality of pieces of image data are synthesized and displayed according to the coalescing information.
[0093]
The multimedia presentation system will be used for product guidance at stores, guidance for exhibits (paintings) at museums, presentation of information at conferences, parties, etc., and reports.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a multimedia presentation system.
FIG. 2 shows an example of a sequence of multimedia presentation.
FIG. 3 shows an example of a recording structure of a management recording medium.
FIG. 4 shows a structure example of a reproduction management file.
FIG. 5 shows an example of the structure of a media description table.
FIG. 6 shows an example of the structure of an image cast.
FIG. 7 shows a structure example of sound cast.
FIG. 8 is a flowchart showing an example of multimedia presentation processing.
FIG. 9 is a flowchart showing an example of multimedia presentation processing.
[Explanation of symbols]
10 Computer system
11 CPU
15, 21, 31, 41 Disk driver
22 Image playback device
23 Display device
32, 42 sound playback device
33, 43 Speaker

Claims (11)

A first recording medium on which a plurality of image data is recorded in association with their identification information;
A second recording medium on which a plurality of first sound data are recorded in association with their identification information;
Using a third recording medium on which a plurality of second sound data is recorded,
A plurality of image casts including at least identification information indicating image data representing an image to be displayed and image display start time data; identification information indicating at least first sound data representing a sound to be generated ; and sound generation start time Multiple sound casts containing point-in-time data representing data and sound data to be generated, image casts of images to be displayed for presentation and sound casts of sounds to be generated in the order in which they should be output stored in the fourth recording medium and create sequences to sequence table describing, and the second sound data access information and time control table describing its start time data used for presentation in advance And
Reading the image cast and sound cast included in the sequence table from the fourth recording medium and reading the time control table;
In accordance with the identification information included in the read image cast and sound cast, the sound of the time zone defined by at least the time point data among the image data and the first sound data from the first recording medium and the second recording medium is represented. the partial readout reads out the second sound data from the third recording medium according to the access information read out the time control table, the image cast, sound casting and the time control start time described in the table Therefore, an image represented by the read image data is displayed on the display device, and is represented by the sound in the time zone defined by the time point data and the read second sound data among the sounds represented by the read first sound data. Sound output from the speaker,
Multimedia presentation method.   The multimedia presentation method according to claim 1, wherein at least two of the first recording medium, the second recording medium, and the third recording medium are the same recording medium.   The multimedia presentation method according to claim 1 or 2, wherein the resolution, position or enlargement / reduction ratio of an image to be displayed is described in advance in an image cast, and an image according to the description is displayed. A coalesced image file including a plurality of image data and data relating to the synthesis of these image data is stored in advance on the first recording medium as the image data, and the identification information of the coalesced image file is included in the image cast. Aside,
When a coalesced image file is specified by an image cast, at least two images specified in the coalesced image file are combined and displayed.
The multimedia presentation method according to any one of claims 1 to 3 . A first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of pieces of image data in association with the identification information;
A second reading device for reading the first sound data corresponding to the instructed identification information from the second recording medium storing the plurality of first sound data in association with the identification information;
A third reading device for reading the second sound data specified by the given access information from the third recording medium storing the second sound data;
A display device for displaying an image represented by image data read from the first recording medium;
A first sound generator for generating a first sound represented by first sound data read from a second recording medium;
Second sound generator for generating second sound represented by second sound data read from third recording medium, identification information indicating image data representing at least image to be displayed, and start of image display plurality of images cast including the time data, a plurality of containing the time data representing a portion to be generated out of at least the first identification information indicating the sound data representing the sound to be generated, start time data, the sound data of the sound generation A sound table , a sequence table in which image casts of images to be displayed for presentation and sound casts of sounds to be generated are arranged in the order to be output , and a second table used for presentation Time control table describing access information and start time data of sound data The image cast and sound cast included in the sequence table are read out from the fourth recording medium storing the image and the time control table is read out, and the first information is included in accordance with the identification information included in the read image cast and sound cast. Read out at least a portion of the image data and the first sound data representing the sound in the time zone defined by the time point data from the recording medium and the second recording medium, and the read access information of the time control table Therefore, the second sound data is read from the third recording medium, and the image represented by the read image data is displayed on the display device in accordance with the image cast, the sound cast and the start time described in the time control table. Displayed by the read first sound data. A second sound represented by the second sound data were sound and reading of the time zone that is defined by the time data of the first sound to be output from the first and second sound generating device to be Control device to control,
Multimedia presentation system with 6. The multimedia presentation system according to claim 5 , wherein at least two of the first recording medium, the second recording medium, and the third recording medium are the same recording medium. 6. The multimedia presentation system according to claim 5 , wherein at least a part of the first sound generator and the second sound generator are shared. A first recording medium on which a plurality of first sound data is recorded in association with their identification information;
Using a second recording medium on which a plurality of second sound data is recorded,
First identification information indicating the sound data representing the sound to be at least generating a plurality of sound cast including time data representing a portion to be generated out of the start time data, the sound data of the sound generation, to be generated for presentation A sequence table in which the sound casts of the sounds are arranged and described in the order to be output , and a time control table in which the access information of the second sound data used for the presentation and its start time data are created in advance Stored in a third recording medium,
Reading the sound cast included in the sequence table from the third recording medium and reading the time control table,
According to the identification information included in the read sound cast, the time control table is read out by reading out the portion representing the sound in the time zone defined by at least the time point data from the first recording medium from the first recording medium. follow the read second audio data from the second recording medium according to the access information, the sound casting and the time control table described start time, of the sound represented by the first sound data read Outputting the sound of the time zone specified by the time data and the sound represented by the read second sound data from the speaker;
Multimedia presentation method. A first reading device for reading first sound data corresponding to instructed identification information from a first recording medium storing a plurality of first sound data in association with the identification information;
A second reading device for reading second sound data designated by given access information from a second recording medium storing second sound data;
A first sound generating device for generating a first sound represented by first sound data read from a first recording medium;
A second sound generating device for generating a second sound represented by the second sound data read from the second recording medium, and at least identification information and sound indicating the first sound data representing the sound to be generated Sequence table described by arranging multiple sound casts including generation start time data and time data representing the portion to be generated among sound data, and sound casts of sounds to be generated for presentation in the order to be output , and reads the sound cast contained in the third the sequence table from the recording medium storing the second sound data time control table describing the access information and its start time data to be used for presentation The above time control table is read and included in the read sound cast. According to the identification information, at least a portion representing the sound in the time zone defined by the time point data is read from the first sound data from the first recording medium, and according to the read access information of the time control table. reads the second sound data from the second recording medium, in accordance with sound casting and the time control table described start time, the first sound above among represented by the first sound data read A control device for controlling to output from the first and second sound generators the sound of the time zone defined by the time point data and the sound represented by the read second sound data ;
Multimedia presentation system with A first recording medium on which a plurality of image data is recorded in association with their identification information;
Using a second recording medium that records a plurality of sound data,
A plurality of image casts including at least identification information indicating image data representing an image to be displayed and image display start time data, an image cast sequence table of images to be displayed for presentation, and used for presentation A time control table describing the access information of the sound data and its start time data is created in advance and stored in the third recording medium,
Reading the image cast included in the sequence table from the third recording medium and reading the time control table;
The image data is read from the first recording medium in accordance with the identification information included in the read image cast, and the sound data is read from the second recording medium in accordance with the access information of the read time control table. According to the start time described in the time control table, the image represented by the read image data is displayed on the display device, and the sound represented by the read sound data is output from the speaker.
Multimedia presentation method. A first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of pieces of image data in association with the identification information;
A second reading device for reading sound data specified by given access information from a second recording medium storing sound data;
A display device for displaying an image represented by image data read from the first recording medium;
A sound generating device for generating sound represented by sound data read from the second recording medium, and a plurality of image casts including at least identification information indicating image data representing an image to be displayed and image display start time data , A third recording medium storing a sequence table of image casts of images to be displayed for presentation, and a time control table describing access information and start time data of sound data used for presentation The image cast included in the sequence table is read out, the time control table is read out, the image data is read out from the first recording medium according to the identification information included in the read image cast, and the time Control table access The sound data is read from the second recording medium according to the access information, the image represented by the read image data is displayed on the display device according to the start time described in the image cast and the time control table, and read out. A control device for controlling the sound represented by the sound data to be output from the sound generator;
Multimedia presentation system with

Images