JPH0844857A - Method and system for multimedia presentation, method and system for preparing multimedia data and method and system for compositing image - Google Patents

Abstract

PURPOSE:To facilitate the preparation and correction of multimedia data by reading image data and sound data from first and second recording media, displaying the image of the read image data on a display device in the order of descriptions in a script file and outputting the sound of the read sound data from a loudspeaker. CONSTITUTION:Plural pieces of image data are previously stored in the first disk-shaped recording medium of a disk driver 21 while being related to their discrimination information. Besides, plural pieces of voice data are stored in the second disk-shaped recording medium of a disk driver 31 while being related to their discrimination information. The image data and the voice data are read from those first and second disk-shaped recording media by a voice reproducing device 32 and an image reproducing device 22 respectively, in the order of descriptions in the script file of a third disk-shaped recording medium for management of a disk driver 15, that image is displayed on a display device 23 and that voice is outputted from a speaker 33. Thus, the preparation and correction of multimedia data can be facilitated.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a multimedia presentation method and system for generating multimedia consisting of images (including character images) and sounds (including music, narration, etc.), and multimedia used in this presentation method and system. The present invention relates to a method and system for creating media data, and a method and system for synthesizing images included in multimedia or images used for other purposes.

[0002]

BACKGROUND ART In order to generate images (mainly still images) and sound sequentially in time order (regardless of whether image and sound are simultaneous), image data and sound data are generated in time order. Must be arranged on the recording medium. When a part of such multimedia data (data consisting of image data and sound data) is modified (data addition, deletion, replacement or change), the entire multimedia flow is reconstructed and Since it is necessary to rewrite all the data (at least the data after the corrected portion), the work must be complicated.

On the other hand, a still image used for multimedia or a still image used for other purposes may be created by synthesizing two or more images. For example, there is a case where a picture and a character are combined. In such a case, if the picture before combining, the character, and the image after combining are to be stored, three types of image data representing the picture before combining, image data representing the character, and combined image data are available. Must be recorded on a recording medium, and a large recording capacity is required. If only the composite image data is stored, it is difficult to correctly restore the image data of a picture or character before composition when it is needed.

[0004]

DISCLOSURE OF THE INVENTION The present invention facilitates the creation and modification of multimedia data.

According to the present invention, the recording capacity is reduced so that the image data before composition can be stored and the images can be composed.

In the method of creating multimedia data according to the present invention, a first recording medium storing a plurality of image data in association with their identification information and a plurality of sound data in association with their identification information are stored. Using the second recording medium, an image cast including identification information indicating at least image data representing an image to be displayed, a sound cast including identification information indicating at least sound data representing sound to be generated, and an order of outputting. The script file in which the image cast and the sound cast are arranged is created and stored in the third recording medium.

At least two of the first recording medium, the second recording medium and the third recording medium may be the same recording medium.

In a preferred embodiment, from the reference time point of the image display according to the preceding image cast or the reference time point of sound generation according to the sound cast, the reference time point of image display according to the subsequent image cast or the sound generation according to the sound cast The transition time to the reference time of
Alternatively, the transition time from the start time of the presentation to the reference time point of image display according to the image cast or the reference time point of sound generation according to the sound cast is included in the image cast or script file.

In a further preferred embodiment, the display time of the image is included in the image cast or script file.

In another embodiment, the resolution, position or enlargement / reduction ratio of the image to be displayed is included in the image cast.

In yet another embodiment, the effect and time to be performed in the first stage of displaying the image are included in the image cast.

More preferably, the sound cast includes time data representing a portion of the sound data to be generated.

In a preferred embodiment, a merged image file containing a plurality of image data and data relating to the combination of these image data is stored in the first recording medium as the image data, and the merged image file is used for the image cast. Include identification information.

The multimedia data creating system according to the present invention reads the image data corresponding to the instructed identification information from the first recording medium in which the plurality of image data are stored in association with the identification information. Reader,
A second reading device for reading sound data corresponding to the designated identification information from a second recording medium that stores a plurality of sound data in association with the identification information, and at least image data representing an image to be displayed A third recording of a script file in which the image cast including the identification information indicating the sound, the sound cast including the identification information indicating the sound data indicating the sound to be generated, and the image cast and the sound cast are arranged in the order to be output. A recording device for recording on a medium is provided.

According to the present invention, a description about an image to be displayed is an image cast, a description about a sound to be generated is a sound cast, and a reproduction order of the image and the sound is a script.
Included in each file. Since these image information, sound information, and order information can be handled separately, their creation and modification are facilitated.

The present invention provides a multimedia presentation method and system using the multimedia data thus created.

In the multimedia presentation method according to the present invention, a plurality of image data are associated with their identification information and stored in advance in the first recording medium, and a plurality of sound data are associated with the identification information. An image cast including identification information indicating at least image data representing an image to be displayed, a sound cast including identification information indicating at least sound data indicating a sound to be generated, and output. A script file in which image casts and sound casts are arranged in a power sequence is created and stored in the third recording medium, the script file is read from the third recording medium, and is described in the read script file. Read out the image cast and sound cast, and read out the read image cast and sound key. The image data and the sound data are read from the first recording medium and the second recording medium according to the identification information included in the list, and the images represented by the read image data are displayed on the display device in the order described in the script file. The sound represented by the displayed and read sound data is output from the speaker.

The multimedia presentation system according to the present invention reads the image data corresponding to the instructed identification information from the first recording medium in which a plurality of image data are stored in association with the identification information. Reading device, a second recording device that reads a plurality of sound data in association with their identification information and stores the sound data corresponding to the specified identification information, and a first recording medium A display device for displaying an image represented by the read image data, a sound generating device for producing a sound represented by the sound data read from the second recording medium,
And an image cast including identification information indicating at least image data representing an image to be displayed, a sound cast including at least identification information indicating sound data representing a sound to be generated, and an image cast and a sound cast in an output order. The script file is read from the third recording medium in which the arranged script files are stored, the image cast and the sound cast described in the read script file are read, and the identification information included in the read image cast and the sound cast is read. Therefore, the image data and the sound data are read from the first recording medium and the second recording medium, the images represented by the read image data are displayed on the display device in the order described in the script file, and the read sound is read. Generates the sound represented by the data And a control device for controlling so as to put et output.

At least any two of the first recording medium, the second recording medium and the third recording medium may be the same recording medium. When the first recording medium and the second recording medium are the same recording medium, the first reading device and the second reading device are the same device.

In this way, a presentation is effectively performed based on the multimedia data created by the above method.

The present invention further provides an image synthesizing method and system using a merged image file.

In the image synthesizing method according to the present invention, a merged image file containing a plurality of image data and data relating to the synthesis of these image data is stored in advance in a recording medium, and the merged image file is recorded from the recording medium. Is read out, at least two pieces of image data are combined on the memory in accordance with the combined data in the read-out combined image file, and the image represented by the image data obtained by the combination is displayed on the display device.

According to the image synthesizing method of the present invention, a reading device for reading a merged image file from a recording medium storing a merged image file containing a plurality of image data and data relating to the synthesis of these image data is read by the reading device. An image synthesizing means for synthesizing at least two pieces of image data on a memory in accordance with the synthesizing data in the merged image file, and a display device for displaying an image represented by the image data obtained by the synthesizing.

According to the present invention, it is not necessary to store the combined image data in the recording medium, so that the capacity can be effectively used. Moreover, all the image data before and after the coalescence can be easily obtained.

[0025]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT FIG. 1 shows an overview of the overall configuration of a multimedia presentation system. The system can also be used for multimedia data creation and image composition.

The computer system 10 may be dedicated to multimedia presentations (and multimedia data creation and image synthesis), or a general-purpose computer system may be used for multimedia presentations (and multimedia data creation and image creation). It may be programmed to (synthesis).

The computer system 10 includes a CPU 11, a memory 12, an input device 13, and a display device 14.
The memory 12 includes a semiconductor memory, a floppy disk, a hard disk, etc., and stores a program executed by the CPU 11 and is used as a work area. The input device 13 includes a keyboard, a mouse, etc., and gives commands, data, etc. to the CPU 11. The display device 14 is realized by, for example, a CRT display device, a liquid crystal display device, or the like.

Computer system 10 has a SCSI
(Small Computer System Interface) bus,
The disk driver 15, image system and sound system are connected.

The disk driver 15 writes data in a disk-shaped recording medium (optical disk, magneto-optical disk, magnetic disk, etc.) and reads data from this recording medium. The recording medium read and written by the disk driver 15 will be referred to as a management recording medium in order to distinguish it from other recording media. A script file, an image cast, a sound cast, etc., which will be described in detail later, are recorded on or recorded in the management recording medium.

The image system includes a disk driver 21, an image reproducing device 22, and a display device 23. The disc-shaped recording medium read and written by the disc driver 21 is referred to as an image recording medium. The image recording medium is a merged image file described later, an image file (image data representing an image for one screen (including image data compressed or encoded, character image data) is called an image file. Or, a collection of united image files is referred to as an album) or the like is recorded or is accessible.

The image reproducing device 22 performs a process of displaying on the display device 23 an image represented by the image data read from the image recording medium by the disk driver 21 or the image data supplied from the computer system 10. Yes, it includes a VRAM, a D / A conversion circuit, an image processing circuit, a display control circuit, and the like.

The display device 23 is realized by a CRT display device or a liquid crystal display device (including one used as a part of a video projector). Computer systems for multimedia presentation systems
At least one of the display device 14 of 10 and the display device 23 may be provided.

The sound system includes a disk driver 31, a sound reproducing device 32 and a speaker 33. The disc-shaped recording medium read and written by the disc driver 31 will be referred to as a sound recording medium. The sound recording medium is a digital data (ADPCM; Adaptive Diffe
(including those that have been subjected to rential Pulse Code Modulation). A sound file is a unit of sound data, such as a piece of music or a cohesive narration.

The sound reproducing device 32 converts the sound data read from the sound recording medium into a sound signal and drives the speaker 33, and includes an ADPCM decoding circuit, a D / A conversion circuit and the like.

The sound recording medium is MIDI (Musical Instrument
(ment Digital Interface) data may be stored in part or in whole. In this case, the sound reproducing device 32 includes an electronic musical instrument.

The image file and the sound file may be stored in one recording medium. In this case, one driver is enough. The high-speed disk driver can read the image file and the sound file in a time division manner, and can display the image and generate (output) the sound at the same time based on the read data. Further, the image recording medium, the image recording medium, and the sound recording medium may be the same recording medium. In this case, the driver 15, the driver 21, and the driver 31 are shared by one driver. At least any two of these three types of recording media may be the same recording medium.

Instead of the disk-shaped recording medium, a semiconductor memory or a tape-shaped recording medium (optical tape, magnetic tape, etc.) can be used for recording an image file or a sound file.

Multimedia presentation system (or multimedia data creation system,
An image data input device, a sound data input device, and the like may be connected to the image synthesis system. The image data input device may include, for example, a device for A / D converting an input video signal and compressing the data. A sound data input device includes a microphone, an A / D conversion circuit, a buffer memory, and an AD.
PCM encoding circuitry etc. may be included.

The merged image file will be described. In order to make it easier to understand, a combined image file that creates a composite image as shown in FIG. 4 using the natural image (picture) shown in FIG. 2 and the character image shown in FIG. 3 will be described.
The combined image file basically includes image data representing a natural image, image data representing a character image, and information (data) necessary to combine these image data. The merged image file does not include image data representing the combined image.

FIG. 5 shows an example of the structure of the merged image file. The merged image file is composed of a header, an information area, a path area, and an image data area.

The image data area stores image data representing a natural image shown in FIG. 2 and image data representing a character image shown in FIG.

There are three types of image data representing natural images shown in FIG. 2, which are reduced image data for retrieval A1, standard image data A2, and image data for high definition A3.

The reduced image data A1 is the standard image data A2.
Is reduced by thinning processing, averaging processing, etc.
64) and is mainly used for search processing. That is, during the retrieval process, reduced image data is read from each of a large number of merged image files,
The reduced images represented by these reduced image data are displayed on the display screen so as to form a multi-screen.

The standard image data A2 is image data having a resolution suitable for displaying on a television screen. The image data used for image display in the multimedia presentation system is basically the standard image data A2. Of course, the other image data A1 and A3 can also be used for the multimedia presentation.

The high-definition image data A3 has a high resolution (for example, four times the standard image data) and is used for high-definition display or printing. Image data of higher resolution (for example, one having a resolution four times higher than that for high definition, to obtain a larger print image) can be included in the combined image file. The number of types of image data representing a natural image is arbitrary.

Character image data B representing the characters shown in FIG.
Only one type is available. The character image data B need only be at least for the character area, and not necessarily for one screen. As for the character image data, a plurality of types having different resolutions may be prepared.

It goes without saying that image data representing different pictures and characters may be provided in the combined image file. This is because the merged image file is for synthesizing two or more types of images. Not only color images but also black and white image data may be prepared.

In the path area, the above-mentioned image data A
Data for accessing 1, A2, A3 and B (data related to a path or an offset, and other addresses) are stored.

In the header, a code indicating a merged image file, the name (name) of the album to which this merged image file belongs, the name (name) of the merged image file, etc. are stored.

In the information area, the version number, compression method, image rotation information, table, creation date, etc. are described.

The version number is a version 1.2 or version 3.5 number for identifying the version.

The compression method is used when the image data in the image data area is compressed (for example, JP
EG method, etc.), which is mainly applied to natural images.

The image rotation information indicates how many times the image data in the image data area (sometimes a natural image) should be rotated counterclockwise to be displayed correctly for the observer. Is. For example, this information has 0 degrees,
There are 90 degrees, 180 degrees and 270 degrees.

The table shows the type and resolution of the image data stored in the image data area. For example,
Color (24-bit) natural image (reduced 1/64, standard 1/1,
Data of high-definition 4/1), characters (8 bits), and images (standard 1/1) are described in a table in a fixed array. This array matches the order of the path data described in the path area.

The creation date is the creation date of this merged image file.

A plurality of such merged image files are stored in the image recording medium. Creation of this merged image file can be performed using the system shown in FIG. Necessary image data and its information may be created and stored in the recording medium in a format as shown in FIG.

Image files other than the merged image file are also stored in the image recording medium. This image file also stores the album name, the header including the file name, the information as shown in the information area of FIG. 5, the path and the image data. It is advisable to store image data with multiple resolutions for one picture or character image.

The sound file stored in the sound recording medium is also configured to include an album name, a header including a file name, information necessary for reproduction, and sound data. However, the album name, file name, and information may be stored in the directory.

FIG. 6 shows an example of an image (still image) and sound sequence generated in this multimedia presentation system.

First, the introduced music (1) (sound) is played from the speaker 33, and an image is displayed on the display device 23 while this music (1) is played.
(1) is displayed. The introduced music (1) switches to the narration (2) (sound) while the image (1) is displayed. After the narration (2) is finished, the sound stops temporarily.
During this period, the image (1) is switched to the image (2), and then the narration (3) flows. In this example, the image and sound may be output at the same time.

In this example, the time from the start of the output of a certain sound or the display of an image to the start of the output of the next sound or the display of an image is called the transition time. The time when one image is displayed is called the display time.

FIG. 7 shows another example of a generated image (still image) and sound sequence. In this sequence, sound and image do not occur at the same time. Either a sound or an image is playing, or neither is playing at any one time.

In the example of this sequence, the time from the stop of the output of a certain sound or the end of the display of an image to the start of the output of the next sound or the start of the display of an image is defined as the transition time. The time when one image is displayed is the display time. As shown by the broken line, for an image, the transition time can be set from the start of displaying one image to the start of displaying the next image. Furthermore, a time (start time) (also referred to as a transition time) from the time of the start of the presentation (generation of the first sound or image display) (also referred to as a transition time) may be defined instead of the above-described transition time.

Such one image or one sound to be reproduced is described by an image cast or a sound cast, and the order of reproduction thereof is described in the script file.

An example of a script file is shown in FIG. This script file represents the sequence shown in FIG. PLAY gives a playback command by Audio
Cast represents a sound cast, and Image Cast represents an image cast. PLAY Audio Cast (1) is one statement, which is a sound cast (1)
Is meant to be played. These command statements are described in the order of reproduction. Therefore, the sound (1),
Image (1), sound (2), image (2), and sound (3) are played in this order. This is the same as the sequence of FIG. In the script file, the description of the command PLAY can be omitted. The transition time and display time described in the image cast and sound cast may be described in the script file.

FIG. 9 shows an example of the structure of an image cast. The image cast includes a header, an album name, a (merged) image file name, merged information, transition time, display time, image appearance effect, image appearance effect time, image resolution, position information, enlargement ratio, and the like.

The header indicates that it is an image cast.

The album name and the (combined type) image file name indicate image files to be reproduced (combined type image file or other image files).

The merged information is used when a merged image file is instructed, and includes information indicating which of a plurality of image data included in the merged image file is used (type of image to be merged). , And a synthesis (coalescing) method. The information on the types of images to be combined also includes information on whether or not to combine the images. In the case of combining, the image data to be combined is specified (in this example, the image data to be combined is indicated by the resolution of the image). If you do not want to combine,
It describes which image (natural image, character image) is used. There are OR, AND, NOR, etc. in the combination method.

The transition time and display time are as described above.

The image appearance effect is as follows: when the display of the image is started, the entire screen is suddenly displayed (whether the entire screen is instantaneously switched) or the double door (or curtain) is opened. Whether to display an image, to display the next image while sweeping from right to left, to start displaying an image while sweeping from top to bottom, or to gradually expand the display area from the center to make a picture appear Such a screen effect is selected. The image appearance effect time is
It is the time from the start of appearance of a part of the image to the appearance of the whole image.

The image resolution indicates the resolution of the image (natural image) to be displayed as described above, and in the example of FIG.
Either 1/1 or 4/1 is selected. By specifying this resolution, image data is selected as a result.

The position information represents the position of the image to be displayed on the display screen. For example, it is represented by the X and Y coordinates of the center of the image to be displayed.

The enlargement factor (including the reduction factor) represents the factor for enlarging or reducing the image to be displayed.

FIG. 10 shows an example of the structure of a sound cast (Audio Cast). The sound cast includes a header, album name, sound file name, track number, attribute, transition time, start pointer, stop pointer, and the like.

The header indicates that it is a sound cast.

The album name and file name identify the sound file to be reproduced. The track number indicates the track number on the sound recording medium in which the sound file to be reproduced exists. When the track number is uniquely determined by the file name, the track number is not always necessary.

The attribute indicates the nature of sound, for example, mono / stereo, and the number of channels.

The transition time is as described above.

Regarding sounds, not all sounds in the sound file are reproduced. For example, it may be required to play only a specific part (this is called a clip) in one song (one sound file). start·
The pointer and the stop pointer represent the start position and the end position of the clip to be played back in time with reference to the position of the first sound in the sound file.

Such a script file, image cast, and sound cast are stored in the management recording medium.

11 to 13 show a processing procedure for generating (reproducing) multimedia in the multimedia presentation system. This processing is mainly executed by the CPU 11 in the computer system 10. Further, this processing complies with the definition of the transition time shown in FIG.

One or more script files are stored in the management recording medium. When an input for designating a script file to be reproduced is given from the input device 13, the CPU 11 activates the disk driver 15, reads the designated script file from the management recording medium, and stores the work file in the memory 12. Store in area (step 41).

All casts (image casts and sound casts) listed in the read script file are similarly read from the management recording medium and stored in the work area (step 42). CPU 11 checks if all the casts listed in the script file are present (step 43).

The CPU 11 further includes a disk driver 21
And 31 are started, and it is checked whether all the image files and sound files described in the previously read cast are recorded in the image recording medium and the sound recording medium (steps 44 to 46). Generally, one file is described in one cast, so step
The treatment of 45 is not always necessary.

If any one of the casts described in the script file does not exist in the management recording medium, or if any of the files described in the cast does not exist in the image or sound recording medium. It's an error.

If there is no error, the reproduction operation is performed according to the script file and cast stored in the read work area.

A cast counter is provided to indicate the currently playing cast in the script file. The cast counter is set to 1 (step 47).

The cast indicated by the cast counter is decoded and it is determined whether it is an image cast or a sound cast (step 51). In the case of an image cast, the process proceeds to the process shown in FIG. 12, and in the case of a sound cast, the process proceeds to the process shown in FIG.

In the case of the image cast, the image synthesizing process is first performed. The image recording medium is accessed using the album name and file name included in the image cast, and the corresponding image file is read and stored in the work area. In the case of a merged image file, one or a plurality of image data designated by the resolution information is read. If the read image data is data-compressed, decompression processing is performed. The image data in the work area is rotated as necessary according to the image rotation information described in the image file (merged image file). The image data is enlarged or reduced as necessary according to the enlargement or reduction ratio described in the image cast. If necessary, the image data is positioned and cut out according to the position information in the image cast.

Preferably, the image reproducing device 22 has two VRs.
AM is provided. One is for the currently displayed image and the other is for the next image to be displayed. In such a case, the work area image data is transferred to and stored in the VRAM of the image reproducing device 22. In the case of united image data, two or more image data are combined on the VRAM (step 52).

In the case of the first cast, (step
If YES in 53), the image combining process is performed, and immediately thereafter (steps 54 to 58 are skipped), the combined image output process and the display command process are performed (step 59). The image appearance effect and the effect time are given to the image reproducing device 22 together with the display command, and the VRAM
The image represented by the above image data will be displayed on the display device 23 with the instructed effect.

In this embodiment, while the current cast is being reproduced, the image synthesizing process for the next image cast is performed. Respective timers are provided to measure the transition time and the display time. The transition time is set in the transition time timer when the playback of the current cast is started (step 62). If the current cast is an image cast, its display time is set in the display time timer (step 61).

If the cast counter is other than 1 (NO in step 53), wait for the transition time timer to time up (timer interrupt) (step 58), and proceed to composite image output and display command processing. This will be the case (step 59).

Thereafter, the cast counter is incremented by 1 (step 60), and the display time and the transition time in the current image cast are set in the display time counter and the transition time counter, respectively (steps 61 and 62). After this,
Returning to step 50, preparation for the next cast begins.

During the waiting time for the transition time timer to time up, when the display time timer times up (when there is a timer interrupt), an erase command is given to the image reproducing device 22 (step 56, 57), display device 23
The image displayed on disappears. When the processing of step 59 causes the next image to be displayed immediately, the image will appear to have been switched.

When the current cast is a sound cast and the notification that the reproduction of the instructed clip is completed has arrived from the sound reproducing device 32, the CPU 11 recognizes that (steps 54 and 55).

If the image reproduction device 22 has only one VRAM, the image composition (or writing) process on the VRAM in step 52 will be performed in step 59.

In the case of sound cast, the start pointer and stop pointer (expressed by time) included in the sound cast are converted into physical addresses on the sound recording medium (step 63). Thereafter, the transition timer 58 is timed out (step 58), and a reproduction command including the data described in the sound cast and the physical address is given to the sound reproduction device 32 (step 6).
Four). In response to this, the sound reproducing device 32 reproduces the instructed clip in the sound file instructed from the sound recording medium and outputs the sound from the speaker 33. Other processes are the same as those shown in FIG. 12, and the same steps are designated by the same reference numerals to avoid redundant description. In the process of FIG. 13, there is no display time setting process.

When the processing for all casts described in the script file is completed (YES in step 48)
), Waiting for the display time timer for the last image cast to time up, or in the case of a sound cast, waiting for a sound reproduction end report from the sound reproducing device to finish all processing (step 49).

FIGS. 14 and 15 show the processing according to the transition time defined in FIG. 7, and correspond to FIGS. 12 and 13, respectively. FIG. 11 is used as it is in this example.

In FIG. 14, the image synthesizing process of step 52 shown in FIG. 12, the synthetic image output of step 59, and the display command process are continuously performed (step 71), and the image instructed by the image cast is displayed on the display device 23. Is displayed in. Thereafter, the cast counter is incremented (step 60) and the display time is set in the display time timer (step 61).

After waiting for the display time timer to time up (step 56), an image erasing command is output (step 57) and the transition time is set in the transition time timer (step 62).

When the transition time timer has timed up (step 58), the process for the next cast proceeds (step 50).

If the transition time is zero, steps 62 and 58 are skipped.

When the transition time shown by the broken line in FIG. 7 is defined, along with the display time set in step 61,
A transition time is set (step 62).

Similarly in the processing for the sound cast of FIG. 15, in step 72, step 63 of FIG.
And 64 are processed. As a result, the sound is reproduced. After this, the cast counter is incremented (step 60).

After the notification that the reproduction of the clip instructed by the sound reproduction device 32 has been completed (step 54),
The transition time is set (step 62). After the transition time timer has expired (step 58), the process proceeds to the next cast (step 50).

When the time (start time) from the start of the presentation to the image display or sound generation according to each cast is defined as the transition time, the transition times are read from all the casts and arranged in that order. (Time table) Compares the time measured by the timer started from the start of the presentation with each transition time, and when both times match, the sound or image is displayed according to each cast. (At this time, the preprocessing should be performed a little earlier in consideration of the time required for the sound generation or the preprocessing for image display).

The process of creating an image cast will be described. This process can be divided into rough selection of images and specification of details of the image cast data.

In the rough image selection, a desired one is selected from the image files (including the merged image file) stored in the image recording medium. At this time, the above-mentioned search image data will be effectively used. The image represented by the selected image file is displayed on the display device 14 or 23 (data expansion and image composition are performed). The operator looks at the displayed image and decides whether to make a final selection. The program name and file name of the finally selected image file are stored in the work area of the memory 12.

When the necessary image files have been selected,
An image cast is created for each selected image file. The united information, transition time, display time, image appearance effect and its time, position information, magnification, etc. necessary for the image cast are sequentially input. The created image cast is saved in the work area. When all the required image casts have been created, these image casts are stored in the management recording medium.

The creation of the sound cast is performed in almost the same procedure. First, a sound file is selected. A sound file is specified in the sound recording medium, and the sound is played. Upon hearing the played sound, the operator finally decides whether to make a selection. The album name and file name of the determined sound file are saved in the work area.

Of the detailed data of the sound cast, the ones that need to be input are the transition time, the start pointer and the stop pointer. The selected sound file is played. At the time when the sound to be used as the start pointer is output, when an input designating the time is given from the input device 13, the CPU 11 queries the sound reproducing device 32 for the time. The time returned from the sound playback device 32 starts
It becomes a pointer. Similarly, the stop pointer is set. Finally, the transition time is input.

The script file is created by inputting already created casts in the order of reproduction.

The script file and cast that have been created once are reproduced by the procedure described above. The operator corrects the necessary parts while watching the reproduced multimedia. The information about each media is described in the image cast and sound cast, and the whole flow is described in the script file, so it is sufficient to modify them individually, and the modification work is easy.

[0117] The multimedia presentation system will be used for product information at stores, information on exhibits (paintings) at museums, etc., information presentation at conferences, parties, etc., reports, etc.

[Brief description of drawings]

FIG. 1 is a block diagram illustrating a multimedia presentation system.

FIG. 2 shows a natural image before synthesis.

FIG. 3 shows a character image before composition.

FIG. 4 shows a composite image.

FIG. 5 shows an example of the structure of a merged image file.

FIG. 6 shows an example of a multimedia presentation sequence.

FIG. 7 shows another example of a sequence of a multimedia presentation.

FIG. 8 shows an example of a script file.

FIG. 9 shows an example of the structure of an image cast.

FIG. 10 shows a structural example of a sound cast.

FIG. 11 is a flow chart showing an example of multimedia presentation processing.

FIG. 12 is a flow chart showing an example of multimedia presentation processing.

FIG. 13 is a flow chart showing an example of multimedia presentation processing.

FIG. 14 is a flow chart showing another example of multimedia presentation processing.

FIG. 15 is a flowchart showing another example of multimedia presentation processing.

[Explanation of symbols]

 10 Computer system 11 CPU 15, 21, 31 Disk driver 22 Image playback device 23 Display device 32 Sound playback device 33 Speaker

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical display location G06T 11/80 H04N 5/76 B 9194-5L G06F 15/40 370 G 9365-5H 15/62 321 A

Claims (23)

[Claims] 1. A plurality of image data are stored in advance in a first recording medium in association with their identification information,
A plurality of sound data are stored in advance in a second recording medium in association with their identification information, and an image cast including identification information indicating at least image data representing an image to be displayed, a sound representing at least a sound to be generated. A sound cast including identification information indicating data and a script file in which image casts and sound casts are arranged in an order to be output are created and stored in a third recording medium, and a script is written from the third recording medium. Reading the file, reading the image cast and sound cast described in the read script file, and image data from the first recording medium and the second recording medium according to the identification information contained in the read image cast and sound cast And sound data are read and read in the order described in the script file. Displays on the display device an image represented by the image data, to output the sound represented by the read-out sound data from the speaker, multimedia presentation method 2. The multimedia presentation method according to claim 1, wherein at least two of the first recording medium, the second recording medium, and the third recording medium are the same recording medium. 3. From a reference time point of image display according to a preceding image cast or a reference time point of sound generation according to a sound cast to a reference time point of image display according to a subsequent image cast or a reference time point of sound generation according to a sound cast. The transition time from the start of the presentation to the reference time of the image display according to the image cast or the reference time of sound generation according to the sound cast is described in advance in the image cast or script file. The multimedia presentation method according to claim 1 or 2, wherein an image is displayed or a sound is generated following a time defined by the transition time. 4. The multimedia contents according to claim 1, wherein the display time of the image is described in advance in the image cast or script file, and the image is displayed during this display time. Presentation method. 5. The resolution according to claim 1, wherein the resolution, position or enlargement / reduction ratio of an image to be displayed is described in advance in the image cast, and the image is displayed in accordance with this description. Multimedia presentation method. 6. The effect according to any one of claims 1 to 5, wherein the effect to be executed at the first stage of image display and its time are described in advance in the image cast, and the effect display is performed according to this description. Multimedia presentation method. 7. The method according to claim 1, wherein time data representing a portion of the sound data to be generated is described in a sound cast in advance, and a sound in a time zone defined by the time data is generated. The multimedia presentation method according to the item 1. 8. A merged image file including a plurality of image data and data relating to the combination of these image data,
The image data is previously stored in the first recording medium, the identification information of the merged image file is included in the image cast, and when the merged image file is instructed by the image cast, the merged image is displayed. The multimedia according to any one of claims 1 to 4, wherein at least two images defined in the file are combined and displayed.
Presentation method. 9. A first reading device for reading out image data corresponding to designated identification information from a first recording medium which stores a plurality of image data in association with the identification information.
Second reading device for reading the sound data corresponding to the designated identification information from the second recording medium storing a plurality of sound data in association with the identification information, and an image read from the first recording medium A display device for displaying an image represented by the data, a sound generating device for generating a sound represented by the sound data read from the second recording medium, and an image including identification information indicating at least image data representing the image to be displayed A script file from a third recording medium storing a cast, a sound cast including identification information indicating at least sound data representing a sound to be generated, and a script file in which an image cast and a sound cast are arranged in an order to be output. Read out the image cast and sound cast described in the read script file, Image data and sound data are read from the first recording medium and the second recording medium according to the identification information included in the issued image cast and sound cast, and are represented by the read image data in the order described in the script file. A multimedia presentation system comprising: a control device for displaying an image to be displayed on the display device and controlling the sound represented by the read sound data to be output from the sound generation device. 10. The multimedia presentation system according to claim 9, wherein at least any two of the first recording medium, the second recording medium and the third recording medium are the same recording medium. . 11. From a reference time point of image display according to a preceding image cast or a reference time point of sound generation according to a sound cast to a reference time point of image display according to a subsequent image cast or a reference time point of sound generation according to a sound cast. , Or the transition time from the start of the presentation to the reference time of the image display according to the image cast or the reference time of sound generation according to the sound cast is described in advance in the image cast or script file. 10. The control device controls to display an image or generate a sound that follows the time defined by the transition time.
The multimedia presentation system described in 10. 12. A merged image file including a plurality of image data and data relating to the combination of these image data is previously stored in the first recording medium as the image data, and the merged image file is included in the image cast. Image identification information is included, and when a merged image file is designated by the image cast, image combining means is further provided for combining at least two images defined in the merged image file, A multimedia presentation system according to any one of claims 9 to 11. 13. A first recording medium in which a plurality of image data are stored in association with their identification information and a second recording medium in which a plurality of sound data are stored in association with their identification information. An image cast including identification information indicating image data representing an image to be displayed, a sound cast including identification information indicating sound data representing at least a sound to be generated, and an image cast and a sound cast are arranged in an output order. A method for creating multimedia data in which a script file is created and stored in a third recording medium. 14. The multimedia data creating method according to claim 13, wherein the first recording medium and the second recording medium are the same recording medium. 15. From a reference time point of image display according to a preceding image cast or a reference time point of sound generation according to a sound cast to a reference time point of image display according to a subsequent image cast or a reference time point of sound generation according to a sound cast. Or the transition time from the start of the presentation to the reference time of the image display according to the image cast or the reference time of sound generation according to the sound cast is stored in the image cast or the script file. The multimedia data creation method described in 14. 16. The multimedia data creating method according to claim 13, wherein the display time of the image is stored in an image cast or a script file. 17. The method for creating multimedia data according to claim 13, wherein the resolution, position or enlargement / reduction ratio of the image to be displayed is stored in the image cast. 18. The effect to be executed in the first stage of image display and its time are stored in an image cast.
The method for creating multimedia data according to any one of 1 to 17. 19. The method for producing multimedia data according to claim 13, wherein time point data representing a portion of the sound data to be generated is stored in the sound cast. 20. A merged image file including a plurality of image data and data relating to the combination of these image data is stored in the first recording medium as the image data, and identification information of the merged image file is included in the image cast. The method for creating multimedia data according to any one of claims 13 to 16, further comprising: 21. A first reading device for reading out image data corresponding to designated identification information from a first recording medium storing a plurality of image data in association with the identification information, and a plurality of sound data. A second reading device for reading out sound data corresponding to the designated identification information from the second recording medium stored in association with the identification information, and at least identification information indicating image data representing an image to be displayed. A record for recording on the third recording medium a picture file including the image cast, a sound cast including at least identification information indicating sound data representing a sound to be generated, and a script file in which the image cast and the sound cast are arranged in an order to be output. A multimedia data creation system equipped with a device. 22. A merged image file including a plurality of image data and data relating to combination of these image data is stored in advance in a recording medium, the merged image file is read from the recording medium, and the read merged image file. An image synthesizing method for synthesizing at least two pieces of image data on a memory in accordance with the synthesizing data in a pattern image file and displaying an image represented by the image data obtained by the synthesizing on a display device. 23. A reading device for reading a merged image file from a recording medium storing a merged image file containing a plurality of image data and data relating to the combination of these image data, and a reading device in the read merged image file. An image synthesizing system comprising: an image synthesizing means for synthesizing at least two pieces of image data on a memory in accordance with synthesizing data; and a display device for displaying an image represented by the image data obtained by the synthesizing.