JP3730639B2 - Multimedia presentation method and system, multimedia data creation method and system - Google Patents

Description

[0001]
【Technical field】
The present invention relates to a multimedia presentation method and system for generating multimedia composed of images (including character images) and sounds (including music, narration, etc.), and multimedia data used in the presentation method and system. The present invention relates to a method and system for creating, and a method and system for synthesizing images included in multimedia or used for other purposes.
[0002]
[Background]
In order to generate images (mainly still images) and sound sequentially in time order (regardless of whether the image and sound are simultaneous), the image data and sound data are recorded on the recording medium in that time order. Must be arranged in When modifying a part of such multimedia data (data consisting of image data and sound data) (subscribing, deleting, replacing or changing data), the multimedia flow is reconstructed and Since it is necessary to rewrite all the data (at least the data after the corrected part), the work must be complicated.
[0003]
On the other hand, a still image used in multimedia or another application may be created by combining two or more images. For example, a case where a picture and a character are combined. In such a case, if an attempt is made to save the pre-combination picture, characters, and post-combination image, there are three types: image data representing the picture before composition, image data representing the character, and composited image data. Must be recorded on a recording medium, and a large recording capacity is required. If only the composite image data is saved, it is difficult to correctly restore the image data of the picture or character before the composition when it is needed.
[0004]
DISCLOSURE OF THE INVENTION
The present invention facilitates the creation and modification of multimedia data.
[0005]
According to the present invention, the recording capacity is reduced so that image data before synthesis can be stored and images can be synthesized.
[0006]
The multimedia data creating method according to the present invention includes a first recording medium storing a plurality of image data in association with their identification information, and a second recording medium storing a plurality of sound data in association with their identification information. And at least an image cast including identification information indicating image data representing an image to be displayed, a sound cast including identification information indicating sound data representing a sound to be generated, and an image cast in an order to be output And a sound file are created and stored in a third recording medium.
[0007]
At least two of the first recording medium, the second recording medium, and the third recording medium may be the same recording medium.
[0008]
In a preferred embodiment, the reference time point of the image display according to the preceding image cast or the reference time point of the sound generation according to the sound cast to the reference time point of the image display according to the subsequent image cast or the reference time point of the sound generation according to the sound cast. The transition time from the start time of the presentation to the reference time point of image display according to the image cast or the reference time point of sound generation according to the sound cast is included in the image cast or script file.
[0009]
In a further preferred embodiment, the image display time is included in the image cast or script file.
[0010]
In another embodiment, the image cast includes the resolution, position or enlargement / reduction ratio of the image to be displayed.
[0011]
In yet another embodiment, the image cast includes the effect to be performed at the initial stage of image display and the time thereof.
[0012]
More preferably, the time cast representing the portion of the sound data to be generated is included in the sound cast.
[0013]
In a preferred embodiment, a combined image file including a plurality of image data and data relating to the synthesis of these image data is stored as the image data in the first recording medium, and identification information of the combined image file is included in the image cast. Is included.
[0014]
A multimedia data creation system according to the present invention includes a first reader for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of pieces of image data in association with the identification information. , A second reading device for reading the sound data corresponding to the instructed identification information from the second recording medium storing the plurality of sound data in association with the identification information, and at least an image representing the image to be displayed An image cast including identification information indicating data, a sound cast including at least identification information indicating sound data to be generated, and a script file in which the image cast and the sound cast are arranged in an order to be output A recording device for recording on a recording medium is provided.
[0015]
According to the present invention, the description regarding the image to be displayed is included in the image cast, the description regarding the sound to be generated is included in the sound cast, and the reproduction order of the image and sound is included in the script file. Since these image information, sound information, and order information can be handled separately, the creation and correction thereof are facilitated.
[0016]
The present invention provides a multimedia presentation method and system using multimedia data thus created.
[0017]
In the multimedia presentation method according to the present invention, a plurality of image data are stored in advance in a first recording medium in association with their identification information, and a plurality of sound data are associated with their identification information in a second recording. An image cast including identification information indicating image data representing an image to be displayed at least stored in a medium in advance, a sound cast including identification information indicating sound data representing at least sound to be generated, and an order of output A script file in which image casts and sound casts are arranged is created and stored in a third recording medium, the script file is read from the third recording medium, and the image cast described in the read script file is read. And sound casts, included in read image and sound casts Image data and sound data are read from the first recording medium and the second recording medium according to the identification information, and the image represented by the read image data is displayed on the display device in the order described in the script file, The sound represented by the read sound data is output from the speaker.
[0018]
A multimedia presentation system according to the present invention includes a first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of image data in association with the identification information. , A second reading device that reads sound data corresponding to the instructed identification information from a second recording medium that stores a plurality of sound data in association with the identification information, and is read from the first recording medium A display device for displaying an image represented by image data, a sound generating device for generating sound represented by sound data read from the second recording medium, and identification information indicating at least image data representing the image to be displayed Image cast, at least sound cast including identification information indicating sound data representing sound to be generated, and output First, the script file is read from the third recording medium storing the script file in which the image cast and the sound cast are arranged, the image cast and the sound cast described in the read script file are read, and the read image cast The image data and the sound data are read from the first recording medium and the second recording medium in accordance with the identification information included in the sound cast, and the image represented by the read image data in the order described in the script file is described above. A control device is provided for controlling the sound generating device to output the sound displayed on the display device and represented by the read sound data.
[0019]
At least any two of the first recording medium, the second recording medium, and the third recording medium may be the same recording medium. When the first recording medium and the second recording medium are the same recording medium, the first reading device and the second reading device are the same device.
[0020]
In this way, the presentation is effectively performed based on the multimedia data created by the previous method.
[0021]
The present invention further provides an image composition method and system using a combined image file.
[0022]
In the image composition method according to the present invention, a coalesced image file including a plurality of image data and data relating to the synthesis of these image data is stored in advance in a recording medium, and the coalesced image file is read from the recording medium, At least two pieces of image data are combined on the memory in accordance with the combined data in the read merged image file, and an image represented by the image data obtained by combining is displayed on the display device.
[0023]
An image composition method according to the present invention includes a reading device that reads a combined image file from a recording medium that stores a combined image file that includes a plurality of image data and data relating to the combination of these image data, and the read combined image. Image composing means for composing at least two image data on a memory in accordance with data relating to compositing in the file, and a display device for displaying an image represented by the image data obtained by compositing.
[0024]
According to the present invention, it is not necessary to store the combined image data in the recording medium, so that the capacity can be used effectively. Moreover, all image data before and after the merge can be easily obtained.
[0025]
【Example】
FIG. 1 shows an overview of the overall configuration of the multimedia presentation system. This system can also be used for multimedia data creation and image composition.
[0026]
The computer system 10 may be dedicated to multimedia presentations (and multimedia data creation and image composition), or a general-purpose computer system for multimedia presentations (and multimedia data creation and image composition). It may be programmed.
[0027]
The computer system 10 includes a CPU 11, a memory 12, an input device 13, and a display device 14. The memory 12 includes a semiconductor memory, a floppy disk, a hard disk, etc., and stores a program executed by the CPU 11 or is used as a work area. The input device 13 includes a keyboard, a mouse, etc., and gives commands, data, etc. to the CPU 11. The display device 14 is realized by a CRT display device, a liquid crystal display device or the like, for example.
[0028]
A disk driver 15, an image system, and a sound system are connected to the computer system 10 via a SCSI (Small Computer System Interface) bus.
[0029]
The disk driver 15 writes data to a disk-shaped recording medium (optical disk, magneto-optical disk, magnetic disk, etc.) and reads data from this recording medium. The recording medium read / written by the disk driver 15 is referred to as a management recording medium in order to distinguish it from other recording media. The management recording medium records or records a script file, an image cast, a sound cast, etc., which will be described in detail later.
[0030]
The image system includes a disk driver 21, an image reproduction device 22, and a display device 23. A disk-shaped recording medium read / written by the disk driver 21 is referred to as an image recording medium. The image recording medium includes a coalesced image file, which will be described later, and an image file (image data representing an image for one screen (including image data that has been compressed or encoded, and character image data) is called an image file. Or a collection of combined image files is referred to as an album) or the like.
[0031]
The image reproducing device 22 performs a process of displaying on the display device 23 the image data read from the image recording medium by the disk driver 21 or the image represented by the image data given from the computer system 10. , A D / A conversion circuit, an image processing circuit, a display control circuit, and the like.
[0032]
The display device 23 is realized by a CRT display device or a liquid crystal display device (including those used as part of a video projector). The multimedia presentation system may be provided with at least one of the display device 14 of the computer system 10 or the display device 23.
[0033]
The sound system includes a disk driver 31, a sound reproduction device 32, and a speaker 33. A disk-shaped recording medium read / written by the disk driver 31 is referred to as a sound recording medium. The sound recording medium records digital data (including ADPCM; Adaptive Differential Pulse Code Modulation) representing sound. A unit of sound data, such as a piece of music or a single narration, is called a sound file.
[0034]
The sound reproducing device 32 converts sound data read from the sound recording medium into a sound signal and drives the speaker 33, and includes an ADPCM decoding circuit, a D / A conversion circuit, and the like.
[0035]
The sound recording medium may store a part or all of MIDI (Musical Instrument Digital Interface) data. In this case, the sound reproducing device 32 includes an electronic musical instrument.
[0036]
The image file and the sound file may be stored in one recording medium. In this case, one driver is sufficient. The high-speed disk driver can read the image file and the sound file in a time-sharing manner, and can simultaneously display an image and generate (output) sound based on the read data. Furthermore, the image recording medium, the image recording medium, and the sound recording medium may be the same recording medium. In this case, the driver 15, the driver 21, and the driver 31 are shared by a single driver. At least any two of these three types of recording media may be the same recording medium.
[0037]
Instead of the disk-shaped recording medium, a semiconductor memory or a tape-shaped recording medium (optical tape, magnetic tape, etc.) can be used for recording image files and sound files.
[0038]
An image data input device, a sound data input device, or the like may be connected to the multimedia presentation system (or multimedia data creation system or image composition system). The image data input device may include, for example, a device that A / D converts an input video signal and compresses the data. The sound data input device may include a microphone, an A / D conversion circuit, a buffer memory, an ADPCM encoding circuit, and the like.
[0039]
The combined image file will be described. For ease of understanding, a combined image file for creating a composite image as shown in FIG. 4 using the natural image (picture) shown in FIG. 2 and the character image shown in FIG. 3 will be described. The combined image file basically includes image data representing a natural image, image data representing a character image, and information (data) necessary to synthesize these image data. The combined image file does not include image data representing the combined image.
[0040]
FIG. 5 shows an example of the configuration of a combined image file. The combined image file is composed of a header, an information area, a path area, and an image data area.
[0041]
In the image data area, image data representing a natural image shown in FIG. 2 and image data representing a character image shown in FIG. 3 are stored.
[0042]
There are three types of image data representing a natural image shown in FIG. 2, which are reduced image data for search A1, standard image data A2, and image data for high vision A3.
[0043]
The reduced image data A1 is created by reducing (for example, 1/64) the standard image data A2 by thinning, averaging, etc., and is mainly used for search processing. That is, at the time of search processing, reduced image data is read from a large number of combined image files, and reduced images represented by these reduced image data are displayed on a display screen so as to constitute a multi-screen.
[0044]
The standard image data A2 is image data having a resolution suitable for display on a television screen. The image data used for image display in the multimedia presentation system is basically this standard image data A2. Of course, other image data A1, A3 can also be used for multimedia presentation.
[0045]
The high-definition image data A3 has a high resolution (for example, four times the standard image data) and is used for high-definition display or printing. Furthermore, image data having a high resolution (for example, one having a resolution four times as high as that for high-definition, for obtaining a larger print image) can be included in the combined image file. The number of types of image data representing a natural image is arbitrary.
[0046]
Only one type of character image data B representing characters shown in FIG. 3 is prepared. This character image data B only needs to be at least the character area, and one screen is not necessarily required. A plurality of types of character image data having different resolutions may be prepared.
[0047]
It goes without saying that image data representing different pictures and characters may be provided in the combined image file. This is because the merged image file combines two or more types of images. Not only color images but also monochrome image data may be prepared.
[0048]
In the path area, data for accessing each of the above-described image data A1, A2, A3 and B (data related to a path or offset and other addresses) is stored.
[0049]
The header stores a code indicating that it is a combined image file, the name (name) of the album to which the combined image file belongs, the name (name) of the combined image file, and the like.
[0050]
In the information area, version number, compression method, image rotation information, table, creation date, etc. are described.
[0051]
The version number is a number such as Version 1.2 or Version 3.5 for identifying the version.
[0052]
The compression method indicates a method (for example, JPEG method) when image data in the image data area is compressed, and this is mainly applied to a natural image.
[0053]
The image rotation information indicates how many times the image data area should be rotated counterclockwise to display the image data (sometimes a natural image) in the image data area so that the image is correctly displayed to the observer. For example, this information includes 0 degrees, 90 degrees, 180 degrees, and 270 degrees.
[0054]
The table shows the type and resolution of image data stored in the image data area. For example, color (24-bit) natural images (reduced 1/64, standard 1/1, high-definition 4/1), characters (8-bit), and images (standard 1/1) are arranged in a table. It is described in. This array matches the order of the path data described in the path area.
[0055]
The creation date is the date on which this combined image file was created.
[0056]
A plurality of such combined image files are stored in the image recording medium. The merged image file can be created using the system shown in FIG. Necessary image data and its information may be created and stored in a recording medium in a format as shown in FIG.
[0057]
An image file other than the combined image file is also stored in the image recording medium. This image file also stores the album name, a header including the file name, information as shown in the information area of FIG. 5, a path, and image data. It is preferable to store image data having a plurality of types of resolution for one picture or character image.
[0058]
The sound file stored in the sound recording medium is also configured to include an album name, a header including the file name, information necessary for reproduction, and sound data. However, the album name, file name, and information may be stored in a directory.
[0059]
FIG. 6 shows an example of a sequence of images (still images) and sounds generated in this multimedia presentation system.
[0060]
First, the introduction music (1) (sound) flows from the speaker 33, and the image (1) is displayed on the display device 23 while the music (1) is flowing. While the image (1) is displayed, the introductory music (1) switches to narration (2) (sound). After the narration (2) is over, the sound is temporarily stopped. During this time, the image (1) is switched to the image (2), followed by the narration (3). In this example, an image and sound may be output simultaneously.
[0061]
In this example, the time from the start of the output of a certain sound or image display until the start of the output of the next sound or image display is referred to as a transition time. The time during which one image is displayed is called display time.
[0062]
FIG. 7 shows another example of a sequence of generated images (still images) and sounds. In this sequence, sound and image do not occur simultaneously. Either a sound or an image is played at a certain point, or neither is played.
[0063]
In this sequence example, the transition time is defined as the time from the stop of the output of a certain sound or the end of image display until the start of the output of the next sound or the start of image display. The time during which one image is displayed is the display time. As indicated by the broken line, the transition time from the start of display of one image to the start of display of the next image can be set as the transition time. Furthermore, the time (start time) from the start of the presentation (generation of the first sound or image display) (also referred to as transition time) may be defined instead of the above-described transition time.
[0064]
Such an image or sound to be reproduced is described by image cast or sound cast, and the order of reproduction is described in a script file.
[0065]
An example of a script file is shown in FIG. This script file represents the sequence shown in FIG. PLAY represents a playback command, Audio Cast represents a sound cast, and Image Cast represents an image cast. PLAY Audio Cast (1) is one statement, which means that the sound cast (1) should be played. These statements are described in the order to be reproduced. Therefore, sound (1), image (1), sound (2), image (2), and sound (3) are reproduced in this order. This is the same as the sequence of FIG. In the script file, the description of the command PLAY can be omitted. The transition time and display time described in the image cast and sound cast may be described in the script file.
[0066]
FIG. 9 shows an example of the structure of an image cast. The image cast includes a header, album name, (combination type) image file name, coalescence information, transition time, display time, image appearance effect, image appearance effect time, image resolution, position information, enlargement magnification, and the like.
[0067]
The header indicates an image cast.
[0068]
The album name and the (union type) image file name indicate the image file to be reproduced (union type image file or other image file).
[0069]
The coalescing information is used when a coalesced image file is instructed. Information indicating which of a plurality of image data included in the coalesced image file is used (the type of image to be merged) and the composition ( Coalescing) method. Information on the types of images to be merged includes information on whether to merge or not. In the case of merging, the image data to be merged is specified (in this example, the image data to be merged is indicated by the resolution of the image). If they are not merged, it is described which image (natural image, character image) is used. The coalescence method includes OR, AND, NOR, and the like.
[0070]
The transition time and display time are as described above.
[0071]
The effect of image appearance is to display the next image in such a way that the full screen is suddenly displayed (when the full screen is switched instantaneously) or the double door (or curtain) is opened at the start of image display. Do you want to display the next image while sweeping from right to left, start displaying the image while sweeping from top to bottom, or whether to make the picture appear while gradually expanding the display area from the center? Select the screen effect. The image appearance effect time is the time from the start of the appearance of a part of the image until the entire appearance.
[0072]
The resolution of the image indicates the resolution of the image (natural image) to be displayed as described above, and in the example of FIG. 5, one of 1/64, 1/1, and 4/1 is selected. By designating this resolution, image data is selected as a result.
[0073]
The position information represents the position on the display screen of the image to be displayed. For example, it is expressed by the X and Y coordinates of the center of the image to be displayed.
[0074]
The enlargement magnification (including the reduction magnification) represents the magnification at which the displayed image is enlarged or reduced.
[0075]
FIG. 10 shows an example of the structure of a sound cast (Audio Cast). The sound cast includes a header, album name, sound file name, track number, attribute, transition time, start pointer, stop pointer, and the like.
[0076]
The header indicates a sound cast.
[0077]
The album name and file name identify the sound file to be reproduced. The track number indicates the track number on the sound recording medium where the sound file to be reproduced exists. When the track number is uniquely determined by the file name, the track number is not always necessary.
[0078]
The attribute indicates the nature of the sound, such as mono / stereo and the number of channels.
[0079]
The transition time is as described above.
[0080]
For sounds, not all sounds in the sound file are played. For example, it may be required to play back only a specific part (this is called a clip) in one song (one sound file). The start pointer and stop pointer express the start position and end position of a clip to be reproduced in time with the position of the first sound in the sound file as a reference.
[0081]
Such script files, image casts, and sound casts are stored in the management recording medium.
[0082]
FIG. 11 to FIG. 13 show processing procedures for generating (reproducing) multimedia in the multimedia presentation system. This process is mainly executed by the CPU 11 in the computer system 10. Further, this processing conforms to the transition time definition shown in FIG.
[0083]
One or more script files are stored in the management recording medium. When an input specifying a script file to be reproduced is given from the input device 13, the CPU 11 activates the disk driver 15, reads the specified script file from the management recording medium, and reads the work file in the memory 12. Store in the area (step 41).
[0084]
All casts (image cast and sound cast) listed in the read script file are similarly read from the management recording medium and stored in the work area (step 42). CPU 11 checks whether all casts listed in the script file exist (step 43).
[0085]
The CPU 11 also activates the disk drivers 21 and 31 to check whether all the image files and sound files described in the previously read cast are recorded on the image recording medium and the sound recording medium. (Steps 44 to 46). In general, since one file is described in one cast, the processing in step 45 is not necessarily required.
[0086]
An error occurs if at least one cast described in the script file does not exist in the management recording medium, or if at least one file described in the cast does not exist in the image or sound recording medium. become.
[0087]
If there is no error, the reproduction operation is performed according to the script file and cast stored in the read work area.
[0088]
A cast counter is provided to indicate the currently playing cast in the script file. 1 is set in this cast counter (step 47).
[0089]
The cast indicated by the cast counter is decoded, and it is determined whether it is an image cast or a sound cast (step 51). In the case of image cast, the process proceeds to the process shown in FIG. 12, and in the case of sound cast, the process proceeds to the process shown in FIG.
[0090]
In the case of an image cast, an image composition process is first performed. The image recording medium is accessed using the album name and file name included in the image cast, and the corresponding image file is read out and stored in the work area. In the case of a combined image file, one or a plurality of image data designated by the resolution information is read out. When the read image data is compressed, an expansion process is performed. The image data in the work area is rotated as necessary according to the image rotation information described in the image file (union type image file). In accordance with the enlargement / reduction ratio described in the image cast, the image data is enlarged or reduced as necessary. If necessary, the image data is positioned and cut out according to the position information in the image cast.
[0091]
Preferably, the image reproducing device 22 is provided with two VRAMs. One is for the currently displayed image and the other is for the next image to be displayed. In such a case, the image data of the work area is transferred to the VRAM of the image reproducing device 22 and stored. In the case of combined image data, two or more image data are synthesized on the VRAM (step 52).
[0092]
In the case of the first cast (YES in step 53), after the image composition process, the process immediately proceeds (skips steps 54 to 58) and proceeds to the composite image output process and the display command process (step 59). The image appearance effect and the effect time are given to the image reproducing device 22 together with the display command, and the image represented by the image data on the VRAM is displayed on the display device 23 with the instructed effect.
[0093]
In this embodiment, image composition processing for the next image cast is performed while the current cast is being reproduced. Each timer is provided for measuring the transition time and the display time. The transition time is set in the transition time timer when playback of the current cast is started (step 62). If the current cast is an image cast, the display time is set in the display time timer (step 61).
[0094]
If the cast counter is other than 1 (NO in step 53), it waits for the transition time timer to expire (timer interrupt) (step 58), and proceeds to composite image output and display command processing. (Step 59).
[0095]
Thereafter, the cast counter is incremented by 1 (step 60), and the display time and the transition time in the current image cast are set in the display time counter and the transition time counter, respectively (steps 61 and 62). Thereafter, returning to step 50, preparation for the next cast is started.
[0096]
When the display time timer expires during the waiting time of the transition time timer (when a timer interrupt occurs), an erase command is given to the image playback device 22 (steps 56 and 57). The image displayed on the display device 23 disappears. When the next image is immediately displayed by the processing of step 59, it appears that the image has been switched.
[0097]
When the current cast is a sound cast, and the notification that the reproduction of the instructed clip has been completed is received from the sound reproduction device 32, the CPU 11 recognizes that fact (steps 54 and 55).
[0098]
If the image reproducing device 22 has only one VRAM, the image composition (or writing) processing on the VRAM in step 52 will be performed in step 59.
[0099]
In the case of sound cast, the start pointer and stop pointer (expressed in time) included in the sound cast are converted into physical addresses on the sound recording medium, respectively (step 63). Thereafter, the transition timer 58 waits for time up (step 58), and a reproduction command including the data described in the sound cast and the physical address is given to the sound reproducing device 32 (step 64). In response to this, the sound reproducing device 32 reproduces the instructed clip in the sound file instructed from the sound recording medium, and outputs the sound from the speaker 33. The other processes are the same as those shown in FIG. 12, and the same steps are denoted by the same reference numerals to avoid redundant description. In the process of FIG. 13, there is no display time setting process.
[0100]
When all the casts described in the script file have been processed (YES in step 48), the sound playback device waits for the display time timer to expire for the last image cast, or in the case of sound casts. All processing ends after waiting for the sound reproduction end report from (step 49).
[0101]
FIGS. 14 and 15 show processing according to the transition time defined in FIG. 7, and correspond to FIGS. 12 and 13, respectively. FIG. 11 is also used as it is in this example.
[0102]
In FIG. 14, the image composition processing in step 52 shown in FIG. 12, the composite image output in step 59, and the display command processing are continuously performed (step 71), and the image designated by the image cast is displayed on the display device 23. The Thereafter, the cast counter is incremented (step 60), and the display time is set in the display time timer (step 61).
[0103]
Waiting for the display time timer to expire (step 56), outputting an image deletion command (step 57), and setting the transition time to the transition time timer (step 62).
[0104]
When the transition time timer expires (step 58), the process proceeds to the next cast (step 50).
[0105]
If the transition time is zero, steps 62 and 58 are skipped.
[0106]
When the transition time indicated by the broken line in FIG. 7 is defined, the transition time is set (step 62) together with the display time set in step 61.
[0107]
Similarly, in the processing for the sound cast in FIG. 15, the processing in steps 63 and 64 in FIG. As a result, sound is reproduced. Thereafter, the cast counter is incremented (step 60).
[0108]
After the notification that the reproduction of the instructed clip has been completed is received from the sound reproducing device 32 (step 54), the transition time is set (step 62). After the transition time timer expires (step 58), the process proceeds to the next cast process (step 50).
[0109]
When the time (start time) from the start of the presentation to the image display or sound generation according to each cast is defined as the transition time, the transition time is read from all casts and arranged in that order (time Table), the time measured by the timer started from the start of the presentation and each transition time are compared, and when the two times match, the sound that follows each cast is generated or the image is displayed (at this time) Considering the time required for preprocessing for sound generation or image display, preprocessing should be performed a little earlier.)
[0110]
An image cast creation process will be described. This processing can be divided into rough selection of images and specification of details of image cast data.
[0111]
In the rough selection of an image, a desired one is selected from among image files (including a combined image file) stored in an image recording medium. At this time, the above-described search image data will be used effectively. An image represented by the selected image file is displayed on the display device 14 or 23 (data expansion and image synthesis are performed). The operator looks at the displayed image and decides whether or not to make a final selection. The program name and file name of the finally selected image file are stored in the work area of the memory 12.
[0112]
When the selection of necessary image files is completed, an image cast is created for each selected image file. Merge information necessary for image casting, transition time, display time, image appearance effect and time, position information, magnification, etc. are sequentially input. The created image cast is saved in the work area. When the creation of all necessary image casts is completed, these image casts are stored in the management recording medium.
[0113]
The sound cast is created in almost the same procedure. First, a sound file is selected. A sound file is specified on the sound recording medium, and the sound is reproduced. Upon listening to the reproduced sound, the operator finally decides whether to make a selection. The album name and file name of the determined sound file are stored in the work area.
[0114]
Among the detailed data of the sound cast, those that require input are the transition time, start pointer, and stop pointer. The selected sound file is played. When an input designating the time point is given from the input device 13 when the sound desired to be the start pointer is output, the CPU 11 inquires of the sound reproduction device 32 at that time. The time returned from the sound reproducing device 32 becomes the start pointer. Similarly, the stop pointer is set. Finally, the transition time is input.
[0115]
The script file is created by inputting the already created cast in the playback order.
[0116]
Once created, the script file and cast are played back in the above-described procedure. The operator corrects necessary parts while viewing the reproduced multimedia. Information about each media is described in the image cast and sound cast, and the entire flow is described in the script file. Therefore, it is sufficient to individually correct these, and the correction work is easy.
[0117]
The multimedia presentation system will be used for product guidance at stores, guidance for exhibits (paintings) at museums, presentation of information at conferences, parties, etc., and reporting.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a multimedia presentation system.
FIG. 2 shows a natural image before synthesis.
FIG. 3 shows a character image before synthesis.
FIG. 4 shows a composite image.
FIG. 5 shows an example of the structure of a combined image file.
FIG. 6 shows an exemplary sequence of multimedia presentation.
FIG. 7 shows another example of a sequence of multimedia presentations.
FIG. 8 shows an example of a script file.
FIG. 9 shows an example of the structure of an image cast.
FIG. 10 shows a structure example of sound cast.
FIG. 11 is a flowchart showing an example of multimedia presentation processing.
FIG. 12 is a flowchart showing an example of multimedia presentation processing.
FIG. 13 is a flowchart showing an example of multimedia presentation processing.
FIG. 14 is a flowchart showing another example of multimedia presentation processing.
FIG. 15 is a flowchart showing another example of multimedia presentation processing.
[Explanation of symbols]
10 Computer system
11 CPU
15, 21, 31 Disk driver
22 Image playback device
23 Display device
32 sound player
33 Speaker

Claims (17)

A plurality of image data is stored in advance in the first recording medium in association with the identification information,
A plurality of sound data are stored in advance in the second recording medium in association with their identification information,
At least identification information indicating image data representing an image to be displayed and a plurality of image casts describing transition time data relating to the image representing image output start time, identification information indicating at least sound data representing sound to be generated, and sound output start A plurality of sound casts describing transition time data relating to sound representing time and time point data representing a portion of sound data to be generated, an image cast of an image to be displayed, and a sound cast of a sound to be generated. Create a script file written in the order in which it should be output and store it in the third recording medium.
Read the script file from the third recording medium, read the image cast and sound cast described in the read script file,
In the order of image cast and sound cast described in the script file, the image data is read from the first recording medium in accordance with the identification information included in the read image cast, and the image represented by the read image data is displayed as the image. The sound in the time zone specified by the time data among the sound data of the second recording medium displayed on the display device at the time specified by the transition time data and specified by the identification information included in the read sound cast And output this sound from the speaker at the time specified by the transition time data for the sound.
Multimedia presentation method   The multimedia presentation method according to claim 1, wherein at least any two of the first recording medium, the second recording medium, and the third recording medium are the same recording medium.   The transition time from the reference time point of the image display according to the preceding image cast or the reference time point of the sound generation according to the sound cast to the reference time point of the image display according to the subsequent image cast or the reference time point of the sound generation according to the sound cast The multimedia presentation method according to claim 1, wherein the time is from a start time of presentation to a reference time point of image display according to image cast or a reference time point of sound generation according to sound cast.   4. The multimedia presentation method according to claim 1, wherein an image display time is described in advance in an image cast or a script file, and the image is displayed during the display time.   The multimedia presentation method according to any one of claims 1 to 4, wherein the resolution, position or enlargement / reduction ratio of an image to be displayed is described in advance in an image cast, and an image according to the description is displayed. . A coalesced image file including a plurality of image data and data relating to the synthesis of these image data is stored in advance on the first recording medium as the image data, and the identification information of the coalesced image file is included in the image cast. Aside,
When a coalesced image file is specified by the image cast, at least two images specified in the coalesced image file are combined and displayed.
The multimedia presentation method according to any one of claims 1 to 4. A first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of pieces of image data in association with the identification information;
A second reading device for reading sound data corresponding to the instructed identification information from a second recording medium storing a plurality of sound data in association with the identification information;
A display device for displaying an image represented by image data read from the first recording medium;
A sound generator for generating sound represented by sound data read from the second recording medium, and at least identification information indicating image data representing an image to be displayed and transition time data relating to an image representing an image output start time A plurality of sound casts, identification information indicating sound data representing sound to be generated, transition time data relating to sound representing sound output start time, and sound data describing time point data representing a portion to be generated among sound data A script file is read from a third recording medium storing a cast and a script file in which an image cast of an image to be displayed and a sound cast of a sound to be generated are arranged in the order to be output; The image cast described in the read script file and The sound cast is read, and the image data is read from the first recording medium according to the identification information included in the read image cast in the order of the image cast and the sound cast described in the script file, and is represented by the read image data. The image to be displayed is displayed on the display device at a time specified by the transition time data relating to the image, and is defined by the time data among the sound data of the second recording medium specified by the identification information included in the read sound cast A control device for generating a sound in a specified time zone and controlling the sound to be output from the sound generator at a time defined by transition time data relating to the sound;
Multimedia presentation system with   The multimedia presentation system according to claim 7, wherein at least two of the first recording medium, the second recording medium, and the third recording medium are the same recording medium.   The transition time from the reference time point of the image display according to the preceding image cast or the reference time point of the sound generation according to the sound cast to the reference time point of the image display according to the subsequent image cast or the reference time point of the sound generation according to the sound cast The multimedia presentation system according to claim 7 or 8, wherein the time is from a start time of a presentation to a reference time point of image display according to image cast or a reference time point of sound generation according to sound cast. A coalesced image file including a plurality of image data and data relating to the synthesis of these image data is stored in advance on the first recording medium as the image data, and the identification information of the coalesced image file is included in the image cast. And
Image synthesizing means for synthesizing at least two images defined in the coalesced image file when the coalesced image file is instructed by the image cast;
The multimedia presentation system according to any one of claims 7 to 9. Using a first recording medium storing a plurality of image data in association with their identification information, and a second recording medium storing a plurality of sound data in association with their identification information,
At least identification information indicating image data representing an image to be displayed and a plurality of image casts describing transition time data relating to the image representing image output start time, identification information indicating at least sound data representing sound to be generated, and sound output start Multiple sound casts describing transition time data relating to sound representing time and point-in-time data representing the portion to be generated of the sound data, and image cast of the image to be displayed and sound cast of the sound to be generated Create a script file that is arranged and described in the order to be stored and store it in the third recording medium.
How to create multimedia data.   12. The multimedia data creation method according to claim 11, wherein the first recording medium and the second recording medium are the same recording medium.   The transition time from the reference time point of the image display according to the preceding image cast or the reference time point of the sound generation according to the sound cast to the reference time point of the image display according to the subsequent image cast or the reference time point of the sound generation according to the sound cast 13. The method of creating multimedia data according to claim 11 or 12, wherein the time is from a start time of a presentation to a reference time point of image display according to image cast or a reference time point of sound generation according to sound cast.   The multimedia data creation method according to any one of claims 11 to 13, wherein the display time of the image is stored in an image cast or a script file.   15. The multimedia data creation method according to any one of claims 11 to 14, wherein the resolution, position or enlargement / reduction ratio of an image to be displayed is stored in an image cast.   A merged image file including a plurality of image data and data relating to the synthesis of these image data is stored as the image data in the first recording medium, and the identification information of the merged image file is included in the image cast. Item 15. The multimedia data creation method according to any one of Items 11 to 14. A first reading device for reading image data corresponding to instructed identification information from a first recording medium storing a plurality of pieces of image data in association with the identification information;
A second reading device for reading out sound data corresponding to the instructed identification information from a second recording medium storing a plurality of sound data in association with the identification information, and image data representing at least an image to be displayed A plurality of image casts describing transition time data related to an image representing the image output start time, identification information indicating sound data representing at least sound to be generated, transition time data relating to sound representing the sound output start time, and Multiple sound casts describing time point data representing the portion of sound data to be generated, and image casts of images to be displayed and sound casts of sounds to be generated arranged in the order in which they should be output A recording device for recording the script file on a third recording medium;
Multimedia data creation system with

Images