JPH0697383B2 - Multimedia software temporary editing method and temporary editing apparatus - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION <Industrial field of application> The present invention relates to CD-I software (title), CD-ROM software, CD
The present invention relates to a method for creating multimedia software such as ROMXA software and a device for creating the multimedia software.

<Prior art> Multimedia software uses large-capacity storage media such as CD-I and CD-ROM and the computing power of computers to unify character code data, image data, sound data, etc., with different expression formats. It is software that can output multimedia by advanced handling.

For example, a CD-ROMXA disc is manufactured through the process shown in FIG.

First, a plan is made on what kind of disc to make (S901). The production concept is decided.

Then, the designer creates a scenario based on the plan (S902). In this case, when creating multimedia software,
It is handwritten on the paper by the designer.

This multimedia software is software that controls the display of images and characters and their changes with a computer program (playback program) in time with the progress of sound. But,
Precise design of the display timing and various visual effects was difficult even for a skilled designer.

So, in reality, after the conceptual scenario is written on paper (S902), after the material collection process (S903), the computer engineer makes an appropriate judgment to process the data for each material (S904), And develop the program (S90
Five).

Furthermore, the correction feedback loop is repeated, in which the thus-produced one is reproduced and the correction instruction is given again while watching this.

In this data processing (S904), the sound data is digitally converted for the analog material, and data compression processing is performed (S906). Image data is obtained by digitally converting an analog material such as a photograph (S907) and then performing data compression processing. Also, these image data are interleaved with the sound data after the layout editing step (S908) (S909).

A document as a material undergoes CTS (Computer Type Setting System) processing (S910) and database processing (S911).

Furthermore, regarding the program, after modification, compile,
It is the one to be linked.

Then, each data processed and edited in this way is formatted according to the mounted media (S912), and after premastering (S913),
It is stored on that medium, eg a CD-ROM XA disc.

Then, this CD-ROM XA disk is driven by a CD-ROM reproducing device, and the stored data is reproduced and displayed by a monitor or a speaker based on a program.

<Problems to be Solved by the Invention> In such a conventional method for creating multimedia software, since the process of material processing (data processing) is complicated and very long, even a slight change in a part of the software causes a correction work. There was a problem that it took a long time. If it takes too long for the modified feedback loop to converge and the software be created, the cost will be high, and the problem of not being able to produce a work with good content has also been derived.

Therefore, the following methods are conceivable in order to solve this problem.

One is the shortening of the above material processing steps. For example, simultaneous digitization of sound and ADPCM compression can be performed.

Alternatively, it is a simplification of the editing process. In particular, in data editing on a CD-ROMXA disc and a CD-I disc, advanced multimedia expression is possible by appropriately interleaving image data and compressed sound data. However, since this interleaving process takes time, the interleaving process is not actually performed, but a virtually interleaved situation is created to shorten the feedback loop.

However, even with these methods, the following drawbacks still occurred.

In other words, even if the above improvements have been made, once the state of being able to be played back on the computer (above S913) is checked, the result of the playback is checked to see the sound material or image (pictures, characters, etc.)
There are many cases where you want to replace some of the material in the feedback loop. In this case, it is necessary to digitize the material and perform compression processing (data processing) every time. With the conventional creation method, it is not possible to make changes on the spot and display and generate the results in front of the designer.

In addition, the program needs to be modified at the same time by simply changing the display timing or the picture display method.

Therefore, according to the present invention, by temporarily editing a video image without processing the material, a designer or the like can easily make corrections and the like, which can be created accurately in a short time, and further cost reduction can be achieved. To provide a method for creating multimedia software and a device for creating multimedia software,
Its purpose is.

<Means for Solving the Problems> A temporary editing method for multimedia software according to the present invention is a multimedia created by processing and editing a plurality of media materials including sound and images into a format usable by a computer. A method for temporarily editing media software, comprising: recording an image as a video signal together with a time code; recording sound together with the time code; And a temporary editing step of laying out on the time axis of the time code, a step of checking whether or not the sound and image laid out by the temporary editing conform to the format used in the software, A multimedia software including a step of extracting timing data based on a sound and an image laid out by editing. This is a temporary editing method for software.

The temporary editing apparatus for multimedia software according to the present invention is a temporary editing apparatus for multimedia software created by processing and editing a plurality of media materials including sounds and images into a format usable by a computer. There is an image input means for inputting an image as a video signal together with a time code, a sound input means for inputting a sound together with a time code, and a function for reproducing the inputted sound and image. A temporary editing means for extracting and laying out the time code on the time axis, a format checking means for checking whether or not the laid out sound and image conform to the format used for the software, and the temporary editing Multimedia software comprising timing data extraction means for extracting timing data from the means. It is a temporary editing apparatus A.

<Operation> In the temporary editing method and the temporary editing apparatus for multimedia software according to the present invention, an image is converted into a video signal and recorded together with a time code, and a sound is recorded together with the time code. While playing back these recorded images and sounds, necessary sounds and images are extracted and laid out on the time axis of the time code (temporary editing). And
Timing data is extracted based on the laid out sound and the image.

Therefore, the strict scenario in the conventional process is unnecessary, and the necessary information can be easily defined while performing the simulation in the temporary editing process.

<Example> Hereinafter, an example of the present invention will be described with reference to the drawings.

1 to 8 are diagrams for explaining an embodiment of a method for creating multimedia software according to the present invention.

As shown in FIG. 1, the method of creating multimedia software is such that the rough scenario creating step (S1
01), the material collecting step (S102), the temporary editing step (S103), the material processing step (S104), and the like.

The rough scenario creating step (S101) is a step of creating a scenario in which sounds and images change with time. The scenario in this case does not have to be rigorous, and may be a scenario in which an outline story that represents a concept is developed.

The material collecting step (S102) collects sound data and image data, which are a plurality of media data, based on the above-mentioned scenario. For example, as shown in FIG.
Collect sound sources (magnetic tape), video tapes, color photographs (positive film), typeset letters, drawings, or character data (documents, CTS tapes) according to the subject of the scenario. These are taken in by a scanner or the like according to the material.

In the provisional editing step (S103), a provisional editing device capable of outputting and temporally editing by a video image for materials related to these images and a voice synchronized with the video image for materials related to sound is used. The simulation of the layout of these materials on the time axis is performed.

In the material processing step (S104), the material temporarily edited in the temporary editing step is processed according to the medium in which the software is used. For example, CD-ROM XA
When making discs for audio, ADPC for sound data
M-encoding is CLUT data for videotapes and color photographs.

FIG. 2 is a diagram for explaining the concept of the temporary editing device used in the temporary editing step (S103).

As shown in this figure, a picture, a film, etc. are recorded as image data by a video signal by the camera 21, and are inputted and stored in the control device 22 constituted by a computer.

The characters are recorded as image data by a video signal by the video teloper 23, and are input and stored in the computer 22.

The video tape on which other moving images and the like are recorded is input to the computer 22 by the video tape recorder 24 together with the time code.

As for sound (magnetic tape), a time code and sound data are input to the computer 22 by the audio recorder 25.

The computer 22 includes, for example, 8 MB RAM, a video frame buffer, a video digitizer, an audio digitizer, a 1.2 GB hard disk, and the like.

Therefore, each media data input to the computer 22 can be selected and extracted by the computer 22, and the image data is displayed on the monitors 26 and 27,
Although not shown, the sound data will be reproduced by a speaker. Then, the video data and the sound data are edited while being reproduced and output in real time.

For example, extraction of necessary parts from each video and sound data,
The layout is edited based on the time code (which is automatically managed by the computer 22), and the effect is given by the video effect device 28 and the like. Therefore, designers etc. refer to the monitor display and audio output using this temporary editing system based on the above rough scenario,
This makes it possible to easily perform temporary editing in real time while simulating.

Then, in this provisional editing system, timing data is output from the data thus provisionally edited and created as a floppy 30 via the video effect device operation monitor means 29.

Here, the timing data specifies which part of which kind of material is used, and the specified material is
It indicates at what timing it is used.

Further, in this provisional editing system, at the same time when the timing data 30 is created, the proofreading video tape 32 which is provisionally edited by the video recording device 31 can be created.

In this temporary editing system, CD-I media,
Data processing (data compression, formatting, etc.) for CD-ROM media etc. is not performed.

FIG. 3 is a conceptual diagram showing a process of extracting each information after the temporary editing by the video is completed.

The material list creating means 331 extracts the following editing list based on the timing data 30. For example,
A floppy disk 34 storing a list showing display materials such as pictures and films, a floppy disk 35 storing a list showing character materials to be displayed, a floppy disk 36 storing a list showing video frames of video images to be extracted.
To create.

For the sound, a floppy disk 37 storing a list (designated by a time code) indicating the sound material to be extracted is created.

Further, the interleave parameter creating means 332 creates the floppy disk 38 in which the parameters for interleaving are stored.

FIG. 4 is a conceptual diagram showing the steps of material processing.

In this material processing step, for the materials such as video tapes and magnetic tapes for sound, only the parts that are actually used are extracted based on the time code using the list of each material described above, and the data is digitized and digitalized. Perform compression. For the film, the film number to be actually used is selected from the time code given at the time of temporary editing, and the data is digitized and the data is compressed.

For example, the picture 41 is extracted from the list 34, digitized by the scanner 42, and then compressed into a DYUV signal to be recorded on the magnetic disk 45.
Hold on. 43 is a magnetic disk that holds the digitized data, and 44 is the data on this magnetic disk 43
The process of compressing to a UV signal is shown.

The sound tape 46 is a tape 48 that is digitized after being extracted from the lists 36 and 37 and that uses a PCM sound source or the like.
In step 49, it is further compressed into an ADPCM signal. A magnetic disk 50 stores the compressed signal.

For the characters 51 described in a document or the like, character pages are extracted from the list 35, digitized by the word processor 52 or CTS, and stored in the floppy disk 53. This disc 53
When handling the character data as the character data, the magnetic disk 55 is created through steps 54 such as code conversion and font extraction for CD-I or CD-ROM.

When the character data of the disk 53 is treated as a picture (image data), it is stored in the magnetic disk 58 in the digitizing and CLUT forming step 57 after the camera taking step 56 of the telop after phototypesetting.

The video frame 59 extracted from the video tape or the like by the list 36 is stored in the frame buffer 60 of the computer, then stored in the magnetic disk 61, compressed into DYUV data 62, and held in the magnetic disk 63.

FIG. 5 conceptually shows the process of data editing.

Each digital data processed in the material processing step is read from each magnetic disk 45, 50, 55 (or 58), 63, and these data are automatically interleaved by using the interleave parameter 38, and 65 Each is processed in the file edit processing step 66.

This automatic interleave processing is performed as follows. First, the file name of the real-time file on the CD-I disc is decided in advance. Time data is SAMPTE time code (30 frames / second) on the timing data 30 of provisional editing.
Is converted to the number of sectors on the CD-I disc (75 sectors / second). Then, the coding information is automatically generated. When processing a material, add the following information to the material data. For image data, image compression format,
The type (for example, DYUV, CLUT8, etc.), and in the case of sound data, the compression format and type of sound (for example, B level stereo). Furthermore, when the compression level of the sound is decided,
The layout pitch is uniquely determined. This is because it is necessary to output so that the sound is not interrupted,
For example, in the B level stereo, sound data is stored in one of every four sectors. The image is laid out and stored by being divided into empty sectors between the sound sectors. In this case, all images must be laid out before the time when they are displayed as images. If this layout is not possible, an error will occur. In addition, a mark indicating the end of the file is added to the last divided sector.

Further, in the temporary editing step before the automatic interleaving step, it is possible to check whether the image data can be read from the disc before the designated image display time.

First, the timing of image display by the timing parameter, for example, the time from the A image display to the B image display is calculated by the SAMPTE time code, and this calculated value is converted into the number of sectors of the CD-I disk. It is calculated whether this converted value can store all B image data. For example, if the B image data is 300 Kbytes, (300 × 102
4) ÷ 2324 = 133 sectors are calculated (one sector consists of 2324 bytes). A sector for storing sound is required during this period, and 25% of the sector is set as a sound sector in the B level stereo. 133
× 1.25 = 167 sectors. Furthermore, 167 ÷ 75 = 2.23 seconds.

Therefore, the sound level and the image type are input in advance, and the above interval (time between A image display and B image display)
If it is less than 2.23 seconds, a warning message will be issued and the operator will be notified of the software with a CD-I or CD-R.
Warning that OMXA media cannot be created. As a result, the scenario can be rigorized on the spot in the temporary editing step before the interleave processing is performed, and the work efficiency can be significantly improved as compared with the case where this check is not performed.

When these data are interleaved and edited as described above, additional processing of error correction data necessary for CD-I, CD-ROM, etc. is further performed in the premastering processing step 67, and the disc creation step 68 is performed. At CD-I or
A test disc 69 for the CD-ROM is created.

FIG. 6 shows a reproducing parameter generating process for giving a display timing of the interleaved data to a multimedia reproducing program for operating on a reproducing apparatus for CD-I or CD-ROM.

The reproduction parameter generation means 71 uses the timing data 30
The time code of each video frame obtained by
30 frames / second SAMPTE time code), CD-I or
Includes a means for converting to different time codes (eg, 75 sectors / second trigger count) used in CD-ROMs, etc., and creates playback parameters consisting of this time code and a list of image display methods (visual effects, etc.). The reproduction parameters are stored in the disc 72.

In this way, the reproduction parameter is generated and held separately from the multimedia reproduction program, and defines the processing sequence (image display timing, display method, etc.) of the multimedia reproduction program.

As a result, as shown in FIG. 7, in the reproduction test of the test disc 69, the multimedia reproduction program 74 and the reproduction parameter 72 including the display method and the display timing are loaded into the CD-I player 73 or the like. Then, a reproduction procedure is created, and after that, the test disk 69 is controlled to perform a final reproduction test.

Further, in this case, since the video medium simulated by the temporary editing device and the CD-ROM medium and the CD-I medium have different data, hardware specifications, etc., there may be some timing error in reproduction and display. At this time, as compared with the calibration video tape 32, this time shift is counted as the number of frames on the video frame, and the timing can be adjusted easily by only correcting the reproduction parameter 72 with an editor.

FIG. 8 is a conceptual diagram showing the main data editing process.

If the timing is correct in the above test process, CD-I, CD-ROM
Make a master disc of the disc.

This is final edited using the modified playback parameters 81, test disc 69 and multimedia playback program 74.

Then perform premastering again, and finally, for example, 3 /
Output to PCM1630 format on 4 inch U-matic tape and press the disk 82 at the mastering factory.

<Effect> As described above, according to the present invention, since these materials can be provisionally edited before the material is processed, it is possible to perform accurate editing that cannot be expressed in the conventional scenario written on paper. It becomes possible to give an instruction about data processing at a timing. As a result, the quality (content) of the software work can be improved.

In addition, when a part of the scenario is changed during editing, it is not necessary to perform the material processing work for a long time each time, and the software can be easily modified as a whole. Therefore, it is possible to achieve a significant cost reduction in creating software.

Furthermore, the designer who created the scenario can edit the material, so that the finish of the work can be improved.

[Brief description of drawings]

FIG. 1 is a flow chart showing a procedure for creating multimedia software according to an embodiment of the present invention, FIG. 2 is a conceptual diagram for explaining a temporary editing device according to an embodiment, and FIG. FIG. 4 is a conceptual diagram showing a material list and an interleave parameter creating process according to one embodiment, FIG. 4 is a conceptual diagram showing a material processing process according to one embodiment, and FIG.
FIG. 6 is a conceptual diagram for explaining from data editing to test disc creation according to one embodiment, FIG. 6 is a conceptual diagram showing a reproduction parameter generation process according to one embodiment, and FIG. 7 is related to one embodiment. FIG. 8 is a conceptual diagram for explaining a reproduction test process, FIG. 8 is a conceptual diagram for explaining a data main editing process according to one embodiment, and FIG. 9 is a process diagram showing a conventional CD-ROM XA title manufacturing process. is there. S101 …… Rough scenario creation process, S102 …… Material collection process, S103 …… Temporary editing process, S104 …… Material processing process.

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI Technical display location H04N 5/76 Z 7916-5C 5/782 A 7916-5C

Claims (2)

[Claims] 1. A temporary editing method for multimedia software, which is created by processing and editing a plurality of media materials including sound and images into a format usable by a computer, wherein the images are time codes as video signals. And a step of recording the sound together with the time code, and a step of temporarily editing the recorded image and the sound while extracting the necessary sound and image and laying them out on the time axis of the time code. , A step of checking whether or not the sound and image laid out by the temporary editing conform to the format used by the software, and extracting timing data based on the sound and image laid out by the temporary editing A temporary editing method for multimedia software, which comprises the steps of: 2. A temporary editing apparatus for multimedia software created by processing and editing a plurality of media materials including sound and image into a format usable by a computer, wherein the image is a time code as a video signal. An image input means for inputting together with the sound, a sound input means for inputting sound together with the time code, and a function for reproducing the input sound and image, and extracting necessary sound and image on the time axis of the time code. A temporary editing means for laying out, a format checking means for checking whether or not the laid out sound and image are compatible with the format used for the software, and timing data extraction for extracting timing data from the temporary editing means. A provisional editing device for multimedia software, characterized by comprising: