JPH07222163A - Moving picture editing device - Google Patents

Abstract

PURPOSE:To reduce the capacity of a picture memory required during an editing operation by encoding data encoded by a moving picture encoding system using inter-frame correlation again by an intra-frame encoding system, editing moving pictures and encoding them again by the moving picture encoding system. CONSTITUTION:In the memory or a file, respective frames from the frame 15 to the frame 44 are encoded by a JPEG system and obtained code data are stored. The encoded data from the frame 20 to the frame 40 are read from the memory or file 22, decoded in a JPEG decoder 24 and picture data are prepared. Thereafter, the editing from the frame 20 to the frame 40 is performed by an editing device 25, encoding by a JPEG encoder 21 is performed and storage in the memory or file 22 is performed. When the editing operation is completed, the encoded data are read, the picture data are decoded in the JPEG decoder 24, MPEG encoding is performed by an MPEG encoder 29 and the output from the file is performed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image editing apparatus.

[0002]

2. Description of the Related Art MP is used as a moving image coding system for storage.
There is an EG method, and there is an H261 method as a moving image coding method for communication such as a TV conference and a TV phone. International standardization is recommended for each of these methods.

Since each of the MPEG and H261 systems is a coding system using inter-frame correlation of moving image data and a Huffman code allocation system, it is coded by a variable length coding system. .

[0004]

However, since a moving picture is coded using inter-frame correlation such as MPEG or H261 as a method of coding a moving picture, it is necessary to decode all frames in the conventional moving picture editing. There was a large amount of memory required. Also, MPEG, H261
Since each method is coding using inter-frame correlation, the images of all the frames that make up the moving image are not edited when editing all the frames of the moving image, but when editing the predetermined frame. After decoding the data, it was necessary to perform the editing process and re-encode the moving image.

The present invention has been made in view of the above problems, and an object of the present invention is to provide a moving image editing apparatus which does not require a large-capacity memory when editing encoded moving image data. To provide. Further, it is another object of the present invention to provide a moving image editing apparatus in which the amount of image data to be decoded is suppressed as much as possible when an editing process is performed on a predetermined frame.

[0006]

For this reason, the moving image editing apparatus according to the present invention decodes the encoded moving image data, and the decoded moving image data is intra-frame encoded and stored. Storing means, editing means for decoding the intra-frame coded image stored in the storing means and performing arbitrary editing, and coding for coding the edited frame image by a moving picture coding system And means.

Of the encoded moving image data, I
Intra frame detection means for detecting an intra frame, decoding means for decoding a predetermined number of frames of moving image data after the frame detected by the intra frame detection means, and moving image decoded by the decoding means Storage means for storing data on a frame-by-frame basis, editing means for arbitrarily editing an image on a frame-by-frame basis stored in the storage means, and encoding the edited frame image by a moving image encoding method. And an encoding unit.

[0008]

With the above structure, moving image data encoded by the moving image encoding system using inter-frame correlation is once re-encoded by the intra-frame encoding system, edited by the moving image, and then encoded by the moving image encoding system again. It becomes possible to edit moving image data of encoded data that could not be directly edited in the past, and it is possible to greatly reduce the amount of image memory required during editing work. .

Further, since it is possible to reduce the amount of moving image data to be decoded when a predetermined frame is edited, it is possible to speed up the range of memory capacity and processing.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the first embodiment, the moving image coded data to be input is the MPEG system, the intraframe coding system to be used internally is the JPEG system, and the input moving image coded data is A case will be described in which all the frames are subjected to code conversion for editing work.

FIG. 1 is a block diagram of the moving image editing apparatus of this embodiment. Reference numeral 1 is a system bus that controls the entire system, and 2 is a code conversion unit I that decodes input moving image coded data and converts it into intraframe coded data.
Reference numeral 3 denotes a moving picture editing unit that decodes the internally coded data and edits a moving image. Reference numeral 4 denotes a code conversion unit II that converts the result of the moving picture editing into moving image coded data again.

A detailed block configuration of each processing unit is shown in FIG. In the figure, the same blocks as those in FIG. 1 are designated by the same reference numerals.

The code conversion unit I of 2 has three blocks 2
It consists of 0, 21, 22. Reference numeral 20 denotes an MPEG decoding unit that decodes a bit stream encoded by the MPEG method, which is input moving image encoded data, and 21 denotes
JPE for encoding the frame image data decoded in 20 by the JPEG method which is an intraframe code
The G encoder unit 22 is a memory or a file for accumulating the output of 21.

The moving image editing unit 3 is provided with 22 and 24 to 26.
It consists of 5 blocks. 24 is a JPEG decoder, 25 is an editing unit for editing a moving image in frame units,
26 is a frame of the frame unit edited in 25 JP
JPEG encoder for EG encoding, 22
Is a memory or file that stores the 26 outputs.

The code conversion unit 4 is composed of two blocks 22 and 29, and 29 is an MPEG encoder for encoding in the MPEG system.

The processing procedure of the moving image editing apparatus of the first embodiment will be described below with reference to FIG.

First, when moving picture coded data coded by the MPEG system as an input is designated by a user by a pointing device such as a mouse (not shown), the instructed moving picture coded data is stored in the code conversion section 2. MPEG
The MPEG bit stream is decoded in order by the decoder 20. Next, the image data for each frame, which is the output result, is input to the JPEG encoder 21, JPEG-encoded on a frame-by-frame basis, and stored in a memory 22 or a file. Then, the JPEG-encoded image data stored in the memory or the file 22 is arbitrarily searched by the user for a frame to be edited, thereby enabling the moving image editing process.

For moving image editing, a frame designated by the user is read from 22 memories or files, and 24 frames are read.
It is decoded by the JPEG decoder of and returned to the frame image. The image data returned to the frame image is edited by 25 editors. The editing work in this embodiment is to rewrite the image data itself in the frame. The frame image after the completion of the editing work is encoded for each frame image by the JPEG encoder 26 so as to be stored again in the memory or the file 22. When there are a plurality of frames to be edited, this work is repeated, and after the work of editing all the frame images is completed, the code conversion unit II of 4 performs JPEG coding for each frame to convert the coded data into 2 frames.
Read from 2 memory or file, 29 MPEG
An encoder performs moving image coding on all frames by the MPEG method.

As described above, according to the present embodiment, JPEG is applied to the input moving image encoded data encoded by the MPEG system.
After performing intra-frame coding using the method, search the screen to be edited, perform the editing process, and perform the moving image coding again, and as a result, it becomes possible to edit the moving image coded data. It is possible to significantly reduce the memory capacity.

(Second Embodiment) In the first embodiment, MP
Although an example of editing after decoding all the image data encoded by the EG method has been described, in the second embodiment,
A case will be described in which only the image data of a portion required for editing is decoded from the image data encoded by the moving image in the MPEG system to perform the editing process.

In the present embodiment, a case will be described in which the image data coded by the MPEG system is subjected to intra-picture coding every 15 frames. Also, there are 20 frames for the user to perform editing processing.
It is assumed that there are 20 frames from frame to 40 frames.

In this case, the input image data encoded by the MPEG system has a structure as shown by 38 in FIG. 3, and reference numerals 30 to 34 in the figure denote images encoded by the input MPEG system. Intra-Pic of data
indicates the position of the true, for example, 30 Intr
a-Picture is the 0th frame, and the next Int
The ra-Picture 31 is the 15th frame. In the case of the present embodiment, since there are 20 to 40 frames to be edited, 31 Int in 38 bit streams are used.
Intra-Pict of 33 from ra-Picture
It is sufficient to decode and edit up to the point before ure.

A configuration for performing the above processing will be described with reference to FIG.

In the figure, blocks which operate in the same manner as in the first embodiment are designated by the same reference numerals. In the figure, 40 is MP
Int among the image data encoded by the EG method
Detecting a frame image that is ra-Picture I
ntra detector.

First, the bit stream 38 is 40
Intra detector. Then 30 In
Intra-Pic 31 from tra-Picture
Up to 14 frames before the true,
The input bit stream is output to the line 41 as it is and stored in a predetermined file. 31 Intra-P
If the code of the image is detected, Intra of 31
-Frames after the Picture are output to the line 42 for the editing processing. The data of the bit stream output to the line 42 is the MPEG decoder 20, JP
Through the EG encoder 21, each frame is encoded and output to 22 memories or files by the JPEG method.
Intra detector 40 has 33 Intra-Pict
The signal is output on the line 42 until the sign of ure is detected. After detecting the code of Intra-Picture of 33, the output returns to the line 41 again, and the subsequent bit stream is output to a file different from the previous one.

From the above, 35 and 37 are filed without being edited.

Next, a process in which the user edits 20 to 40 frames will be described.

In the memory or file, each frame from 15 frames to 44 frames is stored as code data encoded by the JPEG system. The JPEG encoded data of 20 to 40 frames is read from the memory or the file 22 and decoded by the 24 JPEG decoder to create image data.

Then, 25 editors edit the 20 to 40 frames, and 21 JPEs are edited.
It is JPEG encoded by the G encoder and stored in 22 memories or files. When editing is completed, JPEG
The encoded data is read from 22 memory or file, decoded into image data by 24 JPEG decoder, MPEG encoded by 29 MPEG encoder, and output to a file or the like. This output result is filed as encoded data indicated by 36 in FIG.

Finally, the encoded data of 35, 36 and 37 is converted into a bit stream as one encoded data by a CPU (not shown) or the like, so that only the necessary frames desired by the user can be edited.

In the second embodiment, the JPE after moving image editing is used.
The frame edited in the G method is re-encoded in the MPEG method, but the present invention is not limited to this, and the edited image data is stored in the memory or the file 22 without being JPEG encoded. In the 24 JPEG decoder part, only frames that have not been edited, that is, 15 to 19 frames and 41 to 44 frames that are JPEG coded in the present embodiment, are decoded, and the edited uncoded frames are decoded. May pass the JPEG decoder 24 and directly output to the MPEG encoder.

With the above configuration, when a moving image is edited for a predetermined frame, the amount of image data to be decoded can be reduced, and as a result, the memory capacity for storing the decoded image data can be suppressed. Is possible. Also, the time required for decoding can be suppressed, and high-speed moving image editing can be performed.

(Third Embodiment) In the second embodiment,
Although the case where the JPEG method is used as the intra-frame encoding method has been described, the intra-picture in the MPEG chip may be used as shown in FIG. It should be noted that, in the figure, the same reference numerals are attached to the same components as those in the first and second embodiments.

The third embodiment differs from FIG. 4 which is a block diagram of the second embodiment in that 21 JPEG encoders are 50 MPEG encoders and 24 JPEG decoders are 51 MPEG encoders. This is a point changed to a decoder.

The detailed operation is the same as that of the second embodiment. The difference is that the portion stored in the memory or file 22 is MPEG Intra-Picture code data. Is omitted.

The input moving picture coding method used in the third embodiment is the MPEG method, but the present invention is not limited to this, and the H261 method may be used, and another moving picture coding method may be used. It is clear that it is acceptable.

The internal encoding system is JPEG system, M
Although it has been described by the intra-picture of PEG, the present invention is not limited to this, and any method may be used as long as it is an intraframe coding method.

Further, although it has been described that the image in the frame is changed as the moving image editing, the present invention is not limited to this, and the editing work in the time axis direction such as changing the number of frames, cutting the frame, inserting the frame, etc. You may go.

It can be easily inferred that the moving image coded data may be communicated in real time from an external communication means.

When editing the image data stored in 22 memories or files, 1 is displayed on a monitor (not shown).
Decoding and displaying an image with only low-frequency components from the image data for a frame to determine an edited image using a low-resolution image, and then displaying all one frame for the actual editing process is fast. Edit processing is possible.

[0041]

As described above, according to the present invention,
Up to now, by re-encoding the moving image data encoded by the moving image encoding method using inter-frame correlation by the intra-frame encoding method, editing the moving image, and encoding again by the moving image encoding method, As well as being able to edit moving image data of encoded data that could not be directly edited as moving images,
It is possible to significantly reduce the amount of image memory required during editing work.

Furthermore, since the amount of moving image data to be decoded when editing a predetermined frame can be reduced,
It is possible to reduce the memory capacity and speed up the processing.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic configuration of a system of the present invention.

FIG. 2 is a block diagram of a main part of the first embodiment.

FIG. 3 is an explanatory diagram of a second embodiment.

FIG. 4 is a block diagram of main parts of a second embodiment.

FIG. 5 is a block diagram of an essential part of a third embodiment.

[Explanation of symbols]

 1 System Bus 2 Code Converter I 3 Video Editor 4 Code Converter II

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI technical display location G06F 15/66 330 A

Claims (10)

[Claims] 1. Decoding means for decoding encoded moving picture data, storage means for intra-frame encoding and storing the decoded moving picture data, and image for intra-frame encoding stored in the storage means. And a coding means for decoding the edited frame image by a moving picture coding system. 2. The moving image editing apparatus according to claim 1, wherein the encoded moving image data is transmitted by communication from an external device. 3. The moving image editing apparatus according to claim 1, wherein the arbitrary editing is editing within a frame or editing in a time axis direction between frames. 4. The moving image editing apparatus according to claim 1, further comprising a display unit, wherein the decoding unit decodes a part of the moving image data in the encoded moving image data, A moving image editing apparatus characterized by performing editing by the editing means by displaying on a display means. 5. Int of encoded moving image data
Intra frame detection means for detecting ra frames, decoding means for decoding moving image data of a predetermined number of frames after the frame detected by the intra frame detection means, and moving image decoded by the decoding means Storage means for storing data in frame units,
It is characterized by further comprising: an editing unit for arbitrarily editing the frame-based image stored in the storage unit; and a coding unit for coding the edited frame image by a moving image coding system. Video editing device. 6. The moving image editing apparatus according to claim 5, further comprising an intra-frame encoding means, wherein the storing means frames the decoded moving image data by the intra-frame encoding means. A moving image editing apparatus characterized by storing after inner coding. 7. The moving image editing apparatus according to claim 5, wherein the encoded moving image data is transmitted from an external device by communication. 8. The moving image editing apparatus according to claim 5, wherein the arbitrary editing is editing within a frame or editing in a time axis direction between frames. 9. The moving image editing apparatus according to claim 5, wherein the decoding means performs decoding from an Intra frame immediately before a frame to be edited by the editing means. 10. The decoding means decodes a part of the moving image data in the coded moving image data and displays it on the display means to perform editing by the editing means. Item 4. The moving image editing apparatus according to item 4.