JP3094358B2 - Compressed video data editing device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the field of editing compressed moving pictures, and more particularly to a compressed moving picture data editing apparatus having a structure capable of editing compressed moving picture data from an arbitrary image position.

[0002]

2. Description of the Related Art There are various means for transmitting information, such as voice, video and text. However, video, audio, and the like have a larger amount of information than text, and it has been difficult to store them in storage media or transmit them on a transmission path as they are. In particular, video has a remarkably large amount of information.
In the case of using the color representation of bits, 250 Kbytes of data are required. Then, for example, when drawing a video of 30 frames per second, a 7.5-Mbyte information amount is actually required to reproduce a 1-second moving image.

[0003] In recent years, various compression techniques have been devised and put to practical use in order to overcome such problems with the development of techniques. For example, JPEG (Joint Picture Encoding ex
pertGroup) or MPEG (Moving Pictures Encoding expe
rt Group) examines and standardizes the encoding algorithms for still images and moving images. In the case of a still image, the amount of information is compressed using the redundancy in the spatial axis direction, and in the case of a moving image, the compression rate is increased by using the redundancy in the time axis direction. To explain in more detail, in general, in a continuous moving image, a certain image and an image before and after the image have a strong correlation, and the compression can be efficiently performed by using the correlation in the time direction. In other words, the difference between the interpolated image created from the front and back or the front and back temporally and the image to be compressed is obtained, and only the difference value is compressed (encoded) to reduce the information amount of the compressed moving image data. A considerable amount of compression becomes possible.

[0004] However, when the above-described compression method is used, there is a problem that the data after compression cannot be edited, or can be edited only for data that satisfies specific restrictions.

[0005] The compressed moving image data editing apparatus under the above-mentioned specific restrictions includes an image group (Group Of Picture, hereinafter referred to as GO).
P). This is for editing from several to several tens of images as one GOP and using this GOP as a minimum unit.

Hereinafter, a conventional procedure for editing compressed moving image data for a GOP will be described with reference to the drawings.

FIG. 9 is a block diagram of a conventional compressed moving picture data editing apparatus, wherein 1 is input means for converting input information 101 into image information 102, 2 is data analysis means for analyzing image information 102, and 3 is each means. Control means for sending control information 120 to
Reference numeral 4 denotes an image information storage unit for storing specific image information 102. Reference numeral 5 denotes an edited image information 103 by editing the image information 102.
The editing means 6 generates the output information 104 from the edited image information 103.

[0008] Input means 1 of the compressed moving picture data editing apparatus
Is a block for converting the input information 101 into image information 102. According to the control information 120 from the control means 3, the image information 102 is extracted from the input information 101 in which the sound and the image information 102 are multiplexed. , Etc., to convert it into image information 102. The input information 101 is converted into image information 102 by the input unit 1 and sent to the data analysis unit 2.

The data analysis means 2 is a block for analyzing the image information 102. According to the control information 120 from the control means 3, the result of analysis of the image information 102 is sent to the control means 3 as analysis information 121 such as an address. Alternatively, the image information 102 to be edited is sent to the image information storage unit 4.

The control means 3 is a block for sending control information 120 to each means, and controls each means. Control information 12
0 instructs the data analysis means 2 to send or stop the image information 102 to the editing means 5,
Based on the analysis information 121 from the data analysis means 2, the image information 102 is stored in the image information storage means 4, and the control information 120 is sent to the editing means 5 and the output means 6.

The image information storage means 4 stores the specific image information 102 based on the control information 120, or stores the stored image information 102
Is transmitted to the editing means 5. The control information 120 from the control means 3 temporarily stores the information from the data analysis means 2 and delivers the stored image information 102 to the editing means 5.

The editing means 5 is a block for actually editing the image information 102. The editing means 5 sends the image information 102 from the image information storage means 4 transmitted by the control information 120 from the control means 3.
And the image information 102 from the data analysis means 2, the GOP
Editing such as deletion, insertion, and replacement in units is executed to obtain edited image information 103.

The output means 6 receives control information 12 from the control means 3.
This block converts the edited image information 103 into output information 104 according to 0. The output information 104 generated here is prepared by multiplexing the edited image information 103 in accordance with the control information 120 or by adding change information to a required format.

FIGS. 10 and 11 are diagrams showing the structure of compressed moving image data.
Particularly, FIG. 10 shows an example of editing GOP deletion and replacement.
11A and 11A show image information, and FIGS. 10B and 11B show edited image information.

For example, when an nGOP is deleted in FIG. 10, the control means 3 sends the control information 1 so that the image information 102 up to the end of the (n-1) GOP is sent to the editing means 5 as it is.
20 to the data analysis means 2 and when nGOP is detected,
The control information 120 is sent to the data analyzing means 2 so that the image information 102 is not sent to the editing means 5.

Next, when the (n + 1) GOP is detected by the analysis information 121, the control means 3 sends the control information 120 to the data analysis means 2 so as to restart the transmission of the image information 102. As a result, the edited image information 103 from the editing means 5 is edited into data from which the nGOP has been deleted as shown in FIG.

In FIG. 11, (n-1) GOP and (n +)
1) When replacing GOPs, if the control means 3 detects a (n-1) GOP to be replaced and edited, control is performed to store the image information 102 of (n-1) GOPs and nGOPs thereafter. The image information storage unit 4 is instructed by the information 120, and the editing unit 5 stops sending the image information 102.
Next, when the (n + 1) GOP is detected, the editing means 5 restarts the transmission of the image information 102 until the (n + 1) GOP. (n +
2) When a GOP is detected, the data analysis means 2 stops sending the image information 102, and the image information 102 of the (n-1) GOP and nGOP stored in the image information storage means 4 is converted to nG.
The control information 120 instructs the image information storage means 4 to transmit the OP and (n-1) GOP to the editing means 5 in this order. In the editing means 5, after (n + 1) GOP, nGOP, (n-1) GOP
The OP is combined to continue to the edited image information 103. Finally, it operates so that the data analysis means 2 restarts the transmission of the image information 102.

[0018]

However, a compressed moving picture data editing apparatus having such a configuration is, for example, an MPEG moving picture editing apparatus.
In the case of compressed moving image data using a compression method such as forward reference or backward reference as in the standard, certain types of images cannot be edited because they require reference to nearby image information, or the minimum edit unit is There is a problem that editing can be performed only under specific restrictions such as a specific type of GOP.

For example, in the configuration diagram of the GOP shown in FIG. 12, I is a compressed image that has been compressed in an image, P is a compressed image using forward reference, and B is a compressed image using preceding and following image references. A GOP that can be edited by the conventional compressed moving image data editing device is, as shown in FIG.
It has to be a so-called closed GOP (hereinafter referred to as a closed GOP) in which forward reference or backward reference is used only within the OP. If Figure 12
In a so-called open GOP (hereinafter, referred to as an open GOP) in which a reference spans between GOPs as shown in (b), the 0th, 1st, and 2nd images of the (n + 1) GOP are n
If the (n + 1) GOP is moved to a position other than immediately after the nGOP by editing because the eighth image of the GOP is referenced, decoding of these images becomes impossible. For this reason, the conventional apparatus cannot edit an open GOP.

Further, in the case of editing a plurality of materials even in a closed GOP, in a configuration diagram showing an example of insertion and editing of compressed moving image data shown in FIG. When the XGOP of the image information B is inserted between the nGOP of the information A and the (n + 1) GOP, the conventional apparatus results in edited image information as shown in FIG.
When the data compression conditions are different between P and XGOP, there is a problem that the XGOP cannot be decoded by a decoder such as MPEG that refers to the compression conditions in the data when decoding. Therefore, it is necessary to add compression information to the data as shown in FIG. However, in the conventional compressed moving image data editing apparatus, there is no mechanism for storing and adding the compressed information.

In the case of compressed data having a fixed bit rate and a closed GOP, if the compressed information is added after editing as shown in FIG. There was also a problem that the rate could not be secured.

Similarly, when the constraint parameter flag of the MPEG standard is set, the buffer capacity required for the decoder is limited, and it is necessary to manage the buffer capacity. There was a problem that overflow and underflow occurred.

As described above, in the case of a material that is known in advance to be edited by the conventional method, a closed GOP that facilitates editing is used, the buffer management is made uniform, and a GOP unit is used. Had to be edited. That is, there is an inherent problem that editing from an arbitrary position cannot be performed.

Further, in order to edit a plurality of compressed moving image data in a mixed manner, it is necessary to make the virtual buffer capacity, data bit rate, etc. the same due to the above-mentioned restrictions. There was also a problem that it was not possible to edit. For this reason, there has been a demand for an editing apparatus that can freely edit a plurality of materials at an arbitrary image position, as in conventional film editing and video editing, even in compressed moving image data.

The present invention solves the above-mentioned problem of the prior art, in which a plurality of sources can be freely edited from an arbitrary image position as in the editing of a current video or film regardless of the compression condition of the compressed moving image data. It is an object of the present invention to provide a compressed moving image data editing device that can perform the above.

[0026]

To achieve this object, the present invention provides an input means for converting input information into image information, a data analysis means for analyzing image information to generate analysis information, Image information storage means for storing the image information from the analysis means, decompression processing means for decompressing the image information and converting it to decompressed image information, and decompressing the decompressed image information or editing by performing decompression image information or image information editing processing Editing means for generating image information and sending editing information; compression processing means for performing compression processing on the edited and expanded image information from the editing means to convert the edited image information into image information; and output means for converting the edited image information into output information. Based on analysis information and editing information
Independent images that are not referenced forward or backward
By converting the image information, that controls each unit to perform the editing
And having a control means for sending the control information.

Also, input means for converting input information into image information, data analyzing means for analyzing image information to generate analysis information and compression information, and image information storage means for storing image information from the data analysis means When the compressed information storage means for storing the compressed information from the data analysis means, compression information compression information and compression information to the image information edit processing to from the storage means
Editing means for generating edited image information to which editing information is added , transmitting the editing information, outputting means for converting the edited image information into output information, and transmitting control information for controlling each means by the analysis information and the editing information. And control means.

An input unit for converting the input information into image information; a data analyzing unit for analyzing the image information to generate analysis information and buffer information; and an information storage unit for storing the image information from the data analyzing unit. Buffer information storage means for storing buffer information from the data analysis means, decompression processing means for decompressing image information and converting it to decompressed image information, and buffer information and decompression image information or image information from the buffer information storage means. An editing unit that generates edited expanded image information or edited image information by performing an editing process, and performs a compression process on the edited expanded image information from the editing unit based on the buffer information from the buffer information storage unit; Compression processing means for converting to image information; output means for converting edited image information to output information; And having a control means for sending the control information to control.

An input unit for converting the input information into image information; a data analysis unit for analyzing the image information to generate analysis information and bit rate information; and an image information storage for storing the image information from the data analysis unit. Means, bit rate information storage means for storing bit rate information from data analysis means, decompression processing means for decompressing image information and converting it to decompressed image information, and bit rate information and decompression from bit rate information storage means Editing means for generating edited and decompressed image information or edited image information by performing image information or image information editing processing, and sending the editing information; and editing from the editing means based on the bit rate information from the bit rate information storage means. Compression processing means for performing compression processing on the decompressed image information and converting it to image information; output means for converting edited image information into output information; And having a control means for transmitting control information for controlling each unit by the analysis information and the editing information.

An input means for converting the input information into image information, an image information is analyzed to analyze information and buffer information,
Data analysis means for generating bit rate information, image information storage means for storing image information from the data analysis means, buffer information storage means for storing buffer information from the data analysis means, and bit rate from the data analysis means Bit rate information storage means for storing information; decompression processing means for decompressing image information and converting it to decompressed image information;
Editing means for editing the buffer information, bit rate information and the decompressed image information or the image information to generate the decompressed image information or the edited image information, and transmitting the editing information; and editing based on the buffer information and the bit rate information. Compression processing means for performing compression processing on the edited and decompressed image information from the means and converting the image information into image information; output means for converting the edited image information into output information; and control information for controlling each means with analysis information and editing information Is provided.

Input means for converting the input information into image information; data analyzing means for analyzing the image information to generate analysis information and compression information, buffer information and bit rate information; and image information from the data analyzing means. Image information storage means for storing the compressed information from the data analysis means, buffer information storage means for storing the buffer information from the data analysis means, and a bit rate from the data analysis means. Bit rate information storage means for storing information, decompression processing means for decompressing image information and converting it to decompressed image information, and performing compression information, buffer information, bit rate information and decompressed image information or image information editing processing Editing means for generating edited expanded image information or edited image information and sending out the editing information; buffer information and bit rate information; Compression processing means for performing a compression process on the edited and decompressed image information from the editing means to convert the image information into image information, output means for converting the edited image information into output information, and controlling each means by analysis information and editing information And a control means for transmitting control information for the control.

[0032]

According to the above arrangement, the image information to be edited is converted into independent image information which is not referred to forward and backward by the decompression processing means, and is compressed by the compression processing means after the editing is completed.

Further, by storing the compressed information in the compressed information storage means and adding the information again at the time of editing, a plurality of compressed moving image data having different compressed information can be edited.

Further, by storing the buffer information in the buffer information storage means and compressing the edited and expanded image information after the editing so as to keep the limit of the buffer capacity,
Editing a compressed video with limited buffer capacity does not cause buffer overflow or underflow.

The bit rate information is stored in the bit rate information storage means, and the compression of the edited and expanded image information after editing is controlled so as to maintain the bit rate, whereby the image information of the fixed bit rate can be matched. it can.

The buffer information and the bit rate information are stored in each storage means, and the compression of the edited and expanded image information after the editing is controlled so as to keep the restrictions on the buffer capacity and the bit rate. The rate image information is matched so that the buffer does not overflow or underflow.

The image information to be edited is converted by the decompression processing means into independent image information that is not referred to forward and backward, and the compression information, buffer information and bit rate information are also stored in each storage means. By compressing the edited and expanded image information so as to protect such information during the compression processing, a plurality of compressed moving image data can be edited from an arbitrary position.

[0038]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram of a compressed moving picture data editing apparatus according to a first embodiment of the present invention. FIG.
Wherein 1 is input means for converting input information 101 into image information 102, 2 is data analysis means for analyzing image information 102,
3 is a control means for sending control information 120 to each means, 4 is an image information storage means for storing specific image information 102, and 5 is an editing means for editing the image information 102 to generate edited image information 103 Means 6, output means 104 for generating output information 104 from the edited image information 103, decompression processing means 7 for once decompressing the image information 102 and converting it to decompressed image information 105, and 8 for compressing the decompressed image information 105 This is compression processing means for converting the information into information 102.

FIG. 2 shows a time code 00: 0 of the image information 102 of the compressed moving image data encoded according to the MPEG standard.
FIG. 7 is a conversion diagram showing a transition of information, taking deletion editing from 1:24:05 to 00: 01: 24: 13 as an example. The image information 102 (a) input to the data analysis means 2 and the decompression processing means 7 Input compressed image information 102 (b), decompressed image information 105 (c) decompressed and output by decompression processing means 7, decompressed image information 105 (d) deleted and edited by editing means 5, editing means 5, the edited and decompressed image information 106 (e) sent to the compression processing means 8, the image information 102 (f) output by being compressed (encoded) by the compression processing means 8, and the preceding and following image information 102 by the editing means 5. This shows the edited image information 103 (g) output in combination with the edited image information 103 (g).

In FIG. 2, I is a compressed image compressed in an image, P is a compressed image using only forward reference, B is a compressed image using preceding and following image references, and SIF is a preceding and following video such as SIF format. , A solid line image indicates an expanded image, a broken line image indicates a compressed image, and an image surrounded by a broken line indicates that the image is included in one GOP.

In the compressed moving picture data editing apparatus configured as described above, the time codes 00: 01: 24: 05 to 00: 01: 24: 13 of the compressed moving picture data encoded according to the MPEG standard shown in FIG. The operation will be described below as an example of the transition of information for deleting and editing up to.

The input means 1 is a block for converting the input information 101 into image information 102. Control information 12 from control means 3
According to 0, audio and video information are multiplexed, for example, MP
MPEG system decoding is performed to delete additional information such as a system layer and an audio layer from the input information 101 obtained by encoding the EG standard or JPEG and μLow by an implicit synchronization method, or to delete an MPEG video layer or a JPEGMovie.
, And is converted into image information 102. The converted image information 102 is sent to the data analysis means 2.

The data analysis means 2 is a block for analyzing the image information 102. The time code value 00: 0 according to the control information 120 such as an address request command from the control means 3
1:24:00 is sent back to the control means 3 as the analysis information 121, and the image information 102 is sent to the image information storage means 4 or the decompression processing means 7.

In the example shown in FIG. 2, the time code 00: 01: 2
From 4:05 to 00: 01: 24: 13, according to the control information 120 such as an image deletion request command, for example, the image information 102 which is an MPEG video layer is analyzed to delete the designated portion as shown in FIG. Required (n-1) GOP, nGOP, (n + 1) GOP
As image information 102 to the decompression processing means 7.

The control means 3 is a block for sending control information 120 to each means, and controls each means. Input means 1
For example, an instruction to temporarily stop or re-establish the conversion of the input information 101 to the image information 102, and send or stop the image information 102 to the editing means 5 and the decompression processing means 7 for the data analysis means 2, To the image information storage means 4, for example, to store the image information 102, or to output the stored image information 102 to the editing means 5, and to the decompression processing means 7 and the compression processing means 8, for example, Instructions to expand (decode) and compress (encode) the sent information,
For example, a command for instructing the editing unit 5 to send or execute editing information 122 and an output unit 6 for converting the edited image information 103 into output information 104 at the instructed bit rate. There is a command as described above, such as a command for sending a message.

The decompression processing means 7 is a block for converting the image information 102 into decompressed image information 105 in accordance with control information 120 such as a designated-part decompression command from the control means 3. The image information 102 input here is a compressed moving image sequence compressed (encoded) according to the MPEG standard to be edited. In the example shown in FIG. 2, (n−1) GOP, nGOP, and (n + 1) GOP are sent from the data analysis unit 2. Of the images in this GOP, only the images whose reference information is
For example, the image is expanded (decoded) into an independent image sequence such as the SIF format in which the preceding and following images are not referred to. Fig. 2 (b)
Since the time codes 05 to 13 shown in the above are deleted, the section in which the reference information is damaged by the deletion is defined as the section from the image 02 to which the image 05 is forward-referenced to the image 19 which is affected by the image 13. Up to the image. FIG. 2 (c) shows the section expanded in SIF format. Since the SIF in the decompressed image information 105 is independent image information 102, editing equivalent to frame unit editing in film editing or video editing can be performed.

The image information storage means 4 is a block for storing the image information 102 or the decompressed image information 105 according to the control information 120 and for sending the stored information to the editing means 5. In the example shown in FIG. 2, the decompressed image information 105 shown in FIG. 2C from the decompression processing means 7 is temporarily stored by the control information 120 such as a storage command from the control means 3, and the transfer command from the control means 3 is transmitted. The image information 102 stored according to the control information 120 such as is transmitted to the editing means 5.

The editing means 5 is a block for actually editing the image information 102. Depending on the control information 120 such as an edit command from the control means 3, the image information 102 sent from the image information storage means 4, the image information 102 from the data analysis means 2, or the compressed image information from the compression processing means 8 Ten
Edits such as deletion, insertion, and replacement are performed on the GOP 2 in units of GOPs, and the expanded image information 105 sent from the expansion processing means 7 is edited in units of frames to edit the edited image information 103 or the edited expanded image. Obtain information 106.

The decompressed image information 105 shown in FIG. 2 (c) is transferred to the time code 00: 01: 24: 05 to 00: 01: 24: 13 from the control means 3 as shown in FIG. 2 (d). The compressed processing means 8 edits and deletes the edited and expanded image information 106 shown in FIG.
Send to Further, the image information 102 which has been subjected to the compression processing as shown in FIG. 2 (f) from the compression processing means 8 is combined with the preceding and following image information 102 to obtain the edited image information 103 of FIG. 2 (g).

The compression processing means 8 has the expanded image information 105 and the edited expanded image information 10 according to the control information 120 from the control means 3.
6 is a block that compresses the image data 6 and converts it into image information 102. The edited decompressed image information 106 input here is an independent image sequence after being decompressed by the decompression processing means 7 and edited by the editing means 5, and compressed again to have the same compression method as the image information 102. The image information 102 is converted into image information 102 in a compression format according to the format.

The independent SIF image of the edited and expanded image information 106 shown in FIG. 2E is compressed again according to the MPEG standard.
(Encoding), and a new (n-1) GO is obtained as shown in FIG.
It is compressed (encoded) into P, nGOP, (n + 1) GOP and sent back to the editing means 5. Thereafter, the editing means 5 combines the compressed image information 102 with the preceding and following data to edit the edited image information 1.
Convert to 03.

The output means 6 receives the control information 12 from the control means 3.
This block converts the edited image information 103 into output information 104 according to 0. The output information 104 generated here is prepared by multiplexing the edited image information 103 in accordance with the control information 120, or by adding change information to prepare the MPEG system layer format.

Next, FIG. 3 is a block diagram showing a compressed moving picture data editing apparatus according to a second embodiment of the present invention. Here, the same reference numerals are given to the same functions and effects described in FIG. , And a detailed description thereof will be omitted. 3, reference numeral 1 denotes input means, 2 denotes data analysis means, 3 denotes control means, 4 denotes image information storage means, 5 denotes editing means, 6 denotes output means, and 9 denotes compression for storing compression information 123. Information storage means. FIG. 4 shows an example of the structure of the compressed moving image data.
The configuration (a) of the image information 102A, the configuration (b) of the image information 102B, and the image information 10
It is a figure which shows the structure (c) of the edit image information 103 which inserted the XGOP of image information 102B between nGOP of 2A and (n + 1) GOP.

The compression information storage means 9 stores the compression information 123 from the data analysis means 2 in accordance with the control information 120 from the control means 3.
Is a block for storing. Compression information stored here
Reference numeral 123 denotes a so-called sequence header such as a quantization matrix, image size information, or a picture rate in the case of compressed (encoded) data of the MPEG standard, for example, which is referred to when decompressing (decoding). . Therefore, in order to mix and edit materials that have been compressed (encoded) by different compression information 123, the compression information 123 must be added at the switching point.

The nGOP and (n +) of the image information 102A shown in FIG.
1) When inserting the XGOP of the image information 102B of FIG. 4B between GOPs, the data analysis means 2 analyzes the input image information 102A and the image information 102B according to the instruction of the control information 120 of the control means 3. Then, the compressed information 123 is detected and transferred to the compressed information storage means 9 as the compressed information 123A and the compressed information 123B and stored.

When the control unit 3 detects the (n + 1) GOP to be inserted and edited in the input image information 102A, the control unit 3 sends the image information 102A to the editing unit 5. The transmission of the image information 102A is stopped. Similarly, when an XGOP serving as an insertion GOP is detected in the input image information 102B, an instruction is sent to transmit the XGOP of the image information 102B to the image information storage unit 4.

The compressed information 123B of the image information 102B stored in the compressed information storage means 9 and the XGOP of the image information 102B stored in the image information storage means 4 are sent to the editing means 5 according to the control information 120 from the control means 3. Image information 1
Connect after 02G nGOP. At this time, the editing means 5
, The compression information 123B is added before the XGOP. After that, the compressed information 123A of the image information 102A is transmitted to the editing means 5, and the transmission of the image information 102A is restarted. Also at this time, in the editing means 5, the compressed information 123A is converted to the (n + 1) GO of the image information 102A.
It is added before P. As a result, edited image information 103 as shown in FIG. As described above, it is possible to edit a plurality of pieces of image information 102 having different compression information 123.

FIG. 5 is a block diagram showing a compressed moving picture data editing apparatus according to a third embodiment of the present invention. Here, the same reference numerals are given to the same functions and effects described in FIG. , And a detailed description thereof will be omitted. In FIG. 5, 1 is an input means, 2 is a data analysis means, 3 is a control means, 4 is an image information storage means, 5 is an editing means, 6 is an output means, 7 is an expansion processing means, 8 is a compression processing means, 10 Is buffer information 124 indicating the capacity of the image information 102 to occupy the buffer of the decoder.
Is buffer information storage means for storing the information.

The buffer information storage means 10 stores the buffer information 124 from the data analysis means 2 according to the control information 120 from the control means 3 and sends the stored buffer information 124 to the editing means 5 and the compression processing means 8. It is a block. The buffer information 124 input here is buffer occupancy information for controlling the buffer amount of the decoder analyzed by the data analysis means 2.

The buffer information 124 is stored in the compression processing unit 8
During the process of compressing the expanded image information 105 and the edited expanded image information 106 to convert the expanded image information 106 into the image information 102, when the edited image information 103 is edited, the buffer size is adjusted so that the buffer information 124 does not become inconsistent between GOPs. Is used to perform compression processing.

For example, when the compressed and expanded image information 106 shown in FIG. 2E is compressed (encoded) by the compression processing means 8, the last buffer occupancy of the (n-1) GOP is 32 Kbytes and (n +1) Assuming that the buffer occupancy immediately before the GOP is 40 Kbytes, when compressing (encoding) the nGOP,
By compressing (encoding) the last buffer occupation amount to 32 Kbytes and the occupation buffer amount of the last image to 40 Kbytes, the buffer control of (n-1) GOP and (n + 1) GOP is matched. It is possible to generate compressed (encoded) data.

FIG. 6 is a block diagram showing a compressed moving picture data editing apparatus according to a fourth embodiment of the present invention. In FIG. , And a detailed description thereof will be omitted. 6, reference numeral 1 denotes input means, 2 denotes data analysis means, 3 denotes control means, 4 denotes image information storage means, 5 denotes editing means, 6 denotes output means, 7 denotes expansion processing means, 8 denotes compression processing means, 11 Is a bit rate information storage means for storing bit rate information 125 of the image information 102.

The bit rate information storage means 11 is
This block stores the bit rate information 125 from the data analysis means 2 in accordance with the control information 120 from the CPU 5 and sends the stored bit rate information 125 to the editing means 5 and the compression processing means 8. Bit rate information 125 input here
Is local bit rate information for controlling the bit rate of the decoder analyzed by the data analysis means 2.
125.

In the process of compressing the decompressed image information 105 and the edited decompressed image information 106 by the compression processing means 8 and converting the same into the image information 102, the bit rate information 125 This is used to perform a compression process by controlling the bit rate amount so that bit rate mismatch does not occur.

For example, when the compressed / decompressed image information 106 shown in FIG. 2E is compressed (encoded) by the compression processing means 8, if the bit rate is 1152 Kbit / sec, the nGOP is compressed (encoded). ) Is compressed (encoded) to 1152 Kbits / sec. That is, since the number of images of the nGOP is 8, compression (encoding) is performed so that the total becomes 1152 × 8/30 bits, thereby generating compressed (encoded) data consistent with the preceding and following bit rate control. Becomes possible.

FIG. 7 is a block diagram showing a compressed moving picture data editing apparatus according to a fifth embodiment of the present invention.
The same reference numerals are given to those having the same operation and effect as described above, and detailed description thereof will be omitted. 7, reference numeral 1 denotes input means, 2 denotes data analysis means, 3 denotes control means, 4 denotes image information storage means, 5 denotes editing means, 6 denotes output means, 7 denotes expansion processing means, 8 denotes compression processing means, 9 Is compression information storage means for storing the compression information 123 from the data analysis means 2;
Reference numeral 0 denotes buffer information storage means for storing buffer information 124 of the image information 102, and reference numeral 11 denotes bit rate information storage means for storing bit rate information 125 of the image information 102.

FIG. 8 is a diagram showing an example in which the time codes 00: 01: 24: 05 to 00: 01: 24: 13 of the image information 102A of the compressed moving image data compressed (encoded) according to the MPEG standard are deleted. FIG. 10 is a conversion diagram showing a transition of information as an example of editing in which time codes 01: 15: 04: 28 to 01: 15: 05: 05 of 102B are inserted. Decompressed image information deleted by the editing means 5
105A (a) (the same information as in FIG. 2 (d)) and decompressed image information 10
5B (b), the edited expanded image information 106 (c) in which the editing means 5 inserts and edits the time code 01: 15: 04: 28 to 01: 15: 05: 05 of the expanded image information 105B into the expanded image information 105A. ),
The edited and expanded image information 106 shown in FIG. 8C is compressed (encoded) by the compression processing means 8 and output as image information 102 (d).
The image information 102 of FIG.
2 shows the edited image information 103 (e) that is output in combination with 2.

In FIG. 8, I is a compressed image that has been compressed within an image, P is a compressed image that uses only forward reference, B is a compressed image that uses preceding and following image references, and SIF is a preceding and following image such as the SIF format. , An image indicated by a solid line is an expanded image, an image indicated by a broken line is a compressed image, and an image enclosed by a broken line is included in one GOP.

According to the fifth embodiment constructed as described above, the editing means 5 transmits the decompressed image information 105A to the control means 3.
As shown in FIG. 8A, the time code of the decompressed image information 105B shown in FIG. 8B is edited by deleting the time code from 00: 01: 24: 05 to 00: 01: 24: 13. Code 01: 15: 04: 28
To 01: 15: 05: 05, inserted into the decompressed image information 105A, and sent to the compression processing means 8 as edited decompressed image information 106 shown in FIG. 8 from the compression processing means 8.
The image information 102 compressed as shown in (d) is combined with the preceding and following image information 102 to obtain edited image information 103 shown in FIG. 8 (e). At this time, the compression information 123 from the compression information storage
Is added.

The independent SIF image of the edited and expanded image information 106 shown in FIG. 8C is again compressed (encoded) according to the MPEG standard by the compression processing means 8, and as shown in FIG. New (n-2) GOP, (n-1) GOP, nGO
P, (n + 1) GOP and (n + 2) GOP are compressed (encoded) and sent back to the editing means 5. At this time, the buffer information 124 from the buffer information storage means 10 and the bit rate information 125 from the bit rate information storage means 11 are fed back, and compressed (encoded) in accordance with the feedback so that the compressed (encoded) ) Becomes possible.

Thereafter, the editing means 5 sends the compressed information 123
A or image information 102 obtained by compressing the compressed information 123B before and after
And converted into the edited image information 103 shown in FIG.

According to the present embodiment having such a configuration, a plurality of materials can be freely edited from an arbitrary image position, such as video or film editing of compressed moving image data, regardless of the data compression conditions. .

[0074]

As described above, according to the present invention,
The image information to be edited is converted by the decompression processing means into independent image information that is not referred to forward and backward, and is compressed by the compression processing means after the end of editing, so that the independent image information is edited from an arbitrary position. It is possible to edit freely from any position like video editing without being aware that the video is a compressed video.

Further, by storing the compressed information of the image information in the compressed information storage means and adding the information again at the time of editing, even a plurality of compressed moving image data having different compressed information can be mutually edited.

Further, the buffer information of the image information is stored in the buffer information storage means, and the edited and expanded image information after the editing is compressed so as to keep the limit of the buffer capacity. Editing of the compressed moving image can be performed from any position without causing overflow or underflow of the buffer.

The bit rate information of the image information is stored in the bit rate information storage means, and the compression of the edited decompressed image information after the editing is controlled so as to keep the bit rate. Information can be edited from any position.

The buffer information and the bit rate information of the image information are stored in each storage means, and the compression of the edited and expanded image information after the editing is controlled so as to keep the restrictions on the buffer capacity and the bit rate. The image information at a fixed bit rate can be edited from any position without causing overflow or underflow of the buffer.

The image information to be edited is converted by the decompression processing means into independent image information that is not referred to forward and backward, and the compression information, buffer information and bit rate information are also stored in each storage means, and the edited editing information is stored. By compressing the decompressed image information to protect it during the compression process,
A plurality of compressed moving image data can be edited from an arbitrary position.

The effect that a compressed moving image data editing apparatus capable of freely editing a plurality of materials from an arbitrary image position, such as video or film editing, regardless of the data compression condition can be realized. Play.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a compressed moving image data editing device according to a first embodiment of the present invention.

FIG. 2 is a conversion diagram illustrating a transition of information in an example of editing in which part of image information of compressed moving image data encoded according to the MPEG standard is deleted.

FIG. 3 is a block diagram illustrating a configuration of a compressed moving image data editing device according to a second embodiment of the present invention.

FIG. 4 is a configuration example of compressed moving image data, and is a configuration of image information A;
(a), configuration of image information B (b), nGOP of image information A
It is a figure which shows the structure (c) of the edit image information which inserted the XGOP of the image information B between (n + 1) GOPs.

FIG. 5 is a block diagram illustrating a configuration of a compressed moving image data editing device according to a third embodiment of the present invention.

FIG. 6 is a block diagram illustrating a configuration of a compressed moving image data editing device according to a fourth embodiment of the present invention.

FIG. 7 is a block diagram illustrating a configuration of a compressed moving image data editing device according to a fifth embodiment of the present invention.

FIG. 8 is a conversion diagram illustrating a transition of information in an example of editing in which a part of image information A of compressed moving image data encoded according to the MPEG standard is deleted and a part of image information B is inserted.

FIG. 9 is a block diagram showing a configuration of a conventional compressed moving image data editing device.

FIG. 10 is a configuration diagram of compressed moving image data showing a conventional deletion editing example.

FIG. 11 is a configuration diagram of compressed moving image data showing a conventional replacement editing example.

FIG. 12 shows a closed GOP only in a GOP when each image of the GOP uses forward reference or backward reference.
(a), It is a block diagram which shows the open GOP (b) which straddles between GOPs.

FIG. 13 shows an example of insertion and editing of compressed moving image data, in which the configuration (a) of image information A and B to be edited, the configuration (b) of edited image information in which only image information is inserted, and compression information is added to the image information. It is a figure showing composition (c) of edit image information.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input means, 2 ... Data analysis means, 3 ... Control means, 4 ... Image information storage means, 5 ... Editing means, 6 ...
Output means 7 expansion processing means 8 compression processing means
9: Compressed information storage means, 10: Buffer information storage means, 11: Bit rate information storage means, 101: Input information, 102: Image information, 103: Edited image information, 104: Output information, 105: Decompressed image information, 106 ... Edited and expanded image information, 120 ... Control information, 121 ... Analysis information, 122 ... Edit information, 123 ... Compression information, 124 ... Buffer information, 125
... bit rate information.

──────────────────────────────────────────────────続 き Continued on the front page (58) Field surveyed (Int. Cl. ⁷ , DB name) H04N 5/91-5/956 H04N 9/79-9/898 H04N ^7/ 24-7/68

Claims (9)

(57) [Claims] An input unit that converts input information into image information; a data analysis unit that analyzes the image information to generate analysis information; and an image information storage unit that stores the image information from the data analysis unit. Decompression processing means for decompressing the image information and converting it to decompressed image information, generating edited decompressed image information or edited image information by editing the decompressed image information or the image information, and transmitting the edited information Editing means for performing compression processing on the edited and decompressed image information from the editing means to convert the edited image information into the image information; output means for converting the edited image information into output information; Edit based on edit information
Independent image information that is not referenced forward or backward
By converting the broadcast, compressed video data editing apparatus characterized by a control means for sending the control to that control information of each unit to perform the edit. 2. An input means for converting input information into image information; a data analysis means for analyzing the image information to generate analysis information and compression information; and an image storing the image information from the data analysis means. Information storage means, compression information storage means for storing the compression information from the data analysis means, an edited image obtained by editing the compression information and the image information from the compression information storage means and adding the compression information Editing means for generating information and sending edit information; output means for converting the edited image information into output information; and control means for sending control information for controlling each means with the analysis information and the edit information. And a compressed moving image data editing device. 3. An input unit for converting input information into image information, a data analysis unit for analyzing the image information to generate analysis information and buffer information, and an image for storing the image information from the data analysis unit. Information storage means, buffer information storage means for storing the buffer information from the data analysis means, decompression processing means for decompressing the image information and converting it to decompressed image information, and the buffer from the buffer information storage means Editing means for editing information and the decompressed image information or the image information to generate edited decompressed image information or edited image information, and based on the buffer information from the buffer information storage means; Compression processing means for performing a compression process on the edited and expanded image information from the editing means and converting it to the image information; A compressed moving image data editing apparatus, comprising: output means for converting to output information; and control means for transmitting control information for controlling each means based on the analysis information and the editing information. 4. An input unit for converting input information into image information, a data analysis unit for analyzing the image information to generate analysis information and bit rate information, and an image for storing image information from the data analysis unit. Information storage means, bit rate information storage means for storing bit rate information from the data analysis means, decompression processing means for decompressing the image information and converting it to decompressed image information, Editing means for editing the bit rate information and the decompressed image information or the image information to generate edited decompressed image information or edited image information, and transmitting the editing information; and a bit rate from the bit rate information storage means. Compression processing means for performing a compression process on the edited and expanded image information from the editing means based on information and converting the compressed and expanded image information into the image information; A compressed moving image data editing apparatus comprising: output means for converting edited image information into output information; and control means for transmitting control information for controlling each means based on the analysis information and the editing information. 5. A compression apparatus according to claim 4, wherein said data analysis means analyzes the image information to generate buffer information, and has buffer information storage means for storing said buffer information from said data analysis means. Video data editing device. 6. A compression apparatus according to claim 3, wherein said data analysis means analyzes the image information to generate compression information, and further comprises compression information storage means for storing said compression information from said data analysis means. Video data editing device. 7. A compression apparatus according to claim 4, wherein said data analysis means analyzes the image information to generate compression information, and further comprises compression information storage means for storing said compression information from said data analysis means. Video data editing device. 8. The compression apparatus according to claim 5, wherein said data analysis means analyzes the image information to generate compression information, and further comprises compression information storage means for storing said compression information from said data analysis means. Video data editing device. 9. The compressed moving picture data editing apparatus according to claim 8, wherein the compressed moving picture data is compressed according to the MPEG standard.