JPH0870422A - Compressed dynamic image data editing device - Google Patents

Abstract

PURPOSE: To freely edit information from the arbitrary picture positions of plural materials such as video/film editing in spite of a compression condition in the editing of compressed dynamic image data. CONSTITUTION: An expansion processing means 7 expands inputted image information 102 into expanded image information 105 which can be edited from the arbitrary image position. An image information storage means 4 temporarily stores image information 102 or expanded image information 105, and transmits stored information to an editing means 5. Expanded image information 105 and edited/expanded image information 106 obtained by editing expanded image information 105 are compressed by a compression processing means 8. The editing means 5 edits image information 102 and image information 102 from the compression processing means 8 and outputs it as edited image information 103 to an output means 6. Respective means are controlled by control information 120 of a control means 3.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to the field of editing compressed moving picture data, and more particularly, to a compressed moving picture data editing apparatus capable of editing from any image position of compressed moving picture data.

[0002]

2. Description of the Related Art As means for transmitting information, there are various types such as voice, video and characters. However, video, audio, etc., have much more information than characters, and it was difficult to store them in storage media or transmit them on the transmission path as they were. Especially, the video has a remarkably large amount of information.
When using the bit color expression, 250 Kbytes of data are required. Then, for example, when drawing a video of 30 frames per second, an amount of information of 7.5 M bytes is actually required to reproduce a moving image of 1 second.

In recent years, various compression techniques have been devised and put into practical use in order to overcome such problems due to technological development. For example, JPEG (Joint Picture Encoding ex)
pert Group) and MPEG (Moving Pictures Encoding expe)
(rt Group) is studying and standardizing still image and video encoding algorithms. In the case of a still image, the amount of information is compressed by utilizing the redundancy in the spatial axis direction, and in the case of a moving image, the compression rate is increased by utilizing the redundancy in the time axis direction. Explaining in a little more detail, generally in a continuous moving image, a certain image and the images before and after it have a strong correlation, and it is possible to efficiently compress by using the correlation in the time direction. In other words, the information amount of compressed moving image data is obtained by taking the difference between the interpolated image created from the front and the back, or the front and the back and the image to be compressed, and compressing (encoding) only the difference value. It is possible to compress a considerable amount.

However, when the above-mentioned compression method is used, there is a problem that the data after compression cannot be edited or only the data that meets a specific constraint can be edited.

As a compressed moving picture data editing apparatus under the above-mentioned specific limitation, an image group (Group Of Picture, hereinafter, GO)
There is an editing device (referred to as P). This is for editing several to several tens of images as one GOP and using this GOP as the minimum unit for editing.

Hereinafter, a conventional procedure for editing compressed moving image data for GOP will be described with reference to the drawings.

FIG. 9 is a block diagram of a conventional compressed moving image data editing apparatus. 1 is input means for converting input information 101 into image information 102, 2 is data analysis means for analyzing image information 102, and 3 is each means. Control means for sending control information 120 to
Reference numeral 4 is an image information storage means for storing specific image information 102, and 5 is the edited image information 103 by editing the image information 102.
And 6 is an output unit for generating output information 104 from the edited image information 103.

Input means 1 of the compressed moving image data editing apparatus
Is a block for converting the input information 101 into the image information 102. According to the control information 120 from the control means 3, the image information 102 is extracted from the input information 101 in which the voice and the image information 102 are multiplexed, or the input information 101. Are converted into image information 102 by deleting various additional information from. The input information 101 that has been input is converted into image information 102 by the input means 1 and sent to the data analysis means 2.

The data analysis means 2 is a block for analyzing the image information 102. According to the control information 120 from the control means 3, the result of analysis of the image information 102 is sent to the control means 3 as analysis information 121 such as an address. Alternatively, the image information 102 to be edited is sent to the image information storage means 4.

The control means 3 is a block for sending the control information 120 to each means, and controls each means. Control information 12
By 0, the data analysis means 2 is instructed to send or stop the image information 102 to the editing means 5,
The image information 102 is stored in the image information storage means 4 based on the analysis information 121 from the data analysis means 2, or the control information 120 is sent to the editing means 5 and the output means 6.

The image information storage means 4 stores specific image information 102 according to the control information 120, or the stored image information 102.
Is sent to the editing means 5, and the information from the data analysis means 2 is temporarily stored by the control information 120 from the control means 3 and the stored image information 102 is delivered to the editing means 5.

The editing means 5 is a block for actually editing the image information 102, and the image information 102 from the image information storage means 4 sent by the control information 120 from the control means 3 is sent.
And the image information 102 from the data analysis means 2, the GOP
Editing such as deletion, insertion, and replacement in units is executed to obtain the edited image information 103.

The output means 6 is control information 12 from the control means 3.
This block converts the edited image information 103 into output information 104 according to 0. The output information 104 generated here is multiplexed with the edited image information 103 in accordance with the control information 120, or modified information is added to prepare the required format.

10 and 11 are block diagrams of compressed moving image data.
In particular, an example of editing GOP deletion and replacement is shown in FIG.
11 (a) and 11 (a) are image information, and FIGS. 10 (b) and 11 (b) are edited image information.

For example, when nGOP is deleted in FIG. 10, the control means 1 controls the control means 1 so that the image information 102 up to the end of the (n-1) GOP is sent to the editing means 5 as it is.
When 20 is sent to the data analysis means 2 and nGOP is detected,
The control information 120 is sent to the data analysis means 2 so that the image information 102 is not sent to the editing means 5.

Next, when (n + 1) GOP is detected from the analysis information 121, the control means 3 sends the control information 120 to the data analysis means 2 so as to restart the sending of the image information 102. As a result, the edited image information 103 from the editing means 5 is edited into data from which nGOP has been deleted as shown in FIG. 10 (b).

Further, in FIG. 11, (n-1) GOP and (n +)
1) When swapping GOPs, if the control means 3 detects an (n-1) GOP to be subject to swap editing, control is performed to store the image information 102 of (n-1) GOPs and nGOPs thereafter. The image information storage means 4 is instructed by the information 120 and the sending of the image information 102 to the editing means 5 is stopped.
Next, when the (n + 1) GOP is detected, the editing means 5 is restarted to send the image information 102 up to the (n + 1) GOP. (n +
2) When a GOP is detected, the data analysis unit 2 is stopped from sending the image information 102, and the image information 102 of (n-1) GOP and nGOP stored in the image information storage unit 4 is nG.
The image information storage means 4 is instructed by the control information 120 to send OP, (n-1) GOP in this order to the editing means 5. In the editing means 5, (n + 1) GOP is followed by nGOP and (n-1) G
The OP is combined and the edited image information 103 is continued. Finally, the data analysis unit 2 operates so as to restart the transmission of the image information 102.

[0018]

However, the compressed moving image data editing apparatus having such a configuration is based on, for example, MPEG.
As in the standard, in the case of compressed moving image data that uses a forward or backward referencing compression method, some images cannot be edited because the neighboring image information needs to be referenced, or the minimum editing unit is There is a problem that editing can be performed only under specific constraints such as being a specific type of GOP.

For example, in the configuration diagram of the GOP shown in FIG. 12, I is a compressed image compressed in the image, P is a compressed image using forward reference, and B is a compressed image using forward and backward image references. The GOP that can be edited by the conventional compressed moving image data editing apparatus is
It had to be a so-called closed GOP (hereinafter referred to as a closed GOP) configured to use forward reference or backward reference only in the OP. What if Figure 12
As shown in (b), in so-called open GOP (hereinafter referred to as open GOP) that is referred to across GOPs, the (n + 1) GOP's 0th, 1st, and 2nd images are n.
Since the (n + 1) GOP is moved to a position other than immediately after the nGOP because of editing the eighth image of the GOP, these images cannot be decoded. For this reason, the conventional device cannot edit the open GOP.

Further, even in the case of a closed GOP, when a plurality of materials are to be edited, in the configuration diagram showing an example of inserting and editing the compressed moving image data shown in FIG. When the XGOP of the image information B is inserted between the nGOP of the information A and the (n + 1) GOP, the conventional apparatus produces the edited image information as shown in FIG.
When the data compression conditions are different between P and XGOP, there is a problem that the decoder that refers to the compression condition in the data at the time of decoding, such as MPEG, cannot decode the XGOP. Therefore, it is necessary to add compression information to the data as shown in FIG. 13 (c). However, the conventional compressed moving image data editing apparatus does not have a mechanism for storing and adding compressed information.

In the case of closed GOP and compressed data having a fixed bit rate, if the compressed information is added after editing as shown in FIG. 13 (c), the bit rate increases by the amount corresponding to the image information. There was also a problem that the rate could not be secured.

Similarly, when the constraint parameter flag of the MPEG standard is set, the buffer capacity required for the decoder is finite, and it is necessary to manage the buffer capacity, and the buffer capacity between GOPs edited after editing is limited. There was a problem that overflow or underflow would occur.

As described above, in the case of a material that is known to be edited by the conventional method, a closed GOP that facilitates editing is used so that buffer management is uniform and GOP units are used. I needed to edit it. That is, there is an inherent problem that editing cannot be performed from any position.

In addition, in order to edit a plurality of compressed moving image data in a mixed manner, it is necessary to keep the virtual buffer capacity, the data bit rate, etc. the same due to the above-mentioned restrictions. There was also the problem that you couldn't edit. Therefore, even for compressed moving image data, there has been a long-felt demand for an editing device capable of freely editing a plurality of materials at arbitrary image positions, as in conventional film editing and video editing.

The present invention solves the above-mentioned problems of the prior art, and freely edits a plurality of sources from arbitrary image positions like current video and film editing regardless of the compression condition of compressed moving image data. It is an object of the present invention to provide a compressed moving image data editing device that enables the above.

[0026]

To achieve this object, the present invention provides an input means for converting input information into image information, a data analysis means for analyzing image information to generate analysis information, and data. Image information storage means for storing the image information from the analyzing means, decompression processing means for decompressing the image information and converting it into decompressed image information, and editing for decompressed image information or image information. Editing means for generating image information and transmitting the editing information, compression processing means for compressing the edited and expanded image information from the editing means to convert it into image information, and output means for converting the edited image information into output information. , And control means for transmitting control information for controlling each means by the analysis information and the editing information.

Input means for converting the input information into image information, data analysis means for analyzing the image information to generate analysis information and compression information, and image information storage means for storing the image information from the data analysis means. A compressed information storage means for storing the compressed information from the data analysis means; an edit means for editing the compressed information and the image information from the compressed information storage means to generate edited image information; and sending the edited information. It is characterized by having an output means for converting the edited image information into output information, and a control means for sending out control information for controlling each means by the analysis information and the edit information.

Also, input means for converting the input information into image information, data analysis means for analyzing the image information to generate analysis information and buffer information, and information storage means for storing the image information from the data analysis means. Buffer information storage means for storing buffer information from the data analysis means, decompression processing means for decompressing image information to convert it to decompressed image information, buffer information from the buffer information storage means and decompressed image information or image information. Edit processing is performed by performing edit processing to generate edit decompressed image information or edited image information, and sending edit information, and compression processing is performed on the edit decompressed image information from the editing means based on the buffer information from the buffer information storage means. A compression processing means for converting into image information, an output means for converting edited image information into output information, and each means according to analysis information and editing information And having a control means for sending the control information to control.

Further, input means for converting input information into image information, data analysis means for analyzing image information to generate analysis information and bit rate information, and image information storage for storing image information from the data analysis means. Means, bit rate information storage means for storing bit rate information from the data analysis means, decompression processing means for decompressing image information and converting it to decompressed image information, bit rate information and decompression from the bit rate information storage means. Editing information for editing image information or image information to generate edited decompressed image information or edited image information and sending the edited information, and editing from the editing means based on the bit rate information from the bit rate information storage means A compression processing means for performing compression processing on the decompressed image information and converting it into image information; and an output means for converting the edited image information into output information. And having a control means for transmitting control information for controlling each unit by the analysis information and the editing information.

Further, input means for converting input information into image information, analysis information for analyzing image information and buffer information,
Data analysis means for generating bit rate information, image information storage means for storing image information from the data analysis means, buffer information storage means for storing buffer information from the data analysis means, and bit rate from the data analysis means Bit rate information storage means for storing information, decompression processing means for decompressing image information and converting it to decompressed image information,
Editing means for editing the buffer information, bit rate information and decompressed image information or image information to generate edited decompressed image information or edited image information, and transmitting the editing information, and editing based on the buffer information and bit rate information Compression processing means for compressing the edited and expanded image information from the means and converting it into image information, output means for converting the edited image information into output information, and control information for controlling each means by analysis information and edit information It is characterized by having a control means for sending out.

Also, input means for converting input information into image information, data analysis means for analyzing image information to generate analysis information, compression information, buffer information, and bit rate information, and image information from the data analysis means. Image information storage means for storing the compressed data, compressed information storage means for storing the compressed information from the data analysis means, buffer information storage means for storing the buffer information from the data analysis means, and bit rate from the data analysis means. Bit rate information storage means for storing information, decompression processing means for decompressing image information to convert it to decompressed image information, and compression processing for the compressed information, buffer information, bit rate information and decompressed image information or image information Editing means for generating edited decompressed image information or edited image information and sending the edited information, buffer information, and bit rate information A compression processing means for compressing the edited and expanded image information from the editing means based on the above to convert it into image information, an output means for converting the edited image information into output information, and each means controlled by analysis information and edit information. It is configured to have a control means for transmitting control information for the purpose.

[0032]

According to the above construction, the image information to be edited is converted by the decompression processing means into independent image information that is not referred to forward or backward, and is compressed by the compression processing means after the editing is completed.

Further, by storing the compressed information in the compressed information storage means and adding the information again at the time of editing, a plurality of compressed moving image data having different compressed information can be edited.

Further, the buffer information is stored in the buffer information storage means, and the edited and expanded image information after editing is compressed so as to keep the buffer capacity limit.
Editing a compressed video with a limited buffer capacity does not overflow or underflow the buffer.

Further, the bit rate information is stored in the bit rate information storage means, and the compression of the edited and expanded image information after editing is controlled so as to protect the bit rate, so that the image information of the fixed bit rate is matched. it can.

Further, the buffer information and the bit rate information are stored in each storage means, and the compression of the edited and expanded image information after the editing is controlled so as to keep the buffer capacity and the bit rate limit. The rate image information is aligned and does not overflow or underflow the buffer.

Further, the image information to be edited is converted into independent image information which is not referred to forward or backward by the decompression processing means, and the compression information, the buffer information and the bit rate information are also stored in each storage means. By compressing the edited decompressed image information so as to protect such information during compression processing, it is possible to edit a plurality of compressed moving image data from arbitrary positions.

[0038]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a block diagram of a compressed moving picture data editing apparatus according to the first embodiment of the present invention. FIG.
In FIG. 1, 1 is an input means for converting the input information 101 into image information 102, 2 is a data analysis means for analyzing the image information 102,
Reference numeral 3 is control means for sending control information 120 to each means, 4 is image information storage means for storing specific image information 102, and 5 is edit for editing the image information 102 to generate edited image information 103. Means, 6 is output means for generating output information 104 from the edited image information 103, 7 is decompression processing means for decompressing the image information 102 and converting it into decompressed image information 105, and 8 is an image obtained by compressing the decompressed image information 105. It is a compression processing means for converting into information 102.

Further, FIG. 2 shows the time code 00: 0 of the image information 102 of the compressed moving image data encoded by the MPEG standard.
A conversion diagram showing a transition of information, which is an example of deletion and editing from 1:24:05 to 00: 01: 24: 13. Image information 102 (a) input to the data analysis means 2 and decompression processing means 7. Input compressed image information 102 (b), expanded image information 105 (c) expanded and output by the expansion processing unit 7, expanded image information 105 (d) deleted and edited by the editing unit 5, editing unit 5, the edited and expanded image information 106 (e) sent from the compression processing unit 8 to the compression processing unit 8, the image information 102 (f) output by being compressed (encoded) by the compression processing unit 8, and the preceding and following image information 102 by the editing unit 5. The edited image information 103 (g) is output after being combined with.

In FIG. 2, I is a compressed image compressed in the image, P is a compressed image using only forward reference, B is a compressed image using forward and backward image references, and SIF is a front and back image such as SIF format. Independent images that are not referred to, a solid line image is a decompressed image, a broken line image is a compressed image, and an image surrounded by a broken line is included in one GOP.

In the compressed moving picture data editing apparatus configured as described above, the time codes 00: 01: 24: 05 to 00: 01: 24: 13 of the compressed moving picture data encoded by the MPEG standard shown in FIG. The operation will be described below by taking the transition of information to be deleted and edited as an example.

The input means 1 is a block for converting the input information 101 into the image information 102. Control information 12 from the control means 3
According to 0, audio and video information are multiplexed, for example, MP
From the input information 101 encoded by the EG standard or JPEG and μLow by the implicit synchronization method, MPEG system decoding is performed to delete additional information such as the system layer and audio layer, and the MPEG video layer and JPEGMovie.
Such video information is extracted and converted into image information 102. The converted image information 102 is sent to the data analysis means 2.

The data analysis means 2 is a block for analyzing the image information 102. According to the control information 120 such as the address request command from the control means 3, the time code value 00: 0
1:24:00 is sent back to the control means 3 as the analysis information 121, or the image information 102 is sent to the image information storage means 4 or the expansion processing means 7.

In the example shown in FIG. 2, the time code is 00: 01: 2.
From 4:05 to 00: 01: 24: 13, in accordance with the control information 120 such as the image deletion request command, the image information 102, which is, for example, the MPEG video layer, is analyzed, and the specified portion as shown in FIG. 2B is deleted. Required (n-1) GOP, nGOP, (n + 1) GOP
Is sent to the expansion processing means 7 as image information 102.

The control means 3 is a block for sending the control information 120 to each means, and controls each means. Input means 1
On the other hand, for example, a command for temporarily stopping or reuniting the conversion of the input information 101 into the image information 102, or sending or stopping the image information 102 to the editing means 5 or the decompression processing means 7 for the data analysis means 2, for example. Command for storing the image information 102 in the image information storage means 4 or outputting the stored image information 102 to the editing means 5, for the expansion processing means 7 and the compression processing means 8, for example An instruction to decompress (decode) or compress (encode) the sent information,
For example, an instruction for sending the editing information 122 to the editing means 5 or an instruction for executing the editing is issued, and for the output means 6, for example, the edited image information 103 is converted into output information 104, and the output information 104 is output at the instructed bit rate. There is an instruction as described above, such as an instruction for sending

The decompression processing means 7 is a block for converting the image information 102 into decompressed image information 105 in accordance with control information 120 such as a designated location decompression command from the control means 3. The image information 102 input here is a compressed moving image sequence compressed (encoded) according to the MPEG standard to be edited. In the example shown in FIG. 2, (n-1) GOP, nGOP, and (n + 1) GOP are sent from the data analysis means 2. Of the GOP images, only the images whose reference information is lost due to deletion editing are
For example, it decompresses (decodes) an independent image sequence that does not refer to the preceding and following images such as the SIF format. Figure 2 (b)
Since the time code 05 to 13 shown in Figure 5 will be deleted, the section in which the reference information is lost due to deletion is that the image of 05 is forward-referenced from the image of 02 to the image of 13 Up to the image. FIG. 2 (c) shows that this section is decompressed into the SIF format. Since the SIF in the decompressed image information 105 is the independent image information 102, it is possible to perform editing equivalent to frame-by-frame editing in film editing or video editing.

The image information storage means 4 is a block for storing the image information 102 or the expanded image information 105 according to the control information 120 and sending the stored information to the editing means 5. In the example shown in FIG. 2, the decompressed image information 105 shown in FIG. 2C from the decompression processing unit 7 is temporarily stored by the control information 120 such as a storage command from the control unit 3, and a transfer command from the control unit 3 is issued. The image information 102 stored by the control information 120 such as is delivered to the editing means 5.

The editing means 5 is a block for actually editing the image information 102. According to control information 120 such as an edit command from the control means 3, the image information 102 sent from the image information storage means 4, the image information 102 from the data analysis means 2, or the compressed image information from the compression processing means 8. Ten
The editing image information 103 or the edited decompressed image is edited by performing editing such as deletion, insertion, and replacement in GOP units on 2 and by editing the decompressed image information 105 sent from the decompression processing means 7 in frame units. Get information 106.

As shown in FIG. 2 (d), the decompressed image information 105 shown in FIG. 2 (c) is output by the image deletion command from the control means 3 from the time code 00: 01: 24: 05 to 00: 01: 24: 13. To the compression processing means 8 as the edited and expanded image information 106 shown in FIG.
Send to. Further, the image information 102 that has been compressed as shown in FIG. 2F from the compression processing means 8 is combined with the preceding and following image information 102 to form the edited image information 103 in FIG. 2G.

The compression processing means 8 decompresses the expanded image information 105 and the edited expanded image information 10 according to the control information 120 from the control means 3.
This is a block for compressing 6 and converting it into image information 102. The edited decompressed image information 106 input here is an independent image sequence that has been decompressed by the decompression processing means 7 and edited by the editing means 5, and is recompressed to the same compression method as the image information 102. It is converted into the image information 102 of the compression format according to the following.

Of the edited and expanded image information 106 shown in FIG. 2E, an independent SIF image is compressed again according to the MPEG standard.
(Encoding) is performed and a new (n-1) GO is generated as shown in FIG. 2 (f).
It is compressed (encoded) into P, nGOP, (n + 1) GOP and sent back to the editing means 5. Thereafter, the editing means 5 combines the compressed image information 102 with the preceding and subsequent data to edit the edited image information 1
Convert to 03.

The output means 6 is the control information 12 from the control means 3.
This block converts the edited image information 103 into output information 104 according to 0. The output information 104 generated here is multiplexed in the edited image information 103 in accordance with the control information 120, or modified information is added to prepare the MPEG system layer format.

Next, FIG. 3 is a block diagram showing a compressed moving picture data editing apparatus according to a second embodiment of the present invention, in which the same functions and effects described in FIG. 1 are designated by the same reference numerals. , Its detailed description is omitted. In FIG. 3, 1 is input means, 2 is data analysis means, 3 is control means, 4 is image information storage means, 5 is edit means, 6 is output means, and 9 is compression for storing compression information 123. It is an information storage means. Further, FIG. 4 shows an example of the structure of compressed moving image data, which is image information.
102A configuration (a), image information 102B configuration (b), image information 10
It is a figure which shows the structure (c) of the edit image information 103 which inserted XGOP of the image information 102B between nGOP of 2A, and (n + 1) GOP.

The compression information storage means 9 follows the control information 120 from the control means 3 and the compression information 123 from the data analysis means 2.
Is a block for storing. Compression information stored here
In compressed (encoded) data of the MPEG standard, for example, 123 is a so-called sequence header such as quantization matrix, image size information, picture rate, etc. When decompressing (decoding), this information is referred to. . Therefore, in order to mix and edit materials compressed (encoded) by different compression information 123, the compression information 123 must be added at the switching point.

The nGOP and (n +) of the image information 102A shown in FIG.
1) When the XGOP of the image information 102B of FIG. 4B is inserted between GOPs, the data analysis unit 2 analyzes the input image information 102A and image information 102B according to the instruction of the control information 120 of the control unit 3. Then, the compressed information 123 is detected, and the compressed information 123A and the compressed information 123B are transferred to and stored in the compressed information storage means 9.

When the (n + 1) GOP to be inserted and edited in the input image information 102A is detected by the data analyzing means 2, the control means 3 sends the image information 102A to the editing means 5. The transmission of the image information 102A is stopped. Similarly, when an XGOP to be an insertion GOP is detected in the input image information 102B, an instruction is sent to send the XGOP of the image information 102B to the image information storage means 4.

Then, according to the control information 120 from the control means 3, the compression information 123B of the image information 102B stored in the compression information storage means 9 and the XGOP of the image information 102B stored in the image information storage means 4 are sent to the editing means 5. Then image information 1
Connect it behind the 02A nGOP. At this time, editing means 5
In, the compression information 123B is added before the XGOP. After that, the compressed information 123A of the image information 102A is sent to the editing means 5, the sending of the image information 102A is restarted, and the editing means 5 connects. Also at this time, in the editing means 5, the compressed information 123A is (n + 1) GO of the image information 102A.
It is added before P. As a result, the edited image information 103 as shown in FIG. From the above, it is possible to edit a plurality of image information 102 with different compression information 123.

Next, FIG. 5 is a block diagram showing a compressed moving image data editing apparatus according to a third embodiment of the present invention. Here, parts having the same function and effect described in FIG. , Its detailed description is omitted. In FIG. 5, 1 is input means, 2 is data analysis means, 3 is control means, 4 is image information storage means, 5 is edit means, 6 is output means, 7 is decompression processing means, 8 is compression processing means, 10 Is buffer information 124 indicating the capacity of the image information 102 to occupy the buffer of the decoder.
Is a buffer information storage means for storing.

The buffer information storage means 10 stores the buffer information 124 from the data analysis means 2 in accordance with the control information 120 from the control means 3 and sends the stored buffer information 124 to the editing means 5 and the compression processing means 8. It is a block. The buffer information 124 input here is buffer occupancy information for controlling the buffer amount of the decoder analyzed by the data analysis unit 2.

This buffer information 124 is stored in the compression processing means 8
In the process of compressing the decompressed image information 105 and the edited decompressed image information 106 into the image information 102, the buffer amount is adjusted so that the buffer information 124 does not become inconsistent between the GOPs when the edited image information 103 is edited. Is used to control the compression process.

For example, when the editing / decompressed image information 106 shown in FIG. 2 (e) is compressed (encoded) by the compression processing means 8, the last buffer occupation amount of (n-1) GOP is 32 Kbytes and (n). +1) If the buffer occupancy immediately before GOP was 40 Kbytes, when compressing (encoding) nGOP,
Matches the buffer control of (n-1) GOP and (n + 1) GOP by compressing (encoding) the last buffer occupancy amount to 32 Kbytes and the last image occupancy buffer amount to 40 Kbytes. It is possible to generate compressed (encoded) data.

Next, FIG. 6 is a block diagram showing a compressed moving picture data editing apparatus according to a fourth embodiment of the present invention, in which the same functions and effects described in FIG. 1 are designated by the same reference numerals. , Its detailed description is omitted. In FIG. 6, 1 is input means, 2 is data analysis means, 3 is control means, 4 is image information storage means, 5 is edit means, 6 is output means, 7 is decompression processing means, 8 is compression processing means, 11 Is a bit rate information storage means for storing the bit rate information 125 of the image information 102.

The bit rate information storage means 11 is the control means 3
This is a block for storing the bit rate information 125 from the data analyzing means 2 in accordance with the control information 120 from and also sending the stored bit rate information 125 to the editing means 5 and the compression processing means 8. Bit rate information entered here 125
Is local bit rate information for controlling the bit rate amount of the decoder analyzed by the data analysis means 2.
125.

In the process of compressing the decompressed image information 105 and the edited decompressed image information 106 into the image information 102 in the compression processing means 8, the bit rate information 125 is converted between GOPs when the edited image information 103 is edited. This is used for compression processing by controlling the bit rate amount so that the bit rate mismatch does not occur.

For example, when the compressed and expanded image information 106 shown in FIG. 2 (e) is compressed (encoded) by the compression processing means 8, if the bit rate is 1152 Kbit / sec, the nGOP is compressed (encoded). In this case, the data is compressed (encoded) to 1152 Kbit / sec. That is, since the number of nGOP images is 8, it is possible to generate compressed (encoded) data that matches the bit rate control before and after by compressing (encoding) so that the total is 1152 × 8/30 bits. Is possible.

FIG. 7 is a block diagram showing a compressed moving picture data editing apparatus according to a fifth embodiment of the present invention, wherein FIG.
The same reference numerals are given to those having the same function and effect as described above, and detailed description thereof will be omitted. In FIG. 7, 1 is input means, 2 is data analysis means, 3 is control means, 4 is image information storage means, 5 is edit means, 6 is output means, 7 is decompression processing means, 8 is compression processing means, 9 Is compression information storage means for storing the compression information 123 from the data analysis means 2, 1
Reference numeral 0 is a buffer information storage means for storing the buffer information 124 of the image information 102, and 11 is a bit rate information storage means for storing the bit rate information 125 of the image information 102.

Further, FIG. 8 shows that the time information from 00: 01: 24: 05 to 00: 01: 24: 13 of the image information 102A of the compressed moving image data compressed (encoded) according to the MPEG standard is deleted to obtain the image information. In the conversion diagram showing the transition of information, which is an example of the editing of inserting the time code 01: 15: 04: 28 to 01: 15: 05: 05 of 102B, the image information 102A is decompressed by the decompression processing means 7. , Decompressed image information deleted by the editing means 5
Decompressed image information 10 obtained by decompressing 105A (a) (the same information as in FIG. 2D) and image information 102B by the decompression processing means 7.
5B (b), edited decompressed image information 106 (c) in which the time code 01: 15: 04: 28 to 01: 15: 05: 05 of the decompressed image information 105B is inserted into the decompressed image information 105A by the editing means 5 and edited. ),
Image information 102 (d), which is output after the edited and expanded image information 106 of FIG. 8 (c) is compressed (encoded) by the compression processing means 8, FIG.
The image information 102 of (d) is the image information 10 before and after by the editing means 5.
2 shows the edited image information 103 (e) that is output by being combined with 2.

In FIG. 8, I is a compressed image compressed in the image, P is a compressed image using only forward reference, B is a compressed image using forward and backward image references, and SIF is a front and back image such as SIF format. Independent images that are not referred to, a solid line image is a decompressed image, a broken line image is a compressed image, and an image surrounded by a broken line is included in one GOP.

According to the fifth embodiment configured as described above, the editing means 5 stores the expanded image information 105A in the control means 3.
From the time code 00: 01: 24: 05 to 00: 01: 24: 13 by the image deletion command as shown in FIG. 8 (a), and the time of the decompressed image information 105B of FIG. 8 (b). Code 01: 15: 04: 28
To 01: 15: 05: 05 are selected and inserted into the decompressed image information 105A and sent to the compression processing means 8 as the edited decompressed image information 106 shown in FIG. 8C. 8 from the compression processing means 8.
The image information 102 compressed as shown in (d) is combined with the preceding and following image information 102 to form the edited image information 103 shown in FIG. 8 (e). At this time, the compressed information 123 from the compressed information storage means 9
Is added.

The compression processing means 8 compresses (encodes) the image of the independent SIF in the edited and expanded image information 106 shown in FIG. 8C again according to the MPEG standard, and as shown in FIG. 8D. New (n-2) GOP, (n-1) GOP, nGO
It is compressed (encoded) into P, (n + 1) GOP and (n + 2) GOP and sent back to the editing means 5. At this time, the buffer information 124 from the buffer information storage means 10 and the bit rate information 125 from the bit rate information storage means 11 are fed back and compressed (encoded) in accordance therewith to achieve a compression (encoding) before and after. ) Is possible.

Thereafter, the editing means 5 uses the compressed information 123.
Image information 102 obtained by compressing A or compression information 123B before and after
And is converted into the edited image information 103 shown in FIG.

In this embodiment having such a configuration, a plurality of materials can be freely edited from arbitrary image positions like video and film editing of compressed moving image data regardless of data compression conditions. .

[0074]

As described above, according to the present invention,
The image information to be edited is converted into independent image information that is not referred to forward or backward by the decompression processing means, and is compressed by the compression processing means after the editing is completed. Therefore, the editing work is performed from an arbitrary position in the independent image information. It is possible to edit from any position as well as video editing without being aware of compressed video.

Further, by storing the compression information of the image information in the compression information storage means and adding the information again at the time of editing, even a plurality of compressed moving image data having different compression information can be mutually edited.

Further, the buffer information of the image information is stored in the buffer information storage means, and the edited and expanded image information after editing is compressed so that the limitation of the buffer capacity is kept, so that the buffer capacity is limited. You can edit compressed video from any position without causing buffer overflow or underflow.

Further, by storing the bit rate information of the image information in the bit rate information storage means and controlling the compression of the edited decompressed image information after editing so as to protect the bit rate, an image of a fixed bit rate is obtained. Information can be edited from any position.

Further, the buffer information and the bit rate information of the image information are stored in each storage means, and the compression of the edited decompressed image information after editing is controlled so as to keep the buffer capacity and the bit rate limit. , It is possible to edit fixed bit rate image information from any position without overflow or underflow of the buffer.

Further, the image information to be edited is converted into independent image information which is not referred to forward or backward by the decompression processing means, and the compression information, the buffer information and the bit rate information are also stored in each storage means, and the edited information is edited. By compressing the decompressed image information so that it is protected during compression processing,
It is possible to edit a plurality of compressed moving image data from arbitrary positions.

It is possible to realize a compressed moving image data editing apparatus capable of freely editing a plurality of materials from arbitrary image positions such as video and film editing of compressed moving image data regardless of data compression conditions. Play.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a compressed moving image data editing apparatus according to a first embodiment of the present invention.

[Fig. 2] Fig. 2 is a conversion diagram showing a transition of information, which is an example of editing for deleting a part of image information of compressed moving image data encoded by the MPEG standard.

FIG. 3 is a block diagram showing a configuration of a compressed moving image data editing device according to a second embodiment of the present invention.

FIG. 4 is a configuration example of compressed moving image data, which is a configuration of image information A.
(a), structure of image information B (b), nGOP of image information A
It is a figure which shows the structure (c) of the edit image information which inserted XGOP of the image information B between (n + 1) GOP.

FIG. 5 is a block diagram showing a configuration of a compressed moving image data editing device according to a third embodiment of the present invention.

FIG. 6 is a block diagram showing a configuration of a compressed moving image data editing device according to a fourth embodiment of the present invention.

FIG. 7 is a block diagram showing a configuration of a compressed moving image data editing device according to a fifth embodiment of the present invention.

[Fig. 8] Fig. 8 is a conversion diagram showing a transition of information as an example of editing in which part of image information A of compressed moving image data encoded according to the MPEG standard is deleted and part of image information B is inserted.

FIG. 9 is a block diagram showing a configuration of a conventional compressed moving image data editing apparatus.

FIG. 10 is a configuration diagram of compressed moving image data showing an example of conventional deletion editing.

FIG. 11 is a configuration diagram of compressed moving image data showing a conventional replacement editing example.

FIG. 12 is a closed GOP only within a GOP when each image of the GOP uses forward reference or backward reference.
It is a block diagram which shows the open GOP (b) which straddles between (a) and GOP.

FIG. 13 is an example of inserting and editing compressed moving image data, in which the configuration of image information A and B to be edited (a), the configuration of edited image information in which only image information is inserted (b), and compression information added to image information It is a figure which shows the structure (c) of edit image information.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input means, 2 ... Data analysis means, 3 ... Control means, 4 ... Image information storage means, 5 ... Editing means, 6 ...
Output means, 7 ... decompression processing means, 8 ... compression processing means,
9 ... Compressed information storage means, 10 ... Buffer information storage means, 11 ... Bit rate information storage means, 101 ... Input information, 102 ... Image information, 103 ... Edited image information, 104 ... Output information, 105 ... Decompressed image information, 106 ... edit decompressed image information, 120 ... control information, 121 ... analysis information, 122 ... edit information, 123 ... compression information, 124 ... buffer information, 125
… Bitrate information.

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical indication H04N 7/24 H04N 7/13 Z

Claims (9)

[Claims] 1. Input means for converting input information into image information, data analysis means for analyzing the image information to generate analysis information, and image information storage means for storing the image information from the data analysis means. A decompression processing means for decompressing the image information and converting it into decompressed image information; and editing processing of the decompressed image information or the image information to generate edited decompressed image information or edited image information, and sending the edited information. Editing means, a compression processing means for compressing the edited and expanded image information from the editing means and converting it into the image information, an output means for converting the edited image information into output information, the analysis information and the A compressed moving image data editing apparatus, comprising: control means for transmitting control information for controlling each means according to edit information. 2. An input means for converting input information into image information, a data analysis means for analyzing the image information to generate analysis information and compression information, and an image for storing the image information from the data analysis means. Information storage means, compression information storage means for storing the compression information from the data analysis means, edit processing of the compression information and the image information from the compression information storage means to generate edited image information, and edit It has edit means for sending information, output means for converting the edited image information into output information, and control means for sending control information for controlling each means by the analysis information and the edit information. Compressed video data editing device. 3. Input means for converting input information into image information, data analysis means for analyzing the image information to generate analysis information and buffer information, and an image for storing the image information from the data analysis means. Information storage means, buffer information storage means for storing the buffer information from the data analysis means, decompression processing means for decompressing the image information and converting it to decompressed image information, and the buffer from the buffer information storage means Based on the buffer information from the buffer information storage means, and editing means for performing edit processing of information and the expanded image information or the image information to generate edited expanded image information or edited image information, and sending the edited information. Compression processing means for performing compression processing on the edited and expanded image information from the editing means and converting it to the image information; A compressed moving image data editing apparatus comprising: output means for converting into output information; and control means for sending out control information for controlling each means by the analysis information and the edit information. 4. Input means for converting input information into image information, data analysis means for analyzing the image information to generate analysis information and bit rate information, and an image for storing the image information from the data analysis means. Information storage means, bit rate information storage means for storing bit rate information from the data analysis means, decompression processing means for decompressing the image information to convert it to decompressed image information, and bit rate information storage means An edit means for performing edit processing of the bit rate information and the expanded image information or the image information to generate edited expanded image information or edited image information, and sending the edit information, and a bit rate from the bit rate information storage means. Compression processing means for compressing the edited and expanded image information from the editing means on the basis of information to convert into the image information; A compressed moving image data editing apparatus comprising: output means for converting the edited image information into output information; and control means for sending out control information for controlling each means by the analysis information and the edit information. 5. The compression according to claim 4, wherein the data analysis unit has a buffer information storage unit that analyzes the image information to generate buffer information and stores the buffer information from the data analysis unit. Video data editing device. 6. The compression according to claim 3, wherein the data analysis means has compression information storage means for analyzing the image information to generate compression information and storing the compression information from the data analysis means. Video data editing device. 7. The compression according to claim 4, wherein the data analysis unit has a compression information storage unit that analyzes the image information to generate compression information and stores the compression information from the data analysis unit. Video data editing device. 8. The compression method according to claim 5, wherein the data analysis means has compression information storage means for analyzing the image information to generate compression information and storing the compression information from the data analysis means. Video data editing device. 9. The compressed moving image data editing apparatus according to claim 8, wherein the compressed moving image data is compressed according to the MPEG standard.