JPH11313317A - Processing method and device for compressed image data, method and device for converting moving image compression form, moving image data compressor, medium for storing compressed image data processing program as well as processing data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a means that generates data to convert data by MPEG 1/2 into data of MPEG 4. SOLUTION: The device is provided with a demultiplexer 10 that receives an MPEG 4 bit stream and extracts and outputs a VOP and scene description information, a decoder group that decodes each VOP to obtain original image data, a synthesis section 30 that synthesizes the original image data obtained by each decoder by using the scene description information to output the original image data consisting of the MPEG 4 bit stream, and an MPEG 1/2 encoder 40. The MPEG 1/2 encoder 40 is provided with an encoding section 41 that generates data in the MPEG 1/2 format and with a processing section 42 that imbeds the scene description information in the data encoded by the encoding section 41.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to compressed image data such as MPEG1 or MPEG2 which performs processing in units of one image, and MPEG4 such as MPEG4 using a VOP (Video Object Plane). The present invention relates to an image compression data processing method and apparatus, a moving image compression format conversion method and apparatus, and a moving image data compression apparatus suitable for use in a network or the like where image compression data coexists.

[0002]

2. Description of the Related Art A system has been proposed in which a moving image server distributes moving image information to each client via a network with the rapid progress of multimedia technology.
At the time of this distribution, a moving image data having a large amount of information is not distributed as it is, but a data obtained by performing a compression process on the moving image information is distributed, thereby increasing a data transmission speed. .

As a moving image compression method for performing such compression processing, MPEG1 or MPEG2 (“MP
EG1 / 2 ") is a representative example,
In recent years, this MPEG1 / 2 has spread.

In recent years, MPEG4, which is a moving picture compression method using VOP, has been proposed and its development is being actively pursued. In MPEG4, when one frame of moving image data is given, the moving image data is divided into VOPs, which are a plurality of types of images, and arrangement information (scenes as appropriate) indicating an area (segment) that each VOP occupies in the frame is provided. "Description information"). Then, compression processing, that is, encoding, is performed on each VOP, and the result of combining the encoding result for each VOP and scene description information is used as moving image compression data in MPEG4.

[0005]

By the way, MPEG1
/ 2 is a method for compressing moving image data without using a VOP.
4 cannot be extended.

[0006] This means that, for example, the first network handles only MPEG1 / 2 data, while the second network handles only MPEG4 data. Data transfer to the MPE in the second network.
It means that extension at G4 cannot be performed.

[0007] Such a situation is not inconvenient today, as the network network is advancing rapidly. SUMMARY OF THE INVENTION The present invention has been made to solve such a conventional problem, and has as its object to convert MPEG1 / 2 format data into a moving image compression system using a VOP, for example, MPP.
An object of the present invention is to provide means for generating data that can be converted to data in the EG4 format.

It is another object of the present invention to provide means capable of encoding data generated by this means by a moving picture compression method such as MPEG4 using VOP.

Further, another object of the present invention is to provide an MPEG-4
Compressed moving image data such as
An object of the present invention is to provide a compression format conversion device for converting PEG1 / 2 moving image compression data.

[0010]

In order to achieve the above object, according to the first aspect of the present invention, MPEG1 or M1 is used.
A method of processing image compression data in PEG2,
In the compressed image data, the unit image data of each VOP to be generated when the original data of the compressed image data is compressed by a moving image compression method using a plurality of types of VOPs (video object planes) And processing for embedding the arrangement information in the compressed image data.

According to a second aspect of the present invention, there is provided a method for converting a moving image compression format, wherein a compression process is performed by a first moving image compression method using a plurality of types of VOPs (video object planes). Receiving the compressed image data, extracting and outputting each VOP and extracting and outputting the arrangement information of each VOP in the unit image data;
Performing decoding for each OP, synthesizing the decoded image data, compressing the synthesized image data using a second moving image compression method, and compressing the image data using the second moving image compression method. Embedding the arrangement information in the compressed image data generated by performing the processing.

According to a third aspect of the present invention, there is provided an apparatus for processing compressed image data, comprising: an encoder for compressing given moving image data by MPEG1 or MPEG2; In the data, the moving image data includes a plurality of types of VOPs (video
A processing unit for embedding the arrangement information in the unit image data of each VOP to be generated when the moving image is compressed by a moving image compression method using an object plane (object plane). It is a data processing device.

According to the present invention, the arrangement information in the unit image data of each VOP is embedded in the data of the MPEG1 / 2 format generated by the encoder, so that it can be decoded by the MPEG1 / 2 decoder and Encoding can also be performed by a moving image compression method using arrangement information such as MPEG4.

Further, the invention according to claim 4 is an apparatus for converting a moving picture compression format, wherein the apparatus is subjected to compression processing by a first moving picture compression method using a plurality of types of VOPs (video object planes). Given compressed image data, a demultiplexer that extracts and outputs each VOP and extracts and outputs the arrangement information of each VOP in unit image data, a decode group that decodes each VOP, and a decoded image A synthesizing unit for synthesizing data, and an encoder for compressing the synthesized image data by a second moving image compression method, wherein the encoder includes: A moving image compression format conversion device that performs a process of embedding arrangement information.

According to the present invention, each VOP extracted by the demultiplexer is decoded by the decoder group, and the synthesizing unit synthesizes the original image data using the decoding result and the arrangement information extracted by the demultiplexer. As a result, the original image data of the image compression data compressed by the first moving image compression method is obtained. Further, the encoder encodes the original image data by a second moving image compression method such as MPEG1 / 2, and embeds arrangement information in the encoded data.

Therefore, the image compression data of the first moving image compression method is converted into image compression data of the second moving image compression method, and the converted data is included in the data of the second moving image compression method. Since the arrangement information of each VOP in the unit image data is embedded therein, it can be encoded by the encoder of the second moving image compression method and can be encoded by MPEG.
4 can be encoded even with a moving image compression method using arrangement information.

The apparatus for compressing processed data according to claim 1, further comprising: a decoder for decompressing in MPEG1 or MPEG2 based on the processed data; and an extracting unit for extracting the arrangement information. And an encoder that performs a compression process by a moving image compression method using a plurality of types of VOPs (video object planes) using the original moving image data expanded by the decoder and the arrangement information extracted by the extraction unit. And a moving image data compression device.

According to the invention, the decoder decodes the processed data, and the extracting unit extracts the arrangement information,
Further, since the encoder performs a compression process using a moving image compression method using a plurality of types of VOPs using the decoding result and the arrangement information, data of the MPEG1 / 2 format is compressed by a moving image compression method such as MPEG4. Can be performed.

Further, the invention according to claim 6 is a MPEG-1
Alternatively, a computer-readable storage medium storing a program for processing image compression data in MPEG2, wherein the original data of the image compression data includes a plurality of types of VOPs (video object planes) in the image compression data. A storage medium storing an image compression data processing program for causing a computer to execute a process of embedding arrangement information in unit image data of each VOP to be generated when the video data is compressed by a moving image compression method using a video compression method. . Here, as the computer, a computer having a CPU (Central Processing Unit) that operates according to the description content of the program, a RAM that functions as a work memory, and the like may be used.

[0020] Further, the invention according to claim 7 is an MPEG file system.
1 or a computer-readable storage medium storing data obtained by processing image compressed data in MPEG2, wherein the processed data includes a plurality of types of VOPs (original data of the image compressed data) in the image compressed data. A video object plane) embedded in a unit of image data of each VOP to be generated when the moving image is compressed by a moving image compression method using a video object plane. This is a storage medium storing processing data. According to the present invention, for example, a CPU that performs decoding in MPEG1 or MPEG2 reads this data, decodes the data in the MPEG1 or MPEG2 format, or extracts the arrangement information. Alternatively, a process of performing encoding by a moving image compression method such as MPEG4 using the decoding result obtained by decoding the data of the MPEG2 format is specified.

The above-mentioned storage medium includes RO
M, semiconductor storage medium such as IC card, CDROM, DV
Examples include an optical storage medium such as a DROM, a magnetic storage medium such as a floppy disk, and a magneto-optical storage medium such as an MO.

[0022]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of an embodiment of the apparatus according to the present invention. This device uses MPE
Given a G4 bit stream, a demultiplexer 10 that extracts and outputs VOP and scene description information, and a decoder group (VOP1 decoder 20a, VOP2 decoder 20) for decoding each VOP and obtaining original image data
b, VOP3 decoder 20c) and the original image obtained by each decoder using the scene description information to synthesize
It has a synthesizing unit 30 that outputs original image data of the EG4 bit stream, and an MPEG1 / 2 encoder 40.

The MPEG1 / 2 encoder 4
0 includes an encoding unit 41 that generates image compressed data in the MPEG1 / 2 format, and a processing unit 42 that performs processing for embedding scene description information in the encoded data in the encoding unit 41. Although this apparatus has a configuration in which three types of VOP encoders are provided, the number of VOP encoders is not particularly limited. That is, in this case, it is assumed that three types of VOPs exist.

By the way, an MPEG4 bit stream is composed of VOPs (for example, three types of VOP1) as shown in FIG.
To VOP3), and scene description information which is information indicating which area in one frame each VOP occupies, for example. Although FIG. 2 shows that data is configured by separating the VOP and the scene description information, actually, such a clear boundary does not exist, and it is easy to understand. Therefore, it is only described schematically.

Now, when this MPEG4 bit stream is provided, the demultiplexer 10
OP3 and scene description information are extracted and output on each signal line. Each of the VOP1 decoder 20a, the VOP2 decoder 20b, and the VOP3 decoder 20c
OP1, VOP2 and VOP3 are decoded and each VP is decoded.
An original image corresponding to O is obtained and output.

Next, the synthesizing section 30 synthesizes images using the original images output from the respective VOP decoders and scene description information indicating what area they occupy.
The original image data for the MPEG4 bit stream is reproduced.

Next, the encoding unit 41 of the MPEG1 / 2 encoder 40 encodes the original image data output from the synthesizing unit 30 using the MPEG1 / 2 moving image compression method.
Further, the processing unit 42 embeds and processes the scene description information into the data of the MPEG1 / 2 format using an algorithm used for digital watermarking or the like, and outputs this as an MPEG1 / 2 bit stream.

FIG. 3 schematically shows this data format, and this data has MPEG1 / 2 and scene description information. Although the VOP and the scene description information are shown as constituting data separately, in practice such a clear boundary does not exist.
They are merely described schematically for ease of understanding.

The MPEG1 / 2 format data can of course be expanded by an MPEG1 / 2 decoder to obtain the original image data, but can also be converted to MPEG4 format data. It is possible. FIG. 4 shows a block diagram of an apparatus for this purpose.

This apparatus comprises an MPEG1 / 2 decoder 50 for decoding MPEG1 / 2 format data.
A scene description information extraction unit 60 for extracting the embedded scene description information, and an MPE that converts the decoded result and the scene description information into data in MPEG4 format.
And a G4 encoder 70. The processing unit 42
The scene description information extraction unit 60 may be configured to operate with an algorithm capable of detecting a watermark by the digital watermark technique used in the above.

When data as shown in FIG. 3 is given to a point A in the figure, the MPEG1 / 2 decoder 50
In addition to decoding the data in the PEG1 / 2 format, the scene description information extraction unit 60 extracts the embedded scene description information. And the MPEG4 encoder 7
0 is MP using the decoding result and the scene description information.
EG4 format data can be generated.

Therefore, if the arrangement information in the unit image data of each VOP is embedded in the data of the MPEG1 / 2 format, the data can be decoded by the MPEG1 / 2 decoder and the arrangement information such as MPEG4 can be used. Encoding can also be performed using the moving image compression method. As a result, MPEG1 / 2 format data is
It is possible to generate data that can be converted to G4 format data, and the first network uses MPEG
In the case where only the data of 1/2 is handled, while the second network handles only the data of MPEG4,
It is possible to transfer data from the first network to the second network and to perform MPEG4 decompression within the second network.

It should be noted that the device as described above is
This can be realized not only by hardware such as SI, but also by using a CPU in which the CPU executes processing based on a program stored in a computer-readable storage medium such as a CDROM.

FIG. 5 shows that MPEG1
FIG. 6 is a specific hardware configuration diagram for embedding the scene description information in the unit image data of each VOP in the data of the / 2 format, and FIG. 6 is an explanatory diagram of a program describing this operation procedure. . This program is stored in a CD ROM 140 as a storage medium.
When the ROM 140 is inserted into the driver 130, the program is read by the CPU 100 and
Is stored in a predetermined area. When the original image data is provided from outside via the I / O 120, the CPU 1
00 transfers the data to the RAM 110 via the bus 150.
Once.

In step S600, the CPU 100 causes the RAM 110
Encodes the original image data stored in
Next, in step S610, a process of embedding scene description information externally provided via the I / O 120 by an algorithm such as a digital watermark is performed.

As described above, even if the CPU 100 performs the processing according to the program stored in the storage medium, each VO in the data of the MPEG1 / 2 format is stored.
Processing for embedding scene description information in the P unit image data can be performed. The CPU 100 can also store the processed image data in a storage medium such as a floppy disk capable of writing and reading information.

As described above, according to the embodiment of the present invention, in the MPEG1 / 2 format data, the unit image data of each VOP to be generated when the original data is compressed by MPEG4. Even if the scene description information indicating the arrangement is embedded and once decoded by MPEG1 / 2, the original data can be converted to MPEG4 again later.

[0038]

As described above, claims 1 and 3,
According to the inventions according to the sixth and seventh aspects, since the arrangement information in the unit image data of each VOP is embedded in the data of the MPEG1 / 2 format, the data of the MPEG1 / 2 format is converted into the data of the MPEG4 format, for example. Convertible data can be generated.

According to the second and fourth aspects of the present invention,
Image compressed data in the first moving image compression method is converted into image compressed data in the second moving image compression method, and the converted data is included in the data of the second moving image compression method in each VOP. Since the arrangement information in the unit image data is embedded, it can be encoded by the encoder of the second moving image compression method and can also be encoded by the moving image compression method using the arrangement information such as MPEG4.

According to the fifth aspect of the present invention, the decoder decodes the processed data, the extracting unit extracts the arrangement information, and the encoder uses the decoding result and the arrangement information to obtain a plurality of types of information. Since the compression processing is performed by the moving image compression method using the VOP, it is possible to perform the compression processing by the moving image compression method such as MPEG4 on the data of the MPEG1 / 2 format.

[Brief description of the drawings]

FIG. 1 is a block diagram of an embodiment of an apparatus according to the present invention.

FIG. 2 is an explanatory diagram of a data format.

FIG. 3 is an explanatory diagram of a data format.

FIG. 4 is a block diagram of another embodiment of the device according to the present invention.

FIG. 5 is a hardware configuration diagram.

FIG. 6 is an explanatory diagram of processing by software.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Demultiplexer 20a VOP1 decoder 20b VOP2 decoder 20c VOP3 decoder 30 Compositing part 40 MPEG1 / 2 encoder 41 Encoding part 42 Processing part 50 MPEG1 / 2 decoder 60 Scene description information extraction part 70 MPEG4 encoder 100 CPU 110 RAM 120 I / O 130 Driver 140 CDROM 150 bus

(54) [Title of the Invention] Image compression data processing method and apparatus, moving image compression format conversion method and apparatus, moving image data compression apparatus, storage medium storing image compression data processing program, and image compression Storage medium that stores data processed data

Claims (7)

[Claims] 1. A method of processing image compressed data in MPEG1 or MPEG2, wherein a plurality of types of VOPs (video object planes) are used as the original data of the image compressed data in the image compressed data. A method of processing compressed image data, comprising: performing processing for embedding arrangement information in unit image data of each VOP to be generated when compressed by a moving image compression method. 2. A method for converting a moving image compression format, comprising a plurality of types of VOPs (video object planes).
, Extracting and outputting each VOP and extracting and outputting the arrangement information of each VOP in the unit image data, when given the compressed image data compressed by the first moving image compression method using Performing decoding for each image, synthesizing the decoded image data, compressing the synthesized image data using a second moving image compression method, and performing compression processing using the second moving image compression method. And embedding the arrangement information in the compressed image data generated by performing the moving image compression method. 3. An apparatus for processing image compression data, comprising: providing a given moving image data with MPEG1 or MPEG2
And an encoder for performing compression processing on the compressed image data compressed by the encoder.
Processing for embedding arrangement information in unit image data of each VOP to be generated when the moving image data is compressed by a moving image compression method using a plurality of types of VOPs (video object planes) And a processing unit for processing the compressed image data. 4. An apparatus for converting a moving image compression format, comprising a plurality of types of VOPs (video object planes).
And a demultiplexer that extracts and outputs each VOP and extracts and outputs the arrangement information of each VOP in the unit image data, when given compressed image data compressed by the first moving image compression method using A decoding group for performing decoding for each VOP, a synthesizing unit for synthesizing the decoded image data, and an encoder for compressing the synthesized image data by a second moving image compression method. A moving image compression format conversion apparatus that performs processing for embedding the arrangement information in image compression data generated by performing processing. 5. An apparatus for compressing processed data according to claim 1, wherein the compressed data is MPEG1 or MPEG based on the processed data.
A plurality of types of VOPs (video and video) using the original moving image data expanded by the decoder and the allocation information extracted by the extraction unit. A moving image data compression apparatus comprising: an encoder that performs a compression process by a moving image compression method using an object plane (object plane). 6. A computer-readable storage medium storing a program for processing image compression data in MPEG1 or MPEG2, wherein the image compression data contains a plurality of types of VOPs (VOPs). An image compression data processing program for causing a computer to execute a process of embedding arrangement information in unit image data of each VOP to be generated when compression is performed by a moving image compression method using a video object plane) A storage medium that stores the information. 7. A computer-readable storage medium storing data obtained by processing compressed image data in MPEG1 or MPEG2, wherein the processed data includes, in the compressed image data, original data of the compressed image data. It is characterized by embedding arrangement information in unit image data of each VOP to be generated when compressed by a moving image compression method using a plurality of types of VOPs (video object planes). A storage medium storing processed data of compressed image data to be processed.