JP2942838B2 - Video processing system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an video processing system, transmission or recording to compress the video, to video processing system for obtaining video and extended this.

[0002]

2. Description of the Related Art Hitherto, there have been high-efficiency moving image compression techniques such as MPEG (Moving Picture Expert Group), FST (Four Square Transfer), and DVI (Digital Video Interactive). If such a moving image compression technique is used, a moving image is recorded on a recording medium having a limited storage capacity such as a CD-ROM (Compact Disk Read Only Memory) and a relatively low data transfer rate, and is recorded in real time. It is possible to play.

[0003]

In a game machine or the like, a game is progressed by superimposing a foreground image of a character or the like appearing in the game on an image of a background image.

In this case, the foreground image has, for each pixel, priority data indicating whether the image is a foreground portion or a background portion, together with RGB color data. Alternatively, background image data is selected and the images are superimposed and displayed.

[0005] Even if an attempt is made to compress the above-described foreground image as a moving image, conventional moving image compression techniques such as MPEG can only compress moving image data composed only of color data and include priority data. There has been a problem that moving image data cannot be compressed.

[0006] The present invention has been made in view of the above points,
Video that can compress and decompress video data including priority data, and display the decompressed video over other images
It is an object to provide a processing system.

[0007]

A moving image processing system according to the present invention compresses image information of a moving image comprising priority data and color data indicating a foreground portion or a background portion in pixel units, and further compresses the compressed image information. A system for expanding image information of a moving image, comprising: moving image compression means for compressing color data in the image information of the moving image; priority data compression means for compressing priority data in the image information of the moving image; and compressed color data compressed by means, separating means for separating and combining means for combining the compressed priority data compressed by the priority data compression means, the combined data into compressed color data and the compressed priority data, separated A moving image decompression means for decompressing the compressed color data to obtain moving image color data, and a separated compression priority data The decompresses and a priority data decompression means for obtaining the priority data of the moving image.
Alternatively, a moving image processing system for expanding compressed image information as synthesized data including compressed priority data in which priority data indicating a foreground portion or a background portion is compressed in pixel units and compressed color data, Separating means for separating the data into compressed color data and compressed priority data; moving picture decompressing means for decompressing the separated compressed color data to obtain moving picture color data; and moving picture decompressing means for decompressing the separated compressed priority data. Priority data expanding means for obtaining priority data.

[0008]

According to the present invention, the compressed moving image data obtained by compressing the color data and the compressed priority data obtained by compressing the priority data are synthesized, and the compressed moving image data and the compressed priority data are separated from the synthesized data and decompressed separately. Therefore, it is possible to compress and decompress the moving image data including the priority data. Since the decompressed image data includes the priority data, the decompressed moving image can be displayed by being superimposed on another image such as a background image.

[0009]

1 and 2 show block diagrams of a compression system and a decompression system, respectively, according to an embodiment of the system of the present invention.

In the compression system shown in FIG.
The moving image picked up by or the moving image reproduced by the video tape recorder 13 is selected by the switch 14 and supplied to the A / D converter 15. Here, as shown in FIG. 3A, for example, the moving image has a blue screen as a background 30 and a foreground 31.
Is a moving image.

The A / D converter 15 separates RGB components of a video signal of a moving image, quantizes each color with, for example, 5 bits, and outputs the image data as 15 bits per pixel. This moving image data is supplied to the chroma key detector 16. The chroma key detector 16 compares the image data with the background color (blue, which is the color of the background 30) on a pixel-by-pixel basis. 0)
Generate a priority bit with value 0. If they do not match, the image data is output as it is as a moving image area, and a priority bit of value 1 is generated. Instead of replacing the color data of the background area with the lowest luminance, the color data may be replaced with the color of the outline of the moving image area. In this case, the bleeding of the outline color at the time of extension is less.

FIG. 3 output from the chroma key detector 16
Image data (color data) with a black background as shown in (B) is supplied to a moving image compressor 18 as moving image compression means. The moving image compressor 18 is, for example, an MPEG encoder, and performs high-efficiency moving image compression, for example, every 0.5 seconds of the display time and supplies it to the data synthesizer 19. The priority bits output from the chroma key detector 16 having a background value of 0 (shown in black in the figure) and a foreground value of 1 (shown in white in the figure) as shown in FIG. It is supplied to a reversible compressor 20 as compression means. Lossless compressor 20
Compresses the priority bits, which are binary data strings with large data unevenness, using a run-length code and a Huffman code so that they can be completely restored, and supplies the compressed data bits to the data combiner 19.

A data synthesizer 19, which is a synthesizing means, is supplied with the compressed moving image data and the compressed priority data from the moving image compressor 18 and the lossless compressor 20, respectively. As shown in FIG. That is, the header 37 is added to the compressed moving image data 35 for 15 frames and the compressed priority data 36 for 15 frames to synthesize the data, and the combined data is supplied to the recording device 22 such as a CD-ROM, a hard disk, and the like. And record
The data is supplied to the transmitter 24 and transmitted to the communication line 26.

In the decompression system shown in FIG. 2, the reproducing device 42 reproduces the synthesized data from the recording medium recorded by the recording device 22 and supplies the synthesized data to the switch 43.
6 is transmitted and supplied to the switch 43. The combined data selected by the switch 43 is supplied to a data separator 45 as separating means, where the combined data is separated into compressed moving image data and compressed priority data of the combined data shown in FIG. The compression priority data is supplied to a certain moving image decompressor 46, and the compressed priority data is supplied to a reversible decompressor 47 as priority decompression means.

The moving picture decompressor 46 is an MPEG decoder, decompresses the compressed moving picture data, and outputs image data synchronized with the vertical synchronizing signal, horizontal synchronizing signal and pixel clock supplied from the synchronizing signal generator 48. The reversible expander 47 expands the compressed priority bits compressed by the run-length code and the Huffman code into the original priority bits, and outputs them in synchronization with the vertical synchronization signal, the horizontal synchronization signal, and the pixel clock.

The above-mentioned image data and priority bits are supplied to an input / output circuit (I / O) 61 in the image processing apparatus 60, and are written in an address of the character memory 63 specified by the CPU 62 in pixel units. On the character memory 63, the image data for one pixel is 16 pixels as shown in FIG.
The lower 5 bits D0 to D4 represent a red level, the next 5 bits D5 to D9 represent a green level, the next 5 bits D10 to D14 represent a blue level, and the most significant bit D15. Is a priority bit.

The graphic processor 64 reads the image data of the foreground moving image stored in the character memory 63, performs processing such as enlargement, reduction, rotation, and color calculation, and writes the processed data into the frame buffer 65. Further, the graphic processor 64 reads the image data of the foreground moving image in the frame buffer 65 and synchronizes the vertical, horizontal, and pixels with the image data of the background image stored in the frame buffer 66 (only the RGB data sets the priority bits. (Not included), and when the priority bit added to the foreground moving image is 1, the RGB data of the foreground moving image is selected. When the priority bit is 0, the image data of the background image is selected and supplied to the video encoder 70. . Accordingly, the video encoder 70 generates a video signal of an image obtained by combining the foreground moving image and the background image, and displays the video signal on the monitor 72.

By the way, in the moving picture compression / expansion method such as MPEG, the decompressed image and the image before compression do not completely match, and color bleeding and the like particularly occur at the outline of the foreground. However, in the compression / expansion method using the run-length code and the Huffman code, the expanded priority bits completely match the priority bits before compression. For this reason, the background side of the color-blurred outline portion of the expanded image is ignored as the background, so that the color blur is almost inconspicuous.

As described above, the compressed moving image data obtained by compressing the color data and the compressed priority data obtained by compressing the priority data are synthesized and transmitted, and the compressed moving image data and the compressed priority data are separated from the transmitted data. Since each of them is separately decompressed, it is possible to compress and decompress the video data including the priority data. Since the decompressed image data includes the priority data, the decompressed video is displayed by being overlapped with another image such as a background image be able to.

Incidentally, after one moving image is developed on the frame buffer 65, another moving image is further developed and developed, so that a plurality of moving images can be displayed in a superimposed manner.

[0021]

As described above, according to the moving picture processing system of the present invention, moving picture data including priority data can be compressed and decompressed, and the decompressed moving picture can be displayed so as to be superimposed on another image. Very useful.

[Brief description of the drawings]

FIG. 1 is a block diagram of a compression system of the system of the present invention.

FIG. 2 is a block diagram of an extension system of the system of the present invention.

FIG. 3 is a diagram for explaining the present invention.

FIG. 4 is a diagram showing a transmission data format.

FIG. 5 is a diagram showing an image data format of a moving image.

[Explanation of symbols]

 Reference Signs List 16 chroma key detector 18 video compressor 19 data synthesizer 20 reversible compressor 22 recording device 24 transmitter 42 playback device 44 receiver 45 data separator 46 video decompressor 47 reversible decompressor

Claims (2)

(57) [Claims] An image information of a moving image comprising priority data and color data for indicating a foreground portion or a background portion in pixel units is compressed , and the compressed image information of the moving image is decompressed.
A system for Zhang, a moving picture compression means for compressing among color data of the image information of the moving image, and priority data compression means for compressing the priority data of the image information of the moving image, which is compressed by the moving picture compressing means Synthesizing means for synthesizing the compressed color data and the compressed priority data compressed by the priority data compressing means; and combining the synthesized data with the compressed color data and the compressed priority data.
Separation means for separating the compressed color data into color data for the moving image by expanding the separated compressed color data
Video decompression means to expand the separated compressed priority data and
Priority data decompression to get priority data
Video processing system characterized by having means. 2. A moving image processing system for decompressing compressed image information as synthesized data comprising compressed priority data in which priority data indicating a foreground portion or a background portion is specified in pixel units and compressed color data. Separating means for separating the combined data into compressed color data and compressed priority data, moving picture decompressing means for decompressing the separated compressed color data to obtain moving picture color data, and decompressing the separated compressed priority data. And a priority data decompression means for obtaining priority data of the moving image.