KR100925627B1 - Scalable video compression encoding/decoding apparatus based on image segmentation - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a flexible video encoding / decoding apparatus based on image segmentation.

2. The technical problem to be solved by the invention

According to the present invention, a video is elastically encoded based on a screen space to efficiently transmit and store a video according to a user's preference, a terminal, a communication network, and the like, and decode the video at a receiving side. To provide a video encoding / decoding apparatus to enable it.

3. Summary of Solution to Invention

According to an aspect of the present invention, there is provided a moving picture encoding apparatus comprising: moving picture splitting means for dividing a central part of a moving picture screen into a base layer and dividing the remaining part except the center part into an enhancement layer; Base layer video encoding means for intra encoding the base layer video divided by the video screen division means; And enhancement layer video encoding means for motion compensation encoding the enhancement layer video divided by the video screen division means by referring to the frame encoded by the base layer video encoding means.

4. Important uses of the invention

The present invention is used for video encoding / decoding.

Description

Scalable video compression encoding / decoding apparatus based on image segmentation

1 is an exemplary diagram of screen space division for moving picture extension code used in the present invention.

2 is a block diagram of an embodiment of a video encoding apparatus according to the present invention;

3 is a block diagram of an embodiment of a video decoding apparatus according to the present invention;

4 is an exemplary explanatory diagram illustrating an enhancement layer prediction encoding process according to the present invention;

5 is an exemplary diagram of enhancement layer screen macroblock division used in the present invention;

6 is a detailed block diagram of an embodiment of the enhancement layer encoder of FIG. 2 according to the present invention;

7 is a structural diagram of an enhancement layer bitstream used in the present invention.

8 is a flowchart illustrating an embodiment of a video encoding method according to the present invention;

9 is a detailed flowchart of an embodiment of the enhancement layer encoding process of FIG. 8 according to the present invention;                 

10 is a flowchart illustrating an embodiment of a video decoding method according to the present invention.

* Explanation of symbols for the main parts of the drawings

21: Video Splitter 22: Base Layer Video Encoder

23: enhancement layer video encoder 31: base layer video decoder

32: Enhancement Layer Video Decoder 33: Video Player

34: video indicator

The present invention relates to a flexible video encoding / decoding apparatus based on video segmentation. In particular, the present invention relates to a flexible video encoding / decoding apparatus, in which video space is flexibly (differently) encoded in a video encoding so that the user can transmit the whole or part of the video as desired. Various services are available according to the bandwidth and the terminal.

With the development of the Internet, digital television (TV), DVD (Digital Versatile Disc), IMT-2000 (International Mobile Telecommunication-2000), and high-speed network, video content has many fields such as education, entertainment, medical, science, etc. It is produced in the US, and is widely used in application services such as multimedia database, remote monitoring, digital TV, Internet broadcasting, and VOD (Video On Demand).

However, in digitally encoding a single video, there is a technique of elastically encoding according to various terminals and communication capacities.

The flexible video encoding scheme is a technique for storing or transmitting a target video code into one base layer code stream and one or more enhancement layer code streams, and the enhancement layer code stream is an efficient encoding technique based on the base layer code stream. .

For example, conventional flexible video coding methods such as MPEG-1 (MPEG-1) and MPEG-2 (MPEG-2) include signal noise ratio telescopic coding, temporal telescopic coding, and spatial telescopic coding. There was a way. These methods are techniques for encoding the entire screen of the input video in the base layer and the enhancement layer. On the other hand, in MPEG-4, there is a method in which the entire screen is encoded into a base layer, and an improvement layer encodes an improvement in image quality of a specific object (area) of the screen. In all of the conventional flexible video encoding methods, the base layer deteriorates the image quality of the entire screen, and the enhancement layer encodes information for improving the image quality based on the base layer.

Therefore, in the current technical field, a method for efficiently transmitting and storing a video according to user preferences, a terminal, a communication network, and the like by encoding the video flexibly based on the screen space is required. .

The present invention has been proposed in order to meet the above requirements, and the video is elastically encoded based on the screen space to efficiently transmit and store the video according to user preferences, terminals, communication networks, etc., the receiving side It is an object of the present invention to provide a video encoding / decoding apparatus for enabling various services according to a bandwidth and a terminal of a service by decoding.

According to an aspect of the present invention, there is provided a moving picture encoding apparatus comprising: moving picture splitting means for dividing a central portion of a moving image screen into a base layer and dividing the remaining portions except the center portion into enhancement layers; Base layer video encoding means for intra encoding the base layer video divided by the video screen division means; And enhancement layer video encoding means for motion compensation encoding the enhancement layer video divided by the video screen division means by referring to the frame encoded by the base layer video encoding means.

The present invention provides a video decoding apparatus comprising: base layer video decoding means for reconstructing a base layer video by decoding a base layer video having an intra-coded central portion of a video screen; Enhancement layer video decoding means for decoding an enhancement layer video including motion compensation encoding of image information of the remaining space excluding a central portion of the video screen based on a decoding result of the base layer video decoding means; The base layer video decoded by the base layer video decoding means is reproduced and transmitted to the video display means, or the base layer video decoded by the base layer video decoding means and the enhancement layer video decoded by the enhancement layer video decoding means. Moving picture reproducing means for reproducing and synthesizing and delivering the synthesized picture to the moving picture display means; And the video display means for screen outputting the video received from the video playback means.

In addition, the present invention is based on the decoding result of the base layer video decoding means, by decoding the enhancement layer video coded video information of the remaining space except the base layer screen of the video screen, reconstructs the enhancement layer video It further comprises an enhancement layer video decoding means for transmitting to the playback means.

According to the present invention for achieving the above object, in the video encoding and decoding apparatus, a video screen division for dividing the video information of a predetermined space of the entire screen of the input video into a base layer, and dividing a portion except the base layer into an enhancement layer Way; Base layer video encoding means for encoding and transmitting a base layer video divided by the video screen division means; Enhancement layer video encoding means for encoding and transmitting an enhancement layer video by referring to the encoded frame of the base layer video encoding means; Base layer video decoding means for decoding the base layer video to reconstruct the base layer video; Enhancement layer video decoding means for decoding the enhancement layer video and reconstructing the enhancement layer video based on a decoding result of the base layer video decoding means; Video reproducing means for reproducing the base layer video and the enhancement layer video decoded by the base layer video decoding means and the enhancement layer video decoding means; And video display means for screen outputting a video reproduced by the video reproducing means.

According to the present invention for achieving the above object, in a video encoding method applied to a video encoding apparatus, the video information of a predetermined space of the entire screen of the input video is divided into a base layer, and the portion except the base layer is divided into enhancement layers. A first step of making; A second step of encoding the divided base layer video; And a third step of encoding the enhancement layer video by referring to the encoded base layer video frame.

The present invention provides a video decoding method applied to a video decoding apparatus, comprising: a first step of decoding a base layer video encoded with video information of a predetermined space in a video screen and reconstructing the base layer video; A second step of playing the decoded base layer video; And a third step of screen outputting the reproduced video.

Also, after performing the first step, the present invention decodes the enhancement layer video by decoding the enhancement layer video encoded with the image information of the remaining space except the base layer screen based on the base layer video decoding result. Fourth step; And a fifth step of playing, synthesizing, and outputting the decoded base layer video and the decoded enhancement layer video.

delete

delete

delete

The present invention encodes the image information of a part of the entire screen of the input video to the base layer, and encodes the remaining space into the enhancement layer, and basically encoded into the base layer according to the user's preference, selection, terminal performance, network capacity, etc. Transmitting, storing, and reproducing the moving picture of the space, and selectively transmitting, storing, and reproducing the information of the enhancement layer to achieve the expandability of the screen space of the moving picture.

According to the present invention, in the field of application services such as multimedia database, remote monitoring, digital TV, Internet broadcasting, VOD, and the like, the video is elastically encoded based on the screen space, and the video is efficiently transmitted according to the user's preference, terminal, and communication network. It is used to store it.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary diagram of screen space division for moving picture extension code used in the present invention.

The base layer screen (b) is a central portion of the entire screen (a).

The enhancement layer screen is a portion of the entire screen (a) except the base layer screen (b).

The base layer video is encoded using video coding methods such as Motion Joint Photographic Coding Experts Group (MJPEG), MPEG-1, 2, 4, and Joint Video Team (JVT).

The encoding process of the enhancement layer video will be described in more detail below.

2 is a block diagram of an embodiment of a video encoding apparatus according to the present invention.

As shown in FIG. 2, the video encoding apparatus according to the present invention uses video information of a predetermined space (b of FIG. 1) in the entire screen (a of FIG. 1) of the input video as a base layer, and excludes the base layer. Of the video layer divider 21 for dividing the portion into enhancement layers, the base layer video encoder 22 for encoding the base layer video divided by the video screen divider 21, and the base layer video encoder 22. An enhancement layer video encoder 23 for encoding an enhancement layer video with reference to the encoded frame is included.

The operation of the flexible video encoding apparatus based on the image segmentation according to the present invention having the above-described configuration will now be described with reference to FIG. 8.

First, each frame of the digitized video is inputted to the video screen divider 21 (801) and divided and output to the base layer video and the enhancement layer video (802).

Subsequently, the base layer video encoder 22 encodes the base layer video (803) to store or transmit the encoded base layer video stream. In this case, the base layer video encoding is performed by using the MPEG-4 video encoding method.

Meanwhile, the enhancement layer video encoder 23 encodes the enhancement layer video (804) to store or transmit the encoded enhancement layer video. At this time, when encoding the enhancement layer video, the encoded frame of the base layer video encoder 22 is referred to.

3 is a block diagram of an embodiment of a video decoding apparatus according to the present invention.

As shown in FIG. 3, the video decoding apparatus according to the present invention decodes a base layer video by encoding image information of a predetermined space (b of FIG. 1) of a video screen (a of FIG. 1) and encodes a base layer video. The base layer video decoder 31 for reconstructing the video, the video player 33 for playing the base layer video decoded by the base layer video decoder 31, and the video played by the video player 33. It includes a video display 34 for screen output.
Further, based on the decoding result of the base layer video decoder 31, the enhancement layer video is decoded by decoding the enhancement layer video encoded with the image information of the remaining space except the base layer screen (b) of the video screen (a). The apparatus further includes an enhancement layer video decoder 32 configured to transfer the video to the video player 33 after the reconstruction.

The operation of the flexible video decoding apparatus based on the image segmentation according to the present invention having the configuration as described above will be described with reference to FIG.

First, the encoded base layer video is input to the base layer video decoder 31 (101), and reconstructed (102) through a decoding process. At this time, the reconstructed base layer video is input to the video player 33 and played back (104), and then displayed on the video display 34 (105).

Meanwhile, the encoded enhancement layer video is selectively input. Without this information, the video decoding apparatus plays only base layer video.

However, the encoded enhancement layer video is input to the enhancement layer video decoder 32 (101) and reconstructed through a decoding process (103). At this time, the enhancement layer video decoder 32 reconstructs the enhancement layer video by referring to the decoding result of the base layer video decoder 31. In this case, the video player 33 plays back and synthesizes the base layer video decoded by the base layer video decoder 31 and the enhancement layer video decoded by the enhancement layer video decoder 32 (104). Displayed on the indicator 34 (105).

4 is an exemplary diagram illustrating an enhancement layer prediction encoding process among video encoding methods according to the present invention.

The base layer video 401 is encoded using a frame-based encoding scheme of MPEG-4.

The base layer video frame 404 is intra encoded, and the base layer video frame 403 is motion compensated encoded with reference to the intra base layer video frame 404.

The enhancement layer video frame 406 is a frame in synchronization with the base layer video frame 404 and is motion compensated encoded by referring to an encoded frame of the intra base layer video frame 404 that is already encoded.

The enhancement layer video frame 405 is a frame synchronized with the base layer video frame 403 and is motion compensated encoded by referring to the base layer video frames 403 and 404 and the enhancement layer video frame 406 that are already encoded.

In this case, the encoding of the frames 405 and 406 of the enhancement layer video 402 is performed by performing motion compensation on the optimal motion vectors in the reference frames in units of macroblocks (see 501 of FIG. 5).

If the image is not filled in the N × M size macroblock 501, the padding technique of the MPEG-4 object-based encoding technique is used.

FIG. 6 is a detailed block diagram of an embodiment of the enhancement layer encoder of FIG. 2 according to the present invention, in which “61” is a macroblock splitter, “62” is a motion estimator, “63” is a motion compensator, and “64” Denotes a motion vector encoder, and " 65 " denotes an error signal encoder.

As shown in FIG. 6, the enhancement layer video encoder 23 includes a macroblock divider 61 and a macroblock divider 61 for dividing an enhancement layer video frame into macroblock units. For each macroblock divided by), the motion estimator 62 for estimating the motion vector with reference to the encoded frame of the base layer video encoder 22 and the motion vector information sent from the motion estimator 62 are used. A motion compensator 63 for compensating motion (compensating an error signal), a motion vector encoder 64 for encoding motion vector and macroblock header information, and an error signal encoder 65 for encoding an error signal. It includes.

An operation of the enhancement layer video encoder 23 having the above configuration will be described with reference to FIG. 9.

First, one enhancement layer video frame is divided by a macroblock divider 61 into macroblock units as shown in FIG. 5 (901), and encoded in macroblock units in a raster scan order.

The encoding of the macroblock takes a similar method to that of the MPEG-4 macroblock coding.

Then, for each macroblock, the motion estimator 62 obtains the optimal motion vector in the reference frames (902), and the motion compensator 63 obtains an error signal (903).

Next, the motion vector encoder 64 encodes macroblock header information including a motion vector, and the error signal encoder 65 processes a discrete cosine transform (DCT), quantization, entropy encoding, and the like. The encoding is performed through to generate an enhancement layer video bitstream. The structure of this enhancement layer video bitstream is shown in FIG.

As shown in FIG. 7, the enhancement layer video sequence 701 is composed of sequence header information 702 and encoded frames 703.

One frame 703 or 704 is composed of frame header information 705 and an encoded macroblock 706.

One macroblock 706 is composed of macroblock header information 707 and encoded macroblock information 708. Each header information includes information necessary for decoding.

The method of the present invention as described above may be implemented as a program and stored in a computer-readable recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.).

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

As described above, the present invention encodes the video information of a part of the entire screen of the input video into a base layer and encodes the remaining space into an enhancement layer, and basically the user's preference, selection, terminal performance, communication network capacity, etc. It is possible to achieve the scalability of the screen space of the video by transmitting, storing, and playing the video of the layer-coded space, and selectively transmitting, storing, and playing the information of the enhancement layer, thereby enabling various video services. have.

Claims (15)

In the video encoding device, Moving picture screen dividing means for dividing a central part of a moving picture screen into a base layer and dividing the remaining part except the center part into an enhancement layer; Base layer video encoding means for intra encoding the base layer video divided by the video screen division means; And Enhancement layer video encoding means for motion compensation encoding the enhancement layer video partitioned by the video screen partitioning means with reference to the frame encoded by the base layer video encoding means Flexible video encoding apparatus based on image segmentation comprising a. In the video decoding apparatus, Base layer video decoding means for reconstructing the base layer video by decoding the base layer video having the center portion of the video screen intra-coded; Enhancement layer video decoding means for decoding an enhancement layer video including motion compensation encoding of image information of the remaining space excluding a central portion of the video screen based on a decoding result of the base layer video decoding means; The base layer video decoded by the base layer video decoding means is reproduced and transmitted to the video display means, or the base layer video decoded by the base layer video decoding means and the enhancement layer video decoded by the enhancement layer video decoding means. Moving picture reproducing means for reproducing and synthesizing and delivering the synthesized picture to the moving picture display means; And The video display means for outputting the video received from the video playback means Elastic video decoding apparatus based on image segmentation comprising a. delete delete delete delete delete delete delete delete delete delete delete delete delete

Images