KR20060083052A - Device and method for merging different video codec - Google Patents

Abstract

The present invention relates to a video integrated codec device and method. The integrated codec device according to the present invention comprises a PD function group for extracting and classifying contextual information, control signals, and data in an input bitstream according to different codec-specific grammars; An MB function group integrated based on a block-based processing unit of each codec to perform decoding on data output from the PD function group; And a GCU (Global Control Unit) for controlling MB function groups classified based on the processing unit after processing the control signals and the context information received from the PD function group corresponding to each codec. Thus, the present invention can suggest new integrated codec concepts and structures that meet the commonalities, differences and considerations between different video codecs.

Integrated Codec, VCTR, MPEG, AVC, VIDEO, Functional Unit, GCU

Description

Device and method for merging different video codec             

1 is a diagram showing a processing method of an integrated codec according to the prior art.

2 is a view showing the structure of an integrated codec according to the prior art.

3 is a diagram showing the structure of an integrated codec according to an embodiment of the present invention.

4 is a view showing the flow and processing of data between another PD function group and the GCU in an embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

200: Parsing and entropy decoding function

210: Data-reordering function

220: Inverse scan function

230: Inverse DC / AC prediction function

240: Inverse Quantization function

250: Inverse Transform function                 

260: Inverse Intra-prediction function

270: Memory for Decoded Sample function

280: Deblocking-Filter function

310: Parsing and Decoding Functional Group

320: MB functional group (MacroBlock-Based Functional Group)

330: Global Control Unit (GCU)

343: Variable length decoding (VLD) function

346: Run Length Decoding (RDL) function

349: MBG (Macro-Block Generator) function

353: DCR (DC Reconstruction) function

356: IS (Inverse Scan) function

359: Inverse AC Prediction (IAP) function

363: Inverse Quantization (IQ) function

366: IT (Inverse Transform) function

The present invention relates to a video integrated codec device and method, and more particularly, to functional units (FU) and macro blocks (MB) for parsing and entropy decoding. The present invention relates to a method and apparatus for efficiently integrating video codecs such as MPEG-2, MPEG-4, and H.264 by designing them into a set of functional units in charge of the base processing.

In general, video codecs have a similar structure, but the details of processing according to each structure are different, and due to such differences, there are many difficulties in implementing an integrated codec.

1 shows a method of processing an integrated codec according to the prior art. FIG. 1 is a diagram illustrating an operation principle of a general intra-only integrated codec, and is a processing method configured based on MPEG-2, MPEG-4, and AVC Intra coding.

Referring to FIG. 1, a parsing and entropy decoding step (S100), a data-reordering step (S110), an inverse scan step (S120), an inverse DC / AC prediction step (S130), and an inverse function based on a temporal order. Quantization step (S140), Inverse Transform step (S150), Inverse Intra-Prediction step (S160), Memory for Decoded Samples step (S170), Deblocking-Filter step (S180). As described above, according to the related art, since it is simply classified according to a function or a processing order, and is configured to process in detail according to a codec at each step, there is a problem that a considerable number of overlapping processing steps are included.

In addition, in order to integrate the video codec, a clear distinction between the common part and the independent part is to be premised.However, in the case of based on the configuration of the integrated codec as applied in the prior art, the common points and differences of the video codecs of different methods are determined. There are many difficulties to divide.

In addition, there is no proposed integrated codec other than the structure of the integrated codec according to the above-described embodiment, there is a problem that can be implemented using the above structure to implement the integrated codec.

Accordingly, the present invention has been made to solve the above problems, by providing a new integrated codec concept and structure that meets the commonalities, differences and considerations between different video codecs, MPEG-2, MPEG-4, H.264, etc. It is an object of the present invention to provide a method and apparatus capable of integrating the same video codec.

In addition, another object of the present invention is to provide a video integrated codec device and method that enables integration between different codecs without changing the function of the block-based video codec.

In addition, another object of the present invention is to provide a video integrated codec apparatus and method capable of effective integrated codec by dividing common parts between different codecs by functional unit (FU: Functional Unit).

Another object of the present invention is to provide an integrated codec structure including a set of functional units performing a parsing and entropy decoding function and a set of functional units based on macroblock-based processing.

In addition, another object of the present invention is to provide an integrated codec structure that can be used in the integration of video and still image codecs that process block units other than MPEG-2, MPEG-4, AVC.

In addition, another object of the present invention is to international standardization of the concept and structure of the integration of the video codec, and the other objects of the present invention will become more apparent through the preferred embodiment described below.

According to the first aspect of the present invention to achieve the above object, it is possible to provide an integrated codec device that can perform integration between different codecs without changing the function of the block-based video codec.

According to a preferred embodiment, the integrated codec device includes: a PD function group (Parsing and Decoding Functional Group) for extracting and classifying context information, control signals, and data in input bitstreams according to different codec-specific grammars; An MB function group (MacroBlock-Based Functional Group) integrated based on a block-based processing unit of each codec to perform decoding on data output from the PD function group; And a Global Control (GCU) for controlling MB function groups classified based on the processing unit after processing the control signals and context information received from the PD function group corresponding to each codec. Unit) is characterized in that it comprises. Here, the plurality of functional units included in the PD functional group may be implemented as one PFU functional unit with a part having less commonality between different codecs. In addition, by extending to the function of the global control unit (GCU) it can be implemented to include the functions of the PD function group in the GCU.

The control signal is information indicating whether to execute a function of an arbitrary function unit included in the MB function group, and the context information is additional information necessary for executing a function of the function unit.

The control signal includes at least one of an AC prediction mode flag, a coded block pattern (CBP), a quantization scale value, a data partition flag, a size of an image, and a short video header flag. It is characterized by including any one.

The context information may be information including information necessary for execution of the function when the execution of any function is instructed by the control information.

The GCU may process the control signal and the context information and transmit the processed signal to each functional unit included in the MB functional group.

According to the second aspect of the present invention to achieve the above object, it is possible to provide an integrated codec method that can perform integration between different codecs without changing the function of the block-based video codec.

According to a preferred embodiment, the integrated codec method comprises the steps of: Parsing and Decoding Functional Group (PD) receiving a bitstream to extract and classify context information, control signals and data according to different codecs for each codec; Performing a decoding on data output from the PD function group by an integrated MB function group (MacroBlock-Based Functional Group) based on block-based processing units of each codec; And processing a control signal received from the PD function group and context information corresponding to each codec by a global control unit (GCU), and then classifying the MB function group classified based on the processing unit. Controlling decoding.

The control signal may be information indicating whether to execute a function of an arbitrary function unit included in the MB function group, and the context information may be additional information required to execute a function of the function unit.

The GCU may process the control signal and the context information and transmit the processed signal to each functional unit included in the MB functional group.

Hereinafter, preferred embodiments of the integrated codec method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are identified by the same reference numerals. The numbering and duplicate description thereof will be omitted.

Overall structure of the integrated codec

2 is a diagram illustrating a structure of an integrated codec according to the prior art, and FIG. 3 is a diagram illustrating a structure of an integrated codec according to a preferred embodiment of the present invention.

Referring to FIG. 2, which illustrates the structure of a conventional integrated codec, the integrated codec device may include a parsing and entropy decoding function unit 200, a data-reordering function unit 210, an inverse scan function unit 220, and an inverse DC / AC prediction. Function unit 230, Inverse Quantization function 240, Inverse Transform function 250, Inverse Intra-prediction function 260, Memory for Decoded Sample function 270, Deblocking-Filter function 280 It is configured to include.

On the other hand, referring to Figure 3, the structure of the integrated codec according to the present invention, the integrated codec device according to the present invention is a set of functional units (FU: Function Unit) for performing the parsing and decoding function (PD FUs-hereinafter, 'PD Function Group' (310), a set of functional units processed based on Macro-Block (MB) (MB-Based FUs-hereinafter referred to as 'MB Function Group') 320 ) And the global control unit (GCU) 330.

In addition, as shown in FIG. 3, each functional group may include a plurality of functional units.

First, the PD function group 310 performs a function of extracting and classifying context information, control signals, and data according to different CODEC-specific grammars from an input bitstream, and a variable length decoding (VLD) function unit 343. ), A Run Length Decoding (RLD) function unit 346, and a Macro-Block Generator (MBG) function unit 349. In FIG. 3, the PD function group 310 is illustrated as including a plurality of functional units for convenience of description and understanding, but it is obvious that the functional units may be integrated into one functional unit.                     

The VLD function unit 343 receives a bitstream, and includes header information (ie, context information, control signals, etc.) and data (eg, a compressed image used when playing an image) included in the input bitstream. Extract and classify data). In general, the VLD function unit 343 may extract and restore the context information and the control signal directly from the header information. However, in some cases, the control signal and the context information may be processed by using the flag and additional information included in the header information in the input bitstream. Here, the control signal (Control Signal) is information indicating whether or not to execute the function of each functional unit, such as whether AC prediction, data partition use, etc., the context information (Context information) is the execution of the indicated function corresponding to the control signal Is additional information attached to the In addition, the VLD function unit 343 decodes the DC information and the AC information of the data information and transmits the DC information to the RLD function unit 346.

The RLD function unit 346 performs run-length decoding on AC coefficients among data information input from the VLD function unit 343.

The MBG function unit 349 may process information input from the RLD function unit 346 (that is, DC information and AC information processed by the RLD function unit 346) in macroblock units (eg, 16 × 16). Macroblock) to the MB function group 320.

Next, the MB function group 320 is an integrated component based on the block-based processing unit of each codec in order to decode the data output from the PD function group 310, and a DCR (DC Reconstruction) function. 353, Inverse Scan (IS) function unit 356, Inverse AC Prediction (IAP) function unit 359, Inverse Quantization (IQ) function unit 363, Inverse Transform (IT) function unit 366 It may include.

The DCR function unit 353 performs inverse DC prediction and inverse quantization on the previously decoded predictive-coded DC information values to perform the IAP function unit 359 to store the DC coefficient values. To save to.

The IS function unit 356 combines the order of the quantized AC coefficients, and the IAP function unit 359 performs the function of returning the AC predictive coded value to the quantized value by performing inverse AC prediction. . The IQ function 363 performs an inverse quantization function, and the IT function 366 performs inverse conversion of DC and AC value data.

Hereinafter, for convenience of description, the function of the components according to the present invention will be described in detail in comparison with the configuration of the prior art.

Structure of integrated codec according to the prior art

First, referring to Figure 2, the structure of the integrated codec according to the prior art will be described.

The parsing and entropy decoding function unit 200 receives the video bitstream and parses it for each context to perform entropy decoding. This is a common process of the above video codec and is the most important part. However, according to the prior art, it is simply configured to only parse and entropy decode.

The data-reordering function unit 210 is a means for reconstructing ordered image information according to whether to perform a data partition function during encoding. Since the ordering method for each codec is different, it is designed individually according to each codec.

The inverse scan function 220 is a means for outputting a value in reverse of the order of scanning in various ways during encoding. There is a part that defines the scan direction according to the distribution of frequency band values before quantization or transformation. Generally, zig-zag scan method is used, but there are several scan methods for each codec.

The inverse DC / AC prediction function 230 is a part used in the MPEG-4 codec. It is a technology to increase the compression efficiency by predicting the directionality of images by using the distribution of DCT coefficients in the frequency band.

The inverse quantization function unit 240 is a part for returning the DC and AC coefficients by using a quantization parameter (QP) specified during encoding.

The inverse transform function unit 250 is an opposite part of a transform process for transferring image information to a frequency band for processing. This is the process of inverting the DC and AC coefficients from the previous Inverse Quantization function to obtain the actual pixel values. That is, it means that the value of the frequency band is converted into a domain value.

Inverse Intra-prediction function unit 260 is a technology used in AVC when Intra coding. It predicts the current block by using the information of the reconstructed neighboring block and returns the compressed value to the previous value. The memory for decoded sample function unit 270 is a part for restoring values of neighboring blocks to perform a prediction function.

The deblocking-filter function 280 eliminates the blocking phenomenon. This is to reduce the blocking phenomenon that can occur in the video codec that is characterized by the block unit processing.

Structure of Integrated Codec According to the Present Invention

As shown in FIG. 3, the integrated codec according to the present invention has a PD function group (Parsing and Decoding FUs, 310), MB function group (MB-Based FUs, 320), and the like. It consists of a Global Control Unit (GCU). The plurality of functional units included in the PD functional group may be implemented as one PFU (Parsing Functional Unit) functional unit with a part having little in common between different codecs. In addition, the PD can be implemented to be included in the GCU by extending the function of the Global Control Unit (GCU).

In addition, the above-described functional units have similar functions to those of the components 210 to 280 divided by the functions of the conventional integrated codec, but the PD function group 310 and the MB function group 320 divided based on the processing basis. And the roles are clearly divided by the GCU 330.

In addition, in the structure of the integrated codec according to the present invention, inserting, modifying, and deleting each functional part in the process of integrating different codecs in the future has an easy advantage compared with the conventional technology.

Hereinafter, the functions of the components according to the present invention will be described in detail with reference to FIG. 3 in comparison with the configurations of the prior art.

Parsing and Decoding Functional Group

The conventional parsing and entropy decoding function 200 is configured to simply perform parsing and entropy decoding in a sequential structure. On the other hand, the PD function group 310 according to the present invention, such as the VLD function 343, RLD function 346, MBG function 349, each of the processing of the information of parsing, entropy decoding, macroblock size It is extended to a set of functional units and is functionally and structurally separated from the MB function group 320 which processes subsequent processes.

The PD function group 310 according to the present invention extracts information according to different codecs for different codecs, calculates a value to be actually processed for each Entropy coder, generates control signals and context information, and generates a GCU 330. To pass). The PD function group 310 is the most basic part in the production of integrated codecs. By sharing and unifying the grammar between different codecs, it is possible to reduce unnecessary duplication of information in the MD function group 320 and to efficiently block-based processing. To do this.

In addition, the PD function group 310 may not be divided into a plurality of functional units as described above, but may be implemented as a PFU (PFU: Parsing Function Unit) functional unit capable of integrally performing the functions of the respective functional groups.

The MB function group 320 processes a general video codec based on a 16x16 macroblock based on control signals and grammar information generated by the PD function group 310. Of course, in some cases, the MB function group 320 may process decoding on a block basis of NxN or NxM units.

MB Functional Group (MacroBlock-Based Functional Group)

The MB function group 320 includes a data-reordering function unit 210, an inverse scan function unit 220, an inverse DC / AC prediction function unit 230, and an inverse quantization function unit 240 in an integrated codec structure according to the related art. , The inverse transform function unit 250, the inverse intra-prediction function unit 260, the memory for decoded sample function unit 270, and the deblocking-filter function unit 280. However, the processing methods of both are different.

Unlike the prior art, which implements the convenience of the system design as a priority, the present invention is classified by function and processing unit, so that the independence of each functional part is ensured to the maximum when the actual integrated codec is manufactured, so that the modification of the existing functional parts, The addition of new functions can be facilitated.

According to the prior art, even though the functions are similar, the components must be separately provided for different codecs, but according to the present invention, by combining different codecs into one codec, one function of the MB function group is not provided with similar functions. It can be implemented through wealth.

In addition, the MB function group 320 includes a DCR function unit 353, an IS function unit 356, an IAP function unit 359, an IQ function unit 363, and an IT function unit 366 as shown in FIG. 3. In the future, when the integration of different codecs, it is easy to insert, add or modify, and delete from the MB function group 320 with respect to the macro block unit functions in the unit of functions.

In addition, according to the related art, since the Inverse Intra-prediction function unit 260 is used only in the AVC codec, when the integrated codec is implemented, the above function may be separately configured to be implemented by adding one function unit to the MB function group. It has an advantage.

According to the concept of the MB function group 320 according to the present invention, by classifying each functional unit by the function, further increase the common functional part from step S110 to step S180 of FIG. 1 according to the prior art to modify the processing efficiency and future codecs However, the ease of adding new codecs can be doubled.

Global Control Unit (GCU)

According to the prior art, it is configured to process the information of the codec in each step or component divided by function.

On the other hand, in the present invention, a separate GCU 330 is configured to control the MB function group 320 by using the context information and the control signal processed by the PD function unit 310.

The GCU 330 according to the present invention performs a function of processing a control signal received from the PD function group 310 and context information, and the MB function by using the processed control signal. The group 320 is controlled.

Operation procedure of the present invention

4 is a view showing the flow and processing of data between the PD function group 310 and the GCU 330 according to an embodiment of the present invention. That is, FIG. 4 illustrates the flow and processing of data between the PD function group 310 and the GCU 330 to receive the encoded bitstream and process the macroblock.

According to an embodiment, the detailed control signal and context information 410 of FIG. 4 may include an image size, a coded block pattern (CBP), a quantization scale, a data partition, a short video header, an AC prediction flag, and an intra. And VLC thresholds.

The VLD function unit 343 converts a part of the bitstream (for example, some header information) into a detailed control signal and context information and transmits the same to the GCU 330, and the DC coefficients 420 which are data information of the bitstream. And AC coefficients symbols 430 to the RLD function 346.

The RLD function unit 346 converts an AC symbol value among the data information 420 and 430 received from the VLD function unit 343 into meaningful information, and transmits it to the MBG function unit 349. The MBG function unit 349 DC and AC data information is transmitted to the MB function group 320 in macroblock units.

So far, the method and apparatus of the integrated video codec according to the present invention have been described based on MPEG-2, MPEG-4, and AVC. In addition, the concept of the integrated video and still image codec having block-based processing is the same without any limitation. Naturally, it can be applied.

As described above, the video integrated codec apparatus and method according to the present invention provides a new integrated codec concept and structure corresponding to commonalities, differences, and considerations among different video codecs, thereby providing MPEG-2, MPEG-4, H.264 (AVC). Video codecs, etc.). That is, the present invention breaks away from the convenience-oriented structure of each conventional codec implementation, classifies the processing base according to the function, and applies the concept of PD function group (Parsing and Decoding Functional Group) and MB function group (MacroBlock-Based Functional Group). Introduced, GCU (Global Control Unit) can be used to minimize unnecessary or redundant parts.

In addition, the present invention enables integration between different codecs without changing the function of the block-based video codec.

In addition, the present invention enables effective integrated codecs by dividing common parts between different codecs by functional units (FU).

In addition, the present invention may provide an integrated codec structure including a set of functional units performing a parsing and decoding function and a function unit based on processing in a macroblock unit.

In addition, the present invention can be equally applied without any limitation when integrating a moving picture or still picture codec that processes blocks in units other than MPEG-2, MPEG-4, and AVC.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

Claims (9)

A PD function group (Parsing and Decoding Functional Group) for extracting and classifying context information, control signals and data in input bitstreams according to different grammars for different codecs; An MB function group (MacroBlock-Based Functional Group) integrated based on a block-based processing unit of each codec to perform decoding on data output from the PD function group; And Global Control Unit (GCU) for controlling MB function groups classified based on the processing unit after processing control signals and context information received from the PD function group corresponding to each codec Integrated codec device comprising a). The method of claim 1, And the control signal is information indicating whether to execute a function of an arbitrary function unit included in the MB function group, and the context information is additional information required to execute a function of the function unit. The method of claim 2, The control signal includes at least one of an AC prediction mode flag, a coded block pattern (CBP), a quantization scale value, a data partition flag, a size of an image, and a short video header flag. An integrated codec device comprising any one. The method of claim 2, And the context information is information including information necessary for executing the function when the execution of any function is instructed by the control information. The method of claim 2, And the GCU processes the control signal and the context information and transmits the control signal and the context information to each function unit included in the MB function group. The method of claim 1, The PD function group is integrated codec method, characterized in that included as one component of the GCU Parsing and Decoding Functional Group (PD) receives the bitstream to extract and classify the context information, control signals and data according to different codecs for each codec; Performing a decoding on data output from the PD functional group by an integrated MB functional group based on block-based processing units of each codec; And After processing by the GCU (Global Control Unit) control signals (Context Signal) and context information (Context information) received from the PD functional group corresponding to each codec, decoding the MB functional group classified based on the processing unit Integrated codec method comprising the step of controlling. The method of claim 7, wherein And the control signal is information indicating whether to execute a function of an arbitrary function unit included in the MB function group, and the context information is additional information required to execute a function of the function unit. The method of claim 7, wherein And the GCU processes and transmits the control signal and the context information to each functional unit included in the MB functional group.

Images