KR20080090231A - Bitstream decoding device and method having decoding solution - Google Patents

Abstract

A bitstream decoding apparatus having a decoding solution and a bitstream decoding method are provided to manage scheduling of each CODEC and organically process functional units using decoder description and allow components used to decode bitstreams to use analyzed syntax element information. A bitstream decoding apparatus includes a decoder forming unit(420), a tool-box(415), a decoding solution(430), and a description decoder(405). The decoder forming unit generates CSCI(Control Signal/Context Information) control information and connection control information using partial decoder descriptions stored in a description storage unit. The tool-box includes multiple functional units which respectively execute predetermined processes. The decoding solution loads the functional units based on hierarchy using the CSCI control information and the connection control information to decode bitstreams into moving image data. The description decoder decodes encoded decode description inputted thereto to generate decoder description and stores a plurality of partial decoder descriptions separated from the decoder description in the description storage unit.

Description

Bitstream decoding device and method having decoding solution

1 is a diagram schematically showing a configuration of a general decoder.

2 is a diagram schematically illustrating a configuration of a general encoder.

3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention.

4 is a diagram schematically showing a configuration of a decoding processing unit according to an embodiment of the present invention.

5 is a diagram schematically showing a configuration of a decoding processing unit according to another embodiment of the present invention.

FIG. 6 is a diagram briefly illustrating a configuration of an extended bit-stream according to an embodiment of the present invention. FIG.

7 is a diagram illustrating types of functional units for syntax parsing according to an embodiment of the present invention.

8 illustrates types of functional units for performing decoding processing according to an embodiment of the present invention.

FIG. 9 illustrates a hierarchical structure defined by a decoding hierarchy table (DHT) according to an embodiment of the present invention. FIG.

FIG. 10 illustrates an inter-layer calling structure and an intra-layer connection structure defined by a Syntax Rule Table (S-RT) according to an embodiment of the present invention. FIG.

FIG. 11 is a diagram for explaining an interface set for a functional unit applied to a plurality of standards according to an embodiment of the present invention. FIG.

12 is a diagram illustrating a connection structure of dedicated buffer spaces between nodes of each layer according to an embodiment of the present invention.

FIG. 13 is a view illustrating a inclusion relationship of a dedicated buffer space for storing CSCI data according to an embodiment of the present invention. FIG.

FIG. 14 is a view illustrating a inclusion relationship of a dedicated buffer space for storing output data by a functional unit according to an embodiment of the present invention; FIG.

FIG. 15 conceptually illustrates parallel processing of syntax parsing and data decoding according to an embodiment of the present invention. FIG.

16 is a diagram showing the configuration of an extended bitstream according to the first embodiment of the present invention;

17 is a diagram showing the configuration of an extended bitstream according to the second embodiment of the present invention.

18 is a diagram showing the configuration of an extended bitstream according to the third embodiment of the present invention.

19 is a diagram showing the configuration of an extended bitstream according to the fourth embodiment of the present invention.

20 is a diagram showing the configuration of an extended bitstream according to the fifth embodiment of the present invention;

21 is a diagram showing the configuration of an extended bitstream according to the sixth embodiment of the present invention.

22 is a diagram showing the configuration of an extended bitstream according to the seventh embodiment of the present invention.

23 is a diagram showing the configuration of an extended bitstream according to an eighth embodiment of the present invention;

24 is a block diagram of an encoder according to an embodiment of the present invention.

The present invention relates to encoding / decoding of video data, and more particularly, to a bitstream decoding apparatus and method having a decoding solution.

In general, a video is converted into a bitstream form by an encoder. In this case, the bitstream is stored according to an encoding type satisfying the constraint of the encoder.

MPEG requires syntax (hereinafter referred to as 'syntax') and semantics (hereinafter referred to as 'semantics') as constraints of the bitstream.

syntax indicates the structure, format, and length of the data, and in what order the data is represented. That is, syntax is to fit a grammar for encoding / decoding, and defines the order of each element included in the bitstream, the length of each element, and the data format.

Semantics means what each bit of data means. That is, semantics indicates what the meaning of each element in the bitstream is.

Therefore, various types of bitstreams may be generated according to encoding conditions of an encoder or an applied standard (or codec). In general, each standard (eg MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) has a different bitstream syntax.

Accordingly, bitstreams encoded according to each standard or encoding condition may have different formats (ie, syntax and semantics), and a decoder corresponding to an encoder should be used to decode the bitstream.

As described above, the conventional bitstream decoder has a limitation of satisfying the constraints of the encoder, and this limitation causes a difficulty in implementing an integrated decoder corresponding to a plurality of standards.

Accordingly, the present invention is to solve the above-described problem, and is encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) It is an object of the present invention to provide a bitstream decoding method and apparatus capable of decoding a bitstream in the same information recognition scheme.

According to the present invention, an extended bitstream including a decoder description or a decoder description can be generated to decode a bitstream encoded in various formats (syntax, semantics) according to each standard in the same information recognition method. It is an object of the present invention to provide a bitstream encoding method and apparatus for independently generating a decoder description.

The present invention provides a bitstream decoding in which a bitstream compressed by various encoding methods is parsed by the same information analysis method, and each functional unit (FU) for organic decoding is organically controlled using the parsed data. To provide a method and apparatus.

An object of the present invention is to provide a method and apparatus for encoding a bitstream, by which a decoder description can be described more efficiently by applying a hierarchical structure of a codec to a syntax parsing and decoding process.

The present invention can propose scheduling management of each codec and organic processing structures (eg, parallel combining structure, serial merging structure, independent processing structure, individual processing structure, etc.) by using the decoder description. To provide a bitstream decoding method and apparatus.

The present invention is to provide a method and apparatus for encoding a bitstream capable of designing and constructing various systems using only the described decoder description or layer information.

The present invention provides a method and apparatus for encoding / decoding a bitstream to which a syntax interpretation method for decoding various types of bitstreams can be commonly applied.

The present invention provides a bitstream encoding / decoding method and apparatus capable of applying a new set of instructions for parsing various types of bitstreams using a common syntax analysis method.

The present invention provides a method and apparatus for decoding a bitstream in which a decoder can easily decode a bitstream even when a syntax element is changed, added, or deleted.

An object of the present invention is to provide a method and apparatus for decoding a bitstream which enables element information of the parsed syntax (ie, the result of syntax parsing) to be used by components used for bitstream decoding.

The present invention is to provide a method and apparatus for decoding a bitstream which makes it possible to use element information of an already parsed syntax for interpretation of subsequent bitstream syntax elements.

The present invention divides functions included in various decoding processes proposed by various standards (codecs) into functional units (FUs), and provides a bitstream decoding method and apparatus provided in a tool box. will be.

An object of the present invention is to provide a method and apparatus for decoding a bitstream selectively using only functional units required by a toolbox to decode a bitstream encoded in various forms.

The present invention is to provide a method and apparatus for decoding a bitstream that is easy to change, add, or delete a functional part stored in a toolbox.

The present invention also aims to achieve international standardization of codec integration for bitstream decoding, generation of decoder descriptions for allowing bitstreams to be processed by the same information analysis method, and implementation of extended bitstreams. The objects of the invention will become more apparent through the embodiments described below.

According to an aspect of the present invention to achieve the above object, there is provided a decoder and / or integrated codec device that can be used universally in various standards.

In accordance with another aspect of the present invention, a decoding apparatus includes: a decoder forming unit configured to generate and output CSCI control information and connection control information using partial decoder descriptions stored in a description storage unit; A tool box including a plurality of functional units implemented to perform a predetermined process, respectively; And a decoding solution that loads a plurality of functional units included in the toolbox in units of layers by using the syntax parsing control information and the connection control information to decode the bitstream into video data.

The decoding apparatus may further include a description decoder that decodes an input encoded decoder description to generate a decoder description and stores a plurality of partial decoder descriptions separated from the decoder description in the description storage unit.

The toolbox may include one or more parsing functions for parsing the syntax of the bitstream and a plurality of decoding functions for decoding the bitstream.

The decoder forming unit may include: an FU checking unit that determines whether a plurality of functional units described in an arbitrary partial decoder description are provided in the tool box; And an information processor for generating the syntax parsing control information and the connection control information using the partial decoder descriptions.

The decoding solution may include a control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units. ; And a connection controller configured to control an operation of each functional unit through selective loading of a plurality of functional units by referring to the syntax parsing control information and the connection control information.

The decoding solution may include a control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units. ; At least one parsing function for parsing the bitstream according to the syntax parsing control information; And a connection controller for controlling the operation of each functional unit through selective loading of a plurality of functional units with reference to the connection control information. Here, the toolbox may be provided with a plurality of decoding functions for decoding the bitstream.

The decoding solution may comprise a working memory for causing one or more functional units to be loaded and operated.

When the encoded decoder description and the bitstream are input as a unified integrated bitstream, the decoding apparatus may further include a separation unit for separating and outputting the encoded decoder description and the bitstream.

When the encoded video data is encoded by a plurality of standards, the decoding solution sequentially loads a plurality of functional units performing a process according to a plurality of standards with reference to the connection control information to generate and output the video data. can do.

The connection control information includes information about a layer of functional units, and the decoding solution may make an inter-layer call to one or more functional units with reference to the information.

The decoding solution controls object generation and execution for the top layer, and the caller for the function part included in the top layer by the object execution and the call of the layer designated by the layer information can be loaded.

The caller may load the corresponding layer if one or more functional units belonging to the correspondingly designated layer are stored in the storage unit to process data necessary for performing a predetermined process.

The loaded functional unit may start processing when processing data for performing a designated process is stored in the storage unit.

Result data by the process of each functional unit can be stored in the storage unit.

The hierarchical structure recognized by the information about the layer is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and a lower layer may be called by an upper layer.

Dedicated storage space for each of the decoding functions may be allocated in the storage.

The storage unit may include a CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function unit; And a data storage unit for storing data corresponding to the encoded video data generated by the parsing unit and data for decoding processing, which is one or more of processing data processed by the decoding unit.

The partial decoder descriptions stored in the description storage unit may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data and information on a lower layer of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. A DVT (Default Value Table) indicating a relationship between actual values and code values during entropy coding may be further stored in the description storage unit as a partial decoder description.

The syntax parsing control information may be generated with reference to one or more of the SET, the S-RT, the DHT, the CSCIT, and the DVT.

The connection control information may be generated with reference to one or more of the FL, the F-RT, the DHT, and the FU-CSCIT.

The decoder description may consist of one or more division regions, and information for configuring the partial decoder description may be inserted into each division region.

The partial decoder description includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the description decoder is previously described in the description storage unit. Among the plurality of stored partial decoder descriptions, n tables corresponding to the predetermined information may be extracted.

M (arbitrary natural numbers) of the division areas include codec numbers (Codec No.) and corresponding information corresponding to profile and level numbers (Profile and level No.) for corresponding partial decoder descriptions, The k division areas include binary code information for configuring a corresponding partial decoder description, and the description decoder includes m partial decoder descriptions corresponding to the designated information among a plurality of partial decoder descriptions previously stored in the description storage unit. And k tables may be generated using the binary code information and stored in the description storage unit.

According to another aspect of the present invention for achieving the above object, there is provided a decoding method that can be used universally in various standards and / or a recording medium on which a program for executing the method is recorded.

According to an embodiment of the present invention, a decoding method includes: (a) generating and storing a plurality of partial decoder descriptions corresponding to an input decoder description; (b) generating CSCI control information and connection control information using the partial decoder descriptions; (c) storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And (d) decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information.

The step (c) and the step (d) refer to the CSCI control information or the connection control information by the connection control unit loaded in a hierarchical unit among a plurality of functional units provided in the tool box (Tool-Box) Can be executed respectively.

Step (d) may be repeatedly performed until a result of the process of the plurality of functional units started by selective loading of the connection controller becomes the video data.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

The result data of the preceding functional unit among the plurality of functional units loaded in hierarchical units may be recorded in a buffer memory accessible by the subsequent functional unit.

The connection control unit may provide result data of a preceding functional unit among the plurality of sequentially loaded functional units as input data of a subsequent functional unit.

The partial decoder descriptions stored in the description storage unit may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data and information on a lower layer of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. A DVT (Default Value Table) indicating a relationship between actual values and code values during entropy coding may be further stored in the description storage unit as a partial decoder description.

According to another embodiment of the present invention, a program of instructions that can be executed in a decoding apparatus to perform a decoding method is tangibly implemented, and in a recording medium in which a program that can be read by the decoding apparatus is recorded, Generating and storing a plurality of partial decoder descriptions corresponding to the decoded decoder descriptions; Generating CSCI control information and connection control information using the partial decoder descriptions; Storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term “and / or” includes any combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, embodiments of an integrated codec method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are denoted by the same reference numerals. And duplicate description thereof may be omitted.

FIG. 1 is a diagram schematically showing a configuration of a general decoder, and FIG. 2 is a diagram schematically showing a configuration of a general encoder.

As shown in FIG. 1, the MPEG-4 decoder 100 generally includes a variable length decoding unit 110, an inverse scan unit 115, and an inverse DC / AC prediction unit. / AC Prediction (120), Inverse Quantization (125), Inverse Discrete Cosine Transform (Inverse Discrete Cosine Transformation, 130), and Video Restoration (VOP Reconstruction, 135). Obviously, the configuration of the decoder 100 may be different according to the applicable standard, and some components may be replaced with other components.

When the transmitted bitstream 105 is parsed and parsed to extract header information and encoded video data, the variable length decoding unit 110 quantizes the Huffman table using a pre-stored Huffman Table. The inverse scan unit 115 performs the inverse scan to generate data in the same order as the moving image 140. That is, the inverse scan unit 115 outputs a value in reverse of the order of scanning in various ways during encoding. After quantization is performed during encoding, a scan direction may be defined according to a distribution of frequency band values. In general, a zig-zag scan method is used, but the scan method may vary by codec.

Syntax parsing may be performed integrally in the variable length decoding unit 110 or may be performed in any component that processes the bitstream 105 prior to the variable length decoding unit 110. In this case, since syntax parsing is the same as that of the standard applied to the encoder and the decoding period, the syntax parsing is performed only by a predetermined standard corresponding to the standard.

The inverse DC / AC predictor 120 determines the direction of the reference block for prediction by using the magnitude of the DCT coefficient in the frequency band.

The inverse quantizer 125 inverse quantizes the inversely scanned data. That is, the DC and AC coefficients are reduced by using a quantization parameter (QP) specified during encoding.

The inverse DCT unit 130 generates a video object plane (VOP) by obtaining an actual video pixel value by performing an inverse discrete cosine transform.

The video reconstruction unit 135 reconstructs and outputs a video signal by using the VOP generated by the inverse DCT unit 130.

As shown in FIG. 2, the MPEG-4 encoder 200 generally includes a DCT unit 210, a quantizer 215, a DC / AC predictor 220, a scan unit 230, and a variable length encoder ( 235).

Each component included in the encoder 200 performs the inverse function of each component of the corresponding decoder 100, which is obvious to those skilled in the art. In brief, the encoder 200 performs encoding by converting a video signal (ie, a digital image pixel value) into a frequency value through a discrete cosine transform, quantization, and the like, and then encoding the information. Variable length encoding that differentiates the bit length according to the frequency is performed and output in the compressed bitstream state.

3 is a diagram schematically showing a configuration of a decoder according to an embodiment of the present invention, FIG. 4 is a diagram schematically showing a configuration of a decoding processing unit according to an embodiment of the present invention, and FIG. 5 is a diagram of the present invention. 2 is a diagram schematically illustrating a configuration of a decoding processing unit according to another embodiment. FIG. 6 is a diagram schematically illustrating a configuration of an extended bit-stream according to an embodiment of the present invention, and FIG. 7 illustrates types of functional units for syntax parsing according to an embodiment of the present invention. 8 is a diagram illustrating types of functional units for performing decoding processing according to an embodiment of the present invention. FIG. 9 is a diagram illustrating a hierarchical structure defined by a decoding hierarchy table (DHT) according to an embodiment of the present invention, and FIG. 10 is a syntax rule table (S-RT) according to an embodiment of the present invention. FIG. 11 is a diagram illustrating a defined inter-layer calling structure and an intra-layer connection structure, and FIG. 11 is a view for explaining an interface set for a functional unit applied to a plurality of standards according to an embodiment of the present invention. 12 is a diagram illustrating a connection structure of dedicated buffer spaces between nodes of each layer according to an embodiment of the present invention, and FIG. 13 includes a dedicated buffer space for storing CSCI data according to an embodiment of the present invention. FIG. 14 is a diagram illustrating a relation of inclusion of a dedicated buffer space for storing output data by a functional unit according to an embodiment of the present invention, and FIG. 15 is a syntax according to an embodiment of the present invention. A conceptual diagram illustrating parallel processing of parsing and data decoding.

As shown in FIG. 3, the decoder 300 according to the present invention has a configuration different from that of a conventional decoder (see FIG. 1).

That is, to perform the encoding / decoding method according to the present invention, a decoder description is provided to the decoder 300 together with the bitstream. The decoder description may be provided to the decoder 300 in the form of an extended bitstream 305 integrated with the bitstream, or may be provided to the decoder 500 in the form of independent data. Of course, if hierarchical information corresponding to the decoder description is previously stored in a specific storage unit of the decoder 500, the provision of the decoder description may be omitted. However, hereinafter, the data will be described with reference to a case where the corresponding data is included in the extended bitstream and provided to the decoder 500.

The decoder 300 according to an embodiment of the present invention includes a separator 310 and a decoding processing unit 320. One or more of the components of the decoder 300 shown (eg, the separation unit 310, the decoding processing unit 320 itself, or one or more components included in the decoding processing unit 320, etc.) are described below. It is apparent that the present invention may be implemented as a software program (or a combination of program codes) implemented to perform a function to be described.

The separation unit 310 separates the input extended bitstream 305 into an encoded decoder description 313 and a general bitstream 316 (hereinafter referred to as a conventional bitstream). Input to the decoding processing unit 320, respectively.

The separation unit 310 may input the encoded decoder description 313 to the description decoder 505, and the conventional bitstream 316 may be input to the decoder forming unit 520. As described above, when the encoded decoder description 313 and the conventional bitstream 316 are input as independent data, the separation unit 310 may be omitted. In addition, the conventional bitstream 316 may be data of the same or similar format as the bitstream 105 of FIG. 1.

An example of an extended bitstream 305 is illustrated in FIG. 6. Referring to FIG. 6, the extended bitstream 305 may include a decoder description 313 and a conventional bitstream 316. The examples of the extended bitstream 305 and encoded decoder description 313 of FIG. 6 are for convenience of explanation and understanding only, and the extended bitstream 305 and / or encoded decoder description 313 of the present invention. It is obvious that the form of) is not limited thereto.

The decoder description 314 in which the encoded decoder description 313 is decoded by the description decoder 405 is encoded using a bitstream encoded by various encoding schemes and / or user selected functions among various functions. In order to parse the stream by a common interpretation method, configuration information of the conventional bitstream 316, a method in which the conventional bitstream 316 is encoded (or connection information between functional units), and a specific functional part Information about the I / O data specification. The decoder description 314 may be described in a description manner such as textual description or binary description. Of course, if the encoded decoder description 313 is implemented to be recognized by the decoder forming unit 420 without the processing of the description decoder 405, the description decoder 405 may be omitted.

The encoded decoder description 313 may be decoded by the description decoder 405 into a decoder description 314. Decoder descriptions are Functional Unit List (FL), Functional Unit Rule Table (F-RT) 620, Functional Unit CSCIT (630), Control Signal and Context Information Table (640), and Decoding (DHT). It can be separated into partial decoder descriptions such as Hierarchy Table (650), Syntax Element Table (660), Syntax-Rule Table (670), Default Value Table (DVT), etc. have.

The above-described partial decoder descriptions can be activated as a plurality of functional units included in the decoder 300 according to the present invention corresponding to the hierarchical structure of encoded video data, and used as hierarchical information for performing a predetermined process. In addition, the above-described partial decoder descriptions may be used as operation control information for specifying which input data each function unit performs a specified process, and what name information to store the result data generated as a result of the process execution. It may be. Of course, it is obvious that the operation control information may be included in the layer information.

In addition, as described below, the layer information may be embodied by one or more of the F-RT 620, the DHT 645, the S-RT 660, and the like.

If the encoded video data is composed of hierarchical subordinate structures such as "top layer, next layer,…, next layer and bottom layer", the top layer is first activated by the layer information (i.e., the object of the top layer is Generated and executed), the next-order layers are activated sequentially, and the lowest layer is finally activated. Even if each layer is activated sequentially, decoding of encoded video data may not be completed by sequentially operating functions included in each layer, and in some cases, functions of several layers alternately operate. Decoding of the encoded video data may thereby be completed.

When one layer is activated, all decoding functions included in the object of the layer and one or more callers belonging to the next-order layer included in the object are activated. The decoding functions belonging to the activated layer are started when the CSCI information (Control Signal / Context Information) necessary for performing a predetermined process and data for decoding are stored in the CSCI storage unit 432.

In addition, if the caller of the activated next layer is one or more of the decoding functions of the same layer is stored in the CSCI storage unit 432 CSCI information (Control Signal / Context Information) and data for decoding necessary for performing the process layer It generates and executes an object of, thereby activating all decoding functions included in the object and one or more callers belonging to the next-order layer included in the object. As described above, the lower layer may be called by performing the object of one layer.

Obviously, the order of the partial decoder descriptions for configuring the decoder description 314 may be variously modified.

Wherein FL (Functional unit List, 610), F-RT (Functional unit Rule Table, 620), FU-CSCIT (Functional Unit CSCIT, 630), CSCIT (Control Signal and Context Information Table, 640), DHT (Decoding Hierarchy) Table 650 and the like may be used to set the connection of each functional unit (FU) (the corresponding partial decoder descriptions may be referred to as 'first decoder description' if necessary).

The DHT 650 may be information describing a hierarchical structure of each codec and information on lower layers of each layer (see FIG. 9). The hierarchical structure of each codec may be expressed as a structure between an upper layer and a lower layer. For example, a sequence layer, a GOP layer, a VOP layer, a slice layer, a macroblock (MB) layer, a block layer Each codec may be composed of one or more layers, and each layer may include one or more objects.

For example, the decoding process of encoded video data composed of a plurality of layers will be briefly described as follows. Of course, the method of decoding the bitstream in conformity with the hierarchical structure is not limited thereto.

When performing the decoding process, an object of the highest layer (first layer) is first generated and executed, and then all decoding functions included in the object and one or more lower layer (second layer) callers included in the object are executed. Is activated. Here, the caller may be one component of the connection controller 434 or may mean a control operation of the connection controller 434.

For example, assuming that the hierarchical structure consists of the first layer, the second layer, and the third layer, one or more layers belonging to the second layer by executing the object of the first layer (eg, the sequence layer). One or more layer calling units belonging to the third layer by executing a second layer object of any one of the second layers being activated (e.g., GOP-1 layer, GOP-2 layer, GOP-3 layer) (E.g., Picture-1 layer, Picture-2 layer, Picture-3 layer, Picture-4 layer, etc. when the object of the GOP-1 layer is executed) is activated. Of course, in the activation process by the inter-layer call in the present invention, the upper layer is not necessarily limited to calling only the lower layer, and the upper layer is called by the lower layer if necessary based on the decoder description (or partial decoder description). It can be obvious.

The decoding functions of the activated layer (first layer) are activated when CSCI information (Control Signal / Context Information) necessary for performing a predetermined process and data for decoding are stored in the CSCI storage unit 432.

The lower layer (layer 2) caller of the activated layer (first layer) has CSCI information (Control Signal / Context Information) necessary for performing a process by one or more decoding functions of the layer to which the layer belongs, and the data for decoding is CSCI. When stored in the storage unit 432, an object of the corresponding layer (second layer) is generated and executed, and all decoding functions included in the object and one or more lower layer (third layer) calling units included in the object are executed. Is activated

As described above, a lower layer may be called by performing a layer object, the decoding functions of the called layer perform a predetermined process, and the functional units designated by the decoder description among the functions included in each layer. By this function one or more times, encoded video data is reconstructed and output as moving picture data.

The FU-CSCIT 630 may be partial decoder description information for mapping between each functional unit in the toolbox 415 and element information stored in the CSCI storage unit 432. In this case, the element information may function as a control variable for each functional unit in the toolbox 415.

In addition, CSCIT (Control Signal and Context Information Table, 640), DHT (Decoding Hierarchy Table, 650), SET (Syntax Element Table, 660), S-RT (Syntax-Rule Table, 670), DVT (Default Value Table, 680 and the like may be used for syntax parsing of the conventional bitstream 316 (the corresponding partial decoder descriptions may be referred to as 'second decoder description' if necessary). The form and function of each partial decoder description will be described in detail later.

The description decoder 405 decodes the encoded decoder description 313 input from the separation unit 310 to generate the decoder description 314, and then recognizes it in the decoder forming unit 420 or the decoding solution 430. The partial decoder description may be divided into a plurality of types and may be stored in the description storage unit 410.

Each partial decoder description stored in the description storage 410 does not necessarily need to be a table in a general form, but may be a form of information that can be recognized by the decoder forming unit 420 or the decoding solution 430.

The partial decoder descriptions stored in the description storage unit 410 by the decoder description analysis of the description decoder 405 include FL 610, F-RT 620, FU-CSCIT 630, CSCIT 640, and DHT ( 650, SET 660, S-RT 670, DVT 680, and the like. The description decoder 405 may insert a table identifier (TI) for each partial decoder description information to be distinguished.

Of course, not all partial decoder descriptions must be included in the decoder description, but include a codec number (Codec #) and a profile and level #, or only a partial codec description for a partial decoder description. ) And profile and level # may be included. If the codec number (Codec #) and profile and level # are included, the description decoder 405 stores the description without generating a new partial decoder description for the full partial decoder description or the partial decoder description. One of the partial decoder descriptions previously stored in the unit 410 may be selected to be used in decoding. Of course, if the codec number (Codec #), profile and level # (Profile and level #) and the correction information is included, the description decoder 405 to the corresponding codec of the partial decoder descriptions previously stored in the description storage unit 410 A corresponding partial decoder description may be extracted to generate a new partial decoder description reflecting the correction information. Of course, if the codec number (Codec #) and profile and level # are not included and the decoder description for generating the partial decoder description is included, the description decoder 405 may be the full partial decoder description or the partial decoder. A new partial decoder description may be generated for the description for use in decoding.

In addition, the decoder description may further include revision information in addition to the decoder description DD-T for each partial decoder description.

The description storage 410 stores the partial decoder descriptions separated by the description decoder 405. Of course, the description storage unit 410 may include one or more partial decoder descriptions corresponding to the decoding unit 340 when the extended bitstream 305 includes a codec number and a profile and level number. One or more partial decoder descriptions may be stored in advance to be available by. The configuration of the encoded decoder description 313 for extracting the partial decoder descriptions will be described in detail later with reference to FIGS. 16 to 23.

4 and 5 illustrate each embodiment of a decoding processing unit 320.

Referring to FIG. 4, where a first embodiment of the decoding processing unit 320 is shown, the decoding processing unit 320 may include a description decoder 405, a description storage unit 410, a tool box 415, and a decoder formation. Unit 420 and decoding solution 430.

The decoder forming unit 420 includes an FU confirming unit 422, an information processing unit 424, and an information transmitting unit 426.

If the partial decoder descriptions are stored in the description storage unit 410 by the processing of the description decoder 405, the FU check unit 422 may include the functional units described in the partial decoder description (for example, the FL 610). Check whether all are present in the toolbox 415. If any of the functional units described in the partial decoder description does not exist in the toolbox 415, an error message may be displayed on the display device or the user may be requested to update the functional unit. Of course, when combined with the server device for the update of the functional unit via a communication network FU check unit 422 may execute an automatic update through the communication network.

The information processing unit 424 classifies each of the partial decoder descriptions stored in the description storage unit 410 according to a role, and processes the partial decoder descriptions into data types that the decoding solution 430 can easily operate. This means that the stored format (eg, table format) of the partial decoder descriptions stored in the description storage 410 is not suitable for use by the decoding solution 430 or that the decoding solution 430 may use more efficiently. Information may be needed.

Since the function and format of each partial decoder description will be described in detail later with reference to related drawings, only the processed data form will be briefly described here.

The information processing unit 424 classifies the partial decoder descriptions according to their roles such as whether they are used for generating or storing CSCI (Control Signal / Context Information) or for connecting functional units. After that, the CSCI control information and connection control information are processed. For example, the partial decoder descriptions used to generate CSCI control information may be SET 660, S-RT 670, CSCIT 640 and DVT 680, and may be part for generating connection control information. Decoder descriptions may be FL 610, F-RT 620, DHT 650, S-RT 660 and FU-CSCIT 630.

The CSCI control information and the connection control information processed by the information processing unit 424 may be expressed according to, for example, an XML-based Abstract Decoder Model (ADM) expression method. Of course, it is obvious that the representation of the processed CSCI control information and the connection control information is not limited thereto.

First, CSCI control information may be expressed as follows.

<CSCIs>

    <csci_memory id = "C0" name = "CSCI # 0" type = "integer" />

    <csci_memory id = "C1" name = "CSCI # 1" type = "integer" />

    <csci_memory id = "C2" name = "CSCI # 2" type = "array" />

    <csci_memory id = "C3" name = "CSCI # 3" type = "integer" />

    <csci_memory id = "C4" name = "CSCI # 4" type = "integer" />

    <csci_memory id = "C5" name = "CSCI # 5" type = "integer" />

    <csci_memory id = "C6" name = "CSCI # 6" type = "integer" />

    <csci_memory id = "C7" name = "CSCI # 7" type = "integer" />

    <csci_memory id = "C8" name = "CSCI # 8" type = "integer" />

    <csci_memory id = "C9" name = "CSCI # 9" type = "integer" />

    <csci_memory id = "C10" name = "CSCI # 10" type = "integer" />

    <csci_memory id = "C11" name = "CSCI # 11" type = "integer" />

    <csci_memory id = "C12" name = "CSCI # 12" type = "integer" />

      … …

</ CSCI>

Next, the connection control information may be expressed as follows.

<Network name = "Decoder">

<Package>

<QID>

<ID id = "MPEG4 Simple Profile" />

</ QID>

</ Package>

<Port kind = "Input" name = "BITSTREAM" />

<Port kind = "Ouput" name = "YUV" />

<Instance id = "1">

<Class name = "Parser">

<QID>

<ID id = "c" />

</ QID>

</ Class>

<Note kind = "label" name = "Stream Parser" />

</ Instance>

<Instance id = "2">

<Class name = "VS">

<QID>

<ID id = "c" />

</ QID>

<Note kind = "label" name = "Video Session" />

</ Class>

</ Instance>

<Connection src = "" src-port = "BITSTREAM" dst = "1" dst-port = "BITSTREAM" />

<Connection src = "1" src-port = "CSCI" dst = "2" dst-port = "CSCI" />

<Connection src = "1" src-port = "DATA" dst = "2" dst-port = "DATA" />

<Connection src = "2" src-port = "YUV" dst = "" dst-port = "YUV" />

</ Network>

The information transfer unit 426 transfers the CSCI control information and the connection control information processed by the information processing unit 424 to the decoding solution 430. The information transfer unit 426 may transfer the CSCI control information to the CSCI storage unit 432 in charge of actual storage and operation of the CSCI information, and the connection control information to the connection control unit 434 that controls the connection between the functional units. have. If the CSCI storage unit 432 functions only for the storage of CSCI information, and the operation of the CSCI information is performed by the connection control unit 434, the information transfer unit 424 connects the CSCI control information and the connection control information. Obviously, the control unit 434 may transmit the information to the control unit 434.

The decoding solution 430 includes a CSCI storage 432 and a connection controller 434. Although not shown, the decoder solution 430 may further include a working memory for loading one or more functional units by a call of the connection controller 434 to perform a predetermined process.

Referring to FIG. 5 where a second embodiment of the decoding processing unit 320 is shown, the decoding processing unit 320 may include a description decoder 405, a description storage unit 410, a tool box 415, and a decoder formation. Unit 420 and decoding solution 430.

Compared with FIG. 4, the decoding solution 430 of the decoding processing unit 320 of FIG. 5 may further include a parsing function 510. The parsing function unit 510 is a function unit that parses a bitstream. The parsing function 510 may be included in the decoding solution 430 as an independent component, but the decoding solution 430 may include two working memories, and the connection controller 434 may use one working memory for decoding processing. It is apparent that only the functional units may be controlled to be loaded exclusively, and another working memory may be implemented such that the same effect is obtained by controlling only the parsing function 510 to be loaded exclusively. In both cases described above, the parsing and decoding processing for the bitstream may be performed sequentially or in parallel.

In addition, as compared with FIG. 4, the information processing unit 424 further processes the syntax parsing control information and provides the decoding solution 430 to the processing of the parsing function unit 510. Accordingly, the role of the partial decoder description used to generate the CSCI control information, the connection control information, and the syntax parsing control information may vary.

That is, the information processing unit 424 determines whether each of the partial decoder descriptions is used for generation or storage of CSCI (Control Signal / Context Information), syntax parsing, and connection of functional units. CSCI control information, connection control information, and syntax parsing control information are processed after classifying them according to their role. For example, the partial decoder description used to generate CSCI control information may be CSCIT 640, and the partial decoder descriptions for generating connection control information may be FL 610, F-RT 620, DHT ( 650), FU-CSCIT 630, and the like, and the partial decoder descriptions used to generate the syntax parsing control information are SET 660, S-RT 670, DHT 650, CSCIT 640. ), DVT 680, and the like.

As described above, the CSCI control information and the connection control information processed by the information processing unit 424 may be expressed according to, for example, an XML-based Abstract Decoder Model (ADM) expression method, and the expression example of the syntax parsing control information. Is shown below.

<syntax>

    <syntax_element id = "S0" name = "Syntax # 0">

      <process>

        <cmd type = "READ">

          <parameter index = 0> 32 </ parameter>

          <parameter index = 1> B </ parameter>

        </ cmd>

        <cmd type = "EXPRESSION">

          <parameter index = 0> (C0 = (IBS == HEX: 1B0)) </ parameter>

        </ cmd>

      </ process>

    </ syntax_element>

    <syntax_element id = "S1" name = "Syntax # 1">

      <process>

        <cmd type = "READ">

          <parameter index = 0> 8 </ parameter>

          <output type = "CSCI"> C1 </ output>

        </ cmd>

      </ process>

    </ syntax_element>

    (……)

</ syntax>

The information transfer unit 426 transfers the CSCI control information, the connection control information, and the syntax parsing control information processed by the information processing unit 424 to the decoding solution 430. Here, the syntax parsing control information may include one or more of information for controlling selective loading of the parsing functions of FIG. 7, CSCI control information, and the like.

The information transmitting unit 426 transmits the CSCI control information to the CSCI storage unit in charge of the actual storage and operation of the CSCI information, the connection control information is transferred to the connection control unit 434 that controls the connection between the functional units, and syntax parsing control. The information may be passed to the parsing function 510. If the CSCI storage unit 432 functions only for the storage of CSCI information, and the operation of the CSCI information is performed by the connection control unit 434, the information transfer unit 424 connects the CSCI control information and the connection control information. Obviously, the control unit 434 may transmit the information to the control unit 434. Also, if the parsing function unit 510 performs syntax parsing of the bitstream under the control of the connection control unit 434, the information transfer unit 424 may transfer the syntax parsing control information to the connection control unit 434. It is self-evident.

The decoding solution 430 includes a CSCI storage 432, a connection controller 434 and a parsing function 510. The decoder solution 430 may further include one or more working memories for loading one or more functional units by a call of the connection control unit 434 to perform a predetermined process.

The parsing function unit 510 may be a syntax unit capable of parsing all bitstreams regardless of the encoding format of the bitstream, or may be a function unit specifically generated for syntax parsing of a specific type of bitstream. That is, the parsing function 510 is one or more functional units for performing syntax parsing, which will be described in detail with reference to the accompanying drawings.

As illustrated in FIGS. 4 and 5, the decoder 300 according to the present invention includes the functional units (decoding function for performing decoding processing and / or parsing function for performing syntax parsing) provided in the toolbox 415. By selectively loading and decoding the unit 510, the decoder 300 recombined or generated in various forms can be implemented to decode the input bitstream regardless of the encoded method.

As described above, the decoder forming unit 420 or the connection control unit 434 performs a function of configuring a decoder for processing the input bitstream, and decoding the bitstream is performed by the decoder forming unit 420 or the connection control unit. By the actual decoder configured by the control of 434), i. By separating the two processing units that are functionally causal in this way, a plurality of decoding solutions can be manufactured using one decoder formation information, so that the decoder can provide more efficient processing.

Hereinafter, functions and operations of the components of the decoding processing unit 320 will be described with reference to the accompanying drawings.

As described above, the description decoder 405 decodes the input encoded decoder description 313 into the decoder description 314 and then stores the plurality of partial decoder descriptions in the description storage unit 410.

The toolbox 415 includes a plurality of functional units, each implemented to perform a predetermined process. The functional units include functional units for performing syntax parsing (see FIG. 7, a set of functional units are referred to as a Syntax Parser Group 700), and functional units for decoding encoded video data. (See FIG. 8, the set of corresponding functional units is referred to as the decoding function group 800). For example, the SYN parser group 700 may be implemented as one functional unit. The SYN parser family 700 and / or the respective functional units may each be implemented in a combination of program codes or algorithms.

That is, the tool box 510 is an area including functional units (FUs) that are implemented to perform respective functions (that is, a predetermined process). Each of the functional units included in the decoding function group 800 ( Hereinafter, the decoding function unit is activated (selectively loaded) under the control of the connection control unit 434 to output encoded video data included in the conventional bitstream 105 as moving picture data.

The connection control unit 434 may control the corresponding functional units to be sequentially activated in each hierarchical unit (eg, activated in the order of the first layer, the second layer, the third layer, and the like, and the second layer is At the time of activation, the first layer may remain activated or may be deactivated if no further data processing is required). However, even if activated simultaneously as functional units included in the same hierarchical structure, if the functional unit uses result data by the processing of another functional unit as input data, the result data is generated by the other functional unit and stored in the CSCI storage unit 432. Until the treatment is reserved.

Each of the functional units included in the decoding function group 800 may belong to one or more layers divided according to the characteristics of the codec. Any function included in the called SYN parser group 700 (hereinafter referred to as a parsing function) performs syntax parsing of the bitstream, and the decoding functions are provided for CSCI information and decoding necessary for performing a specified process. If data is saved, processing is performed. In addition, according to the flow of CSCI information and data, the upper layer calls the decoding function unit of the lower layer (performed by the control of the connection control unit 434 which has received the connection control information from the information transfer unit 426), and specified in the decoder description. All the decoding functions perform the process more than once as necessary to output the video data corresponding to the bitstream. Accordingly, the decoder description (or partial decoder description) may be used to present scheduling management of each codec and an organic processing structure of each functional unit.

Of course, as described with reference to FIG. 5, the parsing function unit 510 is included in the decoding solution 430 and uses the syntax parsing control information provided from the decoder forming unit 420 to connect the connection control unit 434. It may be set to perform interpretation of the conventional bitstream 316 without control. This means that the following functional units are interpreted by the parsing function 510 and stored in the CSCI storage 432. Element information and / or a macroblock (MB) size video output from the parsing function 510 is output. This is because data is available.

The parsing function unit (hereinafter referred to as the parsing function unit 510) included in the parsing function unit or the decoder solution 430 loaded by the control of the connection control unit 434 is a conventional bit input using syntax parsing control information. The stream 316 is interpreted to store element information, which is a result of syntax parsing, in the CSCI storage unit 432. The CSCI storage unit 432 may be, for example, a buffer memory. The element information may be, for example, Control Signal / Context Information (CSCI). The element information parsed by the parsing function unit 510 and stored in the CSCI storage unit 532 may be an input value for determining the syntax belonging to the conventional bitstream 316 at the same time as the parsing result of the corresponding step.

In addition, the parsing function unit 510 performs entropy decoding on the header of the syntax-parsed conventional bitstream 316 and the image data, and subsequently performs video data having a predetermined macroblock size according to the connection control of the connection controller 434. Can be output to the function unit (FU).

Of course, the parsing function unit 510 stores the macroblock size video data in a predetermined buffer memory, and the subsequent function unit according to the load of the connection control unit 434 (that is, the connection control) has the macroblock size in the buffer memory. After processing and reading the moving picture data, the processed moving picture data may be stored in the buffer memory for processing of a subsequent functional unit.

That is, the parsing function unit 510 stores the macroblock sized video data in the CSCI storage unit 432 or a separate buffer memory, and the connection control unit 434 provides the stored macroblock sized video data to the selected function unit. Alternatively, it is apparent that the selected function unit may read the video data from the CSCI storage unit 432 or a separate buffer memory. However, hereinafter, it is assumed that the macroblock size video data output by the parsing function unit 510 is directly input to the function unit according to the connection control of the connection control unit 434.

The parsing function 510 may be implemented as one software program (including a combination of program codes). Although the parsing function 510 is implemented to perform a plurality of functions respectively corresponding to a plurality of standards (for example, MPEG-1 / 2/4 / AVC, etc.), syntax parsing control information is used to perform a corresponding operation. Because it can be done. Of course, the parsing functional unit 510 may be implemented by being divided into a plurality of functional units as shown in FIG. 7, and each of the functional units may be implemented as a combination of blocked program codes.

As described above, when the conventional bitstream 316 is input to the decoding processing unit 320, the connection control unit 434 loads a parsing function unit using the connection control information received from the decoder forming unit 420 to parse the syntax. In this case, the parsing function unit 510 that receives syntax parsing control information from the decoder forming unit 420 may perform syntax parsing.

In addition, the connection controller 434 controls the functional units of the highest layer to be loaded or activated with reference to the connection control information (which may be information corresponding to the F-RT 620). Although only some of the first decoder description and the second decoder description are used in the early stages, the first decoder description and the second decoder description are each used organically in the form of cross-references and the like.

Each of the optionally loaded functional units will wait until the CSCI or / and data needed for processing is stored in the CSCI storage 432, and the CSCI or / and data needed is loaded into the CSCI storage 432. If it is recorded at, processing starts for each functional unit. In this way, the decoding processing unit 320 according to the present invention may simultaneously perform a syntax parsing operation and data decoding for video output (see FIG. 15). In addition, it is determined whether the functional units included in the decoding function group 800 are activated on a hierarchical basis, and each functional unit is individually determined to reserve or start an operation, so that organic operations (eg, functional units) of each functional unit are determined. The operation is performed by forming a serial / parallel coupling structure of the liver.

The parsing functions or parsing function 510 is inputted with reference to syntax parsing control information corresponding to DHT 650, SET 660, S-RT 670, CSCIT 640, DVT 680, and the like. The bitstream 316 is interpreted to store element information, which is a result of syntax parsing, in the CSCI storage unit 432. The CSCI storage unit 432 may be, for example, a buffer memory. The element information may be, for example, Control Signal / Context Information (CSCI). The element information parsed by the parsing function unit 510 and stored in the CSCI storage unit 432 may be an input value for determining a subsequent syntax of the conventional bitstream 316 while being a parsing result of the corresponding step.

In addition, the parsing function unit 510 performs entropy decoding on the header of the syntax-parsed conventional bitstream 316 and the image data, and thus has a predetermined size (for example, 1 pixel unit, 4x4 unit, 8x8 unit, etc.). The encoded data may be stored in the CSCI storage 432 for use by decoding functions (see FIG. 8). For example, the parsing function unit 510 may store the data to be used in the decoding process such as DC / AC in syntax in the CSCI storage unit 432. The CSCI storage unit 432 may be a buffer memory, and a dedicated buffer space may be previously designated for each functional unit (see FIG. 12).

In addition, each dedicated buffer space may be set to have an inclusion relationship for each layer as illustrated in FIGS. 13 and 14. Therefore, the function unit loaded in the work memory may immediately start processing when the input data is recorded in the CSCI storage unit 432. If the processing result data is used as input data of the other function unit, the corresponding result data is stored in the CSCI storage unit. 432 may be recorded.

The parsing function 510 may be implemented as one software program (including a combination of program codes). Although the parsing function 510 is implemented to perform a plurality of functions respectively corresponding to a plurality of standards (for example, MPEG-1 / 2/4 / AVC, etc.), the DHT 650, the SET 660, the S This is because the corresponding operation may be performed by referring to syntax parsing control information corresponding to the RT 670, the CSCIT 640, the DVT 680, and the like. Of course, the parsing functional unit 510 may be implemented by being divided into a plurality of functional units as illustrated in FIG. 7, and each of the functional units may be implemented as a combination of blocked program codes.

By explaining the functional units illustrated in FIG. 7 (hereinafter, referred to as the parsing function group 700 for convenience) in detail, the functions of the functional units that perform syntax parsing in the parsing function unit 510 or the toolbox 415 will be described. As follows.

As illustrated in FIG. 7, the parsing function group 700 includes a network abstraction layer parsing (NALP) function (FU) 710, a syntax parsing (SYNP) function 720, and a context determination (CTX) function 730. ), A Variable Length Decoding (VLD) function unit 740, a Run Length Decoding (RLD) function unit 750, a Macro Block Generator (MBG) function unit 760, and the like.

Of course, the parsing function group 700 may include all of the functional units for syntax parsing irrespective of the applied standard, and additionally, necessary functions for syntax parsing may be added in the process of technology development, and existing functions may be added. It is apparent that modifications can be made and unnecessary functions can be removed. In addition, it is apparent that each functional unit provided in the parsing functional group 700 does not exist independently in each standard, and in the case of a functional unit capable of the same processing regardless of the standard, it may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The NALP function unit 710 is a function unit for parsing a Network Abstraction Layer (NAL) of MPEG-4 AVC, and the SYNP function unit 720 is a function unit for parsing syntax of a bitstream. The SYNP function 720 may be included in the VLD function 740.

The CTX function unit 730 is a function unit that determines a VLC table of MPEG-4 AVC, and the VLD function unit 740 is a function unit that performs entropy decoding.

The RLD function unit 750 is a function unit for entropy decoding AC values, and the MBG function unit 760 is a function unit for generating one MB (Macro Block) data by combining the DC value and the AC values. All of the functional units and some of the functional units in the aforementioned SYN parser group 700 may be included in the VLD functional unit 740 according to a system implementation.

As described above, the parsing function group 700 may be implemented by one software program, or may be implemented by a plurality of software programs (for example, the VLD function unit 740 may be independently implemented by an independent software program). The parsing function group 700 controls syntax parsing corresponding to the first description information (ie, one or more of DHT 650, SET 660, S-RT 670, DVT 680, and CSCIT 640). Element information may be extracted or generated using the information and stored in the CSCI storage unit 432.

Hereinafter, the functions of the decoding functions will be described in detail by describing each of the functional units illustrated in FIG. 8 (hereinafter, referred to as a decoding function group 800 for convenience). Decoding functions may be provided in the toolbox 415.

The decoding function group 800 processes the encoded data stored in the CSCI storage unit 432 in a predetermined processing unit by performing a predetermined process by an arbitrary function unit of the parsing function group 700, thereby moving image data having a predetermined size. Output as. The processing unit of the encoded data may be predefined or generalized as the same processing unit to be applied differently for each functional unit.

The decoding function group 800 may include functional units FU for performing the above-described functions corresponding to each standard. Each functional unit is implemented as an independent processing block (for example, a software program, a combination of instruction codes, a function, etc.) to form a decoding function group 800, or the decoding function group 800 is a single integrated processing block. It may be implemented. Although the decoding function group 800 is implemented as one integrated processing block, it is apparent that the corresponding processing can be performed by the connection control of the connection control unit 434.

As illustrated in FIG. 8, the decoding function group 800 includes a de-blocking filter (DF) function 810, a VR (OPOP Reconstructor) function 815, and a frame field reordering (FFR) function 820. Intra prediction and picture reconstruction (IPR) function 830, inverse transform (IT) function 835, inverse quantization (IQ) function 845, inverse AC prediction function (855), IS An inverse scan function unit 860 and a DC reconstruction (DCR) function unit 865 may be included.

The IT4x4 function unit 840, the IQ4x4 function unit 850, and the DCR4x4 function unit 870 are characterized in that the block size to be processed is 4x4. This is because MPEG-4 AVC processes data with 4x4 block size, whereas MPEG-1 / 2/4 processes data with 8x8 block size during Transform, Quantization, and Prediction.

The decoding function group 800 may include all of the functional units for performing data decoding functions regardless of the applicable standard, and may add necessary functions in the course of technology development, and may modify existing functions, and may be unnecessary. It is obvious that the functional part can be removed. For example, if an IS4x4 function unit that processes data with a 4x4 block size is additionally required for the decoding process, the corresponding function units may be added to the decoding function group 800. In addition, a special prediction (SPR) function (not shown) for performing intra prediction in MPEG-4 AVC may be further added.

Each functional unit included in the decoding function group 800 does not exist independently of each standard, and it is obvious that the functional unit capable of the same processing regardless of the standard may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The DF function 810 is a de-blocking filter of MPEG-4 AVC, and the VR function 815 is a function that stores the reconstructed pixel value.

The FFR function unit 820 is a function unit for the interlaced mode, and the IPR function unit 830 is a function unit that stores the reconstructed pixel value after intra prediction of MPEG-4 AVC. As described above, intra prediction of MPEG-4 AVC may be performed by the SPR function.

The IT function unit 835 is a function unit that performs inverse transform of DC values and AC values, and the IQ function unit 845 is a function unit for inverse quantization of AC values.

The IAP function 855 is a function for inverse AC prediction of AC values, and the IS function 860 is a function for inverse scan of AC values. The DCR function unit 865 is a function unit that performs inverse prediction and inverse quantization of DC values.

The above-described parsing function group 700 and the decoding function group 800 are started to operate separately, and each functional unit in the decoding function group 800 is activated by the activation control of the connection control unit 434 and then required for processing. And / or start operation separately when data is written to the CSCI storage 432.

 The CSCI storage unit 432 corresponds to the first decoder description (ie, CSCIT 640, DHT 650, SET 660, S-RT 670, DVT 680) in the parsing function group 700. Element information (eg, CSCI), which is a result of syntax parsing referring to syntax parsing control information, is stored. Element information is stored to correspond to CSCIT 640. The CSCI storage unit 432 may be, for example, a buffer memory.

 Element information stored in the CSCI storage unit 432 is used as input data for performing the process of the SET 660 by the parsing function group 700, or a control for determining a subsequent connection index in the S-RT 670 It can be used as a variable.

In addition, the element information stored in the CSCI storage unit 432 is loaded by the connection control unit 434 in a hierarchical structure with reference to the connection control information (for example, information corresponding to the F-RT 620). Each functional unit may be used to map the input CSCI designated in the FU-CSCIT 630 with element information stored in the CSCI storage unit 432. Of course, in the case of the element information that can be used by the functional units in the decoding function group 800, the parsing function group 700 may be stored in the CSCI storage unit 432 as described above.

That is, the CSCI storage unit 432 decodes the CSCI (Control Signal / Context Information, control information / context information) generated by the parsing function group 700, and any functional unit included in the decoding processing group 800. Data to be processed may be stored. Of course, the CSCI storage unit 432 may be implemented by being divided into a CSCI storage unit for storing the CSCI and a data storage unit for storing the data to be decoded according to the type of information to be stored.

The connection controller 434 controls each function unit included in the parsing function group 700 and / or the decoding function group 800 to be loaded or activated in order to decode bitstreams encoded by various standards. The parsing function group 700 may be provided in the decoding solution 430 in the form of the parsing function 510.

That is, the connection controller 434 controls to load or activate each functional unit included in the decoding function group 800 in a hierarchical structure with reference to the connection control information. This is because the input data for the functional units belonging to the lower hierarchical structure may be the result data processed by the functional units belonging to the upper hierarchical structure.

As described above, the decoding solution 430 may include a working memory for loading one or more functional units under the control of the connection controller 434 to perform a predetermined process.

Connection control information input from the decoder forming unit 420 so that the connection control unit 434 activates each function unit and processes and outputs the data encoded by the function units as video data (that is, FL 610 and F−). RT 620, FU-CSCIT 630, CSCIT 640, DHT 650, etc. can be generated using).

Since the plurality of functional units illustrated in FIG. 8 operate organically with each other, the encoded data may be converted into video data and output. Which functional units should be operated sequentially to convert the video data may be different according to each encoding standard, which is obvious to those skilled in the art. Therefore, the following description will focus on an organic relationship between partial decoder descriptions used for generating connection control information for organic operation control of a plurality of functional units.

First, as shown in FIG. 9 and Table 1, DHT (Decoding Hierarchy Table) 650 is a partial decoder description describing the information about the hierarchical structure of the codec and the lower layer for each layer.

Table 1. Decoding Hierarchy Table (DHT)

Index Name Children hierarchy Note H0 VS H1 Video Session H1 GOP H2, H3 Group of picture H2 VOP-1 H5 Video Object Plane: Type 1 H3 VOP-2 H4 Video Object Plane: Type 2 H4 MB-1 H6 H5 MB-2 H7 H6 B-1 None H7 B-2 None H8 … … ... ... ... ... ...

As illustrated in Table 1, the DHT 650 may include items such as Index, which is a sequentially assigned layer number, a name indicating a name of each layer, and a Children Hierarchy indicating a lower layer of the corresponding layer. The number of layers or the number of children hierarchies can be expressed differently depending on the codec. For example, if there are more VOP-3, MB-3, etc. as illustrated in FIG. 9, it is obvious that a corresponding layer number may be added.

The hierarchical structure represented by the DHT 650 of the present invention means that different codecs based on one codec can be integrated at free layer positions in a free form. In other words, a new codec can be constructed using several different codecs using an integrated codec, and video compression and reconstruction are possible using this codec.

In addition, the main function of the DHT 650 is to introduce a hierarchical structure to a given codec so that various implementations of the decoding solution to be configured using decoder description (sequential / parallel, single / multiple threads, sw / hw hybrid decoding) To facilitate.

The hierarchy described through the DHT 650 illustrated in Table 1 is commonly applied in syntax parsing and decoding processes. Of course, it is obvious that there may be more hierarchies to be used independently in the syntax parsing or decoding process.

Next, as shown in Table 2 below, FL (FU List, 610) is a portion that describes the information, such as a list of the respective functional units provided in the decoding function group 800, the quantity of input and output data of the corresponding functional units Decoder description.

Table 2. FL (FU List)

FU ID FU name input CSCI output CSCI D0092 FU-A 2 0 D0098 FU-B 2 0 … … … …

The FL 610 designates the name of the dedicated buffer area (or the write address of the data or the address in the buffer memory in which the data is recorded) in which the input data for each functional unit is recorded, and the output data by the corresponding functional unit is recorded. The buffer region may further include a name (or a write address of the corresponding data or an address in the buffer memory in which the corresponding data is to be written). Accordingly, each functional unit may record output data obtained by reading and processing input data using the FL 610. However, the FL 610 does not describe the input data and the output data of the parsing function group 700 for generating element information, which means that the parsing function group 700 corresponds to syntax parsing control information (which is SET 660 or the like). The element information is generated and the generated element information is recorded in the designated position.

As illustrated in Table 2, the FL 610 includes an FU ID that is a unique number of a functional unit (FU) in the tool box 510, an FU name that is a name of each functional unit, and an input CSCI indicating a quantity of input data. It may include an item such as output CSCI indicating a quantity of result data (output data). The order of listing the functional units in the FL 610 corresponds to the order of listing the FU or the Index No. of the FU-CSCIT 630. In the FU name item which is the name of each functional unit, the names of the respective functional units described above with reference to FIG. 8 may be described.

The specific function unit of the layer activated by the connection control unit 434 reads necessary data from the CSCI storage unit 432 by referring to connection control information corresponding to the FU-CSCIT 630, the CSCIT 640, or the like. The data input by 434 is used to perform a preset process and generate output data. The generated output data may be recorded in the CSCI storage unit 432, and the data recorded in the CSCI storage unit 432 may be used as input data of a functional unit that performs subsequent processing. Here, the functional unit is included in the decoding function group 800, and refers to a series of processes (for example, a function, an algorithm, or a function) for processing input data in a predetermined process to generate output data.

If the decoding processing unit 320 is sufficient to use only one standard for decoding the encoded video data included in the conventional bitstream 316, then the FL 610 may be equipped with functional units for performing corresponding processing in that standard. It can only contain information about.

However, if the video data is encoded by a plurality of standards (e.g., if the encoding standard is applied differently in a plurality of frames), the functions of the plurality of standards according to the plurality of standards may be used for decoding the encoded video data. Information will be needed. Accordingly, in this case, the FL 610 should include information of the functional units according to the plurality of standards necessary for decoding of the encoded video data among all the functional units according to the corresponding plurality of standards.

Of course, even if the video data is differently applied to the encoding standard in the unit of a plurality of frames, each FL 610 if a plurality of conventional bitstream 316 and the extended bitstream 305 is generated and provided divided by the applied encoding standard Each would only need to contain information on the functional units according to the corresponding standard.

The FL 610 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required during the partial decoder description may be described in a similar script language.

Next, the F-RT (FU-Rule Table) 620 provides connection information of functional units to be used to decode the input conventional bitstream 316. That is, the F-RT 620 is configured as a structure in which an upper layer calls a lower layer by using the hierarchical structure specified in the DHT 650 as illustrated in Table 3 below.

Table 3. F-RT ( FU  - Rule Table )

Decoding Hierarchy Children ( FU Of FH ) LOOP LOOP Condition Input Description  FH0 FU1 NO - FH0 FH1 YES CH1.C0 == 1 FU1 FH1 [0..N-1] e.g., FH1 [i] is executed when CH1 [i] .C0 is 1. FH1 YES CH1.C1 == 1 FH1 [i-1] FH1 FU2 No - FH1 FU2 No - FH1 … … … … … …

As shown in Table 3, the F-RT 620 includes a decoding hierarchy representing each hierarchical structure, a children representing a functional unit to be activated or a lower layer to be called, a loop indicating whether to operate a loop, and a loop when a loop operation is required. Loop Condition indicating a condition, input information (or activation order) of each functional unit or a lower layer, and an input indicating a Decorating Hierarchy or Children.

As illustrated in Table 3, the layer of FH0 will be activated first, and the FH1 layer will subsequently be activated since it uses the result data of FU1 as input data. Alternatively, after the FH1 layer is also activated at the same time as the FH0 layer, the processing operation may be suspended until the result data of the FU1 is stored in the CSCI storage unit 432.

Each layer is created as an object that ensures independence in the concept of instance / object when called. That is, FH1 [0], FH1 [1], FH1 [2],... It creates multiple FH1s, such as FH1 [n], and this structure can be equally applied to other layers (eg, FH0, FH2, FH3, etc.). In addition, a dedicated buffer space for each object may be allocated. As illustrated in FIGS. 12 and 13, each dedicated buffer space stores CSCI or data for processing a specific hierarchy or a functional unit within the hierarchy.

The F-RT 620 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the partial decoder description may be described in a similar script language. .

Next, the FU-CSCIT (FU CSCI Table) 630 is a partial decoder description for connecting element information stored in the CSCI storage unit 432 with element information (input CSCI) required by each function unit.

Table 4. FU -CSCIT ( FU CSCI Table )

Index No . CSCI information CSCI table element The num of interface set  : One One Quantiser_scale CH2.C6 The number of MB CH2.C1 The num of interface set  : 2  2 CBP_MPEG2 CH3.C1 Ac_pred_flag_MPEG2 CH3.C6 CBP_MPEG4 CH4.C2 Ac_pred_flag_MPEG4 CH4.C5

As illustrated in Table 4 above, the FU-CSCIT 630 is Index No, which is 1: 1 mapped with the FU ID of the FL 610, information on CSCI, and an index of the CSCIT 640 for mapping. (CSCI table element) is included. Both are 1: 1 mapped by the order of listing the functional parts of the FL 610 and the order of listing the Index No. of the FU-CSCIT 630. That is, FU-A, which is the first functional part of Table 2, is Index No., which is the first index of FU-CSCIT 630. Mapped to 1.

In addition, the FU-CSCIT 630 further includes information on how many interfaces are set for each Index No. The number of interface sets means the number of cases mapped. That is, since D0092 of the FL 610 is designated by the number of interface sets by the FU-CSCIT 630, only CH2.C6 and CH2.C1 are used as element information. However, since D0098 has two interface sets, in some cases, CH3.C1 and CH3.C6 are used as element information, and in others, CH4.C2 and CH4.C5 are used. Each function unit reads the designated element information from the CSCI storage unit 432 to perform a predetermined process and stores the generated output data (result data) in the CSCI storage unit 432.

The purpose of specifying the number of interface sets for each Index No. in the FU-CSCIT 630 is because one functional unit may perform different processing operations according to different data flows. That is, as illustrated in FIG. 11, if the FU-A is a functional part having a function that can be used simultaneously in MPEG-2 and MPEG-4, the case of processing data encoded in the MPEG-2 standard and MPEG-4 Different element information may be used for each processing standard encoded data. Thus, a plurality of interface sets are required so that element information when processing encoded data according to each standard can be distinguished.

The FU-CSCIT 630 may not only be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), but the minimum data required in the partial decoder description may be described in a similar script language. .

Finally, as shown in Table 5 below, the CSCIT 640 may include element information (for example, information about a result of the process of the SYN parser group 700 using the SET 660, the S-RT 670, or the like). Detailed information on CSCI is described. That is, the CSCIT 640 is processed from the conventional bitstream 316 and stored in the CSCI storage 432, and information about all meaningful data (i.e. element information) to be used by the decoding function group 800. Has

Table 5. CSCIT

Decoding Hierarchy Index Element Name Type Note  CH0 CH0.C1 Profile and level indication Integer CH0.C2 User data Array An array of arbitrary length of user data. CH0.C3 Visual object VerID Integer …  CH1 CH1.C1 Integer CH1.C2 Integer … CH2 CH2.C1 Macro-block type Integer …

As illustrated in Table 5 above, the CSCIT 640 is a hierarchical classification of each element information, an index that is a delimiter as a unique number of the element information, an index, an element name of the element information, and an element of the element information. Attributes for specifying data structural characteristics (for example, whether the element information is an integer or an array) are included. The CSCI information configured for each layer may be used in the form of multiple arrays as needed when configuring the decoder.

The CSCIT 640 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the partial decoder description may be described in a similar script language.

Subsequently, the CSCIT 640 used to generate syntax parsing control information used by the parsing function group 700 to extract or generate element information from the conventional bitstream 316 and store it in the CSCI storage unit 432; DHT 650, SET 660, S-RT 670, and DVT 680 will be described. However, since the CSCIT 640 and the DHT 650 have been described above, a description thereof will be omitted. As the plurality of functional units illustrated in FIG. 7 operate organically with each other, element information may be generated and stored in the CSCI storage unit 432. The type of element information may be different for each encoding standard, which is obvious to those skilled in the art. Accordingly, hereinafter, the parsing function group 700 integrated into a plurality of functional units or a single functional unit may be used to generate element information and store the element information in the CSCI storage unit 432 of the second decoder description included in the extended bitstream. The organic relationship between the partial decoder descriptions will be described.

First, SET 660 is a partial decoder description configured by information on the syntaxes of the input conventional bitstream 316, as shown in Table 6 below.

Table 6. Syntax Element Table (SET)

Index Element Name Input Process by SET-PROC S0 Visual object sequence start code 32 bit READ 32 B; (IBS == HEX: 1B0) >>; S1 Profile and level indication 8 bit READ 8 >>; S2 Visual object sequence end code 32 bit READ 32 B; ((IBS == HEX: 1B1) || (EOF)) >>; … … … …

As illustrated in Table 6 above, SET 660 includes an index for each syntax, an Element Name of element information, input data, and a process by SET-PROC. Contains information. In this case, the index is a delimiter S for distinguishing each syntax used in the S-RT 670.

The element name is a name of a syntax and may be named according to the meaning or role of the syntax. The input data is the nominal bit length input at one time in the conventional bitstream 316. The SET-process describes the process of receiving each bitstream syntax and what processing procedure to generate element information, which is output data. For reference, the SET-process "READ 32 B; (IBS == HEX: 1B0) >>;" corresponding to index S0 reads 32 bits and satisfies the information when "(IBS == HEX: 1B0)" is satisfied. It means to output (>>). The output data is element information (ie, CSCI information (C)), and CSCI information (for example, CH0.C1, etc.) specified in the S-RT 670 with reference to the Syntax #ID of the S-RT 670. It is stored in the CSCI storage unit 432.

The SET 660 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required during the partial decoder description may be described in a similar script language.

Next, as shown in Table 7 below, the S-RT 670 shows layer and connection information between each syntax in the conventional bitstream 316. That is, the S-RT 670 has information instructing the higher layer to call the syntax of the lower layer and move to the next syntax. The parsing function group 700 reads the conventional bitstream 316 using the syntax parsing control information corresponding to the S-RT 670 or stores and / or updates element information in the CSCI storage unit 432. Define the order in which As illustrated in FIG. 10, the parsing function group 700 is composed of a plurality of threads with reference to the S-RT 670, so that the upper thread can call the lower thread. This can be done.

Table 7. Syntax Rule Table (S-RT)

Decoding Hierarchy Index Syntax #ID CSCI Branch Information Note SH0 SH0.SR1 S0 CH0.C1, CH0.C0 1: (CH0.C0 == 1) GO SR2; 2: GO ERR; VS Start Code SH0.SR2 S1 … 1: GO SR3; SH0.SR4 S5 While (conditions) {CALL SH1 [CH0.C6]; CH0.C6 ++; } SH1 SH1.SR1 S6 1: (CH0.C0 == 1) GO SR2; 2: GO ERR; GOP Start Code SH1.SR2 S7 1: ([CH1.C13] == 1 && [CH1.C14] == 1) SR3; 2: GO SR4; SH2 … … … … … … … … … … …

As illustrated in Table 7 above, the S-RT 670 includes a decode hierarchy, an index R, a syntax ID (Syntax #ID), input data (CSCI), and branch information of each syntax. Branch Information).

The index R distinguishes each connection information rule. Since the index S of the syntax specifies a syntax to be processed by a specific connection index within each layer, the parsing function group 700 refers to the syntax parsing control information corresponding to SET 660 and specifies the syntax. Perform the process.

The input data represents a list of element information to be used for determining a condition for connection control in the corresponding connection index. The result of the process by the SET 660 is stored as the name of the input data corresponding to the Syntax #ID as described above.

Branch information is a condition determination algorithm that determines which connection index to process next. The branch information can directly determine which contents are read in what order. When the number of branches is 1 (for example, when the Syntax #ID is S1), input data may not exist.

The S-RT 670 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the partial decoder description may be described in a similar script language. .

Finally, DVT 680 is a partial decoder description in which Huffman table information used in each encoder / decoder is recorded, as shown in Table 8 below. In MPEG-1 / 2/4 / AVC, entropy coding is performed at each encoding. In this case, a Huffman coding method is mainly used, and the information used in this case is a Huffman table. In order to implement an integrated codec for decoding a bitstream encoded by various standards, Huffman table information to be used in a corresponding decoder must be provided at each decoding. Therefore, Huffman table information corresponding to each syntax is included in the syntax of the decoder according to the present invention. Of course, if Huffman table information corresponding to each standard is already recorded in the description storage unit 410, transmission of the DVT 680 is omitted, or codec number (Codec #), profile and level for designation of Huffman table information. Only numbers (Profile and level #) may be included.

Table 8. Default Value Table

name value code MCBPC 0 One MCBPC One 001 MCBPC 2 010 … … … MCBPC 9 NULL CBPY 0 0011 CBPY One 00101 … … … CBPY 17 000001 CBPY 18 NULL intraDCy 0 011 intraDCy One 11 … … … intraDCy 12 00000000001 intraDCy 13 NULL intraDCc 0 11 intraDCc One 10 … … … intraDCc 13 NULL DCT intra 0 10 DCT intra One 1111 … … … DCT intra 101 000001011111 DCT intra 102 0000011 DCT intra 103 NULL … … …

As illustrated in Table 8, the DVT 680 stores a name for each Huffman table, an actual value compressed and output by Huffman coding, and a compressed actual value in the conventional bitstream 316. Contains the code value to be used when For example, if the MCBPC value is compressed to obtain an actual value of 3, the conventional bitstream 316 is performed by a Huffman table mapping operation (for example, the PROCESS portion of SET 660). The code value 011 is recorded. As another example, if VLD [1] is recorded in the Process part of a specific index of SET 660, a conventional function called VLD is called, and the conventional bitstream 316 by a predetermined length (fixed length or variable length) by the function is called. ), You can get the code value and then get the corresponding actual value by Huffman table mapping. The Huffman table used at this time is [1], that is, the first table, CBPY.

The DVT 680 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

For example, the DVT 470 may be textual description as follows.

DVT {((0,1), (1,001), (2,010), (3,011), (4,0001), (5,000001), (6,000010), (7,000011), (8,000000001) , (9, NULL)) ((0,0011), (1,00101), (2,00100), (3,1001), (4,00011), (5,0111), (6,000010), (7,1011), (8,00010), (9,000011), (10,0101), (11,1010), (12,0100), (13,1000), (14,0110), (15 , (11), (16,000000), (17,000001), (18, NULL)) ((0,011), (1,11), (2,10), (3,010), (4,001), (5, 0001), (6,00001), (7,000001), (8,0000001), (9,00000001), (10,000000001), (11,0000000001), (12,00000000001), (13, NULL) ) ((0,11), (1,10), (2,01), (3,001), (4,0001), (5,00001), (6,000001), (7,0000001), (8 , 00000001), (9,000000001), (10,0000000001), (11,00000000001), (12,000000000001), (13, NULL)) ...

As another example, the DVT 470 may be binary described as follows.

00000011111111111111111111111110111110000110001100100011010000110110010000010011000000100110000010001100000110100100000000100000111110010000110010100101001010010000100100100101000110010001110011000001000100101100101000100011000001100100010100100101000100010000100100000100011000010110011000000000110000 00100000111110001101100010110001010000110100001100100100000100101000010011000000100111000000101000000000010100100000000101010000000000101011000000000010000011111000101100010100001001000110010010000010010100001001100000010 ...

Each partial decoder description has the advantage of reducing the storage space, improving processing efficiency, and reducing the transmission time of the extended bitstream 305 including the decoder description by the binary description.

Hereinafter, the interworking process between the partial decoder descriptions used by the parsing function group 700 and / or the connection control unit 434 will be described.

First, the connection controller 434 calls the functional units of the highest layer with reference to the information corresponding to the F-RT 620 among the connection control information. The called functions wait until the CSCI information and / or data necessary for processing are stored in the CSCI storage 432 by the parsing function group 700.

The parsing function group 700 reads the syntax corresponding to the highest layer by referring to the information corresponding to the rule information of the S-RT 670 among the syntax parsing control information, and sets SET 660, that is, syntax parsing control information. Recognizing that it is VS Start Code by the information corresponding to the SET, and reading the corresponding bit (that is, 32 bits set as the input value in the SET 660) in the conventional bitstream 316, the output value ( That is, as element information, C0 is stored in the CSCI storage unit 432 under the name of input data (CSCI) defined in the S-RT 670. The CSCIT 640 describes what element information is stored in the CSCI storage 432 and in which layers it is used. The parsing function group 700 then substitutes the element information (i.e., C0) stored in the CSCI storage 432 into the corresponding branch information of the S-RT 670, and processes the index corresponding to the result. Proceed. For example, since the branch information corresponding to the index SH0.SH1 is 'CH0.C0 == 1', if this is satisfied, the branch information corresponds to the index SR2 in the SH0 layer.

However, when the parsing function group 700 generates element information using the SET 660 (that is, information corresponding to the SET in the syntax parsing control information) and stores the element information in the CSCI storage unit 432, when the VLD function is called. (Eg, index S74 of SET 660) entropy decoding is performed using DVT 680 (ie, information corresponding to DVT in syntax parsing control information). When the element information is generated in this process, it is stored in the CSCI storage unit 432.

Each decoding function loaded while the element information or / and data is stored in the CSCI storage 432 by the parsing function group 700 stores all the element information or / and data necessary for performing a predetermined process. Check if it is Whether all of the corresponding functional units are stored may be checked with reference to the FU-CSCIT (ie, information corresponding to the FU-CSCIT in the connection control information). In addition, what the corresponding element information may be recognized through mapping with the CSCIT 640. The function unit, which stores all necessary element information and / or data, starts performing a predetermined process, and stores the processed result data in the CSCI storage unit 432.

As described above, the functional units may be sequentially activated or called in hierarchical units. Activation of the hierarchical unit may be controlled by the connection control unit 434 which monitors, for example, whether processing of the element information or / and data necessary in the current layer is completed. The called function units read and process the element information or data stored therein when it is recognized to perform a predetermined process. This process produces the same effect as each functional unit is connected sequentially or in parallel to perform the processing.

Since all the layers of all the functional units necessary for the conversion to the video data are activated, the decoding processing unit 320 may output the video data corresponding to the input conventional bitstream 316.

15 is a diagram conceptually illustrating parallel processing of syntax parsing and data decoding according to an embodiment of the present invention. As shown in FIG. 15, when the above-described connection control information and / or syntax parsing control information are used, data decoding is separately (independently) performed by the syntax parsing and decoding function group 800 by the parsing function group 700. Can be performed. That is, as long as element information and / or data required by each functional unit for data decoding are stored in the CSCI storage unit 432, the corresponding functional unit may perform a predetermined process. In addition, an independent function may be performed between each function unit unless the result data of another function unit is used as input data among the respective function units within the decoding function group 800 which performs the decoding process.

Therefore, the decoder 300 according to the present invention is not restricted to start the decoding function group 800 after all syntax parsing is completed, and the processing of the parsing function group 700 and the decoding function group 800 is possible separately. In addition, there is an advantage that can be processed separately between the functional units in the decoding function group (800). This may be implemented by having a parsing function 510 in the decoding solution 430 or by having a plurality of functional parts loaded into one or more working memories.

As described above, according to the present invention, an existing profile may be used by using functional units provided by a conventional standard (ie, a codec), or a new decoder may be configured by using existing functional units. In addition, a new decoder may be implemented using a new function unit. That is, various and unlimited decoder implementations are possible.

However, when adding a new functional unit (Functional Unit) to the tool box 510, it is necessary to add the algorithm for the functional unit (that is, description of the functional unit) and add the corresponding information to the FL 610. . In this case, a compilation process for the algorithm may be additionally required.

In order to implement the integrated codec, each component must be organically controlled to parse a bitstream compressed by various coding methods and decode the bitstream by a decoding method corresponding to the corresponding coding method.

In this case, the corresponding bitstream may be a bitstream composed of various shapes in which various standards (codecs) are mixed or various types of bitstreams generated by various coding schemes within one standard. In addition, in order to support various encoding / decoding methods, various functions used in various standards are divided into separate units, and only one function and a function required by the user are selected to select one codec (encoder and decoder). You should be able to make it.

As described above, the present invention has an advantage that the functional description can be organically connected and controlled by the same information interpretation method regardless of the encoding scheme in which the bitstream is encoded by providing the decoder description together.

In addition, another advantage of the present invention is that even if the syntax of the bitstream is changed or newly added, the S-RT 670 may enable active response only by modifying the corresponding information or inserting additional information. In addition, the F-RT 620 is configured by selecting a function desired by the user in units of processing such as a bit stream level, a frame level, and a macroblock level (MB-level). There is also an advantage in that the connection relationship between the decoding function group 800 functional units can be set.

Hereinafter, the instructions constituting the partial decoder descriptions will be described in detail.

In each of the above-exemplified tables, instructions used in respective partial decoder descriptions are illustrated. Each of the illustrated instructions can be used to construct information (ie, partial decoder description) for parsing a standard syntax such as MPEG-2 / MPEG-4 / MPEG-4 AVC.

Instructions for configuring each partial decoder description may include READ, SEEK, FLUSH, IF, WHILE, UNTIL, DO ~ WHILE, DO ~ UNTIL, BREAK, SET, STOP, PUSH, and the like. Of course, not all instructions need to be used within each partial decoder description, and it is obvious that any instruction can be selectively used for each partial decoder description. Hereinafter, the purpose of each command will be briefly described.

First, READ is a command for reading a certain bit from the bitstream. For example, it may be expressed as "READ bits B> CSCI;". Here, "bits" represents the number of bits to be read, "B" represents a Byte-alignment flag, and "> CSCI" represents a CSCI index to be stored. "B" and "> CSCI" are used as options. If "> CSCI" is not specified, it is set to store only in the variable IBS.

Next, SEEK reads a bit from the bitstream but does not move the file pointer. The file pointer means a reference position during an operation such as reading a predetermined bit. The parameters of the SEEK command can be applied in the same way as the READ described above.

Next, FLUSH is a command for moving a file point by a certain number of bits in the bitstream. Parameters can be applied similarly to READ.

Next, IF may be used in the form of "IF (condition) {~} ELSE {~}", and is an instruction that provides a branch according to a given condition.

Next, WHILE can be used in the form of "WHILE (condition) {~}", and is a command to repeatedly execute a designated block while a given condition is true.

Next, UNTIL can be used in the form of "UNTIL (condition) {~}", which is a command to repeatedly execute a designated block until a given condition becomes true.

Next, DO ~ WHILE can be used in the form of "DO {~} WHILE (condition)" and it is a command to transform the WHILE statement to execute a block before determining the condition.

Next, DO ~ UNTIL can be used in the form of "DO {~} UNTIL (condition)", which is a command to transform a UNTIL statement to execute a block before determining a condition.

Next, the command (~) (compute) is used in the form of "(C11 = (V2 + 3));". In other words, all calculations of SET-PROC can be written in parentheses. Operators such as arithmetic, assignment, comparison, addition / subtraction (++ /-), bitwise operation, logical sum / logical product, and check whether CSCI is used or not Can be used.

Next, BREAK tells you to break away from the nearest loop structure.

Next, SET is a command for setting whether to use flags for designated CSCIs, and CSCIs for designating flags are listed and separated by commas (eg, SET C0, C2;).

Next, STOP is a command for stopping the processing of the currently executing syntax element and moving on to the next.

Next, PUSH is an instruction to add a given data from the last point in which data was recorded in the array CSCI, and the added values are listed (for example, PUSH C8 8, 16, 32;) by comma. Are distinguished.

Next, GO tells you to branch to the specified location. For example, GO SR # ;; is a command to branch to SR #, and GO RT is a command to return to where it was called.

Next, HEX is a command that indicates that the value following the HEX command is hexadecimal.

Next, RLD is an interface for an RLD function supported in MPEG-4, and may be used in the form of "RLD index, level, run, islastrun, t #;". Here, index, level, run, and islastrun represent CSCI or internal variables storing the RLD return value, and t # represents the Huffman Table ID used for the RLD.

Next, VLD2 is a VLD function for MPEG-2, and may be used in the form of "VLD2 [t #] in> v1, v2, v3;". Here, t # is a Huffman Table ID used for the VLD, in represents an index value to be input, and v1 to v3 represent an output result value.

Finally, VLD4 is a VLD function for MPEG-4, and may be used in the form of "VLD4 [T #]> CSCI;". Here, t # represents a Huffman Table ID used for the VLD, and "> CSCI " represents a CSCI index to be stored. "> CSCI" is an option. If not specified, it is stored only in the variable IBS.

16 is a diagram illustrating a configuration of an extended bitstream according to the first embodiment of the present invention, FIG. 17 is a diagram illustrating a configuration of an extended bitstream according to the second embodiment of the present invention, and FIG. 19 is a diagram illustrating a configuration of an extended bitstream according to a third embodiment, and FIG. 19 is a diagram illustrating a configuration of an extended bitstream according to a fourth embodiment of the present invention.

As shown, the encoded decoder description 313 included in the extended bitstream 305 according to the present invention is configured to include only the standard information applied without including information for generating the partial decoder description (No table). ), It may be configured to include all table information (Full tables), or may be configured to include only some table information (Partial tables). To distinguish each of these, the decoder description information may include stream identifier information (SI), and the SI information may be divided as shown in Table 2 below.

Table 9. Stream Identifier

SI Decoding Description 00 No table 01 Full tables 10 Partial tables

As illustrated in FIG. 16, the extended bitstream 305 is a decoder description and includes an SI 1610 (that is, 00), a codec number (Codec #, 1620), and a profile and level number (indicative of not including table information). Profile and level #, 1630).

This is the case when partial decoder descriptions already stored in the description storage unit 410 are used without sending information for generating partial decoder descriptions. Although only the basic information about which codec, profile and level is used by the conventional bitstream 316, the decoding processing unit 320 can decode using the indicated partial decoder descriptions.

For this purpose, SET 660, CSCIT 640, FL 610, FU-CSCIT 630, DVT 680, and the like are described for each application standard (i.e., codec), F-RT 420, S The RT 460 may be described for each profile of each applicable standard (see Tables 10 and 11).

Table 10. Table breakdown by codec

Standard Table separator MPEG-1 SET # 1 FL # 1 FU-CSCIT # 1 CSCIT # 1 DVT # 1 MPEG-2 SET # 2 FL # 2 FU-CSCIT # 2 CSCIT # 2 DVT # 2 MPEG-4 SET # 3 FL # 3 FU-CSCIT # 3 CSCIT # 3 DVT # 3 AVC SET # 4 FL # 4 FU-CSCIT # 4 CSCIT # 4 DVT # 4

Table 11.Table Classification by Profile and Level

SI Table separator MPEG-1 F-RT # 1-1 S-RT # 1-1 MPEG-2 MP F-RT # 2-1 S-RT # 2-1 MPEG-4 SP F-RT # 3-1 S-RT # 3-1 MPEG-4 ASP F-RT # 3-2 S-RT # 3-2 AVC BP F-RT # 4-1 S-RT # 4-1

For MPEG-4 SP, the decoding method is explained using SET # 3, FL # 3, CSCIT # 3, FU-CSCIT # 3, DVT # 3, F-RT # 3-1, and S-RT # 3-1. If the codec number is 3 and the profile and level number are 2 and transmitted, the decoding processing unit 320 may perform a decoding operation with reference to tables corresponding thereto.

In addition, as illustrated in FIG. 17, the extended bitstream 305 may be provided with an encoded decoder description 313 corresponding to all the partial decoder descriptions described above. In this case, the SI 810 will be set to 01 when referring to Table 9. Each table has a table identifier (TI) 1710, a table start code (TS Code), a table start code (1720), a table description (TD, Table Description) 1730, and a table end code (TE Code, Table). End Code) 1740. The order of the table identifier 1710 and the table start code 1720 may be changed, and the table description 1730 may be described in the form of a binary description. Of course, the order of each table can be changed.

In addition, as illustrated in FIG. 18, the extended bitstream 305 may include some partial decoder descriptions and a codec number corresponding to some partial decoder descriptions described above. In this case, the SI 1610 will be set to 10 when referring to Table 9. However, in this case, since the formats of the partial decoder descriptions are not uniform, it may be preferable to further include a configuration identifier 1810 after the table identifier 1710 so as to determine what type of partial decoder description is configured. will be.

In addition, as illustrated in FIG. 19, the extended bitstream 305 may further include decoder description (DD-T) 1910 and update information for the partial decoder description. The decoder description 1910 for the partial decoder description can be any of the partial decoder descriptions described above with reference to the associated figures, and the SI 1610 will be set to the corresponding value. The update information may include an update start code (RS code) and an update content (Revision 1930).

The update content 1930 may be content such as adding, deleting, or updating rule information of an arbitrary partial decoder description. Its form is 'insert index into table-name (…);', 'delete index from table-name;', 'update index in table-name (…);' And the like. For example, if you want to add S100 to SET # 4, the update 1230 is 'insert S100 into SET # 4 ("READ 1; IF (IBS == 1) {SET C31;}");' It may be configured in the form of.

The partial decoder of the contents changed in the description storage unit 410 while the description decoder 1405 reads the above updated contents 1930 and the decoding processing unit 320 performs decoding on the corresponding extended bitstream 305. Allow descriptions to be stored. However, when decoding is completed, the corresponding partial decoder descriptions stored in the description storage unit 410 should be restored to their original state. Whether the decoding is completed may be recognized by the decoding processing unit 320 or the trigger by providing the completion notification to the description decoder 405, or by the description decoder 405 monitoring the completion of the decoding processing unit 320.

As described above, according to the present invention, an existing profile may be used by using functional units provided by a conventional standard (ie, a codec), or a new decoder may be configured by using existing functional units. In addition, a new decoder may be implemented using a new function unit. That is, various and unlimited decoder implementations are possible.

However, when adding a new functional unit (Functional Unit) to the toolbox 415, the algorithm for the functional unit (that is, description of the functional unit) will have to add the information to the FL (610). In this case, a compilation process for the algorithm may be additionally required.

In order to implement the integrated codec, each component must be organically controlled to parse a bitstream compressed by various coding methods and decode the bitstream by a decoding method corresponding to the corresponding coding method.

In this case, the corresponding bitstream may be a bitstream composed of various shapes in which various standards (codecs) are mixed or various types of bitstreams generated by various coding schemes within one standard. In addition, in order to support various encoding / decoding methods, various functions used in various standards are divided into separate units, and only one function and a function required by the user are selected to select one codec (encoder and decoder). You should be able to make it.

As described above, the present invention has an advantage that the functional description can be organically connected and controlled by the same information interpretation method regardless of the encoding scheme in which the conventional bitstream 316 is provided by providing the decoder description together.

In addition, another advantage of the present invention is that even if the syntax of the bitstream is changed or newly added, the S-RT 670 may enable active response only by modifying the corresponding information or inserting additional information. In addition, the F-RT 620 is configured by selecting a function desired by the user in units of processing such as a bit stream level, a frame level, and a macroblock level (MB-level). There is also an advantage in that the connection relationship of the decoding processing unit 320 functional units can be set.

20 is a diagram showing the configuration of an extended bitstream according to the fifth embodiment of the present invention, FIG. 21 is a diagram showing the configuration of an extended bitstream according to the sixth embodiment of the present invention, and FIG. FIG. 23 is a diagram illustrating a configuration of an extended bitstream according to the seventh embodiment, and FIG. 23 is a diagram illustrating a configuration of an extended bitstream according to an eighth embodiment of the present invention.

The extended bitstream 305 according to the present invention consists of an encoded decoder description 313 and a conventional bitstream 316. It will be apparent to those skilled in the art that the conventional bitstream 316 consists of coded video data (or / and coded audio data).

Here, the encoded decoder description 313 may be formed in a different structure according to the codec characteristic to be applied to decode the conventional bitstream 316. That is, first, when using a single codec standardized in the prior art, the first decoder description structure may be applied.

Secondly, some content of one codec that has been standardized in the prior art may be modified (that is, some of the partial decoder descriptions of the above-described partial decoder descriptions may use the partial decoder description content corresponding to the corresponding codec as it is and other partial decoder descriptions may be used. The second decoder description structure may be applied.

Third, process and use table information of a plurality of codecs that have been standardized in the prior art (i.e., some tables of the above-described partial decoder descriptions selectively use the content of partial decoder descriptions of the conventional plurality of codecs and modify other partial decoder descriptions. Third decoder description structure may be applied.

Fourth, the fourth decoder description structure may be applied when using a new codec that is not conventionally standardized (i.e., transmitting all of the above-described partial decoder descriptions composed of new contents).

Each of the four decoder description structures described above may be classified as different codec type information. For example, "codec_type = 0" for the first decoder description structure, "codec_type = 1" for the second decoder description structure, and "codec_type = 2" for the third decoder description structure. In the case of the fourth decoder description structure, it may be set to "codec_type = 3".

A first decoder description structure is illustrated in FIG. 20. According to the first decoder description structure, the encoded decoder description 313 may be composed of a codec type (codec_type) 2010, a codec number (codec_num) 2020, and a profile and level number (profile_level_num) 2030. . That is, according to the first decoder description structure, only the information about the codec to be applied is described in the decoder description area. Although each field is illustrated as 8 bits in the figure, it is obvious that the size of each field may be added or subtracted according to the size of information to be represented.

The codec type 2010 will be set to 0 (i.e., codec_type = 0), which means that the codec type 2010 uses one of various codecs standardized as it is.

A second decoder description structure is illustrated in FIG. 21. According to the second decoder description structure, the encoded decoder description 313 may include a codec type (codec_type) 2010, a codec number (codec_num) 2020, a profile and level number (profile_level_num) 2030, and a table description 2110. It can be composed of). That is, according to the second decoder description structure, the encoded decoder description 313 is described based on the information about the codec to be applied and the contents which are modified among the partial decoder descriptions. Here, the table description is provided separately for each of the partial decoder descriptions. That is, a plurality of partial decoder descriptions may exist in the encoded decoder description 313.

Each table description 2110 includes a table start code (Table_start_code) 2120, a table identifier (Table_identifier) 2130, a table type (Table_type) 2140, a content 2145, and a table end code (Table_end_code) as illustrated. 2150). Of course, the size of each field can be increased or decreased as needed. In addition, as described below, the content 2145 may be omitted or included according to the information of the table type 2140.

For example, if the value of the table type 2140 is 0, the existing partial decoder description (that is, the codec type (codec_type) 2010, the codec number (codec_num) 2020), the profile and level number (profile_level_num) 2030 and It can be recognized to be applied without modification of the partial decoder description recognized by the table identifier 2130. In this case, the content 2145 may be omitted.

However, if the value of the table type 2140 is 1, the existing partial decoder description (that is, codec type (codec_type) 2010, codec number (codec_num) 2020), profile and level number (profile_level_num) 2030, and table identifier The partial decoder description recognized by 2130 may be recognized for use with some modification (ie, with the content defined in content 2145). In this case, the modified content (for example, an update command) may be described in the content 2145. For example, modifications (such as update commands) may include commands such as update, insert, and / or delete to include partial decoder descriptions of the corresponding indexes of the table. It may be information to modify the.

However, if the value of the table type 2140 is 2, the existing partial decoder description (that is, codec type (codec_type) 2010, codec number (codec_num) 2020), profile and level number (profile_level_num) 2030, and table identifier The partial decoder description recognized by 2130 may be fully modified (i.e., changed to the content defined in content 2145) to be used. In this case, the changed content 2145 may describe changed contents (for example, contents for newly defining a corresponding table such as a new command).

A third decoder description structure is illustrated in FIG. 22. According to the third decoder description structure, the encoded decoder description 313 may consist of a codec type (codec_type) 2010 and a table description 2110. That is, according to the third decoder description structure, the encoded decoder description 313 is configured based on information about a codec to be applied and contents which are modified among partial decoder descriptions. Here, the table description is provided separately for each of the partial decoder descriptions. That is, encoded decoder description 313 may relate to a plurality of partial decoder descriptions.

Each table description 2110 includes a table start code (Table_start_code) 2120, a table identifier (Table_identifier) 2130, a table type (Table_type) 2140, a content 2145, and a table end code (Table_end_code) as illustrated. 2150). Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 2140 is 0, the existing partial decoder description (that is, the codec type (codec_type) 2010, the codec number (codec_num) 2020), the profile and level number (profile_level_num) 2030 and It can be recognized to be applied without modification of the partial decoder description recognized by the table identifier 2130. That is, the codec number (codec_num) 2020 and the profile and level number (profile_level_num) 2030 corresponding to the partial decoder description to be applied in the content 2145 field are described.

However, if the value of the table type 2140 is 1, the existing partial decoder description (that is, codec type (codec_type) 2010, codec number (codec_num) 2020), profile and level number (profile_level_num) 2030, and table identifier The partial decoder description recognized by 2130 may be recognized to be partially modified (that is, modified to contents defined as the modified contents). In this case, the codec number (codec_num), profile and level number (profile_level_num) corresponding to the table to be applied in the content 2145 field are described, and the modified content (for example, update command, etc.) is described in the modification field. Can be.

However, if the value of the table type 2140 is 2, then the existing partial decoder description (i.e., the partial decoder description recognized by the table identifier 2130) is completely changed (i.e. the content defined in the content 2145 field). Can be recognized for use. In this case, the changed contents (for example, contents for newly defining a corresponding table such as a new command) may be described in the contents 2145 field. That is, when the table type 2140 is 0 or 1 as described above, since a specific codec is used as it is or some partial decoder description is modified and used, information about the codec (ie, codec number (codec_num), profile, and level) is used. Number (profile_level_num)) is required, but if the table type 2140 is 2, completely new table information is defined, so no separate codec information is required.

A fourth decoder description structure is illustrated in FIG. According to the fourth decoder description structure, the encoded decoder description 313 may include a codec type (codec_type) 2010 and a table description 2110. That is, according to the fourth decoder description structure, the partial decoder description area is described around the partial decoder descriptions, and the table description is provided for each partial decoder description separately.

Each table description 2110 includes a table start code (Table_start_code) 2120, a table identifier (Table_identifier) 2130, a table type (Table_type) 2140, a content 2145, and a table end code (Table_end_code) as illustrated. 2150). Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 2140 is a predetermined value (e.g., 2), then the content 2145 field contains information (e.g., for describing a new partial decoder description corresponding to the table identifier 2130). , new command, etc.) to display a new definition of the partial decoder description. As described above, when the codec type 2010 is 3, it is recognized that decoding is performed using new partial decoder descriptions, so that only one table type 2010 may be designated or the table type 2010 may be omitted. have.

Hereinafter, the syntax structure of the encoded decoder description 313 and the syntax structure of each field will be illustrated as respective tables.

Table 12. Decoder description

Decoder_Description () { No. of bits codec_type 8 If ((codec_type == 0x00) || (codec_type == 0x01)) { Codec_Description () } If (codec_type! = 0x00) { do { Table_Description () } while (next_bits () == table_idetifier) } }

Table 13. Codec description

Codec_Description () { No. of bits codec_num 8 profile_level_num 8 }

Table 14. Table description

Table_Description () { No. of bits table_start_code 24 table_identifier 4 table_type 4 if ((table_type == '0000') || (table_type == '0001')) { if (codec_type == 0x02) Codec_Description () if (table_type == '0001') Update_Description () } if (table_type == '0010') { New_description () } table_end_code 24 }

Table 15. Update description

Update_Description () { No. of bits Mnemonic   Update_Command vlclbf }

Table 16. New description

New_Description () { No. of bits Mnemonic New_command vlclbf }

The semantics of the decoder description are described below as respective tables.

Table 17. Decoder description

codec_type Meaning 0x00 A profile @ level of an existing MPEG standard 0x01 Some parts of the existing one profile @ level changed 0x02 Some parts of the existing multiple profile @ level changed 0x03 A new decoding solution 0x04-0xFF RESERVED

Here, the codec type is an 8-bit code and may be information for identifying the type of the codec.

Table 18. Codec description

codec_num MPEG standards and others 01 MPEG-1 02 MPEG-2 03 MPEG-4 Part 2 04 MPEG-4 Part 10 (AVC) 05-FF RESERVED

Here, the codec number codec_num is an 8-bit code and may be information indicating a code of a used codec. In addition, the profile and level number (profile_level_num) is an 8-bit code and may be information for indicating the number of the profile and the level for the codec. The profile and level numbers may match the profile and level numbers of each MPEG standard.

Table 19. Table description (table identifier)

table_identifier table name 0000 SET (Syntax Element Table) 0001 Syntax Rule Table (S-RT) 0010 CSCIT (CSCI Table) 0011 DVT (Default Value Table) 0100 FL (FU List) 0101 F-RT (FU Rule Table) 0110 FU-CSCIT (FU CSCI Table) 0111-1111 RESERVED

Here, the table start code (table_start_code) may be a 26-bit string 0xFFFFFE in hexadecimal, which may mean the start of a table description. The table identifier (table_identifier) may be each 4-bit code as shown in Table 12 above.

Table 20. Table description (table type)

table_type Meaning 0000 conventional table 0001 updated table 0010 new table 0011-1111 RESERVED

Here, the table type is information for determining whether to maintain an existing table with a 4-bit value, update an existing table, or create a new table. The table end code (table_end_code) may be a 26-bit string 0xFFFFFF in hexadecimal, which may mean the end of the table description.

Table 21. Instruction set for update command (update_command)

Code Instruction Usage 00 UPDATE UPDATE [index #] in [table #] [a record]; 01 INSERT INSERT into [table #] [a record]; 10 DELETE DELETE [index #] from [table #]; 11 RESERVED

Here, index # may be a 4-bit string indicating an index number of an arbitrary table, and table # may be a 32-bit string as a table identifier.

Table 22. Instruction set for new command (new_command)

Code Instruction Usage 00000001 READ READ bits B> CSCI; 00000010 SEEK SEEK bits B> CSCI; 00000011 FLUSH FLUSH bits B; 00000100 IF IF (condition) {~} ELSE {~} 00000101 WHILE WHILE (condition) {~} 00000110 UNTIL UNTIL (condition) {~} 00000111 ~ 0 DO-WHILE DO {~} WHILE (condition) 00000111 ~ 1 DO ~ UNTIL DO {~} UNTIL (condition) 00001000 (~) (compute) (………) 00001001 BREAK BREAK; 00001010 SET SET CSCI, CSCI; 00001011 STOP STOP; 00001100 PUSH PUSH CSCI Value, Value; 00001101 RLD RLD index, level, run, islastrun, t #; 00010010 VLD2 VLD2 [T #] in> v1, v2, v3; 00010100 VLD4 VLD4 [T #]> CSCI;

Here, bits are any of 3 to 34 bits indicating the number of bits required, and B is a 1-bit string indicating byte alignment. ">" Is a 1-bit string for printing the output on the left, and VLD2 (for MPEG-2) and VLD4 (for MPEG-4) are functions for entropy coding.

24 is a block diagram of an encoder according to an embodiment of the present invention.

The encoder 2400 according to the present invention further includes an extended bitstream generation and output unit 2410 as compared to the conventional encoder 200 described with reference to FIG. 2. The extended bitstream generation and output unit 2410 may control information (eg, a list and connection relations of the functional units used, input of the corresponding functional units) in the process of generating the conventional bitstream 316 generated by processing up to the front end. Data, syntax information, syntax connection information, etc.) to generate a decoder description. In addition, the extended bitstream 305 is generated using the generated decoder description 313 and the conventional bitstream 316 and transmitted to the decoder 300.

The method of generating the decoder description will be fully understood by those skilled in the art based only on the above descriptions, and thus description thereof will be omitted. In addition, when a person skilled in the art refers to the foregoing description, the encoder 2400 may also include a tool box including a plurality of functional units, and one or more encoding standards may be provided through sequential or organic combinations of the functional units included in the tool box. It will be readily understood that the bitstream generation according to the present invention will be possible.

In addition, in the present specification, the variable length encoding unit 235 refers to any component (for example, an encoding unit) that performs encoding in order to generate the conventional bitstream 316 in the encoder 2400. The present invention is not limited thereto, and the scope of the present invention is not limited thereto.

FIG. 24 is a diagram illustrating a case in which an extended bitstream 305 generated using decoder description information and a conventional bitstream 316 is provided to a decoder.

However, as described above, the decoder description may be delivered to the decoder 300 in the form of separate data or bitstream. In this case, an encoded decoder description 313 generation and an output unit (not shown) are positioned after the variable length encoding unit 235 to decode the encoded decoder description generated independently of the conventional encoding unit 200. Obviously, it may be provided to the device 300.

In the description of the integrated codec apparatus and method according to the present invention, the decoder has been described with reference to the decoder. However, the interrelationship between the decoder and the encoding period is apparent to those skilled in the art. Obviously, the invention is not limited to decoders.

As described above, the integrated codec device and method according to the present invention facilitate the interpretation of syntax elements and control of the connection of functional units within one standard (or codec) or between different standards (or codecs). That is, it is not a problem to change the order of syntax elements, insert new syntax elements, or delete existing syntax elements in a bitstream generated according to a specific standard.

In addition, according to the related art, when the syntax element is manipulated, the decoder cannot decode the corresponding bitstream normally. For example, if the bitstream information is ABC and the bitstream is changed to ACB to configure and transmit the bitstream, the decoder cannot recognize the bitstream and thus normal decoding is not possible. The same applies to the case where a new stream is inserted into an ABFC, or a B is deleted to form a bitstream with AC.

However, using the integrated codec apparatus and method according to the present invention, since the decoder description information is provided as data included in the extended bitstream or as independent data, the decoder 300 can perform a smooth decoding operation.

So far, the decoding apparatus and the syntax parsing method for decoding the bitstream according to the present invention have been described based on MPEG-4 AVC, but the MPEG-1, MPEG-2, MPEG-4 and other video encoding / decoding standards Naturally, the same can be applied without any limitation.

In addition, the information included in each decoder description is not described only with information about connection relations of functional units for performing decoding by one standard, processing processes required for the corresponding functional unit, and the like. It is obvious that the information may be described.

For example, assume that an initial plurality of frames of encoded video data included in the extended bitstream are encoded in MPEG-2, subsequent frames are encoded in MPEG-4, and the remaining frames are encoded in MPEG-1. lets do it. In this case, the decoder description information included in the decoder description for decoding the encoded video data may be operated by combining the functional units according to each standard included in the tool box 510 for each frame having a different encoding method. It is obvious that it will be implemented.

As described above, the integrated codec apparatus and method according to the present invention are encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.). The decoded bitstream can be decoded with the same information recognition scheme.

In addition, the present invention is an effect that can generate an extended bitstream with a decoder description (decoder description) to decode the bitstream encoded in various formats (syntax, semantics) according to each standard in the same information recognition method There is also.

In addition, the present invention has an effect of more efficiently describing the decoder description by applying the hierarchical structure of the codec to the syntax parsing and decoding process.

In addition, the present invention proposes scheduling management of each codec and an organic processing structure (eg, a parallel combining structure, a serial merging structure, an independent processing structure, an individual processing structure, etc.) of each codec using a decoder description. There is also an effect that can be done.

In addition, the present invention has the effect that it is possible to design and build a variety of systems only by the decoder description described.

In addition, the present invention parses a bitstream compressed by various encoding schemes by the same information analysis method, and can organically control functional units (FU) for decoding using the parsed data. There is also an effect.

In addition, the present invention has the effect that can be commonly applied to the syntax analysis method for decoding various types of bitstream.

In addition, the present invention has the effect of applying a new set of instructions for parsing various types of bitstreams with a common syntax analysis method.

In addition, the present invention also has the effect that the decoder can easily decode the bitstream even when the syntax element is changed or added.

In addition, the present invention has an effect that allows the components used for bitstream decoding to share the element information (the result of parsing the syntax) of the parsed syntax.

In addition, the present invention also has the effect that the element information of the parsed syntax can be used for the interpretation of subsequent bitstream syntax elements.

In addition, the present invention also has an effect that can be used when integrating a moving picture or still picture codec that processes block units other than MPEG-1, MPEG-2, MPEG-4, and MPEG-4 AVC.

In addition, the present invention has an effect that can be stored in a toolbox by dividing the functions constituting various decoding methods proposed by various standards (codecs) into functional units (FU).

In addition, the present invention has the effect that it is possible to selectively decode only the functional units required in the toolbox to decode the bitstream encoded in various forms.

In addition, the present invention has an effect that it is easy to change, add, or delete a function unit stored in a toolbox.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

Claims (33)

A decoder forming unit for generating and outputting CSCI control information and connection control information using partial decoder descriptions stored in the description storage unit; A tool box including a plurality of functional units implemented to perform a predetermined process, respectively; And And a decoding solution configured to load a plurality of functional units included in the toolbox in units of layers by using the syntax parsing control information and the connection control information to decode the bitstream into video data. The method of claim 1, And a description decoder which decodes the input encoded decoder description to generate a decoder description and stores a plurality of partial decoder descriptions separated from the decoder description in the description storage unit. The method of claim 1, And the toolbox includes at least one parsing function for parsing the syntax of the bitstream and a plurality of decoding functions for decoding the bitstream. The method of claim 1, The decoder forming unit, A FU checking unit for determining whether a plurality of functional units described in any partial decoder description are provided in the tool box; And And an information processing unit for generating the syntax parsing control information and the connection control information using the partial decoder descriptions. The method of claim 1, The decoding solution, A control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units; And And a connection controller configured to control an operation of each functional unit through selective loading of a plurality of functional units by referring to the syntax parsing control information and the connection control information. The method of claim 1, The decoding solution, A control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units; At least one parsing function for parsing the bitstream according to the syntax parsing control information; And Including a connection control unit for controlling the operation of each functional unit through the selective loading of a plurality of functional units with reference to the connection control information, The toolbox is provided with a plurality of decoding functions for decoding the bitstream decoding device. The method according to claim 5 or 6, And the decoding solution comprises a working memory for causing one or more functional units to be loaded and operated. The method of claim 2, And a separator for separating and outputting the encoded decoder description and the bitstream when the encoded decoder description and the bitstream are input as a unified integrated bitstream. The method of claim 1, When the encoded video data is encoded by a plurality of standards, the decoding solution sequentially loads a plurality of functional units performing a process according to a plurality of standards with reference to the connection control information to generate and output the video data. Decoding apparatus, characterized in that. The method of claim 1, And the connection control information includes information about a layer of functional units, and the decoding solution makes an inter-layer call to one or more functional units with reference to the information. The method of claim 10, The decoding solution controls the object generation and execution of the highest layer, and the decoding unit characterized in that the function unit included in the highest layer by the object execution and the calling unit for the call of the layer designated by the layer information is loaded. . The method of claim 11, And the caller loads the corresponding layer when one or more functional units belonging to the corresponding layer are stored in the storage unit, wherein the processing data necessary for performing a predetermined process is stored in the storage unit. The method of claim 12, The loaded functional unit starts processing when the processing data for performing a designated process is stored in the storage unit. The method of claim 12, Decoding device, characterized in that the result data by the process of each functional unit is stored in the storage unit. The method of claim 10, The hierarchical structure recognized by the information about the layer is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and a lower layer is called by an upper layer Decoding device. The method of claim 12, And a dedicated storage space is allocated to each of the decoding functions in the storage. The method of claim 12, The storage unit, A CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function; And And a data storage unit for storing data corresponding to the encoded video data generated by the parsing function unit and data for decoding processing which is one or more of processing data processed by the decoding function unit. The method of claim 1, Partial decoder descriptions stored in the description storage unit may include: A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And the decoding function unit is a FU-CSCIT indicating CSCI information necessary for performing a process. The method of claim 18, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding is further stored in the description storage unit as a partial decoder description. The method of claim 19, The syntax parsing control information is generated by referring to at least one of the SET, the S-RT, the DHT, the CSCIT, and the DVT. The method of claim 18, The connection control information is generated by referring to at least one of the FL, the F-RT, the DHT, and the FU-CSCIT. The method of claim 2, And the decoder description is composed of one or more division regions, and information for configuring the partial decoder description is inserted into each division region. The method of claim 22, The partial decoder description includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the description decoder extracts n tables corresponding to the specified information among a plurality of partial decoder descriptions previously stored in the description storage unit. The method of claim 22, M (arbitrary natural numbers) of the division areas include codec numbers (Codec No.) and corresponding information corresponding to profile and level numbers (Profile and level No.) for corresponding partial decoder descriptions, The k partitions contain binary code information for constructing corresponding partial decoder descriptions, The description decoder extracts m partial decoder descriptions corresponding to the specified information among a plurality of partial decoder descriptions previously stored in the description storage unit, generates k tables using the binary code information, and stores the description. And a decoding apparatus. (a) generating and storing a plurality of partial decoder descriptions corresponding to the input decoder description; (b) generating CSCI control information and connection control information using the partial decoder descriptions; (c) storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And (d) decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information. The method of claim 25, The step (c) and the step (d) are performed by a functional unit loaded in a hierarchical unit among a plurality of functional units provided in a tool box by referring to the CSCI control information or the connection control information. Decoding method characterized in that each is executed. The method of claim 25, The step (d) is repeatedly performed until the result of the process of the plurality of functional units started by the selective load of the connection control unit is the video data. The method of claim 27, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. The method of claim 26, And the result data of the preceding functional unit among the plurality of functional units loaded in hierarchical units is recorded in a buffer memory accessible by the subsequent functional unit. The method of claim 26, And the connection control unit provides the result data of the preceding functional unit among the plurality of sequentially loaded functional units as input data of the subsequent functional unit. The method of claim 25, Partial decoder descriptions stored in the description storage unit may include: A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And the decoding function unit is a FU-CSCIT indicating CSCI information necessary for performing a process. The method of claim 31, wherein And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding is further stored in the description storage unit as a partial decoder description. In a recording medium in which a program of instructions that can be executed in a decoding apparatus is tangibly implemented to perform a decoding method, and in which a program that can be read by the decoding apparatus is recorded, Generating and storing a plurality of partial decoder descriptions corresponding to the input decoder description; Generating CSCI control information and connection control information using the partial decoder descriptions; Storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And And decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information.

Images