KR100813435B1 - Device and method for encoding/decoding bit-stream - Google Patents

Abstract

A bit stream encoding/decoding method and apparatus are provided to generate an extended bit stream having a decoding description so that bit streams encoded in various formats can be decoded according to the same information recognition method. A description decoder(320) generates table information corresponding to a decoding description received from an encoder and stores it in a table storage unit(330). A decoding unit(340) decodes encoded video data included in a bit stream received from the encoder into video data by using the table information stored in the table storage unit(330). The decoding description includes one or more table regions, and table information is inserted into each table region to configure a table. The decoding unit(340) includes a tool box having a plurality of function parts implemented respectively to process a previously designated process, and a storage unit for storing one or more of CSCI(Control Signal/Context Information) generated by performing a process by one or more function parts and data to be decoded.

Description

Device and method for encoding / decoding bit-stream}

1 is a diagram schematically showing a configuration of a general decoder.

2 is a diagram schematically illustrating a configuration of a general encoder.

3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention.

4 is a diagram schematically illustrating a configuration of an extended bit-stream according to an embodiment of the present invention.

5 is a diagram schematically illustrating a configuration of a decoding unit according to an embodiment of the present invention.

FIG. 6 is a diagram schematically illustrating a configuration of a SYN parser according to an embodiment of the present invention. FIG.

7 is a diagram schematically illustrating a configuration of a decoding processing unit according to an embodiment of the present invention.

8 illustrates a configuration of an extended bitstream according to the first preferred embodiment of the present invention.

9 illustrates a configuration of an extended bitstream according to the second preferred embodiment of the present invention.

10 is a diagram showing the configuration of an extended bitstream according to the third preferred embodiment of the present invention.

11 is a diagram showing the configuration of an extended bitstream according to a fourth preferred embodiment of the present invention.

12 is a diagram showing the configuration of an extended bitstream according to the fifth preferred embodiment of the present invention.

13 is a diagram showing the configuration of an extended bitstream according to the sixth preferred embodiment of the present invention.

14 illustrates a configuration of an extended bitstream according to the seventh preferred embodiment of the present invention.

15 is a diagram showing the configuration of an extended bitstream according to an eighth preferred embodiment of the present invention.

FIG. 16 illustrates a hierarchical structure defined by a decoding hierarchy table (DHT) according to an embodiment of the present invention. FIG.

FIG. 17 is a diagram illustrating an inter-layer call structure and an intra-layer connection structure defined by a Syntax Rule Table (S-RT) according to an embodiment of the present invention. FIG.

18 is a diagram for explaining an interface set for a functional unit applied to a plurality of standards according to an embodiment of the present invention.

19 is a diagram illustrating a connection structure of dedicated buffer spaces between nodes of each layer according to an embodiment of the present invention.

FIG. 20 is a view illustrating a inclusion relationship of a dedicated buffer space for storing CSCI data according to an embodiment of the present invention. FIG.

FIG. 21 is a view illustrating a inclusion relationship of a dedicated buffer space for storing output data by a functional unit according to an embodiment of the present invention; FIG.

FIG. 22 conceptually illustrates parallel processing of syntax parsing and data decoding according to an embodiment of the present invention. FIG.

The present invention relates to an integrated codec, and more particularly to a method and apparatus for bitstream encoding / decoding.

In general, a video is converted into a bitstream by an encoder. In this case, the bitstream is stored according to an encoding type satisfying the constraint of the encoder.

MPEG requires syntax (hereinafter referred to as 'syntax') and semantics (hereinafter referred to as 'semantics') as constraints of the bitstream.

syntax indicates the structure, format, and length of the data, and in what order the data is represented. That is, syntax is to fit a grammar for encoding / decoding, and defines the order of each element included in the bitstream, the length of each element, and the data format.

Semantics means what each bit of data means. That is, semantics indicates what the meaning of each element in the bitstream is.

Therefore, various types of bitstreams may be generated according to encoding conditions of an encoder or an applied standard (or codec). In general, each standard (eg MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) has a different bitstream syntax.

Accordingly, bitstreams encoded according to each standard or encoding condition may have different formats (ie, syntax and semantics), and a decoder corresponding to an encoder should be used to decode the bitstream.

As described above, the conventional bitstream decoder has a limitation of satisfying the constraints of the encoder, and this limitation causes a difficulty in implementing an integrated decoder corresponding to a plurality of standards.

Accordingly, the present invention is to solve the above-described problem, and is encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) Disclosed is a method and apparatus for decoding a bitstream capable of decoding the bitstream in the same information recognition scheme.

Another object of the present invention is to generate an extended bitstream to which a decoding description is added so that a bitstream encoded in various formats (syntax, semantics) according to each standard can be decoded in the same information recognition scheme. To provide a bitstream encoding method and apparatus.

It is still another object of the present invention to parse a bitstream compressed by various encoding schemes by the same information analysis method, and to control organically each functional unit (FU) for decoding using the parsed data. The present invention provides a method and apparatus for decoding a bitstream.

It is still another object of the present invention to provide a bitstream encoding method and apparatus for more efficiently describing a decoding description by applying a hierarchical structure of a codec to a syntax parsing and decoding process.

Still another object of the present invention is to use scheduling description of each codec to manage scheduling and organic processing structure of each functional unit (eg, parallel combining structure, serial merging structure, independent processing structure, and individual processing structure). It is to provide a method and apparatus for decoding a bitstream that can present.

It is still another object of the present invention to provide a bitstream encoding method and apparatus capable of designing and building various systems with only the described decoding description.

It is still another object of the present invention to provide a bitstream encoding / decoding method and apparatus for applying a syntax analysis method for decoding various types of bitstreams in common.

It is still another object of the present invention to provide a bitstream encoding / decoding method and apparatus capable of applying a new set of instructions for parsing various types of bitstreams using a common syntax analysis method.

It is still another object of the present invention to provide a bitstream decoding method and apparatus capable of easily decoding a bitstream even when a syntax element is changed, added, or deleted.

It is still another object of the present invention to provide a bitstream decoding method and apparatus for making element information (ie, a result of parsing a syntax) of an interpreted syntax available to components used for bitstream decoding.

It is yet another object of the present invention to provide a bitstream decoding method and apparatus which makes it possible to use element information of an already parsed syntax for interpretation of subsequent bitstream syntax elements.

It is still another object of the present invention to provide a method and apparatus for decoding a bitstream including functions in a tool box by dividing functions included in various decoding processes proposed by various standards (codecs) into functional units (FU). To provide.

It is still another object of the present invention to provide a method and apparatus for decoding a bitstream selectively using only functional units required by a toolbox to decode a bitstream encoded in various forms.

It is still another object of the present invention to provide a bitstream decoding method and apparatus that is easy to change, add, or delete a functional part stored in a toolbox.

It is still another object of the present invention to integrate codecs for bitstream decoding, to generate decoding descriptions for the bitstreams to be processed by the same information analysis method, and to internationally standardize the implementation of extended bitstreams. The objects of the present invention will become more apparent through the preferred embodiments described below.

According to an aspect of the present invention to achieve the above object, there is provided an encoder / decoder and / or integrated codec device that can be used universally in various standards.

Decoding apparatus according to an embodiment of the present invention comprises a table information storage unit; A description decoder for generating n (random natural numbers) table information corresponding to the decoding description received from the encoder and storing the table information in the table information storage unit; The decoder may include a decoder configured to decode encoded video data included in a bitstream received from the encoder into corresponding video data by using the table information stored in the table information storage unit.

The decoding unit may include a tool box including a plurality of functional units each implemented to process a predetermined process; And a storage unit for storing one or more of CSCI (Control Signal / Context Information) information generated by process execution by one or more functional units and data for decoding processing. Here, the plurality of functional units may include one or more parsing functional units for syntax parsing of the bitstream, and a plurality of decoding functional units for decoding processing of the encoded video data. In addition, the decoding functions may determine whether to activate or call in accordance with the hierarchical structure of the encoded video data.

The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and a lower layer may be called by an upper layer.

Each of the plurality of functional units may be implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream.

Each of the decoding functions may be started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage.

Dedicated storage space for each of the decoding functions may be allocated.

The storage unit may include a CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function unit; And a data storage unit for storing data corresponding to the encoded video data generated by the parsing unit and data for decoding processing, which is one or more of processing data processed by the decoding unit.

The table information stored in the table information storage unit may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information about lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information stored in the table information storage unit may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

The decoding unit may further include a decoding control unit for controlling activation or calling of one or more decoding functions corresponding to a highest layer using the F-RT.

The parsing function may generate at least one of the CSCI information and the data to be decoded using at least the SET, the S-RT, and the CSCIT.

The decoding function unit may perform a predetermined process using at least the FL, the F-RT, the FU-CSCIT, and the CSCIT.

When the decoding description and the extended bitstream in which the bitstream is integrated are received from the encoder, the decoder may further include a separation unit for separating the decoding description and the bitstream.

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the description decoder is configured in advance in the table information storage unit. Among the plurality of stored tables, n tables corresponding to the designated information may be extracted.

The table information inserted into each of the n table areas includes binary code information for constituting each table, and the description decoder generates n tables using the binary code information and stores them in the table information storage unit. Can be.

M (arbitrary natural numbers) of the n table areas include designation information corresponding to a codec number (Codec No.) and a profile and level number (Profile and level No.) for a corresponding table. The table area (any number of nm) includes binary code information for configuring a corresponding table, and the description decoder includes m pieces corresponding to the designated information among a plurality of tables previously stored in the table information storage unit. Tables may be extracted, k tables may be generated using the binary code information, and stored in the table information storage unit.

Decoding apparatus according to another embodiment of the present invention, the table storage unit; A description decoder for generating n (random natural numbers) table information corresponding to the decoding description received from the encoder and storing the table information in the table storage unit; A plurality of functional units, each of which has a predetermined process to be performed to decode and output encoded video data included in a bitstream received from the encoder into corresponding video data using the table information stored in the table information storage unit; A decoding unit including an information storage unit for storing processing data by each of the functional units; And a decoding controller configured to conform to the hierarchical structure of the encoded video data and to activate or call the functional units belonging to the highest layer. Here, when the processing data for performing the first layer is stored in the information storage unit in accordance with the hierarchical structure, the first layer may be called by the second layer which is in an activated state. The decoding function of the called layer may start processing when processing data for performing a designated process is stored in the information storage unit.

The plurality of functional units may include one or more parsing functions for syntax parsing of a bitstream, and a plurality of decoding functions for decoding processing of the encoded video data. In this case, the processing data stored in the information storage unit may include one or more of CSCI (Control Signal / Context Information) information generated by a process performed by one or more functional units and data for decoding processing.

The decoding functions may be activated or called according to the hierarchical structure of the encoded video data.

The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and a lower layer may be called by an upper layer.

Each of the plurality of functional units may be implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream.

Each of the decoding functions may be started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage.

Dedicated storage space for each of the decoding functions may be allocated.

The storage unit may include a CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function unit; And a data storage unit for storing data corresponding to the encoded video data generated by the parsing unit and data for decoding processing, which is one or more of processing data processed by the decoding unit.

The table information stored in the table information storage unit may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information about lower layers of each layer; A Syntax Element Table (SET) indicating information on bitstream syntax and a process for generating element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information stored in the table information storage unit may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

When the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder, the decoding apparatus may further include a separation unit for separating the decoding description and the bitstream.

According to another exemplary embodiment of the present invention, an encoding apparatus may generate a bitstream including encoded video data corresponding to moving image data by using a plurality of functional units implemented to each perform a function defined by one or more encoding standards. An encoding unit to generate; And a description encoder for generating a decoding description corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data. can do. Here, the bitstream and the decoding description may be provided together with a decoder for decoding the bitstream.

The encoding apparatus may further include an extension bitstream generation and output unit that generates one extension bitstream using the bitstream and the decode description.

The plurality of functional units included in the decoder may include one or more parsing functions for syntax parsing of the bitstream, and a plurality of decoding functions for decoding processing of the encoded video data. In addition, the decoding functions may be activated or called according to the hierarchical structure of the encoded video data by arbitrary table information included in the decoding description.

The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. It may be called by the activated second layer.

The n (arbitrary natural number) table information generated by the description encoder is a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information about lower layers of each layer. ; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

The decoder may control activation or calling of one or more decoding functions corresponding to the highest layer using the F-RT.

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the decoder includes N tables corresponding to the designated information can be extracted and used.

According to another aspect of the present invention for achieving the above object, there is provided a decoding method / encoding method that can be used universally in various standards and / or a recording medium on which a program for executing the method is recorded.

According to an embodiment of the present invention, a decoding method includes: (a) generating and storing a plurality of table information corresponding to the description information when a bitstream and description information are input; And (b) calling the parsing function and the one or more decoding functions belonging to the highest layer using the one or more table information. Herein, the parsing function performs syntax parsing of the bitstream, and the decoding function of the uppermost layer includes CSCI information (Control Signal / Context Information) and data for decoding necessary to perform a predetermined process. If stored in the storage by the parsing function, the processing can be performed. Here, the first layer may be called by the second layer which is in an activated state if CSCI information necessary for performing the first layer and data for decoding are stored in the storage unit according to the hierarchical structure.

The decoding functions may be activated or called according to the hierarchical structure of the encoded video data. Video data corresponding to the bitstream may be output by performing one or more processes of each decoding function specified in the description information.

The hierarchical structure may be composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, and a block layer.

Each of the parsing function and the decoding function may be implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream.

The storage unit may include a CSCI storage unit for storing CSCI information generated by the parsing function unit; And a data storage configured to store data for decoding processing, which is one or more of data corresponding to the encoded video data generated by the parsing function and processing data processed by an arbitrary decoding function.

Each of the decoding functions may be started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage.

Dedicated storage space for each of the decoding functions may be allocated.

The generated table information may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data included in the bitstream and information about lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing a list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

Using the F-RT, activation or invocation of one or more decoding functions corresponding to the highest layer may be controlled.

At least one of the CSCI information and data to be decoded may be generated using at least the SET, the S-RT, and the CSCIT.

When the decoding description and the bitstream are received in the form of an integrated extension bitstream, the step of separating the decoding description and the bitstream may be further performed in step (a).

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

According to another preferred embodiment of the present invention, in a recording medium in which a program of instructions that can be executed in a decoding apparatus for performing a decoding method is tangibly implemented, and a program that can be read by the decoding apparatus is recorded, (a) generating and storing a plurality of table information corresponding to the description information when the bitstream and description information are input; And (b) calling the parsing function and the one or more decoding functions belonging to the highest layer using the one or more table information. Herein, the parsing function performs syntax parsing of the bitstream, and the decoding function of the uppermost layer includes CSCI information (Control Signal / Context Information) and data for decoding necessary to perform a predetermined process. The second layer, which is activated when the storage function is stored in the storage unit, when the storage function is stored in the storage unit. The first layer can be called by.

The decoding functions are activated or called according to the hierarchical structure of the encoded video data, and the video data corresponding to the bitstream is generated by performing one or more processes of the respective decoding functions specified in the description information. Can be output. The hierarchical structure may be composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, and a block layer.

Each of the parsing function and the decoding function may be implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream.

Each of the decoding functions may be started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage.

The generated table information may include: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data included in the bitstream and information about lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

An encoding method according to another preferred embodiment of the present invention is a bitstream including encoded video data corresponding to moving image data using a plurality of functional units implemented to each perform a function defined by one or more encoding standards. Generating a; And generating a decoding description corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data. have. Here, the bitstream and the decoding description may be provided together with a decoder for decoding the bitstream.

The encoding method may further include generating one extended bitstream using the bitstream and the decode description.

The plurality of functional units included in the decoder may include one or more parsing functions for syntax parsing of the bitstream, a plurality of decoding functions for decoding processing of the encoded video data, and the decoding functions. May be activated or called in conformity with the hierarchical structure of the encoded video data based on any table information included in the decoding description.

The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. It may be called by the activated second layer.

The generated n (arbitrary natural number) table information includes: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

The decoder may control activation or calling of one or more decoding functions corresponding to the highest layer using the F-RT.

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the decoder includes N tables corresponding to the designated information can be extracted and used.

According to still another embodiment of the present invention, there is provided a recording medium in which a program of instructions that can be executed in an encoding apparatus to perform an encoding method is tangibly implemented, and in which a program that can be read by the encoding apparatus is recorded, Generating a bitstream comprising encoded video data corresponding to moving image data using a plurality of functional units respectively implemented to perform a function defined by at least one encoding standard; And generating a decoding description corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data. A recording medium having a program recorded thereon, wherein the bitstream and the decoding description are provided together with a decoder for decoding the bitstream.

The program may further execute generating one extended bitstream using the bitstream and the decode description.

The plurality of functional units included in the decoder may include one or more parsing functions for syntax parsing of the bitstream, a plurality of decoding functions for decoding processing of the encoded video data, and the decoding functions. May be activated or called in conformity with the hierarchical structure of the encoded video data based on any table information included in the decoding description.

The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. It may be called by the activated second layer.

The generated n (arbitrary natural number) table information includes: a Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) for specifying a name of CSCI information for storing connection information between the bitstream syntaxes, information on a lower layer to be called for each layer, and result data generated by a process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit.

The table information may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

The decoder may control activation or calling of one or more decoding functions corresponding to the highest layer using the F-RT.

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the decoder includes N tables corresponding to the designated information can be extracted and used.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term “and / or” includes any combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, preferred embodiments of the integrated codec method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are identified by the same reference numerals. The numbering and duplicate description thereof will be omitted.

FIG. 1 is a diagram schematically showing a configuration of a general decoder, and FIG. 2 is a diagram schematically showing a configuration of a general encoder.

As shown in FIG. 1, the MPEG-4 decoder 100 generally includes a variable length decoding unit 110, an inverse scan unit 115, and an inverse DC / AC prediction unit. / AC Prediction (120), Inverse Quantization (125), Inverse Discrete Cosine Transform (Inverse Discrete Cosine Transformation, 130), and Video Restoration (VOP Reconstruction, 135). It is apparent that the configuration of the decoder 100 may be different according to the applied standard, and some components may be replaced with other components.

When the transmitted bitstream 105 is parsed and parsed to extract header information and encoded video data, the variable length decoding unit 110 quantizes the Huffman table using a preset Huffman Table. The inverse scan unit 115 performs the inverse scan to generate data in the same order as the moving image 140. That is, the inverse scan unit 115 outputs a value in reverse of the order of scanning in various ways during encoding. After quantization is performed during encoding, a scan direction may be defined according to a distribution of frequency band values. In general, a zig-zag scan method is used, but the scan method may vary by codec.

Syntax parsing may be performed integrally in the variable length decoding unit 110 or may be performed in any component that processes the bitstream 105 prior to the variable length decoding unit 110. In this case, since syntax parsing is the same as that of the standard applied to the encoder and the decoding period, the syntax parsing is performed only by a predetermined standard corresponding to the standard.

The inverse DC / AC predictor 120 determines the direction of the reference block for prediction by using the magnitude of the DCT coefficient in the frequency band.

The inverse quantizer 125 inverse quantizes the inversely scanned data. That is, the DC and AC coefficients are reduced by using a quantization parameter (QP) specified during encoding.

The inverse DCT unit 130 performs an Inverse Discrete Cosine Transform to obtain an actual video pixel value to generate a VOP (Video Object Plane).

The video reconstruction unit 135 reconstructs and outputs a video signal by using the VOP generated by the inverse DCT unit 130.

As shown in FIG. 2, the MPEG-4 encoder 200 generally includes a DCT unit 210, a quantizer 215, a DC / AC predictor 220, a scan unit 230, and a variable length encoder ( 235).

Each component included in the encoder 200 performs the inverse function of each component of the corresponding decoder 100, which is obvious to those skilled in the art. In brief, the encoder 200 performs encoding by converting a video signal (ie, a digital image pixel value) into a frequency value through a discrete cosine transform, quantization, and the like, and then encoding the information. Variable length encoding that differentiates the bit length according to the frequency is performed and output in the compressed bitstream state.

3 is a diagram schematically showing a configuration of a decoder according to an embodiment of the present invention, and FIG. 4 is a diagram briefly showing a configuration of an extended bit-stream according to an embodiment of the present invention. 5 is a diagram schematically showing a configuration of a decoding unit according to an embodiment of the present invention, FIG. 6 is a diagram schematically showing a configuration of a SYN parser according to an embodiment of the present invention, and FIG. 2 is a diagram schematically illustrating a configuration of a decoding processing unit according to an embodiment of the present invention. 16 is a diagram illustrating a hierarchical structure defined by a decoding hierarchy table (DHT) according to an embodiment of the present invention, and FIG. 17 is a syntax rule table (S-RT) according to an embodiment of the present invention. FIG. 18 is a diagram illustrating a defined inter-layer call structure and an intra-layer connection structure, and FIG. 18 is a diagram for explaining an interface set for functional units applied to a plurality of standards according to an embodiment of the present invention. FIG. 19 is a diagram illustrating a connection structure of dedicated buffer spaces between nodes of each layer according to an embodiment of the present invention, and FIG. 20 includes a dedicated buffer space for storing CSCI data according to an embodiment of the present invention. FIG. 21 is a diagram illustrating a relationship of inclusion of a dedicated buffer space for storing output data by a functional unit according to an embodiment of the present invention, and FIG. 22 is a syntax according to an embodiment of the present invention. A conceptual diagram illustrating parallel processing of parsing and data decoding.

In order to perform the encoding / decoding method according to the hierarchical structure of the present invention, a decoding description is provided to the decoder 300 to be extracted and used as table information or to generate table information. The decoding description may be provided to the decoder 300 by configuring an extended bitstream together with the bitstream, or may be provided to the decoder 300 in a data form independent of the bitstream. Of course, if the table information is previously stored in a specific storage unit of the decoder 300, it is obvious that the provision of the decoding description may be omitted. However, hereinafter, the description will be mainly focused on the case where the decoding description is included in the extended bitstream and provided to the decoder 300.

As shown in FIG. 3, the decoder 300 according to the present invention has a configuration different from that of the conventional decoder (see FIG. 1).

That is, the decoder 300 according to an embodiment of the present invention includes a separator 310, a description decoder (DDD) 320, a table storage 330, and a decoder 340. .

One or more of the components of the illustrated decoder (eg, separator 310, description decoder 320, decoder 340, etc.) may be a software program (or program) implemented to perform the functions described below. It is apparent that the implementation may be implemented in a combination of codes).

The separator 310 separates the input extended bitstream 305 into a decoding description region and a general bitstream 105 (hereinafter, referred to as a conventional bitstream) region. The decoding description is input to the description decoder 320 and the conventional bitstream is input to the decoding unit 340.

That is, the extended bitstream according to an embodiment of the present invention may include decoding descriptions 410 to 470 and a conventional bitstream 105 as illustrated in FIG. 4.

The decoding description is a conventional bitstream for parsing a bitstream coded by various coding schemes (or coding standards) and / or a bitstream 105 coded by a user selected among various functions by a common interpretation scheme. Information on the configuration of 105 and the scheme (or connection information between functional units) of the conventional bitstream 105 is encoded. The decoding description may be included in the extension bitstream 305 (which may be provided to the decoder 310 (see Figure 4). Of course, the decoding description may be provided to the decoder 310 in the form of an independent bitstream or data). The decoding description is described in a description manner that can be recognized and / or interpreted by the description decoder 320, and can be described in a description manner such as textual description or binary description, for example.

Decoding descriptions include Functional Unit List (FL), Functional Unit Rule Table (F-RT) 420, Functional Unit CSCIT (430), Control Signal and Context Information Table (440), and Decoding (DHT). Hierarchy Table 445, Syntax Element Table 450, Syntax-Rule Table 460, Default Value Table DVT, and the like. Obviously, the order of the tables for configuring the decoding description information may be modified in various ways.

Here, FL (Functional unit List, 410), F-RT (Functional unit Rule Table, 420), FU-CSCIT (Functional Unit CSCIT, 430), CSCIT (Control Signal and Context Information Table, 440), DHT (Decoding Hierarchy) Table 445 and the like may be used to establish the connection of each functional unit (FU) (the tables may be referred to as 'first decoding description' if necessary).

The DHT 445 may be information describing a hierarchical structure of each codec and information on lower layers for each layer (see FIG. 16). The hierarchical structure of each codec may be expressed as a structure between an upper layer and a lower layer, for example, a sequence layer, a GOP layer, a VOP layer, a slice layer, a macro block (MB) layer, a block layer, and the like. Each codec may be configured of one or more layers, and may include one or more objects in each layer.

For example, the decoding process of encoded video data composed of a plurality of layers will be briefly described as follows. Of course, the method of decoding the bitstream in conformity with the hierarchical structure is not limited thereto.

 When performing the decoding process, an object of the highest layer (first layer) is first generated and executed, and then all decoding functions included in the object and one or more lower layer (second layer) callers included in the object are executed. Is activated. For example, assuming that the hierarchical structure consists of the first layer, the second layer, and the third layer, one or more layers belonging to the second layer by executing the object of the first layer (eg, the sequence layer). One or more layer calling units belonging to the third layer by executing a second layer object of any one of the second layers being activated (e.g., GOP-1 layer, GOP-2 layer, GOP-3 layer) (E.g., Picture-1 layer, Picture-2 layer, Picture-3 layer, Picture-4 layer, etc. when the object of the GOP-1 layer is executed) is activated. Of course, in the activation process by the inter-layer call in the present invention, the upper layer is not necessarily limited to calling only the lower layer, and it is obvious that the upper layer may be called by the lower layer if necessary based on the table information.

 The decoding functions of the activated layer (first layer) are started when the CSCI information (Control Signal / Context Information) necessary for performing a predetermined process and data for decoding are stored in the storage unit 520.

 The lower layer (second layer) caller of the activated layer (first layer) activates CSCI information (Control Signal / Context Information) and data for decoding that one or more of the decoding functions of the layer to which the layer belongs. When stored in the storage unit 520, an object of the corresponding layer (second layer) is generated and executed. All decoding functions included in the object and one or more lower layer (third layer) calling units included in the object are executed. Is activated

 As described above, a lower layer may be called by performing an object of one layer, the decoding functions of the called layer perform a predetermined process, and the functional parts specified by the decoding description among the functions included in each layer. By this function one or more times, encoded video data is reconstructed and output as moving picture data.

The FU-CSCIT 440 may be decoding description information for mapping between each functional unit in the decoding processing unit 550 and element information stored in the CSCI storage unit 522. In this case, the element information may function as a control variable for each functional unit in the decoding processor 550 and / or the SYN parser 540.

In addition, CSCIT (Control Signal and Context Information Table, 440), DHT (Decoding Hierarchy Table, 445), SET (Syntax Element Table, 450), S-RT (Syntax-Rule Table, 460), DVT (Default Value Table, 470 may be used for syntax parsing of the conventional bitstream 105 (the tables may be referred to as 'second decoding description' if necessary). The form and function of each decoding description information will be described later in detail.

The description decoder 320 stores the decoding description input from the separation unit 310 in the table storage unit 330 as a plurality of tables in a form that can be recognized by the decoding unit 340. Each table stored in the table storage unit does not necessarily need to be a table in a general form, but an information type that can be recognized by the decoding unit 340 is sufficient. That is, the description decoder 320 converts the data included in the extended bitstream 305 in the form of binary data into tables that can be interpreted by the SYN parser 540 and / or the decoding control unit 530. Save to 330.

Tables stored in the table storage unit 330 by the decoding description analysis of the description decoder 320 include FL 410, F-RT 420, FU-CSCIT 430, CSCIT 440, and DHT 445. , SET 450, S-RT 460, DVT 470, and the like. As illustrated in FIG. 9, the description decoder 320 may distinguish each table by referring to a table identifier (TI) 910.

Of course, not all tables must be included in the decoding description, and as illustrated in FIG. 8, a codec number (Codec #, 820) and a profile and level # (830) are included, or FIG. 10. As illustrated in FIG. 2, only some tables may include a codec number (Codec #, 1020) and a profile and level # (1030). If a codec number (Codec #) and a profile and level # are included, the description decoder 320 does not create a new table for all or some of the tables, but is stored in the table storage unit 330 in advance. One of the tables may choose to have the corresponding one used for decoding. Of course, when the codec number (Codec #), profile and level # (Profile and level #) and the correction information is included, the description decoder 320 corresponds to the corresponding codec among the tables previously stored in the table storage unit 330 You can also extract a table to create a new table that reflects the modified information. Of course, if the codec number (Codec #) and the profile and level # (Profile and level #) is not included, the description decoder 320 is used to decode the entire table or a part of the table when the table description for creating the table is included. You can also create a new table to do this.

In addition, the decoding description may further include update information 1130 in addition to the decoding description DD-T 1110 for each table, as illustrated in FIG. 11. The configuration of each extended bitstream will be described in detail later with reference to the accompanying drawings.

The table storage unit 330 stores the tables separated by the description decoder 320. Of course, the table storage unit 330 may have one or more corresponding tables when the extended bitstream 305 includes a codec number (Codec #, 820 or 1020) and a profile and level # (830 or 1030). In order to allow them to be used by the decoding unit 340, one or more tables may be stored in advance.

As illustrated in FIG. 5, the decoder 340 may include a tool box 510, a storage 520, and a decoding controller 530. The storage unit 520 stores data to be decoded by the CSCI storage unit 522 and the decoding processor 550 for storing CSCI (Control Signal / Context Information) generated by the SYN parser 540. The data storage unit 524 may be stored.

The tool box 510 includes a SYN parser 540 and a plurality of functional units for decoding and outputting data stored in the data storage 524. Obviously, the SYN parser 540 may also be implemented as one functional unit. The SYN parser 540 and the functional units may each be implemented in a combination of program codes.

That is, the tool box 510 is an area including functional units (FUs) implemented to perform respective functions, and each functional unit included in the decoding processor 550 is controlled by the decoding controller 530. Activated to output encoded video data included in the conventional bitstream 105 as moving image data. The decoding controller 530 may control the corresponding functional units to be sequentially activated in each hierarchical structure unit (eg, activated in the order of the first layer, the second layer, and the third layer, and the second layer is activated). At the time of activation, the first layer may remain activated or may be deactivated if no further data processing is required). However, even if activated simultaneously as the functional units included in the same hierarchical structure, if the functional unit uses the result data by the processing of the other functional unit as input data, the result data is generated by the other functional unit and stored in the data storage unit 524. Until the treatment is reserved. That is, the decoding functions may belong to one or more layers divided according to the characteristics of the codec. The called parsing function performs syntax parsing of the bitstream, and the decoding functions perform processing when CSCI information and data for decoding necessary for performing a designated process are stored. In addition, according to the flow of the CSCI information and data, the upper layer calls the decoding function of the lower layer, and all the decoding functions specified in the decoding description perform the process more than once as necessary to output video data corresponding to the bitstream. Therefore, the scheduling description of each codec and the organic processing structure of each functional unit can be proposed using the decoding description.

That is, when the conventional bitstream 105 is input to the decoding unit 340, the decoding control unit 530 activates the SYN parser 540 to start syntax parsing using the S-RT 460. With reference to the RT (420) it is controlled so that the functional units of the highest layer. Although only some of the first and second decoding descriptions are used in the early stages, the first and second decoding descriptions are organically used in the form of cross-references and the like, respectively.

Each of the activated functional units will wait until the CSCI or / and data needed for processing is stored in the storage unit 520, and if the necessary CSCI or / and data is recorded in the storage unit 520, The process starts by division. Through this, the decoding unit 340 according to the present invention can simultaneously perform a syntax parsing operation and data decoding for video output (see FIG. 22). In addition, it is determined whether the functional units included in the decoding processing unit 550 are activated on a hierarchical basis, and each functional unit is individually determined to reserve or start an operation. The operation is performed by forming a series / parallel coupling structure).

However, the SYN parser 540 included in the tool box 510 may be set to immediately perform interpretation of the conventional bitstream 105 when the conventional bitstream is input without the connection control of the decoding controller 530. This is because the element information and / or the SYN parser 540 stored by the SYN parser 540 and stored in the CSCI storage unit 522 by the functional units in the decoding processing unit 550 for performing subsequent processing are data. This is because the data stored in the storage unit 524 (hereinafter, referred to as 'encoded data') can be used.

The SYN parser 540 parses the conventional bitstream 105 input using the DHT 445, the SET 450, the S-RT 460, the CSCIT 440, the DVT 470, and the like. Element information, which is a result of syntax parsing, is stored in the CSCI storage unit 522. The CSCI storage unit 522 may be, for example, a buffer memory. The element information may be, for example, Control Signal / Context Information (CSCI). The element information parsed by the SYN parser 540 and stored in the CSCI storage unit 522 may be an input value for determining subsequent syntax of the conventional bitstream 105 at the same time as the parsing result of the corresponding step.

In addition, the SYN parser 540 performs entropy decoding on the header and image data of the syntax-parsed conventional bitstream 105 to encode a predetermined size (for example, 1 pixel unit, 4x4 unit, 8x8 unit, etc.). The stored data is stored in the data storage 524 for use by the functional units of the decoding processor 550. In addition, the SYN parser 540 may store the data to be used in the decoding process such as DC / AC in the syntax in the data storage 524. The data storage unit 524 may be a buffer memory, and a dedicated buffer space may be predefined for each functional unit.

In addition, each dedicated buffer space may be set to have an inclusion relationship for each layer as illustrated in FIGS. 20 and 21. Therefore, the activated function unit may immediately start processing when the input data is recorded in the data storage unit 524. If the processed result data is used as the input data of the other function unit, the result data is stored in the data storage unit 524. You can also write to

 SYN parser 540 may be implemented as a single software program (including a combination of program codes). Although the SYN parser 540 is implemented to perform a plurality of functions respectively corresponding to a plurality of standards (e.g., MPEG-1 / 2/4 / AVC, etc.), the DHT 445, the SET 450, and the S- This is because the corresponding operation may be performed using the RT 460, the CSCIT 440, the DVT 470, or the like. Of course, the SYN parser 540 may be implemented by being divided into a plurality of functional units as illustrated in FIG. 6, and each of the functional units may be implemented as a combination of blocked program codes.

The function of the SYN parser 540 by describing each functional unit illustrated in FIG. 6 in detail is as follows.

As illustrated in FIG. 6, the SYN parser 540 includes a network abstraction layer parsing (NALP) function (FU) 610, a syntax parsing (SYNP) function 620, and a context determination (CTX) function 630. And a variable length decoding function unit 640, a run length decoding function unit 650, a macro block generator (MBG) function unit 660, and the like.

Of course, the SYN parser 540 may include all of the functional units for syntax parsing irrespective of the applicable standard, and may add new functional units necessary for parsing Syntax in the process of technology development, and existing functional units. It is apparent that modifications can be made and unnecessary functions can be removed. In addition, it is apparent that each functional unit provided in the SYN parser 540 does not exist independently in each standard, and in the case of a functional unit capable of the same processing regardless of the standard, it may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The NALP function unit 610 is a function unit for parsing a Network Abstraction Layer (NAL) of MPEG-4 AVC, and the SYNP function unit 620 is a function unit for parsing syntax of a bitstream. The SYNP function 620 may be included in the VLD function 640.

The CTX function unit 630 is a function unit that determines a VLC table of MPEG-4 AVC, and the VLD function unit 640 is a function unit that performs entropy decoding.

The RLD function unit 650 is a function unit for entropy decoding AC values, and the MBG function unit 660 is a function unit for generating one MB (Macro Block) data by combining the DC value and the AC values. All of the functional units and some of the functional units in the aforementioned SYN parser 540 may be included in the VLD functional unit 640 depending on the system implementation.

As described above, the SYN parser 540 may be implemented as one software program or may be implemented as a plurality of software programs (for example, the VLD function unit 640 may be independently implemented as an independent software program). The SYN parser 540 extracts element information using the first description information (ie, one or more of the DHT 445, the SET 450, the S-RT 460, the DVT 470, and the CSCIT 440). Or the process of generating and storing in the CSCI storage unit 522 will be described in detail later in the description of the decoding control unit 530.

The decoding processor 550 processes the encoded data stored in the data storage 524 by the SYN parser 540 in a predetermined processing unit, and outputs the encoded data as video data having a predetermined size. The processing unit of the encoded data may be predefined or generalized as the same processing unit to be applied differently for each functional unit.

The decoding processing unit 550 may include a function unit (FU) for performing the above-described function corresponding to each standard. Each functional unit may be implemented as an independent processing block (eg, a software program, a combination of instruction codes, a function, etc.) to configure the decoding processing unit 550, or the decoding processing unit 550 may be implemented as one integrated processing block. Could be Although the decoding processing unit 550 is implemented as one integrated processing block, it is obvious that the corresponding processing may be performed by the connection control of the decoding control unit 530.

As shown in FIG. 7, the decoding processing unit 550 includes a de-blocking filter (DF) function 710, a VR (OPOP Reconstructor) function 715, a frame field reordering (FFR) function 720, Intra prediction and picture reconstruction (IPR) function 730, inverse transform (IT) function 735, inverse quantization (IQ) function 745, inverse AC prediction function 755 (ISA), IS ( An inverse scan function unit 760 and a DC Reconstruction (DCR) function unit 765.

The IT4x4 function unit 740, the IQ4x4 function unit 750, and the DCR4x4 function unit 770 are characterized in that the block size to be processed is 4x4. This is because MPEG-4 AVC processes data with 4x4 block size, whereas MPEG-1 / 2/4 processes data with 8x8 block size during Transform, Quantization, and Prediction.

The decoding processing unit 550 may include all of the functional units for performing the data decoding function regardless of the applicable standard, and may add functions required during the technological development, and may modify existing functions, and unnecessary functions. It is obvious that wealth can be removed. For example, if an IS4x4 function unit for processing data with a 4x4 block size is additionally required for the decoding process, the corresponding function units may be added to the decoding processor 550. In addition, a special prediction (SPR) function (not shown) for performing intra prediction in MPEG-4 AVC may be further added.

Each functional unit included in the decoding processing unit 550 does not exist independently of each standard, and it is obvious that the functional unit capable of the same processing regardless of the standard may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The DF function 710 is a de-blocking filter of MPEG-4 AVC, and the VR function 715 is a function that stores the reconstructed pixel value.

The FFR function unit 720 is a function unit for the interlaced mode, and the IPR function unit 730 is a function unit for storing the reconstructed pixel value after intra prediction of MPEG-4 AVC. As described above, intra prediction of MPEG-4 AVC may be performed by the SPR function.

The IT function unit 735 is a function unit that performs inverse transform of the DC value and the AC values, and the IQ function unit 745 is a function unit that inverse quantizes the AC values.

The IAP function unit 755 is a function unit for inverse AC prediction of AC values, and the IS function unit 760 is a function unit for inverse scan of AC values. The DCR function unit 765 is a function unit that performs inverse prediction and inverse quantization of DC values.

The SYN parser 540 and the decoding processing unit 550 described above are started separately, and each functional unit in the decoding processing unit 550 is activated by the activation control of the decoding control unit 530 and then CSCI and / or necessary for processing. When data is recorded in the storage unit 520, the operation is started separately.

The CSCI storage unit 522 has syntax using a second decoding description (ie, CSCIT 440, DHT 445, SET 450, S-RT 460, DVT 470) in the SYN parser 540. Element information (eg, CSCI) that is a result of parsing is stored in the CSCI storage unit 522. Element information is stored corresponding to CSCIT 440. The CSCI storage unit 522 may be, for example, a buffer memory.

The element information stored in the CSCI storage unit 522 is used as input data for performing the process of the SET 450 by the SYN parser 540 or a control variable for determining a subsequent connection index in the S-RT 460. Or the like.

In addition, the element information stored in the CSCI storage unit 522 refers to the F-RT 420, and each functional unit activated by the decoding control unit 530 in the hierarchical structure unit inputs the CSCI designated by the FU-CSCIT 430 to the CSCI. It may be used to map with element information stored in the storage unit 522. Of course, as described above, the SYN parser 540 may store the data in the data storage unit 524 as long as the element information may be used by the functional units in the decoding processor 550.

The decoding control unit 530 controls each function unit included in the SYN parser 540 and / or the decoding processing unit 550 to be decoded in order to decode bitstreams encoded by various standards. That is, the decoding controller 530 controls the functional units included in the decoding processor 550 to be activated in the hierarchical structure with reference to the F-RT 420. This is because the input data for the functional units belonging to the lower hierarchical structure may be the result data processed by the functional units belonging to the upper hierarchical structure.

Tables used by the decoding control unit 530 to activate each function unit and output the encoded data as the video data by the FL 410, the F-RT 420, the FU-CSCIT 430, There is a CSCIT 440 and a DHT 445. As the plurality of functional units illustrated in FIG. 7 operate organically with each other, the encoded data may be converted into video data and output. Which functional units should be operated sequentially to convert the video data may be different according to each encoding standard, which is obvious to those skilled in the art. Therefore, the following description will focus on the organic relationship between tables of the first decoding description included in the extended bitstream used as basic information for organic operation control of the plurality of functional units.

First, as shown in Fig. 16 and Table 1, DHT (Decoding Hierarchy Table, 445) is a table describing the hierarchical structure of the codec and information on lower layers of each layer.

Table 1. Decoding Hierarchy Table (DHT)

Index Name Children hierarchy Note H0 VS H1 Video Session H1 GOP H2, H3 Group of picture H2 VOP-1 H5 Video Object Plane: Type 1 H3 VOP-2 H4 Video Object Plane: Type 2 H4 MB-1 H6 H5 MB-2 H7 H6 B-1 None H7 B-2 None H8 … … ... ... ... ... ...

As illustrated in Table 1, the DHT 445 may include items such as an index, which is a sequentially assigned layer number, a name indicating a name of each layer, a children hierarchy indicating a lower layer of the corresponding layer, and the like. The number of layers or the number of children hierarchies can be expressed differently depending on the codec. For example, if there are more VOP-3, MB-3, etc. as illustrated in FIG. 16, it is obvious that a corresponding layer number may be added.

The hierarchical structure represented by the DHT 445 of the present invention means that different codecs based on one codec can be integrated at free layer positions in a free form. In other words, a new codec can be constructed using several different codecs using an integrated codec, and video compression and reconstruction are possible using this codec.

In addition, the main function of the DHT 445 is to introduce a hierarchical structure to a given codec to implement various implementations of decoding solutions (sequential / parallel, single / multiple threads, sw / hw hybrid decoding) to be configured using a decoding description. ) To facilitate.

The hierarchy described through the DHT 445 illustrated in Table 1 is commonly applied in the syntax parsing and decoding process. Of course, it is obvious that there may be more hierarchies to be used independently in the syntax parsing or decoding process.

Next, as shown in Table 2, FL (FU List, 410) is a table describing information such as a list of respective functional units included in the decoding processing unit 550, the quantity of input / output data of the corresponding functional units, and the like. .

Table 2. FL (FU List)

FU ID FU name input CSCI output CSCI D0092 FU-A 2 0 D0098 FU-B 2 0 … … … …

The FL 410 designates the name of the dedicated buffer area (or the write address of the data or the address in the buffer memory in which the data is recorded) in which the input data for each functional unit is recorded, and the output data by the corresponding functional unit is recorded. The buffer region may further include a name (or a write address of the corresponding data or an address in the buffer memory in which the corresponding data is to be written). Accordingly, each functional unit may record output data read and processed by the input data using the FL 410. However, the input data and output data of the SYN parser 540 that generates the element information are not described in the FL 410, which is generated by the SYN parser 540 using information such as the SET 450. This is because the element information created in the specified location is recorded.

As illustrated in Table 2, the FL 410 includes an FU ID that is a unique number of a functional unit (FU) in the tool box 510, an FU name that is a name of each functional unit, and an input CSCI indicating a quantity of input data. It may include an item such as output CSCI indicating a quantity of result data (output data). The order of listing the functional units in the FL 410 corresponds to the order of listing the FU of the FU-CSCIT 430 or the index number. Names of the respective functional units described above with reference to FIG. 7 may be described in the FU name item which is the name of each functional unit.

The specific function unit of the layer activated by the decoding control unit 530 reads out necessary data from the data storage unit 524 by using the FU-CSCIT 430, the CSCIT 440, and the like, and performs a preset process, and outputs data. Create The generated output data may be recorded in the data storage unit 524, and the data recorded in the data storage unit 524 may be used as input data of a functional unit that performs subsequent processing. Here, the functional unit is included in the decoding processing unit 550, and refers to a series of processing (for example, a function, an algorithm, or a function) for processing the input data in a predetermined process to generate output data.

If it is sufficient for the decoding unit 340 to use only one standard for decoding the encoded video data included in the conventional bitstream 105, then the FL 410 is provided with functional units for performing the corresponding processing in that standard. It can only contain information.

However, if the video data is encoded by a plurality of standards (for example, if the encoding standard is applied differently in units of a plurality of frames), the functional units according to the plurality of standards may be used to decode the encoded video data. Information will be needed. Accordingly, in this case, the FL 410 should include information of the functional units according to the plurality of standards necessary for decoding of encoded video data among all the functional units according to the corresponding plurality of standards.

Of course, even if the video data is differently applied to the encoding standard in the unit of a plurality of frames, if the plurality of conventional bitstreams 105 and the extended bitstream 305 are generated and provided separately by the applied encoding standard, each FL 410 Each would only need to contain information on the functional units according to the corresponding standard.

The FL 410 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Next, the F-RT (FU-Rule Table) 420 provides connection information of functional units to be used to decode the input conventional bitstream 105. That is, the F-RT 420 has a structure in which an upper layer calls a lower layer by using the hierarchical structure specified in the DHT 445 as illustrated in Table 3 below.

Table 3. F-RT ( FU  - Rule Table )

Decoding Hierarchy Children ( FU Of FH ) LOOP LOOP Condition Input Description FH0 FU1 NO - FH0 FH1 YES CH1.C0 == 1 FU1 FH1 [0..N-1] e.g., FH1 [i] is executed when CH1 [i] .C0 is 1. FH1 YES CH1.C1 == 1 FH1 [i-1] FH1 FU2 No - FH1 FH2 NO - FU2 ... ... ... ... ... ...

As shown in Table 3, the F-RT 420 includes a decoding hierarchy representing each hierarchical structure, a children representing a functional unit to be activated or a lower layer to be called, a loop indicating whether to operate a loop, and a loop when a loop operation is required. Loop Condition indicating a condition, input information (or activation order) of each functional unit or a lower layer, and an input indicating a Decorating Hierarchy or Children.

As illustrated in Table 3, the layer of FH0 will be activated first, and the FH1 layer will subsequently be activated since it uses the result data of FU1 as input data. Alternatively, after the FH1 layer is also activated at the same time as the FH0 layer, the processing operation may be suspended until the result data of the FU1 is stored in the data storage unit 524.

Each layer is created as an object that ensures independence in the concept of instance / object when called. That is, FH1 [0], FH1 [1], FH1 [2],... It creates multiple FH1s, such as FH1 [n], and this structure can be equally applied to other layers (eg, FH0, FH2, FH3, etc.). In addition, a dedicated buffer space for each object may be allocated. As illustrated in FIGS. 20 and 21, each dedicated buffer space stores CSCI or data for processing a specific hierarchical structure or a functional unit within the hierarchical structure.

The F-RT 420 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Next, the FU-CSCIT (FU CSCI Table) 430 is a table for connecting element information stored in the CSCI storage unit 522 and element information (input CSCI) required by each function unit.

Table 4. FU- CSCIT ( FU CSCI Table )

Index No . CSCI information CSCI table element The num of interface set  : One One Quantiser_scale CH2.C6 The number of MB CH2.C1 The num of interface set  : 2 2 CBP_MPEG2 CH3.C1 Ac_pred_flag_MPEG2 CH3.C6 CBP_MPEG4 CH4.C2 Ac_pred_flag_MPEG4 CH4.C5

As illustrated in Table 4 above, the FU-CSCIT 430 is Index No, which is mapped 1: 1 with the FU ID of the FL 410, information on CSCI, and an index of the CSCIT 440 for mapping. (CSCI table element) is included. Both are 1: 1 mapped by the order of listing the functional parts of the FL 410 and the order of listing the Index No. of the FU-CSCIT 430. That is, FU-A, which is the first functional part of Table 2, is Index No., which is the first index of FU-CSCIT 430. Mapped to 1.

In addition, the FU-CSCIT 430 further includes information on how many interfaces are set for each Index No. The number of interface sets means the number of cases mapped. That is, since D0092 of FL 410 is designated by the number of interface sets by FU-CSCIT 430, only CH2.C6 and CH2.C1 are used as element information. However, since D0098 has two interface sets, in some cases, CH3.C1 and CH3.C6 are used as element information, and in others, CH4.C2 and CH4.C5 are used. Each function unit reads the designated element information from the CSCI storage unit 522 or the data storage unit 524, performs a predetermined process, and stores the generated output data in the data storage unit 524.

The purpose of specifying the number of interface sets for each Index No. in the FU-CSCIT 430 is that one functional unit may perform different processing operations according to different data flows. That is, as illustrated in FIG. 18, if the FU-A is a functional part having a function that can be used simultaneously in MPEG-2 and MPEG-4, the case of processing data encoded in the MPEG-2 standard and MPEG-4 Different element information may be used for each processing standard encoded data. Thus, a plurality of interface sets are required so that element information when processing encoded data according to each standard can be distinguished.

The FU-CSCIT 430 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Finally, as shown in Table 5 below, the CSCIT 440 may include element information (eg, CSCI) that is the result information of a process in which the SYN parser 540 uses the SET 450, the S-RT 460, or the like. ) Is described in detail. That is, the CSCIT 440 is processed from the conventional bitstream 105 and stored in the CSCI storage 522 or the data storage 524 and all meaningful material (i.e., elements to be used by the decoding processing unit 550). Information).

Table 5. CSCIT

Decoding Hierarchy Index Element Name Type Note CH0 CH0.C1 Profile and level indication Integer CH0.C2 User data Array An array of arbitrary length of user data. CH0.C3 Visual object VerID Integer ... CH1 CH1.C1 Time code (Hours) Integer CH1.C2 Time code (Minutes) Integer ... CH2 CH2.C1 Macro-block type Integer ...

As illustrated in Table 5 above, the CSCIT 440 is a hierarchical classification of each element information, an index that is a separator as a unique number of the corresponding element information, an element name of the corresponding element information, and a corresponding element information. Attributes for specifying data structural characteristics (for example, whether the element information is an integer or an array) are included. The CSCI information configured for each layer may be used in the form of multiple arrays as needed when configuring the decoder.

The CSCIT 440 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Subsequently, the CSCIT 440, the DHT 445, the SET 450, and the S- used by the SYN parser 540 to extract or generate element information from the conventional bitstream 105 and store the element information in the CSCI storage unit 522. The RT 460 and the DVT 470 will be described. However, since the CSCIT 440 and the DHT 445 have been described above, a description thereof will be omitted. As the plurality of functional units illustrated in FIG. 6 operate organically with each other, element information may be generated and stored in the storage unit 520. The type of element information may be different for each encoding standard, which is obvious to those skilled in the art. Accordingly, hereinafter, the SYN parser 540 integrated into a plurality of functional units or one functional unit is used to generate element information and store them in the storage unit 520 between tables of the second decoding description included in the extended bitstream. Explain the organic relationship between

First, as shown in Table 6 below, SET 450 is a table configured by information on the syntaxes of the input conventional bitstream 105.

Table 6. Syntax Element Table (SET)

Index Element Name Input Process by SET-PROC S0 Visual object sequence start code 32 bit READ 32 B; (IBS == HEX: 1B0) >>; S1 Profile and level indication 8 bit READ 8 >>; S2 Visual object sequence end code 32 bit READ 32 B; ((IBS == HEX: 1B1) || (EOF)) >>; … … … …

As illustrated in Table 6 above, the SET 450 includes an index for each syntax, an element name of element information, input data, and a process by SET-PROC. Contains information. Here, the index is a delimiter S for distinguishing each syntax used in the S-RT 460.

The element name is a name of a syntax and may be named according to the meaning or role of the syntax. The input data is the nominal bit length input at one time in the conventional bitstream 105. The SET-process describes the process of receiving each bitstream syntax and what processing procedure to generate element information, which is output data. For reference, the SET-process "READ 32 B; (IBS == HEX: 1B0) >>;" corresponding to index S0 reads 32 bits and satisfies the information when "(IBS == HEX: 1B0)" is satisfied. It means to output (>>). The output data is element information (i.e., CSCI information C), and CSCI information (e.g., CH0.C1, etc.) specified in the S-RT 460 with reference to the Syntax #ID of the S-RT 460. The data is stored in the CSCI storage unit 522 or the data storage unit 524.

The SET 450 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Next, as shown in Table 7 below, the S-RT 460 shows layer and connection information between each syntax in the conventional bitstream 105. That is, the S-RT 460 has information instructing the higher layer to call the syntax of the lower layer and move to the next syntax. The SYN parser 540 reads the conventional bitstream 105 using the S-RT 460 or defines the order in which element information is stored and / or updated in the CSCI storage 522. As illustrated in FIG. 17, the SYN parser 540 with reference to the S-RT 460 is composed of a plurality of threads so that the upper thread can call the lower thread. Can be performed.

Table 7. Syntax Rule Table (S-RT)

Decoding Hierarchy Index Syntax #ID CSCI Branch Information Note SH0 SH0.SR1 S0 CH0.C1, CH0.C0 1: (CH0.C0 == 1) GO SR2; 2: GO ERR; VS Start Code SH0.SR2 S1 … 1: GO SR3; SH0.SR4 S5 While (conditions) {CALL SH1 [CH0.C6]; CH0.C6 ++; } SH1 SH1.SR1 S6 1: (CH0.C0 == 1) GO SR2; 2: GO ERR; GOP Start Code SH1.SR2 S7 1: ([CH1.C13] == 1 && [CH1.C14] == 1) SR3; 2: GO SR4; SH2 … … … … … … … … … … …

As illustrated in Table 7 above, the S-RT 460 includes a hierarchy hierarchy of each syntax, an index R, an syntax ID (Syntax #ID), input data (CSCI), branch information ( Branch Information).

The index R distinguishes each connection information rule. Since the index S of the syntax specifies a syntax to be processed at a specific connection index within each layer, the SYN parser 540 performs a process specified for the syntax using the SET 450.

The input data represents a list of element information to be used for determining a condition for connection control in the corresponding connection index. The result of the process by the SET 450 is stored as the name of the input data corresponding to the Syntax #ID as described above.

Branch information is a condition determination algorithm that determines which connection index to process next. The branch information can directly determine which contents are read in what order. When the number of branches is 1 (for example, when the Syntax #ID is S1), input data may not exist.

The S-RT 460 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Finally, the DVT 470 is a table in which Huffman table information used in each encoder / decoder is recorded, as shown in Table 8 below. In MPEG-1 / 2/4 / AVC, entropy coding is performed at each encoding. In this case, a Huffman coding method is mainly used, and the information used in this case is a Huffman table. To implement the integrated codec, Huffman table information to be used in the corresponding decoder must be provided for each decoding. Therefore, Huffman table information corresponding to each syntax is included in syntax parsing in the decoding description according to the present invention. Of course, if Huffman table information corresponding to each standard is already recorded in the table storage unit 330, the transmission of the DVT 470 is omitted or as shown in FIG. 10, the codec numbers (Codec #, 1020) and the profile and Only the level number (Profile and level #, 1030) may be included.

Table 8. Default Value Table

name value code MCBPC 0 One MCBPC One 001 MCBPC 2 010 … … … MCBPC 9 NULL CBPY 0 0011 CBPY One 00101 … … … CBPY 17 000001 CBPY 18 NULL intraDCy 0 011 intraDCy One 11 … … … intraDCy 12 00000000001 intraDCy 13 NULL intraDCc 0 11 intraDCc One 10 … … … intraDCc 13 NULL DCT intra 0 10 DCT intra One 1111 … … … DCT intra 101 000001011111 DCT intra 102 0000011 DCT intra 103 NULL … … …

As illustrated in Table 8, the DVT 470 stores a name for each Huffman table, an actual value compressed and output by Huffman coding, and a compressed actual value in the conventional bitstream 105. Contains the code value to be used when For example, if the MCBPC value is compressed to obtain an actual value of 3, the conventional bitstream 105 is performed by a Huffman table mapping operation (for example, the PROCESS portion of SET 450). The code value 011 is recorded. As another example, if VLD [1] is recorded in the Process portion of a particular index of SET 450, the conventional bitstream 105 is called by a function called VLD by a predetermined length (fixed length or variable length) by the function. ), You can get the code value and then get the corresponding actual value by Huffman table mapping. The Huffman table used at this time is [1], that is, the first table, CBPY.

The DVT 470 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar scripting language.

For example, the DVT 470 may be textual description as follows.

DVT {((0,1), (1,001), (2,010), (3,011), (4,0001), (5,000001), (6,000010), (7,000011), (8,000000001) , (9, NULL)) ((0,0011), (1,00101), (2,00100), (3,1001), (4,00011), (5,0111), (6,000010), (7,1011), (8,00010), (9,000011), (10,0101), (11,1010), (12,0100), (13,1000), (14,0110), (15 , (11), (16,000000), (17,000001), (18, NULL)) ((0,011), (1,11), (2,10), (3,010), (4,001), (5, 0001), (6,00001), (7,000001), (8,0000001), (9,00000001), (10,000000001), (11,0000000001), (12,00000000001), (13, NULL) ) ((0,11), (1,10), (2,01), (3,001), (4,0001), (5,00001), (6,000001), (7,0000001), (8 , 00000001), (9,000000001), (10,0000000001), (11,00000000001), (12,000000000001), (13, NULL)) ...

As another example, the DVT 470 may be binary described as follows.

00000011111111111111111111111110111110000110001100100011010000110110010000010011000000100110000010001100000110100100000000100000111110010000110010100101001010010000100100100101000110010001110011000001000100101100101000100011000001100100010100100101000100010000100100000100011000010110011000000000110000 00100000111110001101100010110001010000110100001100100100000100101000010011000000100111000000101000000000010100100000000101010000000000101011000000000010000011111000101100010100001001000110010010000010010100001001100000010 ...

Each table has the advantage of being able to reduce storage space, improve processing efficiency, and reduce transmission time of the extended bitstream 305 including decoding description by binary description.

Hereinafter, the interworking process between the tables used by the SYN parser 540 and / or the decoding control unit 530 will be described.

First, the decoding control unit 530 calls the functional units of the highest layer defined in the F-RT 420 in the table storage unit 330. The called functions wait until the CSCI information and / or data necessary for processing are stored in the storage 520 by the SYN parser 540.

The SYN parser 540 reads the syntax corresponding to the highest layer among the rule information of the S-RT 460, recognizes that it is a VS Start Code by the SET 450, and corresponds to the conventional bitstream 105. Read the bit (that is, 32 bits set as an input value in the SET 450) and read the output value (i.e., C0 as element information) according to the execution of the SET process to the input data (CSCI) specified in the S-RT 460. The name is stored in the CSCI storage unit 522. It is described in the CSCIT 440 what the element information stored in the CSCI storage 522 and in which layer is used. Subsequently, the SYN parser 540 substitutes element information (ie, C0) stored in the CSCI storage unit 522 into corresponding branch information of the S-RT 460, and proceeds to process the index corresponding to the result. do. For example, since the branch information corresponding to the index SH0.SH1 is 'CH0.C0 == 1', if this is satisfied, the branch information corresponds to the index SR2 in the SH0 layer.

However, when the SYN parser 540 generates element information using the SET 450 and stores the element information in the CSCI storage unit 522, when the VLD function is called (for example, the index S74 of the SET 450). Entropy decoding is performed using the DVT 470. When the element information is generated in this process, it is stored in the CSCI storage unit 522.

While the element information or / and data is stored in the storage unit 520 by the SYN parser 540, each activated function in the decoding processing unit 550 is provided with the element information or / and data necessary for performing a predetermined process. Check whether all are saved. Whether all the corresponding functional units are stored may be checked with reference to the FU-CSCIT 430. In addition, the corresponding element information may be recognized through mapping with the CSCIT 440. The function unit, which stores all necessary element information and / or data, starts performing a predetermined process, and stores the processed result data in the data storage unit 524.

As described above, the functional units may be sequentially activated or called in hierarchical units. The activation of the hierarchical unit may be controlled by the decoding control unit 530, for example, which monitors whether the processing of the element information or / and data necessary in the current layer is completed. The called function units read and process the element information or data stored therein when it is recognized to perform a predetermined process. This process produces the same effect as each functional unit is connected sequentially or in parallel to perform the processing.

Since all layers of all the functional units necessary for the conversion to the video data are activated, the decoding unit 340 may output the video data corresponding to the input bitstream 105.

22 is a diagram conceptually illustrating parallel processing of syntax parsing and data decoding according to an embodiment of the present invention. As illustrated in FIG. 22, using the above-described decoding description information, data decoding may be performed separately (independently) by the syntax parsing and decoding processing unit 550 by the SYN parser 540. That is, as long as element information and / or data required by each functional unit for data decoding are stored in the storage unit 520, the corresponding functional unit may perform a predetermined process. In addition, independent functions may be performed between the functional units unless the result data of other functional units are used as input data among the functional units in the decoding processing unit 550 that performs the decoding process.

Accordingly, the decoder 300 according to the present invention is not restricted to start the decoding processing unit 550 after all the syntax parsing is completed, and the SYN parser 540 and the decoding processing unit 550 may process the individual. There is an advantage in that separate processing is possible between the functional units in the decoding processing unit 550.

Hereinafter, the commands constituting each table will be described in detail.

In each of the tables illustrated above, commands used in the tables are illustrated. Each of the illustrated instructions may be used to construct information (ie, a table) for parsing a standard syntax such as MPEG-2 / MPEG-4 / MPEG-4 AVC.

Commands for configuring each table may be READ, SEEK, FLUSH, IF, WHILE, UNTIL, DO ~ WHILE, DO ~ UNTIL, BREAK, SET, STOP, PUSH, and so on. Of course, not all commands need to be used in each table, and it is obvious that any command may be selectively used for each table. Hereinafter, the purpose of each command will be briefly described.

First, READ is a command for reading a certain bit from the bitstream. For example, it may be expressed as "READ bits B> CSCI;". Here, "bits" represents the number of bits to be read, "B" represents a Byte-alignment flag, and "> CSCI" represents a CSCI index to be stored. "B" and "> CSCI" are used as options. If "> CSCI" is not specified, it is set to store only in the variable IBS.

Next, SEEK reads a bit from the bitstream but does not move the file pointer. The file pointer means a reference position during an operation such as reading a predetermined bit. The parameters of the SEEK command can be applied in the same way as the READ described above.

Next, FLUSH is a command for moving a file point by a certain number of bits in the bitstream. Parameters can be applied similarly to READ.

Next, IF may be used in the form of "IF (condition) {~} ELSE {~}", and is an instruction that provides a branch according to a given condition.

Next, WHILE can be used in the form of "WHILE (condition) {~}", and is a command to repeatedly execute a designated block while a given condition is true.

Next, UNTIL can be used in the form of "UNTIL (condition) {~}", which is a command to repeatedly execute a designated block until a given condition becomes true.

Next, DO ~ WHILE can be used in the form of "DO {~} WHILE (condition)", and it is a command to transform a WHILE statement to execute a block before determining a condition.

Next, DO ~ UNTIL can be used in the form of "DO {~} UNTIL (condition)", which is a command to transform a UNTIL statement to execute a block before determining a condition.

Next, the command (~) (compute) is used in the form of "(C11 = (V2 + 3));". In other words, all calculations of SET-PROC can be written in parentheses. Operators such as arithmetic, assignment, comparison, addition / subtraction (++ /-), bitwise operation, logical sum / logical product, and check whether CSCI is used or not Can be used.

Next, BREAK tells you to break away from the nearest loop structure.

Next, SET is a command for setting whether to use flags for designated CSCIs, and CSCIs for designating flags are listed and separated by commas (eg, SET C0, C2;).

Next, STOP is a command for stopping the processing of the currently executing syntax element and moving on to the next.

Next, PUSH is an instruction to add a given data from the last point in which data was recorded in the array CSCI, and the added values are listed (for example, PUSH C8 8, 16, 32;) by comma. Are distinguished.

Next, GO tells you to branch to the specified location. For example, GO SR # ;; is a command to branch to SR #, and GO RT is a command to return to where it was called.

Next, HEX is a command that indicates that the value following the HEX command is hexadecimal.

Next, RLD is an interface for an RLD function supported in MPEG-4, and may be used in the form of "RLD index, level, run, islastrun, t #;". Here, index, level, run, and islastrun represent CSCI or internal variables storing the RLD return value, and t # represents the Huffman Table ID used for the RLD.

Next, VLD2 is a VLD function for MPEG-2, and may be used in the form of "VLD2 [t #] in> v1, v2, v3;". Here, t # is a Huffman Table ID used for the VLD, in represents an index value to be input, and v1 to v3 represent an output result value.

Finally, VLD4 is a VLD function for MPEG-4, and may be used in the form of "VLD4 [T #]> CSCI;". Here, t # represents a Huffman Table ID used for the VLD, and "> CSCI " represents a CSCI index to be stored. "> CSCI" is an option. If not specified, it is stored only in the variable IBS.

8 is a diagram showing the configuration of an extended bitstream according to the first preferred embodiment of the present invention, FIG. 9 is a diagram showing the configuration of an extended bitstream according to the second preferred embodiment of the present invention, and FIG. FIG. 11 is a diagram illustrating a configuration of an extended bitstream according to a third preferred embodiment of the present invention, and FIG. 11 is a diagram illustrating a configuration of an extended bitstream according to a fourth preferred embodiment of the present invention.

As illustrated in FIGS. 8 to 10, the decoding description included in the extended bitstream 305 according to the present invention is configured not to include table information but to include only applied standard information (No table), or to include all table information. It may be configured to include (Full tables) or may be configured to include only some table information (Partial tables). To distinguish each of them, the decoding description information may include stream identifier information (SI), and the SI information may be divided as shown in Table 2 below.

Table 9. Stream Identifier

SI Decoding Description 00 No table 01 Full tables 10 Partial tables

As illustrated in FIG. 9, the extended bitstream 305 is a decoding description, and includes an SI 810 (that is, 00), a codec number (Codec #, 820) and a profile and level number (indicative of not including table information). Profile and level #, 830).

This is a case of using the table information already stored in the table storage unit 330 without sending the table information. Although only the basic information on which codec, profile and level is used by the conventional bitstream 105, the decoding unit 340 can decode using the indicated tables.

For this purpose, SET 450, CSCIT 440, FL 410, FU-CSCIT 430, DVT 470, and the like are described for each application standard (i.e., codec), F-RT 420, S The RT 460 may be described for each profile of each applicable standard (see Tables 10 and 11).

Table 10. Table breakdown by codec

Standard Table separator MPEG-1 SET # 1 FL # 1 FU-CSCIT # 1 CSCIT # 1 DVT # 1 MPEG-2 SET # 2 FL # 2 FU-CSCIT # 2 CSCIT # 2 DVT # 2 MPEG-4 SET # 3 FL # 3 FU-CSCIT # 3 CSCIT # 3 DVT # 3 AVC SET # 4 FL # 4 FU-CSCIT # 4 CSCIT # 4 DVT # 4

Table 11.Table Classification by Profile and Level

SI Table separator MPEG-1 F-RT # 1-1 S-RT # 1-1 MPEG-2 MP F-RT # 2-1 S-RT # 2-1 MPEG-4 SP F-RT # 3-1 S-RT # 3-1 MPEG-4 ASP F-RT # 3-2 S-RT # 3-2 AVC BP F-RT # 4-1 S-RT # 4-1

For MPEG-4 SP, the decoding method is explained using SET # 3, FL # 3, CSCIT # 3, FU-CSCIT # 3, DVT # 3, F-RT # 3-1, and S-RT # 3-1. If the codec number is 3 and the profile and level number are 2 and transmitted, the decoding unit 340 may perform a decoding operation with reference to the tables.

In addition, as illustrated in FIG. 9, the extended bitstream 305 may include all table information described above as a decoding description. In this case, the SI 810 will be set to 01 when referring to Table 9. Each table includes a table identifier (TI) 910, a table start code (TS Code) 920, a table description (TD) 930, a table end code (TE Code, Table). End Code) 940 may be included. The order of the table identifier 910 and the table start code 920 may be changed, and the table description 930 may be described in the form of a binary description. Of course, the order of each table can be changed.

In addition, as shown in FIG. 10, the extended bitstream 305 may include a decoding description and may include some table information and a codec number corresponding to some table information. In this case, the SI 810 will be set to 10 when referring to Table 9. However, in this case, since the format of the table information is not uniform, it may be preferable to further include a configuration identifier 1010 after the table identifier 910 so as to determine what format the table information is configured.

In addition, as illustrated in FIG. 11, the extension bitstream may further include decoding description (T-DD) 1110 and update information for table information. The decoding description 1110 for the table information may be any one of the decoding descriptions described above with reference to FIGS. 8 to 10, and the SI 810 may be set to a corresponding value. The update information may include an update start code (RS code, Revision Start code) 1120 and an update content (Revision 1130).

The update content 1130 may be content such as adding, deleting, or updating rule information of an arbitrary table. Its form is 'insert index into table-name (…);', 'delete index from table-name;', 'update index in table-name (…);' And the like. For example, if you want to add S100 to SET # 4, the update 1230 is 'insert S100 into SET # 4 ("READ 1; IF (IBS == 1) {SET C31;}");' It may be configured in the form of.

As described above, the description decoder 320 reads the update contents 1130 and stores the tables of the changed contents in the table storage unit 330 while decoding of the corresponding extended bitstream 305 is performed. However, when decryption is completed, the corresponding tables stored in the table storage unit 330 will be restored to their original state. Whether or not the decoding is completed may be recognized by the decoding unit 340 or the trigger providing the completion notification to the description decoder 320, or by the description decoder 320 monitoring whether the decoding unit 340 is completed.

As described above, according to the present invention, an existing profile may be used by using functional units provided by a conventional standard (ie, a codec), or a new decoder may be configured by using existing functional units. In addition, a new decoder may be implemented using a new function unit. That is, various and unlimited decoder implementations are possible.

However, when adding a new functional unit (Functional Unit) to the tool box 510, it is necessary to add the algorithm for the functional unit (that is, description of the functional unit) and add the corresponding information to the FL 410. . In this case, a compilation process for the algorithm may be additionally required.

In order to implement the integrated codec, each component must be organically controlled to parse a bitstream compressed by various coding methods and decode the bitstream using a decoding method corresponding to the corresponding coding method.

In this case, the corresponding bitstream may be a bitstream composed of various shapes in which various standards (codecs) are mixed or various types of bitstreams generated by various coding schemes within one standard. In addition, in order to support various encoding / decoding methods, various functions used in various standards are divided into separate units, and only one function and a function required by the user are selected to select one codec (encoder and decoder). You should be able to make it.

As described above, the present invention has an advantage that the functional description can be organically connected and controlled by the same information interpretation method regardless of the encoding scheme in which the bitstream is encoded by providing the decoding description together.

In addition, another advantage of the present invention is that even if the syntax of the bitstream is changed or newly added, it is possible to proactively respond to the S-RT 460 by only modifying the corresponding information or inserting additional information. In addition, the F-RT 420 is configured by selecting a function desired by the user in units of processing such as a bit stream level, a frame level, a macro block level, and an MB-level to decode the corresponding decoding. The decoding processing unit 550 may also establish a connection relationship between functional units.

12 is a diagram showing the configuration of an extended bitstream according to the fifth preferred embodiment of the present invention, FIG. 13 is a diagram showing the configuration of an extended bitstream according to the sixth preferred embodiment of the present invention, and FIG. FIG. 15 is a diagram illustrating a configuration of an extended bitstream according to the seventh preferred embodiment of the present invention, and FIG. 15 is a diagram illustrating a configuration of an extended bitstream according to an eighth preferred embodiment of the present invention.

The extended bitstream 305 according to the present invention is composed of a decoding description region (DD) and a conventional bitstream 105. It will be apparent to those skilled in the art that the conventional bitstream 105 consists of coded video data (or / and coded audio data).

Here, the decoding description region may be formed in a different structure according to the codec characteristic to be applied to decode the conventional bitstream 105. That is, first, when using one codec standardized in the prior art, the first decoding description structure may be applied.

Second, when modifying and using some of the contents of one standardized codec (that is, some of the above seven tables use the table contents corresponding to the corresponding codec and modify some other tables). The second decoding description structure can be applied.

Third, processing and using table information of a plurality of standardized codecs (that is, some of the seven tables described above selectively use the contents of a table of the conventional plurality of codecs and modify some other tables). In this case, a third decoding description structure may be applied.

Fourth, the fourth decoding description structure may be applied when using a new codec that is not conventionally standardized (i.e., including all seven tables described above with new contents).

The four decoding description structures described above may be divided as different codec type information. For example, "codec_type = 0" for the first decoding description structure, "codec_type = 1" for the second decoding description structure, and "codec_type = 2" for the third decoding description structure. In case of the fourth decoding description structure, it may be set to "codec_type = 3".

A first decoding description structure is illustrated in FIG. 12. According to the first decoding description structure illustrated in FIG. 12, the decoding description area may include a codec type (codec_type) 1150, a codec number (codec_num) 1152, and a profile and level number (profile_level_num) 1154. have. That is, according to the first decoding description structure, only the information about the codec to be applied is described in the decoding description area. Although each field is illustrated as 8 bits in the figure, it is obvious that the size of each field may be added or subtracted according to the size of information to be represented.

The codec type 1150 will be set to zero (ie, codec_type = 0), which means that one of the various codecs conventionally standardized is used as it is.

A second decoding description structure is illustrated in FIG. 13.

According to the second decoding description structure illustrated in FIG. 13, the decoding description area includes a codec type (codec_type) 1150, a codec number (codec_num) 1152, a profile and level number (profile_level_num) 1154, and a table description ( 1156). That is, according to the second decoding description structure, the decoding description area is described based on information about a codec to be applied and contents to be modified among seven tables. Here, the table description is provided separately for each of the seven tables. That is, there may be seven table descriptions in the decoding description area.

Each table description 1156 has a table start code (Table_start_code) 1158, a table identifier (Table_identifier) 1160, a table type (Table_type) 1162, contents 1163, and a table end code (Table_end_code) as illustrated. ) 1164. Of course, the size of each field can be increased or decreased as needed. In addition, as described below, the content 1163 may be omitted or included according to the information of the table type 1162.

For example, if the value of the table type 1162 is 0, an existing table (that is, a codec type (codec_type) 1150, a codec number (codec_num) 1152), a profile and level number (profile_level_num) 1154, and a table identifier A table recognized by 1160 may be recognized to be applied without modification. In this case, the content 1163 may be omitted.

However, if the value of the table type 1162 is 1, the existing table (ie, codec type (codec_type) 1150, codec number (codec_num) 1152), profile and level number (profile_level_num) 1154, and table identifier 1160 Table), which is recognized by), may be recognized for use with some modification (i.e., with content defined in content 1163). In this case, the modified content (for example, an update command, etc.) may be described in the content 1263. For example, modifications (such as update commands) may include commands such as update, insert, and / or delete to modify the table contents of the corresponding index of that table. It may be information to be made.

However, if the value of the table type 1162 is 2, an existing table (ie, codec type (codec_type) 1150, codec number (codec_num) 1152), profile and level number (profile_level_num) 1154, and table identifier 1160 Table), which is recognized by < RTI ID = 0.0 > In this case, the changed content 1163 may describe changed contents (for example, contents for newly defining a corresponding table such as a new command).

A third decoding description structure is illustrated in FIG. 14. According to the third decoding description structure illustrated in FIG. 14, the decoding description area may include a codec type (codec_type) 1150 and a table description 1156. That is, according to the third decoding description structure, the decoding description area is described based on information about a codec to be applied and contents to be modified among seven tables. Here, the table description is provided separately for each of the seven tables. That is, there may be seven table descriptions in the decoding description area.

Each table description 1156 has a table start code (Table_start_code) 1158, a table identifier (Table_identifier) 1160, a table type (Table_type) 1162, contents 1163, and a table end code (Table_end_code) as illustrated. ) 1164. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of table type 1162 is 0, an existing table (i.e., a table recognized by codec number (codec_num) 1152, profile and level number (profile_level_num) 1154 and table identifier 1160) It can be recognized to apply without modification of. That is, the codec number (codec_num) 1152, profile and level number (profile_level_num) 1154 corresponding to the table to be applied in the content 1163 field are described.

However, if the value of the table type 1162 is 1, the existing table (that is, the table recognized by the codec number (codec_num) 1152, the profile and level number (profile_level_num) 1154 and the table identifier 1160) is partially selected. It may be recognized for use with modifications (ie, modifications as defined in modification 1166). In this case, the codec number (codec_num) 1152, the profile and level number (profile_level_num) 1154 corresponding to the table to be applied in the content 1163 field are described, and the modified content 1166 field describes the modified content (for example, For example, an update command) may be described.

However, if the value of the table type 1162 is 2, then it is recognized that the existing table (i.e., the table recognized by the table identifier 1160) is completely changed (i.e. changed to the content defined in the content 1163 field). Can be. In this case, in the content 1163 field, changed content (for example, content for newly defining a corresponding table such as a new command) may be described. That is, when the table type 1162 is 0 or 1 as described above, since a specific codec is used as it is or some tables are modified and used, information about the codec (ie, codec number (codec_num) 1152, profile, and level) is used. Number (profile_level_num) 1154) is required, but if the table type 1162 is 2, completely new table information is defined, so no separate codec information is needed.

A fourth decoding description structure is illustrated in FIG. 15. According to the fourth decoding description structure illustrated in FIG. 15, the decoding description area may include a codec type (codec_type) 1150 and a table description 1156. That is, according to the fourth decoding description structure, the decoding description area is described with respect to seven tables, and the table description is provided for each of the seven tables separately.

Each table description 1156 has a table start code (Table_start_code) 1158, a table identifier (Table_identifier) 1160, a table type (Table_type) 1162, contents 1163, and a table end code (Table_end_code) as illustrated. ) 1164. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 1162 is a predetermined value (for example, 2), the content 1163 field includes information for describing a new table corresponding to the table identifier 1160 (for example, new). For defining a new table, such as a command). As described above, when the codec type 1150 is 3, it is recognized that decoding is performed by using new tables. Therefore, only one table type 1162 may be designated, or the table type 1162 may be omitted.

Hereinafter, the syntax structure of the decoding description area and the syntax structure of each field will be exemplified as respective tables.

Table 12. Decoding description

Decoder_Description () { No. of bits codec_type 8 If ((codec_type == 0x00) || (codec_type == 0x01)) { Codec_Description () } If (codec_type! = 0x00) { do { Table_Description () } while (next_bits () == table_idetifier) } }

Table 13. Codec description

Codec_Description () { No. of bits codec_num 8 profile_level_num 8 }

Table 14. Table description

Table_Description () { No. of bits table_start_code 24 table_identifier 4 table_type 4 if ((table_type == '0000') || (table_type == '0001')) { if (codec_type == 0x02) Codec_Description () if (table_type == '0001') Update_Description () } if (table_type == '0010') { New_description () } table_end_code 24 }

Table 15. Update description

Update_Description () { No. of bits Mnemonic   Update_Command vlclbf }

Table 16. New description

New_Description () { No. of bits Mnemonic New_command vlclbf }

The semantics of the decoding description are described below as respective tables.

Table 17. Decoding Description

codec_type Meaning 0x00 A profile @ level of an existing MPEG standard 0x01 Some parts of the existing one profile @ level changed 0x02 Some parts of the existing multiple profile @ level changed 0x03 A new decoding solution 0x04-0xFF RESERVED

Here, the codec type is an 8-bit code and may be information for identifying the type of the codec.

Table 18. Codec description

codec_num MPEG standards and others 01 MPEG-1 02 MPEG-2 03 MPEG-4 Part 2 04 MPEG-4 Part 10 (AVC) 05-FF RESERVED

Here, the codec number codec_num is an 8-bit code and may be information indicating a code of a used codec. In addition, the profile and level number (profile_level_num) is an 8-bit code and may be information for indicating the number of the profile and the level for the codec. The profile and level numbers may match the profile and level numbers of each MPEG standard.

Table 19. Table description (table identifier)

table_identifier table name 0000 SET (Syntax Element Table) 0001 Syntax Rule Table (S-RT) 0010 CSCIT (CSCI Table) 0011 DVT (Default Value Table) 0100 FL (FU List) 0101 F-RT (FU Rule Table) 0110 FU-CSCIT (FU CSCI Table) 0111-1111 RESERVED

Here, the table start code (table_start_code) may be a 26-bit string 0xFFFFFE in hexadecimal, which may mean the start of a table description. The table identifier (table_identifier) may be each 4-bit code as shown in Table 12 above.

Table 20. Table description (table type)

table_type Meaning 0000 conventional table 0001 updated table 0010 new table 0011-1111 RESERVED

Here, the table type is information for determining whether to maintain an existing table with a 4-bit value, update an existing table, or create a new table. The table end code (table_end_code) may be a 26-bit string 0xFFFFFF in hexadecimal, which may mean the end of the table description.

Table 21. Instruction set for update command (update_command)

Code Instruction Usage 00 UPDATE UPDATE [index #] in [table #] [a record]; 01 INSERT INSERT into [table #] [a record]; 10 DELETE DELETE [index #] from [table #]; 11 RESERVED

Here, index # may be a 4-bit string indicating an index number of an arbitrary table, and table # may be a 32-bit string as a table identifier.

Table 22. Instruction set for new command (new_command)

Code Instruction Usage 00000001 READ READ bits B> CSCI; 00000010 SEEK SEEK bits B> CSCI; 00000011 FLUSH FLUSH bits B; 00000100 IF IF (condition) {~} ELSE {~} 00000101 WHILE WHILE (condition) {~} 00000110 UNTIL UNTIL (condition) {~} 00000111 ~ 0 DO-WHILE DO {~} WHILE (condition) 00000111 ~ 1 DO ~ UNTIL DO {~} UNTIL (condition) 00001000 (~) (compute) (………) 00001001 BREAK BREAK; 00001010 SET SET CSCI, CSCI; 00001011 STOP STOP; 00001100 PUSH PUSH CSCI Value, Value; 00001101 RLD RLD index, level, run, islastrun, t #; 00010010 VLD2 VLD2 [T #] in> v1, v2, v3; 00010100 VLD4 VLD4 [T #]> CSCI;

Here, bits are any of 3 to 34 bits indicating the number of bits required, and B is a 1-bit string indicating byte alignment. ">" Is a 1-bit string for printing the output on the left, and VLD2 (for MPEG-2) and VLD4 (for MPEG-4) are functions for entropy coding.

23 is a block diagram of an encoder according to an embodiment of the present invention.

The encoder 2300 according to the present invention further includes an extended bitstream generation and output unit 2310 as compared to the conventional encoder 200 described with reference to FIG. 2. The extended bitstream generation and output unit 2310 may control information (for example, a list and connection relations of the used functional units and input of the corresponding functional units) in the process of generating the conventional bitstream 105 generated by processing up to the front end. Data, syntax information, syntax connection information, etc.) to generate a decoding description. In addition, the extended bitstream 305 is generated using the generated decoding description and the conventional bitstream 105 and transmitted to the decoder 300. The method of generating the decoding description will be fully understood by those skilled in the art based on the above descriptions, and thus description thereof will be omitted. Also, those skilled in the art, when referring to the above descriptions, the encoder 2300 also includes a tool box including a plurality of functional units, and one or more encoding standards through sequential or organic combinations of the functional units included in the tool box. It will be readily understood that the bitstream generation according to the present invention will be possible.

In addition, in the present specification, the variable length encoder 235 refers to an arbitrary component (eg, an encoder) that performs encoding in order to generate the conventional bitstream 105 in the encoder 2300. The present invention is not limited thereto, and the scope of the present invention is not limited thereto.

FIG. 23 is a diagram on the assumption that the extended bitstream 305 generated using the decoding description information and the conventional bitstream 105 is provided to the decoder.

However, as described above, the decoding description may be delivered to the decoder 300 in the form of separate data or bitstream. In this case, the extended bitstream generator and output unit 2310 is not positioned after the variable length encoder 235, and the extended bitstream generator and output unit 2310 is positioned independently of the conventional encoder 200. Obviously, the independently generated information may be provided to the decoder 300.

In the description of the integrated codec apparatus and method according to the present invention, the decoder has been described with reference to the decoder. However, the interrelationship between the decoder and the encoding period is apparent to those skilled in the art. Obviously, the invention is not limited to decoders.

As described above, the integrated codec device and method according to the present invention facilitate the interpretation of syntax elements and control of the connection of functional units within one standard (or codec) or between different standards (or codecs). That is, it is not a problem to change the order of syntax elements, insert new syntax elements, or delete existing syntax elements in a bitstream generated according to a specific standard.

In addition, according to the related art, when the syntax element is manipulated, the decoder cannot decode the corresponding bitstream normally. For example, if the bitstream information is ABC and the bitstream is reconfigured to ACB, the decoder cannot recognize the decoding and cannot normally decode the bitstream. The same applies to the case where a new stream is inserted into an ABFC, or a B is deleted to form a bitstream with AC.

However, using the integrated codec apparatus and method according to the present invention, since the decoding description information is provided as data included in the extended bitstream or as independent data, the decoder 300 can perform a smooth decoding operation.

So far, the decoding apparatus and the syntax parsing method for decoding the bitstream according to the present invention have been described based on MPEG-4 AVC, but the MPEG-1, MPEG-2, MPEG-4 and other video encoding / decoding standards Naturally, the same can be applied without any limitation.

In addition, the information included in each table is not described only with information on connection relations between functional units for performing decoding by one standard, processing processes required for the corresponding functional unit, and the like. It is obvious that information may be described.

For example, assume that an initial plurality of frames of encoded video data included in the extended bitstream are encoded in MPEG-2, subsequent frames are encoded in MPEG-4, and the remaining frames are encoded in MPEG-1. lets do it. In this case, the table information included in the decoding description for decoding the encoded video data may be operated by combining the functional units according to each standard included in the tool box 510 for each frame having a different encoding method. It is obvious that it will be implemented.

As described above, the integrated codec apparatus and method according to the present invention are encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.). The decoded bitstream can be decoded with the same information recognition scheme.

In addition, the present invention can generate an extended bitstream having a decoding description added to decode the bitstreams encoded in various formats (syntax, semantics) according to each standard in the same information recognition method. There is also.

In addition, the present invention has an effect of more efficiently describing the decoding description by applying the hierarchical structure of the codec to the syntax parsing and decoding process.

In addition, the present invention proposes scheduling management of each codec and organic processing structures (eg, parallel combining structure, serial merging structure, independent processing structure, individual processing structure, etc.) of each codec using decoding description. There is also an effect that can be done.

In addition, the present invention also has the effect that a variety of system design and construction is possible only by the described decoding description.

In addition, the present invention parses a bitstream compressed by various encoding schemes by the same information analysis method, and can organically control functional units (FU) for decoding using the parsed data. There is also an effect.

In addition, the present invention has the effect that can be commonly applied to the syntax analysis method for decoding various types of bitstream.

In addition, the present invention has the effect of applying a new set of instructions for parsing various types of bitstreams with a common syntax analysis method.

In addition, the present invention also has the effect that the decoder can easily decode the bitstream even when the syntax element is changed or added.

In addition, the present invention has an effect that allows the components used for bitstream decoding to share the element information (the result of parsing the syntax) of the parsed syntax.

In addition, the present invention also has the effect that the element information of the parsed syntax can be used for the interpretation of subsequent bitstream syntax elements.

In addition, the present invention also has an effect that can be used when integrating a moving picture or still picture codec that processes block units other than MPEG-1, MPEG-2, MPEG-4, and MPEG-4 AVC.

In addition, the present invention has an effect that can be stored in a toolbox by dividing the functions constituting various decoding methods proposed by various standards (codecs) into functional units (FU).

In addition, the present invention has the effect that it is possible to selectively decode only the functional units required in the toolbox to decode the bitstream encoded in various forms.

In addition, the present invention has an effect that it is easy to change, add, or delete a function unit stored in a toolbox.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

Claims (73)

A table information storage unit; A description decoder for generating table information corresponding to a decoding description received from an encoder and storing the table information in the table information storage unit; A decoding unit for decoding and outputting encoded video data included in a bitstream received from the encoder into corresponding video data using the table information stored in the table information storage unit, And the decoding description is composed of one or more table areas, and table information for constituting a table is inserted into each table area. The method of claim 1, The decoding unit, A tool box including a plurality of functional units each implemented to process a predetermined process; And It includes a storage unit for storing one or more of the control signal / context information (CSCI) information generated by the process performed by one or more functional units, the data for decoding processing, The plurality of functional units includes at least one parsing function for syntax parsing of a bitstream, a plurality of decoding functions for decoding processing of the encoded video data, And the decoding functions are activated or called according to the hierarchical structure of the encoded video data. The method of claim 2, The hierarchical structure comprises a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer of one or more layers, wherein the lower layer is called by the upper layer. The method of claim 2, And each of the plurality of functional units is implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream. The method of claim 2, And each of the decoding function units is started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage unit. The method of claim 5, And a dedicated storage space for each of the decoding functions is allocated. The method of claim 2, The storage unit, A CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function; And And a data storage unit for storing data corresponding to the encoded video data generated by the parsing function unit and data for decoding processing which is one or more of processing data processed by the decoding function unit. The method of claim 2, Table information stored in the table information storage unit, A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. The method of claim 8, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 8, The decoding unit further comprises a decoding control unit for controlling the activation or call of one or more decoding function units corresponding to the highest layer using the F-RT. The method of claim 8, And the parsing function unit generates at least one of the CSCI information and data to be decoded using at least the SET, the S-RT, and the CSCIT. The method of claim 8, And the decoding function unit performs a predetermined process using at least the FL, the F-RT, the FU-CSCIT, and the CSCIT. The method of claim 1, And a separating unit for separating the decoding description and the bitstream when the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder. delete The method of claim 13, The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the description decoder extracts tables corresponding to the specified information from among a plurality of tables previously stored in the table information storage unit. The method of claim 13, Table information respectively inserted into the table area includes binary code information for configuring each table, The description decoder generates tables by using the binary code information and stores the tables in the table information storage unit. The method of claim 13, m (any natural number less than n) of the table areas corresponding to the codec number (Codec No.) and the profile and level number (Profile and level No.) for the corresponding table. Specified information is included, and k (any number of nm) table areas include binary code information for configuring a corresponding table, The description decoder extracts m tables corresponding to the designated information among a plurality of tables previously stored in the table information storage unit, generates k tables using the binary code information, and stores the k tables in the table information storage unit. Decoding device, characterized in that. A table storage unit; A description decoder for generating n (random natural numbers) table information corresponding to the decoding description received from the encoder and storing the table information in the table storage unit; A plurality of functional units, each of which has a predetermined process to be performed to decode and output encoded video data included in a bitstream received from the encoder into corresponding video data using the table information stored in the table information storage unit; A decoding unit including an information storage unit for storing processing data by each of the functional units; And A decoding control unit adapted to conform to the hierarchical structure of the encoded video data to perform activation or calling of functional units belonging to a top layer And the first layer is called by the second layer which is activated when the processing data for performing the first layer is stored in the information storage unit in accordance with the hierarchical structure. The method of claim 18, The plurality of functional units includes at least one parsing function for syntax parsing of a bitstream, a plurality of decoding functions for decoding processing of the encoded video data, The processing data stored in the information storage unit includes at least one of control signal / context information (CSCI) information generated by a process performed by at least one functional unit, and data for decoding processing. The method of claim 19, And the decoding functions are activated or called according to the hierarchical structure of the encoded video data. The method of claim 20, The hierarchical structure comprises a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer of one or more layers, wherein the lower layer is called by the upper layer. The method of claim 19, And each of the plurality of functional units is implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream. The method of claim 19, And each of the decoding functions is started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the information storage. The method of claim 23, wherein And a dedicated storage space for each of the decoding functions is allocated. The method of claim 19, The information storage unit, A CSCI storage unit for storing CSCI information (Control Signal / Context Information) generated by the parsing function; And And a data storage unit for storing data corresponding to the encoded video data generated by the parsing function unit and data for decoding processing which is one or more of processing data processed by the decoding function unit. . The method of claim 19, Table information stored in the table information storage unit, A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. The method of claim 26, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 18, And a separating unit for separating the decoding description and the bitstream when the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder. (a) generating and storing a plurality of table information corresponding to the description information when the bitstream and description information are input; And (b) calling the parsing function and the one or more decoding functions belonging to the highest layer using the one or more table information, The parsing function performs syntax parsing of the bitstream, and the decoding function of the uppermost layer parses the CSCI information (Control Signal / Context Information) necessary for performing a predetermined process and the data for decoding. If stored in the storage by the functional unit, perform the processing, And the first layer is called by the second layer which is activated when the CSCI information necessary for the execution of the first layer and the data for decoding are stored in the storage unit according to the hierarchical structure. The method of claim 29, The decoding functions are determined to be activated or called in accordance with the hierarchical structure of the encoded video data, And at least one process of each decoding function specified in the description information outputs video data corresponding to the bitstream. The method of claim 30, And said hierarchical structure is composed of one or more layers of sequence layer, GOP layer, picture layer, slice layer, macroblock layer, block layer. The method of claim 29, Each of the parsing function and the decoding function is implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream. The method of claim 29, The storage unit, A CSCI storage unit for storing CSCI information generated by the parsing function unit; And And a data storage unit for storing data corresponding to the encoded video data generated by the parsing function and data for decoding processing, which is one or more of processing data processed by an arbitrary decoding function unit. . The method of claim 33, wherein And each of the decoding functions is started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage. The method of claim 34, wherein And a dedicated storage space for each of the decoding functions is allocated. The method of claim 29, The generated table information is, A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data included in the bitstream and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. The method of claim 36, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 36, Activation or call of one or more decoding functions corresponding to the highest layer is controlled using the F-RT. The method of claim 36, At least one of the CSCI information and data to be decoded using at least the SET, the S-RT, and the CSCIT. The method of claim 29, And when the decoding description and the bitstream are received in the form of a unified extended bitstream, separating the decoding description and the bitstream is further performed in step (a). 41. The method of claim 29 or 40, And the decoding description is composed of one or more table areas, and table information for constituting the table is inserted into each table area. In a recording medium in which a program of instructions that can be executed in a decoding apparatus is tangibly implemented to perform a decoding method, and in which a program that can be read by the decoding apparatus is recorded, (a) generating and storing a plurality of table information corresponding to the description information when the bitstream and description information are input; And (b) calling the parsing function and the one or more decoding functions belonging to the highest layer using the one or more table information, The parsing function performs syntax parsing of the bitstream, and the decoding function of the uppermost layer parses the CSCI information (Control Signal / Context Information) necessary for performing a predetermined process and the data for decoding. If stored in the storage by the functional unit, perform the processing, When the CSCI information necessary for the execution of the first layer and the data for decoding are stored in the storage unit according to the hierarchical structure, the first layer is called by the activated second layer. Record carrier. The method of claim 42, wherein The decoding functions are determined to be activated or called in accordance with the hierarchical structure of the encoded video data, The video data corresponding to the bitstream is output by performing one or more processes of the respective decoding functions specified in the description information. And the hierarchical structure comprises one or more of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, and a block layer. The method of claim 42, wherein And wherein each of the parsing function and the decoding function is implemented to independently perform each function proposed by respective decoding standards for decoding the bitstream. The method of claim 42, wherein And each of the decoding function units is started by storing CSCI information necessary for performing a predetermined process and data for decoding processing in the storage unit. The method of claim 42, wherein The generated table information is, A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding encoded video data included in the bitstream and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) for specifying names of connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information for storing result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And a FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. An encoding unit for generating a bitstream including encoded video data corresponding to moving image data using a plurality of functional units implemented to each perform a function defined by one or more encoding standards; And And a description encoder for generating decoding descriptions corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data. And the bitstream and the decoding description are provided together with a decoder for decoding the bitstream. The method of claim 47, And an extension bitstream generation and output unit configured to generate one extension bitstream using the bitstream and the decode description. The method of claim 47, The plurality of functional units included in the decoder includes one or more parsing functions for syntax parsing of the bitstream, a plurality of decoding functions for decoding processing of the encoded video data, And the decoding function units determine whether to activate or call in accordance with the hierarchical structure of the encoded video data by arbitrary table information included in the decoding description. The method of claim 47, The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. The encoding apparatus, which is called by the activated second layer. The method of claim 47, N (random natural numbers) table information generated by the description encoder is A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And at least one of the FU-CSCIT indicating the CSCI information necessary for performing the process. The method of claim 51, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 51, The decoder uses the F-RT to control the activation or call of one or more decoding functions corresponding to the highest layer. The method of claim 47, And the decoding description is composed of one or more table areas, and table information for inserting the table is inserted into each table area. The method of claim 54, The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the decoder extracts and uses n tables corresponding to the specified information among a plurality of tables stored in advance. Generating a bitstream comprising encoded video data corresponding to moving image data using a plurality of functional units respectively implemented to perform a function defined by at least one encoding standard; And Generating a decoding description corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data, And the bitstream and the decoding description are provided together to a decoder for decoding the bitstream. The method of claim 56, wherein And generating one extended bitstream using the bitstream and the decode description. The method of claim 56, wherein The plurality of functional units included in the decoder includes one or more parsing functions for syntax parsing of the bitstream, a plurality of decoding functions for decoding processing of the encoded video data, And the decoding functional units are determined to be activated or called according to the hierarchical structure of the encoded video data by arbitrary table information included in the decoding description. The method of claim 58, The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. The encoding method, which is called by the activated second layer. The method of claim 56, wherein The generated n (random natural numbers) table information is A decoding hierarchy table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And at least one of the FU-CSCIT indicating the CSCI information necessary for performing the process by the decoding function unit. The method of claim 60, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 60, The decoder uses the F-RT to control the activation or call of one or more decoding functions corresponding to the highest layer. The method of claim 56, wherein And the decoding description is composed of one or more table areas, and table information for inserting the table is inserted into each table area. The method of claim 63, wherein The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the decoder extracts and uses n tables corresponding to the specified information among a plurality of tables stored in advance. In a recording medium in which a program of instructions that can be executed in an encoding apparatus is tangibly implemented to perform an encoding method, and in which a program that can be read by the encoding apparatus is recorded, Generating a bitstream comprising encoded video data corresponding to moving image data using a plurality of functional units respectively implemented to perform a function defined by at least one encoding standard; And Generating a decoding description corresponding to n (random natural numbers) table information defining an operation relationship between a plurality of functional units included in a decoder for decoding the encoded video data, And the bitstream and the decoding description are provided together to a decoder for decoding the bitstream. 66. The method of claim 65, And generating one extended bitstream using the bitstream and the decode description. 66. The method of claim 65, The plurality of functional units included in the decoder includes one or more parsing functions for syntax parsing of the bitstream, a plurality of decoding functions for decoding processing of the encoded video data, And the decoding function units determine whether to activate or call in accordance with the hierarchical structure of the encoded video data based on any table information included in the decoding description. The method of claim 67, The hierarchical structure is composed of one or more layers of a sequence layer, a GOP layer, a picture layer, a slice layer, a macroblock layer, a block layer, and the first layer, which is inactive according to any table information included in the decoding description, has already been deactivated. A recording medium having recorded thereon a program, which is called by an activated second layer. 66. The method of claim 65, The generated n (random natural numbers) table information is A Decoding Hierarchy Table (DHT) indicating a hierarchical structure for decoding the encoded video data and information on lower layers of each layer; A Syntax Element Table (SET) indicating information on bitstream syntax and a process for generating element information corresponding to the bitstream syntax; A Syntax Rule Table (S-RT) that specifies the name of the connection information between the bitstream syntaxes, information on lower layers to be called for each layer, and CSCI information to store result data generated by the process of the SET; Control Signal and Context Information Table (CSCIT) indicating detailed information on CSCI information for each hierarchical structure; An FU Rule Table (F-RT) indicating a call or activation order among a plurality of decoding functions based on the hierarchical structure; FL (FU List) representing the list of decoding functions; And And at least one of the FU-CSCIT representing the CSCI information necessary for performing the process by the decoding function unit. The method of claim 69, wherein And a Default Value Table (DVT) indicating a relationship between actual values and code values during entropy coding. The method of claim 69, wherein And the decoder controls the activation or calling of one or more decoding functions corresponding to the highest layer using the F-RT. 66. The method of claim 65, And the decoding description is composed of one or more table areas, and table information for inserting the table is inserted into each table area. The method of claim 72, The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the decoder extracts and uses n tables corresponding to the designated information among a plurality of tables stored in advance.

Images