KR100807100B1 - Device and Method for unified codecs - Google Patents

Abstract

An integrated codec apparatus and method are disclosed. Decoding apparatus according to an embodiment of the present invention includes a table storage unit; A description decoder for generating n (random natural numbers) tables corresponding to the decoding description received from the encoder and storing the tables in the table storage unit; The codec unit may generate and output video data corresponding to encoded video data included in a bitstream received from the encoder by using the table information stored in the table storage unit. According to the present invention, a bitstream encoded in various formats according to each standard (eg, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) can be decoded using the same information recognition scheme.

Video compression, integrated codec, VCTR, MPEG, AVC, Toolbox, Functional Unit, Connection,

Description

Device and Method for unified codecs

1 is a diagram schematically showing a configuration of a general decoder.

2 is a diagram schematically illustrating a configuration of a general encoder.

3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention.

4 is a diagram schematically illustrating a configuration of a universal bit-stream according to an embodiment of the present invention.

5 is a view schematically showing a configuration of a codec unit according to an embodiment of the present invention.

FIG. 6 is a diagram schematically illustrating a configuration of a SYN parser according to an embodiment of the present invention. FIG.

7 is a diagram schematically showing a configuration of an MB processing unit according to an embodiment of the present invention.

8 is a diagram showing the configuration of an extended bitstream according to the first embodiment of the present invention;

9 illustrates a configuration of an extended bitstream according to the second embodiment of the present invention.

10 is a diagram showing the configuration of an extended bitstream according to the third embodiment of the present invention.

11 illustrates a configuration of an extended bitstream according to the fourth embodiment of the present invention.

12A illustrates a configuration of an extended bitstream according to the fifth embodiment of the present invention.

12B illustrates a configuration of an extended bitstream according to the sixth embodiment of the present invention.

12C illustrates a configuration of an extended bitstream according to the seventh embodiment of the present invention.

12D is a diagram showing the configuration of an extended bitstream according to an eighth embodiment of the present invention;

13 is a block diagram of an encoder according to an embodiment of the present invention.

14-53 illustrate respective tables in accordance with embodiments of the present invention.

TECHNICAL FIELD The present invention relates to an integrated codec, and more particularly, to an integrated codec apparatus and method that can be used universally in various encoding / decoding standards.

In general, a video is converted into a bitstream by an encoder. In this case, the bitstream is stored according to an encoding type satisfying the constraint of the encoder.

MPEG requires syntax (hereinafter referred to as 'syntax') and semantics (hereinafter referred to as 'semantics') as constraints of the bitstream.

syntax indicates the structure, format, and length of the data, and in what order the data is represented. That is, syntax is to fit a grammar for encoding / decoding, and defines the order of each element included in the bitstream, the length of each element, and the data format.

Semantics means what each bit of data means. That is, semantics indicates what the meaning of each element in the bitstream is.

Therefore, various types of bitstreams may be generated according to encoding conditions of an encoder or an applied standard (or codec). In general, each standard (eg MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) has a different bitstream syntax.

Accordingly, bitstreams encoded according to each standard or encoding condition may have different formats (ie, syntax and semantics), and a decoder corresponding to an encoder should be used to decode the bitstream.

As described above, the conventional bitstream decoder has a limitation of satisfying the constraints of the encoder, and this limitation causes a difficulty in implementing an integrated decoder corresponding to a plurality of standards.

Accordingly, the present invention is to solve the above-described problem, and is encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) It is an object of the present invention to provide an integrated codec apparatus and method capable of decoding a bitstream in the same information recognition scheme.

Another object of the present invention is to parse a bitstream compressed by various encoding schemes by the same information analysis method, and to control each functional unit (FU) for decoding using parsed data. An integrated codec device and method are provided.

Still another object of the present invention is to provide an integrated codec apparatus and method capable of commonly applying a syntax analysis method for decoding various types of bitstreams.

Another object of the present invention is to provide an integrated codec apparatus and method capable of applying a new set of instructions for parsing various types of bitstreams using a common syntax analysis method.

It is still another object of the present invention to provide an integrated codec device and method that can easily decode a bitstream even when a syntax element is changed, added, or deleted.

It is still another object of the present invention to provide an integrated codec device and method for allowing components used for bitstream decoding to share element information (ie, output by syntax parsing) of parsed syntax.

It is yet another object of the present invention to provide an integrated codec apparatus and method that enables element information of an interpreted syntax to be used for interpretation of subsequent bitstream syntax elements.

Another object of the present invention is to provide an integrated codec device and method for dividing functions constituting various decoding methods proposed by various standards (codecs) into functional units (FU) and storing them in a toolbox.

It is still another object of the present invention to provide an integrated codec apparatus and method for selecting and decoding only functional units required by a toolbox to decode a bitstream encoded in various forms.

Still another object of the present invention is to provide an integrated codec apparatus and method capable of changing, adding, or deleting a functional part stored in a toolbox.

Further, another object of the present invention is to internationally standardize the concept and structure of the codec integration for bitstream decoding, and the other objects of the present invention will become clearer through the embodiments described below.

According to an aspect of the present invention to achieve the above object, there is provided an encoder / decoder and / or integrated codec device that can be used universally in various standards.

Decoding apparatus according to an embodiment of the present invention includes a table storage unit; A description decoder for generating n (random natural numbers) tables corresponding to the decoding description received from the encoder and storing the tables in the table storage unit; The codec unit may generate and output video data corresponding to encoded video data included in a bitstream received from the encoder by using the table information stored in the table storage unit.

The codec unit may include: a tool box including a plurality of functional units respectively implemented to process a predetermined process; A Control Signal / Context Information (CSCI) storage unit for storing a plurality of element information generated by syntax parsing of the bitstream by at least one of the plurality of functional units; And a connection controller for designating a sequential processing order of the plurality of functional units by referring to one or more predetermined tables.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

When the encoded video data is encoded by a plurality of standards, the codec unit may generate and output the video data by sequentially connecting a plurality of functional units that perform a process according to a plurality of standards with reference to the table information. Can be.

The tool box may include: a parsing function unit generating a plurality of element information by syntax parsing of the bitstream, storing the plurality of element information in the CSCI storage unit, and generating and sequentially outputting macroblock data corresponding to the encoded video data; And a plurality of processing functional units, each of which is assigned a process to be processed to convert the macroblock data into the video data.

The n tables include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts, and FU-CSCIT indicating element information to be input to the selected functional unit. The n tables may further include a default value table (DVT) indicating a relationship between actual values and code values during entropy coding.

The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) read a k (arbitrary natural number) bit by moving a file pointer. Instructions, a seek command that reads k bits without moving the file pointer, a flush command that moves file points by k bits from the file pointer, a GO instruction that indicates a branch between indexes, and element information. It may be configured to include one or more of the set (SET) command to set the flag.

The connection control unit may designate a sequential processing order of a plurality of functional units selected from the parsing function unit and the plurality of processing function units using the F-RT.

The processing function selected by the connection control unit may perform a predetermined process using predetermined element information and output data by the immediately preceding function unit.

The parsing function unit may generate the element information by using the SET, the S-RT, and the CSCIT.

When the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder, the decoding apparatus may further include a separation unit for separating the decoding description and the bitstream.

The decoding description may include one or more table areas, and table information for configuring the table may be inserted into each table area.

The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the description decoder is stored in advance in the table storage unit. N tables corresponding to the specified information among a plurality of tables may be extracted.

The table information inserted into each of the n table areas includes binary code information for configuring each table, and the description decoder generates n tables using the binary code information and stores them in the table storage unit. Can be.

M (arbitrary natural numbers) of the n table areas include designation information corresponding to a codec number (Codec No.) and a profile and level number (Profile and level No.) for the corresponding table, k The table area (any number of nm) includes binary code information for configuring a corresponding table, and the description decoder includes m tables corresponding to the specified information among a plurality of tables previously stored in the table storage unit. And k tables are generated using the binary code information and stored in the table storage unit.

Decoding apparatus according to another embodiment of the present invention includes a table storage unit for storing a plurality of table information that is organically interlocked; Storing a plurality of element information generated by syntax parsing of a bitstream received from an encoder by using one or more table information stored in the table storage unit in an element information storage unit, and encoding included in the bitstream A syntax parser for sequentially outputting macroblock data corresponding to the processed video data; An MB processing unit including a plurality of functional units each configured to process a preset process; And a connection controller configured to sequentially select a plurality of functional units by using one or more table information stored in the table storage unit. Here, the arbitrary functional unit selected by the connection controller may process and output the macroblock data by using predetermined element information among the element information stored in the element information storage unit.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

The connection controller may control an operation of the syntax parser using predetermined table information.

The decoding apparatus may further include a description decoder which generates n (random natural numbers) tables corresponding to the decoding description received from the encoder and stores the tables in the table storage unit.

When the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder, the decoding apparatus may further include a separation unit for separating the decoding description and the bitstream and inputting them to the syntax parser and the description decoder, respectively. can do.

The description information may be input as independent data or bitstream.

The connection controller may control the result data of the preceding functional unit to be input to the following functional unit among the plurality of sequentially selected functional units.

The result data of the preceding functional unit among the plurality of functional units sequentially selected by the connection control unit may be recorded in a buffer memory accessible by the subsequent functional unit.

Macroblock data sequentially output by the syntax parser may be written to the buffer memory.

The description information may be composed of binary code.

The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing the list of the functional units, the syntax parser or the sequential selection of the functional units It may include an FU-Rule Table (F-RT) and an FU-CSCIT indicating element information to be input to the selected functional unit. The table may further include a default value table (DVT) indicating a relationship between actual values and code values during entropy coding.

The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) read a k (arbitrary natural number) bit by moving a file pointer. Command, a SEEK instruction that reads k bits without moving the file pointer, a FLUSH instruction that moves the file pointer by k bits from the file pointer, a GO instruction that indicates a branch between indexes, and element information It may be configured to include one or more of the set (SET) command to set the flag.

The syntax parser selects a bitstream syntax to be processed using the S-RT, generates the element information using the process recorded in the SET, and sets the element information to correspond to the CSCIT. Can be stored in the information storage.

The connection controller selects the syntax parser or any one functional unit using the F-RT, recognizes the syntax parser or the characteristics of the functional unit using the FL, and uses the FU-CSCIT and the CSCIT. The element information to be input to the selected functional unit may be extracted from the element information storage unit and input to the selected functional unit.

An encoding apparatus according to another embodiment of the present invention includes an encoding unit for converting an input video into a bitstream according to a predetermined encoding scheme using a plurality of functional units sequentially; And a description information generator for generating description information according to a connection relationship between the syntax information of the bitstream and the functional units. Here, the bitstream and the description information may be provided together to the decoding apparatus.

The bitstream and the description information may be generated as one extension bitstream and provided to the decoding apparatus.

The description information may be provided to the decoding apparatus as independent data or bitstream.

The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing a functional unit list of the decoding apparatus corresponding to the functional units, A FU-Rule Table (F-RT) for sequential selection of the functional units may include a FU-CSCIT indicating element information to be input to the selected functional unit.

The description information may further include a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding.

Decoding apparatus according to another embodiment of the present invention includes a table storage unit for storing one or more table information; Generate n (any number less than 0 or m) table information corresponding to the decoding description received from the encoder and store it in the table storage, or store k (any number being mn) table information in the table storage. A description decoder selected from the portion; Generating and outputting moving image data corresponding to encoded video data included in a bitstream received from the encoder using m (any natural number equal to or greater than n) table information generated or selected by the description decoder. It may include a codec unit.

The m table information is selected by the table storage unit when the decoding description includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Codec No.) in which the bitstream is encoded. Can be.

The decoding description is composed of m table areas, and table information for constituting the table may be inserted into each table area.

When generation information is included in a table area corresponding to arbitrary table information, the description decoder may newly generate a corresponding table using the generation information.

When correction information is included in a table area corresponding to arbitrary table information, the description decoder may modify the corresponding table using the correction information.

When a table area corresponding to any table information or a codec number (Codec No.), a profile and a level number (Profile and level No.) are further included before the table area, the description decoder is further configured to correspond to the codec. Table information can be modified by the correction information.

The codec unit may include: a tool box including a plurality of functional units respectively implemented to process a predetermined process; A Control Signal / Context Information (CSCI) storage unit for storing a plurality of element information generated by syntax parsing of the bitstream by at least one of the plurality of functional units; And a connection controller for designating a sequential processing order of the plurality of functional units by referring to one or more predetermined tables.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

When the encoded video data is encoded by a plurality of standards, the codec unit may generate and output the video data by sequentially connecting a plurality of functional units that perform a process according to a plurality of standards with reference to the table information. have.

The tool box may include: a parsing function unit generating a plurality of element information by syntax parsing of the bitstream, storing the plurality of element information in the CSCI storage unit, and generating and sequentially outputting macroblock data corresponding to the encoded video data; And a plurality of processing functional units, each of which is assigned a process to be processed to convert the macroblock data into the video data.

The m tables may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts, and FU-CSCIT indicating element information to be input to the selected functional unit. The table may further include a default value table (DVT) indicating a relationship between actual values and code values during entropy coding.

The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) move a file pointer to read s (arbitrary natural numbers) bits. Command, a SEEK instruction that reads the s bits without moving the file pointer, a FLUSH instruction that moves the file pointer by s bits in the file pointer, a GO instruction that indicates a branch between indexes, and element information It may be configured to include one or more of the set (SET) command to set the flag.

The connection control unit may designate a sequential processing order of a plurality of functional units selected from the parsing function unit and the plurality of processing function units using the F-RT.

The processing function selected by the connection control unit may perform a predetermined process using predetermined element information and output data by the immediately preceding function unit.

The parsing function unit may generate the element information by using the SET, the S-RT, and the CSCIT.

When the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder, the decoding apparatus may further include a separation unit for separating the decoding description and the bitstream.

According to another aspect of the present invention for achieving the above object, there is provided a decoding method / encoding method that can be used universally in various standards and / or a recording medium on which a program for executing the method is recorded.

According to an embodiment of the present invention, a decoding method includes: (a) receiving a bitstream and description information from an encoding apparatus; (b) generating and storing a plurality of table information corresponding to the description information; (c) storing a plurality of element information generated by syntax parsing of the bitstream using at least one table information in an element information storage unit; (d) converting the encoded video data of the bitstream into macroblocks having a predetermined size and sequentially outputting the macroblocks; (e) selecting an arbitrary function unit using one or more table information, and selectively inputting element information predetermined for the selected function unit among a plurality of element information stored in the element information storage unit; And (f) outputting the result data by performing a predetermined process using the input element information by the selected function unit. Here, the step (e) and the step (f) may be repeated until the result data is moving picture data corresponding to the encoded video data.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

During the repeated execution of step (e) and step (f), if the element information required for the functional unit to be selected by step (e) is not stored in the element information storage unit, the step (b) After performing, the repeated execution of step (e) and step (f) may be resumed.

The result data of the preceding functional unit among the plurality of sequentially selected functional units can be recorded in a buffer memory accessible by the subsequent functional unit.

In the step (b), the macroblocks that are sequentially output may be written to the buffer memory.

The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing the list of functional units, F-RT (for sequential selection of the functional units) FU-Rule Table) and an FU-CSCIT indicating element information to be input to the selected functional unit. Also, a DVT (Default Value Table) indicating a relationship between an actual value and a code value during entropy coding may be further included.

In step (c), the SET, the S-RT, the CSCIT and the DVT can be used.

The functional unit for performing the step (c), the step (d) and the step (f) may be determined by the F-RT.

Step (c) comprises: (g) selecting a bitstream syntax to be processed using the S-RT; (h) generating the element information using the process recorded in the SET; And (i) storing the generated element information in the element information storage unit to correspond to the CSCIT. Here, the steps (g) to (i) may be repeated until element information corresponding to all bitstream syntaxes is generated and stored.

Step (e) may include selecting any one of the functional units using the F-RT; Extracting, from the element information storage unit, element information to be input to the selected functional unit by using the FU-CSCIT and the CSCIT to match the characteristics of the functional unit recognized by the FL; And inputting the extracted element information into the selected function unit.

When the bitstream and the description information are input as one extension bitstream, the step (b) may be preceded by dividing the bitstream and the description information in the extension bitstream.

The description information may be input as independent data or bitstream.

The description information may be composed of binary code.

According to another aspect of the present invention, there is provided an encoding method comprising: (a) converting an input video into a bitstream according to a predetermined encoding scheme using a plurality of functional units sequentially; (b) generating description information according to a connection relationship between the syntax information of the bitstream and the functional units; And (c) transmitting the bitstream and the description information to a decoding apparatus.

Step (c) comprises: generating one extension bitstream including the bitstream and the description information; And transmitting the extended bitstream to the decoding apparatus.

According to still another embodiment of the present invention, there is provided a recording medium in which a program of instructions that can be executed in a decoding apparatus for performing a decoding method is tangibly implemented, and in which a program that can be read by the decoding apparatus is recorded. (a) generating and storing a plurality of table information corresponding to the description information input from the encoding apparatus; (b) storing a plurality of element information generated by syntax parsing of a bitstream input from an encoding apparatus using the stored one or more table information; (c) converting the encoded video data of the bitstream into macroblocks having a predetermined size and sequentially outputting the macroblocks; And (d) invoking one processing function by referring to the stored one or more table information among a plurality of processing functions each having a process to be processed for converting the macroblock data into the video data. The called processing function outputs result data of performing a specified process using predetermined element information among the plurality of stored element information, and the step (d) includes moving picture data in which the result data corresponds to the encoded video data. There is provided a recording medium on which a program is recorded, which is repeated until

During the repetition of the step (d), if the element information required for the functional unit to be selected by the step (d) is not stored in the element information storage unit, the step (d) after the redo of the step (b) ) Can be resumed.

The predetermined process of each of the processing functions may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding of the bitstream.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, embodiments of an integrated codec method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are denoted by the same reference numerals. And duplicate description thereof will be omitted.

FIG. 1 is a diagram schematically showing a configuration of a general decoder, and FIG. 2 is a diagram schematically showing a configuration of a general encoder.

As shown in FIG. 1, the MPEG-4 decoder 100 generally includes a variable length decoding unit 110, an inverse scan unit 115, and an inverse DC / AC prediction unit. / AC Prediction (120), Inverse Quantization (125), Inverse Discrete Cosine Transform (Inverse Discrete Cosine Transformation, 130), and Video Restoration (VOP Reconstruction, 135). It is apparent that the configuration of the decoder 100 may be different according to the applied standard, and some components may be replaced with other components.

When the transmitted bitstream 105 is parsed and parsed to extract header information and encoded video data, the variable length decoding unit 110 quantizes the Huffman table using a preset Huffman Table. The inverse scan unit 115 performs the inverse scan to generate data in the same order as the moving image 140. That is, the inverse scan unit 115 outputs a value in reverse of the order of scanning in various ways during encoding. After quantization is performed during encoding, a scan direction may be defined according to a distribution of frequency band values. In general, a zig-zag scan method is used, but the scan method may vary by codec.

Syntax parsing may be performed integrally in the variable length decoding unit 110 or may be performed in any component that processes the bitstream 105 prior to the variable length decoding unit 110. In this case, since syntax parsing is the same standard applied to the encoder and the decoding period, the syntax parsing is performed only by a predetermined standard corresponding to the standard.

The inverse DC / AC predictor 120 determines the direction of the reference block for prediction by using the magnitude of the DCT coefficient in the frequency band.

The inverse quantizer 125 inverse quantizes the inversely scanned data. That is, the DC and AC coefficients are reduced by using a quantization parameter (QP) specified during encoding.

The inverse DCT unit 130 performs an Inverse Discrete Cosine Transform to obtain an actual video pixel value to generate a VOP (Video Object Plane).

The video reconstruction unit 135 reconstructs and outputs a video signal by using the VOP generated by the inverse DCT unit 130.

As shown in FIG. 2, the MPEG-4 encoder 200 generally includes a DCT unit 210, a quantizer 215, a DC / AC predictor 220, a scan unit 230, and a variable length encoder ( 235).

Each component included in the encoder 200 performs the inverse function of each component of the corresponding decoder 100, which is obvious to those skilled in the art. In brief, the encoder 200 performs encoding by converting a video signal (ie, a digital image pixel value) into a frequency value through a discrete cosine transform, quantization, and the like, and then encoding the information. Variable length encoding that differentiates the bit length according to the frequency is performed and output in the compressed bitstream state.

3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention, and FIG. 4 is a diagram schematically illustrating a configuration of a universal bit-stream according to an embodiment of the present invention. FIG. 5 is a diagram schematically showing a configuration of a codec unit according to an embodiment of the present invention, FIG. 6 is a diagram schematically showing a configuration of a SYN parser according to an embodiment of the present invention, and FIG. 2 is a diagram schematically illustrating a configuration of an MB processing unit according to an embodiment of the present invention.

As shown in FIG. 3, the decoder 300 according to the present invention has a configuration different from that of a conventional decoder (see FIG. 1).

That is, the decoder 300 according to the embodiment of the present invention includes a separator 310, a description decoder (DDD) 320, a table storage unit 330, and a codec unit 340. . One or more of the components of the illustrated decoder (eg, the separation unit 310, the description decoder 320, the codec unit 340, etc.) may be a software program (or program) implemented to perform the functions described below. It is apparent that the implementation may be implemented in a combination of codes).

The separation unit 310 separates the input extended bitstream (Universal Bit-stream, 305) into a decoding description (DD, Decoding Description) region and a general bitstream 105 (hereinafter, referred to as a conventional bitstream) region, The decoding description is input to the description decoder 320 and the conventional bitstream is input to the codec unit 340.

That is, the extended bitstream according to the present invention may include decoding descriptions 410 to 470 and a conventional bitstream 105 as illustrated in FIG. 4.

The decoding description may include a conventional bitstream 105 configuration information and a conventional bit in order to parse a bitstream encoded by various encoding schemes and / or a bitstream encoded by a user-selected function among various functions by a common interpretation scheme. Information about the manner in which the stream 105 is encoded (or connection information between functional units). The decoding description may be included in the extended bitstream 305 (provided to the decoder 310 (see FIGS. 4, 9 to 12)) or may be provided to the decoder 310 in the form of an independent bitstream or data. The decoding description may be described by a description method such as a textual description or a binary description.

Decoding descriptions include Functional Unit List (FL), Functional Unit Rule Table (F-RT) 420, Functional Unit CSCIT (430), Control Signal and Context Information Table (440), and SET (Syntax). Element Table 450), Syntax-Rule Table 460, S-RT, Default Value Table 470, and the like. Obviously, the order of the tables for configuring the decoding description information may be modified in various ways.

Here, the functional unit list (FL), the functional unit rule table (F-RT) 420, the functional unit CSCIT (430), the control signal and context information table (CSCIT), and the like are each functional units. (FU) may be used to establish a connection relationship (the corresponding tables may be referred to as 'first decoding description' if necessary).

The FU-CSCIT 440 may be decoding description information for mapping between each functional unit in the MB processing unit 550 and element information stored in the CSCI storage unit 520. In this case, the element information may function as a control variable for each functional unit in the MB processing unit 550 and / or the SYN parser 540.

In addition, the control signal and context information table (CSCIT) 440, the syntax element table 450 (SET), the syntax-rule table 460 (S-RT), the default value table (DVT), and the like are conventional bitstreams 105. Can be used for parsing (the tables can be referred to as 'second decoding description' if necessary). The form and function of each decoding description information will be described later in detail.

The description decoder 320 stores the decoding description input from the separation unit 310 in the table storage unit 330 as a plurality of tables in a form that can be recognized by the codec unit 340. That is, the description decoder 320 converts the data included in the extended bitstream 305 in the form of binary data into tables that can be interpreted by the SYN parser 540 and stores the data in the table storage unit 330.

Tables stored in the table storage unit 330 by the decoding description analysis of the description decoder 320 include FL 410, F-RT 420, FU-CSCIT 440, CSCIT 440, and SET 450. , S-RT 460, DVT 470, and the like. As illustrated in FIG. 10, the description decoder 320 may distinguish each table with reference to a table identifier (TI) 1010.

Of course, not all tables must be included in the decoding description, and as illustrated in FIG. 8, a codec number (Codec #, 920) and a profile and level # (930) are included, or FIG. 11. As illustrated in FIG. 2, only some tables may include a codec number (Codec #, 1120) and a profile and level # (1130). If a codec number (Codec #) and a profile and level # are included, the description decoder 320 does not create a new table for all or some of the tables, but is stored in the table storage unit 330 in advance. One of the tables may choose to have the corresponding one used for decoding. Of course, when the codec number (Codec #), profile and level # (Profile and level #) and the correction information is included, the description decoder 320 corresponds to the corresponding codec among the tables previously stored in the table storage unit 330 You can also extract a table to create a new table that reflects the modified information. Of course, if the codec number (Codec #) and the profile and level # (Profile and level #) is not included, the description decoder 320 is used to decode the entire table or a part of the table when the table description for creating the table is included. You can also create a new table to do this.

Also, as illustrated in FIG. 11, the decoding description may further include update information 1230 in addition to the decoding description DD-T 1210 for each table. The configuration of each extended bitstream will be described in detail later with reference to the accompanying drawings.

The table storage unit 330 stores the tables separated by the description decoder 320. Of course, the table storage unit 330 may include one or more tables corresponding to the case where the extension bitstream 305 includes a codec number (Codec #, 920 or 1120) and a profile and level # (930 or 1130). In order for them to be used by the codec unit 340, one or more tables may be stored in advance.

As illustrated in FIG. 5, the codec unit 340 may include a tool box (510), a control signal / context information (CSCI) storage unit 520, and a connection control unit 530. It may include.

The tool box 510 includes a SYN parser 540 and a plurality of functional units. Obviously, the SYN parser 540 may also be implemented as one functional unit. The SYN parser 540 and the functional units may each be implemented in a combination of program codes.

That is, the tool box 510 is an area including functional units (FU) implemented to perform respective functions, and each functional unit is formed in a sequential connection relationship according to the connection control of the connection controller 530. Then, the encoded video data included in the conventional bitstream 105 is output as video data. However, the SYN parser 540 included in the tool box 510 may be set to perform the analysis of the conventional bitstream 105 without the connection control of the connection controller 530. This means that the following functional units interpret the element information stored by the SYN parser 540 and stored in the CSCI storage unit 520 and / or the macroblock (MB) size video data output from the SYN parser 540. Because it is available.

SYN parser 540 interprets the conventional bitstream 105 input using SET 450, S-RT 460, CSCIT 440, DVT 470, etc., resulting in syntax parsing. In element information is stored in the CSCI storage unit 520. The CSCI storage unit 520 may be, for example, a buffer memory. The element information may be, for example, Control Signal / Context Information (CSCI). The element information parsed by the SYN parser 540 and stored in the CSCI storage unit 520 may be an input value for determining subsequent syntax of the conventional bitstream 105 at the same time as the parsing result of the corresponding step.

In addition, the SYN parser 540 performs entropy decoding on the header and the image data of the syntax-parsed conventional bitstream 105 to perform video data having a predetermined macroblock size according to the connection control of the connection controller 530. Output to the function unit (FU).

Of course, the SYN parser 540 stores the macroblock sized video data in a predetermined buffer memory, and a subsequent function unit according to the connection control of the connection controller 530 reads out the macroblock sized video data from the corresponding buffer memory. After processing, the processed video data may be stored in a corresponding buffer memory for processing of a subsequent functional unit. That is, the SYN parser 540 stores the macroblock sized video data in the CSCI storage unit 520 or a separate buffer memory, and then the connection control unit 530 provides the stored macroblock sized video data to the selected function unit. It is apparent that the selected function unit may read the video data from the CSCI storage unit 520 or a separate buffer memory. However, hereinafter, it is assumed that the video data of the macroblock size output by the SYN parser 540 is directly input to the functional unit according to the connection control of the connection controller 530.

SYN parser 540 may be implemented as a single software program (including a combination of program codes). Although the SYN parser 540 is implemented to perform a plurality of functions respectively corresponding to a plurality of standards (e.g., MPEG-1 / 2/4 / AVC, etc.), the SET 450, S-RT 460, This is because the corresponding operation may be performed using the CSCIT 440, the DVT 470, or the like. Of course, the SYN parser 540 may be implemented by being divided into a plurality of functional units as shown in FIG. 6, and each of the functional units may be implemented as a combination of blocked program codes.

The function of the SYN parser 540 by describing each functional unit illustrated in FIG. 6 in detail is as follows.

As illustrated in FIG. 6, the SYN parser 540 includes a network abstraction layer parsing (NALP) function (FU) 610, a syntax parsing (SYNP) function 620, and a context determination (CTX) function 630. And a variable length decoding function unit 640, a run length decoding function unit 650, a macro block generator (MBG) function unit 660, and the like.

Of course, the SYN parser 540 may include all of the functional units for syntax parsing regardless of the applicable standard, and may add new functional units necessary for parsing Syntax in the process of technology development, and modify existing functional units. It is also possible that unnecessary functions can be removed. In addition, it is apparent that each functional unit provided in the SYN parser 540 does not exist independently in each standard, and in the case of a functional unit capable of the same processing regardless of the standard, it may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The NALP function unit 610 is a function unit for parsing a Network Abstraction Layer (NAL) of MPEG-4 AVC, and the SYNP function unit 620 is a function unit for parsing syntax of a bitstream. The SYNP function 620 may be included in the VLD function 640.

The CTX function unit 630 is a function unit that determines a VLC table of MPEG-4 AVC, and the VLD function unit 640 is a function unit that performs entropy decoding.

The RLD function unit 650 is a function unit for entropy decoding AC values, and the MBG function unit 660 is a function unit for generating one MB (Macro Block) data by combining the DC value and the AC values. All of the functional units and some of the functional units in the aforementioned SYN parser 540 may be included in the VLD functional unit 640 depending on the system implementation.

As described above, the SYN parser 540 may be implemented as one software program or may be implemented as a plurality of software programs (for example, the VLD function unit 640 may be independently implemented as an independent software program). The SYN parser 540 extracts or generates element information using the first description information (ie, one or more of SET 450, S-RT 460, DVT 470, CSCIT 440, etc.) to generate CSCI. The process of storing in the storage unit 520 will be described in detail later in the description of the connection controller 530.

The MB processing unit 550 decodes the video data of the macroblock unit input from the SYN parser 540 (or stored in the buffer memory by the SYN parser 540) and outputs the video data as a predetermined size.

The MB processing unit 550 may include functional units FU for performing the above-described functions corresponding to each standard. Each functional unit may be implemented as an independent processing block (eg, a software program, a combination of instruction codes, a function, etc.) to configure the MB processing unit 550, or the MB processing unit 550 may be implemented as one integrated processing block. Could be Although the MB processing unit 550 is implemented as one integrated processing block, it is obvious that the corresponding processing may be performed by the connection control of the connection control unit 530.

As illustrated in FIG. 7, the MB processing unit 550 includes a De-blocking Filter (DF) function 710, a VOP Reconstructor (VR) function 715, a Frame Field Reordering (FFR) function 720, Intra prediction and picture reconstruction (IPR) function 730, inverse transform (IT) function 735, inverse quantization (IQ) function 745, inverse AC prediction function 755 (ISA), IS ( An inverse scan function unit 760 and a DC Reconstruction (DCR) function unit 765.

The IT4x4 function unit 740, the IQ4x4 function unit 750, and the DCR4x4 function unit 770 are characterized in that the block size to be processed is 4x4. This is because MPEG-4 AVC processes data with 4x4 block size, whereas MPEG-1 / 2/4 processes data with 8x8 block size during Transform, Quantization, and Prediction.

The MB processing unit 550 may include all of the functional units for performing the data decoding function regardless of the applicable standard, and may add necessary functions in the process of technology development, and may modify existing functions, and unnecessary functions. It is obvious that wealth can be removed. For example, if an IS4x4 function unit for processing data with a 4x4 block size is additionally required for the decoding process, the corresponding function units may be added to the MB processor 550. In addition, a special prediction (SPR) function (not shown) for performing intra prediction in MPEG-4 AVC may be further added.

Each functional unit provided in the MB processing unit 550 does not exist independently in each standard, and in the case of a functional unit capable of the same processing irrespective of the standard, it may be apparent that the functional units may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The DF function 710 is a de-blocking filter of MPEG-4 AVC, and the VR function 715 is a function that stores the reconstructed pixel value.

The FFR function unit 720 is a function unit for the interlaced mode, and the IPR function unit 730 is a function unit for storing the reconstructed pixel value after intra prediction of MPEG-4 AVC. As described above, intra prediction of MPEG-4 AVC may be performed by the SPR function.

The IT function unit 735 is a function unit that performs inverse transform of the DC value and the AC values, and the IQ function unit 745 is a function unit that inverse quantizes the AC values.

The IAP function unit 755 is a function unit for inverse AC prediction of AC values, and the IS function unit 760 is a function unit for inverse scan of AC values. The DCR function unit 765 is a function unit that performs inverse prediction and inverse quantization of DC values.

The above-described SYN parser 540 and the MB processing unit 550 are not necessarily operations that must be sequentially performed (that is, the operation of the MB processing unit after the operation of the syntax parsing unit is completed), and the connection of the connection controller 530 is performed. It is obvious that parallel processing is also possible by the control. For example, it may be sufficient that only the minimum element information necessary for the operation of the functional unit currently operated by the MB processing unit 550 is stored in the CSCI storage unit 520 by the SYN parser 540.

In the CSCI storage unit 520, element information (eg, CSCI) that is a result of syntax parsing using the SET 450 and the S-RT 460 in the SYN parser 540 corresponds to the CSCIT 440. Stored. The CSCI storage unit 520 may be, for example, a buffer memory.

The element information stored in the CSCI storage unit 520 is used as input data for performing the process of the SET 450 by the SYN parser 540 or a control variable for determining a subsequent connection index in the S-RT 460. It can be used as.

In addition, the element information stored in the CSCI storage unit 520 is used as a control variable for determining a subsequent connection index in the F-RT 420 by the connection control unit 530, or a specific function in the FU-CSCIT 430 The input FU may be used to map element information stored in the CSCI storage unit 520.

That is, the element information stored in the CSCI storage unit 520 serves to interwork between the SYN parser 540 and the MB processing unit 550.

The connection control unit 530 sets connections of respective functional units included in the MB processing unit 550 to decode bitstreams encoded by various standards. That is, the connection controller 530 selects an appropriate functional unit from among the functional units included in the MB processing unit 550 to determine an execution order between the selected functional units. To this end, the connection controller 530 connects the corresponding functional units by using the FL 410, the F-RT 420, and the CSCIT 440, and each of the functional units uses the element information provided by the SYN parser 540. Decode the video data in units of macroblocks.

Tables used by the connection controller 530 to perform the above-described functions include the FL 410, the F-RT 420, the FU-CSCIT 430, and the CSCIT 440.

First, as shown in FIG. 14, the FL (FU List) 410 is a table containing a list of respective functional units included in the MB processing unit 550, input / output data of the corresponding functional units, and element information for controlling the functional units. .

The FL 410 is a buffer memory name (or a write address of the data or an address in the buffer memory in which the data is recorded) of the input data for each functional unit and a buffer memory name (or the corresponding data) of the output data by the corresponding functional unit. May be further included).

Accordingly, each functional unit may record output data read and processed by the input data using the FL 410. In addition, the input / output data may be transmitted between the respective functional units using the information recorded in the FL 410, or the connection controller 530 may provide appropriate input data to each functional unit.

However, the input data and output data of the SYN parser 540 that generates the element information are not described in the FL 410, which is generated by the SYN parser 540 using information such as the SET 450. This is because the element information created at the specified position is recorded.

As illustrated in FIG. 14, the FL 410 includes an index (F), which is an identifier for distinguishing each functional unit, a name of each functional unit (FU Name), the number of input control (CSCI) variables required for the corresponding functional unit, and an input. Data and output data.

The specific function unit selected by the connection control unit 530 receives input data from the connection control unit 530 and performs a preset process to generate output data. Here, the functional unit is included in the MB processing unit 550, and refers to a series of processes (for example, a function, an algorithm, or a function) for processing the input data in a predetermined process to generate output data. The function unit may store the output data in a buffer memory for processing of a subsequent function unit (ie, a function unit subsequently selected by the connection control unit 530). Since the functional units FU illustrated in FIG. 14 have already been described above in the description of the MB processing unit 550, the description thereof will be omitted. In addition, since QFS, QFSP, PQF, QF, etc. in FIG. 14 are obvious to those skilled in the MPEG field and the like, description thereof will be omitted. For example, QFS means an output value obtained by variable length coding.

If the codec unit 340 uses only one standard for decoding the encoded video data included in the conventional bitstream 105, then the FL 410 is provided to the functional units for performing the corresponding processing in that standard. It can only contain information.

However, when the video data is encoded by a plurality of standards (for example, when the encoding standard is applied differently in units of a plurality of frames), the information of the functional units according to the plurality of standards for decoding the encoded video data. Will be needed. Accordingly, in this case, the FL 410 should include information of the functional units according to the plurality of standards necessary for decoding of encoded video data among all the functional units according to the corresponding plurality of standards.

Of course, even if the video data is differently applied to the encoding standard in units of a plurality of frames, each FL 410 is each if a plurality of conventional bitstreams 105 and extension bitstreams 305 are generated and output for each applied encoding standard. It may be necessary to include only the information of the functional units according to the corresponding standard.

The FL 410 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Next, the F-RT (FU-Rule Table) 420 provides connection information of functional units to be used to decode the input conventional bitstream 105.

As shown in FIG. 15, the F-RT 420 includes an index (Index, R) for distinguishing each connection information (Rule), a function unit (FU, F) corresponding to the corresponding connection index, and necessary for connection control. Element information (Input CS / CI, C), number of branches that can be connected to subsequent functional units, and branch information required by the number of branches (# 1, # 2, # 3…) and the like.

Necessary element information exists only when the number of branches is 2 or more. In this case, the connection index may vary according to the determination result of the conditional statement using the required element information. That is, when the number of branches is 1, necessary element information does not exist and the process proceeds to the connection index indicated by the branch information. After that conditional statement, the subsequent connection index (R) is presented.

If the codec unit 340 uses only one standard for decoding the encoded video data included in the conventional bitstream 105, the F-RT 420 may perform the corresponding processing only in the standard. The connection relationship between the functional units will be indicated.

However, if the video data is encoded by a plurality of standards (for example, if the encoding standard is applied differently in a plurality of frames), the connection of functional units according to the plurality of standards for decoding of the encoded video data. It is obvious that information for specifying a relationship will be included. It is obvious that each of the tables mentioned below will further include corresponding information if it needs additional information and / or a modification to be applied to a plurality of standards in order to apply in a plurality of standards.

The F-RT 420 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

The function unit FU for implementing R0 to R5 and R12 among the indexes R and R for distinguishing each connection information Rule illustrated in FIG. 15 is F0. Referring to FL 410 of FIG. 14, it may be understood that F0 is a SYN parser 540. Accordingly, it can be seen that the connection controller 530 controls the operational connection relationship of the respective functional units (including the SYN parser 540) included in the tool box 510. In addition, when the selected functional unit is the SYN parser 540, it can be seen that the F-RT 420 includes connection information (Rule) regarding how many Syntax the SYN parser 540 should read and process (eg, For example, F0 (R74) and the like.

In addition, the index R1 defines 'PROCESS1' as the functional part item. For example, 'PROCESS1' may be a function that is called to perform other tasks (ie, operations other than syntax parsing and data decoding) required for the software implementation, such as variable declaration, memory setting, and variable value initialization. Such a process may be inserted into a required location of the F-RT 420 for execution of software and called and executed by the connection controller 530 in the middle of a syntax parsing or data decoding process. Although only one process is inserted in FIG. 15, it is obvious that a plurality of processes having the same or different performing operation may be inserted at a plurality of positions of the F-RT 420.

Next, the FU-CSCIT (FU CSCI Table) 430 is a table for connecting element information stored in the CSCI storage unit 520 and element information (input CSCI) required by each function unit.

As illustrated in FIG. 16, the FU-CSCIT 430 is an index (FC) listed as a pair of indexes and element information of the FL 410, an index used by the CSCIT 440 for corresponding element information, and mapping ( C). In addition, the FU-CSCIT 430 may further include a data type of element information. For example, the data type may be described in the form of a 9-bit integer, a 1-bit flag, or the like.

The FU-CSCIT 430 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

For example, if F1 receives input of four element information in the F-RT 420 (see FIG. 14), the element information for each functional part is listed in the FU-CSCIT 430. That is, F1-C1, F1-C2, F1-C3. F1-C4 are listed and each element information is mapped, such as C54, C56, C58, C65, using index C of CSCIT 440 (see FIG. 17).

Similarly, if F2 has an input of two element information, it is indexed by F2-C1, F2-C2 and mapped to C56, C58 values. Here, C54, C56, etc. may be recognized as an address (for example, a write address, a buffer memory name, or a write address in the buffer memory) in which the corresponding element information is stored, and the corresponding function unit may correspond to the input data and the index C. Output data may be generated and output (or written to a buffer memory) using corresponding element information.

For example, in FL 410, DCR needs 4 element information to process input data called QFS, and the 4 element information is C54, C56, C58 and C65 by FU-CSCIT 430. Recognized, the CSCI storage unit 520 may generate element QFSP by reading element information corresponding to the corresponding index (C).

Finally, the CSCIT 440 describes detailed information on element information (eg, CSCI) that is the result information of a process in which the SYN parser 540 uses the SET 450 and the S-RT 460. That is, the CSCIT 440 is processed from the conventional bitstream 105 and stored in the CSCI storage unit 520, and provides information on all meaningful data (i.e. element information) to be used by the MB processing unit 550. Have

As illustrated in FIG. 17, the CSCIT 440 is a unique number of the corresponding element information, which is an index C, a flag, an element name of the element information, and a data structural characteristic of the element information. To specify whether the element information is used only in the syntax parsing process or the overall decoding process, for example, the storage space of the element information, whether the element information is an array, etc. Includes Global / Local, etc.

The CSCIT 440 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Subsequently, the CSCIT 440, SET 450, S-RT 460, which the SYN parser 540 uses to extract or generate element information from the conventional bitstream 105, and store the element information in the CSCI storage unit 520. The DVT 470 will be described. However, since the CSCIT 440 has been described with reference to FIG. 17, description thereof will be omitted.

First, the SET 450 is a table configured by information on the syntaxes of the conventional bitstream 105 input.

As illustrated in FIGS. 18 to 21, the SET 450 includes an index, an element name, input data, output data, and a SET-process (for each syntax). process by SET-PROC) information. Here, the index is a delimiter S for distinguishing each syntax used in the S-RT 460. The element name is a name of a syntax and may be named according to the meaning or role of the syntax. The input data is the nominal bit length input at one time in the conventional bitstream 105. The output data is element information (ie, CSCI information C) and represents a list of CSCITs 440 to which reference is made when storing acquired data. Here, the output data field may be a buffer memory name (or a write address of the corresponding data or an address in the buffer memory where the corresponding data is recorded) in which the generated element information is to be recorded. By using this, if the corresponding element information is needed later as input data, the corresponding element information may be read using the CSCI information (C). The SET-process describes the process of receiving each bitstream syntax and what processing procedure to generate element information, which is output data.

The SET 450 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Next, the S-RT 460 shows connection information between each syntax in the conventional bitstream 105. That is, the S-RT 460 has information instructing to call each syntax and move to the next syntax. The SYN parser 540 reads the conventional bitstream 105 using the S-RT 460 or defines the order in which element information is stored and / or updated in the CSCI storage 520.

As illustrated in FIGS. 22 to 25, the S-RT 460 stores an index R, a syntax index S, input data C, a number of branches, and branch information. Include.

The index R distinguishes each connection information rule. Since the index S of the syntax designates a syntax to be processed at a specific connection index, the SYN parser 540 performs a process specified for the syntax using the SET 450.

The input data represents a list of element information to be used for determining a condition for connection control in the corresponding connection index.

The number of branches is the number of cases that can be linked to subsequent syntax, and represents the total number of branch paths that the connection index has. Branch information is a condition determination algorithm for determining the number of branch information necessary for the number of branches (# 1, # 2, # 3, etc.), and which connection index to process next. The branch information can directly determine which contents are read in what order. As shown in Figs. 22 to 25, when the number of branches is 1, there is no input data, and the process proceeds immediately to process the connection index specified in the branch information. However, if the number of branches is 2 or more, condition determination is performed (consisting of the next connection information R after the conditional statement) and proceeds to process the corresponding connection index.

The SYN parser 540 updates the CSCI storage unit 520 by processing the syntax defined in the corresponding connection index, reads the element information of the updated CSCI storage unit 520, and uses the same to determine branch conditions. This is, for example, C0 at 'C0 == 1' which is a branch condition of branch information of index R0 is element information C0 after processing syntax S0.

The S-RT 460 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar script language.

Finally, the DVT 470 is a table in which Huffman table information used in each encoder / decoder is recorded. In MPEG-1 / 2/4 / AVC, entropy coding is performed at each encoding. In this case, a Huffman coding method is mainly used, and the information used in this case is a Huffman table. To implement the integrated codec, Huffman table information to be used in the corresponding decoder must be provided for each decoding. Therefore, Huffman table information corresponding to each syntax is included in syntax parsing in the decoding description according to the present invention. Of course, if Huffman table information corresponding to each standard is already recorded in the table storage unit 330, transmission of the DVT 470 is omitted or as shown in FIG. 11, the codec number (Codec #, 1120) and the profile and Only the level number (Profile and level #, 1130) may be included.

As illustrated in FIGS. 26 to 27, the DVT 470 includes a name for each Huffman table, an actual value compressed and output by Huffman coding, and a compressed actual value. ) Contains the code value used when stored in). For example, if the MCBPC value is compressed to obtain an actual value of 3, the conventional bitstream 105 is performed by a Huffman table mapping operation (for example, the PROCESS portion of SET 450). The code value 011 is recorded. As another example, the VLD [1] is recorded in the process portion of the index S77 (see FIGS. 18 to 21) of the SET 450 illustrated above, thereby calling a function called VLD. This function reads a conventional bitstream 105 for a predetermined length (fixed or variable length), obtains a code value, and then performs a corresponding actual value by Huffman table mapping. Can be obtained. The Huffman table used at this time is [1], that is, the first table, CBPY.

The DVT 470 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the table may be described in a similar scripting language.

For example, the DVT 470 may be textual description as follows.

DVT {((0,1), (1,001), (2,010), (3,011), (4,0001), (5,000001), (6,000010), (7,000011), (8,000000001) , (9, NULL)) ((0,0011), (1,00101), (2,00100), (3,1001), (4,00011), (5,0111), (6,000010), (7,1011), (8,00010), (9,000011), (10,0101), (11,1010), (12,0100), (13,1000), (14,0110), (15 , (11), (16,000000), (17,000001), (18, NULL)) ((0,011), (1,11), (2,10), (3,010), (4,001), (5, 0001), (6,00001), (7,000001), (8,0000001), (9,00000001), (10,000000001), (11,0000000001), (12,00000000001), (13, NULL) ) ((0,11), (1,10), (2,01), (3,001), (4,0001), (5,00001), (6,000001), (7,0000001), (8 , 00000001), (9,000000001), (10,0000000001), (11,00000000001), (12,000000000001), (13, NULL)) ...

As another example, the DVT 470 may be binary described as follows.

0000001111111111111111111111111011111000011000110010001101000011011001000001001100000010011000001000110000011010010000000010000011111001000011001010010100101001000010010010010100011001000111001100000100010010110010100010001100000110010001010010010100010001000010010000010001100001011001100000000011000000100000111110001101100010110001010000110100001100100100000100101000010011000000100111000000101000000000010100100000000101010000000000101011000000000010000011111000101100010100001001000110010010000010010100001001100000010 ...

Each table has the advantage of being able to reduce storage space, improve processing efficiency, and reduce transmission time of the extended bitstream 305 including decoding description by binary description. For example, overhead bits of the textual description and the binary description of each table based on MPEG-4 Simple Profile (SP) are shown in Table 1 below.

Table 1.Overhead of Textual / Binary Description (bytes)

Table name Textual Description Binary Description SET 3653 1089 S-RT 4201 1122 F-RT 466 142 CSCIT 808 24 FU-CSCIT 151 37 FL 98 28 DVT 2599 259 Total 11,976 2,702

Hereinafter, the interworking process between the tables used by the SYN parser 540 and / or the connection controller 530 will be described.

The method of starting the operation of the codec unit 340 of the decoder 300 according to the present invention may vary. Some examples are as follows.

In the first embodiment, the SYN parser 540 independently starts operation (i.e., starts parsing syntax of the conventional bitstream 105 using the tables stored in the table storage 330) to parse syntax for the conventional bitstream. In this case, the connection controller 530 controls the connection relationship between the respective functional units of the MB processor 550 using the tables stored in the table storage unit 330.

In this case, the SYN parser 540 must first recognize that the storage of the tables necessary for the table storage unit 330 is completed. To this end, the SYN parser 540 continuously monitors whether the table information is stored in the table storage unit 330, or the description decoder 320 that has completed the storage of the table information should notify the SYN parser 540 of this. .

In addition, the connection controller 530 must first recognize whether the SYN parser 540 has completed storing some / all required element information in the CSCI storage unit 520. To this end, the connection control unit 530 continuously monitors whether necessary element information to the CSCI storage unit 520 has been stored, or the SYN parser 540 storing the element information is notified to the connection control unit 530 (eg, For example, the control authority is returned to the connection control unit 530, such as index R72 of the S-RT 460). Of course, the connection control unit 530 or any functional unit selected by the connection control unit 530) and / or the SYN parser 540 may determine whether information necessary for the table storage unit 330 or the CSCI storage unit 520 has been stored. Obviously, it is possible to wait until the necessary information is stored in the storage unit in the state of starting operation without monitoring.

In the second embodiment, the connection controller 530 controls the connection relationship between the functional units of the SYN parser 540 and the MB processor 550 using the tables stored in the table storage 330. As shown in the above-described F-RT 420, first, the operation of the SYN parser 540 is instructed so that element information obtained by syntax parsing the conventional bitstream is stored in the CSCI storage unit 520. When the control right is returned to the connection control unit 530 (for example, such that the control right is returned to the connection control unit 530, such as index R72 of the S-RT 460), the corresponding functional unit FU is followed. Control the connection of each functional unit to handle the operation. In this case, the connection controller 530 must first recognize that the storage of the tables necessary for the table storage unit 330 is completed. To this end, the connection control unit 530 continuously monitors whether the table information is stored in the table storage unit 330, or the description decoder 320 that has completed storing the table information should notify the connection control unit 530 of this. . Of course, the connection control unit 530 or any functional unit selected by the connection control unit 530) and / or the SYN parser 540 may determine whether information necessary for the table storage unit 330 or the CSCI storage unit 520 has been stored. Obviously, it is possible to wait until the necessary information is stored in the storage unit in the state of starting operation without monitoring.

In a third embodiment, a trigger is implemented to instruct operation of the connection controller 530 and / or the SYN parser 540 to start. The trigger recognizes when the extended bitstream 305 is received and instructs the operation of the separation unit 310 first, and recognizes when a plurality of tables corresponding to the decoding description are stored in the table storage unit 330. The operation of the codec unit (ie, the connection controller 530 and / or the SYN parser 540) may be instructed. By providing a trigger, in each of the above-described embodiments, the connection control unit 530 and / or the SYN parser 540 does not need to monitor the table storage unit 330 or the like to determine when to start operation.

Hereinafter, the interworking process between the tables used by the SYN parser 540 and / or the connection controller 530 will be described based on the second embodiment described above.

First, the connection controller 530 reads the first rule information (Rule) of the F-RT 420 from the table storage unit 330 and calls the corresponding function unit. The connection control unit 530 first reads F0 (R0) as shown by the F-RT 420, and instructs the SYN parser 540 to process it. This may be to cause a processing block of program codes corresponding to SYN parser 540 to be activated. According to the FL 410, it can be seen that F0 is the SYN parser 540. If the selected functional unit FU is the SYN parser 540, information about the number of syntaxes to be read and processed is described together (for example, For example, F0 (R0), F0 (R114) and the like).

The SYN parser 540 reads corresponding syntax by reading rule information designated by the connection controller 530 (that is, designated by the F-RT 420) among the rule information (Rules) of the S-RT 460. Since the rule information indicated by the F-RT 420 was F0 (R0), the SYN parser 540 starts processing from the index R0. The SYN parser 540 recognizes that the syntax to be processed at the index R0 by the S-RT 460 is S0, and S0 is the Visual Object Sequence Start Code by the SET 450, and corresponds to the corresponding bitstream 105 in the related art. The bit (ie, 32 bits set as an input value in the SET 450) is read, and a corresponding output value (ie, C0 as element information) is generated and stored in the CSCI storage unit 520. What is the element information stored in the CSCI storage unit 520 is described in the CSCIT 440. Subsequently, the SYN parser 540 substitutes element information (i.e., C0) stored in the CSCI storage unit 520 into corresponding branch information of the S-RT 460, and proceeds to process the index corresponding to the result. do. For example, since the branch information corresponding to the index R0 is 'C0 == 1', if the content is satisfied, the branch information proceeds to the index R1, otherwise, an error process is performed. This process continues until it encounters a 'GO RT' and control authority is transferred to the F-RT 420 (ie, the connection control unit 530) (eg, index R72 of the S-RT 460).

However, when the SYN parser 540 generates element information using the SET 450 and stores the element information in the CSCI storage unit 520, when the VLD function is called (for example, the index S74 of the SET 450). Entropy decoding is performed using the DVT 470. When the element information is generated in this process, it is stored in the CSCI storage unit 520.

During the processing of the SYN parser 540, 'GO RT' is met and control authority is transferred to the F-RT 420 (i.e., the connection control unit 530) (for example, the index R72 of the S-RT 460). If the connection control unit 530 receives the C63 (that is, the element information according to the index S57 of the SET 450 in the syntax parsing process) that is the input value of the index R0 of the F-RT 420, the CSCI storage unit 520 receives the C-value. Index to read and assign to branch information (ie, ((C63 == 1) || (C63 == 2)) or ((C63 == 3) || (C63 == 4))) Specifies. That is, it is determined whether to proceed to the index R1, end (END), or error processing depending on whether the branch information is satisfied.

When proceeding to the index R1, after performing a predetermined process (eg, variable declaration, memory setting, variable value initialization, etc.), an index to be subsequently processed is determined.

As described above, when all / part of element information is stored in the CSCI storage unit 520 by the processing of the SYN parser 540, the connection control unit 530 calls the function unit F1 at the index R6. It is recognized by the FL 410 that F1 is a DC Reconstruction (DCR).

The DCR recognizes that there are four input values (that is, C54, C56, C58, and C65) with reference to the FU-CSCIT 430, and reads corresponding element information from the CSCI storage unit 520. What the corresponding element information is may be recognized through mapping with the CSCIT 440. The DCR completes the processing of the video data of the macroblock size predetermined for the corresponding functional unit by using the read element information, and stores the processed video data in the buffer memory or the CSCI storage unit 520.

This process continues from index R6 to R11 as illustrated in F-RT 420. Thereby, the DCR, IS, IAP, IQ, IT, VR and the like are controlled so as to be sequentially connected. The connection control unit 530 may recognize whether any functional unit has completed the processing, and when the processing of the preceding functional unit is completed, instructs the processing of the subsequent functional unit. In addition, the preceding function unit stores the data processed for moving image data processing in a subsequent function unit in a preset buffer memory or CSCI storage unit 520. Since the connection control unit 530 recognizes whether any function has completed the processing, it will be apparent to those skilled in the art, and a description thereof will be omitted.

The codec unit 340 inputs the conventional bitstream by controlling the connection control unit 530 to perform the above-described process, that is, processing according to the index order described in the F-RT 420 and / or the index order according to the branch condition. Video data corresponding to 105 may be output.

As will be understood from the above description, the interworking loop between tables according to the present invention can be largely divided into two. That is, the F-RT loop is divided into F-RT (420), FL (410), FU-CSCIT (430), F-RT (420), CSCIT (branch condition application, etc.), F-RT (next rule). S-RT loop consists of S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition application, etc.), S-RT (next rule) do.

In addition, the F-RT loop can be divided into two as follows. First, when instructing execution of the MB processing unit 550, F-RT 420, FL 410, FU-CSCIT 440, F-RT 420, CSCIT (branch condition application, etc.), F- It consists of RT (next rule). Next, when instructing execution of the SYN parser 540, F-RT 420, FL 410, (S-RT loop), F-RT 420, CSCIT (branch condition application, etc.), F It consists of -RT (next rule).

In addition, the S-RT loop can be divided into two as follows. When branching to the next rule information, S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition apply), S-RT (next rule) ), And when returning to the F-RT 420, S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition application, etc.) , F-RT (index of the called F-RT 420).

By the connection control of the connection controller 530 according to the F-RT 420, the connection relationship between the respective functional units provided in the tool box 510 may be different.

Hereinafter, the commands constituting each table will be described in detail.

FIG. 28 illustrates the commands used in each table for syntax parsing. Each of the illustrated instructions can be used to construct information (ie, tables) for parsing standard syntax such as MPEG-2 / MPEG-4 / MPEG-4 AVC. Hereinafter, an example of tables for parsing MPEG-2 MP (Main Profile) intra coded syntax and an interworking relationship between the tables will be described.

As illustrated in FIG. 28, instructions for configuring each table include READ, SEEK, FLUSH, IF, WHILE, UNTIL, DO ~ WHILE, DO ~ UNTIL, BREAK, SET, STOP, PUSH, and the like. Of course, not all commands need to be used in each table, and it is obvious that any command may be selectively used for each table. Hereinafter, the purpose of each command will be briefly described.

First, READ is a command for reading a certain bit from the bitstream. For example, it may be expressed as "READ bits B> CSCI;". Here, "bits" represents the number of bits to be read, "B" represents a Byte-alignment flag, and "> CSCI" represents a CSCI index to be stored. "B" and "> CSCI" are used as options. If "> CSCI" is not specified, it is set to store only in the variable IBS.

Next, SEEK reads a bit from the bitstream but does not move the file pointer. The file pointer means a reference position during an operation such as reading a predetermined bit. The parameters of the SEEK command can be applied in the same way as the READ described above.

Next, FLUSH is a command for moving a file point by a certain number of bits in the bitstream. Parameters can be applied similarly to READ.

Next, IF may be used in the form of "IF (condition) {~} ELSE {~}", and is an instruction that provides a branch according to a given condition.

Next, WHILE can be used in the form of "WHILE (condition) {~}", and is a command to repeatedly execute a designated block while a given condition is true.

Next, UNTIL can be used in the form of "UNTIL (condition) {~}", which is a command to repeatedly execute a designated block until a given condition becomes true.

Next, DO ~ WHILE can be used in the form of "DO {~} WHILE (condition)", and it is a command to transform a WHILE statement to execute a block before determining a condition.

Next, DO ~ UNTIL can be used in the form of "DO {~} UNTIL (condition)", which is a command to transform a UNTIL statement to execute a block before determining a condition.

Next, the command (~) (compute) is used in the form of "(C11 = (V2 + 3));". In other words, all calculations of SET-PROC can be written in parentheses. Operators such as arithmetic, assignment, comparison, addition / subtraction (++ /-), bitwise operation, logical sum / logical product, and check whether CSCI is used or not Can be used.

Next, BREAK is a command to break out of the nearest loop structure.

Next, SET is a command for setting whether to use flags for designated CSCIs, and CSCIs for designating flags are listed and separated by commas (eg, SET C0, C2;).

Next, STOP is a command for stopping the processing of the currently executing syntax element and moving on to the next.

Next, PUSH is an instruction to add a given data from the last point in which data was recorded in the array CSCI, and the added values are listed (for example, PUSH C8 8, 16, 32;) by comma. Are distinguished.

Next, GO tells you to branch to the specified location. For example, GO R # ;; is a command to branch to R #, and GO RT is a command to return to where it was called.

Next, HEX is a command that indicates that the value following the HEX command is hexadecimal.

Next, RLD is an interface for an RLD function supported in MPEG-4, and may be used in the form of "RLD index, level, run, islastrun, t #;". Here, index, level, run, and islastrun represent CSCI or internal variables storing the RLD return value, and t # represents the Huffman Table ID used for the RLD.

Next, VLD2 is a VLD function for MPEG-2, and may be used in the form of "VLD2 [t #] in> v1, v2, v3;". Here, t # is a Huffman Table ID used for the VLD, in represents an index value to be input, and v1 to v3 represent an output result value.

Finally, VLD4 is a VLD function for MPEG-4, and may be used in the form of "VLD4 [T #]> CSCI;". Here, t # represents a Huffman Table ID used for the VLD, and "> CSCI " represents a CSCI index to be stored. "> CSCI" is an option. If not specified, it is stored only in the variable IBS.

Details of each table configured by the above-described instructions (that is, each table for syntax processing for MPEG-2 MP Intra coding) are illustrated in FIGS. 29 to 53. Specifically, SET 450 is shown in FIGS. 29 to 35, S-RT 460 is shown in FIGS. 36 to 40, CSCIT 440 is shown in FIGS. 41 to 44, FL 410 is shown in FIG. 45, The F-RT 420 is illustrated in FIG. 46, the FU-CSCIT 430 is illustrated in FIG. 47, and the DVT 470 is illustrated in FIGS. 48 through 53, respectively.

Since the interworking relationship between the tables has been described in detail above, the description will be briefly described in general here.

Interworking between tables for syntax parsing first proceeds in index order of the F-RT 420 (see FIG. 46). In other words, it starts from the index R0 of the F-RT 420.

The F-RT 420 recognizes the index number F # of the FU corresponding to the index number R # to be currently processed. For example, if the index number to be processed is R0, F0 (i.e., Syntax Parser of FL 410) will be recognized, and if the index number to be processed is R9, F1 (i.e. DCR of FL 410) will be recognized. Will be.

First, the case where the corresponding FU is a Syntax Parser (that is, index number F0 of FL 410) by the recognized index number will be described.

Recognize R # using "F # (R #)" information recorded in the "FU" field of the F-RT 420, and recognize the index S # corresponding to the index number R # in the S-RT 460. do. For example, "F0 (R0)" is recorded in the "FU" field of the index R0 of the F-RT 420, and R0 corresponds to S0 of the Syntax field of the S-RT 460.

Subsequently, the SET 450 recognizes "Process by SET-PROC" corresponding to the recognized S #. For example, "Process by SET-PROC" of the SET corresponding to S0 in the Syntax field of the S-RT 460 is "READ 32 B; IF (IBS == HEX: 000001B3) C72 = 1; IF (IBS = = HEX: 000001B8) C72 = 2; IF (IBS == HEX: 00000100) C72 = 3; IF (IBS == HEX: 000001B7) C72 = 4;

The operation result of "Process by SET-PROC" of SET 450 is stored to correspond to the C # of the "Output" field of the corresponding index (S #). For example, "Process by SET-PROC" of the SET corresponding to S0 of the Syntax field of the S-RT 460 is stored as C72.

When the storage of the calculation result is completed, the S-RT 460 determines whether the stored CSCI information satisfies the branching condition. If the index R0 of the S-RT 460, the CSCI information C72 is the branching condition "1: (C72 == 1) GO R1; 2: (C72 == 2) GO R39; 3: (C72 == 3 ) GO R47; 4: (C72 == 4) GO RT; " It is determined which one is satisfied. If any one of 1 to 3 of the above 4 conditions is satisfied, the above process is repeated by going to the corresponding index R # in the S-RT 460, but the 4th condition (that is, (C72 == 4). GO RT) is returned to the F-RT 420.

Next, the case where the corresponding FU is not Syntax Parser (i.e., index number F0 of FL 410) by the recognized index number will be described.

By using the " F # " information recorded in the " FU " field of the F-RT 420 and the FL 410, the number of input CSCIs corresponding to the corresponding F # is recognized. For example, "F1" is recorded in the "FU" field of the index R9 of the F-RT 420, and it is recorded in the FL 410 that F1 is a DCR and requires four input CSCIs.

If the number of input CSCIs required by referring to the FL 410 is not zero, the CSCI storage unit 520 recognizes a CSCI value (C #) corresponding to the "F # (C #)" fields by referring to the FU-CSCIT 440. ) Reads the corresponding value.

Subsequently, the FU generates output data using the input data (eg, MB data) and input CSCI values, and then returns to the F-RT 420.

As described above, when the corresponding FU satisfies "GO RT" when it is a Syntax Parser (that is, index number F0 of the FL 410), when the corresponding FU is not Syntax Parser, a predetermined operation is completed. After that, the process returns to the F-RT 420.

The F-RT 420 determines the branch condition according to the C # value of the current step and proceeds to the corresponding step. If the satisfied condition is END (e.g. (C72 == 4) GO END;), then Syntax parsing ends, and if the satisfied condition indicates R # (e.g. GO R1) Proceed to index.

8 is a diagram illustrating a configuration of an extended bitstream according to the first embodiment of the present invention, FIG. 9 is a diagram illustrating a configuration of an extended bitstream according to the second embodiment of the present invention, and FIG. FIG. 11 is a diagram illustrating a configuration of an extended bitstream according to a third embodiment, and FIG. 11 is a diagram illustrating a configuration of an extended bitstream according to a fourth embodiment of the present invention.

As illustrated in FIGS. 8 to 10, the decoding description included in the extended bitstream 305 according to the present invention is configured not to include table information but to include only applied standard information (No table), or to include all table information. It may be configured to include (Full tables) or may be configured to include only some table information (Partial tables). To distinguish each of them, the decoding description information may include stream identifier information (SI), and the SI information may be divided as shown in Table 2 below.

Table 2. Stream Identifier

SI Decoding Description 00 No table 01 Full tables 10 Partial tables

As shown in FIG. 8, the extended bitstream 305 is a decoding description, and includes an SI 910 (that is, 00), a codec number (Codec #, 920) and a profile and level number (indicative of not including table information). Profile and level #, 930).

This is a case of using the table information already stored in the table storage unit 330 without sending the table information. Although only the basic information on which codec, profile and level is used by the conventional bitstream 105, the codec unit 340 can decode using the indicated tables.

For this purpose, SET 450, CSCIT 440, FL 410, FU-CSCIT 430, DVT 470, and the like are described for each application standard (i.e., codec), F-RT 420, S The RT 460 may be described for each profile of the applicable standard (see Tables 3 and 4).

Table 3. Table Breakdown by Codec

Standard Table separator MPEG-1 SET # 1 FL # 1 FU-CSCIT # 1 CSCIT # 1 DVT # 1 MPEG-2 SET # 2 FL # 2 FU-CSCIT # 2 CSCIT # 2 DVT # 2 MPEG-4 SET # 3 FL # 3 FU-CSCIT # 3 CSCIT # 3 DVT # 3 AVC SET # 4 FL # 4 FU-CSCIT # 4 CSCIT # 4 DVT # 4

Table 4. Table Classification by Profile and Level

SI Table separator MPEG-1 F-RT # 1-1 S-RT # 1-1 MPEG-2 MP F-RT # 2-1 S-RT # 2-1 MPEG-4 SP F-RT # 3-1 S-RT # 3-1 MPEG-4 ASP F-RT # 3-2 S-RT # 3-2 AVC BP F-RT # 4-1 S-RT # 4-1

For MPEG-4 SP, the decoding method is explained using SET # 3, FL # 3, CSCIT # 3, FU-CSCIT # 3, DVT # 3, F-RT # 3-1, and S-RT # 3-1. If the codec number is 3 and the profile and level number are 2 and transmitted, the codec unit 340 may perform a decoding operation with reference to the tables.

In addition, as illustrated in FIG. 9, the extended bitstream 305 may include all table information described above as a decoding description. In this case, the SI 910 will be set to 01 when referring to Table 2. Each table includes a table identifier (TI) 1010, a table start code (TS Code) 1020, a table description (TD) 1030, and a table end code (TE Code, Table). End Code) 1040 may be included. The order of the table identifier 1010 and the table start code 1020 may be changed, and the table description 1030 may be described in the form of a binary description. Of course, the order of each table can be changed.

In addition, as shown in FIG. 10, the extended bitstream 305 may include a decoding description and may include some table information and a codec number corresponding to some table information. In this case, the SI 910 will be set to 10 when referring to Table 2. However, in this case, since the format of the table information is not uniform, it may be preferable to further include a configuration identifier 1110 at the rear of the table identifier 1010 so as to determine what format the table information is configured.

In addition, as illustrated in FIG. 11, the extended bitstream may further include decoding description (T-DD) 1210 and update information about table information. The decoding description 1210 for the table information may be any one of the decoding descriptions described above with reference to FIGS. 8 to 10, and the SI 910 may be set to a corresponding value. The update information may include an update start code (RS code, Revision Start code) 1220 and an update content (Revision 1230).

The update content 1230 may be content such as adding, deleting, or updating rule information of an arbitrary table. Its form is 'insert index into table-name (…);', 'delete index from table-name;', 'update index in table-name (…);' And the like.

For example, if you want to add S100 to SET # 4, the update content 1230 is 'insert S100 into SET # 4 ("READ 1; IF (IBS == 1) {SET C31;}");' It can be configured together. In addition, in the case of deleting R31 in S-RT # 3-1, the update contents 1230 may be configured as 'delete R31 from S-RT # 3-1;'. In addition, in the case where it is desired to modify R7 in F-RT # 2-1, the update contents 1230 are 'update R7 in F-RT # 2-1 (F6, 1: (C66 <= 6) GO R5; 2: (C65 <= C67) GO R4; 3: GO R12;); '.

The description decoder 320 reads the update contents 1230 as described above, so that the table of the changed contents is stored in the table storage unit 330 while the decoding of the corresponding extended bitstream 305 is performed. However, when decryption is completed, the tables stored in the table storage unit 330 will be restored to their original state. Whether the decoding is completed may be recognized by the codec unit 340 or the trigger by providing the completion notification to the description decoder 320 or by the description decoder 320 monitoring whether the codec unit 340 is completed.

As described above, according to the present invention, an existing profile may be used by using functional units provided by a conventional standard (ie, a codec), or a new decoder may be configured by using existing functional units. In addition, new decoders can be used to implement new decoders. That is, various and unlimited decoder implementations are possible.

However, when adding a new functional unit (Functional Unit) to the tool box 510, it is necessary to add the algorithm for the functional unit (that is, description of the functional unit) and add the corresponding information to the FL 410. . In this case, a compile process for the algorithm may be additionally required.

In order to implement the integrated codec, each component must be organically controlled to parse a bitstream compressed by various coding methods and decode the bitstream by a decoding method corresponding to the corresponding coding method.

In this case, the corresponding bitstream may be a bitstream composed of various shapes in which various standards (codecs) are mixed or various types of bitstreams generated by various coding schemes within one standard. In addition, in order to support various encoding / decoding methods, various functions used in various standards are divided into separate units, and only one function and a function required by the user are selected to select one codec (encoder and decoder). You should be able to make it.

As described above, the present invention has an advantage that the functional description can be organically connected and controlled by the same information interpretation method regardless of the encoding scheme in which the bitstream is encoded by providing the decoding description together.

In addition, another advantage of the present invention is that even if the syntax of the bitstream is changed or newly added, the S-RT 460 may enable active response by only modifying the corresponding information or inserting additional information. . In addition, the F-RT 420 is configured by selecting a function desired by the user in units of processing such as a bit stream level, a frame level, a macro block level, and an MB-level to decode the corresponding decoding. There is also an advantage that can establish the connection relationship between the MB processing unit 550 functional units.

12A is a diagram showing the configuration of an extended bitstream according to the fifth embodiment of the present invention, FIG. 12B is a diagram showing the configuration of an extended bitstream according to the sixth embodiment of the present invention, and FIG. 12 is a diagram illustrating a configuration of an extended bitstream according to a seventh embodiment, and FIG. 12D is a diagram illustrating a configuration of an extended bitstream according to an eighth embodiment of the present invention.

The extended bitstream 305 according to the present invention is composed of a decoding description region (DD) and a conventional bitstream 105. It will be apparent to those skilled in the art that the conventional bitstream 105 consists of coded video data (or / and coded audio data).

Here, the decoding description region may be formed in a different structure according to the codec characteristic to be applied to decode the conventional bitstream 105. That is, first, when using one codec standardized in the prior art, the first decoding description structure may be applied.

Second, when modifying and using some of the contents of one standardized codec (that is, some of the above seven tables use the table contents corresponding to the corresponding codec and modify some other tables). The second decoding description structure can be applied.

Third, processing and using table information of a plurality of standardized codecs (that is, some of the seven tables described above selectively use the contents of a table of the conventional plurality of codecs and modify some other tables). In this case, a third decoding description structure may be applied.

Fourth, the fourth decoding description structure may be applied when using a new codec that is not conventionally standardized (i.e., including all seven tables described above with new contents).

The four decoding description structures described above may be divided as different codec type information. For example, "codec_type = 0" for the first decoding description structure, "codec_type = 1" for the second decoding description structure, and "codec_type = 2" for the third decoding description structure. In case of the fourth decoding description structure, it may be set to "codec_type = 3".

A first decoding description structure is illustrated in FIG. 12A.

According to the first decoding description structure illustrated in FIG. 12A, the decoding description area may include a codec type (codec_type) 1250, a codec number (codec_num) 1252, and a profile and level number (profile_level_num) 1254. have. That is, according to the first decoding description structure, only the information about the codec to be applied is described in the decoding description area. Although each field is illustrated as 8 bits in the figure, it is obvious that the size of each field may be added or subtracted according to the size of information to be represented.

The codec type 1250 will be set to zero (ie, codec_type = 0), which means that the codec type 1250 uses one of various codecs standardized in the prior art.

A second decoding description structure is illustrated in FIG. 12B.

According to the second decoding description structure illustrated in FIG. 12B, the decoding description area includes a codec type (codec_type) 1250, a codec number (codec_num) 1252, a profile and level number (profile_level_num) 1254, and a table description ( 1256). That is, according to the second decoding description structure, the decoding description area is described based on information about a codec to be applied and contents to be modified among seven tables. Here, the table description is provided separately for each of the seven tables. That is, there may be seven table descriptions in the decoding description area.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1263, and a table end code (Table_end_code) as illustrated. 1264 may be included. Of course, the size of each field can be increased or decreased as needed. In addition, as described below, the content 1263 may be omitted or included according to the information of the table type 1262.

For example, if the value of the table type 1262 is 0, an existing table (that is, a codec type (codec_type) 1250, a codec number (codec_num) 1252), a profile and level number (profile_level_num) 1254, and a table identifier (Recognized by 1260) can be recognized to be applied without modification. In this case, the content 1263 can be omitted.

However, if the value of the table type 1262 is 1, an existing table (ie, codec type (codec_type) 1250, codec number (codec_num) 1252), profile and level number (profile_level_num) 1254, and table identifier 1260 Table), which is recognized by), may be recognized for use with some modification (i.e., with content defined in content 1263). In this case, the modified content (for example, an update command, etc.) may be described in the content 1263. For example, modifications (such as update commands) may include commands such as update, insert, and / or delete to modify the table contents of the corresponding index of that table. It may be information to be made.

However, if the value of the table type 1262 is 2, an existing table (ie, codec type (codec_type) 1250, codec number (codec_num) 1252), profile and level number (profile_level_num) 1254, and table identifier 1260 Table) is recognized to be used in its entirety (i.e., with the content defined in content 1263). In this case, the changed contents 1263 may describe the changed contents (for example, contents for newly defining a corresponding table such as a new command).

A third decoding description structure is illustrated in FIG. 12C.

According to the third decoding description structure illustrated in FIG. 12C, the decoding description area may be composed of a codec type 1250 and a table description 1256. That is, according to the third decoding description structure, the decoding description area is described based on information about a codec to be applied and contents to be modified among seven tables. Here, the table description is provided separately for each of the seven tables. That is, there may be seven table descriptions in the decoding description area.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1263, and a table end code (Table_end_code) as illustrated. 1264 may be included. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 1262 is 0, an existing table (that is, a table recognized by the codec number (codec_num) 1252, the profile and level number (profile_level_num) 1254 and the table identifier 1260) It can be recognized to apply without modification of. That is, the codec number (codec_num) 1252, profile and level number (profile_level_num) 1254 corresponding to the table to be applied in the content 1262 field are described.

However, if the value of the table type 1262 is 1, the existing table (that is, the table recognized by the codec number (codec_num) 1252, the profile and level number (profile_level_num) 1254 and the table identifier 1260) is partially selected. It may be recognized for use as a modification (ie, modification as defined in modification 1266). In this case, the codec number (codec_num) 1252, profile and level number (profile_level_num) 1254 corresponding to the table to be applied in the content 1262 field are described, and the modified content 1266 field is a modified content (e.g., For example, an update command) may be described.

However, if the value of the table type 1262 is 2, it is recognized that the existing table (that is, the table recognized by the table identifier 1260) is completely changed (that is, changed to the content defined in the Content 1262 field) to be used. Can be. In this case, the changed contents (1263) field may describe the changed contents (for example, contents for newly defining the table such as a new command). That is, when the table type 1262 is 0 or 1 as described above, since a specific codec is used as it is or some tables are modified and used, information about the codec (that is, codec number (codec_num) 1252, profile, and level) is used. Number (profile_level_num) 1254) is required, but if the table type 1262 is 2, completely new table information is defined, so no separate codec information is needed.

A fourth decoding description structure is illustrated in FIG. 12D.

According to the fourth decoding description structure illustrated in FIG. 12D, the decoding description area may be composed of a codec type (codec_type) 1250 and a table description 1256. That is, according to the fourth decoding description structure, the decoding description area is described with respect to seven tables, and the table description is provided for each of the seven tables separately.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1263, and a table end code (Table_end_code) as illustrated. 1264 may be included. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 1262 is a predetermined value (for example, 2), the content 1263 field contains information for describing a new table corresponding to the table identifier 1260 (for example, new). For defining a new table, such as a command). As described above, when the codec type 1250 is 3, it is recognized that decoding is performed by using new tables. Therefore, only one table type 1262 may be designated, or the table type 1262 may be omitted.

Hereinafter, the syntax structure of the decoding description area and the syntax structure of each field will be exemplified as respective tables.

Table 5. Decoding Description

Decoder_Description () { No. of bits codec_type 8 if ((codec_type == 0x00) || (codec_type == 0x01)) { Codec_Description () } if (codec_type! = 0x00) { do { Table_Description () } while (next_bits () == table_idetifier) } }

Table 6. Codec description

Codec_Description () { No. of bits codec_num 8 profile_level_num 8 }

Table 7. Table Description

Table_Description () { No. of bits table_start_code 24 table _ identifier 4 table_type 4 if ((table_type == '0000') || (table_type == '0001')) { if (codec_type == 0x02) Codec_Description () if (table_type == '0001') Update_Description () } if (table_type == '0010') { New_description () } table_end_code 24 }

Table 8. Update description

Update_Description () { No. of bits Mnemonic   Update_Command vlclbf }

Table 9. New description

New_Description () { No. of bits Mnemonic New_command vlclbf }

The semantics of the decoder description are described below as respective tables.

Table 10. Decoding description

codec_type Meaning 0x00 A profile @ level of an existing MPEG standard 0x01 Some parts of the existing one profile @ level changed 0x02 Some parts of the existing multiple profile @ level changed 0x03 A new decoding solution 0x04-0xFF RESERVED

Here, the codec type is an 8-bit code and may be information for identifying the type of the codec.

Table 11. Codec description

codec_num MPEG standards and others 01 MPEG-1 02 MPEG-2 03 MPEG-4 Part 2 04 MPEG-4 Part 10 (AVC) 05-FF RESERVED

Here, the codec number codec_num is an 8-bit code and may be information indicating a code of a used codec. In addition, the profile and level number (profile_level_num) is an 8-bit code and may be information for indicating the number of the profile and the level for the codec. The profile and level numbers may match the profile and level numbers of each MPEG standard.

Table 12. Table description (table identifier)

table_identifier table name 0000 SET (Syntax Element Table) 0001 Syntax Rule Table (S-RT) 0010 CSCIT (CSCI Table) 0011 DVT (Default Value Table) 0100 FL (FU List) 0101 F-RT (FU Rule Table) 0110 FU-CSCIT (FU CSCI Table) 0111-1111 RESERVED

Here, the table start code (table_start_code) may be a 26-bit string 0xFFFFFE in hexadecimal, which may mean the start of a table description. The table identifier (table_identifier) may be each 4-bit code as shown in Table 12 above.

Table 13. Table description (table type)

table_type Meaning 0000 conventional table 0001 updated table 0010 new table 0011-1111 RESERVED

Here, the table type is information for determining whether to maintain an existing table with a 4-bit value, update an existing table, or create a new table. The table end code (table_end_code) may be a 26-bit string 0xFFFFFF in hexadecimal, which may mean the end of the table description.

Table 14. Instruction set for update command (update_command)

Code Instruction Usage 00 UPDATE UPDATE [index #] in [table #] [a record]; 01 INSERT INSERT into [table #] [a record]; 10 DELETE DELETE [index #] from [table #]; 11 RESERVED

Here, index # may be a 4-bit string indicating an index number of an arbitrary table, and table # may be a 32-bit string as a table identifier.

Table 15. Instruction set for new command (new_command)

Code Instruction Usage 00000001 READ READ bits B> CSCI; 00000010 SEEK SEEK bits B> CSCI; 00000011 FLUSH FLUSH bits B; 00000100 IF IF (condition) {~} ELSE {~} 00000101 WHILE WHILE (condition) {~} 00000110 UNTIL UNTIL (condition) {~} 00000111 ~ 0 DO-WHILE DO {~} WHILE (condition) 00000111 ~ 1 DO ~ UNTIL DO {~} UNTIL (condition) 00001000 (~) (compute) (………) 00001001 BREAK BREAK; 00001010 SET SET CSCI, CSCI; 00001011 STOP STOP; 00001100 PUSH PUSH CSCI Value, Value; 00001101 RLD RLD index, level, run, islastrun, t #; 00010010 VLD2 VLD2 [T #] in> v1, v2, v3; 00010100 VLD4 VLD4 [T #]> CSCI;

Here, bits are any of 3 to 34 bits indicating the number of bits required, and B is a 1-bit string indicating byte alignment. ">" Is a 1-bit string for printing the output on the left, and VLD2 (for MPEG-2) and VLD4 (for MPEG-4) are functions for entropy coding.

13 is a block diagram of an encoder according to an embodiment of the present invention.

The encoder 1300 according to the present invention further includes an extension bitstream generation and output unit 1310 as compared to the conventional encoder 200 described with reference to FIG. 2. The extended bitstream generation and output unit 1310 may control information (eg, a list and connection relations of the used functional units and input of the corresponding functional units in the process of generating the conventional bitstream 105 generated by the process up to the front end). Data, syntax information, syntax connection information, etc.) to generate a decoding description. In addition, the extended bitstream 305 is generated using the generated decoding description and the conventional bitstream 105 and transmitted to the decoder 300. The method of generating the decoding description will be fully understood by those skilled in the art based on the above descriptions, and thus description thereof will be omitted.

In addition, in the present specification, the variable length encoder 230 refers to an arbitrary component (eg, an encoder) that performs encoding in order to generate the conventional bitstream 105 in the encoder 1300. The present invention is not limited thereto, and the scope of the present invention is not limited thereto.

FIG. 13 is a diagram illustrating a case in which an extended bitstream 305 generated using decoding description information and a conventional bitstream 105 is provided to a decoder.

However, as described above, the decoding description may be delivered to the decoder 300 in the form of separate data or bitstream. In this case, the extended bitstream generation and output unit 1310 is not positioned after the variable length encoding unit 235, and the extended bitstream generation and output unit 1310 is positioned independently of the conventional encoding unit 200. Obviously, the independently generated information may be provided to the decoder 300.

In the description of the integrated codec apparatus and method according to the present invention, the decoder has been described with reference to the decoder. However, the interrelationship between the decoder and the encoding period is apparent to those skilled in the art. Obviously, the invention is not limited to decoders.

As described above, the integrated codec device and method according to the present invention facilitate the interpretation of syntax elements and control of the connection of functional units within one standard (or codec) or between different standards (or codecs). That is, it is not a problem to change the order of syntax elements, insert new syntax elements, or delete existing syntax elements in a bitstream generated according to a specific standard.

In addition, according to the related art, when the syntax element is manipulated, the decoder cannot decode the corresponding bitstream normally. For example, if the bitstream information is ABC and the bitstream is changed to ACB to configure and transmit the bitstream, the decoder cannot recognize the bitstream and thus normal decoding is not possible. The same is also true when a new F is inserted into an ABFC or a B is deleted to form a bitstream with AC.

However, using the integrated codec apparatus and method according to the present invention, since the decoding description information is provided as data included in the extended bitstream or as independent data, the decoder 300 can perform a smooth decoding operation.

So far, the decoding apparatus and the syntax parsing method for decoding the bitstream according to the present invention have been described based on MPEG-4 AVC, but the MPEG-1, MPEG-2, MPEG-4 and other video encoding / decoding standards Naturally, the same can be applied without any limitation.

In addition, the information included in each table is not described only with information on connection relations between functional units for performing decoding by one standard, processing processes required for the corresponding functional unit, and the like. It is obvious that information may be described.

For example, assume that an initial plurality of frames of encoded video data included in the extended bitstream are encoded in MPEG-2, subsequent frames are encoded in MPEG-4, and the remaining frames are encoded in MPEG-1. lets do it. In this case, the table information included in the decoding description for decoding the encoded video data is used so that each frame having a different encoding method may be functionally combined with the functional units according to each standard included in the tool box 510. It is obvious that it will be implemented.

As described above, the integrated codec apparatus and method according to the present invention are encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.). The decoded bitstream can be decoded with the same information recognition scheme.

In addition, the present invention parses a bitstream compressed by various encoding schemes by the same information analysis method, and can organically control functional units (FU) for decoding using the parsed data. There is also an effect.

In addition, the present invention has the effect that can be commonly applied to the syntax analysis method for decoding various types of bitstream.

In addition, the present invention has the effect of applying a new set of instructions for parsing various types of bitstreams with a common syntax analysis method.

In addition, the present invention also has the effect that the decoder can easily decode the bitstream even when the syntax element is changed or added.

In addition, the present invention has an effect that allows the components used for bitstream decoding to share the element information (the result of parsing the syntax) of the parsed syntax.

In addition, the present invention also has the effect that the element information of the parsed syntax can be used for the interpretation of subsequent bitstream syntax elements.

In addition, the present invention also has an effect that can be used when integrating a moving picture or still picture codec that processes block units other than MPEG-1, MPEG-2, MPEG-4, and MPEG-4 AVC.

In addition, the present invention has an effect that can be stored in a toolbox by dividing the functions constituting various decoding methods proposed by various standards (codecs) into functional units (FU).

In addition, the present invention has the effect that it is possible to selectively decode only the functional units required in the toolbox to decode the bitstream encoded in various forms.

In addition, the present invention has an effect that it is easy to change, add, or delete a function unit stored in a toolbox.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

Claims (72)

A table storage unit; A description decoder for generating n (random natural numbers) tables corresponding to the input decoding description and storing the tables in the table storage unit; And a codec unit configured to decode encoded video data included in a bitstream input to correspond to the decoding description into video data using the table stored in the table storage unit. The method of claim 1, The codec unit, A tool box including a plurality of functional units each implemented to process a predetermined process; A Control Signal / Context Information (CSCI) storage unit for storing a plurality of element information generated by syntax parsing of the bitstream by at least one of the plurality of functional units; And And a connection controller for recognizing a processing order of the plurality of functional units and controlling the corresponding functional units to be activated by referring to one or more predetermined tables. The method of claim 2, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. The method of claim 3, When the encoded video data is encoded by a plurality of standards, the connection controller sequentially activates a plurality of functional units performing a process according to a plurality of standards by referring to the table so that the encoded video data is the video data. Decoding apparatus characterized in that the decoding to. The method of claim 2, The tool box, A parsing function unit which generates a plurality of element information by syntax parsing of the bitstream and stores the plurality of element information in the CSCI storage unit, and generates and sequentially outputs the encoded video data as macroblock data having a predetermined size; And And a plurality of processing functional units each having a process to be processed for converting the macroblock data into the moving image data. The method of claim 5, The n tables include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts, FU-CSCIT indicating element information to be input to the selected functional unit. The method of claim 6, The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) read a k (arbitrary natural number) bit by moving a file pointer. Instructions, a seek command that reads k bits without moving the file pointer, a flush command that moves file points by k bits from the file pointer, a GO instruction that indicates a branch between indexes, and element information. And at least one of a set (SET) instruction for setting a flag. The method of claim 6, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 6, And the connection controller specifies an order in which the plurality of selected functional units of the parsing function unit and the plurality of processing function units are activated using the F-RT. The method of claim 9, And a processing function unit activated by the connection control unit performs a predetermined process by using predetermined element information and output data by a previous function unit. The method of claim 6, And the parsing function unit generates the element information using the SET, the S-RT, and the CSCIT. The method of claim 1, And a separation unit for separating the decoding description and the bitstream when the decoding description and the extension bitstream in which the bitstream are integrated are input. The method according to claim 1 or 12, wherein The decoding description is composed of one or more table areas, and each table area is inserted one or more table information for configuring the table. The method of claim 13, The table information includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, And the description decoder extracts n tables corresponding to the specified information among a plurality of tables previously stored in the table storage unit. The method of claim 13, Table information respectively inserted into the n table areas includes binary code information for constituting each table, And the description decoder generates n tables using the binary code information and stores the n tables in the table storage unit. The method of claim 13, M (arbitrary natural numbers) of the n table areas include designation information corresponding to a codec number (Codec No.) and a profile and level number (Profile and level No.) for the corresponding table, k (any number of nm) table areas contain binary code information for constructing corresponding tables, The description decoder extracts m tables corresponding to the designated information among a plurality of tables previously stored in the table storage unit, generates k tables using the binary code information, and stores the k tables in the table storage unit. Decoding apparatus characterized by. A table storage unit for storing a plurality of tables; Stores a plurality of element information generated by syntax parsing of an input bitstream using one or more tables stored in the table storage unit, and stores the element information in an element information storage unit, and encodes the encoded video included in the bitstream. A syntax parser for sequentially outputting macroblock data corresponding to the data; An MB processing unit including a plurality of functional units each configured to process a preset process; And And a connection controller for controlling a plurality of functional units to be selectively activated by referring to one or more tables stored in the table storage unit. And any functional unit activated by the connection control unit processes and outputs the macroblock data using predetermined element information among element information stored in the element information storage unit. The method of claim 17, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. The method of claim 17, And the connection controller controls an operation of the syntax parser with reference to a predetermined table. The method of claim 17, And a description decoder configured to generate n (random natural numbers) tables corresponding to the decoding description and store them in the table storage unit when the decoding description corresponding to the bitstream is further input. The method of claim 20, And a splitter configured to separate the decoding description and the bitstream and input them to the syntax parser and the description decoder, respectively, when the decoding description and the extension bitstream in which the bitstream are integrated are input. The method of claim 20, And the description information is input in the form of independent data or bitstream. The method of claim 17, And the connection controller controls the result data of a previously activated functional unit to be input to a later activated functional unit. The method of claim 17, And the resultant data is written to a buffer memory accessible by the function to be activated later. The method of claim 24, And the macroblock data sequentially output by the syntax parser is written to the buffer memory. The method of claim 20, And the description information comprises a binary code. The method of claim 26, The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing the list of the functional units, the syntax parser or the sequential selection of the functional units And a FU-CSCIT indicating element information to be input to the selected functional unit. The method of claim 27, The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) read a k (arbitrary natural number) bit by moving a file pointer. Command, a SEEK instruction that reads k bits without moving the file pointer, a FLUSH instruction that moves the file pointer by k bits from the file pointer, a GO instruction that indicates a branch between indexes, and element information And at least one of a set (SET) instruction for setting a flag. The method of claim 27, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 27, The syntax parser selects a bitstream syntax to be processed using the S-RT, generates the element information using the process recorded in the SET, and sets the element information to correspond to the CSCIT. A decoding apparatus, characterized in that stored in the information storage. The method of claim 30, The connection controller selects the syntax parser or any one functional unit using the F-RT, recognizes the syntax parser or the characteristics of the functional unit using the FL, and uses the FU-CSCIT and the CSCIT. And the element information to be input to the selected function unit is extracted from the element information storage unit and input to the selected function unit. An encoding unit which converts an input video into a bitstream according to a predetermined encoding scheme using a plurality of functional units in sequence; And A description information generator configured to generate description information according to a connection relationship between the syntax information of the bitstream and the functional units; And the bitstream and the description information are provided to a decoding device. 33. The method of claim 32, And the bitstream and the description information are generated as one extension bitstream and provided to the decoding device. 33. The method of claim 32, And the description information is provided to the decoding apparatus in the form of independent data or bitstream. The method of any one of claims 32 to 34, wherein The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing a functional unit list of the decoding apparatus corresponding to the functional units, And a FU-CSCIT indicating element information to be input to the selected functional unit. 36. The method of claim 35 wherein And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. (a) receiving a bitstream and description information; (b) generating and storing a plurality of tables corresponding to the description information; (c) storing a plurality of element information generated by syntax parsing of the bitstream using at least one table in an element information storage unit; (d) converting the encoded video data of the bitstream into macroblocks having a predetermined size and sequentially outputting the macroblocks; (e) activating any functional unit with reference to one or more table information; And (f) performing the predetermined process by using the element information stored in the element information storage unit by the activated functional unit to output the result data, And said step (e) and said step (f) are repeated until said result data becomes moving picture data corresponding to said encoded video data. The method of claim 37, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. The method of claim 37, During the repeated execution of step (e) and step (f), if the element information required for the functional unit to be selected by step (e) is not stored in the element information storage unit, the step (b) And repeating the steps (e) and (f) after the execution. The method of claim 37, And the result data of the previously activated functional section is written to a buffer memory accessible by the later activated functional section. The method of claim 40, In the step (b), the sequential output macroblock is written to the buffer memory. The method of claim 37, The description information may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing the list of functional units, F-RT (for sequential selection of the functional units) FU-Rule Table), and a FU-CSCIT indicating element information to be input to the selected functional unit. The method of claim 42, wherein And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. The method of claim 43, In step (c), the SET, the S-RT, the CSCIT and the DVT are used. The method of claim 42, wherein And a functional unit for performing the step (c), the step (d) and the step (f) is determined by the F-RT. The method of claim 42, wherein Step (c) is, (g) selecting a bitstream syntax to be processed using the S-RT; (h) generating the element information using the process recorded in the SET; And (i) storing the generated element information in the element information storage to correspond to the CSCIT, The steps (g) to (i) are repeated until element information corresponding to all bitstream syntaxes is generated and stored. The method of claim 37, When the bitstream and the description information are input into one extension bitstream, the step (b) may include: And dividing the bitstream and the description information in the extended bitstream. The method of claim 37, And the description information is input in the form of independent data or bitstream. 49. The method of claim 47 or 48, And the description information comprises a binary code. (a) converting the input video into a bitstream according to a predetermined encoding scheme by sequentially using a plurality of functional units; (b) generating description information according to a connection relationship between the syntax information of the bitstream and the functional units; And (c) transmitting the bitstream and the description information to a decoding apparatus. 51. The method of claim 50, Step (c) is, Generating one extended bitstream including the bitstream and the description information; And And transmitting the extended bitstream to the decoding apparatus. In a recording medium in which a program of instructions that can be executed in a decoding apparatus is tangibly implemented to perform a decoding method, and in which a program that can be read by the decoding apparatus is recorded. (a) generating and storing a plurality of tables corresponding to the input description information; (b) storing a plurality of element information generated by syntax parsing of an input bitstream using the stored one or more tables; (c) converting the encoded video data of the bitstream into macroblocks having a predetermined size and sequentially outputting the macroblocks; And (d) executing a step of calling one processing function by referring to the stored one or more table information among a plurality of processing functions each having a process to be processed to convert the macroblock data into the video data, The called processing function unit outputs a result data of performing a specified process using predetermined element information among the plurality of stored element information, And said step (d) is repeated until said result data becomes moving picture data corresponding to said encoded video data. The method of claim 52, wherein During the repetition of the step (d), if the element information required for the functional unit to be selected by the step (d) is not stored in the element information storage unit, the step (d) after the redo of the step (b) Recording medium recording a program, characterized in that to repeat the repeated execution of). The method of claim 52, wherein And a predetermined process of each of said processing functions is implemented to independently perform each of the functions proposed by a plurality of standards for decoding said bitstream. A table storage unit for storing one or more table information; Generate n (any number less than 0 or m) table information corresponding to the decoding description received from the encoder and store it in the table storage, or store k (any number being mn) table information in the table storage. A description decoder selected from the portion; Generating and outputting moving image data corresponding to encoded video data included in a bitstream received from the encoder using m (any natural number equal to or greater than n) table information generated or selected by the description decoder. Decoding device comprising a codec unit. The method of claim 55, The m table information is selected by the table storage unit when the decoding description includes designation information corresponding to a codec number (Codec No.), a profile and a level number (Codec No.) in which the bitstream is encoded. Decoding apparatus, characterized in that. The method of claim 55, And the decoding description is composed of m table areas, and table information for configuring the table is inserted in each table area. The method of claim 57, And when the generation information is included in a table area corresponding to arbitrary table information, the description decoder newly generates a corresponding table using the generation information. The method of claim 57, And when the modification information is included in a table area corresponding to arbitrary table information, the description decoder modifies the corresponding table by using the modification information. The method of claim 59, When a table area corresponding to any table information or a codec number (Codec No.), a profile and a level number (Profile and level No.) are further included before the table area, the description decoder is further configured to correspond to the codec. And decoding table information by the correction information. The method of claim 55, The codec unit, A tool box including a plurality of functional units each implemented to process a predetermined process; A Control Signal / Context Information (CSCI) storage unit for storing a plurality of element information generated by syntax parsing of the bitstream by at least one of the plurality of functional units; And And a connection controller for recognizing a processing order of the plurality of functional units and controlling the corresponding functional units to be activated by referring to one or more predetermined tables. 62. The method of claim 61, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. The method of claim 62, When the encoded video data is encoded by a plurality of standards, the connection controller sequentially activates a plurality of functional units performing a process according to a plurality of standards by referring to the table so that the encoded video data is the video data. Decoding apparatus characterized in that the decoding to. 62. The method of claim 61, The tool box, A parsing function unit which generates a plurality of element information by syntax parsing of the bitstream and stores the plurality of element information in the CSCI storage unit, and generates and sequentially outputs the encoded video data as macroblock data having a predetermined size; And And a plurality of processing functional units each having a process to be processed for converting the macroblock data into the moving image data. 65. The method of claim 64, The m tables may include a Syntax Element Table (SET) indicating a process for generating information on bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts, FU-CSCIT indicating element information to be input to the selected functional unit. 66. The method of claim 65, The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) move a file pointer to read s (arbitrary natural numbers) bits. Command, a SEEK instruction that reads the s bits without moving the file pointer, a FLUSH instruction that moves the file pointer by s bits in the file pointer, a GO instruction that indicates a branch between indexes, and element information And at least one of a set (SET) instruction for setting a flag. 66. The method of claim 65, And a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. 66. The method of claim 65, And the connection controller specifies an order in which the plurality of selected functional units of the parsing function unit and the plurality of processing function units are activated using the F-RT. The method of claim 68, And a processing function unit activated by the connection control unit performs a predetermined process by using predetermined element information and output data by a previous function unit. 66. The method of claim 65, And the parsing function unit generates the element information using the SET, the S-RT, and the CSCIT. The method of claim 55, And a separating unit for separating the decoding description and the bitstream when the decoding description and the extended bitstream in which the bitstream are integrated are received from the encoder. delete

Images