KR101305517B1 - Bitstream decoding device and method having decoding solution - Google Patents

Abstract

Disclosed is a bitstream decoding apparatus and method having a decoding solution. The decoding apparatus includes: a decoder forming unit generating and outputting CSCI control information and connection control information using partial decoder descriptions stored in the description storage unit; A tool box including a plurality of functional units, each implemented to perform a preset process; And a decoding solution that selectively loads a plurality of functional units included in the toolbox by using the CSCI control information and the connection control information to decode the bitstream into video data. According to the present invention, a bitstream encoded in various formats according to each standard (eg, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) can be decoded using the same information recognition scheme.

Video compression, integrated codec, VCTR, MPEG, AVC, Toolbox, Functional Unit, Connection,

Description

Bitstream decoding device and method having decoding solution

1 is a diagram schematically showing a configuration of a general decoder.

2 is a diagram schematically illustrating a configuration of a general encoder.

3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention.

4 is a diagram schematically illustrating a configuration of an extended bit-stream according to an embodiment of the present invention.

5 is a diagram schematically showing a configuration of a decoding processing unit according to an embodiment of the present invention.

6 is a diagram schematically showing a configuration of a decoding processing unit according to another embodiment of the present invention.

7 illustrates an example of functional units for syntax parsing according to an embodiment of the present invention.

8 illustrates an example of functional units for decoding processing according to an embodiment of the present invention.

9 illustrates a configuration of an extended bitstream according to the first embodiment of the present invention.

10 illustrates a configuration of an extended bitstream according to the second embodiment of the present invention.

11 illustrates a configuration of an extended bitstream according to the third embodiment of the present invention.

12 is a diagram showing the configuration of an extended bitstream according to the fourth embodiment of the present invention.

13 is a diagram showing the configuration of an extended bitstream according to the fifth embodiment of the present invention.

14 is a diagram showing the configuration of an extended bitstream according to the sixth embodiment of the present invention;

15 is a diagram showing the configuration of an extended bitstream according to the seventh embodiment of the present invention;

16 is a diagram showing the configuration of an extended bitstream according to an eighth embodiment of the present invention;

17 is a block diagram of an encoder according to an embodiment of the present invention.

18 to 57 show examples of configurations of respective partial decoder descriptions.

The present invention relates to a bitstream decoding method and apparatus, and more particularly, to a bitstream decoding method and apparatus having a decoding solution.

In general, a video is converted into a bitstream form by an encoder. In this case, the bitstream is stored according to an encoding type satisfying the constraint of the encoder.

MPEG requires syntax (hereinafter referred to as 'syntax') and semantics (hereinafter referred to as 'semantics') as constraints of the bitstream.

syntax indicates the structure, format, and length of the data, and in what order the data is represented. That is, syntax is to fit a grammar for encoding / decoding, and defines the order of each element included in the bitstream, the length of each element, and the data format.

Semantics means what each bit of data means. That is, the semantics indicate what the meaning of each element in the bitstream is.

Therefore, various types of bitstreams may be generated according to encoding conditions of an encoder or an applied standard (or codec). In general, each standard (eg MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) has a different bitstream syntax.

Accordingly, bitstreams encoded according to each standard or encoding condition may have different formats (ie, syntax and semantics), and a decoder corresponding to an encoder should be used to decode the corresponding bitstream.

As described above, the conventional bitstream decoder has a limitation of satisfying the constraints of the encoder, and this limitation causes a difficulty in implementing an integrated decoder corresponding to a plurality of standards.

Accordingly, the present invention is to solve the above-described problem, and is encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.) An object of the present invention is to provide a bitstream decoding apparatus and method having a decoding solution capable of decoding a bitstream in the same information recognition scheme.

The present invention parses a bitstream compressed by various encoding schemes using the same information analysis method, and decodes organically controlled functional units (FU) for decoding using the parsed data. To provide a bitstream decoding apparatus and method having a solution.

An object of the present invention is to provide an apparatus and method for decoding a bitstream having a decoding solution that can commonly apply syntax interpretation methods for decoding various types of bitstreams.

The present invention provides a bitstream decoding apparatus and method having a decoding solution that can apply a new set of instructions for parsing various types of bitstreams using a common syntax analysis method.

The present invention provides a bitstream decoding apparatus and method having a decoding solution that can easily decode a bitstream even when a syntax element is changed, added, or deleted.

The present invention provides a bitstream decoding apparatus and method having a decoding solution that allows the components used for bitstream decoding to share element information (ie, the result of syntax parsing) of parsed syntax. It is for.

The present invention is directed to a bitstream decoding apparatus and method having a decoding solution that makes it possible to use element information of an interpreted syntax for interpretation of subsequent bitstream syntax elements.

The present invention provides a bitstream decoding apparatus and method having a decoding solution included in a toolbox by implementing functions constituting various decoding methods proposed by various standards (codecs) in units of functional units (FU). It is for.

An object of the present invention is to provide a bitstream decoding apparatus and method having a decoding solution for performing a predetermined process by selecting and loading only functions required by a toolbox to decode a bitstream encoded in various forms. .

The present invention provides a bitstream decoding apparatus and method having a decoding solution capable of changing, adding, or deleting a functional unit included in a toolbox.

In addition, the present invention is intended to achieve international standardization on the concept and structure of codec integration for bitstream decoding, and other objects of the present invention will become more apparent through the preferred embodiments described below.

According to an aspect of the present invention to achieve the above object, there is provided an encoder / decoder and / or integrated codec device that can be used universally in various standards.

In accordance with another aspect of the present invention, a decoding apparatus includes: a decoder forming unit configured to generate and output CSCI control information and connection control information using partial decoder descriptions stored in a description storage unit; A tool box including a plurality of functional units implemented to perform a predetermined process, respectively; And a decoding solution that selectively loads a plurality of functional units included in the toolbox by using the CSCI control information and the connection control information to decode the bitstream into video data.

The decoding apparatus may further include a description decoder that decodes an input encoded decoder description to generate a decoder description and stores a plurality of partial decoder descriptions separated from the decoder description in the description storage unit.

The toolbox may include one or more parsing functions for parsing the bitstream and a plurality of decoding functions for decoding the bitstream.

The decoder forming unit may include: an FU checking unit that determines whether a plurality of functional units described in an arbitrary partial decoder description are provided in the tool box; And an information processor configured to generate the CSCI control information and connection control information using the partial decoder descriptions.

The decoding solution may include a control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units. ; And a connection controller for controlling the operation of each functional unit through selective loading of a plurality of functional units with reference to the CSCI control information and the connection control information.

The decoding solution may include a control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units. ; At least one parsing function to parse syntax of the bitstream according to the CSCI control information; And a connection controller for controlling the operation of each functional unit through selective loading of a plurality of functional units with reference to the connection control information. Here, the toolbox may be provided with a plurality of decoding functions for decoding the bitstream.

The decoding solution may comprise a working memory for causing one or more functional units to be loaded and operated.

The predetermined process for each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

When the encoded decoder description and the bitstream are input as a unified integrated bitstream, the decoding apparatus may further include a separation unit for separating and outputting the encoded decoder description and the bitstream.

When the encoded video data is encoded by a plurality of standards, the decoding solution generates and outputs the video data by sequentially connecting a plurality of functional units performing a process according to a plurality of standards with reference to the connection control information. can do.

The partial decoder descriptions are a Syntax Element Table (SET) representing a process for generating information about bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts, FU-CSCIT indicating element information to be input to the selected functional unit. A DVT (Default Value Table) indicating the relationship between the actual value and the code value during entropy coding may be further stored as the partial decoder description.

The SET (Syntax Element Table), the S-RT (Syntax-Rule Table), and the F-RT (FU-Rule Table) read a k (arbitrary natural number) bit by moving a file pointer. Instructions, a seek command that reads k bits without moving the file pointer, a flush command that moves file points by k bits from the file pointer, a GO instruction that indicates a branch between indexes, and element information. It may be configured to include one or more of the set (SET) command to set the flag.

The function unit loaded by the connection control unit may perform a predetermined process of using one or more of predetermined element information and output data by the function unit loaded immediately before as input data.

The parsing function unit may generate element information using the CSCI control information.

The decoding description is composed of one or more partial decoder description regions, and information for generating or recognizing a corresponding partial decoder description may be inserted into each partial decoder description region.

The information is designation information for a partial decoder description corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, and the description decoder is previously described in the description storage unit. Among the plurality of stored partial decoder descriptions, n tables corresponding to the predetermined information may be selected.

The information inserted separately into one or more partial decoder description regions includes binary code information for configuring each partial decoder description, and the description decoder generates n partial decoder descriptions using the binary code information. Can be stored in the description storage.

M (arbitrary natural number) of the plurality of partial decoder description areas, the codec number (Codec No.) and the profile and level number (Profile and level No.) corresponding to the corresponding partial decoder description area designation. Information, wherein the k (any number being nm) partial decoder description area includes binary code information for constructing a corresponding partial decoder description, wherein the description decoder includes a plurality of partial decoders previously stored in the description storage unit. M partial decoder descriptions corresponding to the specified information among the descriptions may be extracted, and k partial decoder descriptions may be generated using the binary code information and stored in the description storage unit.

The CSCI control information may be generated using the SET, the CSCIT, the S-RT, and the DVT, and the connection control information may be generated using the FL, the F-RT, the FU-CSCIT, and the CSCIT. have.

According to another aspect of the present invention, there is provided an encoding apparatus, including: an encoding unit configured to convert an input video into a bitstream according to a predetermined encoding scheme using a plurality of functional units in sequence; And a description information generator for generating description information according to a connection relationship between the syntax information of the bitstream and the functional units. The bitstream and the description information may be provided to a decoding apparatus.

According to still another aspect of the present invention, a decoding apparatus includes: a decoder forming unit configured to generate and output CSCI control information and connection control information using partial decoder descriptions stored in a description storage unit; And a decoding solution that selectively loads a plurality of functional units by using the CSCI control information and the connection control information to decode the bitstream into video data.

According to another aspect of the present invention for achieving the above object, there is provided a decoding method / encoding method that can be used universally in various standards and / or a recording medium on which a program for executing the method is recorded.

According to an embodiment of the present invention, a decoding method includes: (a) generating and storing a plurality of partial decoder descriptions corresponding to an input decoder description; (b) generating CSCI control information and connection control information using the partial decoder descriptions; (c) storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And (d) decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information.

The step (c) and the step (d) may be performed by the functional control unit selectively loaded among the plurality of functional units provided in the toolbox by the connection controller with reference to the CSCI control information or the connection control information. Can be executed.

Step (d) may be repeatedly performed until a result of the process of the plurality of functional units started by selective loading of the connection controller becomes the video data.

The predetermined process of each of the functional units may be implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream.

The result data of the preceding functional unit among the plurality of functional units loaded sequentially may be written to a buffer memory accessible by the subsequent functional unit.

The connection control unit may provide result data of a preceding functional unit among the plurality of sequentially loaded functional units as input data of a subsequent functional unit.

The partial decoder descriptions are a Syntax Element Table (SET) representing a process for generating information about bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) representing detailed information about the element information, FL (FU List) representing the list of the functional units, F-RT for sequential selection of the functional units (FU-Rule Table) may be an FU-CSCIT indicating element information to be input to the selected functional unit. A DVT (Default Value Table) indicating a relationship between an actual value and a code value during entropy coding may be further included.

The CSCI control information may be generated using the SET, the CSCIT, the S-RT, and the DVT, and the connection control information may be generated using the FL, the F-RT, the FU-CSCIT, and the CSCIT. have.

The decoder description may be input in the form of independent data or bitstream. The decoder description may be input in the form of an integrated bitstream integrated with the bitstream.

According to another embodiment of the present invention, a program of instructions that can be executed in a decoding apparatus to perform a decoding method is tangibly implemented, and in a recording medium in which a program that can be read by the decoding apparatus is recorded, Generating and storing a plurality of partial decoder descriptions corresponding to the decoded decoder descriptions; Generating CSCI control information and connection control information using the partial decoder descriptions; Storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And decoding and outputting encoded video data of the bitstream into moving image data using the connection control information and the element information.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments of the integrated codec method and apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are identified by the same reference numerals. Numbering and overlapping descriptions thereof may be omitted.

FIG. 1 is a diagram schematically showing a configuration of a general decoder, and FIG. 2 is a diagram schematically showing a configuration of a general encoder.

As shown in FIG. 1, the MPEG-4 decoder 100 generally includes a variable length decoding unit 110, an inverse scan unit 115, and an inverse DC / AC prediction unit. / AC Prediction (120), Inverse Quantization (125), Inverse Discrete Cosine Transform (Inverse Discrete Cosine Transformation, 130), and Video Restoration (VOP Reconstruction, 135). It is apparent that the configuration of the decoder 100 may be different according to the applied standard, and some components may be replaced with other components.

When the transmitted bitstream 105 is parsed and parsed to extract header information and encoded video data, the variable length decoding unit 110 quantizes the Huffman table using a preset Huffman Table. The inverse scan unit 115 performs the inverse scan to generate data in the same order as the moving image 140. That is, the inverse scan unit 115 outputs a value in reverse of the order of scanning in various ways during encoding. After quantization is performed during encoding, a scan direction may be defined according to a distribution of frequency band values. In general, a zig-zag scan method is used, but the scan method may vary by codec.

Syntax parsing may be performed integrally in the variable length decoding unit 110 or may be performed in any component that processes the bitstream 105 prior to the variable length decoding unit 110. In this case, since syntax parsing is the same as that of the standard applied to the encoder and the decoding period, the syntax parsing is performed only by a predetermined standard corresponding to the standard.

The inverse DC / AC predictor 120 determines the direction of the reference block for prediction by using the magnitude of the DCT coefficient in the frequency band.

The inverse quantizer 125 inverse quantizes the inversely scanned data. That is, the DC and AC coefficients are reduced by using a quantization parameter (QP) specified during encoding.

The inverse DCT unit 130 performs an Inverse Discrete Cosine Transform to obtain an actual video pixel value to generate a VOP (Video Object Plane).

The moving picture restoring unit 135 restores the moving picture signal using the VOP generated by the inverse DCT unit 130 and outputs the restored moving picture signal.

As shown in FIG. 2, the MPEG-4 encoder 200 generally includes a DCT unit 210, a quantizer 215, a DC / AC predictor 220, a scan unit 230, and a variable length encoder ( 235).

Each component included in the encoder 200 performs the inverse function of each component of the corresponding decoder 100, which is obvious to those skilled in the art. In brief, the encoder 200 performs encoding by converting a video signal (ie, a digital image pixel value) into a frequency value through a discrete cosine transform, quantization, and the like, and then encoding the information. Variable length encoding that differentiates the bit length according to the frequency is performed and output in the compressed bitstream state.

FIG. 3 is a diagram schematically illustrating a configuration of a decoder according to an embodiment of the present invention, and FIG. 4 is a diagram schematically illustrating a configuration of an extended bit-stream according to an embodiment of the present invention. 5 is a diagram schematically showing a configuration of a decoding processing unit according to an embodiment of the present invention, and FIG. 6 is a diagram schematically showing a configuration of a decoding processing unit according to another embodiment of the present invention. FIG. 7 illustrates an example of functional units for syntax parsing according to an embodiment of the present invention, and FIG. 8 illustrates an example of functional units for decoding processing according to an embodiment of the present invention.

As shown in FIG. 3, the decoder 300 according to the present invention has a configuration different from that of a conventional decoder (see FIG. 1).

That is, to perform the encoding / decoding method according to the present invention, a decoder description is provided to the decoder 300 together with the bitstream. The decoder description may be provided to the decoder 300 in the form of an extended bitstream 305 integrated with the bitstream, or may be provided to the decoder 500 in the form of independent data. Of course, if hierarchical information corresponding to the decoder description is previously stored in a specific storage unit of the decoder 500, the provision of the decoder description may be omitted. However, hereinafter, the data will be described with reference to a case where the corresponding data is included in the extended bitstream and provided to the decoder 500.

The decoder 300 according to an embodiment of the present invention includes a separator 310 and a decoding processing unit 320. One or more of the components of the decoder 300 shown (eg, the separation unit 310, the decoding processing unit 320 itself, or one or more components included in the decoding processing unit 320, etc.) are described below. It is apparent that the present invention may be implemented as a software program (or a combination of program codes) implemented to perform a function to be described.

The separation unit 310 converts the input extended bitstream 305 into an encoded decoder description 313 and a general bitstream 316 (hereinafter, referred to as a conventional bitstream). Separately input to the decoding processing unit 320, respectively.

The separation unit 310 may input the encoded decoder description 313 to the description decoder 505, and the conventional bitstream 316 may be input to the decoder forming unit 520. As described above, when the encoded decoder description 313 and the conventional bitstream 316 are input as independent data, the separation unit 310 may be omitted. In addition, the conventional bitstream 316 may be data of the same or similar format as the bitstream 105 of FIG. 1.

An example of an extended bitstream 305 is illustrated in FIG. 4. Referring to FIG. 4, the extended bitstream 305 may include a decoder description 313 and a conventional bitstream 316. The examples of the extended bitstream 305 and encoded decoder description 313 of FIG. 4 are for convenience of explanation and understanding only, and the extended bitstream 305 and / or encoded decoder description 313 of the present invention. It is obvious that the format of is not limited thereto.

The decoder description 590, in which the encoded decoder description 313 is decoded by the description decoder 505, is a bitstream encoded using various encoding schemes and / or bits encoded using user-selected functions among various functions. In order to parse the stream by a common interpretation method, configuration information of the conventional bitstream 316, a method in which the conventional bitstream 316 is encoded (or connection information between functional units), and a specific functional part Information about the I / O data specification. Decoder description 590 may be described in a description manner such as textual description or binary description. Of course, if the encoded decoder description 316 is implemented to be recognized by the decoder forming unit 520 without the processing of the description decoder 505, the description decoder 505 may be omitted.

The decoder description 590 may include a functional unit list (FL), a functional unit rule table (F-RT) 420, a functional unit CSCIT (430), a control signal and context information table (CSCIT), It is divided into partial decoder descriptions such as SET (Syntax Element Table, 450), S-RT (Syntax-Rule Table, 460), DVT (Default Value Table, 470), and the like. Can be stored. Obviously, the order of the partial decoder descriptions for constructing the decoder description may be variously modified.

Here, the functional unit list (FL), the functional unit rule table (F-RT) 420, the functional unit CSCIT (430), the control signal and context information table (CSCIT), and the like are each functional units. (FU) may be used to establish a connection relationship (the corresponding partial decoder descriptions may be referred to as 'first decoder description' if necessary).

Of these, the FU-CSCIT 440 may be a partial decoder description for mapping between respective functional units (ie, functional units for decoding processing) in the toolbox 515 and element information stored in the CSCI storage unit 532. have. In this case, the element information may function as a control variable for each functional unit (ie, a functional unit for decoding processing and / or a syntax parser) in the toolbox 515.

In addition, the control signal and context information table (CSCIT) 440, the syntax element table 450 (SET), the syntax-rule table 460 (S-RT), the default value table 470 (DVT), and the like are conventional bitstreams 316. Can be used for parsing (partial decoder descriptions can be referred to as 'second decoder description' if necessary). The form and function of each partial decoder description will be described in detail later.

The description decoder 405 decodes the encoded decoder description 313 input from the separation unit 310 to generate the decoder description 314, and then recognizes it in the decoder forming unit 520 or the decoding solution 530. A plurality of partial decoder descriptions in a form that can be divided are stored in the description storage unit 510.

Each partial decoder description stored in the description storage 510 does not necessarily need to be a table in a general form, but is sufficient as a form of information that can be recognized by the decoder forming unit 520 or the decoding solution 530.

The partial decoder descriptions stored in the description storage unit 510 by the decoder description analysis of the description decoder 405 are FL 410, F-RT 420, FU-CSCIT 440, CSCIT 440, and SET ( 450), S-RT 460, DVT 470, and the like. As illustrated in FIG. 11, the description decoder 405 may distinguish each partial decoder description with reference to a table identifier (TI) 1010.

Of course, the information corresponding to all the partial decoder descriptions does not necessarily need to be included in the decoder description, and as illustrated in FIG. 9, the codec number Codec # 920 and the profile and level # 930 may be included. As illustrated in FIG. 11, a codec number Codec # 1120 and a profile and level # 1130 may be included only for some partial decoder descriptions.

If a codec number (Codec #) and a profile and level # are included, the description decoder 405 does not generate a new partial decoder description for the full partial decoder description or some partial decoder descriptions, but rather the description store. One of the partial decoder descriptions previously stored at 510 may be selected to be used in decoding. In addition, when the codec number (Codec #), the profile and level # (Profile and level #) and the correction information is included, the description decoder 405 is applied to the corresponding codec among the partial decoder descriptions stored in the description storage unit 510 in advance. A corresponding partial decoder description may be extracted to generate a new partial decoder description reflecting the correction information. Of course, if the codec number (Codec #) and profile and level # are not included and the table description for generating the partial decoder description is included, the description decoder 405 may be a full partial decoder description or a partial partial decoder. A new partial decoder description may be generated for the description for use in decoding.

In addition, as illustrated in FIG. 12, the decoder description may further include update information 1230 in addition to the decoder description DD-T 1210 for each partial decoder description. The configuration of each extended bitstream will be described in detail later with reference to the accompanying drawings.

In the description storage unit 510, the partial decoder descriptions separated by the description decoder 405 are stored. Of course, the description storage 510 may include one or more portions of the extended bitstream 305 when the extended bitstream 305 includes a codec number (Codec #, 920 or 1120) and a profile and level # (930 or 1130). One or more partial decoder descriptions may be stored in advance in order for the decoder descriptions to be used by the decoder forming unit 520 or the decoding solution 530.

5 and 6 each embodiment of a decoding processing unit 320 is shown.

Referring to FIG. 5, in which a first embodiment of the decoding processing unit 320 is shown, the decoding processing unit 320 may include a description decoder 505, a description storage unit 510, a tool box 515, and a decoder formation. Unit 520 and decoding solution 530.

The decoder forming unit 520 includes a FU confirming unit 522, an information processing unit 524, and an information transmitting unit 526.

If the partial decoder descriptions are stored in the description storage unit 510 by the processing of the description decoder 505, the FU checker 522 may include the functional units described in the partial decoder description (for example, the FL 410). Check whether all are present in the toolbox 515. If any of the functional units described in the partial decoder description does not exist in the toolbox 515, an error message may be displayed through the display device or the user may be requested to update the functional unit. Of course, when combined with the server device for the update of the functional unit via a communication network, the FU check unit 522 may execute an automatic update through the communication network.

The information processing unit 524 classifies each of the partial decoder descriptions stored in the description storage unit 510 according to a role, and processes the partial decoder descriptions into data types that the decoding solution 530 can easily operate. This may indicate that the stored format (eg, table format) of the partial decoder descriptions stored in the description storage 510 is not suitable for use by the decoding solution 530 or that the decoding solution 530 may use information more efficiently. This may be necessary.

Since the function and format of each partial decoder description will be described in detail later with reference to related drawings, only the processed data form will be briefly described here.

The information processing unit 524 classifies each partial decoder description according to a role such as whether it is used for generating or storing CSCI (Control Signal / Context Information), or for connecting the functional units. After that, the CSCI control information and connection control information are processed. For example, the partial decoder descriptions used to generate CSCI control information may be SET 450, S-RT 460, CSCIT 440 and DVT 470, and the part for generating connection control information. Decoder descriptions may be FL 410, F-RT 420, S-RT 460 and FU-CSCIT 440.

The CSCI control information and the connection control information processed by the information processing unit 524 may be expressed according to, for example, an XML-based Abstract Decoder Model (ADM) expression method. Of course, it is obvious that the representation of the processed CSCI control information and the connection control information is not limited thereto.

First, CSCI control information may be expressed as follows.

<CSCIs>

    <csci_memory id = "C0" name = "CSCI # 0" type = "integer" />

    <csci_memory id = "C1" name = "CSCI # 1" type = "integer" />

    <csci_memory id = "C2" name = "CSCI # 2" type = "array" />

    <csci_memory id = "C3" name = "CSCI # 3" type = "integer" />

    <csci_memory id = "C4" name = "CSCI # 4" type = "integer" />

    <csci_memory id = "C5" name = "CSCI # 5" type = "integer" />

    <csci_memory id = "C6" name = "CSCI # 6" type = "integer" />

    <csci_memory id = "C7" name = "CSCI # 7" type = "integer" />

    <csci_memory id = "C8" name = "CSCI # 8" type = "integer" />

    <csci_memory id = "C9" name = "CSCI # 9" type = "integer" />

    <csci_memory id = "C10" name = "CSCI # 10" type = "integer" />

    <csci_memory id = "C11" name = "CSCI # 11" type = "integer" />

    <csci_memory id = "C12" name = "CSCI # 12" type = "integer" />

      ... ...

</ CSCI>

Next, the connection control information may be expressed as follows.

<Network name = "Decoder">

<Package>

<QID>

<ID id = "MPEG4 Simple Profile" />

</ QID>

</ Package>

<Port kind = "Input" name = "BITSTREAM" />

<Port kind = "Ouput" name = "YUV" />

<Instance id = "1">

<Class name = "Parser">

<QID>

<ID id = "c" />

</ QID>

</ Class>

<Note kind = "label" name = "Stream Parser" />

</ Instance>

<Instance id = "2">

<Class name = "VS">

<QID>

<ID id = "c" />

</ QID>

<Note kind = "label" name = "Video Session" />

</ Class>

</ Instance>

<Connection src = "" src-port = "BITSTREAM" dst = "1" dst-port = "BITSTREAM" />

<Connection src = "1" src-port = "CSCI" dst = "2" dst-port = "CSCI" />

<Connection src = "1" src-port = "DATA" dst = "2" dst-port = "DATA" />

<Connection src = "2" src-port = "YUV" dst = "" dst-port = "YUV" />

</ Network>

The information transfer unit 526 transfers the CSCI control information and the connection control information processed by the information processing unit 524 to the decoding solution 530. The information transfer unit 526 may transfer the CSCI control information to the CSCI storage unit 532 in charge of the actual storage and operation of the CSCI information, and the connection control information to the connection control unit 534 that controls the connection between the functional units. have. If the CSCI storage unit 532 functions only for the storage of CSCI information, and the operation of the CSCI information is performed by the connection control unit 534, the information transfer unit 524 connects the CSCI control information and the connection control information. Obviously, the control unit 534 may transfer the information to the control unit 534.

The decoding solution 530 includes a CSCI storage 532 and a connection controller 534. Although not shown, the decoder solution 530 may further include a working memory for loading one or more functional units by a call of the connection controller 534 to perform a predetermined process.

Referring to FIG. 5, where a second embodiment of the decoding processing unit 320 is shown, the decoding processing unit 320 may include a description decoder 505, a description storage unit 510, a tool box 515, and a decoder formation. Unit 520 and decoding solution 530.

Compared with FIG. 5, the decoding solution 530 of the decoding processing unit 320 of FIG. 6 may further include a parsing function 610. The parsing function 610 is a function that performs syntax parsing of a bitstream. The parsing function 610 may be included in the decoding solution 530 as an independent component, but the decoding solution 530 may include two working memories, and the connection controller 534 may use one working memory for decoding processing. It is apparent that only the functional units may be controlled to be loaded exclusively, and another working memory may be implemented such that the same effect is obtained by controlling only the parsing functional unit 610 to be loaded exclusively. In both cases described above, the parsing and decoding processing for the bitstream may be performed sequentially or in parallel.

In addition, in comparison with FIG. 5, the information processing unit 524 further processes the syntax parsing control information and provides the decoding solution 530 to the processing of the parsing function unit 610. Accordingly, the role of the partial decoder description used to generate the CSCI control information, the connection control information, and the syntax parsing control information may vary.

That is, the information processing unit 524 determines whether each of the partial decoder descriptions is used for generation or storage of CSCI (Control Signal / Context Information), syntax parsing, or connection of functional units. The CSCI control information, the connection control information, and the syntax parsing control information are processed after being classified according to the role such as whether the data is used for the purpose. For example, the partial decoder description used to generate CSCI control information may be CSCIT 440, and the partial decoder descriptions for generating connection control information may be FL 410, F-RT 420 and FU-. CSCIT 440, and the partial decoder descriptions used to generate the syntax parsing control information may be SET 450, S-RT 460, CSCIT 440, and DVT 470.

As described above, the CSCI control information and the connection control information processed by the information processing unit 524 may be expressed according to, for example, an XML-based Abstract Decoder Model (ADM) expression method, and the expression example of the syntax parsing control information. Is shown below.

<syntax>

    <syntax_element id = "S0" name = "Syntax # 0">

      <process>

        <cmd type = "READ">

          <parameter index = 0> 32 </ parameter>

          <parameter index = 1> B </ parameter>

        </ cmd>

        <cmd type = "EXPRESSION">

          <parameter index = 0> (C0 = (IBS == HEX: 1B0)) </ parameter>

        </ cmd>

      </ process>

    </ syntax_element>

    <syntax_element id = "S1" name = "Syntax # 1">

      <process>

        <cmd type = "READ">

          <parameter index = 0> 8 </ parameter>

          <output type = "CSCI"> C1 </ output>

        </ cmd>

      </ process>

    </ syntax_element>

    (……)

</ syntax>

The information transfer unit 526 transfers the CSCI control information, connection control information, and syntax parsing control information processed by the information processing unit 524 to the decoding solution 530. The information transfer unit 526 transfers the CSCI control information to the CSCI storage unit in charge of the actual storage and operation of the CSCI information, the connection control information is transferred to the connection control unit 534 that controls the connection between the functional units, and syntax parsing control. The information may be transferred to the parsing function 610. If the CSCI storage unit 532 functions only for the storage of CSCI information, and the operation of the CSCI information is performed by the connection control unit 534, the information transfer unit 524 connects the CSCI control information and the connection control information. Obviously, the control unit 534 may transfer the information to the control unit 534. In addition, if the parsing function unit 610 performs syntax parsing of the bitstream under the control of the connection controller 534, the information transfer unit 524 may transfer syntax parsing control information to the connection controller 534. It is self-evident.

The decoding solution 530 includes a CSCI storage 532, a connection controller 534 and a parsing function 610. The decoder solution 530 may further include one or more working memories for loading one or more functional units by a call of the connection control unit 534 to perform a predetermined process.

The parsing function 610 may be a function that enables syntax parsing for all bitstreams regardless of the encoding format of the bitstream, or may be a function that is specifically generated for syntax parsing of a specific type of bitstream. That is, the parsing function 610 is one or more functional units for performing syntax parsing, which will be described in detail later with reference to related drawings.

As illustrated in FIGS. 5 and 6, the decoder 300 according to the present invention may include the functional units (decoding function for performing decoding processing and / or parsing function for performing syntax parsing) provided in the toolbox 515. By selectively loading (610) and decoding processing, it becomes possible to implement the decoder 300 that is recombined or generated in various forms so that the input bitstream can be decoded regardless of the encoded method.

As described above, the decoder forming unit 520 or the connection control unit 534 performs a function of configuring a decoder for processing the input bitstream, and decoding of the bitstream is performed by the decoder forming unit 520 or the connection control unit. By the actual decoder configured by the control of 534). By separating the two processing units that are functionally causal in this way, a plurality of decoding solutions can be manufactured using one decoder formation information, so that the decoder can provide more efficient processing.

Hereinafter, functions and operations of the components of the decoding processing unit 320 will be described with reference to the accompanying drawings.

As described above, the description decoder 505 decodes the input encoded decoder description 313 into the decoder description 314 to be stored in the description storage 410 as a plurality of partial decoder descriptions.

The tool box 510 includes a plurality of functional units, each implemented to perform a predetermined process. In this case, the parsing function 610 implemented as one function unit or a combination of a plurality of functions may be implemented to be included in the toolbox 515 or may be included in the decoding solution 530. The parsing function and the respective functions may each be implemented in a combination of program codes.

That is, the tool box 510 is an area including functional units (FUs) implemented to perform respective functions (that is, a predetermined process), and each functional unit is connected to the connection control of the connection controller 534. By loading into the working memory to form a sequential connection operation relationship, the encoded video data included in the conventional bitstream 316 is output as video data.

Of course, as described with reference to FIG. 6, the parsing function 610 is included in the decoding solution 530 to use syntax parsing control information, thereby enabling the conventional bitstream 316 to be controlled without the connection control of the connection controller 534. It may be set to perform an analysis. This is because the following functional units are interpreted by the parsing function 610 and stored in the CSCI storage 532, and the element information (element information) and / or the macroblock (MB) size video output from the parsing function (610) This is because data is available.

The parsing function 610 interprets the conventional bitstream 316 input using syntax parsing control information and stores element information, which is a result of syntax parsing, in the CSCI storage 532. . The CSCI storage 532 may be, for example, a buffer memory. The element information may be, for example, Control Signal / Context Information (CSCI). The element information parsed by the parsing function unit 610 and stored in the CSCI storage unit 532 may be an input value for determining subsequent syntax of the conventional bitstream 316 at the same time as the parsing result of the corresponding step.

In addition, the parsing function unit 610 performs entropy decoding on the header of the syntax-parsed conventional bitstream 316 and the image data, and subsequently performs video data having a predetermined macroblock size according to the connection control of the connection controller 534. Can be output to the function unit (FU).

Of course, the parsing function unit 610 stores the macroblock size video data in a predetermined buffer memory, and the subsequent function unit according to the load of the connection control unit 534 (that is, the connection control) has the macroblock size in the buffer memory. After processing and reading the moving picture data, the processed moving picture data may be stored in the buffer memory for processing of a subsequent functional unit.

That is, the parsing function unit 610 stores the macroblock sized video data in the CSCI storage unit 532 or a separate buffer memory, and then provides the stored macroblock sized video data to the selected function unit. Alternatively, it is apparent that the selected function unit may read out corresponding video data from the CSCI storage unit 532 or a separate buffer memory. However, hereinafter, it is assumed that the macroblock size video data output by the parsing function unit 610 is directly input to the function unit according to the connection control of the connection control unit 534.

The parsing function 610 may be implemented as one software program (including a combination of program codes). Although the parsing function 610 is implemented to perform a plurality of functions respectively corresponding to a plurality of standards (for example, MPEG-1 / 2/4 / AVC, etc.), syntax parsing control information is used to perform a corresponding operation. Because it can be done. Of course, the parsing function 610 may be implemented by being divided into a plurality of functional units as shown in FIG. 7, and each of the functional units may be implemented as a combination of blocked program codes.

The function of the parsing function unit 610 by describing each functional unit illustrated in FIG. 7 in detail is as follows.

As illustrated in FIG. 7, the parsing function unit 610 includes a Network Abstraction Layer Parsing (NALP) function (FU) 710, a Syntax Parsing (SYNP) function 720, and a context determination (CTX) function 730. ), A Variable Length Decoding (VLD) function unit 740, a Run Length Decoding (RLD) function unit 750, a Macro Block Generator (MBG) function unit 760, and the like.

Of course, the parsing function 610 may include all of the functional parts for syntax parsing regardless of the applied standard, and additionally, necessary functions for syntax parsing may be added in the process of technology development. It is apparent that modifications can be made and unnecessary functions can be removed. In addition, it is apparent that each functional unit provided in the parsing function unit 610 does not exist independently in each standard, and in the case of a functional unit capable of the same processing regardless of the standard, it may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The NALP function unit 710 is a function unit for parsing a Network Abstraction Layer (NAL) of MPEG-4 AVC, and the SYNP function unit 720 is a function unit for parsing syntax of a bitstream. The SYNP function 720 may be included in the VLD function 740.

The CTX function unit 730 is a function unit that determines a VLC table of MPEG-4 AVC, and the VLD function unit 740 is a function unit that performs entropy decoding.

The RLD function unit 750 is a function unit for entropy decoding AC values, and the MBG function unit 760 is a function unit for generating one MB (Macro Block) data by combining the DC value and the AC values. All of the functional units in the parsing function 610 and some of the functional units mentioned above may be included in the VLD function 740 according to a system implementation.

As described above, the parsing function unit 610 may be implemented as one software program or may be implemented as a plurality of software programs (for example, the VLD function unit 740 may be independently implemented as an independent software program). The process of the parsing function unit 610 extracting or generating element information using the syntax parsing control information and storing the element information in the CSCI storage unit 532 will be described in detail later in the description of the connection controller 534.

The decoding functions included in the toolbox 515 are activated by an optional load of the connection control unit 534 and output by the parsing function 610 (or the parsing function 610 is buffered by performing a predetermined process, respectively). The video data of the macroblock unit stored in the memory is decoded and output as video data having a predetermined size.

The tool box 515 may include a function unit (FU) for performing the above-described function in accordance with each standard. Each functional unit may be implemented as a separate processing block (eg, a software program, a combination of instruction codes, a function, etc.) or may be implemented as one integrated processing block. Although the decoding functions are implemented in one integrated processing block, it is obvious that the corresponding processing can be performed by the connection control of the connection control unit 534.

As shown in FIG. 8, the decoding functions include a de-blocking filter (DF) function 810, a VOP reconstructor (VR) function 815, a frame field reordering (FFR) function 820, and an IPR (IPR). Intra prediction and Picture Reconstruction function unit 830, Inverse Transform function unit 835, Inverse Quantization (IQ) function unit 845, Inverse AC Prediction (IAP) function unit 855, Inverse Scan The functional unit 860 includes a DC Reconstruction (DCR) functional unit 865.

The IT4x4 function unit 840, the IQ4x4 function unit 850, and the DCR4x4 function unit 870 are characterized in that the block size to be processed is 4x4. This is because MPEG-4 AVC processes data with 4x4 block size, whereas MPEG-1 / 2/4 processes data with 8x8 block size during Transform, Quantization, and Prediction.

The toolbox 515 may include all of the functional units for performing data decoding regardless of the applicable standard, and may add necessary functions in the course of technology development, modify existing functions, and unnecessary functions. It is obvious that it can be removed. For example, if an IS4x4 functional unit for processing data with a 4x4 block size is additionally required for the decoding process, the corresponding functional units may be added to the toolbox 515. In addition, a special prediction (SPR) function (not shown) for performing intra prediction in MPEG-4 AVC may be further added.

Each functional unit provided in the toolbox 515 does not exist independently of each standard, and in the case of a functional unit capable of the same processing irrespective of the standard, it is obvious that the functional unit may be integrated into one functional unit. The function of each functional unit is obvious to those skilled in the art and will be described briefly.

The DF function 810 is a de-blocking filter of MPEG-4 AVC, and the VR function 815 is a function that stores the reconstructed pixel value.

The FFR function unit 820 is a function unit for the interlaced mode, and the IPR function unit 830 is a function unit that stores the reconstructed pixel value after intra prediction of MPEG-4 AVC. As described above, intra prediction of MPEG-4 AVC may be performed by the SPR function.

The IT function unit 835 is a function unit that performs inverse transform of DC values and AC values, and the IQ function unit 845 is a function unit for inverse quantization of AC values.

The IAP function 855 is a function for inverse AC prediction of AC values, and the IS function 860 is a function for inverse scan of AC values. The DCR function unit 865 is a function unit that performs inverse prediction and inverse quantization of DC values.

The above-described processing operations between the parsing function unit 610 and the decoding function units must not be sequentially performed (that is, the operation of the decoding function unit after the operation of the parsing function unit 610 is completed), and the connection control unit 534 It is obvious that parallel processing is also possible by allowing two or more functional units to be loaded into the working memory by the control of the connection. For example, it may be sufficient if only the minimum element information necessary for the operation of a particular decoding function is stored in the CSCI storage 532 by the parsing function 610.

In addition, as described above with reference to FIG. 6, when the parsing function 610 is provided in the decoding solution 530 or two or more working memories are provided, syntax parsing and decoding processing is performed even if there is no separate control of the connection controller 534. The parallel processing of is possible even if the description is omitted.

In the CSCI storage unit 532, element information (eg, CSCI) that is a result of syntax parsing using CSCI control information (or syntax parsing control information) in the parsing function unit 610 corresponds to the CSCIT 440. Stored. The CSCI storage unit 532 may be, for example, a buffer memory.

The element information stored in the CSCI storage unit 532 is used as input data for performing the process of the SET 450 by the parsing function unit 610, or a control for determining a subsequent connection index in the S-RT 460. Can be used as a variable.

In addition, the element information stored in the CSCI storage unit 532 is used by the connection control unit 534 as a control variable for determining a subsequent connection index in the F-RT 420, or a specific function in the FU-CSCIT 430 It may be used to map the input CSCI of the unit FU with element information stored in the CSCI storage unit 532.

That is, element information stored in the CSCI storage unit 532 serves to interwork between the parsing function unit 610 and the decoding function units.

The connection control unit 534 establishes a connection relationship of each decoding function unit to decode bitstreams encoded by various standards through control of selective load of each function unit. That is, the connection controller 534 selects an appropriate functional unit among the functional units included in the toolbox 515 to determine an execution order between the selected functional units. To this end, the connection control unit 534 connects the corresponding functional units using the connection control information, and allows each functional unit to decode the video data in macroblock units using the element information provided by the parsing functional unit 610. .

Hereinafter, the functions and uses of the respective decoder descriptions will be described with reference to the accompanying drawings, focusing on the operation of the information processing unit 524 of the decoder forming unit 520 shown in FIG. 5. In addition, although the information processed by the information processing part 524 is used for the processing operation of the connection control part 534 etc., it demonstrates with reference to the content of the partial decoder description for convenience of description and understanding.

The partial decoder descriptions used by the information processing unit 524 to generate the connection control information include the FL 410, the F-RT 420, the FU-CSCIT 430, and the CSCIT 440. In addition, the S-RT 460 may further be used to establish a connection relationship of respective functional units for syntax parsing.

First, as shown in FIG. 18, the FL (FU List) 410 is a partial decoder description including a list of respective functional units included in the toolbox 515, input / output data of the corresponding functional units, and element information for controlling the functional units. to be.

The FL 410 is a buffer memory name (or a write address of the data or an address in the buffer memory in which the data is recorded) of the input data for each functional unit, and a buffer memory name (or the corresponding data) of the output data by the corresponding functional unit. The write address or address in the buffer memory to which the corresponding data is to be written).

Accordingly, each functional unit may record output data read and processed by the input data using the FL 410. In addition, the input / output data may be transferred between the respective functional units using the information recorded in the FL 410, or the connection controller 534 may provide appropriate input data to each functional unit.

However, the input data and output data of the parsing function unit 610 for generating the element information are not described in the FL 410, which is determined by the parsing function unit 610 using information such as the SET 450. This is because it creates and records the created element information in the specified location.

As illustrated in FIG. 18, the FL 410 includes an index (F), which is an identifier for distinguishing each functional unit, a name of each functional unit (FU Name), the number of input control (CSCI) variables required for the corresponding functional unit, and an input. Data and output data.

The specific function unit loaded in the working memory by the connection controller 534 receives input data from the connection controller 534 and performs a preset process to generate output data. Here, the functional unit is included in the toolbox 515, and refers to a series of processes (eg, a function, an algorithm, or a function) for processing input data in a predetermined process to generate output data. The function unit may store the output data in a buffer memory for processing of a subsequent function unit (ie, a function unit subsequently loaded by the control of the connection control unit 534). Since the functional units FU illustrated in FIG. 18 have already been described with reference to the related drawings, the description thereof will be omitted. In addition, since QFS, QFSP, PQF, and QF in FIG. 18 are obvious to those skilled in the art of MPEG, the description thereof will be omitted. For example, QFS means an output value obtained by variable length coding.

If the decoding processing unit 320 is sufficient to use only one standard for decoding the encoded video data included in the conventional bitstream 316, the FL 410 may be equipped with functional units for performing corresponding processing in that standard. It can only contain information about.

However, when the video data is encoded by a plurality of standards (for example, when the encoding standard is applied differently in units of a plurality of frames), the information of the functional units according to the plurality of standards for decoding the encoded video data. Will be needed. Accordingly, in this case, the FL 410 should include information of the functional units according to the plurality of standards necessary for decoding of encoded video data among all the functional units according to the corresponding plurality of standards.

Of course, even if the video data is differently applied to the encoding standard in units of a plurality of frames, each of the FLs 410 is provided if a plurality of conventional bitstreams 316 and extension bitstreams 305 are generated and output for each applied encoding standard. It may be necessary to include only the information of the functional units according to the corresponding standard.

The FL 410 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required during the partial decoder description may be described in a similar script language.

Next, the F-RT (FU-Rule Table) 420 provides connection information of functional units to be used to decode the input conventional bitstream 316.

As shown in FIG. 19, the F-RT 420 is required for index control (Index, R) for distinguishing each connection information (Rule), function units (FU, F #) corresponding to the corresponding connection index, and connection control. Element information (Input CS / CI, C #), the number of branches that can be connected to subsequent functional units, and each branch information required by the number of branches (# 1, # 2, # 3…) and the like.

Necessary element information exists only when the number of branches is 2 or more. In this case, the connection index may vary according to the determination result of the conditional statement using the required element information. That is, when the number of branches is 1, necessary element information does not exist and the process proceeds to the connection index indicated by the branch information. After that conditional statement, the subsequent connection index (R) is presented.

If the decoding processing unit 320 is sufficient to use only one standard for decoding the encoded video data included in the conventional bitstream 316, the F-RT 420 may perform the corresponding processing only in that standard. Will indicate the connection relationship between the functional units.

However, if the video data is encoded by a plurality of standards (for example, if the encoding standard is applied differently in units of a plurality of frames), the functional units according to the plurality of standards may be used to decode the encoded video data. It is obvious that information for specifying a connection relationship will be included. It is obvious that each of the partial decoder descriptions mentioned below will further include corresponding information if it needs additional information and / or modification to be applied to the plurality of standards in order to be applied in the plurality of standards.

The F-RT 420 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the partial decoder description may be described in a similar script language. .

The functional unit FU for implementing R0 to R5 and R12 among the indexes (R) that distinguish each connection information (Rule) illustrated in FIG. 19 is F0. Referring to FL 410 of FIG. 18, it may be understood that F0 is a parsing function 610. Accordingly, it can be seen that the connection controller 534 controls the operational connection relationship of each of the functional units (in the case of FIG. 5, including the functional unit that performs syntax parsing) included in the toolbox 515. In addition, when the selected function is a function that performs syntax parsing, it can be seen that the F-RT 420 includes connection information (Rule) regarding how many syntaxes the function should read. F0 (R74), etc.).

In addition, the index R1 defines 'PROCESS1' as the functional part item. For example, 'PROCESS1' may be a function that is called to perform other tasks (ie, operations other than syntax parsing and data decoding) required for the software implementation, such as variable declaration, memory setting, and variable value initialization. Such a process may be inserted into a required position of the F-RT 420 to be executed by the software, and may be called and executed by the connection controller 534 in the middle of a syntax parsing or data decoding process. Although only one process is inserted in FIG. 19, it is apparent that a plurality of processes having the same or different performing operations may be inserted at a plurality of positions of the F-RT 420.

Next, the FU-CSCIT (FU CSCI Table) 430 is a partial decoder description for connecting the element information stored in the CSCI storage unit 532 and the element information (input CSCI) required for each functional unit.

As illustrated in FIG. 20, the FU-CSCIT 430 is an index (FC) listed as a pair of indexes and element information of the FL 410, and an index used by the CSCIT 440 for corresponding element information and mapping ( C). In addition, the FU-CSCIT 430 may further include a data type of element information. For example, the data type may be described in the form of a 9-bit integer, a 1-bit flag, or the like.

The FU-CSCIT 430 may not only be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), but the minimum data required among the partial decoder descriptions may be described in a similar script language. .

For example, if F1 receives input of four element information in the F-RT 420 (see FIG. 18), the element information for each functional part is listed in the FU-CSCIT 430. That is, F1-C1, F1-C2, F1-C3. F1-C4 is listed and each element information is mapped, such as C54, C56, C58, C65, using the index C of CSCIT 440 (see FIG. 21).

Similarly, if F2 has an input of two element information, it is indexed by F2-C1, F2-C2 and mapped to C56, C58 values. Here, C54, C56, etc. may be recognized as an address (for example, a write address, a buffer memory name, or a write address in the buffer memory) in which the corresponding element information is stored, and the corresponding function unit may correspond to the input data and the index C. Output data may be generated and output (or written to a buffer memory) using corresponding element information.

For example, in FL 410, DCR needs 4 element information to process input data called QFS, and the 4 element information is C54, C56, C58 and C65 by FU-CSCIT 430. The QFSP may be generated by reading the element information corresponding to the corresponding index C from the CSCI storage unit 532.

Finally, the CSCIT 440 describes detailed information about element information (eg, CSCI) that is the result information of the process in which the parsing function 610 uses the SET 450 and the S-RT 460. . That is, the CSCIT 440 is processed from the conventional bitstream 316 and stored in the CSCI storage 532 and has information about all meaningful material (ie element information) to be used by the decoding functions.

As illustrated in FIG. 21, the CSCIT 440 is a unique number of the corresponding element information. The index C, a flag, the element name of the element information, and the data structural characteristics of the element information are delimiters. To specify whether the element information is used only in the syntax parsing process or the overall decoding process, for example, the storage space of the element information, whether the element information is an array, etc. Includes Global / Local, etc.

The CSCIT 440 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required in the partial decoder description may be described in a similar script language.

Then, the CSCI used by the parsing function 610 (or functions that perform syntax parsing in the toolbox 515) to extract or generate element information from the conventional bitstream 316 and store it in the CSCI storage 532. The partial decoder descriptions for generating control information, CSCIT 440, SET 450, S-RT 460 and DVT 470, will now be described. However, since the CSCIT 440 has been described above with reference to FIG. 21, description thereof will be omitted.

First, the SET 450 is a partial decoder description configured by information on the syntaxes of the input conventional bitstream 316.

As illustrated in FIGS. 22 through 25, the SET 450 includes an index, an element name, input data, output data, and a SET-process (for each syntax). process by SET-PROC) information. Here, the index is a delimiter S for distinguishing each syntax used in the S-RT 460. The element name is the name of the syntax, and can be named according to the meaning or role of the syntax. The input data is the nominal bit length input at one time in the conventional bitstream 316. The output data is element information (ie, CSCI information C) and represents a list of CSCITs 440 to which reference is made when storing acquired data. Here, the output data field may be a buffer memory name (or a write address of the corresponding data or an address in the buffer memory where the corresponding data is recorded) in which the generated element information is to be recorded. By using this, if the corresponding element information is needed later as input data, the corresponding element information may be read using the CSCI information (C). The SET-process describes the process of inputting each bitstream syntax and generating the element information of the output data through a certain processing procedure.

The SET 450 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required during the partial decoder description may be described in a similar script language.

Next, the S-RT 460 shows connection information between each syntax in the conventional bitstream 316. That is, the S-RT 460 has information instructing to call each syntax and move to the next syntax. The parsing function 610 reads the conventional bitstream 316 using the S-RT 460 or defines the order in which element information is stored and / or updated in the CSCI storage 532.

As illustrated in FIGS. 26 to 29, the S-RT 460 stores the index R, the syntax index S, the input data C, the number of branches, and branch information. Include.

The index (R) distinguishes each connection information (Rule). Since the index S of the syntax designates a syntax to be processed in a specific connection index, the parsing function (or functional units performing syntax parsing) performs a process specified for the syntax using the SET 450.

The input data represents a list of element information to be used in condition determination for connection control in the corresponding connection index.

The number of branches indicates the total number of branch paths in the corresponding connection index, which is the number of cases that can be connected to the following syntax. The branch information is a condition judgment algorithm for determining whether there is branch information necessary for the number of branches (# 1, # 2, # 3, ..., etc.) and which link index to process next. It is possible to directly determine what contents to read in accordance with the branch information. As shown in Figs. 22 to 25, when the number of branches is 1, there is no input data, and the process proceeds immediately to process the connection index specified in the branch information. However, if the number of branches is two or more, the condition determination is performed (composed of the next connection information R after the conditional statement) and proceeds to process the corresponding connection index.

The parsing function unit 610 updates the CSCI storage unit 532 by processing the syntax defined by the corresponding connection index, reads the element information of the updated CSCI storage unit 532, and uses the same to determine branch conditions. . This is, for example, the element information C0 after processing the syntax S0 in the branch condition of the branch information of the index R0, that is, C0 at 'C0 == 1'.

Not only can the S-RT 460 be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), but the minimum data required in the partial decoder description may be described in a similar script language. have.

Finally, DVT 470 is a partial decoder description in which Huffman table information used in each encoder / decoder is recorded. In MPEG-1/2/4 / AVC, entropy coding is performed at each encoding. In this case, a Huffman coding method is mainly used, and the information used in this case is a Huffman table. In order to implement the integrated codec, Huffman table information to be used in the corresponding decoder in each decoding should be provided. Therefore, Huffman table information corresponding to each syntax is included in the syntax description in the decoding description according to the present invention. Of course, if Huffman table information corresponding to each standard is already recorded in the description storage unit 510, the transmission of the DVT 470 is omitted or as shown in FIG. 11, the codec number (Codec #, 1120) and the profile and Only the level number (Profile and level #, 1130) may be included.

As illustrated in FIGS. 30 to 31, the DVT 470 includes a name for each Huffman table, an actual value compressed and output by Huffman coding, and a compressed actual value. ) Contains the code value used when stored in). For example, if the MCBPC value is compressed to obtain an actual value of 3, the conventional bitstream 316 is performed by a Huffman table mapping operation (for example, the PROCESS portion of the SET 450). The code value 011 is recorded. As another example, the VLD [1] is recorded in the Process portion of the index S77 (see FIGS. 22 to 25) of the SET 450 as described above, thereby calling a function called VLD. The conventional bit stream 316 is read by a predetermined length (fixed length or variable length) by this function to obtain a code value and then a corresponding actual value is obtained by a Huffman table mapping operation. Can be obtained. The Huffman table used in this case is [1], that is, the first table, CBPY.

The DVT 470 may be described in a description manner such as a textual description or a binary description (in the form of a bit-converted binary code), and the minimum data required during the partial decoder description may be described in a similar script language.

For example, the DVT 470 may be textual description as follows.

DVT {(0,1), (1,001), (2,010), (3,011), (4,0001), (5,000001), (6,000010), (7,000011), (8,000000001) , (9, NULL)) ((0,0011), (1,00101), (2,00100), (3,1001), (4,00011), (5,0111), (7,1011), (8,00010), (9,000011), (10,0101), (11,1010), (12,0100), (13,1000), (14,0110), , 1,11), (2,00), (2,010), (4,001), (5,000) 000001), (6,00001), (7,000001), (8,0000001), (9,00000001), (10,000000001), (11,0000000001), (12,00000000001), (13, NULL) (0,11), (1,10), (2,01), (3,001), (4,0001), (5,00001), (6,000001), (7,0000001), (8 , 00000001), (9,000000001), (10,0000000001), (11,00000000001), (12,000000000001), (13, NULL)) ...

As another example, the DVT 470 may be binary described as follows.

0000001111111111111111111111111011111000011000110010001101000011011001000001001100000010011000001000110000011010010000000010000011111001000011001010010100101001000010010010010100011001000111001100000100010010110010100010001100000110010001010010010100010001000010010000010001100001011001100000000011000000100000111110001101100010110001010000110100001100100100000100101000010011000000100111000000101000000000010100100000000101010000000000101011000000000010000011111000101100010100001001000110010010000010010100001001100000010 ...

Each partial decoder description has the advantage of reducing the storage space, improving processing efficiency, and reducing the transmission time of the extended bitstream 305 including the decoding description by being binary description. For example, overhead bits of the textual description and the binary description of each partial decoder description based on the MPEG-4 SP (Simple Profile) are shown in Table 1 below.

Table 1.Overhead of Textual / Binary Description (bytes)

Table name Textual Description Binary Description SET 3653 1089 S-RT 4201 1122 F-RT 466 142 CSCIT 808 24 FU-CSCIT 151 37 FL 98 28 DVT 2599 259 Total 11,976 2,702

Hereinafter, the interworking process between the partial decoder descriptions used by the parsing function unit 610 and / or the connection control unit 534 will be described.

The method of starting the operation of the decoding processing unit 320 of the decoder 300 according to the present invention may vary. Some examples are as follows.

As an example that may be applied in the decoding processing unit 320 shown in FIG. 5, the connection control unit 534 may use the CSCI control information and the connection control information received from the decoder forming unit 520 and each function in the toolbox 515. It is a method of controlling the processing relationship of the parts (for example, operation order, connection relationship, etc.). As shown in the above-described F-RT 420, the element information obtained by first parsing the conventional bitstream by first loading the parsing function 610 among the functional parts in the toolbox 515 is stored in the CSCI storage 532. After the control authority is returned to the connection control unit 534 (for example, the control authority is returned to the connection control unit 534, such as index R72 of the S-RT 460). The connection of each of the functional units is controlled by loading (FU) to process subsequent operations.

Next, as an example applicable to the decoding processing unit 320 illustrated in FIG. 6, the parsing function unit 610 receiving syntax parsing control information independently starts operation to complete syntax parsing of a conventional bitstream. In this case, the connection control unit 534 receiving the connection control information controls a connection relationship through selective loading of the decoding functions. In this case, the connection control unit 534 must first recognize whether the parsing function unit 610 has finished storing some / all required element information in the CSCI storage unit 532. To this end, the connection control unit 534 continuously monitors whether necessary element information to the CSCI storage unit 532 has been stored, or the parsing function unit 610 that stores the element information is notified to the connection control unit 534 ( For example, the control authority may be returned to the connection controller 534, such as the index R72 of the S-RT 460. Of course, the connection control unit 534 or any functional unit loaded by the control of the connection control unit 534) and / or the parsing function unit 610 need to monitor whether the information necessary for the CSCI storage unit 532 has been stored. Obviously, it is possible to wait until the required information is stored in the storage unit in a state where the operation is started.

As an example that may be applied in the decoding processing unit 320 shown in FIG. 5 and / or 6, the decoder forming unit 520 transmits CSCI control information, connection control information, and the like to the connection control unit 534 and / or the parsing function unit. The method may be implemented to start operation by forwarding to 610.

Hereinafter, the interworking process between the partial decoder descriptions used by the parsing function unit 610 and / or the connection control unit 534 will be described based on the first embodiment described above.

First, the connection control unit 534 reads the first rule information Rule of the F-RT 420 from the description storage unit 510 and calls the corresponding function unit. The connection control unit 534 first reads F0 (R0) as shown in the F-RT 420, loads the parsing function in the toolbox 515 to start the process. This may be to enable a processing block of program codes corresponding to the parsing function 610 to be activated. The FL 410 shows that F0 is a parsing function, and when the selected function FU is a parsing function, information on the number of syntaxes to be read and processed is described together (for example, F0 (R0). ), F0 (R114), etc.).

The parsing function is the rule information designated by the connection control unit 534 (that is, designated by the F-RT 420) among the rule information (Rules) of the S-RT 460 (which is determined by the information processing unit 524). Read the corresponding syntax). Since the rule information pointed out by the F-RT 420 was F0 (R0), the parsing function unit starts processing from the index R0. The parsing function recognizes that the syntax to be processed at the index R0 by the S-RT 460 is S0, and S0 is the Visual Object Sequence Start Code by the SET 450, and corresponds to the corresponding bit (i.e., the conventional bitstream 316). The 32 bits set as an input value in the SET 450 are read, and a corresponding output value (ie, C0 as element information) is generated and stored in the CSCI storage unit 532. What the corresponding element information stored in the CSCI storage unit 532 is described in the CSCIT 440. The parsing function then assigns the element information (ie, C0) stored in the CSCI storage 532 to the corresponding branch information of the S-RT 460 and proceeds for processing the index corresponding to the result. For example, since the branch information corresponding to the index R0 is 'C0 == 1', if the content is satisfied, the branch information proceeds to the index R1, otherwise, an error is processed. This process continues until it encounters a 'GO RT' and control authority is transferred to the F-RT 420 (ie, connection control unit 534) (eg, index R72 of S-RT 460).

However, when the parsing function generates the element information using the SET 450 and stores the element information in the CSCI storage unit 532, the VLD function is called (for example, the index S74 of the SET 450) and the DVT 470. ) To perform entropy decoding. When the element information is generated in this process, it is stored in the CSCI storage unit 532.

If the control authority is transferred to the F-RT 420 (that is, the connection control unit 534) (eg, the index R72 of the S-RT 460) during the processing of the parsing function, it meets the 'GO RT'. The control unit 534 reads C63 (that is, element information according to the index S57 of the SET 450 in the syntax parsing) from the CSCI storage unit 532, which is an input value of the index R0 of the F-RT 420. , Specifying the index to be processed later by assigning it to branch information (that is, ((C63 == 1) || (C63 == 2)) or ((C63 == 3) || (C63 == 4))) do. That is, it is determined whether to proceed to the index R1, end (END), or error processing depending on whether the branch information is satisfied.

When proceeding to the index R1, after performing a predetermined process (eg, variable declaration, memory setting, variable value initialization, etc.), an index to be subsequently processed is determined.

As described above, when all / part of element information is stored in the CSCI storage unit 532 by the processing of the parsing function unit, the connection control unit 534 calls the function unit F1 at the index R6. It is recognized by the FL 410 that F1 is a DC Reconstruction (DCR).

The DCR recognizes that there are four input values (ie, C54, C56, C58, and C65) with reference to the FU-CSCIT 430, and reads corresponding element information from the CSCI storage unit 532. What the corresponding element information is may be recognized through mapping with the CSCIT 440. The DCR completes the processing of the video data of the macroblock size predetermined for the corresponding functional unit by using the read element information, and stores the processed video data in the buffer memory or the CSCI storage unit 532.

This process continues from index R6 to R11 as illustrated in F-RT 420. Thereby, the DCR, IS, IAP, IQ, IT, VR and the like are controlled so as to be sequentially connected. The connection control unit 534 can recognize whether any functional unit has completed the processing, and instructs processing of the subsequent functional unit when the processing of the preceding functional unit is completed. In addition, the preceding function unit stores the data processed for moving image data processing in a subsequent function unit in a preset buffer memory or CSCI storage unit 532. Since the connection control unit 534 is apparent to those skilled in the art how to recognize whether any function has completed the processing, a description thereof will be omitted.

By controlling the connection control unit 534 to perform the above-described process, that is, processing according to the index order described in the F-RT 420 and / or the index order according to the branch condition, the decoding processing unit 320 inputs the inputted conventional bits. Video data corresponding to the stream 316 may be output.

As will be understood from the above description, the interworking loop between the partial decoder descriptions according to the present invention can be largely divided into two. That is, the F-RT loop is divided into F-RT (420), FL (410), FU-CSCIT (430), F-RT (420), CSCIT (branch condition application, etc.), F-RT (next rule). S-RT loop consists of S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition application, etc.), S-RT (next rule) do.

In addition, the F-RT loop can be divided into two as follows. First, when instructing execution of the decoding function unit, the F-RT 420, FL 410, FU-CSCIT 440, F-RT 420, CSCIT (branch condition application, etc.), F-RT (Next Rule). Next, when instructing execution of the parsing function, the F-RT 420, FL 410, (S-RT loop), F-RT 420, CSCIT (branch condition application, etc.), F-RT ( Next rule).

In addition, the S-RT loop can be divided into two as follows. When branching to the next rule information, S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition apply), S-RT (next rule) ), And when returning to the F-RT 420, S-RT (460), SET (450), CSCIT (440), S-RT (460), CSCIT (branch condition application, etc.) , F-RT (index of the called F-RT 420).

By the connection control of the connection control unit 534 according to the F-RT 420, the connection relationship of the respective functional units provided in the tool box 510 may be different.

Hereinafter, the instructions constituting the partial decoder descriptions will be described in detail.

32 illustrates the instructions used in each partial decoder description for syntax parsing. Each of the illustrated instructions can be used to construct information (ie partial decoder description) for parsing standard syntax such as MPEG-2 / MPEG-4 / MPEG-4 AVC. Hereinafter, an example of partial decoder descriptions for parsing MPEG-2 MP (Main Profile) Intra-coded syntax and an interworking relationship between each partial decoder description will be described.

As illustrated in FIG. 32, instructions for configuring each partial decoder description include READ, SEEK, FLUSH, IF, WHILE, UNTIL, DO ~ WHILE, DO ~ UNTIL, BREAK, SET, STOP, PUSH, and the like. Of course, not all instructions need to be used within each partial decoder description, and it is obvious that any instruction can be selectively used for each partial decoder description. Hereinafter, the purpose of each command will be briefly described.

First, READ is a command for reading a certain bit from the bitstream. For example, it may be expressed as "READ bits B> CSCI;". Here, "bits" represents the number of bits to be read, "B" represents a Byte-alignment flag, and "> CSCI" represents a CSCI index to be stored. "B" and "> CSCI" are used as options. If "> CSCI" is not specified, it is set to store only in the variable IBS.

Next, SEEK reads a bit from the bitstream but does not move the file pointer. The file pointer means a reference position during an operation such as reading a predetermined bit. The parameters of the SEEK command can be applied in the same way as the READ described above.

Next, FLUSH is a command for moving a file point by a certain number of bits in the bitstream. Parameters can be applied similarly to READ.

Next, IF may be used in the form of "IF (condition) {~} ELSE {~}", and is an instruction that provides a branch according to a given condition.

Next, WHILE can be used in the form of "WHILE (condition) {~}", and is a command to repeatedly execute a designated block while a given condition is true.

Next, UNTIL can be used in the form of "UNTIL (condition) {~}", which is a command to repeatedly execute a designated block until a given condition becomes true.

Next, DO ~ WHILE can be used in the form of "DO {~} WHILE (condition)", and it is a command to transform a WHILE statement to execute a block before determining a condition.

Next, DO ~ UNTIL can be used in the form of "DO {~} UNTIL (condition)", which is a command to transform a UNTIL statement to execute a block before determining a condition.

Next, the command (~) (compute) is used in the form of "(C11 = (V2 + 3));". In other words, all calculations of SET-PROC can be written in parentheses. Operators such as arithmetic, assignment, comparison, addition / subtraction (++ /-), bitwise operation, logical sum / logical product, and check whether CSCI is used or not Can be used.

Next, BREAK tells you to break away from the nearest loop structure.

Next, SET is a command for setting whether to use flags for designated CSCIs, and CSCIs for designating flags are listed and separated by commas (eg, SET C0, C2;).

Next, STOP is a command for stopping the processing of the currently executing syntax element and moving on to the next.

Next, PUSH is an instruction to add a given data from the last point in which data was recorded in the array CSCI, and the added values are listed (for example, PUSH C8 8, 16, 32;) by comma. Are distinguished.

Next, GO tells you to branch to the specified location. For example, GO R # ;; is a command to branch to R #, and GO RT is a command to return to where it was called.

Next, HEX is a command that indicates that the value following the HEX command is hexadecimal.

Next, RLD is an interface for an RLD function supported in MPEG-4, and may be used in the form of "RLD index, level, run, islastrun, t #;". Here, index, level, run, and islastrun represent CSCI or internal variables storing the RLD return value, and t # represents the Huffman Table ID used for the RLD.

Next, VLD2 is a VLD function for MPEG-2, and may be used in the form of "VLD2 [t #] in> v1, v2, v3;". Here, t # is a Huffman Table ID used for the VLD, in represents an index value to be input, and v1 to v3 represent an output result value.

Finally, VLD4 is a VLD function for MPEG-4, and may be used in the form of "VLD4 [T #]> CSCI;". Here, t # represents a Huffman Table ID used for the VLD, and "> CSCI " represents a CSCI index to be stored. "> CSCI" is an option. If not specified, it is stored only in the variable IBS.

Detailed illustrations of respective partial decoder descriptions configured by the above-described instructions (that is, each partial decoder description for syntax processing for MPEG-2 MP Intra coding) are illustrated in FIGS. 33 to 57. Specifically, SET 450 is shown in FIGS. 33-39, S-RT 460 is shown in FIGS. 40-44, CSCIT 440 is shown in FIGS. 45-48, FL 410 is shown in FIG. 49, The F-RT 420 is illustrated in FIG. 50, the FU-CSCIT 430 is illustrated in FIG. 51, and the DVT 470 is illustrated in FIGS. 52 through 57, respectively.

Since the interworking relationship between the partial decoder descriptions has been described in detail above, the description will be briefly made by generalizing them.

The interworking between the partial decoder descriptions for syntax parsing first proceeds in index order of the F-RT 420 (see FIG. 50). In other words, it starts from the index R0 of the F-RT 420.

The F-RT 420 recognizes the index number F # of the FU corresponding to the index number R # to be currently processed. For example, if the index number to be currently processed is R0, F0 (i.e., parsing function of FL 410) will be recognized, and if the index number to be currently processed is R9, F1 (i.e., DCR of FL 410) will be recognized. Will be recognized.

First, the case where the corresponding FU is a Syntax Parser (that is, index number F0 of FL 410) by the recognized index number will be described.

Recognize R # using "F # (R #)" information recorded in the "FU" field of the F-RT 420, and recognize the index S # corresponding to the index number R # in the S-RT 460. do. For example, "F0 (R0)" is recorded in the "FU" field of the index R0 of the F-RT 420, and R0 corresponds to S0 of the Syntax field of the S-RT 460.

Subsequently, the SET 450 recognizes "Process by SET-PROC" corresponding to the recognized S #. For example, "Process by SET-PROC" of the SET corresponding to S0 in the Syntax field of the S-RT 460 is "READ 32 B; IF (IBS == HEX: 000001B3) C72 = 1; IF (IBS = = HEX: 000001B8) C72 = 2; IF (IBS == HEX: 00000100) C72 = 3; IF (IBS == HEX: 000001B7) C72 = 4;

The operation result of "Process by SET-PROC" of SET 450 is stored to correspond to the C # of the "Output" field of the corresponding index (S #). For example, "Process by SET-PROC" of the SET corresponding to S0 in the Syntax field of the S-RT 460 is stored as C72.

When the storage of the calculation result is completed, the S-RT 460 determines whether the stored CSCI information satisfies the branching condition. If the index R0 of the S-RT 460, the CSCI information C72 is the branching condition "1: (C72 == 1) GO R1; 2: (C72 == 2) GO R39; 3: (C72 == 3 ) GO R47; 4: (C72 == 4) GO RT; " It is determined which one is satisfied. If any one of 1 to 3 of the above 4 conditions is satisfied, the above process is repeated by going to the corresponding index R # in the S-RT 460, but the 4th condition (that is, (C72 == 4). GO RT) is returned to the F-RT 420.

Next, the case where the corresponding FU is not the parsing function unit (that is, the index number F0 of the FL 410) by the recognized index number will be described.

By using the " F # " information recorded in the " FU " field of the F-RT 420 and the FL 410, the number of input CSCIs corresponding to the corresponding F # is recognized. For example, "F1" is recorded in the "FU" field of the index R9 of the F-RT 420, and it is recorded in the FL 410 that F1 is a DCR and requires four input CSCIs.

If the number of input CSCI required by referring to FL 410 is not 0, the FU-CSCIT 440 recognizes the CSCI value (C #) corresponding to the "F # (C #)" fields and the CSCI storage unit 532. ) Reads the corresponding value.

Subsequently, the FU generates output data using the input data (eg, MB data) and input CSCI values, and then returns to the F-RT 420.

As described above, when the corresponding FU satisfies "GO RT" when it is a Syntax Parser (i.e., index number F0 of FL 410), when the corresponding FU is not Syntax Parser, a predetermined operation is completed. After that, the process returns to the F-RT 420.

The F-RT 420 determines the branch condition according to the C # value of the current step and proceeds to the corresponding step. If the satisfied condition is END (e.g. (C72 == 4) GO END;), then Syntax parsing ends, and if the satisfied condition indicates R # (e.g. GO R1) Proceed to index.

9 is a diagram illustrating a configuration of an extended bitstream according to the first embodiment of the present invention, FIG. 10 is a diagram illustrating a configuration of an extended bitstream according to the second embodiment of the present invention, and FIG. FIG. 12 is a diagram illustrating a configuration of an extended bitstream according to a third embodiment, and FIG. 12 is a diagram illustrating a configuration of an extended bitstream according to a fourth embodiment of the present invention.

As illustrated in FIGS. 9 to 11, the decoding description included in the extended bitstream 305 according to the present invention is configured to include only standard information applied without including partial decoder description information (No table), or partial decoder. It may be configured to include all description information (Full tables) or may be configured to include only some partial decoder description information (Partial tables). To distinguish each of them, the decoding description information may include stream identifier information (SI), and the SI information may be divided as shown in Table 2 below.

Table 2. Stream Identifier

SI Decoding Description 00 No table 01 Full tables 10 Partial tables

As shown in FIG. 9, the extended bitstream 305 is a decoder description (decoded into a partial decoder description by the description decoder 505 with an encoded decoder description 313-hereinafter the same), and the partial decoder description information. SI (910, ie, 00) indicating that it does not include, and may include a codec (Codec #, 920) and a profile and level (Profile and level #, 930).

This is a case where partial decoder description information already stored in the description storage unit 510 is used without sending partial decoder description information. Although only the basic information about which codec, profile and level is used by the conventional bitstream 316, the decoding processing unit 320 can decode using the indicated partial decoder descriptions.

For this purpose, SET 450, CSCIT 440, FL 410, FU-CSCIT 430, DVT 470, and the like are described for each application standard (i.e., codec), F-RT 420, S The RT 460 may be described for each profile of the applicable standard (see Tables 3 and 4).

Table 3. Classification of partial decoder descriptions by codec

Standard Partial Decoder Description Delimiter MPEG-1 SET # 1 FL # 1 FU-CSCIT # 1 CSCIT # 1 DVT # 1 MPEG-2 SET # 2 FL # 2 FU-CSCIT # 2 CSCIT # 2 DVT # 2 MPEG-4 SET # 3 FL # 3 FU-CSCIT # 3 CSCIT # 3 DVT # 3 AVC SET # 4 FL # 4 FU-CSCIT # 4 CSCIT # 4 DVT # 4

Table 4. Classification of partial decoder descriptions by profile and level

SI Partial Decoder Description Delimiter MPEG-1 F-RT # 1-1 S-RT # 1-1 MPEG-2 MP F-RT # 2-1 S-RT # 2-1 MPEG-4 SP F-RT # 3-1 S-RT # 3-1 MPEG-4 ASP F-RT # 3-2 S-RT # 3-2 AVC BP F-RT # 4-1 S-RT # 4-1

For MPEG-4 SP, the decoding method is explained using SET # 3, FL # 3, CSCIT # 3, FU-CSCIT # 3, DVT # 3, F-RT # 3-1, and S-RT # 3-1. If the codec number is 3 and the profile and level number are 2, then the decoding processing unit 320 refers to the corresponding partial decoder descriptions (that is, processed by the information processing unit 524 correspondingly). Information can be used to perform the decryption operation.

In addition, as illustrated in FIG. 10, the extended bitstream 305 may include all partial decoder description information described above as a decoder description. In this case, the SI 910 will be set to 01 when referring to Table 2. Each partial decoder description may include a table identifier (TI) 1010, a table start code (TS Code) 1020, a table description (TD), a table description (1030), and a table end code (TE Code). And Table End Code) 1040. The order of the table identifier 1010 and the table start code 1020 may be changed, and the table description 1030 may be described in the form of a binary description. Of course, the order of each partial decoder descriptions may be changed.

In addition, as illustrated in FIG. 10, the extended bitstream 305 may include a partial decoder description information and a codec number corresponding to some partial decoder description information as described above. In this case, the SI 910 will be set to 10 when referring to Table 2. However, in this case, since the format of the partial decoder description information is not uniform, the configuration identifier 1110 is further provided after the table identifier 1010 so as to determine what format the partial decoder description information is configured. Would be preferred.

In addition, as shown in FIG. 12, the extended bitstream may further include decoding description (T-DD) 1210 and update information for partial decoder description information. The decoding description 1210 for the partial decoder description information may be any one of the decoder descriptions described above with reference to FIGS. 9 through 11, and the SI 910 may be set to a corresponding value. The update information may include an update start code (RS code, Revision Start code) 1220 and an update content (Revision 1230).

The update content 1230 may be content such as adding, deleting, or updating rule information of an arbitrary partial decoder description. Its form is 'insert index into table-name (…);', 'delete index from table-name;', 'update index in table-name (…);' And so on.

For example, if you want to add S100 to SET # 4, the update content 1230 is 'insert S100 into SET # 4 ("READ 1; IF (IBS == 1) {SET C31;}");' It can be configured together. In addition, in the case of deleting R31 in S-RT # 3-1, the update contents 1230 may be configured as 'delete R31 from S-RT # 3-1;'. In addition, in the case where it is desired to modify R7 in F-RT # 2-1, the update contents 1230 are 'update R7 in F-RT # 2-1 (F6, 1: (C66 <= 6) GO R5; 2: (C65 <= C67) GO R4; 3: GO R12;); '.

The description decoder 405 reads the update contents 1230 as described above, so that the partial decoder descriptions of the changed contents are stored in the description storage unit 510 while the decoding of the corresponding extended bitstream 305 is performed. However, when the decoding is completed, the partial decoder descriptions stored in the description storage unit 510 should be restored to their original state. Whether or not decoding is completed may be recognized by the decoder forming unit 520 or the decoding solution 530 by providing a completion notification to the description decoder 405 or by the description decoder 405 monitoring whether the decoding processing unit 320 is completed. Could be.

As described above, according to the present invention, an existing profile may be used by using functional units provided by a conventional standard (ie, a codec), or a new decoder may be configured by using existing functional units. In addition, new decoders can be used to implement new decoders. That is, various and unlimited decoder implementations are possible.

However, when adding a new functional unit (Functional Unit) to the tool box 510, it is necessary to add the algorithm for the functional unit (that is, description of the functional unit) and add the corresponding information to the FL 410. . In this case, a compilation process for the algorithm may be additionally required.

In order to implement the integrated codec, each component must be organically controlled to parse a bitstream compressed by various coding methods and decode the bitstream by a decoding method corresponding to the corresponding coding method.

In this case, the corresponding bitstream may be a bitstream composed of various shapes in which various standards (codecs) are mixed or various types of bitstreams generated by various coding schemes within one standard. In addition, in order to support various encoding / decoding methods, various functions used in various standards are divided into separate units, and only one function and a function required by the user are selected to select one codec (encoder and decoder). You should be able to make it.

As described above, the present invention has an advantage that the functional description can be organically connected and controlled by the same information interpretation method regardless of the encoding scheme in which the bitstream is encoded by providing the decoding description together.

In addition, another advantage of the present invention is that even if the syntax of the bitstream is changed or newly added, the S-RT 460 may enable active response by only modifying the corresponding information or inserting additional information. . In addition, the F-RT 420 is configured by selecting a function desired by the user in units of processing such as a bit stream level, a frame level, a macro block level, and an MB-level to decode the corresponding decoding. There is also an advantage that can control the connection relationship or operation of the decoding functions of the existing.

13 is a diagram illustrating a configuration of an extended bitstream according to the fifth embodiment of the present invention, FIG. 14 is a diagram illustrating a configuration of an extended bitstream according to the sixth embodiment of the present invention, and FIG. FIG. 16 is a diagram illustrating a configuration of an extended bitstream according to the seventh embodiment, and FIG. 16 is a diagram illustrating a configuration of an extended bitstream according to an eighth embodiment of the present invention.

The extended bitstream 305 according to the present invention is composed of a decoder description (DD) region and a conventional bitstream 316. It will be apparent to those skilled in the art that the conventional bitstream 316 consists of coded video data (or / and coded audio data).

Here, the decoder description region may be formed in a different structure according to the codec characteristic to be applied to decode the conventional bitstream 316. That is, first, when using a single codec standardized in the prior art, the first decoder description structure may be applied.

Second, some content of one codec that has been standardized in the prior art may be modified (that is, some of the partial decoder descriptions of the seven partial decoder descriptions described above may use the content of the partial decoder description corresponding to the corresponding codec, and some other partial decoder may be used. In the case of modifying descriptions, a second decoder description structure may be applied.

Third, processing and using partial decoder description information of a plurality of codecs conventionally standardized (that is, some of the partial decoder descriptions of the seven partial decoder descriptions described above selectively use partial decoder description contents of the conventional plurality of codecs, and When some partial decoder descriptions are modified and used, a third decoder description structure may be applied.

Fourth, the fourth decoder description structure may be applied when using a new codec that is not standardized in the prior art (that is, including all the above-described seven partial decoder descriptions composed of new contents).

Each of the four decoder description structures described above may be classified as different codec type information. For example, "codec_type = 0" for the first decoder description structure, "codec_type = 1" for the second decoder description structure, and "codec_type = 2" for the third decoder description structure. In the case of the fourth decoder description structure, it may be set to "codec_type = 3".

A first decoder description structure is illustrated in FIG. 13.

According to the first decoder description structure illustrated in FIG. 13, the decoder description area may include a codec type (codec_type) 1250, a codec number (codec_num) 1252, and a profile and level number (profile_level_num) 1254. have. That is, according to the first decoder description structure, only the information about the codec to be applied is described in the decoder description area. Although each field is illustrated as 8 bits in the figure, it is obvious that the size of each field may be added or subtracted according to the size of information to be represented.

The codec type 1250 will be set to zero (ie, codec_type = 0), which means that the codec type 1250 uses one of various codecs standardized in the prior art.

A second decoder description structure is illustrated in FIG. 14.

According to the second decoder description structure illustrated in FIG. 14, the decoder description area includes a codec type (codec_type) 1250, a codec number (codec_num) 1252, a profile and level number (profile_level_num) 1254, and a table description ( 1256). That is, according to the second decoder description structure, the decoder description area is described based on information about a codec to be applied and contents modified among seven partial decoder descriptions. Here, the table description is provided separately for each of the seven partial decoder descriptions. That is, seven table descriptions may exist in the decoder description area.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1263, and a table end code (Table_end_code) as illustrated. 1264 may be included. Of course, the size of each field can be increased or decreased as needed. In addition, as described below, the content 1263 may be omitted or included according to the information of the table type 1262.

For example, if the value of the table type 1262 is 0, the existing partial decoder description (that is, the codec type (codec_type) 1250, the codec number (codec_num) 1252), the profile and level number (profile_level_num) 1254 and It may be recognized to be applied without modification of the partial decoder description recognized by the table identifier 1260. In this case, the content 1263 can be omitted.

However, if the value of the table type 1262 is 1, the existing partial decoder description (that is, the codec type (codec_type) 1250, the codec number (codec_num) 1252), the profile and level number (profile_level_num) 1254, and the table identifier The partial decoder description recognized by 1260 may be recognized for use with some modifications (ie, modifications to the content defined in content 1263). In this case, the modified content (for example, an update command, etc.) may be described in the content 1263. For example, modified content (eg, update command, etc.) may include instructions such as update, insert, and / or delete to include a partial decoder of the corresponding index of the corresponding partial decoder description. It may be information for modifying the description content.

However, if the value of the table type 1262 is 2, the existing partial decoder description (ie, codec type (codec_type) 1250, codec number (codec_num) 1252), profile and level number (profile_level_num) 1254, and table identifier The partial decoder description recognized by 1260) may be fully modified (i.e., changed to the content defined in content 1263) to be used. In this case, the contents 1263 may describe the changed contents (for example, contents for newly defining the corresponding partial decoder description, such as a new command).

A third decoder description structure is illustrated in FIG. 15.

According to the third decoder description structure illustrated in FIG. 15, the decoder description area may be composed of a codec type 1250 and a table description 1256. That is, according to the third decoder description structure, the decoder description area is described based on information about a codec to be applied and contents which are modified among seven partial decoder descriptions. Here, the table description is provided separately for each of the seven partial decoder descriptions. That is, seven table descriptions may exist in the decoder description area.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1262 and a table end code (as illustrated). Table_end_code) 1264. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 1262 is 0, it is recognized by the existing partial decoder description (i.e., codec number (codec_num) 1252), profile and level number (profile_level_num) 1254 and table identifier 1260. Partial decoder description). That is, the codec number (codec_num) 1252, profile and level number (profile_level_num) 1254 corresponding to the partial decoder description to be applied in the content 1262 field are described.

However, if the value of the table type 1262 is 1, the partial decoder description recognized by the existing partial decoder description (i.e., codec number (codec_num) 1252, profile and level number (profile_level_num) 1254, and table identifier 1260). Description) may be recognized for use with some modification (ie, modification as defined in modification 1266). In this case, the codec number (codec_num) 1252, profile and level number (profile_level_num) 1254 corresponding to the table to be applied in the content 1262 field are described, and the modified content 1266 field is a modified content (e.g., For example, an update command) may be described.

However, if the value of the table type 1262 is 2, then the existing partial decoder description (i.e., the partial decoder description recognized by the table identifier 1260) is completely changed (i.e. changed to the content defined in the Content 1262 field). Can be recognized for use. In this case, a changed content (for example, content for newly defining a corresponding decoder description such as a new command) may be described in the content 1263 field. That is, when the table type 1262 is 0 or 1 as described above, since a specific codec is used as it is or some partial decoder description is modified and used, information about the codec (that is, codec number (codec_num) 1252, profile) And level number (profile_level_num) 1254 are required, but if the table type 1262 is 2, completely new partial decoder description information is defined and no separate codec information is necessary.

A fourth decoder description structure is illustrated in FIG.

According to the fourth decoder description structure illustrated in FIG. 16, the decoder description area may be composed of a codec type 1250 and a table description 1256. That is, according to the fourth decoder description structure, the decoder description area is described centering on the seven partial decoder descriptions, and the table description is separately provided for each of the seven partial decoder descriptions.

Each table description 1256 has a table start code (Table_start_code) 1258, a table identifier (Table_identifier) 1260, a table type (Table_type) 1262, a content 1263, and a table end code (Table_end_code) as illustrated. 1264 may be included. Of course, the size of each field can be increased or decreased as needed.

For example, if the value of the table type 1262 is a predetermined value (e.g., 2), then the contents 1262 field may contain information (e.g., to describe a new partial decoder description corresponding to the table identifier 1260). , new command, etc.) to display a new definition of the partial decoder description. As described above, when the codec type 1250 is 3, it is recognized that decoding is performed using new partial decoder descriptions, so that only one table type 1262 is specified or the table type 1262 is omitted. Can be.

Hereinafter, the syntax structure of the decoder description area and the syntax structure of each field will be exemplified as respective tables.

Table 5. Decoder description

Decoder_Description () { No. of bits codec_type 8 if ((codec_type == 0x00) || (codec_type == 0x01)) { Codec_Description () } if (codec_type! = 0x00) { do { Table_Description () } while (next_bits () == table_idetifier) } }

Table 6. Codec description

Codec_Description () { No. of bits codec_num 8 profile_level_num 8 }

Table 7. Table description

Table_Description () { No. of bits table_start_code 24 table_identifier 4 table_type 4 if ((table_type == '0000') || (table_type == '0001')) { if (codec_type == 0x02) Codec_Description () if (table_type == '0001') Update_Description () } if (table_type == '0010') { New_description () } table_end_code 24 }

Table 8. Update description

Update_Description () { No. of bits Mnemonic   Update_Command vlclbf }

Table 9. New description

New_Description () { No. of bits Mnemonic New_command vlclbf }

The semantics of the decoder description are described below as respective tables.

Table 10. Decoding description

codec_type Meaning 0x00 A profile @ level of an existing MPEG standard 0x01 Some parts of the existing one profile @ level changed 0x02 Some parts of the existing multiple profile @ level changed 0x03 A new decoding solution 0x04-0xFF RESERVED

Here, the codec type is an 8-bit code and may be information for identifying the type of the codec.

Table 11. Codec description

codec_num MPEG standards and others 01 MPEG-1 02 MPEG-2 03 MPEG-4 Part 2 04 MPEG-4 Part 10 (AVC) 05-FF RESERVED

Here, the codec number codec_num is an 8-bit code and may be information indicating a code of a used codec. In addition, the profile and level number (profile_level_num) is an 8-bit code and may be information for indicating the number of the profile and the level for the codec. The profile and level numbers may match the profile and level numbers of each MPEG standard.

Table 12. Table description (table identifier)

table_identifier table name 0000 SET (Syntax Element Table) 0001 Syntax Rule Table (S-RT) 0010 CSCIT (CSCI Table) 0011 DVT (Default Value Table) 0100 FL (FU List) 0101 F-RT (FU Rule Table) 0110 FU-CSCIT (FU CSCI Table) 0111-1111 RESERVED

Here, the table start code (table_start_code) may be a 26-bit string 0xFFFFFE in hexadecimal, which may mean the start of a table description. The table identifier (table_identifier) may be each 4-bit code as shown in Table 12 above.

Table 13. Table description (table type)

table_type Meaning 0000 conventional table 0001 updated table 0010 new table 0011-1111 RESERVED

Here, the table type is information for determining whether to maintain the existing partial decoder description, update the existing partial decoder description, or generate a new partial decoder description with a 4-bit value. The table end code (table_end_code) may be a 26-bit string 0xFFFFFF in hexadecimal, which may mean the end of the table description.

Table 14. Instruction set for update command (update_command)

Code Instruction Usage 00 UPDATE UPDATE [index #] in [table #] [a record]; 01 INSERT INSERT into [table #] [a record]; 10 DELETE DELETE [index #] from [table #]; 11 RESERVED

Here, index # may be a 4-bit string indicating an index number of an arbitrary partial decoder description, and table # may be a 32-bit string as a table identifier.

Table 15. Instruction set for new command (new_command)

Code Instruction Usage 00000001 READ READ bits B> CSCI; 00000010 SEEK SEEK bits B> CSCI; 00000011 FLUSH FLUSH bits B; 00000100 IF IF (condition) {~}
ELSE {~} 00000101 WHILE WHILE (condition) {~} 00000110 UNTIL UNTIL (condition) {~} 00000111 ~ 0 DO-WHILE DO {~} WHILE (condition) 00000111 ~ 1 DO ~ UNTIL DO {~} UNTIL (condition) 00001000 (~) (compute) (………) 00001001 BREAK BREAK; 00001010 SET SET CSCI, CSCI; 00001011 STOP STOP; 00001100 PUSH PUSH CSCI Value, Value; 00001101 RLD RLD index, level, run, islastrun, t #; 00010010 VLD2 VLD2 [T #] in> v1, v2, v3; 00010100 VLD4 VLD4 [T #]> CSCI;

Here, bits are any of 3 to 34 bits indicating the number of bits required, and B is a 1-bit string indicating byte alignment. ">" Is a 1-bit string for printing the output on the left, and VLD2 (for MPEG-2) and VLD4 (for MPEG-4) are functions for entropy coding.

17 is a block diagram of an encoder according to an embodiment of the present invention.

The encoder 1300 according to the present invention further includes an extension bitstream generation and output unit 1310 as compared to the conventional encoder 200 described with reference to FIG. 2. The extended bitstream generation and output unit 1310 may control information (eg, a list and connection relations of the used functional units and input of the corresponding functional units) in the conventional bitstream 316 generation process generated by the process up to the front end. Data, syntax information, syntax connection information, etc.) to generate a decoder description. In addition, the extended bitstream 305 is generated using the generated decoder description and the conventional bitstream 316 and transmitted to the decoder 300. The method of generating the decoder description will be fully understood by those skilled in the art based only on the above descriptions, and thus description thereof will be omitted.

In addition, in the present specification, the variable length encoder 230 refers to an arbitrary component (for example, an encoder) that performs encoding in order to generate the conventional bitstream 316 in the encoder 1300. The present invention is not limited thereto, and the scope of the present invention is not limited thereto.

FIG. 17 illustrates a case in which an extended bitstream 305 generated using decoder description information and a conventional bitstream 316 is provided to a decoder.

However, as described above, the decoder description may be delivered to the decoder 300 in the form of separate data or bitstream. In this case, the extended bitstream generation and output unit 1310 is not positioned after the variable length encoding unit 235, and the decoder description generation and output unit are independently generated by being located independently of the conventional encoding unit 200. It is apparent that may be provided to the decoder 300.

In the description of the integrated codec apparatus and method according to the present invention, the decoder has been described with reference to the decoder. However, the interrelationship between the decoder and the encoding period is apparent to those skilled in the art. Obviously, the invention is not limited to decoders.

As described above, the integrated codec apparatus and method according to the present invention facilitates the interpretation of syntax elements and control of the connection of functional parts within one standard (or codec) or between different standards (or codecs). That is, it is not a problem to change the order of syntax elements, insert new syntax elements, or delete existing syntax elements in a bitstream generated according to a specific standard.

In addition, according to the related art, when the syntax element is manipulated, the decoder cannot decode the corresponding bitstream normally. For example, if the bitstream information is ABC and the bitstream is changed to ACB to configure and transmit the bitstream, the decoder cannot recognize the bitstream and thus normal decoding is not possible. The same applies to the case where a new stream is inserted into an ABFC, or a B is deleted to form a bitstream with AC.

However, using the integrated codec apparatus and method according to the present invention, since the decoder description information is provided as data included in the extended bitstream or as independent data, the decoder 300 can perform a smooth decoding operation.

So far, the decoding apparatus and the syntax parsing method for decoding the bitstream according to the present invention have been described based on MPEG-4 AVC, but the MPEG-1, MPEG-2, MPEG-4 and other video encoding / decoding standards Naturally, the same can be applied without any limitation.

In addition, the information included in each of the partial decoder descriptions is not described only with information on connection relations of functional units for performing decoding by one standard, processing processes required for the corresponding functional unit, and decoding by multiple standards. It is obvious that the information may be described.

For example, assume that the initial plurality of frames of the encoded video data contained in the extended bitstream are encoded in MPEG-2, a subsequent plurality of frames are encoded in MPEG-4, and the remaining frames are encoded in MPEG-1 lets do it. In this case, the partial decoder description information included in the decoder description for decoding the encoded video data may be operated by combining the functional units according to each standard included in the tool box 510 for each frame having a different encoding method. It is obvious that it will be implemented.

As described above, the integrated codec apparatus and method according to the present invention are encoded in various formats (syntax, semantics) according to each standard (for example, MPEG-1, MPEG-2, MPEG-4, MPEG-4 AVC, etc.). The decoded bitstream can be decoded with the same information recognition scheme.

In addition, the present invention parses a bitstream compressed by various encoding schemes by the same information analysis method, and can organically control functional units (FU) for decoding using the parsed data. There is also an effect.

In addition, the present invention has the effect that can be commonly applied to the syntax analysis method for decoding various types of bitstream.

In addition, the present invention has the effect of applying a new set of instructions for parsing various types of bitstreams with a common syntax analysis method.

In addition, the present invention also has the effect that the decoder can easily decode the bitstream even when the syntax element is changed or added.

In addition, the present invention also has an effect of allowing elements used for bitstream decoding to share element information (i.e., the result of syntax parsing) of the analyzed syntax.

In addition, the present invention also has the effect that the element information of the parsed syntax can be used for the interpretation of subsequent bitstream syntax elements.

In addition, the present invention also has an effect that can be used when integrating a moving picture or still picture codec that processes block units other than MPEG-1, MPEG-2, MPEG-4, and MPEG-4 AVC.

In addition, the present invention has an effect that can be included in the toolbox by implementing the functions constituting various decoding methods proposed by various standards (codecs) in units of functional units (FU).

In addition, the present invention has the effect that it is possible to selectively load and decode only the functional units necessary in the toolbox to decode the bitstream encoded in various forms.

In addition, the present invention has the effect that it is easy to change, add, or delete the functional unit provided in the tool box.

Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.

Claims (31)

A decoder forming unit for generating and outputting CSCI control information and connection control information using partial decoder descriptions stored in the description storage unit; A tool box including a plurality of functional units implemented to perform a predetermined process, respectively; A decoding solution that selectively loads a plurality of functional units included in the toolbox by using the CSCI control information and the connection control information to decode a bitstream into video data; And A description decoder which decodes an input decoder description to generate a decoder description and stores a plurality of partial decoder descriptions separated from the decoder description in the description storage, The decoding description is composed of one or more partial decoder description regions, each partial decoder description region is inserted with information for generating or recognizing a corresponding partial decoder description, The information is designation information for a partial decoder description corresponding to a codec number (Codec No.), a profile and a level number (Profile and level No.) for decoding the bitstream, The description decoder selects n tables corresponding to the specified information among a plurality of partial decoder descriptions previously stored in the description storage unit, And when the decoder description includes modification information, the description decoder modifies a partial decoder description corresponding to the modification information according to the modification information. delete The method of claim 1, And the toolbox includes at least one parsing function for parsing the syntax of the bitstream and a plurality of decoding functions for decoding the bitstream. The method of claim 1, The decoder forming unit includes: A FU checking unit for determining whether a plurality of functional units described in any partial decoder description are provided in the tool box; And And an information processing unit for generating the CSCI control information and connection control information using the partial decoder descriptions. The method of claim 1, The decoding solution, A control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units; And And a connection control unit for controlling the operation of each function unit through selective loading of a plurality of function units with reference to the CSCI control information and the connection control information. The method of claim 1, The decoding solution, A control signal / context information (CSCI) storage unit configured to store a plurality of element information generated by syntax parsing of the bitstream by performing a process of at least one of the plurality of functional units; At least one parsing function to parse syntax of the bitstream according to the CSCI control information; And Including a connection control unit for controlling the operation of each functional unit through the selective loading of a plurality of functional units with reference to the connection control information, The toolbox is provided with a plurality of decoding functions for decoding the bitstream decoding device. The method according to claim 5 or 6, And the decoding solution comprises a working memory for causing one or more functional units to be loaded and operated. The method of claim 1, And a separator for separating and outputting an encoded decoder description and the bitstream when the encoded decoder description and the bitstream are input as a unified integrated bitstream. The method of claim 1, The partial decoder descriptions are a Syntax Element Table (SET) representing a process for generating information about bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information on the element information, F-RT (Fu-Rule Table) for sequential selection of a plurality of functional units (FU), the function FL (FU List) indicating a list of parts and FU-CSCIT indicating element information to be input to the selected functional unit. 10. The method of claim 9, And a DVT (Default Value Table) indicating a relationship between actual values and code values during entropy coding in the partial decoder description. The method according to claim 5 or 6, And the functional unit loaded by the connection control unit performs a predetermined process using, as input data, at least one of predetermined element information and output data by the immediately loaded functional unit as input data. The method of claim 3, And the parsing function unit generates element information using the CSCI control information. delete delete The method of claim 1, The information inserted separately into one or more partial decoder description regions includes binary code information for constructing each partial decoder description, And the description decoder generates n partial decoder descriptions using the binary code information and stores the n partial decoder descriptions in the description storage unit. The method of claim 1, M (arbitrary natural number) of the plurality of partial decoder description areas, the codec number (Codec No.) and the profile and level number (Profile and level No.) corresponding to the corresponding partial decoder description area designation. Information, and the k (any number being nm) partial decoder description region includes binary code information for constructing a corresponding partial decoder description, The description decoder extracts m partial decoder descriptions corresponding to the designated information among a plurality of partial decoder descriptions previously stored in the description storage unit, and generates k partial decoder descriptions using the binary code information to generate the description. The decoding apparatus characterized in that stored in the storage unit. The method of claim 10, The CSCI control information is generated using the SET, the CSCIT, the S-RT, and the DVT, and the connection control information is generated using the FL, the F-RT, the FU-CSCIT, and the CSCIT. Decoding apparatus characterized by. delete (a) generating and storing a plurality of partial decoder descriptions corresponding to the input decoder description; Selecting n tables corresponding to designation information for a partial decoder description corresponding to a codec number, a profile and a level number, from among a plurality of previously stored partial decoder descriptions; If the decoder description includes modification information, modifying the partial decoder description corresponding to the modification information according to the modification information; (b) generating CSCI control information and connection control information using the partial decoder descriptions; (c) storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And (d) decoding and outputting encoded video data of the bitstream into video data through a function unit stored in a toolbox by referring to the connection control information and the element information; Wherein said decoding description consists of one or more partial decoder description regions, wherein said specific information for generating or recognizing a corresponding partial decoder description is inserted in each partial decoder description region. 20. The method of claim 19, The step (c) and the step (d) are each performed by a selectively loaded functional unit among a plurality of functional units provided in the toolbox by referring to the CSCI control information or the connection control information. Decryption method. 21. The method of claim 20, The step (d) is repeatedly performed until the result of the process of the plurality of functional units started by the selective load of the connection control unit is the video data. 22. The method of claim 21, A predetermined process of each of the functional units is implemented to independently perform each of the functions proposed by a plurality of standards for decoding the bitstream. 21. The method of claim 20, And the result data of the preceding functional unit among the plurality of functional units loaded sequentially is recorded in a buffer memory accessible by the subsequent functional unit. 21. The method of claim 20, And the connection control unit provides the result data of the preceding functional unit among the plurality of sequentially loaded functional units as input data of the subsequent functional unit. 20. The method of claim 19, The partial decoder descriptions are a Syntax Element Table (SET) representing a process for generating information about bitstream syntax and element information corresponding to the bitstream syntax, and an S-RT indicating connection information between the bitstream syntax. (Syntax-Rule Table), CSCIT (Control Signal and Context Information Table) indicating detailed information about the element information, FL (FU List) indicating a list of functions stored in the toolbox, and sequential selection of the functional parts stored in the toolbox. And a FU-CSCIT indicating element information to be input to the selected functional unit. 26. The method of claim 25, The partial decoder description further includes a default value table (DVT) indicating a relationship between an actual value and a code value during entropy coding. 27. The method of claim 26, The CSCI control information is generated using the SET, the CSCIT, the S-RT, and the DVT, and the connection control information is generated using the FL, the F-RT, the FU-CSCIT, and the CSCIT. A decoding method characterized by the above-mentioned. 20. The method of claim 19, And the decoder description is input in the form of independent data or bitstream. 20. The method of claim 19, And the decoder description is input in the form of an integrated bitstream integrated with the bitstream. In a recording medium in which a program of instructions that can be executed in a decoding apparatus is tangibly implemented to perform a decoding method, and a computer executable program that can be read by the decoding apparatus is recorded. (a) generating and storing a plurality of partial decoder descriptions corresponding to the input decoder description; Selecting n tables corresponding to designation information for a partial decoder description corresponding to a codec number, a profile and a level number, from among a plurality of previously stored partial decoder descriptions; If the decoder description includes modification information, modifying the partial decoder description corresponding to the modification information according to the modification information; (b) generating CSCI control information and connection control information using the partial decoder descriptions; (c) storing a plurality of element information generated by syntax parsing of a bitstream using the CSCI control information in a storage unit; And (d) decoding and outputting encoded video data of the bitstream into moving image data through a function unit stored in a toolbox using the connection control information and the element information. The decoding description is composed of one or more partial decoder description areas, and each of the partial decoder description areas contains the specified information for generating or recognizing a corresponding partial decoder description. . delete

Images