JP2012200012A - Decoding device and decoding method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable an image information encoding device or decoding device to guarantee a certain processing time.SOLUTION: When arithmetic decoding processing using context is performed on a bit stream including uncompressed data, by holding a context value immediately before performing arithmetic encoding processing using context on a block of uncompressed data, and performing termination processing of arithmetic decoding processing using context, a certain processing time can be guaranteed.

Description

  The present invention relates to image information compressed by orthogonal transformation such as discrete cosine transformation or Karhunen-Labe transformation and motion compensation, such as JVT (ITU-T Rec. H.264 | ISO / IEC 14496-10 AVC). (Bitstream) when receiving via a network medium such as satellite broadcast, cable TV or the Internet, or when processing on a storage medium such as an optical disk, magnetic disk or flash memory It is about.

  In recent years, image information has been handled as digital data. At that time, MPEG is used for the purpose of efficient transmission and storage of information, and compression is performed by orthogonal transform such as discrete cosine transform and motion compensation using redundancy unique to image information. An apparatus conforming to the above-described method is becoming widespread in both information distribution of broadcasting stations and information reception in general households.

  In particular, MPEG2 (ISO / IEC 13818-2) is defined as a general-purpose image coding system, and is a standard that covers both interlaced and progressively scanned images, standard resolution images, and high-definition images. And widely used in a wide range of applications for consumer use. By using the MPEG2 compression method, for example, a standard resolution interlaced scanning image having 720 × 480 pixels is 4 to 8 Mbps, and a high resolution interlaced scanning image having 1920 × 1088 pixels is 18 to 22 Mbps. (Bit rate) can be assigned to achieve a high compression rate and good image quality.

  MPEG2 was mainly intended for high-quality encoding suitable for broadcasting, but did not support encoding methods with a lower code amount (bit rate) than MPEG1, that is, a higher compression rate. However, with the widespread use of mobile terminals, the need for such an encoding system is expected to increase in the future, and the MPEG4 encoding system has been standardized accordingly. Regarding the image coding system, the standard was approved as an international standard as ISO / IEC 14496-2 in December 1998.

  Further, in recent years, standardization of a standard called JVT (ITU-T Rec. H.264 | ISO / IEC 14496-10 AVC) has been advanced with the initial purpose of image coding for video conferences. JVT is known to achieve higher encoding efficiency than the conventional encoding schemes such as MPEG2 and MPEG4, although a large amount of calculation is required for encoding and decoding.

  Here, FIG. 8 shows a schematic configuration of an image information encoding apparatus that realizes image compression by orthogonal transformation such as discrete cosine transformation or Karhunen-Labe transformation and motion compensation, which is employed in MPEG2 and JVT. As illustrated in FIG. 8, the image information encoding device 100 includes an A / D conversion unit 101, a screen rearrangement buffer 102, an adder 103, an orthogonal transformation unit 104, a quantization unit 105, and a lossless encoding. Unit 106, accumulation buffer 107, inverse quantization unit 108, inverse orthogonal transform unit 109, frame memory 110, motion prediction / compensation unit 111, and rate control unit 112.

  In FIG. 8, an A / D converter 101 converts an input image signal into a digital signal. The screen rearrangement buffer 102 rearranges the frames according to the GOP (Group of Pictures) structure of the image compression information supplied from the A / D conversion unit 101. Here, the screen rearrangement buffer 102 supplies the image information of the entire frame to the orthogonal transform unit 104 regarding the image on which intra (intra-image) encoding is performed. The orthogonal transform unit 104 performs orthogonal transform such as discrete cosine transform or Karhunen-Loeve transform on the image information, and supplies transform coefficients to the quantization unit 105. The quantization unit 105 performs a quantization process on the transform coefficient supplied from the orthogonal transform unit 104.

  The lossless encoding unit 106 determines an encoding mode from the quantized transform coefficient, quantization scale, and the like supplied from the quantization unit 105, and performs variable length encoding or arithmetic encoding on the encoding mode. The information to be inserted into the header portion of the image coding unit is formed. The encoded encoding mode is supplied to the storage buffer 107 and stored. The encoded encoding mode is output as image compression information.

  In addition, the lossless encoding unit 106 performs lossless encoding such as variable length encoding or arithmetic encoding on the quantized transform coefficient, and supplies the encoded transform coefficient to the accumulation buffer 107 for accumulation. Let The encoded transform coefficient is output as image compression information.

  The behavior of the quantization unit 105 is controlled by the rate control unit 112. The quantization unit 105 supplies the quantized transform coefficient to the inverse quantization unit 108, and the inverse quantization unit 108 inversely quantizes the transform coefficient. The inverse orthogonal transform unit 109 performs inverse orthogonal transform processing on the inversely quantized transform coefficients to generate decoded image information, and supplies the information to the frame memory 110 for accumulation.

  On the other hand, the screen rearrangement buffer 102 supplies image information to the motion prediction / compensation unit 111 for an image on which inter (inter-image) encoding is performed. The motion prediction / compensation unit 111 extracts image information that is referred to at the same time from the frame memory 110 and performs motion prediction / compensation processing to generate reference image information. The motion prediction / compensation unit 111 supplies the reference image information to the adder 103, and the adder 103 converts the reference image information into a difference signal from the image information. In addition, the motion compensation / prediction unit 111 supplies motion vector information to the lossless encoding unit 106 at the same time.

  The lossless encoding unit 106 determines the encoding mode from the quantized transform coefficient and quantization scale supplied from the quantization unit 105, the motion vector information supplied from the motion compensation / prediction unit 111, and the like. The encoding mode is subjected to lossless encoding such as variable length encoding or arithmetic encoding to form information to be inserted into the header portion of the image encoding unit. The encoded encoding mode is supplied to the storage buffer 107 and stored. This encoded encoding mode is output as image compression information.

  Further, the lossless encoding unit 106 performs lossless encoding processing such as variable length encoding or arithmetic encoding on the motion vector information, and forms information to be inserted into the header portion of the image encoding unit.

  Unlike the intra coding, in the case of inter coding, the image information input to the direct conversion unit 104 is a difference signal obtained from the adder 103.

  The other processing is the same as the image compression information subjected to intra coding, and thus description thereof is omitted.

  Next, a schematic configuration of an image information decoding apparatus corresponding to the above-described image information encoding apparatus 100 is shown in FIG. As illustrated in FIG. 9, the image information decoding device 120 includes a storage buffer 121, a lossless decoding unit 122, an inverse quantization unit 123, an inverse orthogonal transform unit 124, an adder 125, and a screen rearrangement buffer 126. , A D / A conversion unit 127, a motion prediction / compensation unit 128, and a frame memory 129.

  In FIG. 9, the accumulation buffer 121 temporarily stores input image compression information, and then transfers it to the lossless decoding unit 122. The lossless decoding unit 122 performs processing such as variable length decoding or arithmetic decoding on the compressed image information based on the determined format of the compressed image information, acquires the encoding mode information stored in the header unit, and performs inverse quantum To the control unit 123 and the like. Similarly, the quantized transform coefficient is acquired and supplied to the inverse quantization unit 123. Further, when the frame is inter-coded, the lossless decoding unit 122 also decodes the motion vector information stored in the header portion of the image compression information, and the information is motion prediction / compensation unit 128. To supply.

  The inverse quantization unit 123 inversely quantizes the quantized transform coefficient supplied from the lossless decoding unit 122 and supplies the transform coefficient to the inverse orthogonal transform unit 124. The inverse orthogonal transform unit 124 performs inverse orthogonal transform such as inverse discrete cosine transform or inverse Karhunen-Labe transform on the transform coefficient based on the determined format of the image compression information.

  Here, if the frame is intra-coded, the image information subjected to the inverse orthogonal transform processing is stored in the screen rearrangement buffer 126 and is subjected to D / A conversion in the D / A conversion unit 127. Output after processing.

  On the other hand, when the frame is inter-coded, the motion prediction / compensation unit 128 refers to the motion vector information subjected to the lossless decoding process and the image information stored in the frame memory 129. An image is generated and supplied to the adder 125. The adder 125 synthesizes the reference image and the output of the inverse orthogonal transform unit 124. The other processing is the same as that of the intra-encoded frame, and thus description thereof is omitted.

  Here, the lossless encoding unit 106 in JVT will be described in detail. In the JVT lossless encoding unit 106, symbols such as the input mode information, motion information, and quantized coefficient information input from the quantization unit 105 and the motion prediction / compensation unit 111 are processed as shown in FIG. In addition, either lossless of arithmetic coding (hereinafter referred to as CABAC) called CABAC (Context-based Adaptive Binary Arithmetic Coding) or variable length coding (hereinafter referred to as CAVLC) called CAVLC (Context-based Adaptive Variable Length Coding). Encoding is applied and image compression information (bitstream) is output. Which lossless encoding is applied is determined by the CABAC / CAVLC selection information in FIG. 10, and this CABAC / CAVLC selection information is determined by the image information encoding device 100 and embedded in the bitstream as header information. Is output.

  First, FIG. 11 shows a configuration diagram of CABAC in the lossless encoding unit 106. In FIG. 11, mode information and motion information input from the quantization unit 105 and the motion prediction / compensation unit 111 and quantized transform coefficient information are input to the binarization unit 131 as multilevel symbols. The binarization unit 131 converts the input multilevel symbol into a binary symbol sequence having an arbitrary length based on a predetermined rule. This binary symbol sequence is input to the CABAC encoder 133. The CABAC encoder 133 applies binary symbol arithmetic encoding to the input binary symbols, and outputs the result as a bit stream for storage. Input to the buffer 107. The Context calculator 132 calculates Context based on the symbol information input to the binarization unit 131 and the binary symbol output from the binarization unit 131 and inputs the Context to the CABAC encoder 133. The Context memory group 135 in the Context calculator 132 stores the Context updated at any time during the encoding process and the initial Context state used at the time of resetting.

  Next, FIG. 12 shows a configuration diagram of CAVLC in the lossless encoding unit 106. In FIG. 12, mode information, motion information, and quantized transform coefficient information input from the quantization unit 105 and the motion prediction / compensation unit 111 are input to the CAVLC encoder 140 as multilevel symbols. The CAVLC encoder 140 outputs a bit stream by applying a variable length code table to the input multi-level symbols as in the variable length encoding employed in the conventional MPEG or the like. Here, the Context storage unit 141 encodes information that has already been encoded by the CAVLC encoder 140, for example, the number of non-zero coefficients in each block in the already processed block as well as the block being processed, and the immediately preceding encoding. The value of the selected coefficient is stored. The CAVLC encoder 140 can switch the variable length code table applied to the symbol based on the information from the context storage unit 141. Note that the Context storage unit 141 also stores the initial Context state used at the time of resetting. This output bit stream is input to the accumulation buffer 107.

  Similarly, the lossless decoding unit 122 in JVT will be described in detail. In the JVT lossless decoding unit 122, as in the lossless encoding unit 106, either CABAC or CAVLC lossless decoding is applied to the input bitstream as shown in FIG. 13. Which lossless decoding is applied applies either CABAC or CAVLC by reading CABAC / CAVLC selection information embedded in the header information of the input bitstream.

  FIG. 14 shows a configuration diagram of CABAC in the lossless decoding unit 122. In FIG. 14, the CABAC decoder 161 applies binary symbol arithmetic decoding to the bit stream input from the accumulation buffer 121, and the result is output as a binary symbol string. This binary symbol sequence is input to the inverse binarization unit 163, and is converted into a multi-level symbol by the inverse binarization unit 163 based on a predetermined rule. The multi-level symbols output from the inverse binarization unit 163 are output from the inverse binarization unit 163 as mode information, motion vectors, and quantized coefficient information, and input to the inverse quantization unit 123 and the motion prediction / compensation unit 128. Is done. The Context calculator 162 calculates Context based on the binarized symbol sequence input to the inverse binarization unit 163 and the multilevel symbol output from the inverse binarization unit 163, and the CABAC decoder 161 input. The Context memory group 165 in the Context calculator 162 stores the Context updated at any time during the decoding process and the initial state of the Context used at the time of resetting.

  Next, FIG. 15 shows a configuration diagram of CAVLC in the lossless decoding unit 122. In FIG. 15, the bit stream input from the accumulation buffer 121 is input to the CAVLC decoder 170. The CAVLC decoder 170 applies the variable length decoding table to the input bit stream, as in the variable length decoding adopted in the conventional MPEG, etc., and the mode information, motion information, and quantization are performed. Output conversion coefficient information. The output information is input to the reversible quantization unit 123 and the motion prediction / compensation unit 128. Here, the Context storage unit 171 decodes information that has already been decoded by the CAVLC decoder 170, for example, the number of non-zero coefficients in each block in the already processed block as well as the currently processed block, and the previous decoding. The value of the selected coefficient is stored. The CAVLC decoder 170 can switch the variable length decoding table applied to the symbol based on the information from the Context storage unit 11. Note that the Context storage unit 141 also stores the initial Context state used at the time of resetting.

  As detailed operations of the CABAC shown in FIGS. 11 and 14, the description of CABAC in Final Commit Draft ISO / IEC 14496-10: 2002 (Section 9.2) is attached below (see, for example, Non-Patent Document 1). ).

9.2 Context-based adaptive binary arithmetic coding (CABAC)
9.2.1 Decoding flow and binarization
Binarization is a process that converts a non-binary symbol to a binary string (called bin). Sections 9.2.1.1-9.2.1.4 specify the basic binarization method for CABAC. Decoding flow and binarization method for all syntax elements are specified in 9.2.1.5-9.2.1.9.

9.2.1.1 Unary binarization
Table 9-19 shows a table for the first 5 symbols of binalization by Unary code.

  Code symbol C corresponds to a binary string in which “0” is appended to the end of C “1”. Bin number = 1 corresponds to the first bit of Bin, bin number = 2 corresponds to the second bit, and the corresponding bin number increases as going to the last bit.

9.2.1.2 Truncated unary (TU) binarization
Truncated unary (TU) binarization is applied to a finite number of symbols {0, ..., C _max }. Symbol C <C _max; against performs Unnary binarization defined in 9.2.1.1 section assigns a C _max number of 1 to symbol C _max. Bin number allocation is the same as in unary binarization.

9.2.1.3 Concatenated unary / k ^th -order Exp-Golomb (UEGk) binarization
Concatenated unary / k ^th -order Exp-Golomb (UEGk) binarization is expressed as follows: truncated unary binarization code (prefix code) with k _max = Ucoff (Ucoff: Cut off parameter) and k-th order Exp-Golomb code (suffix code) The concatenated binary sequence is the binary sequence after conversion. If Symbol C is C <Ucoff, there is no suffix code. If C ≧ Ucoff, the suffix code is an Exp-Golomb code for symbol C-Ucoff.

The kth-order Exp-Golomb code for Symbol S is constructed as follows:
while (1) {
// first unary part of EGk
if (symbol> = (unsigned int) (1 << k)) {
put ('1');
S = S-(1 <<k);
k ++; '
}
else
{
put ('0'); // now terminating zero of unary part of EGk
while (k--) // finally binary part of EGk
put ((S >> k) &0x01);
break;
}
}

  The Bin number is incremented by 1 toward the LSB of the Exp-Golomb code with the first bit of the unary code as bin_num = 1.

9.2.1.4 Fixed-length (FL) binarization
Larbit (L = log ₂ | C _max | +1) binarization is applied to a finite number of symbols {0,..., C _max }. Bin number sets LSB to bin_num = 1 and increases toward MSB.

  9.2.1.5 Binarization schemes for macroblock type and sub macroblock type I The macroblock type binarization scheme in slice is specified in Table 9-20. However, if adaptive_block_size_transform_flag == 1, follow Table 12-10.

Bit block after binarization of macroblock type in SI slice consists of prefix and suffix part, prefix is ₁ bit represented by b ₁ = ((mb_type = = SIntra_4x4)? 0: 1), and suffix is Sintra4x4 (suffix Based on the binarization pattern shown in Table 9-20.

  The binarization of P, SP, and B slice is specified in Table 9-21. Intra macroblock types (corresponding to mb_type values 7 to 30) in P and SP slices are binarized by prefixes shown in Table 9-21 and suffixes shown in Table 9-20.

  For intra macroblock types (corresponding to mb_type values 23 to 47) in B slice, binarization is performed using the prefixes shown in Table 9-21 and the suffixes shown in Table 9-20. When adaptive_block_size_transform_flag == 1, the corresponding slice prefix in Table 9-21 and the suffix specified in Table 12-10 are used.

  The binarization of sub_mb_type in P, SP, and B slice is given in Table 9-22.

9.2.1.6 Decoding flow and assignment of binarization schemes
In this section, coded_block_pattern, delta_qp, reference picture index, motion vector data, and intra4x4 prediction modes are defined for the binarization method of the syntax element.

Basically, the coded block pattern is decoded by the relationship coded_block_pattern = coded_block_patternY + 16 * nc specified in section 7.4.6. First, coded_block_patternY in coded_block_pattern is decoded by fixed-length (FL) binarization with C _max = 15, L = 4, and then nc of color difference is decoded by TU binarization with C _max = 2.

  Decoding of the delta_qp parameter is performed in two stages as shown below. First, the unsigned value wrapped_delta_qp ≧ 0 is decoded by unary binarization, and then converted to a signed value by the correspondence shown in Table 9-2.

Decoding spatial intra prediction modes for Luma of Intra_4x4 and Sintra_4x4 is defined as follows. First, intra_pred_indicator is decoded by truncated unary (TU) binarization with C _max = 8. If intra_pred_indicator is 0, use_most_probable_mode = 1, and if intra_pred_indicator ≧ 1, maintaining_mode_selector = intra_pred_indicator−1. Intra_pred_mode uses the given most_probable_mode and remaining_mode_selector, and is decoded by the method specified in section 9.1.5.1. The decoding order is the same as that shown in Figure 9-1 b). For Chroma intra_chroma_pred_mode, decoding is performed using truncated unary (TU) binarization of C _max = 3.

  Reference picture index parameter is decoded using unary binarization specified in 9.2.1.1.

Each encoded component of the motion vector is decoded for each component. Each component includes horizontal and vertical components, but the one corresponding to the horizontal direction is decoded first. First, the absolute value abs_mvd_comp, and then the code sign_mvd_comp is decoded. The binarization applied to abs_mvd_comp is concatenated unary / 3 ^rd -order Exp-Golomb (UEG3) binarization with cut-off parameter Ucoff = 9. In Exp-Golomb decoding, the Decode_eq_prob process specified in 9.2.4.3.5 is applied.

  9.2.1.7 Decoding flow and binarization of transform coefficients Decoding of transform coefficients consists of three stages. When it is known that there is a coefficient value by coded_block_pattern at the Macroblock level, coded_block_flag for each block is decoded, but when coded_block_flag is 0, subsequent information for the block is not decoded. If coded_block_flag! = 0, decode significant_coeff_flag [i] for each scan position i except the last position of scan. If significant_coeff_flag [i] is 1, then last_significant_coeff_flag [i] is decoded. The fact that last_significant_coeff_flag [i] is 1 means that the coefficient value at the scan position i is the last coefficient that appears in the scan pass order. When last_significant_coeff_flag [i] becomes 1, next, coeff_absolute_value_minus_1 is decoded in the reverse order of scan, and similarly, the next coeff_sign is decoded in the reverse order of scan. coeff_absolute_value_minus_1 is decoded using unary / zero-order Exp-Golomb (UEG0) binarization with UCoff = 14. As in the case of the absolute value decoding of the motion vector, the Exp-Golomb suffix is decoded using the Decode_eq_prob process.

9.2.1.8 Decoding of sign information related to motion vector data and transform coefficients
The motion vector code information sign_mvd_comp and the coefficient value code information coeff_sign are decoded as follows. First, using sign_ind obtained by performing the Decode_eq_prob process defined in section 9.2.4.3.5, sign information info _ ((sign_ind = = 0)? 1: -1) is obtained.

9.2.1.9 Decoding of macroblock skip flag and end-of-slice flag
Decoding of mb_skip_flag is performed as follows. First, mb_skip_flag_decoded is decoded using the context model specified in section 9.2.2.2. Next, mb_skip_flag is obtained by inverting mb_skip_flag_decoded (ie, mb_skip_flag = mb_skip_flag_decoded ^ 0x01).

  end_of_slice_flag is decoded by a fixed, non-adaptive model with State = 63 and MPS = 0. In this case, for the reason described below, it is indicated that the fixed mode is set even though the probability prediction shown in 9.2.4.2 is performed in each decoding step. When end_of_slice values is always “0”, State = 63 remains as State = 63 as a result of probability prediction even by observation of MPS symbol. When the LPS value “1” is decoded as the value of end_of_slice_flag, it means that the end of the slice has been reached at this point, and the subsequent decoding process is not affected. For these reasons, a fixed, non-adaptive model is realized by setting State = 63 and MPS = 0.

9.2.2 Context definition and assignment
For each bin number, a context variable is defined that depends on various conditions including the symbol decoded so far. The value of Context variable defines the context model for a specific bin number. There may be multiple context labels for each bin number: bin_num, but there may be only one.

  This section defines context templates, which is a general method for calculating context variables for encoding syntax elements, and specifies context variables corresponding to each bin number of syntax elements. First, a context identifier: context_id is specified to specify the context variable given to each bin number with a different syntax element. This is because the context variable for bin number k is expressed as context_id [k]. belongs to. This context_id [k] is defined in the range of 1 ≦ k ≦ N (N = max_idx_ctx_id).

  Table 9-23 shows the outline of the context identifier for each category of each syntax element.

  A more detailed description of the corresponding context variable is given in the following sections. Each context identifier corresponds to a specific range of context labels. In the case of macroblock type, there are separate context identifiers for each of I, SI, P, SP, and B. Each has a context label range, but the context label ranges themselves overlap.

  In the case of the context identifier of the transform coefficient, an additional context label value shown in Table 12-12 is used when adaptive_block_size_transform_flag == 1.

9.2.2.1 Overview of assignment of context labels
Tables 9-24 and 9-25 show the range of context identifiers and their context labels. From the relationship between the context label (actually the offset added to the reference label number) and the bin number, it can be understood which context variable uses a fixed model and which context variable has a plurality of models.

  Multiple context labels are assigned to specific bin number bin_num in Table 9-24, and multiple context labels are given to context_category in Table 9-25. Make a selection.

9.2.2.2 Context templates using two neighbor symbols
Figure 9-2 (Figure 22) is used to explain a general context variable setting method. Symbols or bins of the same syntax element in the left block and the upper block adjacent to the block C are shown as A and B.

The first expression that determines Context is as follows.
ctx_var_spat = cond_term (A, B), (9-1)
cond_term (A, B) is a function representing the relationship between adjacent symbols A, B and context variable.

In addition to this, three templates are defined as follows.
ctx_var_spat1 = cond_term (A) + cond_term (B), (9-2)
ctx_var_spat2 = cond_term (A) + 2 * cond_term (B), (9-3)
ctx_var_spat3 = cond_term (A). (9-4)
Table 9-26 shows how to calculate the context variable from two adjacent symbols.
ctx_cbp4 is determined by the six block types shown in Table 9-28 (Luma-DC, Luma-AC, Chroma-U-DC, Chroma-V-DC, Chroma-U-AC, Chroma-V-AC) .

  comp means horizontal component (h) or vertical component (v), and A and B mean adjacent blocks as shown in Figure 9-2. Since these adjacent blocks may belong to different macroblock partitions, the following method for specifying adjacent blocks is defined. Initially, the motion vector of the 4x4 block is oversampled, that is, if the corresponding block is partitioned more coarsely, it is considered that the motion vector of the parent block in the quadtree is inherited. Conversely, if the block C is partitioned more roughly than the adjacent block, the motion vector of the upper left sub-block of the adjacent block is set as the corresponding motion vector. After obtaining the corresponding value in the adjacent block by these processes, the context variable is obtained using (9-5).

9.2.2.3 Context templates using preceding bin values
Assuming that (b ₁ ,…, b _N ) corresponds to binarization of symbol C, the context variable corresponding to the k-th bin of C is defined as follows.
ctx_var_bin [k] = cond_term (b ₁ ,…, b _k-1 ), (9-6)
However, 1 <k ≦ N. Table 9-27 shows how to give this kind of context variable.

9.2.2.4 Additional context definitions for information related to transform coefficients
変換係数の条件付けの為には、さらに3つの異なるcontext identifierが追加で用いられる。

9.2.2.4 Additional context definitions for information related to transform coefficients
Three additional context identifiers are additionally used to condition transform coefficients.

  These context identifiers depend on the context_category shown in Table 9-28.

  When adaptive_block_size_transform_flag == 1, a context category as defined in section 12.5.2 is added. Context identifiers ctx_sig and ctx_last are given as follows according to SIG and LAST having binary values and scanning_pos of the block.

ctx_sig [scanning_pos] = Map_sig (scanning_pos), (9-7)
ctx_last [scanning_pos] = Map_last (scanning_pos). (9-8)
Map_sig and Map_last in (9-7) and (9-8) vary depending on the block type.

  First, when the context category is 0-4, the identity maps are as follows.

Map_sig (scanning_pos) = Map_last (scanning_pos) = scanning_pos, if context_category = 0,…, 4,
scanning_pos indicates the scan position in zig-zag scan. Map_sig and Map_last for context category = 5 to 7 used only when adaptive_block_size_transform_flag == 1 are given in section 12.5.2.

Ctx_abs_level is used as a context identifier when abs_level_m1 representing transform coefficient-1 is decoded. ctx_abs_level is obtained as follows using the values of two context variables ctx_abs_level [1] and ctx_abs_level [2].
ctx_abs_lev [1] = ((num_decod_abs_lev_gt1! = 0)? 4: min (3, num_decod_abs_lev_eq1)), (9-9)
ctx_abs_lev [2] = min (4, num_decod_abs_lev_gt1), (9-10)
num_decod_abs_lev_eq1 represents the number of coefficients having a coefficient value of 1, and num_decod_abs_lev_gt1 represents the number of coefficients having a coefficient value greater than 1. When calculating Context variable ctx_abs_level [k], k = 1, 2, only the conversion coefficient of the block is required, and no other information is required.

9.2.3 Initialization of context models
9.2.3.1 Initialization procedure
The symbol corresponding to the MPS defined in state number and 9.2.4.2 is initialized at the beginning of Slice. These two are collectively referred to as the initial state, but the actual initial state is determined by the quantization parameter QP as follows.

pre_state is calculated by pre_state = ((m * (QP-12)) >> 4) + n.
If pre_state is P, B slice, clip to [0,101], if I slice, clip to [27,74]. Processing is as follows.

pre_state = min (101, max (0, pre_state)) for P- and B-slices and
pre_state = min (74, max (27, pre_state)) for I-slices;
Perform mapping from pre_state to {state, MPS} according to the following formula:
if (pre_state <= 50) then {state = 50-pre_state, MPS = 0} else {state = pre_state-51, MPS = 1}

9.2.3.2 Initialization procedure
Tables 9-29-9-34 show initialization parameters for all syntax elements. The initial state is obtained by the method described in Section 9.2.3.1.

9.2.4 Table-based arithmetic coding
Note-Arithmetic codes are encoded by segmentation. Using the given '0' and '1' prediction probabilities p ('0') and p ('1') = 1-p ('0'), the first interval R given is p ('0 ') ´R and Rp (' 0 ') ´R, respectively. Depending on the received binary value, it is determined which section is the next division target section. Binary value is more dominant symbol (MPS) or inferior symbol (LPS) than '0', '1', each context model CTX has LPS probability p _LPS and MPS type (' 0 'or' 1 ').

  The arithmetic code engine in this Recommendation or International Standard has the following three features.

Probability prediction is performed by a state machine with 64 states. The state machine makes a transition based on the table {P _k | 0 ≦ k <64} corresponding to 64 different LPS occurrence probabilities (p _LPS ).

The variable R representing the division interval is quantized to _four values {Q ₁ ,..., Q ₄ } before calculating a new division interval. By calculating and storing 64 × 4 types of values corresponding to Q _i ′ P _k in advance, the multiplication processing of R ′ P _k can be omitted.
Another decoding process is applied to a syntax element that can be considered that the occurrence probabilities of “0” and “1” are substantially equal.

9.2.4.2 Probability estimation
Probability prediction is performed by a finite-state machine (FSM) consisting of LPS probabilities {P _k | 0 ≦ k <64} and transition laws. Table 9-35 shows the transition law for MPS or LPS given. The MPS or LPS is encoded from an arbitrary State to transit to Next_State_MPS (State) or Next_State_LPS (State).

  The state numbers correspond to those in which State = 0 corresponds to the occurrence probability of LPS = 0.5, and the occurrence probability of LPS decreases as the number increases. For I slice, since the state is limited to the first 24, Table 9-35 has Next_State_MPS_INTRA used for that purpose. Note that Next_State_MPS_INTRA and Next_State_MPS differ only in one place.

Next_State_MPS (35) = to avoid transition to a state greater than 23 when decoding I slice
Use 23. See Table 9-35 for details.
Each time one symbol is encoded / decoded, State changes, and as a result, the probability is updated.
if (decision = = MPS)
State ← Next_State_MPS_INTRA (State)
else
State ← Next_State_LPS (State)
and all other
slice types
if (decision = = MPS)
State ← Next_State_MPS (State)
else
State ← Next_State_LPS (State).
When the LPS occurrence probability is 0.5, that is, when another LPS is obtained when State = 0, symbols “0” and “1” corresponding to LPS and MPS are exchanged.

9.2.4.3 Description of the arithmetic decoding engine
The state of the arithmetic code decoder is represented by the value V pointing into the subdivision of range R. Figure 9-3 shows the entire decryption process. First, V and R are initialized by performing the InitDecoder process specified in 9.2.4.3.1. One decision is performed in the following two steps. First, a context model CTX is generated according to the rules shown in Section 9.2.2, and then the Decode (CTX) specified in Section 9.2.4.3.2 is applied according to the given CTX to obtain symbol S.

9.2.4.3.1 Initialization of the decoding engine
In the initialization process shown in Figure 9-4, V is set to a 2-byte value obtained by using the GetByte process shown in 9.2.4.3.4, and R is set to 0x8000.

9.2.4.3.2 Decoding a decision
Figure 9-5 shows a process flowchart that performs one decision. In the first step, sections R _LPS and R _MPS corresponding to _LPS and _MPS are predicted as follows.
The width R of a given interval is first quantized to a value of Q as shown below.
Q = (R-0x4001) >> 12, (9-11)
By indexing RTAB using Q and State, R _LPS can be obtained as follows.
R _LPS = RTAB [State] [Q]. (9-12)
Table 9-36 shows the 16-bit representation of RTAB. RTAB is actually given with 8bit precision, but is given with 6bit left shift. This is to facilitate implementation on a 16-bit architecture.

Next, V is compared with the MPS interval R _MPS, and if V is equal to or greater than R _MPS , the LPS is decoded. At the same time, R _MPS is reduced from V, and R _LPS is inserted into R. If V is less than R _MPS , MPS is decoded and R _MPS is stored in R. With each decoding decision, the probability specified in 9.2.4.2 is updated. Depending on the new interval value R, the renormalization specified in 9.2.4.3.3 applies.

9.2.4.3.3 Renormalization in the decoding engine (RenormD)
Figure 9-6 shows the renormalization process. The comparison between the interval value R and 0x4000 is performed first, but if R is greater than 0x4000, renormalization is not performed and the process ends. Otherwise, the renormalization loop is entered. Within this loop, the value of R is doubled, that is, shifted to the left by 1 bit, and bit-count BG is decremented by 1. When BG <0, new data is read by GetByte and the least significant bit of B is set to V.

9.2.4.3.4 Input of compressed bytes (GetByte)
Figure 9-7 shows the compressed data input process. This process is applied when the bit-counter BG becomes negative during initialization or renormalization. First, a new byte is read from bitstream C. Next, the value of CL indicating the position in the bitstream is incremented by 1, and the value of bit-counter is set to 7.

9.2.4.3.5 Decoder bypass for decisions with uniform pdf (Decode_eq_prob)
This process is a special process applied when it is considered that the encoded symbols have the same probability of occurrence, such as the sign of the motion vector and the sign of the transform coefficient. In such a case, the normal process of decoding symbol S and dividing the section can be performed only with one comparison (V> = R _half ?). Renormalization is similar to that shown in Figure 9-8, except for the following two points. The first point is that rescaling processing R ← (R << 1) is unnecessary, and the second point is that the first comparison (R <= 0x4000?) Can be omitted.

Final Committee Draft ISO / IEC 14496-10: 2002 (Section 9.2)

  By the way, when encoding one picture in the image information encoding apparatus 100, the encoding unit is encoded regardless of whether the encoding unit is considered as one picture, slice, macroblock, or block. The number of symbols included in the unit and input to the binarization unit 131 in FIG. 11 is not fixed, and varies depending on the input image signal and encoding conditions, and is undefined.

  Further, the length of the binary data string output for one symbol input to the binarization unit 131 is not a fixed length as shown in the quotation in JVT FCD section 9.2.1. . For example, as described in JVT FCD Section 9.2.1.5 Table 9-20, the length of the binary data string for mb_type1 Symbol in I slice is 1 at the minimum (at Intra_4x4) and 6 at the maximum. Thus, the output binary data length of the binazization unit 131 for one Symbol is also undefined.

  For this reason, the number of binary data output by the binarization unit 131 is not fixed with respect to the symbols included in a certain encoding unit of the input image signal, and is very indefinite depending on the input data and encoding conditions. A large amount of binary data may be output from the binarization unit 131.

  Here, the binary data output from the binarization unit 131 is input to the CABAC encoder 133 in FIG. 11, and the CABAC encoder 133 processes one input binary data. However, since a processing time of 1 clock or more is necessary for mounting, if the number of binary data input to the CABAC encoder 133 is enormous, the processing time is so much required. Processing time. As described above, since the number of binary data input to the CABAC encoder 133 is indefinite, it becomes difficult to estimate the worst value of the processing time.

  Therefore, in the image information encoding device 100, when it is necessary to guarantee real-time processing or a certain processing speed, whether the number of binary data input to the CABAC encoder 133 is enormous, Or, if it is indefinite, the guarantee is impossible.

  Further, the output bit length of the CABAC encoder 133 for the binary data string output for one symbol input to the binarization unit 131 is indefinite. This is because CABAC variably controls the output bit length according to the occurrence probability of input binary data. Therefore, one binary data input to the CABAC encoder 133 can be bit stream data of 1 bit or less or bit stream data of several bits or more depending on the occurrence probability.

  Here, since the CABAC encoder 133 requires a processing time of one clock or more in processing to process one output bit data, the bit data output from the CABAC encoder 133 is enormous. If it is, it will require processing time, and when it is mounted, it will take enormous processing time. Further, as described above, since the number of bit data output from the CABAC encoder 133 is indefinite, it becomes difficult to estimate the worst value of the processing time.

  Therefore, in the image information encoding apparatus 100, when it is necessary to guarantee real-time processing or a certain processing time, the number of bit data output from the CABAC encoder 133 is enormous, or If it is indefinite, it cannot be guaranteed.

  As described above, the number of binary data and bit data input / output to / from the CABAC encoder 133 is indefinite within one picture, a slice in a picture, a coding unit such as a macroblock, and a block. The fact that the number can become enormous hinders guaranteeing a certain processing time in the coding unit in terms of implementation.

  Subsequently, when one picture is encoded in the image information decoding apparatus 120, the encoding unit can be used regardless of whether the encoding unit is considered as one picture, a slice, a macroblock, or a block. The number of bits of the bit stream included in the encoding unit and input to the CABAC decoder 161 in FIG.

  Here, since the CABAC decoder 161 requires a processing time of one clock or more in processing to process one input bit data, the bit data input to the CABAC decoder 161 is enormous. If it is, it will require processing time, and when it is mounted, it will take enormous processing time. Further, as described above, since the number of bit data input to the CABAC decoder 161 is indefinite, it becomes difficult to estimate the worst value of the processing speed.

  For this reason, in the image information decoding apparatus 120, when it is necessary to guarantee real-time processing or a certain processing time, the number of bit data input to the CABAC decoder 161 is enormous, or If it is indefinite, it cannot be guaranteed. In particular, the image information decoding apparatus 120 is more demanding than the image information encoding apparatus 100 to decode and display image information in real time, so that real-time processing cannot be guaranteed.

In order to solve this problem, the present invention provides a decoding device for decoding a bitstream including uncompressed data, a decoding means for performing arithmetic decoding processing using a context on the bitstream, and a unit for performing the encoding processing If the block is a block of uncompressed data, the context value immediately before performing the arithmetic coding process using the context for the uncompressed data block is retained, and the end of the arithmetic decoding process using the context Control means for controlling the decoding means so as to perform processing.
Further, the present invention provides a decoding method for decoding a bitstream including uncompressed data, wherein a decoding step for performing arithmetic decoding processing using a context on the bitstream and a block that is a unit for the encoding processing are not included. When it is a block of compressed data, the context value immediately before performing the arithmetic coding process using the context for the non-compressed data block is retained, and the arithmetic decoding process using the context is terminated. And a control step for controlling the decoding process in the decoding step.
.

  When performing arithmetic decoding using context on a bitstream containing uncompressed data, the context value immediately before performing arithmetic coding using context on the block of uncompressed data is retained, and the context is A certain processing time can be guaranteed by performing the termination process of the used arithmetic decoding process.

Configuration example of image information encoding device according to the present invention (device 10) Configuration example of image information encoding apparatus according to the present invention (apparatus 30) Configuration example of image information encoding apparatus according to the present invention (apparatus 40) Configuration example of image information encoding apparatus according to the present invention (apparatus 50) Configuration example of image information encoding apparatus according to the present invention (apparatus 60) Configuration example of image information decoding apparatus according to the present invention (apparatus 80) Configuration example of macroblock processing unit in the present invention Configuration example of conventional image information encoding device Configuration example of conventional image information decoding apparatus Configuration example of variable length encoder in JVT (conventional) Configuration example of CABAC encoder in JVT (conventional) Configuration example of CAVLC encoder in JVT (conventional) Configuration example of variable length decoder in JVT (conventional) Configuration example of CABAC decoder in JVT (conventional) Configuration example of CAVLC decoder in JVT (conventional) Overview of the Decoding Process Flowchart of initialisation of the decoding engine Flowchart for decoding a decision Flowchart of renormalization Flowchart for Input of Compressed Bytes Flowchart of decoding bypass Illustration of the generic context template using two neighbors symbols A and B for conditional coding of a current symbol C

  Embodiments of the present invention will be described below with reference to the drawings.

Description of Embodiment by Apparatus 10 in FIG. 1 An embodiment of an image encoding apparatus in the present invention is shown in FIG. In the apparatus 10 of FIG. 1, an image signal to be encoded is input, and an encoded bit stream is output. The apparatus 10 includes an input buffer 11, a conversion processing unit 12, a CABAC processing unit 13, a limit monitor 14, and an output buffer 15. The input buffer 11 divides the input image into units of macroblocks and outputs them, and outputs the next macroblock every time the macroblock processing is completed in the subsequent stage. The conversion processing unit 12 performs processing on the input macroblock image, and outputs header information and quantized coefficient information to the CABAC processing unit 13. Specifically, macro parameter mode information, motion vector information, and header information such as quantization parameters are set by the parameter setting unit 16, and their values (symbols) are set in the predictor 17, DCT unit 18, and quantizer 19. And output to the CABAC processing unit 13. Here, since the parameter setting unit 16 can set and output not only macroblock header information but also slice and picture header information, all are collectively referred to as header information here. . The predictor 17 refers to the input signal from the parameter setting unit 16 for the input signal from the previous stage, the motion compensation for the DCT unit 18, the DCT transform for the DCT unit 18, and the quantization process for the quantizer 19. Applied.

  The CABAC processing unit 13 receives header information and quantized coefficient information as symbol data, is applied with arithmetic coding, and is output as bit data. Specifically, the input symbol data is converted into a binary data string by the binarization unit 20, and the binary data is entropy-encoded by the CABAC encoder 22 based on the context information from the context calculator 21. To do. The Context calculator 21 updates the Context based on the symbol data input to the binarization unit 20 and the binary data output from the binarization unit 20, and outputs the Context information to the CABAC encoding unit 22. .

  The limit monitor 14 has a counter for the number of binary data input to the CABAC encoder 22 and a counter for the number of bit data (bit counter 25) to be output to the CABAC encoder 22. Each time value data is input, the former counter is incremented by one, and each time bit data is output from the CABAC encoder 22, the latter counter is incremented by one. Each of these counters is reset to 0 each time processing at the head of the macroblock is started. This makes it possible to count the number of input data and output data of the CABAC encoder 22 in each macroblock.

  In the limit monitor 14, if any one of these counters exceeds a preset threshold value, a signal indicating that the encoded data is invalid (hereinafter referred to as a re-encoded signal). And output to the output buffer 15, the context calculator 21, and the parameter setter 16. Receiving this re-encoded signal, the parameter setting unit 16 resets the encoding parameter with care not to exceed the threshold again, and re-encodes the macro block data to be encoded. The Context computing unit 21 has a Context memory group 23, and this Context memory group 23 is updated at any time during the encoding process, like the conventional Context memory group 135 in FIG. 103 of the prior art. The initial state of the context and the context used at the time of resetting are saved, and at the same time, the state of the context immediately before data processing of the macroblock can be saved. As a result, the Context computing unit 16 that has received the re-encoded signal rewrites the state of the internal Context to the value of the Context stored in the newly added memory. It is possible to restore to the state of Context immediately before being updated with data. Further, the output buffer 15 that has received the re-encoded signal deletes all bit data of the encoding target macroblock stored therein, and waits for input of macroblock data encoded with a new encoding parameter. On the other hand, if the counter of the limit monitor 14 does not exceed the preset threshold when the encoding process of the target macroblock is finished, the bit data of the target macroblock in the output buffer 15 is stored. It can be output as a bit stream.

  In the apparatus 10 shown in FIG. 1 described so far, the counter in the limit monitor 14 is reset at the head of the macroblock, so this is binary data input to the CABAC encoder 22 in units of macroblocks. This means that the number of output bit data is monitored and limited. If the reset timing is set for each block in the macro block, the number of data in each block is monitored and limited. It becomes possible. Similarly, if reset is performed in units of slices, the number of data can be monitored and limited in units of slices, and if reset is performed in units of pictures, the number of data can be monitored and limited in units of pictures. Become. Further, when changing the encoding unit for monitoring and limiting the number of data in this way, the Context memory group 23 in the Context calculator 21 simultaneously stores the Context value immediately before the encoding unit. Context state restoration is also restored to the state immediately before the coding unit. In addition, the deletion of the bit data of the output buffer 15 is performed in the same encoding unit.

  In this restoration, not the Context value immediately before the coding unit saved in the Context memory 23 group, but the restoration to a predetermined initial value similarly saved in the Context memory group 23. Is also possible.

  In the apparatus 10 of FIG. 1 described so far, two counters are set in the limit monitor 14, but the threshold values set in these counters can be set independently as independent values. It is also possible to configure such that only the data count corresponding to only one of the two is monitored and the other is ignored or does not have the counter itself.

  This apparatus 10 can limit the upper limit of the amount of data input to and output from the CABAC encoder in one macroblock process, so that the required processing time for one macroblock can be satisfied. It becomes possible. It is also possible to output a bitstream that can be decoded in the requested processing time.

  Here, for future explanation, FIG. 7 shows a macroblock processing unit 29, which is an apparatus that collectively represents the conversion processing unit 12 and the CABAC processing unit 13 in FIG. The macroblock processing unit 29 in the future description will behave in the same manner as a device in which the conversion processing unit 12 and the CABAC processing unit 13 in FIG. 1 are connected in series.

Description of Embodiment by Device 30 in FIG. 2 In the device 10 shown in FIG. 1, every time the limit monitor 14 outputs a re-encoded signal, the conversion processing unit 12 sets a new encoding parameter again. The target macroblock must be encoded, and it may be repeated that the counter of the limit monitor 14 exceeds the threshold again due to the data obtained by the reset parameters. For this reason, the encoding process must be continuously applied to a single macroblock a plurality of times, and accordingly, the encoding time for one picture is increased.

  Therefore, as another embodiment of the image encoding apparatus according to the present invention, an example in which encoding in which different encoding parameters are applied to a target macroblock is performed in parallel is shown in FIG. 2 as a second embodiment.

  In the apparatus 30 in FIG. 2, as in the apparatus 10 in FIG. 1, an image signal to be encoded is input, and an encoded bit stream is output. The apparatus 30 in FIG. 2 includes an input buffer 31, macroblock processing units 32-1 to 32-N that enable N stages of parallel encoding processing using N different encoding parameters, and an output buffer 33- 1 to 33-N, a restriction monitor / route selector 34 and a switch 35.

  In the apparatus 30 of FIG. 2, N different encoding parameters are set for a macroblock to be encoded, and encoding processing using the respective encoding parameters is performed by the macroblock processing units 32-1 to 32-N. The outputs are stored in parallel in the output buffers 33-1 to 33-N.

  The limit monitoring / path selector 34 has two input / output data counters (bit counters 36) for the CABAC encoders corresponding to the macroblock processing units 32-1 to 32-N, and is included in N parallel paths. From this, the counter selects the coding path that does not exceed the threshold and has the best coding efficiency, and selects the system to be output by the switch 35.

  Other detailed operations in the apparatus 30 of FIG. 2 and variations such as a coding unit are the same as those of the apparatus 10 of FIG.

  This apparatus 30 can limit the upper limit of the amount of data input to and output from the CABAC encoder at the time of encoding, so that the required encoding processing time can be satisfied. It is also possible to output a bitstream that can be decoded in the requested processing time.

3. Description of Embodiment by Apparatus 40 in FIG. 3 Next, FIG. 3 shows another embodiment of the image coding apparatus according to the present invention. In this embodiment, in addition to the embodiment of FIG. 1, there is a path for encoding uncompressed encoded data, that is, RAW data that is not compressed with respect to the input macroblock as it is.

  3 differs from the apparatus 10 of FIG. 1 in that the macroblock image data is input not only to the macroblock processing unit 41 but also to the uncompressed encoding unit 43. In the non-compression encoding unit 43, data that is not subjected to any conversion processing and entropy encoding for input image information, that is, RAW data is output to the output buffer B44. The limit monitor / route selector 47 monitors the input / output data amount of the CABAC encoder by the bit counter 49 in the same manner as the behavior of the limit monitor 14 in FIG. When the value exceeds a preset threshold value, the switch 46 selects and outputs the input from the output buffer B44. On the contrary, if the threshold value is not exceeded, it is possible to select either the output of the output buffer A42 or the output buffer B44.

  Here, when the restriction monitoring / route selector 45 selects the output buffer B44, that is, RAW data, this is also notified to the Context calculator in the macroblock processing unit 41, and the Context value in the Context calculator Is restored to the state immediately before processing the macroblock processed as the RAW data, using the value of Context immediately before processing the macroblock stored in the Context memory group.

  Note that, as a method of restoring the Context when the macroblock is processed as RAW data, it is possible to restore to a predetermined initial state.

  Here, in order to indicate whether or not the macroblock is encoded as RAW data, the data for that purpose is embedded in the header information of the output bitstream.

  When the RAW data is encoded, the CABAC encoding unit performs CABAC termination processing before outputting the RAW data to the bit stream.

  The non-compression encoder 45 can be replaced with various compression devices such as a DPCM encoding device as well as an uncompression processing device that outputs RAW data.

  Other detailed operations in the apparatus 40 of FIG. 3 and variations such as a coding unit are the same as those of the apparatus 10 of FIG.

  This apparatus 40 can limit the upper limit of the amount of data input to and output from the CABAC encoder at the time of encoding, so that the requested encoding processing time can be satisfied. It is also possible to output a bitstream that can be decoded in the requested processing time.

4. Description of Embodiment by Apparatus 50 in FIG. 4 Next, FIG. 4 shows an apparatus 50 which is another embodiment of the image encoding apparatus according to the present invention. In this embodiment, in addition to the apparatus 30 of FIG. 2, there is a path for encoding uncompressed encoded data, that is, RAW data that is not compressed, as it is for the input macroblock.

  The operation of the common part of the apparatus of FIG. 4 to that of the apparatus of FIG. 2 is almost the same as that of the apparatus of FIG. 1, so that only the differences are specifically shown, the macroblock image data is the macroblock processing unit 51-1. Is input not only to ˜51-N but also to the uncompressed encoding unit 58. The non-compression encoding unit 58 outputs the input image information to the output buffer B 59 as data that does not undergo any conversion processing and entropy encoding, that is, RAW data. The limit monitor / route selector 53 monitors the bit counter 55 in the same manner as the behavior of the limit monitor / route selector 34 in FIG. ) Exceeds a preset threshold value, the signal selector 54 selects and outputs the input from the output buffer B59. On the contrary, when the threshold value is not exceeded, it is possible to select either output of the output buffers A 52-1 to 52 -N and the output buffer B 59.

  When the RAW data from the output buffer B59 is selected by the signal selection unit 54, the Context state of the Context calculation unit in the macroblock processing units 51-1 to 51-N is stored in the Context memory group. It is restored to the state of Context immediately before processing the macroblock. In this restoration, it is also possible to restore to a predetermined initial value as described in the apparatus 10 of FIG.

Conversely, when the signal selection unit 54 selects the output buffer A52-i, which is one of the output buffers A52-1 to 52-N, instead of the RAW data from the output buffer, the macroblock processing unit 51 The Context state of the -i Context calculation unit is copied to the Context calculation units in the other macroblock processing units 51-1 to 51-N. This is because the Context states of all Context operation units must be the same when starting the encoding of the subsequent macroblock.
Incidentally, the non-compression encoding unit 58 can be replaced with various compression devices such as a DPCM encoding device as well as an uncompression processing device that outputs RAW data.

  Other detailed operations in the apparatus 50 of FIG. 4 and variations such as encoding units are the same as those of the apparatus 10 of FIG.

  This apparatus 50 can limit the upper limit of the amount of data input to and output from the CABAC encoder at the time of encoding, so that the requested encoding processing time can be satisfied. It is also possible to output a bitstream that can be decoded in the requested processing time.

FIG. 5 shows an apparatus 60 that applies CAVLC instead of CABAC as the lossless encoding unit 106 of FIG. This apparatus 60 is obtained by replacing the CABAC processing unit 13 of the apparatus 10 in FIG. 1 with a CAVLC processor 63. Since the CAVLC processor 63 and the limit monitor 64 behave in the same manner, the CAVLC processor 63 is used here. Only the operation of the limit monitor 64 will be described.

  The CAVLC processor 63 receives header information and quantized coefficient information as symbol data, and applies variable-length coding using a variable-length table similar to conventional MPEG2 and outputs the bit data. The Here, the CAVLC processor 63 is composed of the CAVLC encoder and the Context storage unit described with reference to FIG. 104 of the prior art. Like the conventional storage unit, the information already encoded by the CAVLC encoder, for example, In addition to storing the number of non-zero coefficients in each block in the already processed block as well as the block being processed and the value of the coefficient encoded immediately before, the CAVLC processor 63 in the present invention The state of the Context immediately before encoding the macroblock can be saved so that the state immediately before encoding the macroblock can be restored when the re-encoded signal comes. The CAVLC encoder can switch the variable length code table applied to the symbol based on the information from the Context storage. Note that the initial state of the context used at the time of resetting is also saved in the context saver.

  The limit monitor 64 has one counter (bit counter 75) for the number of bit data output from the CAVLC processor 63, and increments this counter by one each time bit data is output from the CAVLC processor 63. Let This counter is reset to 0 when processing at the head of the macroblock is started. Thereby, the number of output data from the CAVLC processor 63 in each macro block can be counted.

  In the limit monitor 64, when the counter 75 exceeds a preset threshold value, a signal indicating that the encoded data is invalid (hereinafter, re-encoded signal) is output to the output buffer 65 and the parameter. Output to the setting device 66. Receiving this re-encoded signal, the parameter setting unit 66 sets the encoding parameter again so as not to exceed the threshold again, and re-encodes the macro block data to be encoded. Further, the output buffer 65 that has received the re-encoded signal deletes all bit data of the encoding target macroblock stored therein, and waits for the input of the macroblock data encoded with the new encoding parameter.

  Other detailed operations in the device 60 of FIG. 5 and variations such as a coding unit are the same as those of the device 10 of FIG.

  This apparatus 60 can limit the upper limit of the amount of data output from the CAVLC encoder in one macroblock process, so that the required processing time for one macroblock can be satisfied. . It is also possible to output a bitstream that can be decoded in the requested processing time.

  In addition to the apparatus shown in FIG. 1, it is possible to replace the CABAC processing unit with a CAVLC processing unit for the apparatuses shown in FIGS. 2 to 4, and the behavior is the same as that of the embodiment shown here. And However, when a macroblock is encoded as RAW data, the CAVLC processor cannot have the Context of the macroblock, so for such a case, how to update the Context when the RAW data is encoded. Must be defined. Any method can be used as long as the encoding device and the decoding device are synchronized. For example, the number of non-zero coefficients existing in a block in a macroblock encoded as RAW data is assumed to be 15. The apparatus can limit the upper limit of the amount of data output from the CAVLC encoder at the time of encoding, so that the requested encoding processing time can be satisfied. It is also possible to output a bitstream that can be decoded in the requested processing time.

6. Description of Embodiment by Apparatus 80 in FIG. 6 Next, an apparatus 80 which is an image information decoding apparatus in the present invention corresponding to the apparatus in FIGS. 1 and 2, since there is no uncompressed encoding section and its path, the path to the uncompressed decoding section 88 is not selected in the apparatus 80 of FIG. If this is clear, the uncompressed decoding unit 88 and its path can be omitted.

  6 receives a bit stream to be decoded and outputs a decoded image signal. The apparatus 80 shown in FIG. 6 includes path selectors A 81 and B 85, an encoding method determination unit 84, an inverse conversion processing unit 83, a CABAC processing unit 82, a restriction monitor 86, and an uncompressed decoder 88.

  First, at the beginning of processing each macroblock, the route selectors A 81 and B 85 select the route of the CABAC processing unit 82. When the CABAC processing unit 82 decodes a macroblock from the input bitstream, first, a symbol indicating whether or not the macroblock is RAW data embedded in the bitstream is decoded. When the determination unit 84 determines that the data is RAW data, the path selectors A81 and B85 select the path of the uncompressed decoding unit 88 and output the output from the uncompressed decoding unit 88 as an image signal. Like. Here, the uncompressed decoding unit 88 performs fixed-length decoding and acquires image data. When this uncompressed encoding unit 88 is selected, the Context state in the Context operation unit 92 of the CABAC processing unit 82 may not be changed, and may be initialized with a predetermined value. However, it may be changed by using other laws, and it is only necessary to be synchronized with the behavior of the CABAC processing unit on the encoding device side. At this time, a predictor used for decoding a macroblock decoded later in the same picture is set to a predetermined value. For example, the motion vector of an uncompressed macroblock is set to 0, and the macroblock type is set as “intra coding”. As long as the value of the predictor is synchronized with the encoder side, any value may be set.

  On the other hand, when the encoding method determination unit 84 selects that the macroblock data is to be processed by the CABAC processing unit 82, the input bit stream is continuously input to the CABAC processing unit 82.

In the CABAC processing unit 82, header information and quantized coefficient information are decoded and output as symbol data from the input bitstream. Specifically, the input bit stream is entropy-decoded by the CABAC decoder 90 based on the Context information from the Context calculator 92, and the binary symbol sequence output therefrom is converted by the inverse binarization unit 91. Convert to symbol data. The Context calculator 92 updates the Context based on the binary data input to the inverse binarization unit 91 and the symbol data output from the inverse binarization unit 91, and outputs the Context information to the CABAC decoding unit 90. To do. The operation of the CABAC processing unit 88 is the same as the JVT described in “Prior Art”.
It shall conform to the description in FCD Section 9.2.

  The inverse transform processing unit 83 decodes and outputs an image signal by performing inverse quantization, inverse DCT, and motion compensation on the input header information and quantized coefficient information.

  The limit monitor 86 has a counter for the number of bit data input to the CABAC decoder 90 and a counter (bit counter 93) for the number of binary data output to the CABAC decoder 90. Each time data is input, the former counter is incremented by one, and each time binary data is output from the CABAC decoder 90, the latter counter is incremented by one. Each of these counters is reset to 0 when processing of the head of the macroblock is started. This makes it possible to count the number of input data and output data in the CABAC decoder 90 in each macroblock.

  The limit monitoring unit 86 executes error processing when one of these counters exceeds a preset threshold value. As an error process, it is possible to stop the decoding process, wait for the next slice header or picture header, start the decoding process again, or simply issue a warning and continue the decoding process. It is. It is also possible to continue the decoding process without performing error processing.

  This device 80 can monitor the amount of data input to and output from the CABAC decoder 90 at the time of decoding. Therefore, even if a data amount exceeding this upper limit is input / output, the requested decoding is performed. Error processing or the like can be performed so as to satisfy the conversion processing time.

  Further, as a mounting method, the restriction monitoring unit 86 is not necessarily mounted in the device 80. In that case, the amount of data input / output in the CABAC encoder 90 is not monitored.

  In the apparatus 80, the embodiment of the image information decoding apparatus according to the present invention when CABAC is applied as entropy decoding has been described. However, as already shown in the embodiment of the image encoding apparatus, this CABAC processing unit Can be replaced with a CAVLC processing unit, and the mounting method is almost similar in a one-to-one manner as described in the embodiment of the encoding apparatus. As in the case of the encoding apparatus, a method of updating the CAVLC Context when a macroblock is encoded with RAW data is defined in advance.

Description of Embodiments of Bitstream According to the Present Invention Next, embodiments of the encoded bitstream according to the present invention will be described. As described in the above description, in the present invention, it is possible to encode data compressed in a bit stream or RAW data. Therefore, in the bit stream of the present invention, in the macroblock header, header information that explicitly indicates whether or not the macroblock is encoded as RAW data is added, and the RAW data, Alternatively, either the compressed bit data is continued. Here, in order to explicitly indicate whether it is encoded as RAW data or not, it is specified by macroblock type which is one of macroblock header information. In other words, the bitstream in the present invention can mix different encoding methods in units of macroblocks.

  In addition, here, a case has been shown in which information specifying the encoding method of the macroblock is incorporated as header information of the macroblock. However, if this specification information is incorporated into a slice header or a picture header, the unit of the information is specified. It is possible to mix and specify encoding methods.

  Here, in the bit stream in the present invention, when this header information (for example, macroblock type) is encoded by CABAC, and then RAW data (that is, a fixed-length bit string) is encoded, the RAW data is encoded. Before conversion, a CABAC terminated bit is inserted.

In addition, when the bit stream in the present invention is encoded by CABAC, as described in the previous embodiments, either the CABAC encoder or the input / output bit counter of the decoder is used. It is composed of data that does not exceed a preset threshold. In addition, when encoded by CAVLC, the bit counter of the output of the CAVLC encoder and the input of the decoder is composed of data that does not exceed a preset threshold value.
For these reasons, the bit stream in the present invention makes it possible to guarantee a certain decoding processing time for the image information encoder and the image information decoder.

  10, 30, 40, 50, 60, 80 ... Device, 11, 61 ... Input buffer, 12, 62 ... Conversion processing unit, 13 ... CABAC processing unit, 29, 32, 41, 51 ... Macro block Processing unit, 63... CAVLC processor.

Claims (2)

In a decoding device for decoding a bitstream including uncompressed data,
Decoding means for performing arithmetic decoding using context on the bitstream;
If the block that is the unit for the encoding process is a block of uncompressed data, the context value immediately before performing the arithmetic encoding process using the context for the block of uncompressed data is retained, and the context is Control means for controlling the decoding means so as to perform termination processing of the used arithmetic decoding process;
A decoding device comprising: In a decoding method for decoding a bitstream including uncompressed data,
A decoding step for performing an arithmetic decoding process using context on the bitstream;
If the block that is the unit for the encoding process is a block of uncompressed data, the context value immediately before performing the arithmetic encoding process using the context for the block of uncompressed data is retained, and the context is A control step for controlling the decoding process in the decoding step so as to perform a termination process of the used arithmetic decoding process;
A decoding method including:

Images