TWI577191B - Filtering of blocks coded in the pulse code modulation mode - Google Patents

Description

Filtering technique for blocks coded in pulse code modulation mode Field of invention

The invention relates to filtering of images. More specifically, the present invention relates to deblocking filtering and to PCM encoded samples for its application.

Background of the invention

At present, most standardized video coding algorithms are based on hybrid video coding technology. Hybrid video coding methods typically combine several different lossless compression and lossy compression schemes to achieve the desired compression gain. Hybrid video coding is also an ITU-T standard (H.26x standards such as H.261, H.263) and ISP/IEC standards (MPEG-X standards such as MPEG-1, MPEG-2, and MPEG-4). The latest and highest-order video coding standards are currently marked with the H.264/MPEG-4 Advanced Video Coding (AVC) standard, which is the Joint Video Group (JVT), the ITU-T Group and the ISO/IEC MPEG Group. The results of the standardization efforts of the joint group. This codec was further developed by the Joint Coordination Group for Video Coding (JCT-VC) under the name of High Efficiency Video Coding (HEVC), especially for improving the efficiency of high resolution video coding.

The video signal input to an encoder is a series of images called frames, and each frame is a two-dimensional pixel matrix. All of the foregoing criteria are based on hybrid video coding, including subdividing individual video frames into smaller blocks of multiple pixels. The block size can vary, for example, depending on the content of the image. The encoding method typically varies with each block reference. The largest possible size of such a block is, for example, HEVC is 64x64 pixels. As the largest code Unit (LCU). In H.264/MPEG-4 AVC, a macroblock (usually labeled as a block of 16x16 pixels) is a basic image element, which is encoded and possibly further partitioned into smaller sub-blocks. / decoding step.

Typically, the encoding step of the hybrid video encoding includes spatial and/or temporal prediction. Accordingly, each block to be encoded first uses its spatially adjacent block or temporally adjacent block, i.e., from a previously encoded video frame. Then calculate a difference block between the block to be coded and its prediction, which is also called a prediction residual block. Another encoding step transforms a residual block from a spatial (pixel) domain to a frequency domain. This transformation is aimed at reducing the correlation of the input blocks. The further encoding step is the quantization of the transform coefficients. In this step, actual lossy (irreversible) compression is performed. Typically, the compressed transform coefficient values are further reduced (encrypted lossless) using entropy coding. In addition, the side information required for the reconstructed video signal is encoded and provided along with the encoded video signal. The side information is, for example, information about spatial and/or temporal prediction, quantized amount, and the like.

1 is an example of a typical H.264/MPEG-4 AVC and/or HEVC video encoder 100. The subtracter 105 first determines one of the input blocks of the input video image (input signal s) to be encoded and a corresponding prediction block. The difference e, which is used as a prediction for the current block to be encoded. The predicted signal can be obtained by temporal prediction or spatial prediction 180. The predictive type can be changed on a per-frame basis or on a per block basis. The block and/or frame predicted by the time prediction is used as the "inter" prediction, and the block and/or frame predicted by the spatial prediction is referred to as the "inner" prediction. The predicted signal using the time prediction is derived from the previously encoded image stored in the memory. The predicted signal using spatial prediction is derived from the boundary pixel values of adjacent blocks, which have previously been encoded, decoded, and stored in memory. The difference e between the input signal and the predicted signal, labeled as the prediction error or residual, is transformed 110, causing the coefficients to be quantized 120. The entropy encoder 190 then applies the quantized coefficients to further reduce the amount of data to be stored and/or transmitted in a lossless manner. This is primarily achieved by applying a code of one of the codeword groups of variable length, wherein the length of a codeword group is selected based on its probability of occurrence.

Inside the video encoder 100, a decoding unit is coupled to obtain a decoded (reconstructed) video signal s'. Following the encoding step, the decoding step includes dequantization and inverse transform 130. The prediction error signal e' thus obtained is different from the original prediction error signal due to the quantization error, and is also referred to as quantization noise. Then by adding the prediction error signal e' to 140 to the prediction signal Obtain a reconstructed image signal s'. In order to maintain compatibility between the encoder side and the decoder side, the prediction signal It is obtained based on the encoded and then decoded video signal, which is known at both the encoder and the decoder.

Due to the quantization, the quantization noise is superimposed on the reconstructed video signal. Due to block-by-block coding, stacked noise often has block characteristics, especially for strong quantization, which often results in visible block boundaries that are affected by decoding. Such block artifacts have negative images of human visual senses. To reduce such artifacts, deblocking filtering 150 is applied to each reconstructed image block. The deblocking filtering is applied to the reconstruction signal s'. For example, the deblocking filtering of H.264/MPEG-4 AVC has local adaptability. In the case of high block noise, a strong (narrowband) low pass filter is applied, while in the case of low block noise, a weaker (wideband) low pass filter is applied. The strength of the low-pass filter is predicted by the signal And determined by the quantized prediction error signal e'. Deblocking filtering typically smoothes the edge of the block, resulting in improved subjective quality of the decoded image. In addition, because the filtering portion of the image is used for motion compensated prediction of additional images, filtering also reduces prediction errors, thus permitting improved coding efficiency.

After solution block filtering, sample adaptive offset 155 and/or adaptive loop filter 160 may be applied to the image containing the resolved block signal s". Deblocking filtering improves subjective quality, sample adaptive offset (SAO) and adaptive loop filtering (ALF) are aimed at improving the fidelity of one pixel by pixel ("objective" quality). More specifically, the SAO adds an offset value based on the immediate vicinity of a pixel. Adaptive Loop Filter (ALF) is used to compensate for image distortion caused by compression. Typically, the adaptive loop filtering is a Wiener filter, and the filter coefficients are determined such that the mean squared difference (MSE) between the reconstructed s' and the source image s is minimized. The ALF coefficients can be calculated and transmitted on a frame-by-frame basis. The ALF can be applied to the entire frame (image of the video sequence) or to the area (block). An additional side information that can be transmitted (block-based, frame-based, or quad-tree based) indicating which areas are to be filtered.

For decoding, the inter-coded block also requires the storage of previously encoded and subsequently decoded partial images in the reference frame buffer 170. A-coded block is predicted 180 by using motion compensated prediction. First, a best matching block is found for the current block inside the previously encoded and decoded video frame by a motion estimator. The best matching block then becomes a prediction signal, and then the relative displacement (movement) between the current block and its best matching block is in the form of a three-dimensional motion vector, along with the side provided by the encoded video material. Information is internally sent as mobile data. The 3D system contains two spatial dimensions and one temporal dimension. To optimize prediction accuracy, spatial sub-pixel resolution, such as half-pixel or quarter-pixel resolution, can be used to determine the motion vector. A motion vector having spatial sub-pixel resolution may point to a spatial location within a decoding frame where no actual pixel values are available, i.e., sub-pixel locations. As such, spatial interpolation of such pixel values is required to perform motion compensated prediction. This can be achieved by interpolation filtering (integrated within prediction block 180 in Figure 1).

For both, ie, intra-coded and inter-coded modes, the difference e between the input signal and the predicted signal is transformed 110 and quantized 120, resulting in a quantized coefficient. In general, orthogonal transforms, such as two-dimensional discrete cosine transform (DCT), are used in their integer versions because they effectively reduce the correlation of natural video images. After the conversion, the low-frequency components are usually more important to the image quality than the high-frequency components, so the bits used in the encoding low-frequency components are more high-frequency components. In an entropy coder, a two-dimensional matrix of quantized coefficients is converted into a one-dimensional array. Typically, such conversion is performed by a so-called zigzag scan that begins with the DC coefficients of the upper left corner of the two-dimensional array and scans the two-dimensional array in a predetermined order, ending at the DC coefficient in the lower right corner. Since the energy is typically concentrated in the upper left portion of the two-dimensional matrix of coefficients, corresponding to lower frequencies, the zigzag scan results in an array whose normal end value is zero. Such permission is effectively encoded using the run length code before the actual entropy coding is part of / before.

H.264/MPEG-4 H.264/MPEG-4 AVC and HEVC include two functional layers, the Video Coding Layer (VCL) and the Network Abstraction Layer (NAL). The VCL provides a short description of the square coding function as described above. NAL is based on its further Applications such as transmission through channels or storage in storage devices encapsulate information elements into standardized units called NAL units. The information element is, for example, other information required to encode the prediction error signal or the video signal, such as prediction type, quantization parameter, motion vector, and the like. The VCL NAL unit contains compressed video data and related information, as well as additional information for non-VCL units, such as a parameter set associated with the entire video sequence, or Supplemental Enhancement Information (SEI) that provides additional information to improve decoding performance.

2 illustrates an example of a decoder 200 in accordance with the H.264/MPEG-4 AVC or HEVC video coding standard. The encoded video signal (the input signal of the decoder) is first input to an entropy decoder 290 that decodes the quantized coefficients, decodes data elements such as moving data, prediction modes, and the like. The quantized coefficients are inversely scanned to obtain a two-dimensional matrix and then fed to inverse quantization and inverse transform 230. After the inverse quantization and inverse transform 230, the decoded (quantized) prediction error signal e' is obtained, and the difference obtained by subtracting the prediction signal from the signal of the input encoder is obtained corresponding to the case where no quantization noise is introduced and no error occurs. .

The predicted signal is derived from time or space prediction 280. Decoding the information element typically further includes information needed for prediction, such as prediction types in the case of intra-prediction, and mobile data in the case of motion compensated prediction. The quantized prediction error signal in the spatial domain is then added to the prediction signal resulting from motion compensated prediction or intra-frame prediction 280 using adder 240. The reconstructed image s' may be subjected to deblocking filtering 250, sample adaptive offset processing 255, and adaptive loop filtering 260, and the resulting decoded signal is stored in memory 270 for application to the following blocks/images or Spatial prediction.

When compressing and decompressing an image, the block artifact is typically paired The most annoying artifact of the user. The deblocking filter assists in improving the user's sensory experience by smoothing the edges between the blocks in the reconstructed image. One of the difficulties in deblocking filtering is to correctly determine the edge caused by tiling by applying the quantizer and the edge belonging to a portion of the encoded signal. Deblock filtering is only required when the edge of the block boundary is caused by compression artifacts. In other cases, by applying deblocking filtering, reconstructing the signal can be disappointing and distorted. Another difficulty is the selection of appropriate filters for deblocking filtering. Typically, decisions are made between several low pass filters with different frequency responses resulting in strong or weak low pass filtering. In order to decide whether to apply deblocking filtering and to select an appropriate filter, consider image data near the boundaries of the two blocks.

For example, H.264/MPEG-4 AVC evaluates the absolute value of the first derivative (derivative) of each of the two adjacent blocks, and its boundary will be solved. Furthermore, the first derivative across the edge between the two blocks is evaluated, for example as described in section H.264/MPEG-4 AVC Standard Section 8.7.2.2. HEVC uses a similar mechanism, but only uses the second derivative.

The deblocking filter can decide whether to filter and which filter or filter type to use for each sample at the block boundary. When it is decided that filtering is to be applied, then a low pass filter is applied to smooth across the block boundaries. The purpose of deciding whether to filter is to filter only the samples, as described in the Background of the Invention section above, applying the quantized results one by one to cause significant signal changes at the block boundaries. The result of the deblocking filtering is signal smoothing at the block boundary. The smoothing signal is less annoying to the viewer than the block artifact. There are large sample changes at the block boundaries that belong to the original signal to be encoded, which should not be filtered to maintain high frequencies and thus maintain a sharp vision. In the wrong decision In this case, the image is unnecessarily smoothed or maintained in a block shape. The deblocking filtering is performed across the vertical edge of the block (horizontal filtering) and across the horizontal edge of the block (vertical filtering).

Figure 4A illustrates the decision on a vertical boundary (to use horizontal deblocking filtering or no filtering), and Figure 4B illustrates the decision on a horizontal boundary (to use vertical deblocking filtering or no filtering). More specifically, FIG. 4A shows a current block 440 to be decoded and its decoded neighbor blocks 410, 420, and 430. A decision is made for pixel 460 in a row. Similarly, Figure 4B shows the same current block 440 and the decision of pixel 470 in a column.

Determining whether to apply the deblocking filter can be performed as follows. A row of six pixels 460 is set. The first three pixels p2, p1, and p0 belong to the left neighboring block A 430, and the last three pixels q0, q1, and q2 belong to the current block B 440, as illustrated in FIG. 4 .

Line 1410 of Figure 14 illustrates the boundary between blocks A and B. The pixels p0 and q0 are pixels of the left adjacent block A and the current block B which are directly adjacent to each other. The pixels p0 and q0 are subjected to block filtering filtering when the following conditions are satisfied: | p ₀ - q ₀ | < α _{H 264} ( QP _New ), | p ₁ - p ₀ | < β _{H 264} ( QP _New ), And | q ₁ - q ₀ | < β _{H 264} ( QP _New ), where usually β _{H 264} ( QP _New ) < α _{H 264} ( QP _New ). These conditions are for detecting whether the difference between p0 and q0 is based on block artifacts. It corresponds to the evaluation of the first derivative within and between each of blocks A and B. In addition to the above three conditions, if the following conditions are also satisfied, the pixel p1 is filtered: | p ₂ - p ₀ | < β _{H 264} ( QP _New ). In addition to the first three conditions described above, if the following conditions are also satisfied Condition, pixel q1 is filtered: | q ₂ - q ₀ | < β _{H 264} ( QP _New ).

These conditions respectively correspond to the first derivation inside the first block and the second derivation inside the second block. In the above condition, QP represents a quantization parameter indicating the amount of quantization applied, and β and α are scale constants. More specifically, QP _{New is} based on the quantization parameters QP _A and QP _B applied to the individual first and second blocks A and B, as follows: QP _New = ( QP _A + QP _B +1) >>1, where ">>1" means shifting one bit to the right.

The decision can be performed on only selected rows of a block, and the filtering of the pixels is performed on all rows 460. An example 520 involving a HEVC-compliant decision line 530 is illustrated in FIG. Based on row 530, a decision is made whether to filter the entire block.

Another example of deblocking filtering in HEVC can be found in JTC-VC, ITU-T SG16 WP3, and JCTVC-E603 document section 8.6.1 of ISO/IEC JTC1/SC29/WG11, available free of charge from http://hpenix. Int-evry.fr/jct/index.php/.

Two rows 1430 are used to determine if and how to apply deblocking filtering. Example 1420 assumes that the third (with index 2) and sixth (with index 5) rows are evaluated for horizontal block filtering. More specifically, the second derivative inside each block is evaluated, resulting in the obtained metrics d ₂ and d ₅ as follows: d ₂ =| p 2 ₂ -2. p 1 ₂ + p 0 ₂ |+| q 2 ₂ -2. q 1 ₂ + q 0 ₂ |, d ₅ =| p 2 ₅ -2. p 1 ₅ + p 0 ₅ |+| q 2 ₅ -2. q 1 ₅ + q 0 ₅ |.

The pixel p belongs to the block A and the pixel q belongs to the block B. The first digit after p or q indicates that the column index and then the subscript number indicate the number of columns inside the block. All eight rows of solution blocks illustrated for example 520 are permitted when the following conditions are met: d = d ₂ + d ₅ < β ( QP _Frame ).

If the above conditions are not satisfied, the solution block is not applied. In the case where the solution block is enabled, the filter to be used for solving the block is determined. This decision is based on the evaluation of the first derivative between blocks A and B. More specifically, for each row i, where i is an integer from 0 to 7, it is decided whether to apply a strong or weak low pass filter. Strong filtering is used if the following conditions are met.

| p 3 _i - p 0 _i |+| q 3 _i - q 0 _i |<( β ( QP _Frame )>>3)^

d <( β ( QP _Frame )>>2)^

| p 0 _i - q 0 _i |<(( t _c ( QP _Frame ).5+1)>>1).

Conform to the HEVC model, "Strong filtering" using _{p 3 i, p 2 i,} p 1 i, p 0 i, q 0 i, q 1 i, q 2 i, q 3 i and filtered samples p 2 _i, p 1 _i , p 0 _i , q 0 _i , q 1 _i , q 2 _i , and "weak filtering" filters the sample p using p 2 _i , p 1 _i , p 0 _i , q 0 _i , q 1 _i , q 2 _i 1 _i , p 0 _i , q 0 _i , q 1 _i . In the above case, the parameters β and t _c are all functions of the quantization parameter QP _Frame that can be set for the image cut slice or the like. The values of β and t _{c are} typically derived based on the QP _Frame using an interrogation table.

Note that strong filtering is only beneficial for extremely flat signals. Otherwise, a fairly weak low pass filtering is advantageous.

A pixel system involving strong low-pass filtering is illustrated in FIG. 6A in accordance with conventional hybrid coding. More specifically, Figure 6A shows samples for filtering. These samples correspond to the individual four adjacent pixels to the left and right of the boundary between blocks A and B. These samples are used for filtering to represent their value input filtering process. Figure 6A further shows samples modified by filtering. These are the three adjacent individual pixel values that are closest to the boundary between blocks A and B on their right and left. This value is modified by a filter, that is, smoothed. To be more precise, hereinafter, include having the index i, q1 sample values _{p0 'i, p1' i,} p2 'i, q0' i 'i and q2' _i of that has been modified.

p 0 ' _i = Clip (( p 2 _i +2. p 1 _i +2. p 0 _i +2. q 0 _i + q 2 _i +4)>>3)

p 1 ' _i = Clip (( p 2 _i + p 1 _i + p 0 _i + q 0 _i +2)>>2)

p 2 ' _i = Clip ((2. p 3 _i +3. p 2 _i + p 1 _i + p 0 _i + q 0 _i +4)>>3)

q 0 ' _i = Clip (( q 2 _i +2. q 1 _i +2. q 0 _i +2. p 0 _i + p 2 _i +4)>>3)

q 1 ' _i = Clip (( q 2 _i + q 1 _i + q 0 _i + p 0 _i +2)>>2)

q 2 ' _i = Clip ((2. q 3 _i +3. q 2 _i + q 1 _i + q 0 _i + p 0 _i +4)>>3) The function Clip ( x ) is defined as follows: Thereby, max_allowed_value is the maximum value that x can have. In the case of PCM coding with k-bit samples, the maximum value will be max_allowed_value = 2 ^k -1. For example, in the case of PCM encoding with 8-bit samples, the maximum value will be max_allowed_value=255. In the case of PCM encoding with a 10-bit sample, the maximum value will be max_allowed_value=1023.

The strong filtering process to be applied is thus described in the above equation. It can be seen from the above equation that the pixels p3 _i and q3 _i of the column i are used in the equation, that is, used for filtering, but they are unmodified, that is, unfiltered.

Figure 16B illustrates the application of weakly solved block filtering. More specifically, the sample for filtering is shown on the left and the sample modified by the filter is shown on the right. For weak filtering operations, only two adjacent pixels on the boundary between blocks A and B are filtered, and three adjacent pixels on the edges of blocks A and B are used. Make a second decision for weak filtering. The first decision is whether or not to apply a weak filter to a particular row. This decision is based on the delta value and is calculated as follows △ = (9. ( q 0 _i - p 0 _i ) - 3. ( q 1 _i - p 1 _i ) + 8) >> 4 based on the calculated △, if |△|<10. t _c applies filtering. Otherwise, the filter is not applied to the bit at the boundary between the two blocks A and B pixels p0 _'i and q0' _i.

If filtering is to be applied, the following is performed: p 0 ' _i = Clip ( p 0 _i +Δ ₁ )

q 0 ' _i = Clip ( q 0 _i - Δ ₁ ) where Δ ₁ = Clip 3 (- t _c , t _c , Δ).

The function Clip ( x ) is defined as above. The function Clip 3( x ) is defined as follows:

When administered decided filter and the pixel p0 _'i and p0' _i filtering has elapsed, a further decision pixel p1 _'i and p1' _i whether to be filtered.

Only if d _p <( β /6) pixel p1' _i is filtered, and correspondingly, only d _p <( β /6) pixel q1' _i is filtered. The filtering of these pixels is performed as follows p 1 ' _i = Clip ( p 1 _i + Δ _{2 p} )

q 1 ' _i = Clip ( q 1 _i + Δ _{2 q} ) has Δ _{2 p} = Clip 3(- t _{c 2} , t _{c 2} ,((( p 2 _i + p 0 _i +1)>>1)- p 1 _i +Δ ₁ )>>1) and t _{c 2} = t _c >>1 and Δ _{2 q} = Clip 3(- t _{c 2} , t _{c 2} ,((( q 2 _i + q 0 _i +1) )>>1)- q 1 _i -Δ ₁ )>>1).

In addition to predictive coding, blocks can also be encoded without applying any prediction. The corresponding coding mode is called "Pulse Code Modulation (PCM) Mode". Samples encoded in PCM mode may contain, but do not necessarily contain, quantized noise. According to the submission JCTVC-E192 "Prompt for Enhanced PCM Coding in HEVC", a switch is used in the HEVC encoder and decoder for switching between the enabling and disabling of the filtering of the PCM encoded samples. Accordingly, all of the filters in the loop are switched on or off. The switching mechanism is advantageous because it allows the filtering to be turned off without quantization noise. In this case, filtering can degrade the quality of the noise-free filtered image. On the other hand, if the PCM samples include quantization noise, the filtering can be advantageously performed.

Summary of invention

Block artifacts interfere with the sensory quality of the image when the PCM-encoding region without noise is adjacent to the area predicted by non-PCM encoding but by temporal or spatial prediction. On the other hand, in this case, filtering may reduce the quality of the PCM coded area without noise.

In the case where the prior art has such problems, an efficient deblocking filtering method is advantageously proposed, which can also be applied to the case where the PCM samples are surrounded by samples encoded by predictive coding.

The specific method of the present invention is to permit solution block filtering and Another filtering of the PCM coding block is separate and possibly individual enabling/disabling.

According to one aspect of the present invention, a method for using a pulse code modulation (PCM) coded into an image of a video signal to become a one-bit stream is proposed, the method comprising: determining a solution region Whether block filtering is to be applied to the sample block; determining whether a second filter different from the deblocking filter is to be applied to the sample block; including a deblocking filter indicator in the bit stream, indicating Determining whether a result of a deblocking filter is to be applied; and including, in the bitstream, a second filtering indication different from the deblocking filtering indicator, indicating whether a second filtering result is to be applied.

According to another aspect of the present invention, a method for decoding an identical block of a video signal from a bit stream is provided, the sample block being encoded by a pulse code modulation (PCM), the method comprising Extracting a deblocking block filter indicator from the bit stream, indicating whether a deblocking block filter is to be applied to the sample block; extracting a second filter separate from the deblocking block filter indicator from the bit stream An indicator indicating whether a second filtering is to be applied to the sample block; applying or not applying deblocking filtering to the sample block according to the extracted deblocking filtering indicator; and according to the extracted second filtering indicator, A second filter is applied or not applied to the sample block.

According to still another aspect of the present invention, a device for using a pulse code modulation (PCM) encoded in an image of a video signal to become a one-bit stream is provided, the device comprising: a solution The block determining unit is configured to determine whether a deblocking filter is to be applied to the sample block; a second determining unit is configured to determine that a second filtering different from the deblocking filtering is Whether to be applied to the sample block; and an embedding unit for including a deblocking filter indicator in the bit stream, indicating whether a result of determining a deblocking filter is to be applied; and the bit string The stream includes a second filtering indication that is different from the deblocking filter indicator, indicating a result of determining whether a second filtering is to be applied.

According to still another aspect of the present invention, a device for decoding an identical block of a video signal from a bit stream is provided, the sample block being encoded by a pulse code modulation (PCM). The method includes: an extracting unit configured to extract a deblocking filter indicator from the bit stream, indicating whether a deblocking filter is to be applied to the sample block; and extracting from the bit stream and the solution area a second filtering indicator separated by the block filtering indicator, indicating whether a second filtering is to be applied to the sample block; a deblocking filtering unit configured to apply or according to the extracted deblocking filtering indicator, No deblocking filtering is applied to the sample block; and a second filtering unit is configured to apply or not apply the second filtering to the sample block according to the extracted second filtering indicator.

100‧‧‧Video Encoder

105‧‧‧Subtractor

110‧‧‧Transformation

120‧‧‧Quantification

130, 230‧‧‧ inverse transformation

140, 240‧‧ ‧ adder

150, 250‧‧ ‧ solution block filtering

155, 255‧‧‧ sample adaptive offset

160, 260‧‧‧ Adaptive loop filtering

170‧‧‧Reference frame buffer

180, 280‧‧ forecast

190‧‧ Entropy encoder

200‧‧‧Decoder

290‧‧‧ Entropy decoder

410, 420, 430‧‧‧ Decoded adjacent blocks

440, 1010‧‧‧ current block

460, 470, p0-2, q0-2‧‧ ‧ pixels

500, 600, 700, 900‧‧ ‧ video encoder

510, 560, 610, 710, 760‧‧‧ bit deep extension unit, bit depth increase unit

530, 630, 730, 930 ‧ ‧ buffer

550, 750 ‧ ‧ bit depth reduction unit

570, 670, 770, 970, 981-983‧‧ ‧ switch

595, 695, 795, 995‧‧‧ multiplexers

740‧‧‧Solution block filter unit

745‧‧‧Adaptive loop filtering (ALF), second filtering unit

801, 802, 1010, 1020‧‧‧ blocks

1210-1290, 1310-1360, 1610-1680‧‧ steps

Ex100‧‧‧content providing system

Ex101‧‧‧Internet

Ex102‧‧‧Internet Service Provider

Ex103‧‧‧Streaming server

Ex104‧‧‧Phone network

Ex106-110‧‧‧ Platform

Ex111‧‧‧ computer

Ex112‧‧‧ Personal Digital Assistant (PDA)

Ex113, ex116‧‧‧ camera

Ex114‧‧‧Cell phone

Ex115‧‧‧game machine

Ex117‧‧‧ microphone

Ex200‧‧‧Digital Broadcasting System

Ex201‧‧‧Broadcasting station

Ex202‧‧‧ satellite

Ex203‧‧‧ cable

Ex204-5, ex350‧‧‧ antenna

Ex210‧‧‧car

Ex211‧‧‧Car navigation system

Ex215-6‧‧‧record media

Ex217‧‧‧Set-top box

Ex218‧‧‧Reader/recorder

Ex219‧‧‧ monitor

Ex220‧‧‧Remote control

Ex230‧‧‧Information track

Ex231‧‧‧record block

Ex232‧‧‧ inner circumference area

Ex233‧‧‧data record area

Ex234‧‧‧ outer circumferential area

Ex235‧‧‧ video streaming

Ex236, ex239, ex242, ex245‧‧‧PES packets

Ex237, ex240, ex243, ex246‧‧‧TS packets

Ex238‧‧‧ audio streaming

Ex241‧‧‧ indicates type graphic streaming

Ex244‧‧‧ interactive graphics streaming

Ex247‧‧‧Multi-work data

Ex300‧‧‧TV

Ex301‧‧‧Tuner

Ex302, ex352‧‧‧ modulation/demodulation unit

Ex303, ex353‧‧‧Multiplex/Demultiplexing unit

Ex304, ex354‧‧‧ audio signal processing unit

Ex305, ex355‧‧‧ video signal processing unit

Ex306‧‧‧Signal Processing Unit

Ex307‧‧‧Speaker

Ex308, ex358‧‧‧ display unit

Ex309‧‧‧output unit

Ex310‧‧‧Control unit

Ex311‧‧‧Power supply circuit unit

Ex312‧‧‧Operation input unit

Ex313‧‧‧bridge

Ex314, ex364‧‧‧ slot unit

Ex315‧‧‧ drive

Ex316‧‧‧data machine

Ex317‧‧‧Interface unit

Ex318-321, ex404, ex508‧‧‧ buffer

Ex351‧‧‧Send and receive unit

Ex356‧‧‧ audio input unit

Ex357‧‧‧ audio output unit

Ex359‧‧‧LCD control unit

Ex360‧‧‧Main control unit

Ex361, ex505‧‧‧Power supply circuit unit

Ex362‧‧‧Operation Input Control Unit

Ex363‧‧‧ camera interface unit

Ex365‧‧‧ camera unit

Ex366‧‧‧Operation key unit

Ex367‧‧‧ memory unit

Ex370‧‧‧Synchronous bus

Ex400‧‧‧Information Reproduction/Recording Unit

Ex401‧‧‧ optical head

Ex402‧‧‧ modulated recording unit

Ex403‧‧‧Regeneration demodulation unit

Ex405‧‧‧ disc motor

Ex406‧‧‧Servo Control Unit

Ex407‧‧‧System Control Unit

Ex500‧‧‧large integrated circuit (LSI)

Ex501‧‧‧Control unit

Ex502‧‧‧Central Processing Unit (CPU)

Ex503‧‧‧ memory controller

Ex504‧‧‧Streaming controller

Ex506‧‧‧Streaming IO

Ex507‧‧‧Signal Processing Unit

Ex509‧‧‧AV IO

Ex510‧‧‧ busbar

Ex511‧‧‧ memory

Ex512‧‧‧Drive frequency control unit

Ex800, ex900‧‧‧ configuration

Ex801-2‧‧‧Decoding processing unit

Ex803‧‧‧Drive frequency switching unit

Ex901-2, ex1001-2‧‧‧ Dedicated decoding processing unit

Ex1000‧‧‧Processing part sharing examples

Ex1003‧‧‧Decoding processing unit

Yy1-4‧‧‧ arrow

The accompanying drawings are incorporated in and constitute a The drawings, together with the detailed description, are used to explain the principles of the invention. The drawings are only for the purpose of illustrating the preferred embodiments of the invention and the embodiments of the invention, and are not intended to limit the invention. Further features and advantages will be more apparent from the following detailed description of the various embodiments of the invention. Symbols refer to like elements and figures: Figure 1 is a block diagram illustrating an example of a video encoder.

2 is a block diagram illustrating an example of a video decoder.

3 is a block diagram illustrating an example of a video encoder with separate vertical and horizontal filtering.

4A is a schematic illustration of the application of horizontal deblocking filtering.

Figure 4B is a schematic illustration of the application of vertical deblocking filtering.

5 is a block diagram illustrating an encoder including a PCM encoding mode with bit depth reduction; FIG. 6 is a block diagram illustrating an encoder including a PCM encoding mode with no bit depth reduction; FIG. 7 is a block diagram illustrating one The encoder includes a switch to switch the filtered PCM coding mode; FIG. 8 is a schematic diagram illustrating an example of filtering of the enable/disable PCM coding block and the non-PCM coding block; FIG. 9 is a block diagram illustrating the present invention. One embodiment has an individual switching on/off one encoder of different filters; FIG. 10A is a schematic diagram illustrating a region that can be modified by deblocking block filtering; FIG. 10B is a schematic illustration illustrating that filtering can be performed by non-depletable block filtering Switched on/off sample adaptive offset application for modified regions; FIG. 10C is a schematic illustration of switched on/off adaptive loop filtering (ALF) applications for regions that can be modified by non-depletable block filtering; FIG. The schematic diagram illustrates an example of PCM encoded and non-PCM encoded adjacent blocks and their characteristic quantization parameters; 12 is a flow chart illustrating an example of using a deblocking filter encoding method according to an embodiment of the present invention; FIG. 13 is a flowchart illustrating an example of using a deblocking filter decoding method according to an embodiment of the present invention. 1 is an example; FIG. 14 is a schematic diagram illustrating deblocking filtering according to the prior art; FIG. 15A is a schematic diagram illustrating samples used by deblocking filtering and a sample of borrowed block filtering modification; FIG. 15B is a schematic illustration Samples used by deblocking filtering and samples modified by decomposed block filtering; FIG. 16A is an example of a decoding method for decoding and filtering of PCM encoded samples; FIG. 16B is a flowchart illustrating an area An example of an encoding method for PCM encoding and filtering of block samples; Figure 17 shows a general configuration of a content providing system for embodying content distribution services.

Figure 18 shows the overall configuration of a digital broadcast system.

Fig. 19 shows a block diagram illustrating an example of configuration of a television.

Figure 20 is a block diagram showing an example of configuration of an information reproducing/recording unit for reading and writing information from and to a recording medium which is a compact disc.

Figure 21 shows an example of a recording medium which is a configuration of one of the optical discs.

Figure 22A shows an example of a cell phone.

Fig. 22B is a block diagram showing an example of the configuration of a cell phone.

Figure 23 illustrates one of the structures of the multiplexed data.

Figure 24 is a schematic illustration of how the various streams are multiplexed in the multiplexed data.

Figure 25 shows in further detail a stream of video streams stored in a stream of PES packets.

Figure 26 shows the structure of one of the TS packet and the source packet in the multiplexed data.

Figure 27 shows the data structure of one of the PMTs.

Figure 28 shows the internal structure of one of the multiplexed data information.

Figure 29 shows the internal structure of one of the stream attribute information.

Figure 30 shows the steps of identifying video material.

FIG. 31 shows a configuration example of an integrated circuit for embodying a moving image encoding method and a moving image decoding method according to various embodiments.

Figure 32 shows one configuration for driving inter-frequency switching.

Figure 33 shows the steps for identifying video information and switching between drive frequencies.

Figure 34 shows an example of an interrogation table in which the video data standard is coupled to the drive frequency.

Figure 35A is a schematic diagram showing a configuration example for sharing a module of a signal processing unit.

Figure 35B is a schematic diagram showing another configuration example for sharing a module of a signal processing unit.

Detailed description of the preferred embodiment

The present invention is based on the observation that in some cases, turning on or off all filters at once may degrade subjective image quality. More specific In other words, the application of deblocking filtering may be advantageous in situations where the application of adaptive loop filtering and/or sample adaptive shifting may be superior.

In particular, deblocking filtering may be advantageous when the PCM coding block is adjacent to a block coded by another method. In this case, the deblocking filter smoothes the signal in the boundary region of the two blocks, thus improving the subjective quality, even when a number of noises are introduced into the PCM coded block. However, the quality of the PCM coding block may be degraded in regions where the block is not subjected to deblock filtering and instead is applied adaptive loop filtering and/or sample adaptive offset. Adaptive loop filtering and sample adaptive offset can introduce additional noise and/or artifacts.

In accordance with the present invention, the application of the deblocking filtering to the PCM encoded samples is controlled individually and separately from the control of other filtering applications. Thus, the present invention further reduces undesired quantization noise and can result in further improvements in image quality.

The encoder 500 illustrated in Figure 5 is substantially corresponding to Figures 1 and 3. Further, the introduction of the PCM coding mode is shown, for example, in the projection JCTVC-D0044 "Hypo code modulation mode of HEVC". More specifically, the bit depth extension 510 can be applied to the original video signal with a higher precision for the encoding operation. If the video signal is to be encoded by the PCM encoding mode, the bit depth is again reduced by 550, and the signal is directly output to the multiplexer 595 for inclusion in the bit stream. Switch 570 is switched between PCM coding mode input or prediction and transform coding. Therefore, the PCM coded samples will pass through the deblocking filter ("deblock" in Figure 5) and other loop filters ("ALF" in Figure 5). Buffer 530 is for further use as a reference sample.

Fig. 6 exemplifies another embodiment of the PCM encoding mode in accordance with JCTVC-E057 "Pulse code modulation mode of HEVC". More specifically, after the bit depth is increased 610, the PCM samples are provided directly to multiplexer 695 for inclusion in the encoded bit stream. Switch 670 switches between PCM coding mode samples or predictive/transform coding mode samples. The PCM coded samples or the predictive/transformed coded samples are subjected to deblocking filtering and adaptive loop filtering, and sample adaptive offset filtering is also possible. The filtered sample may then be stored in buffer 630 for further use as a reference sample.

Applying filtering, such as deblocking filtering, adaptive loop filtering, or sample adaptive offset, may result in additional noise being introduced into the image signal if the PCM sample does not contain any quantization errors. Therefore, the JCTVC-E192 projecting prompt switches the switch filter.

Figure 7 illustrates one possible embodiment of a switch that supports an PCM encoding mode and switching filtering in accordance with an HEVC encoder. More specifically, the original video signal is input unit 710 to increase the bit depth. If the encoding mode is the PCM encoding mode, then in the bit depth reducing unit 750, the PCM samples are reduced to a predetermined bit depth. At the same time, the predetermined bit depth is transmitted within the bit stream. The parameter PCM_sample_bit_depth_xxx_minus8, where "xxx" can indicate a luminance or chroma sample ("luma", "chroma"), controls the bit depth of the resulting PCM sample, and then provides it to the multiplexer 795 to include (embed) in the bit string flow. In order to use the buffer samples as reference samples for further use by predictive coding, the bit depth of the PCM coded samples is increased by 760. Through the switch 770, the PCM samples are then input to the deblocking filtering unit 740 and the The second filtering unit 745 (in this case, the adaptive loop filtering unit) is finally stored in the buffer 730. According to the injection JCTVC-E192, a switch for switching on or switching off loop filtering such as deblocking filter 740 and its type loop filter 745 is set. The switch value (on/off) is then included in the bit stream and sent to the decoder to permit similar operations between the decoder and the encoder. The switching (by indicator control, which can be a flag) is illustrated in Figure 7. More specifically, the parameter PCM_sample_loop_filter_disable_flag is signaled within the SPS NAL unit to enable or disable both adaptive loop filtering 745 and deblocking filtering 740.

The purpose of intra-loop filtering, ie, deblocking filtering and adaptive loop filtering, is to correct for distortion associated with lossy compression. However, when the original uncompressed samples are encoded using the PCM coding mode, the samples are undistorted. Therefore, the in-loop filtering must be conceptually disabled, as shown in Figure 7. On the other hand, some encoders embody non-original (reconstructed) samples that can be encoded as PCM samples. In such cases, these PCM samples may indeed include quantization noise. As a result, performing in-loop filtering may be useful because the resulting image quality can be improved. Therefore, the JCTVC-E192 permits switching in the switching loop. However, such a switch may not be sufficient to avoid degradation in quality caused by application or no application of filtering.

Figure 8 illustrates two blocks 801 and 802, where block 801 is encoded by the PCM coding mode and includes the original video samples, labeled I_PCM. Block 802 includes prediction samples that are encoded using intra prediction or inter prediction, labeled as non-I_PCM samples. The samples p ₂ , p ₁ , p ₀ , q ₀ , q _{1 ,} and q ₂ are boundary pixels of the boundary between the block 801 and the block 802 of one of the rows indicated by the 8x6 grid in FIG. When the proposal JCTVC-E192 is applied to this case, the adaptive loop filtering and the deblocking filtering of the block 801 are all de-energized. This means that the pixels p ₀ , p ₁ and p _{2 are} not filtered. Conversely, for block 802, both adaptive loop filtering and deblocking filtering can be enabled. In this case, the block boundary may become visible and contain block artifacts after decoding because the block 801 portion is not smoothed. Note that deblocking filtering and adaptive loop filtering are described in the above example. However, the same applies to the sample adaptive offset, which can be done before or after the adaptive loop filtering, or even without adaptive loop filtering.

In order to overcome the problem of reduced quality, the present invention enables or deblocks the block filtering by enabling and/or enabling other filters such as adaptive loop filtering or sample adaptive offset to be individually and separately signaled.

In accordance with an advantageous embodiment of the present invention, the application of each of the noise reduction filters is individually controlled for the PCM coded blocks. This can be embodied by a flag for each individual noise reduction filter encoding and transmission that indicates the application of the filter to the PCM coded block. In the case of three filters, as shown in Figures 1 and 3 for deblocking filtering, SAO, and adaptive loop filtering, three individual flags can be used.

However, the present invention is not limited thereto, one flag may be used to control deblocking filtering, and the other flag may be used to commonly control remaining filtering, such as adaptive loop filtering and sample adaptive offset.

9 illustrates an example of a video encoder 900 that includes individual switches 981, 982, and 983 for turning individual adaptive loop filtering, sample adaptive offset, and deblocking filtering on or off. Switch position can be encoded as an individual flag The label is transmitted within the bit stream such that the decoder is controlled to perform filtering in the same manner as the encoder.

More preferably, the application of the individual PCM coding block filters is separately controlled for the samples that can be modified by the deblocking filter and the samples that are not deblocked by the block filtering. Such control may be achieved by providing an additional indicator (flag) that is encoded and transmitted within the bit stream along with the encoded image data. By carefully controlling the samples that can be modified by the block filter and the unmodifiable samples, a more detailed adjustment of the filtering is achieved. More specifically, in the case where deblocking filtering is not applied to the PCM encoded samples, adaptive loop filtering or sample adaptive offset may introduce additional noise to the samples. In summary, the deblocking filter is applied to the image signal to improve the subjective quality at the block boundary. Sample adaptive offset and adaptive loop filtering can more advantageously improve objective image quality when deblock filtering is applied.

In addition, for PCM coding blocks, adaptive loop filtering and sample adaptive offset can also be switched on or off based on the result of the deblocking filtering decision. More specifically, if the solution block introduces noise, the noise can be reduced by subsequent application of adaptive loop filtering and/or sample adaptive offset. If it is decided not to apply deblocking filtering, no noise is introduced, so adaptive loop filtering and/or sample adaptive offset will introduce additional noise. In this case, it is preferred to turn off these additional filtering.

10A, 10B and 10C illustrate an example in accordance with the present embodiment. More specifically, it is determined separately for a current block 1010 whether demapping filtering will be applied to its pixels, and whether another filtering will be applied to this block. Samples modified for borrowed block filtering and for other samples (not borrowed Block filtering modification) individually determines whether subsequent filtering should be applied. The flag is then separated to indicate the application of the filter to the modified and unmodified block samples.

FIG. 10A shows the current block 1010 and a block 1020 adjacent to the left side of the current block. In this example, it is assumed that the individual three pixels closest to the boundary between the two blocks can be modified by the deblocking filter. The dashed rectangle in FIG. 10A illustrates a sample modified by borrowing block filtering in adjacent blocks 1010 and 1020 and a sample modified without deblocking block filtering. Let the current block 1010 be a PCM code block without any quantization noise. Block block 1020, on the other hand, is a PCM coded block containing quantization noise. In this example, the block is a coding unit with 16x16 samples. A different flag ("flag 1") indicates whether the tiling filter is applied to the current block 1010 or not. If deblock filtering is applied, only samples near the block boundary are modified (the sample can be modified). Note that only the horizontal deblocking filter area is shown in FIG. However, the present invention is not limited to this, and is equally applicable to vertical filtering across horizontal block boundaries.

FIG. 10B illustrates the same blocks 1010 and 1020 in which a sample adaptive offset is applied to an adjacent block 1020, such as to all 8x8 samples. In the present embodiment, the sample adaptive offset is applied to the current block 1010, which is determined individually for the borrowed block filtered modified samples and the samples that are not modified by the deblocking filter. Correspondingly, the two-character stream ("flag 2a" and "flag 2b" of FIG. 10B) may be included in the bit stream to indicate whether the sample adaptive offset will be applied to the decodable block filter. Whether the modified region and sample adaptive offset will be applied to the region where the non-depletable block filter is modified.

Figure 10C illustrates the same blocks 1010 and 1020, and adaptability The loop filtering is applied to the demultiplexed block filtered modified samples and the non-depleted block filtered modified samples. Similar to the case of applying SAO, the two flags ("flag 3a", "flag 3b" of Figure 10B) may be included in the bit stream to separately and individually indicate whether adaptive loop filtering is applied to the borrowing zone The region modified by the block filter and the region modified by the non-depleted block filter.

In accordance with the present invention, filtering of PCM coding blocks can be separately controlled for different filter types such as deblocking filtering, sample adaptive offset, and adaptive loop filtering. The order of application of such filters is not critical to the invention and can be arbitrarily selected. The indicator can be a binary flag and can have a value of 0 or 1, indicating whether filtering is applied individually. These flags can be inserted into different locations of the bit stream. Excellently, the flag can be inserted into the cut piece header and applied to all of the blocks included in the cut piece. However, the present invention is not limited thereto, and the indicator can be inserted through a packet containing SPS, PPS, or APS. For a particular fine-tuning of the filter, the flag can be signaled based on each coding unit basis. An indicator (flag) indicates a switch position that may be toggled on or off for a particular block sub-area. For example, after encoding the information in the PCM mode encoding block, the switch position can be directly encoded.

In order to improve the reconstruction quality of the video signal, if the quantization error of the neighboring block is regarded as high, the boundary between the PCM coded block and the adjacent block may be deblocked. This can be tested by using a predetermined threshold. For example, when the quantization parameter value of the neighboring block exceeds a predetermined threshold, the quantization error can be made high. Such a threshold may be fixed or adaptive, for example encoded within the bitstream along with the encoded data.

Alternatively or in addition to an indicator to enable or disable deblocking filtering, the quantization parameter value QP _PCM may be included in the encoded bit stream. Such PCM quantization parameter indicates the amount of quantization used to adjust the deblocking filtering of the PCM coded block. The PCM quantization parameter can be determined as the original video signal characteristics of the input PCM code. For example, the PCM quantization parameter may depend on the bit depth of the PCM samples.

In order to permit adaptive selection of deblocking filtering or other filtering, the QP _PCM can be determined at the encoder by quantization (because the encoder knows the original video signal). For example, different values of QP _PCM can be tested and the subjective video quality obtained can be assessed. Then take the value that results in the highest subjective quality as QP _PCM . Note that subjective quality can be tested by calculating subjective video quality metrics. Define a number of different metrics used to estimate subjective video quality estimates. In general, the invention is not limited to any particular measure.

In addition, QP _PCM can be estimated. At the encoder, the mean square error is measured for the PCM coded block. The equivalent quantization parameter is then estimated, and if the transform coding is used, the same mean square error will result. The equivalent QP _PCM thus obtained is then used.

However, the example of obtaining the parameter QP _PCM as above is not exclusive, and any parameter indicating that there is noise in the PCM coding block may be employed.

Figure 11 illustrates two neighboring blocks, one of which is encoded by a PCM coding mode and the other by a non-PCM coding mode, such as the intra- or inter-prediction mode described in the Background section of the invention. For non-PCM coded blocks, the quantization parameters are typically signaled and applied to transform prediction errors to permit lossy compression.

The PCM coding block is not quantized. Instead, the sample is assigned a predetermined number of bits, called the bit depth. However, the PCM encoded signal may originate from a video sequence that has been previously quantized and still contain quantized noise or other noise or artifacts. In accordance with one aspect of the present invention, the application of deblocking filtering to the PCM encoded samples is performed as a function of the quantization parameters of the "PCM Quantization Parameters" QP _PCM and non-PCM blocks. For example, the average quantization parameter QP _AVE can be calculated as follows: QP _Ave = ( QP _PCM + QP )>>1 where the operation ">>1" indicates shifting one bit to the right. The shift corresponds to being divisible by 2. The adjustment of the deblocking filter can be performed based on the calculated average quantization parameter QP _AVE . For example, it may be determined whether demapping filtering will be applied to the PCM coding block. It can be implemented by comparing the average quantization parameter with a predetermined threshold. This threshold can be a fixed threshold or an adaptive threshold for signaling in a video sequence. The threshold can be obtained by optimizing the application based on the test image or by optimizing based on the encoded image signal.

Additionally or alternatively, the deblocking filtering may be selected based on a function of the PCM quantization parameter and the quantization parameter of the neighboring block. More specifically, the intensity (frequency response, filter coefficient) of the applied deblocking filter can be selected. As for the alternative or as an additional selection criterion, it can be determined which sample (how many samples) at the boundary of the current block is to be filtered.

The PCM quantization parameter QP _PCM can be precoded using predictive coding. The prediction may be, for example, a truncated slice quantization parameter or a quantization parameter of a previously encoded block. QP _PCM coding can also be performed based on the bit depth of the PCM coded block, where the bit depth can be encoded and transmitted (embedded in the bit stream). The encoded PCM quantization parameter can be inserted into a slice header, an image, an image sequence, and the like. However, it is also possible to insert another parameter set, such as an Adaptive Parameter Set (APS) or PPS or SPS internal.

The PCM quantization parameter QP _PCM can also be derived based on the bit depth of the PCM coded block.

Figure 12 shows an example of an encoding method for encoding a block sample in a video signal image into a bit stream in accordance with an embodiment of the present invention. More specifically, the input block uses PCM code 1210. Therefore, each sample is represented by a PCM symbol. The PCM code is a binary code with a fixed bit length, such as 8 bits per sample. However, any other length may be used, such as 6, 7, 9, 10, etc. per sample. The PCM code can include a longer or shorter bit length of the original input image signal. If the input image signal is already at the desired bit depth, no further operations are required. The PCM coded block of the sample is then sent to decide whether to apply the filter.

More specifically, it is determined if 1220 deblocking filtering will be applied to the PCM coded block of the sample. If the decision 1220 is to apply deblock filtering ("YES" in step 1230), then the PCM block is deblocked 1240. When it is determined 1220 that no deblocking filtering will be applied ("NO" in step 1230), the block is not subject to block filtering filtering. Care must be taken to determine the characteristics of the vertical and horizontal adjacent blocks, which can be determined separately for vertical and horizontal filtering applications. After deciding and possibly applying the deblocking filter, it is determined 1250 whether a second filter different from the deblocking filtering is applied to the current block sample. If it is determined that the second filter will be applied ("YES" in step 1260), the second filter applies 1270 to the current block. Once it is determined that the second filter is not applied ("NO" in step 1260), the second type of filtering will not be applied. According to decisions 1220 and 1250, the second indicator is embedded in the bit stream. First, a deblocking filter indicator includes a 1280 bit stream to indicate whether a decision to filter the deblocking will be applied. Of course Thereafter, the second filter indicator includes a 1290 stream in the bit stream to indicate whether a second filter is to be applied.

The determining whether to apply the de-blocking to the PCM coding block of the sample may further comprise the step of determining whether a neighboring block of the sample block will be encoded using pulse code modulation or by predictive/transform coding. . When the neighboring block is precoded by predictive coding, it is determined that the deblocking filter will be applied to the block sample. Otherwise it is determined that no deblocking filtering will be applied. It is assumed here that the predictive coding system link can reduce the quantization of the adjacent block quality, that is, the quantization noise is introduced into the adjacent block. Therefore, the boundary of the adjacent block and the original PCM code block becomes more visible, resulting in block artifacts, which are preferably for the block.

Additionally or alternatively, determining whether to apply deblock filtering to the sample block is performed based on comparing a quantization error of the block adjacent to the sample block with a predetermined threshold.

Determining whether the second filtering is to be applied to the current block sample may include the steps of determining a quantized noise amount of the current block in the PCM encoding, and determining whether the second filtering is to be applied to the current based on the determined quantization noise amount. Block. The quantized noise of the PCM coded block can be estimated, for example, based on the bit depth of the PCM code used in the sample. Additionally or alternatively, quantization noise can be estimated based on prior knowledge of the input image signal. For example, the input image signal may be a signal reconstructed after being quantized in advance. Where the previous quantized amount is known, it can be used to decide whether to apply the second filter. However, the amount of quantization noise can also be estimated using any available estimation or optimization method.

The second filter can be adaptive loop filtering or sample adaptive bias One of the moves. But it can also filter for another type of noise suppression. In the case that the second filtering is adaptive loop filtering, the corresponding second filtering may be embedded in the bit stream. Furthermore, a third filtering, which may be a sample adaptive offset, may also be applied after the decision, and the corresponding third filtering may also be independent and separate from the indicators related to the application of the deblocking filtering and adaptive loop filtering. Included in the bit stream.

Additionally, the second filtered indicator can be a binary indicator that indicates whether ALF and SAO will be applied to the sample block. If the indicator has a value of 0, neither ALF nor SAO is administered. If the indicator has a value of 1, both SAO and ALF will be administered.

In accordance with an embodiment of the present invention, the step of determining whether the second filter is applied to the sample block further comprises the step of determining whether the second filter is applied to the sample block that can be modified by the deblockable block filter. Still further includes the step of determining whether the second filtering is applied to the sample blocks that are not deprecated by the block filtering modification. The corresponding indicator is included in the bit stream. More specifically, the modifiable sample indicator is included in the bit stream to indicate the result of determining whether the second filter is applied to the modified sample. Further, the undecorated sample indicator is included in the bit stream to indicate the result of determining whether the second filter is applied to the unmodifiable sample. This embodiment provides the advantage of spatially separating the samples modified by the deblocking block and the samples modified without the deblocking block filtering. More specifically, deblocking filtering is aimed at improving subjective image quality. However, the objective image quality may be deteriorated, that is, the pixel-by-pixel difference between the original signal and the filtered signal. In order to improve the objective quality of the deblocked samples, whether or not to apply further filtering to the sample is determined The decision to filter one-step to a sample that is not modified by the deblocking filter is separated.

The words "decorable" and/or "modified" in relation to the de-blocking block filter here indicate that the sample is close to the boundary between the blocks to which the solution block filtering can be applied. Typically, demapping filtering is applied only to 1, 2 or 3 samples that are closest to the boundary. Regardless of whether the deblocking filtering is actually applied to the "modifiable sample", an area may be formed in which the decision to enable/disable another filtering may be performed separately as previously described. Several further details of the decision and selection of deblocking filtering are known from the prior art as will be explained hereinafter. Note that the invention is not limited to separate indicators of the modifiable and non-decorable block samples. In addition, truly modified or unmodified samples can form separate regions that individually perform decisions.

The determination of whether the second filtering will be applied to the sample block may be performed based on whether the deblocking filtering will be applied to the sample block. Similarly, an indicator code indicating whether the second filter will be applied to the sample block may be performed with respect to an indicator indicating whether or not to apply deblocking filtering.

Figure 13 illustrates a method for decoding an identical block in a video signal image in accordance with one aspect of the present invention, wherein bit stream decoding from PCM encoded samples includes the steps of: extracting 1310 a region from the bit stream a block filtering indicator to indicate whether demapping filtering is to be applied to the sample block, and a (different) second filtering indicator separate from the bitstream filtering indicator 1320 is used to indicate Whether the second filter will be applied to the sample block. Deblock 1340 is applied when the deblocking filter indicator indicates that deblock filtering is to be applied ("YES" in step 1330). Then, when the second filter indicator indicates that deblock filtering is to be applied ("YES" in step 1350), A second filter 1360 is applied. If the individual indicator indicates that no individual filtering is applied, no filtering is applied.

Corresponding to the aforementioned encoder, the second filter indicator indicates whether both the adaptive loop filter and the sample adaptive offset will be applied to the sample block, or two different indicators are extracted from the bit stream, One indicates whether adaptive loop filtering will be applied to the sample block and the other indicates whether the sample adaptive offset will be applied to the sample block. Additionally or additionally, the modifiable sample indicator can be extracted and employed to indicate that the second filter is to be applied to the sample blocks that have been modified by the borrowed block filter, and/or the non-modifiable sample indicator can indicate the second The filtering will be applied to the sample blocks that have not been decomposed by the block filtering.

According to another aspect of the present invention, a method for decoding an original block in a video signal obtained from a first-class video signal is provided. The sample block is encoded by pulse code modulation (PCM), and the method includes: Bitstream stream extraction 1610 a PCM quantization parameter indicating the amount of noise in the sample block; selecting 1620 to apply the deblocking filter based on the extracted PCM quantization parameter; and applying 1640 the selected deblocking filter to the Sample block.

An example of a decoding method is shown in Figure 16A. More specifically, the "PCM Quantization Parameter" extracts 1610 from the bit stream. The deblocking filtering to be performed 1620 is then selected based on the extracted PCM quantization parameter (QP_PCM), which may include deciding whether to apply deblocking filtering. Thus, when deblocking filtering is to be applied ("YES" in step 1630), the block is filtered by the selected deblocking filter 1640, otherwise the block is unsolved.

Similarly, a video coding with pulse code modulation (PCM) is proposed. The sample block in the signal image becomes a one-bit stream method, the method includes: determining a 1650-PCM quantization parameter indicating the amount of noise in the sample block; selecting a solution to be applied by the 1660 based on the extracted PCM quantization parameter Block filtering; and applying 1670 selected deblocking filters to the sample block; and including 1680 the PCM quantization parameter to the bit stream. This point is illustrated by the flow chart of Figure 16B.

The step of deblocking filtering may be based on comparing a function of the PCM quantization parameter and the quantized amount (or quantization step size) applied to one of the neighboring sample blocks to a predetermined threshold. More specifically, it may be based on comparing one of the PCM quantization parameters and the quantization parameters associated with the neighboring block.

This function can be average. But it can also be another function, such as minimum, maximum, weighted average, and so on.

The step of selecting deblocking filtering may include the step of deciding whether to apply deblocking filtering to the sample block, this step may be performed on both of the encoder soup decoders in the same manner as the filtering selection.

Additionally or alternatively, the step of selecting deblocking filtering may include selecting a filter bandpass width (frequency response) and/or selecting a sample in the filtered block to apply.

The PCM quantization parameter may depend on the PCM encoded bit depth of the block sample. The PCM quantization parameters may be encoded using prediction, and/or based on the bit depth of the PCM encoded samples, and/or encoded by entropy coding. The PCM quantization parameter can be embedded in the image header, the image cut slice header, the relevant information of the sample block, and the bit stream in the additional information related to the plurality of video images.

According to another aspect of the present invention, a device for decoding a sample block in a video of a video signal from a one-bit stream is provided, the sample block being encoded by pulse code modulation (PCM), the device The method includes: an extracting unit extracting, from the bit stream, one of PCM quantization parameters indicating a noise amount in the sample block; and a filter selecting unit selecting a solution to be applied to the block based on the extracted PCM quantization parameter Block filtering; and a filtering unit applies the selected deblocking filter to the sample block.

According to one aspect of the present invention, a device for encoding a same block in a video signal image into a bit stream by pulse code modulation (PCM) is proposed, the device comprising: a parameter determining unit to determine a PCM Quantization parameters indicate the amount of noise in the sample block; a filter selection unit to select deblocking filtering to be applied to the block based on the extracted PCM quantization parameter; a filtering unit to apply the selected solution block Filtering to the sample block; and an embedding unit to include the PCM quantization parameter to the bit stream.

The filter selection unit can be configured to select deblocking filtering based on comparing quantization parameters associated with adjacent blocks by a function of the PCM quantization parameter. The filter selection unit can be configured to determine whether to apply deblock filtering to the sample block. Additionally or alternatively, the filter selection unit can be configured to select the strength of the filter and/or select the number of samples and sample locations in the block in which the filter is to be applied.

Note that the apparatus of the present invention may be modified by modifying a particular filtering unit (at the encoder's deblocking filtering unit 150 and the decoder's 250), and/or modifying the ALF and/or SAO filtering unit to permit it to be determined as previously described. , selection and filtering.

The parameter decision unit can be configured to determine the PCM quantization parameter as the value of the maximum subjective quality after deblocking filtering, or by estimating the PCM quantization parameter value as a quantization parameter, which will result in the same noise if the transform coding is applied.

As mentioned above, the decision and/or selection of the deblocking filtering can be performed in accordance with the PCM quantization parameters. In accordance with another embodiment of the present invention, the decision and selection of deblocking filtering may be similar to the case involving PCM coding blocks and the case involving only non-PCM coded blocks. More specifically, referring to Figure 15, there are basically three possibilities for adjacent blocks A and B, which may be advantageous for deblocking filtering:

- Block A is a non-PCM coded block and block B is also a non-PCM coded block. In this case, block A is characterized by its quantization parameter, i.e., the quantization parameter applied to encode block A (QP _A = QP(A)). Block B is also (QP _B = QP (B)).

Block A is a non-PCM coded block and block B is a PCM coded block (or vice versa). In this case, block A is characterized by its quantization parameter (QP _A = QP(A)). Block B is characterized by an "PCM Quantization Parameter" indicating an estimate of the amount of noise of Block B (QP _B = QP _PCM (B)).

- Block A and Block B are both PCM coded blocks. In this case, Block A and Block B are characterized by the estimated "PCM Quantization Parameters", indicating Block A (QP _A = QP _PCM (A)) and Block B (QP _B = QP). _The amount of noise in _PCM (B)).

The function of the quantization parameters of blocks A and B can then be used to resolve and/or select the block filtering. For example, the following functions of QP _A and QP _B can be embodied: QP _Ave = ( QP _A + QP _B +1) >> 1 or Or QP _Ave = Max ( QP _A , QP _B ).

However, these are merely examples and any other function may be applied.

Similar to Figure 14, it can first be decided whether to apply the filter to the entire block A and / or B. For example, if the following conditions are met, the block d = d _q + d _p < β ( QP _Ave ) can be enabled.

When block A and/or B enable deblocking, it may be further determined line by line whether to apply deblocking filtering to a particular row (column or column) of the block. It is decided to apply strong filtering when the following conditions are met | p 3 _i - p 0 _i |+| q 3 _i - q 0 _i |<( β ( QP _Ave )>>3)^

d <( β ( QP _Ave )>>2)^

| p 0 _i - q 0 _i |<(( t _c ( QP _Ave ).5+1)>>1).

Otherwise weak (or no) filtering will be applied to this particular row i.

Filtering is then performed as shown in the background section of the invention. The Δ value can also be calculated as shown above, that is, △=(9.( q 0 _i - p 0 _i )-3.( q 1 _i - p 1 _i )+8)>>4 then decides only when |△|<10. Filtered only when t _c ( QP _Ave ). Otherwise, deblocking filtering is not performed. When filtering (weak deblocking block filtering) is to be performed, the following value (Δ1) is calculated: Δ ₁ = Clip 3 (- t _c ( QP _Ave ), t _c ( QP _Ave ), Δ) and in the second block The closest boundary pixels of A and B are filtered as follows: p 0 ' _i = Clip ( p 0 _i - Δ ₁ ), q 0 ' _i = Clip ( q 0 _i - Δ ₁ ).

It is further determined whether or not to filter pixels that are close to the boundary. The pixel p1 is filtered when d _p <( β ( QP _Ave )/6), otherwise the block filter filtering is not borrowed. The pixel q1 is filtered when d _q <( β ( QP _Ave )/6), otherwise the block filtering is not borrowed. Then filter as follows: t _{c 2} ( QP _Ave )= t _c ( QP _Ave )>>1

Δ _{2 p} = Clip 3(- t _{c 2} ( QP _Ave ), t _{c 2} ( QP _Ave ), ((( p 2 _i + p 0 _i +1)>>1)- p 1 _i +Δ ₁ )>>1)

p 1 ' _i = Clip ( p 1 _i +Δ _{2 p} )

Δ _{2 q} = Clip 3(- t _{c 2} ( QP _Ave ), t _{c 2} ( QP _Ave ), ((( q 2 _i + q 0 _i +1)>>1)- q 1 _i -Δ ₁ )>>1)

q 1 ' _i = Clip ( q 1 _i +△ _{2 q} ).

The advantage of the foregoing method is that the filtering of the PCM coding block and the non-PCM coding block can be performed in the same manner, wherein the PCM quantization parameter is considered to represent the noise characteristic of the PCM coding block, and thus can be used as a non-PCM block in the same manner. Quantitative parameters.

Note that typically the PCM quantization parameter can also be considered as an indicator indicating whether demapping filtering will be applied to the sample block, since the PCM quantization parameter can also be used to determine whether the sample for the block/block is enabled/decomposed. Block filtering.

Each of the above examples is related to a block or a coding unit. However, as will be apparent to those skilled in the art, the present invention is also applicable to image areas of other forms (shapes, sizes) used in blocks or coding units of HEVC.

The method described in the respective embodiments can be separately embodied in a recording medium recording method (image encoding method) and moving image decoding method (image decoding method) embodied in the respective embodiments. Independent computer system. The recording medium can be any kind of recording medium, only It is necessary to record programs such as a magnetic disk, a compact disk, a magneto-optical disk, an IC card, and a semiconductor memory.

Hereinafter, a moving image encoding method (image encoding method) and a moving image decoding method (image decoding method) described in the respective embodiments and a system for using the same will be described. The system has image coding and decoding device features, including a video coding device using an image coding method and a video decoding device using a video decoding method. Depending on the case, other configurations of the system can be changed as appropriate.

(Example A)

Fig. 17 illustrates a general configuration of a content providing system ex100 for embodying a content distribution service. The area in which the communication service is provided is divided into cells having a desired size, and the stations ex106, ex107, ex108, ex109, and ex110 are fixed wireless stations located in each cell.

The content providing system ex100 is connected to the device through the Internet ex101, the Internet service provider ex102, the telephone network ex104, and the stations ex106 to ex110, respectively, such as a computer ex111, a personal digital assistant (PDA) ex112, and a camera ex113. , cell phone ex114 and game machine ex115.

However, the configuration of the content providing system ex100 is not limited to the configuration shown in Fig. 17, and the combination of any of the elements is acceptable. In addition, the respective devices may be directly connected to the telephone network ex104 instead of being connected via the stations ex106 to ex110 belonging to the fixed wireless station. In addition, the devices can be interconnected to each other through short-range wireless communication and others.

A camera ex113 such as a digital video camera can capture video. phase The machine ex116, such as a digital camera, can capture static phase and video. Again, the cell phone ex114 can be compliant with any standard, such as Global System for Mobile Communications (GSM)®, Coded Multi-Direct Access (CDMA), Wideband Coded Multi-Direct Access (W-CDMA), Long Term Evolution ( LTE), and High Speed Packet Access (HSPA) In addition, the cell phone ex114 can be a personal handy phone system (PHS).

In the content providing system ex100, the streaming server ex103 is connected to the camera ex113 and the other via the telephone network ex104 and the station ex109, and permits on-site display and other video distribution. In such a distribution, the content captured by the user using the camera ex113 (for example, the video of a live music concert) is encoded as described above in various embodiments (for example, the camera is used as a function of the image encoding device according to one aspect of the present invention). The content is transmitted to the streaming server ex103. On the other hand, when requested, the streaming server ex103 carries the stream of the transmitted content material to the client device. The client devices include a computer ex111, a personal digital assistant (PDA) ex112, a camera ex113, a cell phone ex114, and a gaming machine ex115, which can decode the aforementioned encoded material. Each device that has received the distributed data decodes and reproduces the encoded material (i.e., functions as a video decoding device oriented in accordance with one aspect of the present invention).

The captured data can be encoded by the camera ex113 or the streaming server ex103 that transmits the data, or the encoding process can be shared between the camera ex113 and the streaming server ex103. Similarly, the distributed data can be decoded by the client device or the streaming server ex103, or the decoding process can be shared between the client device and the streaming server ex103. Further, not only the still image and the video material captured by the camera ex113 and simultaneously by the camera ex116 can be transmitted to the streaming server ex103 via the computer ex111. The encoding program can be borrowed from camera ex116, computer ex111 or string The streaming server ex103 executes or shares between them.

Further, the codec process can be executed by a large integrated circuit (LSI) ex500 including the computer ex111 and the device. The LSI ex500 can be assembled from a single wafer or a plurality of chips. The software for codec video can be integrated into a type of recording medium (such as CD-ROM, flexible disc and hard disk) that can be read by computer ex111 and other. The codec process can be executed using software. In addition, when the cell phone ex114 is equipped with a camera, the video material obtained by the camera can be transmitted. The video material is data encoded by the LSI ex500 included in the cell phone ex114.

Further, the streaming server ex103 can be composed of a server and a computer, and can distribute data and process distributed data, records, or data.

As described above, the client can receive and reproduce the encoded material in the content providing system ex100. In other words, the client can receive and decode the information transmitted by the user, and reproduce the decoded data in real time in the content providing system ex100, so that the user without any specific rights and devices can embody the personal broadcast.

In addition to the example of the content providing system ex100, at least one of the moving image encoding method (image encoding method) and the moving image decoding method (image decoding method) described in the respective embodiments may exemplify the digital broadcasting system ex200 in FIG. Reflected in. More specifically, a broadcasting station ex201 transmits or transmits multiplexed data obtained by translating audio data and other multiplexed to video data to a broadcasting satellite ex202 through radio wave communication or transmission. The video material is the data encoded by the moving image encoding method described in the respective embodiments (that is, the data encoded by the image encoding device according to one aspect of the present invention). When receiving multiplexed data, the broadcast satellite ex202 transmits radio waves for broadcasting. Of course Thereafter, the home antenna ex204 having the satellite broadcast receiving function receives radio waves. Next, a device such as a television (receiver) ex300 and a set-top box (STB) ex217 decodes the received multiplexed data and reproduces the decoded data (ie, one of the inventions is used as a video decoding device). Features).

Further, the reader/writer ex218(i) reads and decodes the multiplexed material recorded on the recording medium ex215 such as DVD and DB, or (i) encodes the video material on the recording medium ex215, and in some cases Next, the data obtained by multiplexing the audio signal is written to the coded data. As shown in various embodiments, the reader/writer ex218 may include a moving image decoding device or a moving image encoding device. In this case, the reproduced video signal is displayed on the monitor ex219, and the video signal can be reproduced by another device or system using the recording medium ex215 on which the multiplexed data is recorded. It can also be embodied in a moving image encoding device connected to the cable ex203 for cable television or to the set-top box ex217 for satellite and/or terrestrial broadcast to the antenna ex204, thus displaying the video signal on the monitor ex219 of the television ex300. on. The moving image decoding device may be embodied in the set-top box but on the television set ex300.

Fig. 19 illustrates a television set (receiver) ex300 that uses the moving image encoding method and the moving image decoding method described in the respective embodiments. The television ex300 includes: a tuner ex301, which obtains or provides the obtained multiplexed data by multiplexing the audio data to the video data by receiving the broadcast antenna ex204 or the cable ex203, etc.; a modulation/demodulation unit Ex302, which demodulates the received multiplexed data or transforms the data into multiplexed data to be supplied to the outside; and a multiplexed/demultiplexed unit ex303, which demodulates the modulated multiplexed data Become a video material and audio material, or will be The video data and audio data encoded by a signal processing unit ex306 are multiplexed into data.

The television ex300 further includes: a signal processing unit ex306 comprising an audio signal processing unit ex304 and a video signal processing unit ex305 for respectively decoding the audio data and the video data and the encoded audio data and the video data (which is based on the present invention) And an output unit ex309 includes a speaker ex307 for providing a decoded audio signal, and a display unit ex308 for displaying the decoded video signal, such as a display. Further, the television ex300 includes an interface unit ex317 including an operation input unit ex312 that receives a user operation input. Further, the television ex300 includes a control unit ex310 that controls the entirety of the respective constituent elements of the television ex300, and a power supply circuit unit ex311 that supplies power to the respective components. In addition to operating the input unit ex312, the interface unit ex317 may include: a bridge ex313 coupled to an external device such as the reader/writer ex218; a slot unit ex314 for permitting the recording medium ex216 to be attached, such as an SD card; A driver ex315 connected to an external recording medium such as a hard disk and a data machine ex316 to be connected to one of the telephone networks. Here, the recording medium ex216 can use a non-electrical/electrical semiconductor memory element for storing electrical recording information. The components of the television ex300 are connected to each other through a synchronous bus.

First, the configuration will be explained in which the television ex300 will decode and reproduce decoded data through the antenna ex204 and other externally derived multiplexed data. In the television ex300, when the user operates through the remote controller ex220 and others, the multiplexing/demultiplexing unit ex303 is in the control unit ex310. Under the control, the multiplexed data demodulated by the modulation/demodulation unit ex302 is demultiplexed. Further, in the television ex300, using the decoding method of each embodiment, the audio signal processing unit ex304 decodes the demodulated audio data, and the video signal processing unit ex305 decodes the demodulated video data. The output unit ex309 separately supplies the decoded video signal and audio signal to the outside. When the output unit ex309 provides the video signal and the audio signal, the signal can be temporarily stored in the buffers ex318 and ex319 and others so that the signals can be reproduced in synchronization with each other. Further, the television ex300 can read the multiplexed material from the recording media ex215 and ex216, such as a magnetic disk, a compact disc, and an SD card, via broadcasting and the like. Next, a configuration will be explained in which the television ex300 encodes an audio signal and a video signal, and transmits the data to the outside or writes the data to the recording medium. In the television ex300, when the user operates through the remote controller ex220 and others, in each embodiment, under the control of the control unit ex310, the audio signal processing unit ex304 decodes the demodulated audio data, and the video signal processing. Unit ex305 decodes the demodulated video material. The multiplexer/demultiplexing unit ex303 multiplexes the encoded video signal and the audio signal, and provides the resultant signal to the outside. When the multiplex/demultiplexing unit ex303 multiplexes the encoded video signal and the audio signal, the signal can be temporarily stored in the buffers ex320 and ex321 and others so that the signals can be synchronized with each other. Here, as shown, the buffers ex318, ex319, ex320, and ex321 may be plural, or at least one buffer may be shared by the television ex300. In addition, the data can be stored in a buffer so that system overflow and undershoot can be avoided, for example, between the modulation/demodulation unit ex302 and the multiplex/demultiplexing unit ex303.

In addition, the television ex300 can include a configuration for receiving from An AV input from a microphone or camera, rather than the configuration for obtaining audio and video data from a broadcast or recording medium, and encoding the resulting data. Although in the description, the television ex300 can encode, multiplex, and provide external data, it may only receive, decode, and provide external data, rather than coding, multiplexing, and providing external data.

In addition, when the reader/recorder ex218 reads or writes the multiplexed material from or to a recording medium, one of the television ex300 and the reader/recorder ex218 can decode or encode the multiplexed data. The television ex300 and the reader/recorder ex218 can share decoding or encoding.

As an example, FIG. 20 illustrates the configuration of an information reproducing/recording unit ex400 when data is read or written from or to a compact disc. The information reproducing/recording unit ex400 includes constituent elements ex401, ex402, ex403, ex404, ex405, ex406, and ex407. The optical head ex401 irradiates a laser spot on the recording medium ex215, that is, a recording surface of the optical disk to write information, and detects reflected light from the recording main surface of the recording medium ex215 to read information. The modulation recording unit ex402 electrically drives the semiconductor laser included in the optical head ex401, and modulates the laser light in accordance with the recorded data. The reproduction demodulation unit ex403 amplifies a reproduction signal obtained by electrically detecting reflected light from the recording surface using a photodetector included in the optical head ex401, and separately recording a signal recorded on the recording medium ex215 Ingredients to regenerate the information you need. The buffer ex404 temporarily holds information to be recorded on the recording medium ex215 and information reproduced from the recording medium ex215. The disc motor ex405 rotates the recording medium ex215. The servo control unit ex406 moves the optical head ex401 to a predetermined information track while controlling the rotation of the disc motor ex405 Drive to track the laser point. The system control unit ex407 controls the overall information reproducing/recording unit ex400. The read and write process can be implemented by the system control unit ex407, using various information stored in the buffer ex404 and generating and adding new information as needed, and borrowing the variable recording unit ex402, the regenerative demodulation unit ex403, and the servo control unit. The ex406 records and reproduces information through the optical head ex401 while operating in a coordinated manner. The system control unit ex407 includes, for example, a microprocessor that performs processing by causing a computer to execute a read and write program.

Although the optical head ex401 is illustrated as irradiating a laser spot, high-density recording can be performed using near-field light.

Fig. 21 illustrates a recording medium ex215 which is a compact disc. On the recording surface of the recording medium ex215, a spiral guide groove is formed, and an information track ex230 records address information in advance according to the shape change of the guide groove, indicating the absolute position on the disc. The address information includes information for determining the address of the recording block ex231, which is a unit for recording data. The reproduction of the information track ex230 and the reading of the address information in a device for recording and reproducing data may result in the determination of the location of the recorded block. Further, the recording medium ex215 includes a data recording area ex233, an inner circumferential area ex232, and an outer circumferential area ex234. The data recording area ex233 is an area for recording user data. The inner circumferential area ex232 and the outer circumferential area ex234 are respectively the inner side and the outer side of the data recording area ex233, and are used for a specific purpose, except for recording user data. The information reproducing/recording unit ex400 reads and writes the encoded audio data, encodes the video data, or borrows the multiplexed data obtained by multiplexing the audio and video data from the data recording area ex233 of the recording medium ex215.

Although the description herein describes a disc with a layer such as a DVD and BD is taken as an example, but the optical disc is not limited thereto, and may be a disc having a plurality of layers, which can be recorded on a portion other than the surface. Further, the optical disc may have a multi-dimensional recording/reproduction structure such as recording information on the same portion of the optical disc using colored light having different wavelengths, and recording information having different layers from different angles.

Further, the car ex210 having one antenna ex205 can receive data from the satellite ex202 and others, and reproduce the video on the display device set in the car ex210, such as the car navigation system ex211, in the digital broadcasting system ex200. Here, the configuration of the car navigation system ex211 will be, for example, a GPS receiving unit derived from the configuration illustrated in FIG. This point is also true for the computer ex111, the cell phone ex114 and other configurations.

Fig. 22A illustrates a cell phone ex114 which uses the moving picture coding method and the moving picture decoding method described in the embodiment. The cell phone ex114 includes: an antenna ex350 for transmitting and receiving radio waves through the station ex110; a camera unit ex365 capable of capturing moving images and still images; and displaying information such as photographed by the camera unit ex365 or by One of the decoded video display units ex358 received by the antenna ex350, such as a liquid crystal display. The cell phone ex114 further includes: a main unit including an operation key unit ex366; an audio output unit ex357 such as a speaker for audio output; an audio input unit ex356, such as a microphone for audio input; and a memory unit ex367 For storing moving images or still images, recorded audio, encoded video data and decoded data, still images, emails, or the like; and a slot unit ex364, which is a memory unit ex367 One of the recording media for storing data in the same way unit.

Next, a configuration example of the cell phone ex114 will be described with reference to FIG. 22B. In the cell phone ex114, a main control unit ex360 is designed to control the overall unit of the main body, and the display unit ex358 and the operation key unit ex366 are connected to each other through a synchronous bus line ex370 to a power supply circuit unit ex361. An operation input control unit ex362, a video signal processing unit ex355, a camera interface unit ex363, a liquid crystal display (LCD) control unit ex359, a modulation/demodulation unit ex352, a multiplexing/demultiplexing unit ex353, An audio signal processing unit ex354, the slot unit ex364, and the memory unit ex367.

When a call end button or a power button is turned on by the user's operation, the power supply circuit unit ex361 supplies power to the individual unit from the battery pack, thereby causing the cell phone ex114 to become active.

In the cell phone ex114, the audio signal processing unit ex354 converts the audio signal collected by 356 in a voice conversion mode into a digital audio signal under the control of the main control unit ex360 including the CPU, the ROM, and the RAM. Then, the modulation/demodulation unit ex352 performs the spreading processing on the digital audio signal, and the transmitting and receiving unit ex351 performs the analog-to-digital conversion and frequency conversion on the data, and thus transmits the obtained data through the antenna ex350. Further, in the cell phone ex114, the transmitting and receiving unit ex351 amplifies the data received by the antenna ex350 in the voice conversion mode, and performs frequency conversion and analog-to-digital conversion on the data. Then, the modulation/demodulation unit ex352 performs the inverse spread processing on the data, and the audio signal processing unit ex354 converts the data into an analog audio signal, and thus is output through the audio output unit ex357.

Further, when the e-mail in the material communication mode is transmitted, the text data of the e-mail is input by operating the operation key unit ex366, and the other part of the main body is transmitted to the main control unit ex360 through the operation input control unit ex362. The main control unit ex360 causes the modulation/demodulation unit ex352 to perform the spread spectrum processing on the text data, and the transmission and reception unit ex351 performs the digital-to-analog conversion, and the resulting data is frequency-converted to transmit the data to the station ex110 via the antenna ex350. When an e-mail is received, processing that is approximately reversed from the processing of sending the e-mail is performed on the received material, and the resulting data is supplied to the display unit ex358.

When the video, still image, or video and audio system in the data communication mode is transmitted, the video signal processing unit ex355 compresses and encodes the video signal supplied from the camera unit ex365 using the moving image encoding method shown in each embodiment ( That is, according to one aspect of the present invention, it is directed to a video encoding device, and the encoded video data is transmitted to a multiplex/demultiplexing unit ex353. Conversely, when the camera unit ex365 captures video, still images, and the like, the audio signal processing unit ex354 encodes the audio signal collected by the audio input unit ex356, and transmits the encoded audio data to the multiplex/demultiplexing unit. Ex353.

The multiplexer/demultiplexing unit ex353 multiplexes the encoded video material supplied from the video signal processing unit ex355 and the encoded audio material supplied from the audio signal processing unit ex354 using a predetermined method. Then, the modulation/demodulation unit (modulation/demodulation circuit unit) ex352 performs the spread spectrum processing on the multiplexed data, and the transmitting and receiving unit ex351 performs digital-to-analog conversion and frequency conversion on the data to transmit through the antenna ex350. Information obtained.

When receiving a video file, it is linked to a web page and other data communication mode, or when receiving an email with video and/or audio attached, in order to decode the multiplexed data through the antenna ex350, multiplex The multiplex/demultiplexing unit ex353 multiplexes the multiplexed data into a video data bit stream and an audio data bit stream, and supplies the encoded video data to the video signal processing unit ex355 through the synchronous bus ex370 And supplying encoded audio data to the audio signal processing unit ex354. Using a moving image decoding method corresponding to the moving image encoding method shown in each embodiment, the video signal processing unit ex355 decodes the video signal (that is, the image decoding device according to one aspect of the present invention), and then, The video and still images included in the video file are linked to the web page via the LCD control unit ex359. Further, the audio signal processing unit ex354 decodes the audio signal, and the audio output unit ex357 provides the audio.

Further, similar to the television ex300, a terminal device such as the cell phone ex114 may have a three-type configuration that includes not only (i) both the transmitting and receiving terminal devices including the encoding device and the decoding device, but also includes (ii) only A transmitting terminal device of an encoding device and (iii) a receiving terminal device including only one decoding device. Although the description describes the digital broadcast system ex200 receiving and transmitting the multiplexed audio data to become the multiplexed data obtained by the video data, the multiplexed data may be multiplexed with the non-audio data instead of the video-related symbol data. It becomes information obtained from video materials and may not be multiplexed data but video information itself.

As such, the moving image encoding method and the moving image decoding method can be used in any of the devices and systems described in the various embodiments. So, you can get The advantages described in the various embodiments are obtained.

Further, the present invention is not limited to the embodiments, and various modifications and changes are possible without departing from the scope of the invention.

(Example B)

The video material may be by (i) a moving image encoding method or a moving image encoding device displayed in various embodiments and (ii) a moving image encoding method or a moving image encoding device complying with different standards, such as MPEG-, as needed. 2. Generated by switching between MPEG-4 AVC and VC-1.

Here, when multiple video data conforming to different standards are generated and then decoded, the decoding method must be selected to conform to different standards. However, since the plurality of video data to be decoded each meets which standard cannot be detected, there is a problem that an appropriate decoding method cannot be selected.

In order to solve this problem, the multiplexed audio data and other multiplexed data obtained from the video data have a structure including identifier information indicating which standard the video data conforms to. In various embodiments, the specific structure of the multiplexed data including the video data generated by the moving image encoding device in the moving image encoding method will be described in detail later. The multiplexed data is a digital stream of the MPEG-2 transport stream format.

Figure 23 illustrates the structure of the multiplexed data. As illustrated in FIG. 23, the multiplexed data may be obtained by at least one of a multiplexed video stream, an audio stream, a representation type graphics stream (PG), and an interactive graphics stream. The video stream represents a video and a secondary video of a video. The audio stream (IG) represents an audio portion and a secondary audio portion to be mixed with an audio portion, and the representation type graphic stream represents the subtitle of the movie. Here, one The secondary video system wants to display the normal video on the screen, and the secondary video system wants to display the video of the smaller window in one video. In addition, the interactive graphics stream represents an interactive picture that is generated on the screen by configuring the GUI component. The video stream is in various embodiments, in the moving image encoding method and encoded by the moving image encoding device; or in accordance with conventional standards such as MPEG-2, MPEG-4 AVC, and VC-1, in the mobile image In the encoding method and encoded by the moving image encoding device. Audio streams are based on standard encodings such as Dolby-AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, and Linear PCM.

Each stream that is included in the multiplexed data is identified by the PID. For example, 0x1011 is configured for video streaming of video to be used for video, 0x1100 to 0x111F is configured for audio streaming, 0x1200 to 0x121F is configured for presentation graphics streaming, and 0x1400 to 0x141F is configured for interactive graphics. Streaming, 0x1B00 to 0x1B1F are configured for the video stream of the two video to be used for the video, and 0x1A00 to 0x1A1F are configured for the audio stream to be used for the secondary audio to be mixed once.

Figure 24 shows schematically how the data system is multiplexed. First, a video stream ex235 composed of a video frame and an audio stream ex238 composed of an audio frame are respectively converted into a stream PES packet ex236 and a stream PES packet ex239, and further converted into TS packets ex237 respectively. And TS packet ex240. Similarly, the data representing the pattern stream ex241 and the data of the interactive graphics stream ex244 are converted into a stream PES packet ex242 and a stream PES packet ex245, and further converted into a TS packet ex243 and a TS packet ex246, respectively. These TS packets are multiplexed into a stream to obtain more Industrialization information ex247.

Figure 25 illustrates how a video stream can be stored in a stream of PES packets with further detail. The first column in Figure 25 shows the video frame stream in a video stream. The second column shows the PES packet for the stream. As shown by arrows indicated by yy1, yy2, yy3, and yy4, the video stream is divided into an I picture, a B picture, and a P picture, each of which is a video representation type unit, and the image system is stored in each PES packet payload. The PES packets each have a PES header that stores one of the display time indicating the display time of the image, a type time stamp (PTS), and one of the decoding times of the image, a decoding time stamp (DTS).

Figure 26 illustrates the TS packet format that is ultimately written to the multiplexed material. Each TS packet is a 188-bit fixed-length packet containing a 4-bit TS header with information, such as a PID for identifying the stream and a 184-bit TS payload for storing the data. The PES packets are segmented and stored separately on the TS payload. When a BD ROM is used, each TS packet is given a 4-byte TP_Extra_Header, thus resulting in a 192-bit source packet. The source packet is written on the multiplexed data. TP_Extra_Header stores information such as Arrival_Time_stamp (ATS). The ATS displays the transmission start time of each TS packet to be transmitted to the PID filter. As shown at the bottom of Figure 26, the source packets are arranged in the multiplexed data. The number of increments from the head end of the multiplexed data is called the number of source packets (SPN).

The TS packets included in the multiplexed data include not only audio, video, subtitles, and other streams, but also program linked tables (PAT), program mapping tables (PMT), and program clock references (PCR). . PAT The PID indication for one of the PMTs in the multi-threaded program is displayed, and the PID of the PAT itself is zero. The PMT stores the audio, video, subtitle and other streaming PIDs included in the multiplexed data, and the attribute information of the stream corresponding to the PID. The PMT also has various descriptors associated with multiplexed material. The descriptor has information, such as copy control information indicating whether the multiplexed material is approved for copying. The PCR stores the STC time information corresponding to the ATS, indicating when the PCR packet is transmitted to the decoder to achieve an ATS time axis arrival time clock (ATC) and a PTS and DTS time axis system time clock (STC). Synchronize.

Figure 27 illustrates the details of the data structure of the PMT. The PMT header is placed on top of the PMT. The PMT header description includes the length of the data included in the PMT and others. Multiple descriptors associated with multiplexed data are placed behind the PMT header. Information such as copy control information is described in the descriptor. After the descriptors, there is provided stream information related to the plurality of streams included in the multi-execution program. Each block stream information includes stream descriptors, each describing information such as a stream type of a compressed codec that identifies a stream, a stream PID, and stream attribute information (such as frame rate or aspect ratio). The number of stream descriptors is equal to the number of streams in the multiplexed data.

When the multiplexed data is recorded on a recording medium and other, it is recorded together with the multiplexed data information file.

The multiplexed data information files are each management information of the multiplexed data as shown in FIG. The multiplexed data information file has a one-to-one correspondence with the multiplexed data system, and each of the files includes multiplexed data information, streaming attribute information, and an entry mapping table.

As exemplified in FIG. 28, the multiplexed material information includes a system rate, a regeneration start time, and a regeneration end time. The system rate indicates that a system target decoder details the maximum transmission rate at which the maximum value data is transmitted to a PID filter. The interval of the ATS included in the multiplexed data is set to be no higher than the system rate. The regeneration start time indicates the PTS of a video frame at the beginning of the multiplexed data. A frame interval is added to the PTS of a video frame at the end of the multiplexed data, and the PTS is set to the reproduction end time.

As shown in FIG. 29, for each PID including each stream of the multiplexed material, a piece of attribute information is registered in the stream attribute information. Each piece of attribute information has different information depending on whether the corresponding stream is a video stream, an audio stream, a representation stream, or an interactive stream. Each piece of video stream attribute information carrying information includes: which compression codec is used to compress the video stream, and the resolution, aspect ratio, and graph of the image data blocks included in the video stream Box rate. Each piece of audio stream attribute information carrying information includes: which compression codec is used to compress the audio stream, how many channels are included in the audio stream, which language is supported by the audio stream, and the sampling frequency is high. high. The video stream attribute information and the audio stream attribute information are used to initialize a decoder before the player plays back the information.

In the present embodiment, the multiplexed data to be used is included in the stream type of the PMT. Further, when the multiplexed data is recorded on a recording medium, the video stream attribute information including the multiplexed data information is used. More specifically, the moving image encoding method described in the respective embodiments And the moving image encoding device includes a step or a unit for configuring the unique information, the information indicating the moving image encoding method and the video data generated by the moving image encoding device described in the respective embodiments are included in the PMT Stream type or video stream attribute information. With this configuration, the video data generated by the moving image encoding method and the moving image encoding device described in the respective embodiments can be distinguished from the video material conforming to another standard.

Further, Fig. 30 illustrates steps of the moving picture decoding method according to the present embodiment. In step exS100, the stream type attribute included in the PMT or the video stream attribute information included in the multiplexed material information is obtained from the multiplexed data. Next, in step exS101, it is determined whether the stream type or video stream attribute information indicates that the multiplexed data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments. When it is determined that the stream type or video stream attribute information indicates that the multiplexed data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, in step exS102, various embodiments are used. The moving image decoding method is decoded. Further, when the stream type or video stream attribute information indication conforms to a conventional standard, such as MPEG-2, MPEG-4 AVC, and VC-1, in step exS103, a moving picture conforming to a conventional standard is used. Decode like the decoding method.

Thus, configuring a unique new value for the stream type or video stream attribute information permission determines whether the moving picture coding method and the moving picture coding apparatus described in the respective embodiments can perform decoding. Even if you input multiplexed data that meets different standards, you can still use the appropriate decoding method or device. This may turn into decoding information without any errors. Again, in this real A moving image encoding method or apparatus, or a moving image decoding method or apparatus in the embodiment can be used for the aforementioned apparatus and system.

(Example C)

In various embodiments, the moving image encoding method, the moving image encoding device, the moving image decoding method, or the moving image decoding device is typically implemented in the form of an integrated circuit or a large integrated circuit (LSI) circuit. As for the example of the LSI, Fig. 31 illustrates the configuration of the LSI ex500 fabricated into one wafer. The LSI ex500 includes elements ex501, ex502, ex503, ex504, ex505, ex506, ex507, ex508, and ex509, which are described in detail later, and are connected to each other through a bus line ex510. The power supply circuit unit ex505 is activated by powering each element at the time of startup.

For example, when encoding is performed, the LSI ex500 receives an AV signal from the microphone ex117, the camera ex113, and the like through the AV IO ex509 under the control of the control unit ex501, and the control unit ex501 includes a CPU ex502 and a memory. The controller ex503, the stream controller ex504, and the drive frequency control unit ex512. The received AV signal is temporarily stored in an external memory ex511, such as an SDRAM. Under the control of the control unit ex501, the stored data is segmented into a plurality of data portions in accordance with the processing amount and processing speed to be transmitted to the signal processing unit ex507. Then, the signal processing unit ex507 encodes an audio signal and/or a video signal. Here, the encoding of the video signal is the encoding described in the various embodiments. Further, the signal processing unit ex507 occasionally multiplexes the encoded audio data and the encoded video data, and a stream IO ex506 provides the multiplexed data to the outside. The multiplexed data provided is sent to the station ex107 or written on the recording medium ex215 on. When the data set is multiplexed, the data must be temporarily stored in the buffer ex508 so that the data sets are synchronized with each other.

Although the memory ex511 is an external component of the LSI ex500, it may be included in the LSI ex500. The buffer ex508 is not limited to one buffer, but may be composed of a plurality of buffers. Further, the LSI ex500 can be fabricated into one wafer or a plurality of wafers.

Further, although the control unit ex501 includes the CPU ex502, the memory controller ex503, the stream controller ex504, and the drive frequency control unit ex512, the configuration of the control unit ex501 is not limited thereto. For example, the signal processing unit ex507 may further include a CPU. The inclusion of another CPU in the signal processing unit ex507 can improve the processing speed. Moreover, as another example, the CPU ex502 can be used as or as part of the signal processing unit ex507, for example, can include an audio signal processing unit. In this case, the control unit ex501 includes the signal processing unit ex507, or the CPU ex502 includes a component of the signal processing unit ex507.

The name used here is LSI, but it is also called IC, system LSI, super LSI, or super LSI depending on the degree of accumulation.

In addition, the integration technology is not limited to LSI, special circuits or general-purpose processors can achieve this integration. Programmable Programmable Programmable Gate Array (FPGA) or Licensed Reassembly or LSI Assembly Reconfigurable Processors for LSI can be used for the same purpose.

In the future, with the advancement of semiconductor technology, new technologies may replace LSI. Functional blocks may be integrated using this technique. The invention may be applicable to biotechnology.

(Example D)

When the video data generated by the moving image encoding method and the moving image encoding device described in the respective embodiments are decoded, the video data conforming to the conventional standards such as MPEG-2, MPEG-4 AVC, and VC-1 is compared. When decoded, the amount of processing may increase. Thus, when the video material conforming to the conventional standard is decoded, the LSI ex500 must be set to a higher driving frequency when the CPU ex502 is used. However, when the drive frequency is set to be higher, there is a problem that power consumption increases.

In order to solve this problem, a moving image decoding device such as a television ex300 and an LSI ex500 are combined to determine which standard the video data conforms to, and switch between drive frequencies in accordance with the determined standard. Fig. 32 illustrates one of the configurations ex800 in the present embodiment. When the video data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, the driving frequency switching unit ex803 sets the driving frequency to a higher driving frequency. Then, the drive frequency switching unit ex803 instructs the decoding processing unit ex801, which is one of the moving image encoding methods described in the respective embodiments, to decode the video material. When the video data conforms to the conventional standard, the driving frequency switching unit ex803 sets a driving frequency to be lower than the driving frequency of the video data generated by the moving image encoding method and the moving image encoding device described in the respective embodiments. Drive frequency. Then, the drive frequency switching unit ex803 instructs the decoding processing unit ex802 conforming to the conventional standard to decode the video material.

More specifically, the drive frequency switching unit ex803 is included in the CPU ex502 and the drive frequency control unit ex512 of FIG. Here, executed in The decoding processing unit ex801 of the moving image decoding method and the decoding processing unit ex802 conforming to the conventional standard according to the respective embodiments correspond to the signal processing unit ex507 of Fig. 26, respectively. The CPU ex502 determines which standard of the video material is combined. Then, the drive frequency control unit ex512 determines a drive frequency based on a signal from the CPU ex502. Further, the signal processing unit ex507 decodes the video material based on the signal obtained from the CPU ex502. For example, the identification information described in Embodiment B may be used to identify video material. The identification information is not limited to those described in Embodiment B, but may be any information as long as the information indicates which standard the video material complies with. For example, the decision can be based on such an external signal when it can be determined based on an external signal used to determine whether the video data is used on a television or disc, etc., which decision can be made. Further, the CPU ex502 selects a driving frequency based on, for example, a lookup table in which the video data standard is associated with the driving frequency, as shown in FIG. The drive frequency can be selected by storing the lookup table in the buffer ex508 and the internal memory stored in the LSI, and the CPU ex502 refers to the inquiry table.

Figure 33 illustrates the steps of performing the method of the present embodiment. First, in step exS200, the signal processing unit ex507 obtains identification information from the multiplexed material. Next, in step exS201, the CPU ex502 determines, based on the identification information, whether the video material is decoded by the encoding method and the encoding device generated by the encoding device as described in the respective embodiments. When the video data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, the CPU ex502 transmits a signal to the driving frequency control unit ex512 to set the driving frequency to the higher driving frequency in step exS202. Then, the drive frequency The rate control unit ex512 sets the drive frequency to a higher drive frequency. On the other hand, when the identification information indicates that the video data conforms to a conventional standard such as MPEG-2, MPEG-4 AVC, and VC-1, in step exS203, the CPU ex502 sends a signal to the drive frequency control unit ex512 to set the drive frequency to Lower drive frequency. Then, the drive frequency control unit ex512 sets the drive frequency to compare the video data by the moving image encoding method described in the respective embodiments and the lower driving frequency of the case where the moving image encoding device is generated.

Further, in conjunction with the switching of the driving frequency, the power saving effect can be improved by changing the voltage to be applied to the LSI ex500 or the device including the LSI ex500. For example, when the driving frequency is set to be low, the voltage to be applied to the LSI ex500 or the device including the LSI ex500 may be set to a voltage lower than the case where the driving frequency is set to be high.

Further, when the amount of processing of decoding is larger, the driving frequency can be set higher, and when the amount of processing of decoding is smaller, the driving frequency can be set lower as a method of setting the driving frequency. As such, the setting method is not limited to the foregoing. For example, when the processing amount of decoding the video data conforming to MPEG-4 AVC is greater than the processing amount of decoding the video data generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, the driving frequency may be Set in the reverse order of the above settings.

In addition, the method of setting the driving frequency does not limit the method of setting the driving frequency to be reduced. For example, when the identification information indicates that the video data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, the voltage to be applied to the LSI ex500 or the device including the LSI ex500 may be set higher. . When the identification information indicates that the video data conforms to the conventional standard For example, MPEG-2, MPEG-4 AVC, and VC-1, the voltage to be applied to the LSI ex500 or the device including the LSI ex500 may be set lower. As another example, when the identification information indicates that the video data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, the driving of the CPU ex502 may not need to be put on hold. When the identification information indicates that the video material conforms to conventional standards such as MPEG-2, MPEG-4 AVC, and VC-1, the drive of the CPU ex502 may be put on hold at a given time because the CPU ex502 has additional processing capacity. Even when the identification information indicates that the video data is generated by the moving image encoding method and the moving image encoding device described in the respective embodiments, in this case, the CPU ex502 has an additional processing capacity, and the driving of the CPU ex502 may be given Set aside for a fixed time. In this case, the hold time may be set to be shorter when the identification information indicates that the video material conforms to a conventional standard such as MPEG-2, MPEG-4 AVC, and VC-1.

Accordingly, the power saving effect can be improved by switching between driving frequencies according to standards conforming to the video data. Furthermore, when the LSI ex500 or the LSI ex500-equipped device is driven by a battery, the battery life can be extended by using the power saving effect.

(Example E)

There are a number of situations in which multiple video materials conform to different standards and are provided to devices and systems, such as televisions and cell phones. In order to decode multiple video data that meet different standards, the signal processing unit ex507 of the LSI ex500 must comply with different standards. However, the use of the signal processing unit ex507 which conforms to an individual standard has a problem that the circuit scale of the LSI ex500 increases and the cost increases.

In order to solve this problem, a decoding processing unit configured to embody the moving image decoding method described in the respective embodiments and a decoding processing unit MPEG-2, MPEG-4 AVC, and VC conforming to a conventional standard are conceived. -1 part shared. An example of the configuration of the ex900 display of Figure 35A. For example, the moving image decoding method and the MPEG-4 AVC compliant moving image decoding method described in the respective embodiments have partially common processing details such as entropy coding, inverse quantization, deblocking filtering, and motion compensation prediction. . The processing details to be shared may include a decoding processing unit ex902 conforming to MPEG-4 AVC. Conversely, one of the inventions may be used for other unique processing. Since one aspect of the present invention is directed to inverse quantization as its characteristic, more specifically, for example, the dedicated decoding processing unit ex901 is used for inverse quantization. Otherwise, the decoding processing unit may be shared by one of entropy coding, inverse quantization, deblocking filtering, and motion compensated prediction or all processing. The solution for the moving picture decoding method described in the various embodiments may be shared between processes to be shared, and the dedicated decoding processing unit may be used for MPEG-4 AVC unique processing.

Further, ex1000 of FIG. 35B shows another example in which the processing system portion is shared. This example uses a configuration including a dedicated decoding processing unit ex1001 that supports one of the unique processing of the present invention, a dedicated decoding processing unit ex1002 that supports another conventional standard unique processing, and supports one of the aspects of the present invention. A decoding processing unit ex1003 that processes the processing shared between the image decoding methods. Here, the dedicated decoding processing units ex1001 and ex1002 are not necessarily required for the processing according to one aspect of the present invention and the conventional standard processing, respectively, but may be embodied by a general-purpose processor. Furthermore, the configuration of this embodiment can be embodied by the LSI ex500.

As described above, by sharing the decoding processing unit with the processing common to the moving image decoding method according to one aspect of the present invention and the moving image decoding method conforming to the conventional standard, it is possible to reduce the circuit scale of the LSI and reduce the cost.

In other words, the present invention relates to deblocking filtering that can be applied to smooth block boundaries in image or video encoding and decoding. More specifically, the present invention relates to pulse code modulation (PCM) coding blocks for filtered samples. Therefore, enabling or deactivating one of the deblocking filters of the PCM coding block and dissociating or deactivating one of the second filters separates the indicator into the stream of the coded bits to individually switch the block on or off. Filtering and another filtering such as adaptive loop filtering or sample adaptive offset.

1610-1640‧‧‧Steps

Claims (18)

A method of using a pulse code modulation (PCM) to encode a block in a video of a video signal into a bit stream, the method comprising: determining whether a deblocking filter is to be applied to the a sample block; determining whether a second filter different from the deblocking filter is to be applied to the sample block; including a deblocking filter indicator in the bit stream to indicate whether a solution is to be applied a result of the block filtering; and the bit stream includes a second filter indicator different from the deblocking filter indicator to indicate whether a second filtered result is to be applied. The method of claim 1, wherein the second filtering is an adaptive loop filtering or the same adaptive offset (SAO). The method of claim 1, wherein the deblocking filter indicator is included in the bit stream within a sequence of parameter sets. The method of claim 1, wherein the second indicator is included in the bit stream of each block. The method of claim 1, wherein the determining whether the second filtering is to be applied comprises the steps of: determining a quantized noise amount in the PCM-coded sample block; and determining the quantized noise based on the determined Signal, determine whether to apply a Two filtering. The method of claim 1, wherein the method comprises the steps of: determining whether the same adaptive offset (SAO) is to be applied to the sample block; including an SAO indicator in the bit stream to indicate Determine if the result of a SAO is to be administered. The method of claim 1, wherein the step of determining whether the second filtering is to be applied to the sample block further comprises the step of determining whether the second filtering is to be applied to the deblocking filter modification The samples of the block; including a modified sample indicator in the bit stream to indicate whether a result of determining whether the second filter is to be applied to the modified sample; determining whether the second filter is to be applied Up to the samples of the block that are not modifiable by the demapping filter; and including an unmodified sample indicator in the bit stream to indicate whether the second filter is to be applied to the unmodified The result of the sample. The method of claim 1, wherein the determining whether the second filter is to be applied to the sample block is performed based on a result of determining whether the deblocking filter is to be applied to the sample block. The method of claim 1, wherein the determining whether a deblocking filter is to be applied to the PCM encoded sample block comprises the steps of: Determining whether one of the neighboring blocks of the sample block is encoded by using pulse code modulation coding or by predictive coding; when the adjacent block is encoded by predictive coding, determining that a solution block filter system is applied to The sample block. The method of claim 1, wherein the determining whether a deblocking filter is to be applied to the sample block is performed based on comparing a quantization error of a block adjacent to the sample block with a predetermined threshold. A method for decoding a block from a bit stream into an image of an image of a video signal, the sample block using a pulse code modulation (PCM) encoding, the method comprising: from the bit The meta-stream extracts a deblocking filter indicator to indicate whether a deblocking filter is to be applied to the sample block; separately from the deblocking filter indicator, extracting a second filtered indication from the bit stream a flag indicating whether a second filter is to be applied to the sample block; applying or not applying the deblocking filter to the sample block according to the extracted deblocking filter indicator; and according to the extracted The second filter indicator is applied with or without the second filtering to the sample block. The method of claim 11, wherein the second indicator indicates whether an adaptive loop filter and the same adaptive offset (SAO) are to be applied to the sample block; or stream from the bit Extracting two separate indicators, one to indicate whether adaptive loop filtering will be applied to the sample block, and the other to Whether the SAO will be applied to the sample block is indicated, and the adaptive loop filtering and SAO are applied or not applied to the sample block depending on the extracted indicator. The method of claim 11, wherein the second indicator comprises: a modified sample indicator to indicate whether the second filtering is to be applied to the block that can be modified by the deblocking filter And the like; and/or an unmodified sample indicator to indicate whether the second filter is to be applied to the samples that are not modifiable by the deblocking filter, and based on the extracted modified samples The indicator and the unmodified sample indicator, with or without the second filter applied to the individual modified and unmodified samples of the block. The method of claim 1, wherein the deblocking filter indicator and/or the second filter indicator are inserted in the image slice header or the block information. A computer program product comprising a computer readable medium having a computer readable program code embodied thereon, the program code being adapted to perform the method of claim 1 of the patent application. A device that uses a pulse code modulation (PCM) to encode a block in a video of a video signal into a bit stream, the device comprising: a solution block determining unit for determining a Does deblocking filtering Applying to the sample block; a second determining unit for determining whether a second filter different from the deblocking filter is to be applied to the sample block; and an embedding unit for streaming the bit Enclosing a deblocking filter indicator to indicate whether a result of determining a deblocking filter is to be applied, and to include a second filter different from the deblocking filter indicator in the bit stream An indicator to indicate whether a second filtered result will be applied. A device for decoding a block from a bit stream into an image of a video signal, the sample block using a pulse code modulation (PCM) encoding, the device comprising: an extracting unit Extracting a deblocking filter indicator from the bitstream to indicate whether a deblocking filter is to be applied to the sample block, and separately from the deblocking filter indicator, from the bit string Flow extracting a second filtered indicator to indicate whether a second filtering is to be applied to the sample block; a deblocking filtering unit that is configured to apply according to the extracted deblocking filter indicator or Not applying the deblocking filter to the sample block; and a second filtering unit configured to apply or not apply the second filtering to the sample block according to the extracted second filtering indicator . An integrated circuit for implementing the device of claim 16 of the patent application, further comprising a memory, wherein the memory system is Store one of the pixels to be filtered vertically and/or horizontally.