WO2012026794A2 - 인트라 예측을 이용한 부호화 및 복호화 장치와 방법 - Google Patents
인트라 예측을 이용한 부호화 및 복호화 장치와 방법 Download PDFInfo
- Publication number
- WO2012026794A2 WO2012026794A2 PCT/KR2011/006346 KR2011006346W WO2012026794A2 WO 2012026794 A2 WO2012026794 A2 WO 2012026794A2 KR 2011006346 W KR2011006346 W KR 2011006346W WO 2012026794 A2 WO2012026794 A2 WO 2012026794A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- reference pixel
- intra prediction
- filtering
- result
- characteristic
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/14—Coding unit complexity, e.g. amount of activity or edge presence estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
Definitions
- the present invention relates to an encoding and decoding apparatus and method using intra prediction. More specifically, by determining the reference pixel characteristics of the reference pixels included in the neighboring block of the encoding or decoding object block, and performing one of adaptive filtering-based intra prediction and conventional intra prediction based on the determination, The present invention relates to an encoding and decoding apparatus and method for improving coding efficiency by reducing a required amount of bits indicating whether filtering is performed.
- intra coding improves coding performance through prediction using high correlation between adjacent pixels.
- Intra prediction of H.264 / AVC provides a total of nine prediction modes for blocks of 4x4 units, as shown in FIG. 1 (A), and for blocks of units of 16x16 units, as shown in FIG. As you can see, four prediction modes are used.
- H.264 / AVC provides 9 intra prediction modes for 8x8 blocks like 4x4 blocks, and first applies a filter for removing high frequency components to reference pixels of neighboring blocks to be used for prediction. Prediction is performed after the reference pixels are planarized (Ref. 1). This filtering process may reduce the intra prediction error of the target block by changing the pixels in the vicinity to a value more suitable for intra prediction.
- HHI Fraunhofer Heinrich Hertz Institute
- the adaptive filtering method proposed by HHI compares the prediction error between the case of applying the high frequency component elimination filtering and the case of not applying the block for each intra prediction and applies the case of having the smaller prediction error to the actual coding. This reduces the prediction error.
- JCT-VC Joint Collaborative Team on Video Coding
- the present invention determines the reference pixel characteristics of reference pixels included in a neighboring block of an encoding or decoding target block, and then, based on the determination, any one of intra prediction based on adaptive filtering and conventional intra prediction is determined.
- An object of the present invention is to provide an encoding and decoding apparatus and method for improving coding efficiency by reducing a required amount of bits indicating whether to perform filtering.
- the present invention provides a coding apparatus using intra prediction, receives at least one reference pixel included in an adjacent block of a target block to be encoded, and determines a reference pixel characteristic, Reference pixel feature extractor for determining whether to apply adaptive filtering to the at least one reference pixel based on the feature
- a reference pixel that performs high frequency elimination filtering Compares the result of performing intra prediction with the result of performing the intra prediction using the reference pixel that does not perform the high frequency elimination filtering and outputs the result that is less costly with filtering information indicating whether to perform filtering.
- Adaptive in the 1 intra prediction unit and the reference pixel characteristic extraction unit And a second intra predictor for outputting a result of performing intra prediction using a reference pixel that has not been subjected to the high frequency elimination filtering when it is determined that no terring is to be applied. .
- the reference pixel characteristic extractor may determine the reference pixel characteristic using statistical characteristics of the at least one reference pixel, may use variance as a statistical characteristic, and if the variance is less than or equal to a preset threshold, it is adaptive. You can decide not to apply filtering.
- the reference pixel characteristic extractor may detect whether an outline exists in the adjacent block and determine not to apply adaptive filtering when the outline exists.
- a reference pixel characteristic is determined by receiving at least one reference pixel included in an adjacent block of a target block to be decoded, and determining the reference pixel characteristic.
- Reference pixel feature extractor for determining whether to apply adaptive filtering to the at least one reference pixel based on the filtering information from the encoded data received from the encoding apparatus when the reference pixel feature extractor determines that adaptive filtering is applied.
- one of a result of performing intra prediction using a reference pixel that has been subjected to high frequency elimination filtering and a result of performing intra prediction using a reference pixel which has not been subjected to high frequency elimination filtering A first intra predictor and the reference pixel to output If it is determined by the extractor that the adaptive filtering is not applied, it is determined that the filtering information does not exist in the encoded data, and the result of performing the intra prediction using the reference pixel that does not perform the high frequency elimination filtering is output.
- a decoding apparatus using intra prediction comprising a second intra prediction unit.
- a reference pixel characteristic is determined by receiving at least one reference pixel included in an adjacent block of a target block to be encoded.
- Reference pixel feature extraction step of determining whether to apply adaptive filtering to the at least one reference pixel based on the reference pixel having the high frequency rejection filtering applied when it is decided to apply the adaptive filtering in the reference pixel feature extraction step. Comparing the result of performing the intra prediction with the result of performing the intra prediction using the reference pixel that does not perform the high frequency elimination filtering, and outputs a result that consumes less cost with filtering information indicating whether to perform filtering.
- Adaptive in prediction and extracting reference pixel characteristics And a second intra prediction step of outputting a result of performing intra prediction using a reference pixel that has not been subjected to the high frequency elimination filtering when it is determined that no filtering is to be applied. do.
- a reference pixel characteristic is determined by receiving at least one reference pixel included in an adjacent block of a target block to be decoded.
- Reference pixel characteristic extraction step of determining whether to apply adaptive filtering to the at least one reference pixel based on the filtering information from the encoded data received from the encoding apparatus when it is determined that the adaptive filtering is applied in the reference pixel characteristic extraction step.
- one of a result of performing intra prediction using a reference pixel that has been subjected to high frequency elimination filtering and a result of performing intra prediction using a reference pixel which has not been subjected to high frequency elimination filtering Outputting a first intra prediction step and the true If it is determined in the pixel characteristic extraction step that adaptive filtering is not applied, it is determined that the filtering information does not exist in the coded data, and intra prediction is performed using a reference pixel that does not perform the high frequency elimination filtering. It provides a decoding method using intra prediction, comprising the step of outputting a second intra prediction.
- the characteristics of the reference pixels included in the neighboring block of the encoding target block are determined, and encoding is performed by determining whether to perform adaptive prediction-based intra prediction or normal intra prediction based on the determined reference pixel characteristics. Therefore, it is possible to reduce the frequency of occurrence of the additional information generated by the adaptive filtering.
- This provides higher compression coding efficiency, provides an efficient rate-distortion control factor of video compression encoders by adjusting the strength of the criterion for adaptive filtering, and iterative filtering if adaptive filtering is omitted. And complexity of the encoding and decoding process generated due to the intra prediction process.
- 1 is a view for explaining an intra prediction mode
- FIG. 2 is a block diagram illustrating an encoding apparatus according to an embodiment of the present invention
- FIG. 3 is a block diagram showing a configuration of an intra prediction unit of an encoding apparatus according to an embodiment of the present invention
- FIG. 4 is a diagram illustrating a configuration of a reference pixel characteristic extraction unit 320 according to an embodiment of the present invention
- FIG. 5 is a diagram illustrating an area to which a Sobel mask is applied in an adjacent block for detecting a contour
- FIG. 6 is a block diagram illustrating a configuration of a first intra prediction unit that performs intra prediction based on adaptive filtering according to an embodiment of the present invention
- FIG. 7 is an exemplary diagram for explaining a first intra prediction unit performing intra prediction based on adaptive filtering according to an embodiment of the present invention
- FIG. 8 is a flowchart showing a coding method according to an embodiment of the present invention.
- FIG. 9 is a block diagram showing a configuration of a decoding apparatus according to an embodiment of the present invention.
- FIG. 10 is a block diagram showing a configuration of an intra prediction unit of a decoding apparatus according to an embodiment of the present invention.
- FIG. 11 is a flowchart illustrating a decoding method according to an embodiment of the present invention.
- FIG. 2 is a block diagram illustrating an encoding apparatus according to an embodiment of the present invention.
- the encoding apparatus includes an intra prediction unit 210, a reference picture memory 220, a residual data encoder 230, a residual data decoder 240, and an entropy encoding.
- the unit 250 and the encoded data generator 260 may be included.
- the encoding device may be a personal computer (PC), a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a PlayStation Portable (PSP), a mobile device.
- a communication terminal such as a communication modem for communicating with various devices or a wired / wireless communication network, a memory for storing various programs for encoding an image and data, an operation by executing a program, Means a variety of devices including a microprocessor for controlling.
- the image input to be encoded may be input in units of blocks, and may be a macroblock.
- the macroblock is defined as 16 ⁇ 16 in the same manner as the H.264 / AVC standard, but more generally, the shape of the macroblock may be M ⁇ N. And N may each be greater than 16, and M and N may be different integers or the same integer.
- the intra predictor 210 generates an intra predicted block of the current block by using reference pixel values that can be used in adjacent blocks that are spatially adjacent to the current block. In this case, an error value between the current block and the intra prediction block is calculated for each of the available intra prediction modes, and the intra prediction block is generated by applying the intra prediction mode having the minimum error value. In addition, by encoding the intra prediction mode having the minimum error value, information about the intra prediction mode is provided to the encoded data generator 260.
- the intra prediction unit 210 extracts, from the reference picture memory 220, reference pixels included in adjacent blocks of the target block to be encoded before generating the intra prediction block. Determine the reference pixel characteristics. Then, it is determined whether to perform the intra prediction based on the adaptive filtering or the conventional intra prediction based on the determined reference pixel characteristic, and based on the determination, the intra for the encoding target block is determined using any one of the prediction methods. Create a predictive block. Intra prediction based on adaptive filtering means that the intra prediction after performing the high frequency elimination filtering on the reference pixel included in the neighboring block and the intra prediction without performing the high frequency elimination filtering consumes the least cost. Intra prediction method for outputting the result. In outputting the intra prediction result, filtering information indicating whether high frequency rejection filtering is applied to the intra prediction is also output.
- intra predictor 210 A more detailed description of the intra predictor 210 will be described later with reference to FIGS. 3 to 7.
- the result (intra prediction block) output from the intra prediction unit 210 is subtracted from the encoding target block to generate a residual block, and the generated residual block is output to the residual data encoder 230.
- the residual data encoder 230 transforms and quantizes the residual block, and then generates an encoded residual block.
- a variety of methods for transforming a spatial domain signal such as a Hadamard transform, a discrete cosine transform, and the like, may be used.
- Various quantization techniques such as uniform quantization including a dead zone, a quantization matrix, and the like may be used.
- the transform block may have a size that does not exceed the size of the prediction block. For example, if the size of the prediction block is 16 ⁇ 16, the conversion of 16 ⁇ 16, 16 ⁇ 8, 8 ⁇ 16, 8 ⁇ 8, 8 ⁇ 4, 4 ⁇ 8, 4 ⁇ 4, etc. does not exceed 16 ⁇ 16. Blocks can be used. If the size of the prediction block is 8 ⁇ 8, transform blocks such as 8 ⁇ 8, 8 ⁇ 4, 4 ⁇ 8, 4 ⁇ 4, etc., which do not exceed 8 ⁇ 8, may be used. If the size of the prediction block is 4 ⁇ 4, only 4 ⁇ 4 transform blocks may be used. In addition, the size of the transform block may be selected as a rate-distortion optimization criterion. When the size of the transform block does not exceed the size of the prediction block, the residual data encoder 230 divides the residual block into subblocks equal to the size of the transform block, and then sequentially converts and quantizes the subblocks.
- the transform block may have a size that exceeds the size of the prediction block.
- a transform block such as 32 ⁇ 16, 16 ⁇ 32, 32 ⁇ 32, 64 ⁇ 32, 32 ⁇ 64, 64 ⁇ 64, etc. may be used.
- the residual data encoder 230 combines a plurality of residual blocks adjacent to each other to generate a combined residual block equal to the size of the transform block and then transforms the transform block. And quantize.
- the residual data decoder 240 restores the residual block by inverse quantization and inverse transformation of the residual block transformed and quantized by the residual data encoder 220.
- Inverse quantization and inverse transformation are performed by inversely performing a transform process and a quantization process performed by the residual data encoder 230 and may be implemented in various ways. For example, transform and inverse transform or quantization and inverse quantization of the same process that the residual data encoder 230 and the residual data decoder 240 share in advance may be used, or the residual data decoder 240 may remain.
- Residual data encoder 230 using information on a transform and quantization process generated by the transform and quantization process of data encoder 230 (for example, information on transform size, transform shape, and quantization type). Inverse quantization and inverse transformation can be performed by performing the inverse transformation and quantization processes.
- the residual block output through the residual data decoder 240 is added to the predicted block reconstructed by the intra predictor 210 to generate a reconstructed block, and then stored as a reconstructed block in the reference picture memory 220. It is used as a reference picture for encoding a target block to be encoded.
- the entropy encoder 250 entropy encodes and outputs a residual block output from the residual data encoder 230.
- the entropy encoder 250 may encode not only the residual block but also various pieces of information necessary for decoding the encoded bit string.
- various pieces of information necessary to decode the coded bit string may include information about a macroblock type, information about an intra prediction mode, information about a transform and quantization type, and whether high-frequency elimination filtering has been performed on reference pixels used for intra prediction. Filtering information indicating whether or not.
- the entropy coding unit 250 may use various methods of entropy coding such as Context Adaptive Variable Length Coding (CAVLC) and Context Adaptive Binary Arithmetic Coding (CABAC). .
- CAVLC Context Adaptive Variable Length Coding
- CABAC Context Adaptive Binary Arithmetic Coding
- the encoded data generator 260 arranges the entropy encoded residual block, information on the macroblock type, and information on the intra prediction mode, and outputs the encoded data as encoded data.
- the hatching data generator 260 also outputs filtering information indicating whether filtering is performed as encoded data.
- the filtering information is not included in the encoded data.
- FIG. 3 is a block diagram illustrating a configuration of an intra predictor according to an exemplary embodiment of the present invention.
- the intra predictor 210 uses the reference pixel setter 310, the reference pixel characteristic extractor 320, the first intra predictor 330, the second intra predictor 340, and the like. It may include.
- the reference pixel setting unit 310 extracts pixels (reference pixels) of adjacent blocks adjacent to the encoding target block from the reference picture memory 220.
- the neighboring blocks of the target block to be subjected to the current encoding have completed the encoding and decoding processes in units of blocks, and when the current block is encoded, the pixel values of the corresponding block should be referable. However, in some cases, the pixel value of the neighboring block may not be available depending on the encoding process.
- the unavailable pixels of the neighboring block are processed by the reference pixel setting unit 310. That is, the reference pixel setting unit 310 checks whether there are pixel values of adjacent blocks, and if there are adjacent pixels that cannot be referred to, fills the reference values with values calculated by an arbitrary operation.
- the reference pixel characteristic extractor 320 receives the reference pixel values processed by the reference pixel setting unit 310, determines characteristics of the reference pixels, and based on the result of the determination, intra-based adaptive filtering based intra filtering. It is determined whether to deliver to the first intra predictor 330 that performs the prediction or to the second intra predictor 340 that performs normal intra prediction.
- the characteristics of the reference pixels may include statistical characteristics of the reference pixels or characteristics in the image configured by the reference pixels, and in the embodiment of the present invention, dispersion is used as a statistical characteristic and whether contours exist as a characteristic in the image. It was. However, this is only one embodiment, and if the characteristics of adaptive filtering-based intra prediction and conventional intra prediction can determine whether the coding efficiency and performance is excellent, it should be interpreted as being included in the scope of the present invention. will be.
- the reference pixel characteristic extractor 320 is a statistical feature extractor 410 and an outline.
- the detector 420 and the filtering determiner 430 may be included.
- the statistical feature extractor 410 calculates the variance of the reference pixels and determines whether the variance is equal to or less than a preset threshold.
- the threshold may be determined by various methods. As an example, the following Equation 1 may be used.
- T represents a threshold and Qstep represents the width of the quantization interval. It also means the largest of integers less than x.
- the contour detection unit 420 detects whether or not an outline exists in an adjacent block by using reference pixels included in the adjacent block of the encoded upper block.
- An edge represents a boundary of an area within an image and corresponds to a discontinuity point of brightness. Therefore, the contour line can be detected by using a partial or differential operation or a gradient change of image brightness obtained by using a mask (operator) that performs a role of differential operation.
- a typical method for detecting a contour using a mask is to use a Sobel Mask, but there are other methods, such as Roberts Mask, Laplacian Mask, and Canny Mask.
- a method of detecting an outline using a Sobel mask is used, but the present invention is not limited thereto, and various methods of detecting an outline of an image are also to be interpreted as being included in the scope of the present invention.
- the contour is detected by applying the following mask to an image.
- the left mask is for the vertical gradient.
- the right mask is for obtaining the inclination in the horizontal direction.
- FIG. 5 illustrates an area to which the Sobel mask is applied.
- the size of the adjacent area to extract the contour may vary according to the size of the block used for prediction. have.
- Equation 2 The magnitude of the slope is expressed by Equation 2 below by assuming that the center element value (element (2,2) of the matrix) of the matrix calculated by multiplying each pixel value of the image by the left mask and the right mask is Gy and Gx, respectively.
- the gradient size value is larger than the preset threshold value T, it may be determined that an outline exists in the corresponding area.
- the filtering determiner 430 determines that the variance is less than or equal to the preset threshold by the statistical feature extractor 410 or determines that the adaptive filtering is not applied when the contour detector detects that the contour exists.
- the second intra predictor 340 performs normal intra prediction. However, if not, that is, if the variance is greater than the preset threshold and no contour is detected, the first intra prediction determines to apply adaptive filtering and performs adaptive prediction based intra prediction on the reference pixels. Transfer to section 330.
- index bits indicating whether to perform filtering are not used by performing intra prediction based on adaptive filtering, thereby improving coding efficiency.
- the reference pixel characteristics are determined by using both the statistical characteristics of the reference pixels and the existence of the outline, but the present invention is not limited thereto, and the reference pixel characteristics may be determined using only one of these methods.
- the first intra predictor 330 performs intra prediction based on adaptive filtering.
- FIG. 6 is a block diagram illustrating a configuration of a first intra predictor for performing adaptive filtering-based intra prediction according to an embodiment of the present invention.
- the first intra predictor may include a low pass filter (LPF).
- Low Pass Filter Low Pass Filter
- intra prediction performers 620 and 630 intra prediction performers 620 and 630
- cost calculator 640 and the like.
- the low pass filter 610 removes the high frequency components from the reference pixels and transfers them to the intra prediction performer 620, and the intra prediction performer 620 performs the intra prediction using the reference pixel values from which the high frequency components are removed. After performing, the result is transmitted to the cost calculator 640.
- the intra prediction performer 630 performs intra prediction using original reference pixel values for which the high frequency elimination filtering has not been performed, and transmits the result to the cost calculator.
- the cost calculator 640 calculates the cost and the intra cost for encoding data using the result performed by the intra prediction performer 620 (that is, the intra prediction result using the reference pixel on which the high frequency elimination filtering has been performed). Using the result performed by the prediction performing unit 630 (that is, the intra prediction result using the reference pixel on which the high frequency elimination filtering is not performed), the cost of encoding the data is calculated, and the cost is low. Output the result.
- the cost can be obtained using the rate-distortion or the amount of bits required to encode the data.
- the cost calculator 640 when outputting the intra prediction result, the cost calculator 640 also outputs filtering information indicating whether high frequency elimination filtering has been performed.
- FIG. 7 is an exemplary diagram for describing a first intra prediction unit that performs intra prediction based on adaptive filtering according to an embodiment of the present invention.
- a block of size n x m and the reconstructed reference pixel to perform intra prediction may be expressed as follows.
- the encoding target block O which consists of an array of nxm size
- the predictive block P of the n ⁇ m array predicting the target block O is
- the reconstructed pixel values of the previous block are used as the reference pixel for the current prediction block P.
- 7 shows an example of reconstructed reference pixels for reference.
- restored upper pixel values are expressed as follows.
- the reconstructed pixel value at the upper left is defined as a.
- each pixel of l, t, and a is marked as 'available'.
- a low-pass filter having a length k for smoothing the reference pixels used for intra prediction before performing intra prediction on the original block O is defined as follows.
- the above filter coefficients apply a convolution operation such as Equation 3 to the reference pixel vectors l and t to generate a flattened reference pixel vector.
- the low pass filter 610 of FIG. 6 performs high frequency rejection filtering on original reference pixels by Equation 2.
- the intra prediction performer 620 performs intra prediction using the reference pixel vectors g1 and g2 output from the low pass filter 610.
- the intra prediction performing unit 630 performs intra prediction using original reference pixel vectors l and t on which the high frequency elimination filtering is not performed.
- the cost calculator 640 costs the cost when encoding using the intra prediction result using the reference pixel vectors g1 and g2 and the cost when encoding using the intra prediction result using the original reference pixel vectors l and t. By comparing the results, intra prediction results are output that are less expensive. In addition, the cost calculator 640 outputs filtering information indicating whether or not the intra prediction result outputs the reference pixel on which the high frequency elimination filtering is performed.
- the second intra predictor 340 determines that the reference pixel for which the high frequency elimination filtering is not performed, that is, the original reference pixel vector l is performed. , perform intra prediction using t and output the result. In this case, since the second intra prediction unit does not use the adaptive filtering method, it is not necessary to output filtering information indicating whether high frequency rejection filtering is used for intra prediction.
- the reference pixel characteristic extractor 320 when the reference pixel characteristic extractor 320 decides to apply adaptive filtering, filtering information indicating whether high frequency rejection filtering is used for intra prediction is required, but the reference pixel When the feature extractor 320 decides not to apply the adaptive filtering, since the filtering information is not required, the amount of bits required to indicate whether filtering is performed may be reduced.
- FIG. 8 is a flowchart illustrating an encoding method according to an embodiment of the present invention.
- At least one reference pixel included in an adjacent block adjacent to a target block to be encoded is extracted to determine a reference pixel characteristic (S810).
- the reference pixel characteristics may include statistical characteristics of reference pixels such as variance or characteristics within an image of an image configured by reference pixels such as the existence of an outline.
- the reference pixel characteristic When the reference pixel characteristic is determined, it is determined whether adaptive filtering is applied to intra prediction based on the reference pixel characteristic (S820). For example, if the variance of the reference pixels is smaller than the preset threshold or if there is an outline in an adjacent block, it may be decided not to apply the adaptive filtering, otherwise it may be determined to apply the adaptive filtering. have.
- intra prediction is performed using original reference pixels that do not perform the high frequency elimination filtering, and the result is output (S830).
- high frequency elimination filtering is performed on the reference pixels and intra prediction is performed using the filtered reference pixels (S840 and S850).
- intra prediction is performed using reference pixels on which the high frequency elimination filtering is not performed (S860).
- the intra prediction result consumes less cost.
- filtering information indicating whether the output intra prediction result uses the reference pixel on which the high frequency elimination filtering has been performed is also output (S870).
- FIG. 9 is a block diagram showing a configuration of a decoding apparatus according to an embodiment of the present invention.
- the decoding apparatus may include an encoded data extractor 910, an entropy decoder 920, a residual data decoder 930, an intra predictor 940, and the like.
- the decoding device is a personal computer (PC), a notebook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), as in the encoding device described above with reference to FIG. 2.
- PC personal computer
- PDA personal digital assistant
- PMP portable multimedia player
- PlayStation Portable PSP: PlayStation Portable
- Mobile Communication Terminal Mobile Communication Terminal
- communication devices such as communication devices for performing communication with various devices or wired and wireless communication networks, various programs and data for decoding images It means a variety of devices including a memory for storing the, a microprocessor for operating and controlling the program.
- the encoded data extractor 910 extracts and analyzes the received encoded data, and transmits data on the residual block to the entropy decoder 920, and other data necessary for other prediction, for example, macroblock mode and encoding.
- the predicted prediction information (information about the intra prediction mode, etc.) and the like are transmitted to the intra prediction unit 940.
- the entropy decoder 920 performs entropy decoding on the residual block input from the encoded data extractor 910 to generate a quantized residual block.
- the entropy decoding unit 920 may decode not only the residual block but also various pieces of information necessary for decoding the encoded data.
- the various information required to decode the encoded data may include various information such as information about a block type, information about an intra prediction mode, information about a transform and quantization type, and the like.
- the entropy decoder 1220 may be defined in various ways according to the entropy encoding method used in the entropy encoder 440 of the encoding apparatus to which the embodiment of the present invention is applied.
- the residual data decoder 930 restores the residual block by performing the same process as the residual data decoder 240 of the encoding apparatus according to the embodiment of the present invention. That is, the inverse quantized residual block received from the entropy decoding unit is inversely quantized and then inversely transformed to restore the residual block.
- the intra prediction unit 940 generates an intra prediction block by performing intra prediction based on the intra prediction mode information extracted by the encoding data extractor.
- the intra prediction unit 940 determines a reference pixel characteristic by using reference pixels included in a neighboring block of a target block to be decoded, and adapts the encoding apparatus based on the reference pixel characteristic. It is determined whether intra prediction with the adaptive filtering is performed. When it is determined that adaptive filtering is applied, the filtering information is included in the encoded data received from the encoding apparatus, and thus the filtering information is extracted from the encoded data. Based on the extracted filtering information, intra prediction is performed using a reference pixel that has been subjected to high frequency elimination filtering or intra prediction is performed using original reference pixels that have not been subjected to high frequency elimination filtering and the result is output. . However, if it is determined that the adaptive filtering is not applied, the filtering information will not be present in the encoded data. Therefore, intra prediction is performed using original reference pixels that do not perform the high frequency elimination filtering, and the result is output.
- the result (intra prediction block) output from the intra predictor 940 is added to the residual block reconstructed by the residual data decoder 930 and reconstructed into a block of the original image.
- FIG. 10 is a block diagram showing the configuration of an intra predictor 940 according to an embodiment of the present invention.
- the intra prediction unit 940 may include a reference pixel setting unit 1010, a reference pixel characteristic extraction unit 1020, a third intra prediction unit 1030, and a fourth intra frame.
- the prediction unit 1040 may be included.
- the reference pixel setting unit 1010 extracts pixels (reference pixels) of adjacent blocks adjacent to the decoding target block from the reference picture memory.
- the reference pixel characteristic extractor 1020 receives the reference pixel values transferred from the reference pixel setting unit 1010, determines characteristics of the reference pixels, and determines whether to apply adaptive filtering based on the reference pixel characteristics. Based on the determination result, the reference pixel values are transferred to either the third intra predictor 1030 or the fourth intra predictor 1040.
- the characteristics of the reference pixels may include statistical characteristics of the reference pixels or characteristics in an image formed by the reference pixels.
- reference pixel setting unit 1010 and the reference pixel characteristic extraction unit 1020 have the same functions as the reference pixel setting unit 310 and the reference pixel characteristic extraction unit 320 of the encoding apparatus according to the embodiment of the present invention, respectively. In order to avoid redundant descriptions, further detailed descriptions are omitted.
- the third intra predictor 1030 extracts filtering information from the encoded data when the reference pixel characteristic extractor 1020 determines that the adaptive filtering is to be applied.
- the extracted filtering information indicates to perform high frequency elimination filtering
- high frequency elimination filtering is performed on the reference pixels
- intra prediction is performed using the reference pixels on which the high frequency elimination filtering is performed.
- intra prediction is performed using original reference pixels without performing the high frequency elimination filtering, and the result is output.
- the fourth intra predictor 1040 performs intra prediction using the original reference pixel that does not perform the high frequency elimination filtering. Output the result.
- the reference pixel characteristic extractor 1020 of the decoding apparatus has the same structure as that of the reference pixel characteristic extractor 320 of the encoding apparatus.
- the encoding apparatus determines that the reference pixel characteristic extractor 320 of the encoding apparatus also applies the adaptive filtering.
- the encoded data to be output includes filtering information. Accordingly, the third intra prediction unit 1030 extracts filtering information from the encoded data and performs intra prediction based on the filtering information.
- the reference pixel characteristic extractor 1020 of the decoding apparatus determines that the adaptive filtering is not applied
- the reference pixel characteristic extracting unit 320 of the encoding apparatus will also determine not to apply the adaptive filtering.
- the encoded data output from the device does not include filtering information. Therefore, in this case, the fourth intra prediction unit 1040 performs intra prediction using original reference pixels that do not perform high frequency elimination filtering without considering filtering information.
- FIG. 11 is a flowchart illustrating a decoding method according to an embodiment of the present invention.
- At least one reference pixel included in an adjacent block of the target block to be decoded is extracted to determine a reference pixel characteristic (S1110).
- the reference pixel characteristics may include statistical characteristics of reference pixels such as variance or characteristics in an image configured by reference pixels such as existence of an outline.
- the reference pixel characteristic is determined, it is determined whether to apply adaptive filtering based on the reference pixel characteristic (S1120). For example, if variance of the reference pixels is less than or equal to a preset threshold or there is an outline in an adjacent block, it may be determined not to apply adaptive filtering, otherwise it may be determined to apply adaptive filtering.
- filtering information is extracted from the encoded data (S1140), and the extracted filtering information is checked (S1150).
- the filtering information indicates to perform the high frequency elimination filtering
- intra prediction is performed by using the reference pixel on which the high frequency elimination filtering is performed, and the result is output (S1160).
- intra prediction is performed using a reference pixel that has not been subjected to the high frequency elimination filtering, and the result is output (S1170).
- the embodiment of the present invention provides a high compression coding efficiency by effectively reducing the frequency of generation of the index signal for the additional filter application generated by the adaptive filtering in the intra prediction, and whether or not the adaptive filtering is performed. It provides an efficient rate-distortion control factor of video compression encoder by adjusting the strength of the decision criterion, and further reduces the complexity of the encoding and decoding process caused by iterative filtering and intra prediction process when adaptive filtering is omitted. This is a very useful invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (28)
- 인트라 예측을 이용한 부호화 및 복호화 장치에 있어서,부호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 제1 참조화소 특성을 결정하고, 상기 제1 참조화소 특성에 기반하여, 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 비교하여 비용이 적게 소비되는 결과를 필터링 수행 여부를 나타내는 필터링 정보와 함께 출력하는 제1 인트라 예측과, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측 중 어느 하나를 수행하는 부호화 장치 및복호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 제2 참조화소 특성을 결정하고, 상기 제2 참조화소 특성에 기반하여, 상기 부호화 장치로부터 수신한 부호화 데이터로부터 상기 필터링 정보를 추출하고 상기 필터링 정보에 근거하여 상기 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과 중 어느 하나를 출력하는 제3 인트라 예측과, 상기 부호화 데이터에 상기 필터링 정보가 존재하지 않는 것으로 판단하고 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제4 인트라 예측 중 어느 하나를 수행하는 복호화 장치를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 및 복호화 장치.
- 인트라 예측을 이용한 부호화 장치에 있어서,부호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 참조화소 특성을 결정하고, 상기 참조화소 특성에 기반하여 상기 적어도 하나 이상의 참조화소에 대한 적응적 필터링 적용 여부를 결정하는 참조화소 특성 추출부상기 참조화소 특성 추출부에서 적응적 필터링을 적용하기로 결정한 경우, 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 비교하여 비용이 적게 소비되는 결과를 필터링 수행 여부를 나타내는 필터링 정보와 함께 출력하는 제1 인트라 예측부 및상기 참조화소 특성 추출부에서 적응적 필터링을 적용하지 않기로 결정한 경우, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측부를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 제 2 항에 있어서,상기 참조화소 특성 추출부는, 상기 적어도 하나 이상의 참조화소들의 통계적 특성을 이용하여 상기 참조화소 특성을 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 제 3 항에 있어서,상기 참조화소 특성 추출부는, 상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인 경우, 적응적 필터링을 적용하지 않기로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 제 2 항에 있어서,상기 참조화소 특성 추출부는, 상기 인접블록에 윤곽선이 존재하는지 여부를 검출하여, 윤곽선이 존재하는 경우 적응적 필터링을 적용하지 않기로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 제 2 항에 있어서,상기 참조화소 특성 추출부는,상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인지 여부를 판단하는 통계적 특성 추출부상기 인접블록에 윤곽선이 존재하는지 여부를 검출하는 윤곽선 검출부 및상기 통계적 특성 추출부가 상기 분산이 상기 기 설정된 임계값 이하라고 판단하거나 상기 윤곽선 검출부가 윤곽선을 검출한 경우에 적응적 필터링을 적용하지 않기로 결정하는 필터링 결정부를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 제 2 항에 있어서,상기 제1 인트라 예측부는, 율-왜곡 및 데이터를 부호화하는 데에 소요되는 비트량 중 적어도 어느 하나의 방법에 의해 상기 비용을 산출하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 장치.
- 인트라 예측을 이용한 복호화 장치에 있어서,복호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 참조화소 특성을 결정하고, 상기 참조화소 특성에 기반하여 상기 적어도 하나 이상의 참조화소에 대한 적응적 필터링 적용 여부를 결정하는 참조화소 특성 추출부상기 참조화소 특성 추출부에서 적응적 필터링이 적용된 것으로 결정한 경우, 부호화 장치로부터 수신한 부호화 데이터로부터 필터링 정보를 추출하고, 추출된 필터링 정보에 근거하여 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과 중 어느 하나를 출력하는 제1 인트라 예측부 및상기 참조화소 특성 추출부에서 적응적 필터링이 적용되지 않은 것으로 결정한 경우, 상기 부호화 데이터에 상기 필터링 정보가 존재하지 않는 것으로 판단하고, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측부를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 장치.
- 제 9 항에 있어서,상기 참조화소 특성 추출부는, 상기 적어도 하나 이상의 참조화소들의 통계적 특성을 이용하여 상기 참조화소 특성을 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 장치.
- 제 10 항에 있어서,상기 참조화소 특성 추출부는, 상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인 경우, 적응적 필터링을 적용하지 않은 것으로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 장치.
- 제 9 항에 있어서,상기 참조화소 특성 추출부는, 상기 인접블록에 윤곽선이 존재하는지 여부를 검출하여, 윤곽선이 존재하는 경우 적응적 필터링을 적용하지 않은 것으로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 장치.
- 제 9 항에 있어서,상기 참조화소 특성 추출부는,상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인지 여부를 판단하는 통계적 특성 추출부상기 인접블록에 윤곽선이 존재하는지 여부를 검출하는 윤곽선 검출부 및상기 통계적 특성 추출부가 상기 분산이 상기 기 설정된 임계값 이하라고 판단하거나 상기 윤곽선 검출부가 윤곽선을 검출한 경우에 적응적 필터링을 적용하지 않기로 결정하는 필터링 결정부를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 장치.
- 인트라 예측을 이용한 부호화 및 복호화 방법에 있어서,부호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 제1 참조화소 특성을 결정하고, 상기 제1 참조화소 특성에 기반하여, 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 비교하여 비용이 적게 소비되는 결과를 필터링 수행 여부를 나타내는 필터링 정보와 함께 출력하는 제1 인트라 예측과, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측 중 어느 하나를 수행하는 부호화 단계 및복호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 제2 참조화소 특성을 결정하고, 상기 제2 참조화소 특성에 기반하여, 상기 부호화 장치로부터 수신한 부호화 데이터로부터 상기 필터링 정보를 추출하고 상기 필터링 정보에 근거하여 상기 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과 중 어느 하나를 출력하는 제3 인트라 예측과, 상기 부호화 데이터에 상기 필터링 정보가 존재하지 않는 것으로 판단하고 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제4 인트라 예측 중 어느 하나를 수행하는 복호화 단계를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 및 복호화 방법.
- 인트라 예측을 이용한 부호화 방법에 있어서,부호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 참조화소 특성을 결정하고, 상기 참조화소 특성에 기반하여 상기 적어도 하나 이상의 참조화소에 대한 적응적 필터링 적용 여부를 결정하는 참조화소 특성 추출 단계상기 참조화소 특성 추출 단계에서 적응적 필터링을 적용하기로 결정한 경우, 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 비교하여 비용이 적게 소비되는 결과를 필터링 수행 여부를 나타내는 필터링 정보와 함께 출력하는 제1 인트라 예측 단계 및상기 참조화소 특성 추출 단계에서 적응적 필터링을 적용하지 않기로 결정한 경우, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측 단계를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 제 15 항에 있어서,상기 참조화소 특성 추출 단계는, 상기 적어도 하나 이상의 참조화소들의 통계적 특성을 이용하여 상기 참조화소 특성을 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 제 16 항에 있어서,상기 참조화소 특성 추출 단계는, 상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인 경우, 적응적 필터링을 적용하지 않기로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 제 15 항에 있어서,상기 참조화소 특성 추출 단계는, 상기 인접블록에 윤곽선이 존재하는지 여부를 검출하여, 윤곽선이 존재하는 경우 적응적 필터링을 적용하지 않기로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 제 15 항에 있어서,상기 참조화소 특성 추출 단계는,상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인지 여부를 판단하는 통계적 특성 추출 단계상기 인접블록에 윤곽선이 존재하는지 여부를 검출하는 윤곽선 검출 단계 및상기 통계적 특성 추출 단계에서 상기 분산이 상기 기 설정된 임계값 이하라고 판단하거나 상기 윤곽선 검출 단계에서 윤곽선을 검출한 경우에 적응적 필터링을 적용하지 않기로 결정하는 필터링 결정 단계를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 제 15 항에 있어서,상기 제1 인트라 예측 단계는, 율-왜곡 및 데이터를 부호화하는 데에 소요되는 비트량 중 적어도 어느 하나의 방법에 의해 상기 비용을 산출하는 것을 특징으로 하는 인트라 예측을 이용한 부호화 방법.
- 인트라 예측을 이용한 복호화 방법에 있어서,복호화를 수행할 대상블록의 인접블록에 포함된 적어도 하나 이상의 참조화소를 입력받아 참조화소 특성을 결정하고, 상기 참조화소 특성에 기반하여 상기 적어도 하나 이상의 참조화소에 대한 적응적 필터링 적용 여부를 결정하는 참조화소 특성 추출 단계상기 참조화소 특성 추출 단계에서 적응적 필터링이 적용된 것으로 결정한 경우, 부호화 장치로부터 수신한 부호화 데이터로부터 필터링 정보를 추출하고, 추출된 필터링 정보에 근거하여 고주파 제거 필터링을 수행한 참조화소를 이용하여 인트라 예측을 수행한 결과와 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과 중 어느 하나를 출력하는 제1 인트라 예측 단계 및상기 참조화소 특성 추출 단계에서 적응적 필터링이 적용되지 않은 것으로 결정한 경우, 상기 부호화 데이터에 상기 필터링 정보가 존재하지 않는 것으로 판단하고, 상기 고주파 제거 필터링을 수행하지 않은 참조화소를 이용하여 인트라 예측을 수행한 결과를 출력하는 제2 인트라 예측 단계를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 방법.
- 제 22 항에 있어서,상기 참조화소 특성 추출 단계는, 상기 적어도 하나 이상의 참조화소들의 통계적 특성을 이용하여 상기 참조화소 특성을 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 방법.
- 제 23 항에 있어서,상기 참조화소 특성 추출 단계는 상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인 경우, 적응적 필터링을 적용하지 않은 것으로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 방법.
- 제 22 항에 있어서,상기 참조화소 특성 추출 단계는, 상기 인접블록에 윤곽선이 존재하는지 여부를 검출하여, 윤곽선이 존재하는 경우 적응적 필터링을 적용하지 않은 것으로 결정하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 방법.
- 제 22 항에 있어서,상기 참조화소 특성 추출 단계는,상기 적어도 하나 이상의 참조화소들의 분산이 기 설정된 임계값 이하인지 여부를 판단하는 통계적 특성 추출 단계상기 인접블록에 윤곽선이 존재하는지 여부를 검출하는 윤곽선 검출 단계 및상기 통계적 특성 추출 단계에서 상기 분산이 상기 기 설정된 임계값 이하라고 판단하거나 상기 윤곽선 검출 단계에서 윤곽선을 검출한 경우에 적응적 필터링을 적용하지 않기로 결정하는 필터링 결정 단계를 포함하는 것을 특징으로 하는 인트라 예측을 이용한 복호화 방법.
- 제 15 항 내지 제 21 항 중 어느 하나의 부호화 방법이 프로그램으로 기록된 컴퓨터로 읽을 수 있는 기록매체.
- 제 22 항 내지 제26항 중 어느 하나의 복호화 방법이 프로그램으로 기록된 컴퓨터로 읽을 수 있는 기록매체.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/819,153 US9179146B2 (en) | 2010-08-26 | 2011-08-26 | Encoding and decoding device and method using intra prediction |
US14/859,970 US20160014409A1 (en) | 2010-08-26 | 2015-09-21 | Encoding and decoding device and method using intra prediction |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020100083026A KR101663764B1 (ko) | 2010-08-26 | 2010-08-26 | 인트라 예측을 이용한 부호화 및 복호화 장치와 방법 |
KR10-2010-0083026 | 2010-08-26 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/819,153 A-371-Of-International US9179146B2 (en) | 2010-08-26 | 2011-08-26 | Encoding and decoding device and method using intra prediction |
US14/859,970 Continuation US20160014409A1 (en) | 2010-08-26 | 2015-09-21 | Encoding and decoding device and method using intra prediction |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2012026794A2 true WO2012026794A2 (ko) | 2012-03-01 |
WO2012026794A3 WO2012026794A3 (ko) | 2012-05-31 |
Family
ID=45723952
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2011/006346 WO2012026794A2 (ko) | 2010-08-26 | 2011-08-26 | 인트라 예측을 이용한 부호화 및 복호화 장치와 방법 |
Country Status (3)
Country | Link |
---|---|
US (2) | US9179146B2 (ko) |
KR (1) | KR101663764B1 (ko) |
WO (1) | WO2012026794A2 (ko) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2567860A (en) * | 2017-10-27 | 2019-05-01 | Sony Corp | Image data encoding and decoding |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102595118B (zh) * | 2011-01-14 | 2015-04-08 | 华为技术有限公司 | 一种编解码中的预测方法和预测器 |
US10659817B2 (en) * | 2013-07-15 | 2020-05-19 | Hfi Innovation Inc. | Method of sample adaptive offset processing for video coding |
KR101530774B1 (ko) | 2013-09-30 | 2015-06-22 | 연세대학교 산학협력단 | 영상 부호화 및 복호화 방법, 장치 및 시스템 |
KR101530782B1 (ko) | 2013-12-03 | 2015-06-22 | 연세대학교 산학협력단 | 영상 부호화 및 복호화 방법, 장치 및 시스템 |
CN103888764B (zh) * | 2014-03-14 | 2017-02-15 | 西安交通大学 | 一种自适应补偿视频压缩失真的系统及方法 |
US10390020B2 (en) | 2015-06-08 | 2019-08-20 | Industrial Technology Research Institute | Video encoding methods and systems using adaptive color transform |
CA3005417A1 (en) | 2015-11-17 | 2017-05-26 | Huawei Technologies Co., Ltd. | Method and apparatus for video coding |
US20190037217A1 (en) * | 2016-02-16 | 2019-01-31 | Samsung Electronics Co., Ltd. | Video encoding method and apparatus, and decoding method and apparatus therefor |
USD836156S1 (en) | 2016-03-04 | 2018-12-18 | Samsung Electronics Co., Ltd. | Stand for camera |
CN116320494A (zh) | 2016-11-28 | 2023-06-23 | 韩国电子通信研究院 | 用于滤波的方法和装置 |
WO2018097700A1 (ko) * | 2016-11-28 | 2018-05-31 | 한국전자통신연구원 | 필터링을 위한 방법 및 장치 |
CN115484458A (zh) * | 2017-10-20 | 2022-12-16 | 韩国电子通信研究院 | 图像编码、解码方法以及存储比特流的记录介质 |
CN112399177B (zh) * | 2020-11-17 | 2022-10-28 | 深圳大学 | 一种视频编码方法、装置、计算机设备及存储介质 |
CN112399176B (zh) * | 2020-11-17 | 2022-09-16 | 深圳市创智升科技有限公司 | 一种视频编码方法、装置、计算机设备及存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060003794A (ko) * | 2004-07-07 | 2006-01-11 | 삼성전자주식회사 | 비디오 코딩 방법과 디코딩 방법, 및 비디오 인코더와디코더 |
KR20060091436A (ko) * | 2005-02-15 | 2006-08-21 | (주)씨앤에스 테크놀로지 | 동영상 표준 부호화 방식의 성능 향상을 위한 잔여신호 필터링 방법 |
KR20060129096A (ko) * | 2001-09-14 | 2006-12-14 | 샤프 가부시키가이샤 | 경계강도에 기초한 적응 필터링 |
KR20100045007A (ko) * | 2008-10-23 | 2010-05-03 | 에스케이 텔레콤주식회사 | 동영상 부호화/복호화 장치, 이를 위한 인트라 예측 방향에기반한 디블록킹 필터링 장치 및 필터링 방법, 및 기록 매체 |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6188799B1 (en) * | 1997-02-07 | 2001-02-13 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for removing noise in still and moving pictures |
JPH11243491A (ja) * | 1998-02-26 | 1999-09-07 | Agency Of Ind Science & Technol | 適応進化型画像圧縮符号化装置 |
US6983079B2 (en) * | 2001-09-20 | 2006-01-03 | Seiko Epson Corporation | Reducing blocking and ringing artifacts in low-bit-rate coding |
US20030161407A1 (en) * | 2002-02-22 | 2003-08-28 | International Business Machines Corporation | Programmable and adaptive temporal filter for video encoding |
US20040158878A1 (en) * | 2003-02-07 | 2004-08-12 | Viresh Ratnakar | Power scalable digital video decoding |
JP3997171B2 (ja) * | 2003-03-27 | 2007-10-24 | 株式会社エヌ・ティ・ティ・ドコモ | 動画像符号化装置、動画像符号化方法、動画像符号化プログラム、動画像復号装置、動画像復号方法、及び動画像復号プログラム |
US7317842B2 (en) * | 2003-10-30 | 2008-01-08 | Samsung Electronics Co., Ltd. | Global and local statistics controlled noise reduction system |
KR20050049064A (ko) * | 2003-11-21 | 2005-05-25 | 삼성전자주식회사 | 영상신호의 노이즈 측정장치 및 그 측정방법 |
US7460596B2 (en) * | 2004-04-29 | 2008-12-02 | Mediatek Incorporation | Adaptive de-blocking filtering apparatus and method for MPEG video decoder |
US8208564B2 (en) * | 2005-06-24 | 2012-06-26 | Ntt Docomo, Inc. | Method and apparatus for video encoding and decoding using adaptive interpolation |
CN101361370B (zh) * | 2005-11-30 | 2010-12-01 | 株式会社东芝 | 图像编码/图像解码方法以及图像编码/图像解码装置 |
KR100800888B1 (ko) * | 2005-12-08 | 2008-02-04 | 연세대학교 산학협력단 | 패턴 정보를 이용한 영상잡음 제거방법 |
US20080279279A1 (en) * | 2007-05-09 | 2008-11-13 | Wenjin Liu | Content adaptive motion compensated temporal filter for video pre-processing |
US8576906B2 (en) * | 2008-01-08 | 2013-11-05 | Telefonaktiebolaget L M Ericsson (Publ) | Adaptive filtering |
US20100272191A1 (en) * | 2008-01-14 | 2010-10-28 | Camilo Chang Dorea | Methods and apparatus for de-artifact filtering using multi-lattice sparsity-based filtering |
US10123050B2 (en) * | 2008-07-11 | 2018-11-06 | Qualcomm Incorporated | Filtering video data using a plurality of filters |
CN102165760B (zh) * | 2008-09-25 | 2014-08-06 | 松下电器产业株式会社 | 图像编码装置、数字静态相机、数字摄像机、摄像元件以及图像编码方法 |
US8498330B2 (en) * | 2009-06-29 | 2013-07-30 | Hong Kong Applied Science and Technology Research Institute Company Limited | Method and apparatus for coding mode selection |
KR101510108B1 (ko) * | 2009-08-17 | 2015-04-10 | 삼성전자주식회사 | 영상의 부호화 방법 및 장치, 그 복호화 방법 및 장치 |
JP4834776B2 (ja) * | 2010-03-17 | 2011-12-14 | 株式会社東芝 | 画像処理装置及び画像処理方法 |
WO2011126284A2 (en) * | 2010-04-05 | 2011-10-13 | Samsung Electronics Co., Ltd. | Method and apparatus for encoding video by using adaptive prediction filtering, method and apparatus for decoding video by using adaptive prediction filtering |
JP5875979B2 (ja) * | 2010-06-03 | 2016-03-02 | シャープ株式会社 | フィルタ装置、画像復号装置、画像符号化装置、および、フィルタパラメータのデータ構造 |
US8837577B2 (en) * | 2010-07-15 | 2014-09-16 | Sharp Laboratories Of America, Inc. | Method of parallel video coding based upon prediction type |
US8848779B2 (en) * | 2010-07-15 | 2014-09-30 | Sharp Laboratories Of America, Inc. | Method of parallel video coding based on block size |
US9008175B2 (en) * | 2010-10-01 | 2015-04-14 | Qualcomm Incorporated | Intra smoothing filter for video coding |
US10142630B2 (en) * | 2010-12-10 | 2018-11-27 | Texas Instruments Incorporated | Mode adaptive intra prediction smoothing in video coding |
-
2010
- 2010-08-26 KR KR1020100083026A patent/KR101663764B1/ko active IP Right Grant
-
2011
- 2011-08-26 WO PCT/KR2011/006346 patent/WO2012026794A2/ko active Application Filing
- 2011-08-26 US US13/819,153 patent/US9179146B2/en active Active
-
2015
- 2015-09-21 US US14/859,970 patent/US20160014409A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20060129096A (ko) * | 2001-09-14 | 2006-12-14 | 샤프 가부시키가이샤 | 경계강도에 기초한 적응 필터링 |
KR20060003794A (ko) * | 2004-07-07 | 2006-01-11 | 삼성전자주식회사 | 비디오 코딩 방법과 디코딩 방법, 및 비디오 인코더와디코더 |
KR20060091436A (ko) * | 2005-02-15 | 2006-08-21 | (주)씨앤에스 테크놀로지 | 동영상 표준 부호화 방식의 성능 향상을 위한 잔여신호 필터링 방법 |
KR20100045007A (ko) * | 2008-10-23 | 2010-05-03 | 에스케이 텔레콤주식회사 | 동영상 부호화/복호화 장치, 이를 위한 인트라 예측 방향에기반한 디블록킹 필터링 장치 및 필터링 방법, 및 기록 매체 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2567860A (en) * | 2017-10-27 | 2019-05-01 | Sony Corp | Image data encoding and decoding |
Also Published As
Publication number | Publication date |
---|---|
US20130215958A1 (en) | 2013-08-22 |
KR101663764B1 (ko) | 2016-10-07 |
WO2012026794A3 (ko) | 2012-05-31 |
KR20120041287A (ko) | 2012-05-02 |
US20160014409A1 (en) | 2016-01-14 |
US9179146B2 (en) | 2015-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2012026794A2 (ko) | 인트라 예측을 이용한 부호화 및 복호화 장치와 방법 | |
WO2010050706A2 (ko) | 움직임 벡터 부호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2010120113A2 (ko) | 예측 모드 선택 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2013062197A1 (ko) | 영상 복호화 장치 | |
WO2010032941A2 (ko) | 인트라 예측 모드의 예측 가능성을 이용한 영상 부호화/복호화 장치 및 방법 | |
WO2010027182A2 (ko) | 서브블록 내 임의 화소를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2012144876A2 (ko) | 인루프 필터링을 적용한 예측 방법을 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2010038961A2 (ko) | 복수 개의 움직임 벡터 추정을 이용한 움직임 벡터 부호화/복호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2011031030A2 (ko) | 움직임 벡터 부호화/복호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2011004986A2 (ko) | 영상 부호화/복호화 방법 및 장치 | |
WO2011145819A2 (ko) | 영상 부호화/복호화 장치 및 방법 | |
WO2011031044A2 (ko) | 고해상도 동영상의 부호화/복호화 방법 및 장치 | |
WO2011019234A2 (en) | Method and apparatus for encoding and decoding image by using large transformation unit | |
WO2013109039A1 (ko) | 가중치예측을 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2011087323A2 (en) | Method and apparatus for encoding and decoding image by using large transform unit | |
WO2011126285A2 (ko) | 부호화 모드에 대한 정보를 부호화, 복호화하는 방법 및 장치 | |
WO2012046979A2 (ko) | 주파수 마스크 테이블을 이용한 주파수변환 블록 부호화 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2013069996A1 (ko) | 변환을 이용한 주파수 도메인 상의 적응적 루프 필터를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2013062198A1 (ko) | 영상 복호화 장치 | |
WO2012011672A2 (ko) | 확장된 스킵모드를 이용한 영상 부호화/복호화 방법 및 장치 | |
WO2013002550A2 (ko) | 고속 코딩 단위(Coding Unit) 모드 결정을 통한 부호화/복호화 방법 및 장치 | |
WO2011037337A2 (ko) | 저주파수 성분을 고려한 영상 부호화/복호화 방법 및 장치 | |
WO2011021910A2 (ko) | 인트라 예측 부호화/복호화 방법 및 장치 | |
WO2017043769A1 (ko) | 부호화 장치, 복호화 장치 및 그 부호화 방법 및 복호화 방법 | |
WO2011108879A2 (ko) | 영상 부호화 장치, 그 영상 부호화 방법, 영상 복호화 장치 및 그 영상 복호화 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11820221 Country of ref document: EP Kind code of ref document: A2 |
|
NENP | Non-entry into the national phase in: |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13819153 Country of ref document: US |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11/06/2013) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 11820221 Country of ref document: EP Kind code of ref document: A2 |