Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
  • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/103—Selection of coding mode or of prediction mode
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
  • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock

Definitions

• the present invention relates to encoding and decoding of moving picture based on adaptive scanning; and, more particularly, to a moving picture encoding/decoding apparatus that can increase a compression rate by performing intra prediction onto blocks of a predetermined size, and adaptively scanning coefficients acquired from Discrete Cosine Transform
• the encoding/decoding is performed on the basis of a unit of macro blocks or a unit of a sub-block.
• One frame includes a plurality of macro blocks, and the sub-block is acquired by dividing a macro block into two or four.
• the encoding and decoding are carried out based on temporal prediction and spatial prediction.
• Temporal prediction is predicting motion of the macro blocks of a current frame by referring to macro blocks of adjacent frames.
• Spatial prediction is predicting a macro block of a current from to be encoded based on adjacent macro blocks within the current frame.
• the spatial prediction is also referred to as intra prediction.
• the intra predication takes advantage of a feature that adjacent pixels of a pixel to be predicted is highly likely to have a similar value.
• a pixel value of a current block is predicted based on a prediction mode considering nine directionalities .
• Fig. 1 is a view showing an intra prediction mode for 4 x 4 blocks and 8 x 8 blocks in the H.264.
• the arrows signify predictional directions.
• a prediction process in the vertical mode and the horizontal mode will be described, when intra prediction is performed onto 4 x 4 blocks.
• Fig. 2 is a view for describing a pixel prediction in the horizontal mode.
• pixels a, e, i, and m 302, 304, 306 and 308 are predicted from an adjacent pixel A in the vertical direction.
• pixels b, f, j and n are predicted from a pixel B
• pixels c, g, k and o are predicted from a pixel C
• pixels d, h, 1 and p are predicted from a pixel D.
• Fig. 3 is a view for describing a pixel prediction process in the horizontal mode.
• pixels a, b, c and d 312, 314, 316 and 318 are predicted from an adjacent pixel I in the horizontal direction.
• pixels e, f, g and h are predicted from a pixel J
• i, j, k and 1 are predicted from a pixel K pixels
• pixels m, n, o and p are predicted from a pixel L.
• a conventional moving picture encoder performs entropy encoding by performing Discrete Cosine Transform (DCT) and quantization onto a residue signal, which is obtained by differentially dividing a predicted signal and a current signal, to thereby produce a coefficient and performing zigzag scanning onto the coefficient.
• DCT Discrete Cosine Transform
• the correlation of the residue signal is likely to be high in a horizontal direction or a vertical direction according to whether the prediction mode is a horizontal mode or a vertical mode. Therefore, the conventional encoding method using a fixed zigzag scanning has a drawback that it is not appropriate for acquiring a high compression rate.
• an object of the present invention to provide a moving picture encoding apparatus and method that can increase a compression rate based on adaptive scanning by performing intra prediction onto blocks of a predetermined size, and adaptively scanning a coefficient acquired from Discrete Cosine Transform (DCT) of a residue signal and quantization according to the intra prediction mode, and a decoding apparatus and method therefor.
• DCT Discrete Cosine Transform
• an apparatus for encoding moving picture based on adaptive scanning which includes: a mode selecting means for selecting and outputting a prediction mode; a predicting means for predicting pixel values of pixels to be encoded of an input video based on the prediction mode to thereby output a residue signal block; a transform/quantization means for performing Discrete Cosine Transform (DCT) onto the residue signal block and quantizing the transformed residue signal block; and an encoding means for adaptively scanning and encoding the quantized residue signal block based on the prediction mode.
• DCT Discrete Cosine Transform
• an apparatus for decoding moving picture based on adaptive scanning which includes: an entropy decoder for receiving encoded bitstream, decoding the encoded bitstream based on an entropy decoding method, and outputting decoded signals; a scanning method detector for receiving the decoded signals from the entropy decoder, acquiring a scanning method used in the encoding of the decoded signals, and outputting the scanning method information along with the decoded signals; and a video recovering unit for recovering the decoded signals based on the scanning method and outputting a recovered video, wherein the scanning method is an adaptive scanning where different scanning methods are applied based on an intra prediction mode .
• a method for encoding moving pictures based on adaptive scanning which includes the steps of: a) selecting a prediction mode; b) predicting pixel values of pixels to be encoded of an input video based on the selected prediction mode and outputting a residue signal block; c) performing Discrete Cosine Transform (DCT) onto the residue signal block and quantizing the transformed residue signal block; d) adaptively scanning the quantized residue signal block based on the prediction mode and outputting scanned coefficients; and e) encoding the scanned coefficients.
• DCT Discrete Cosine Transform
• the present invention can improve an encoding compression rate remarkably by performing intra prediction onto blocks of a predetermined size, and adaptively scanning coefficients acquired from Discrete Cosine Transform (DCT) of a residue signal and quantization differently according to the intra prediction mode, and a method thereof.
• DCT Discrete Cosine Transform
• Fig. 1 is a view showing an intra prediction mode for 4 x 4 blocks and 8 x 8 blocks in H.264;
• Fig. 2 is a view describing a pixel prediction process in a vertical mode
• Fig. 3 is a view describing a pixel prediction process in a horizontal mode
• Fig. 4 is a block view illustrating a moving picture encoding apparatus in accordance with an embodiment of the present invention
• Fig. 5 is a view showing a conventional zigzag scanning
• Fig. 6 is a view showing a horizontal preference scanning in accordance with an embodiment of the present invention
• Fig. 7 is a view showing a vertical preference scanning in accordance with an embodiment of the present invention.
• Fig. 8 is a flowchart describing a moving picture encoding method using adaptive scanning in accordance with an embodiment of the present invention
• Fig. 9 is a flowchart describing an adaptive scanning in accordance with an embodiment of the present invention.
• Fig. 10 is a block view illustrating a moving picture decoding apparatus in accordance with an embodiment of the present invention.
• Functions of various devices illustrated in the drawings including a functional block expressed as a processor or a similar concept can be provided not only by using hardware dedicated to the functions, but also by using hardware capable of running proper software for the functions.
• a function When a function is provided by a processor, the function may be provided by a single dedicated processor, single shared processor, or a plurality of individual processors, part of which can be shared.
• the apparent use of a term, 'processor' , 'control' or similar concept should not be understood to exclusively refer to a piece of hardware capable of running software, but should be understood to include a digital signal processor (DSP), hardware, and ROM, RAM and non-volatile memory for storing software, implicatively .
• DSP digital signal processor
• Other known and commonly used hardware may be included therein, too.
• Fig. 4 is a block view illustrating a moving picture encoding apparatus in accordance with an embodiment of the present invention.
• the moving picture encoding apparatus includes an intra predictor 110, a mode selector 120, a Discrete Cosine Transform (DCT) /quantization unit 130, and an entropy coding unit 140.
• intra predictor 110 a mode selector 120
• mode selector 120 a Discrete Cosine Transform (DCT) /quantization unit 130
• entropy coding unit 140 an entropy coding unit 140.
• the mode selector 120 selects an optimal prediction mode among the aforementioned intra prediction modes and outputs it to the intra predictor 110. In other words, the mode selector 120 selects one among diverse encoding prediction modes available during 4 x 4 intra prediction, 16 x 16 intra prediction and 8 x 8 intra prediction. Generally, it selects one prediction mode based on rate- distortion optimization.
• the prediction modes include a vertical mode, a horizontal mode, a DC mode, a Diagonal_Down_Left mode, a Diagonal_Down_Right mode, a Vertical_Right mode, a Horizontal_Down mode, a Vertical_Left mode, and a Horizontal_Up mode, which are intra 4 x 4 luminance encoding modes of the H.264, and a vertical mode, a horizontal mode, a plane mode and a DC mode, which are intra 16 x 16 luminance encoding modes.
• the prediction modes include a vertical mode, a horizontal mode, a plane mode and a DC mode, which are intra M x N chrominance encoding modes of the H.264.
• the intra predictor 110 performs prediction on an input image according to the prediction mode inputted from the mode predictor 120 and outputs a residue signal block which represents a difference between the pixel value of a macro block of a current frame to be encoded and a predicted pixel value.
• a residue signal block which represents a difference between the pixel value of a macro block of a current frame to be encoded and a predicted pixel value.
• 4 x 4 intra prediction is performed onto the pixels of a luminance block
• 8 x 8 intra prediction is performed onto the pixels of a chrominance block.
• the DCT/quantization unit 130 performs DCT and quantization onto the residue signal block inputted from the intra predictor 110 and outputs it to the entropy encoder 140.
• the entropy encoder 140 arranges coefficients by adaptively scanning the quantized residue signal block regardless of the kind of the prediction mode, performs entropy encoding, and outputs encoded signals.
• the entropy encoding is an encoding method which increases the data compression rate by allocating a few bits to data with a high occurrence frequency number and many- bits to data with a low occurrence frequency number.
• the entropy encoding that may be applied to the present invention includes context adaptive variable length coding (CAVLC) and context-based adaptive binary arithmetic coding (CABAC).
• Fig. 5 is a view describing a conventional zigzag scanning. The conventional zigzag scanning of Fig.
• a significant coefficient of DCT is highly likely to be positioned in the left upper part.
• the correlation property of the residue signal may increase in a vertical or a horizontal direction.
• the significant coefficient mainly appears around a first row.
• the significant coefficient mainly appears around a first column. Therefore, another scanning method that can replace the conventional zigzag scanning is required.
• embodiments of adaptive scanning will be described according to the kinds of the intra prediction mode.
• Fig. 6 is a view showing a horizontal preference scanning in accordance with an embodiment of the present invention
• Fig. 7 is a view showing a vertical preference scanning in accordance with an embodiment of the present invention.
• the entropy encoder 140 uses the horizontal preference scanning method shown in Fig. 6, when the intra prediction mode is a vertical mode.
• the entropy encoder 140 uses the vertical preference scanning method shown in Fig. 7.
• the entropy encoder 140 uses the conventional zigzag scanning, arranges coefficients, performs entropy encoding, and outputs encoded signals.
• the horizontal preference scanning method illustrated in Fig. 6 all the blocks of the first row are scanned and then the subsequent scanning is performed in a sequence from all the blocks of the first row, followed by the first to third blocks in the second row, the second block and the first block in the third row, the first and second blocks in the fourth row, the third block in the third row, the fourth block in the second row, the fourth block in the third row, and the third and fourth blocks in the fourth row. Therefore, since the horizontal preference scanning of the present invention scans all the blocks in the first row prior to the other rows, it has a high correlation in the row direction and it is appropriate for the vertical mode where the significant coefficients are mainly positioned in around the first row.
• the vertical preference scanning of the present invention has a high correlation in the column direction and it is appropriate for the vertical mode where the significant coefficients are mainly positioned in around the first column.
• the present invention determines the scanning method to be applied based on the intra mode, it scarcely affects the existing syntax and the apparatus of the present invention can be realized by applying a little modification to the semantics of a scanning method in the encoding and decoding. Since those skilled in the art of a moving picture encoding/decoding technology such as the H.264 can easily realize the adaptive scanning based on an intra prediction mode, which is suggested in the present invention, detailed description on it will not be provided herein.
• Fig. 8 is a flowchart describing a moving picture encoding method using adaptive scanning in accordance with an embodiment of the present invention.
• the intra predictor 110 performs prediction onto the inputted image based on the selected prediction mode at step S530, and creates a residue signal block having a difference value between a pixel value in a macro block of a current frame to be encoded and a predicted pixel value at step S540.
• the DCT/quantization unit 130 performs DCT onto the residue signal block and quantizes the transformed residue signal block.
• the entropy encoder 140 adaptively scans the quantized residue signal block based on the prediction mode at step S560, performs entropy encoding onto the scanned coefficient, and outputs the entropy- encoded coefficient at step S570.
• Fig. 9 is a flowchart describing an adaptive scanning in accordance with an embodiment of the present invention.
• step S610 it is determined at step S610 whether the prediction mode is a vertical mode.
• step S620 horizontal preference scanning is performed at step S620.
• step S630 it is determined at step S630 whether the prediction mode is a horizontal mode.
• Fig. 10 is a block view illustrating a moving picture decoding apparatus in accordance with an embodiment of the present invention.
• the moving picture decoding apparatus of the present invention includes an entropy decoder 210, a scanning method detector 220, and an image recovery unit 230.
• the entropy decoder 210 receives encoded bitstream and decodes it by using an entropy decoding method such as Context Adaptive Variable Length Coding (CAVLC) and Context-based Adaptive Binary Arithmetic Coding (CABAC).
• CAVLC Context Adaptive Variable Length Coding
• CABAC Context-based Adaptive Binary Arithmetic Coding
• the scanning method detector 220 receives the decoded signal from the entropy decoder 210, acquires information on how the decoded signal was scanned in the encoding process, and transmits the scanning method information to the image recovery unit 230 along with the decoded signal.
• the image recovery unit 230 recovers the decoded signal based on the scanning method and outputs a recovered image.
• Table 2 compares compression rates, when the test images are encoded based on the encoding method using the adaptive scanning and the conventional encoding method using the H.264 zigzag scanning under the aforementioned experimental conditions .
• the moving picture encoding/decoding method described above may be authored in the form of a computer program.
• the codes and code segments that form the program may be easily inferred by computer programmers of the art to which the present invention pertains.
• the program is stored in a computer- readable recording medium and it can be read and executed by a computer to realize the moving picture encoding/decoding method.
• the data storage media include magnetic recording media, optical recording media, and carrier wave media.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)

Priority Applications (12)

Applications Claiming Priority (2)

Related Child Applications (2)

Publications (1)

Family

ID=37962701

Family Applications (1)

Country Status (5)

Cited By (30)

Families Citing this family (39)

Citations (4)

Family Cites Families (26)

• 2006
  • 2006-10-19 EP EP14152251.6A patent/EP2733950A1/en not_active Ceased
  • 2006-10-19 EP EP14152254.0A patent/EP2733951A1/en not_active Ceased
  • 2006-10-19 JP JP2008536496A patent/JP5620641B2/ja active Active
  • 2006-10-19 EP EP06799334A patent/EP1949703A4/en not_active Ceased
  • 2006-10-19 WO PCT/KR2006/004260 patent/WO2007046644A1/en not_active Ceased
  • 2006-10-19 EP EP14152256.5A patent/EP2733952A1/en not_active Ceased
  • 2006-10-19 KR KR1020060101828A patent/KR100868476B1/ko active Active
  • 2006-10-19 US US12/090,699 patent/US8199819B2/en active Active
• 2008
  • 2008-09-22 KR KR1020080092738A patent/KR101095938B1/ko active Active
• 2012
  • 2012-05-11 US US13/469,536 patent/US8520729B2/en active Active
  • 2012-12-11 JP JP2012270597A patent/JP5674752B2/ja active Active
• 2013
  • 2013-06-05 US US13/910,639 patent/US9118892B2/en active Active
• 2014
  • 2014-01-20 JP JP2014007967A patent/JP5756537B2/ja active Active
• 2015
  • 2015-06-25 US US14/750,202 patent/US9838714B2/en active Active
• 2017
  • 2017-10-26 US US15/794,568 patent/US10187660B2/en active Active
• 2018
  • 2018-12-11 US US16/216,551 patent/US10575016B2/en active Active
• 2020
  • 2020-01-16 US US16/744,384 patent/US11134274B2/en active Active
• 2021
  • 2021-08-26 US US17/446,091 patent/US11729423B2/en active Active
• 2023
  • 2023-06-23 US US18/340,381 patent/US12137248B2/en active Active
• 2024
  • 2024-10-04 US US18/906,808 patent/US20250030893A1/en active Pending

Patent Citations (4)

Also Published As

Similar Documents

Legal Events