Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
  • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/117—Filters, e.g. for pre-processing or post-processing
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/136—Incoming video signal characteristics or properties
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
  • H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
  • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Definitions

• CODECs are video CODECs with deblocking filters.
• Video data is generally processed and transferred in the form of bit streams.
• a video encoder generally applies a block transform coding, such as a discrete cosine transform (“DCT”), to compress the raw data.
• a corresponding video decoder generally decodes the block transform encoded bit stream data, such as by applying an inverse discrete cosine transform (“IDCT”).
• Deblocking filters are often used in conjunction with block-based digital video compression systems.
• a deblocking filter can be applied inside the compression loop, where the filter is applied at the encoder and at the decoder. Alternatively, a deblocking filter can be applied after the compression loop at only the decoder.
• a typical deblocking filter works by applying a low-pass filter across the edge transition of a block where block transform coding (e.g., DCT) and quantization was performed.
• Deblocking filters can reduce the negative visual impact known as "blockiness" in decompressed video, but generally require a significant amount of computational complexity at the video decoder and/or encoder.
• An encoder and decoder are provided for encoding pixel data as a plurality of block transform coefficients and decoding encoded block transform coefficients to provide reconstructed pixel data, the encoder and/or decoder includes a conditional deblocking filter for filtering only block transitions meeting pre-selected pixel brightness level criteria.
• a corresponding method for a conditional deblocking filter includes receiving at least one first pixel adjacent to a block transition, providing a signal indicative of the brightness of the at least one first pixel, comparing the brightness signal with at least one of an upper brightness threshold and a lower brightness threshold, and conditionally filtering a plurality of adjacent pixels including the first pixel at the block transition in response to the brightness comparison.
• the present invention encompasses teaches a deblocking filter conditioned on pixel brightness in accordance with the following exemplary figures, in which:
• Figure 1 shows a block diagram for an exemplary encoder having an in-loop deblocking filter conditioned on pixel brightness
• Figure 2 shows a block diagram for an exemplary decoder having an in-loop deblocking filter conditioned on pixel brightness and usable with the encoder of Figure 1 ;
• Figure 3 shows a block diagram for an exemplary decoder having a postprocessing deblocking filter conditioned on pixel brightness
• Figure 4 shows flow diagram for an in-loop deblocking filter conditioned on pixel brightness in accordance with the principles of the present invention.
• Implementation of a deblocking filter generally requires a significant amount of computational complexity at the video decoder and/or encoder. Determination of whether or not to filter a particular edge transition and the particular filter used to perform the filtering operation each have a large impact on both the computation complexity and the perceived visual quality.
• Implementation of a deblocking filter in a block-based digital video compression system can be simplified by deciding whether or not to apply a low-pass filter at a block transition based on the brightness level of the pixels at the transition.
• the computational complexity can be reduced by omitting application of a deblocking filter to transitions were it would not improve the perceived visual quality.
• the present invention reduces the computational complexity of a deblocking filter without significantly impacting the perceived visual quality by deciding whether or not to apply a low-pass or deblocking filter at a block transition based on the brightness levels of the pixels at the transition.
• the strength of the particular deblocking filter to be applied depends upon the quantization parameter used to encode a given macroblock.
• ⁇ .264/AVC AVC video compression standard
• factors include whether the block was intra-coded or inter-coded, whether non-zero coefficients were present in the block, the magnitude of the difference in pixel values across the edge, and the magnitude of the difference in motion vectors of blocks across the edge.
• any switches shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
• the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.
• explicit use of the term "processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage. Other hardware, conventional and/or custom, may also be included.
• DSP digital signal processor
• ROM read-only memory
• RAM random access memory
• any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.
• any element expressed as a means for performing a specified function is intended to encompass any way of performing that function including, for example, a) a combination of circuit elements which performs that function or b) software in any form, including, therefore, firmware, microcode or the like, combined with appropriate circuitry for executing that software to perform the function.
• the invention as defined by such claims resides in the fact that the functionalities provided by the various recited means are combined and brought together in the manner which the claims call for. Applicant thus regards any means which can provide those functionalities as equivalent as those shown herein.
• an exemplary encoder having an in-loop deblocking filter conditioned on pixel brightness is indicated generally by the reference numeral 100.
• the encoder 100 includes a video input terminal 112 that is coupled in signal communication to a positive input of a summing block 114.
• the summing block 114 is coupled, in turn, to a function block 116 for implementing an integer transform to provide coefficients.
• the block 116 is coupled to an entropy coding block 118 for implementing entropy coding to provide an output bitstream.
• the block 116 is further coupled to an in-loop portion 120 at a scaling and inverse transform block 122.
• the block 122 is coupled to a summing block 124, which, in turn, is coupled to an intra- frame prediction block 126.
• the intra-frame prediction block 126 is switchably coupled to a switch 127, which, in turn, is coupled to a second input of the summing block 124 and to an inverting input of the summing block 114.
• the output of the summing block 124 is coupled to a conditional deblocking filter 140.
• the deblocking filter 140 is coupled to a frame store 128.
• the frame store 128 is coupled to a motion compensation block 130, which is coupled to a second alternative input of the switch 127.
• the video input terminal 112 is further coupled to a motion estimation block 119 to provide motion vectors.
• the deblocking filter 140 is coupled to a second input of the motion estimation block 119.
• the output of the motion estimation block 119 is coupled to the motion compensation block 130 as well as to a second input of the entropy coding block 118.
• the video input terminal 112 is further coupled to a coder control block 160.
• the coder control block 160 is coupled to control inputs of each of the blocks 116, 118, 119, 122, 126, 130, and 140 for providing control signals to control the operation of the encoder 100.
• an exemplary decoder having an in-loop deblocking filter conditioned on pixel brightness is indicated generally by the reference numeral 200.
• the decoder 200 includes an entropy decoding block 210 for receiving an input bitstream.
• the decoding block 210 is coupled for providing coefficients to an in-loop portion 220 at a scaling and inverse transform block 222.
• the block 222 is coupled to a summing block 224, which, in turn, is coupled to an intra-frame prediction block 226.
• the intra-frame prediction block 226 is switchably coupled to a switch 227, which, in turn, is coupled to a second input of the summing block 224.
• the output of the summing block 224 is coupled to a conditional deblocking filter 240 for providing output images.
• the deblocking filter 240 is coupled to a frame store 228.
• the frame store 228 is coupled to a motion compensation block 230, which is coupled to a second alternative input of the switch 227.
• the decoding block 210 is further coupled for providing motion vectors to a second input of the motion compensation block 230.
• the entropy decoding block 210 is further coupled for providing input to a decoder control block 262.
• the decoder control block 262 is coupled to control inputs of each of the blocks 222, 226, 230, and 240 for communicating control signals and controlling the operation of the decoder 200.
• an exemplary decoder having a post-processing deblocking filter conditioned on pixel brightness is indicated generally by the reference numeral 300.
• the decoder 300 includes an entropy decoding block 310 for receiving an input bitstream.
• the decoding block 310 is coupled for providing coefficients to an in-loop portion 320 at a scaling and inverse transform block 322.
• the block 322 is coupled to a summing block 324, which, in turn, is coupled to an intra-frame prediction block 326.
• the intra-frame prediction block 326 is switchably coupled to a switch 327, which, in turn, is coupled to a second input of the summing block 324.
• the output of the summing block 324 is coupled to a conditional deblocking filter 340 for providing output images.
• the summing block 324 is further coupled to a frame store 328.
• the frame store 328 is coupled to a motion compensation block 330, which is coupled to a second alternative input of the switch 327.
• the entropy encoding block 310 is further coupled for providing motion vectors to a second input of the motion compensation block 330.
• the entropy decoding block 310 is further coupled for providing input to a decoder control block 362.
• the decoder control block 362 is coupled to control inputs of each of the blocks 322, 326, 330, and 340 for communicating control signals and controlling the operation of the decoder 300.
• the processes for an exemplary deblocking filter responsive to pixel brightness is indicated generally by the reference numeral 400.
• the process 400 includes a start step 410 that passes control to an input step 412 for receiving at least one first pixel adjacent to a block transition.
• the input step 412 passes control to step 414 for providing a signal indicative of the brightness of the at least one first pixel.
• the step 414 passes control to a decision step 416 for comparing the brightness signal with an upper brightness threshold. If the brightness is greater than the upper threshold, no deblock filtering is performed and control passes to an end step 428. Otherwise, the step 416 passes control to a decision step 418 for comparing the brightness signal with a lower brightness threshold. If the brightness is less than the lower threshold, no deblock filtering is performed and control passes to an end step 428. Otherwise, the step 418 passes control to a function step 420 for receiving at least one second pixel adjacent to the first pixel and disposed on an opposite side of the block transition.
• the step 420 passes control to a function step 422 for measuring a brightness level difference between the first and second pixels.
• the step 422 passes control to a function step 424 for selecting a deblocking filter strength to be applied in response to the measured difference.
• the step 424 passes control to a function step 426 for conditionally filtering a plurality of adjacent pixels including the first pixel at the block transition in response to the brightness comparison.
• the step 426 passes control to the end step 428.
• the computational complexity of a deblocking filter in an image or video compression system is reduced by not performing deblocking filtering and/or reducing the filter strength for any given block in response to conditions applied to measures of the brightness values of the pixels at or near the block boundary transitions.
• a deblocking filter is not applied for pixel brightness levels below a minimum threshold or above a maximum threshold.
• the deblocking filter is not applied for pixel brightness levels, p, where p ⁇ Y min or p > Y max , and where Y m i n and Y max are the respective minimum and maximum brightness level thresholds.
• the value of p can be based on an individual pixel, or it can be based on an average of pixels across the transition.
• the threshold test can be applied separately for each pixel in a transition, and the application of the deblocking filter skipped only for blocks where all pixels at the transition exceed Y max , or where all pixels at the transition are lower than Y min .
• the decision to filter or not to filter can be incorporated into a system that uses other criteria to make deblocking filter decisions, such as those used in the H.264/AVC compression standard, for example.
• the present filtering decision is applied to the line-based filtering steps of the JM 1.9 deblocking filter.
• the deblocking algorithm proceeds in three steps when it is applied to a transition. In one step the algorithm determines whether or not the current transition will be filtered. This decision relies on line-based criteria as well as on other block-based parameters previously evaluated. For those cases where it decides to filter, there is another step in which the filter to be applied is selected. An additional step begins the filtering process itself, where the value of a certain number of pixels surrounding the block edge is modified in order to smooth this transition.
• a set of eight pixels involved in the filtering of a transition for this exemplary embodiment is denoted by the following notation:
• this criterion is only evaluated on one pixel around the transition where:
• This new criterion for conditional deblocking filters increases the number of operations involved in the decision process, but achieves an overall reduction in computational complexity because of the computations saved when the decision is made not to filter the line transition. Experiments also have shown that the reduction in operations comes without a significant loss of visual quality.
• embodiments of the present invention are implemented as a combination of hardware and software.
• the software is preferably implemented as an application program tangibly embodied on a program storage unit.
• the application program may be uploaded to, and executed by, a machine comprising any suitable architecture.
• the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPU"), a random access memory (“RAM”), and input/output ("I/O") interfaces.
• CPU central processing units
• RAM random access memory
• I/O input/output
• the computer platform may also include an operating system and microinstruction code.
• the various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU.
• various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Compression, Expansion, Code Conversion, And Decoders (AREA)

Priority Applications (7)

Applications Claiming Priority (4)

Publications (2)

Family

ID=29272972

Family Applications (1)

Country Status (11)

Cited By (4)

Families Citing this family (82)

Family Cites Families (17)

• 2003
  • 2003-02-11 US US10/364,430 patent/US6907079B2/en not_active Expired - Lifetime
  • 2003-04-14 CN CNB038133741A patent/CN100370837C/zh not_active Expired - Lifetime
  • 2003-04-14 BR BR0304656-7A patent/BR0304656A/pt not_active Application Discontinuation
  • 2003-04-14 WO PCT/US2003/011398 patent/WO2003094498A2/en not_active Ceased
  • 2003-04-14 AU AU2003224957A patent/AU2003224957A1/en not_active Abandoned
  • 2003-04-14 MX MXPA04010857A patent/MXPA04010857A/es active IP Right Grant
  • 2003-04-14 KR KR1020047017577A patent/KR100942628B1/ko not_active Expired - Lifetime
  • 2003-04-14 JP JP2004502607A patent/JP4518390B2/ja not_active Expired - Lifetime
  • 2003-04-14 EP EP03721655.3A patent/EP1500207B1/en not_active Expired - Lifetime
  • 2003-04-14 ES ES03721655T patent/ES2785061T3/es not_active Expired - Lifetime
  • 2003-04-30 MY MYPI20031639A patent/MY136053A/en unknown

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events