US20110129160A1 - Image processing apparatus and image processing method in the image processing apparatus - Google Patents

Image processing apparatus and image processing method in the image processing apparatus Download PDF

Info

Publication number
US20110129160A1
US20110129160A1 US12/891,423 US89142310A US2011129160A1 US 20110129160 A1 US20110129160 A1 US 20110129160A1 US 89142310 A US89142310 A US 89142310A US 2011129160 A1 US2011129160 A1 US 2011129160A1
Authority
US
United States
Prior art keywords
block boundary
value
image data
pixels
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/891,423
Inventor
Eiki Obara
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to KABUSHIKI KAISHA TOSHIBA reassignment KABUSHIKI KAISHA TOSHIBA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OBARA, EIKI
Publication of US20110129160A1 publication Critical patent/US20110129160A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness

Definitions

  • Embodiments described herein relate generally to a block distortion removal technique suitable for an image processing apparatus which decompresses and decodes image data subjected to compression encoding compliant with, e.g., the H.264 standard.
  • a boundary called a block distortion or the like appears in each block of 8 ⁇ 8 pixels.
  • filtering processing for a fixed position is executed for the block boundary.
  • the block size serving as a processing unit is not a fixed size of 8 ⁇ 8 pixels.
  • filtering processing for a fixed position is not effective.
  • Internet contents such as video data posted to a video sharing website, and view them.
  • Internet contents of this type include one obtained by temporarily decompressing a compressed image, changing the image size, and then compressing the image again, and one obtained by decompressing a recompressed image, changing the size, and then displaying the image.
  • the block boundary does not appear in each unit of 8 ⁇ 8 pixels. Also in this case, filtering processing for a fixed position cannot remove a block distortion and the block distortion often remains.
  • the video signal processing apparatus in Jpn. Pat. Appln. KOKAI Publication No. 2008-124901 determines a block boundary based on the data difference value between adjacent pixels. The apparatus may therefore mistake a so called edge of a pattern or the like for a block boundary.
  • the foregoing filtering processing has a disadvantage that the detail component (contrast component of a local region) of an original image is lost when filtering processing is executed for a block boundary to make a block distortion less conspicuous.
  • FIG. 1 is an exemplary block diagram showing a schematic arrangement of an image processing apparatus according to an embodiment.
  • FIG. 2 is an exemplary block diagram showing detailed functional blocks of the image processing apparatus according to the embodiment.
  • FIG. 3 is an exemplary view showing an image of pixels aligned in the horizontal direction.
  • FIG. 4 is an exemplary flowchart showing the operation sequence of the image processing apparatus according to the embodiment.
  • FIG. 5 is an exemplary flowchart showing the sequence of block boundary detection processing executed by the image processing apparatus according to the embodiment.
  • an image processing apparatus includes a block boundary detection module which detects a block boundary in input image data.
  • the block boundary detection module includes a first calculator, a second calculator, and a determination module.
  • the first calculator calculates a first value which is an absolute value of an adjacent pixel value difference between two adjacent pixels in the image data.
  • the second calculator calculates a second value which is a value obtained by multiplying, by a predetermined coefficient, a sum value of absolute values of adjacent pixel value differences between pixels positioned in a direction in which the two adjacent pixels are aligned, the two adjacent pixels being excluded from calculation of the second value.
  • the determination module determines that a block boundary exists between the two pixels when the first value is larger than the second value.
  • FIG. 1 is an exemplary block diagram showing the schematic arrangement of an image processing apparatus 1 according to the embodiment.
  • an input signal “a 1 ” is a signal in which the size of a block processed in image compression is unknown and which contains block noise.
  • the input signal “a 1 ” is input to a block boundary detection circuit 10 and a detail addition circuit ( 1 ) 30 .
  • the block boundary detection circuit 10 detects a block boundary in the input signal “a 1 ”. The block boundary detection method will be described later.
  • the block boundary detection circuit 10 sends the detected block boundary information to a detail extraction circuit 20 and a deblocking processing circuit 40 .
  • the detail extraction circuit 20 extracts the contrast component (to be also referred to as a detail component) of a local region so as not to cross a block boundary. As for pixels which sandwich the block boundary, the detail extraction circuit 20 performs smoothing processing. The detail component extraction method will also be described later.
  • the detail addition circuit ( 1 ) 30 adds a detail component to the input signal “a 1 ” to compensate in advance for a detail component which may be lost in the subsequent deblocking processing circuit 40 .
  • An output from the detail addition circuit ( 1 ) 30 is input to the deblocking processing circuit 40 .
  • the deblocking processing circuit 40 executes deblocking processing based on the block boundary information sent from the block boundary detection circuit 10 .
  • a boundary step is made inconspicuous using, for example, a low-pass filter.
  • the deblocking processing circuit 40 dynamically switches the tap size of the filter and the number of pixels to be processed in accordance with the size of a step contained in block boundary information.
  • a detail addition circuit ( 2 ) 50 adds a detail component again to the signal in which the block boundary has been made inconspicuous by the deblocking processing circuit 40 , obtaining an output signal “a 2 ”.
  • FIG. 1 shows two detail addition circuits, i.e., the detail addition circuit ( 1 ) 30 which compensates in advance for a detail component that may be lost in the deblocking processing circuit 40 , and the detail addition circuit ( 2 ) 50 which compensates for a detail component which has been lost in the deblocking processing circuit 40 .
  • the detail addition circuit ( 1 ) 30 which compensates in advance for a detail component that may be lost in the deblocking processing circuit 40
  • the detail addition circuit ( 2 ) 50 which compensates for a detail component which has been lost in the deblocking processing circuit 40 .
  • FIG. 2 is an exemplary block diagram showing detailed functional blocks of the image processing apparatus 1 according to the embodiment.
  • the input signal “a 1 ” is a signal in which the size of a block processed in image compression is unknown and which contains block noise.
  • the input signal “a 1 ” is input to a frame memory ( 1 ) 100 , a horizontally adjacent pixel difference absolute value detection circuit 110 , and a vertically adjacent pixel difference absolute value detection circuit 160 .
  • An output signal “b 1 ” from the frame memory ( 1 ) 100 is input to a frame memory ( 2 ) 210 , a horizontal detail detection circuit 130 , and a vertical detail detection circuit 180 .
  • the horizontally adjacent pixel difference absolute value detection circuit 110 processes all the horizontal pixels of an image in one frame, and outputs obtained information “b 2 ” to a horizontal difference absolute value memory/boundary detection circuit 120 .
  • Data “b 3 ” read from the horizontal difference absolute value memory/boundary detection circuit 120 is input to the horizontal detail detection circuit 130 and a frame memory ( 3 ) 230 .
  • the horizontal detail detection circuit 130 receives the data “b 3 ” output from the horizontal difference absolute value memory/boundary detection circuit 120 , and the output signal “b 1 ” from the frame memory ( 1 ) 100 .
  • the horizontal detail detection circuit 130 determines a block boundary based on information of the data “b 3 ”, and extracts a detail component so as not to cross the block boundary.
  • the horizontal detail detection circuit 130 performs smoothing processing for the pixels which sandwich the boundary after extracting detail components near the block boundary, and writes a horizontal detail component as final horizontal detail component data “b 4 ” in a horizontal detail memory 140 .
  • An output signal “b 5 ” from the horizontal detail memory 140 is input to a pre-addition horizontal coring/limiter/gain control circuit 150 and a frame memory ( 5 ) 270 .
  • the pre-addition horizontal coring/limiter/gain control circuit 150 adjusts the addition level of the horizontal detail component. If the level is low, noise is generated, so the pre-addition horizontal coring/limiter/gain control circuit 150 stops addition by coring processing. If the level is excessively high, the pre-addition horizontal coring/limiter/gain control circuit 150 limits the addition amount by limiter processing.
  • the vertically adjacent pixel difference absolute value detection circuit 160 processes all the vertical pixels of an image in one frame, and outputs obtained information “b 6 ” to a vertical difference absolute value memory/boundary detection circuit 170 .
  • Data “b 7 ” read from the vertical difference absolute value memory/boundary detection circuit 170 is input to a vertical detail detection circuit 180 and a frame memory ( 4 ) 250 .
  • the vertical detail detection circuit 180 receives the data “b 7 ” output from the vertical difference absolute value memory/boundary detection circuit 170 , and the output signal “b 1 ” from the frame memory ( 1 ) 100 .
  • the vertical detail detection circuit 180 determines a block boundary based on information of the data “b 7 ”, and extracts a detail component so as not to cross the block boundary.
  • the vertical detail detection circuit 180 performs smoothing processing for the pixels which sandwich the boundary after extracting detail components near the block boundary, and writes a vertical detail component as final vertical detail component data “b 8 ” in a vertical detail memory 190 .
  • An output signal “b 9 ” from the vertical detail memory 190 is input to a pre-addition vertical coring/limiter/gain control circuit 200 and a frame memory ( 6 ) 290 .
  • the pre-addition vertical coring/limiter/gain control circuit 200 adjusts the addition level of the vertical detail component. If the level is low, noise is generated, so the pre-addition vertical coring/limiter/gain control circuit 200 stops addition by coring processing. If the level is excessively high, the pre-addition vertical coring/limiter/gain control circuit 200 limits the addition amount by limiter processing.
  • An input signal “b 10 ” whose delay time has been adjusted by the frame memory ( 2 ) 210 is input to the detail addition circuit ( 1 ) 30 .
  • the detail addition circuit ( 1 ) 30 adds, to the delayed input signal “b 10 ”, an output signal “b 11 ” from the pre-addition horizontal coring/limiter/gain control circuit 150 and an output signal “b 12 ” from the pre-addition vertical coring/limiter/gain control circuit 200 .
  • the detail addition circuit ( 1 ) 30 compensates in advance for a detail component which may be lost in subsequent deblocking processing.
  • a signal “b 13 ” whose detail component has been compensated for by the detail addition circuit ( 1 ) 30 is input to a horizontal deblocking processing circuit 240 .
  • the horizontal deblocking processing circuit 240 receives information “b 14 ” about a horizontal block boundary that has been output from the horizontal difference absolute value memory/boundary detection circuit 120 and delayed by the frame memory ( 3 ) 230 .
  • the information “b 14 ” contains positional information of the horizontal boundary, and step value information of the horizontal block boundary. Based on these pieces of information, the horizontal deblocking processing circuit 240 sets a position to undergo filtering processing, and selects a filter corresponding to the step value.
  • a signal “b 15 ” obtained by correcting a horizontal block boundary step by the horizontal deblocking processing circuit 240 is input to a vertical deblocking processing circuit 260 .
  • the vertical deblocking processing circuit 260 receives information “b 16 ” about a vertical block boundary that has been output from the vertical difference absolute value memory/boundary detection circuit 170 and delayed by the frame memory ( 4 ) 250 .
  • the information “b 16 ” contains positional information of the vertical boundary, and step value information of the vertical block boundary. Based on these pieces of information, the vertical deblocking processing circuit 260 sets a position to undergo filtering processing, and selects a filter corresponding to the step value.
  • a signal “b 17 ” obtained by correcting a vertical block boundary step by the vertical deblocking processing circuit 260 is input to the detail addition circuit ( 2 ) 50 .
  • the detail addition circuit ( 2 ) 50 adds a detail signal “b 18 ” obtained by optimizing the level by a post-addition horizontal coring/limiter/gain control circuit 280 after the frame memory ( 5 ) 270 delays a detail component read from the horizontal detail memory 140 , and a detail signal “b 19 ” obtained by optimizing the level by a post-addition vertical coring/limiter/gain control circuit 300 after the frame memory ( 6 ) 290 delays a detail component read from the vertical detail memory 190 . In this manner, the detail addition circuit ( 2 ) 50 compensates for a detail component which has been lost in deblocking processing.
  • post-addition horizontal coring/limiter/gain control circuit 280 and the post-addition vertical coring/limiter/gain control circuit 300 are the same as those of the pre-addition horizontal coring/limiter/gain control circuit 150 and the pre-addition vertical coring/limiter/gain control circuit 200 , and a description thereof will not be repeated.
  • the output signal “a 2 ” from the detail addition circuit ( 2 ) 50 becomes signal in which the block boundary step is suppressed and the detail component is compensated for.
  • FIG. 3 is an exemplary view showing an image of pixels aligned in the horizontal direction.
  • a circle represents a pixel
  • pn represents the number of each pixel
  • do represents the detail component of each pixel.
  • a pixel number with a suffix “m” represents the pixel value of a pixel.
  • the horizontally adjacent pixel difference absolute value detection circuit 110 shown in FIG. 2 has already detected the absolute values of horizontally adjacent pixels. For example, letting dif be the difference absolute value between pixels p 7 and p 8 shown in FIG. 3 ,
  • the image processing apparatus 1 in the embodiment determines that a block boundary exists between pixels p 7 and p 8 .
  • k is a coefficient.
  • the k value varies depending on the contents, compression ratio, image enlargement/reduction ratio, and the like. By appropriately setting the k value in accordance with the contents, compression ratio, image enlargement/reduction ratio, and the like, a block boundary can be detected at very high probability.
  • the block boundary of an entire frame can be detected by performing this processing for all horizontal and vertical pixels.
  • a filter arrangement corresponding to the step value of a detected block boundary will be exemplified.
  • the step value will be explained with reference to dif and FIG. 3 used in the above description.
  • a corrected pixel value new_pxm can be calculated as follows.
  • the deblocking processing circuit 40 includes a function of selecting and applying an appropriate filter in accordance with the step value of a block boundary.
  • the horizontal detail detection circuit 130 and the vertical detail detection circuit 180 shown in FIG. 2 include the same function except for the difference between the horizontal and vertical directions. Thus, only an operation in the horizontal direction will be described. A method of obtaining a detail (local region contrast) component will be exemplified.
  • the block boundary detection circuit 10 detects the block boundary of an entire image before detecting a detail component. Extraction of the detail components d 5 to d 10 of pixels p 5 to p 10 will be exemplified, assuming that a block boundary exists between pixels p 7 and p 8 shown in FIG. 3 . The important point to note is that extracting detail components which sandwich the block boundary is not performed, and smoothing processing is performed for the detail components of pixels which sandwich a boundary.
  • d 7 and d 8 are detail components which sandwich the block boundary, and undergo smoothing processing.
  • a detail component border_dx after smoothing processing is calculated by
  • the image processing apparatus 1 in the embodiment that executes the above described block boundary detection processing, detail detection processing, and detail addition processing can reduce a block distortion even when the block size used for image compression is not definite. Even a detail component which is lost by filtering in deblocking processing can be reconstructed, greatly improving the image quality.
  • FIG. 4 is an exemplary flowchart showing the operation sequence of the image processing apparatus 1 in the embodiment.
  • FIG. 5 is an exemplary flowchart showing the sequence of block boundary detection processing.
  • the image processing apparatus 1 calculates the absolute value of a pixel value difference between two adjacent pixels (block B 1 ).
  • the image processing apparatus 1 calculates a value by multiplying, by a predetermined coefficient, the sum of the absolute values of adjacent pixel value differences in the same direction as that in which these two pixels are aligned (block B 2 ).
  • the image processing apparatus 1 compares the value calculated in block B 1 with that calculated in block B 2 (block B 3 ). If the value calculated in block B 1 is larger than that calculated in block B 2 (YES in block B 3 ), the image processing apparatus 1 determines that a block boundary exists between these two pixels (block B 4 ).
  • the image processing apparatus 1 extracts the contrast component of a local region so as not to cross the block boundary (block A 2 ). Also, based on positional information of the detected block boundary, the image processing apparatus 1 smoothes contrast components which sandwich the block boundary (out of contrast components extracted in block A 2 ) (block A 3 ). The image processing apparatus 1 adds the extracted/smoothed contrast components to an original signal (before filtering processing in order to make a block distortion less conspicuous) (block A 4 ).
  • the image processing apparatus 1 selects a filter to be applied to filtering processing (block A 5 ), and executes filtering processing (block A 6 ).
  • the image processing apparatus 1 adds the contrast components extracted and smoothed in blocks A 2 and A 3 to the signal subjected to filtering processing (block A 7 ).
  • FIG. 4 shows two blocks, i.e., the block (block A 4 ) of adding extracted/smoothed contrast components to an original signal (before filtering processing), and the block (block A 7 ) of adding extracted/smoothed contrast components to a signal subjected to filtering processing.
  • the block (block A 4 ) of adding extracted/smoothed contrast components to an original signal (before filtering processing) and the block (block A 7 ) of adding extracted/smoothed contrast components to a signal subjected to filtering processing.
  • the image processing apparatus 1 can accurately detect a block boundary and perform effective image processing for the block boundary.
  • the various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)

Abstract

According to one embodiment, an image processing apparatus includes a block boundary detection module which detects a block boundary in input image data. The block boundary detection module includes a first calculator, a second calculator, and a determination module. The first calculator calculates a first value which is an absolute value of an adjacent pixel value difference between two adjacent pixels in the image data. The second calculator calculates a second value which is a value obtained by multiplying, by a predetermined coefficient, a sum value of absolute values of adjacent pixel value differences between pixels positioned in a direction in which the two adjacent pixels are aligned, the two adjacent pixels being excluded from calculation of the second value. The determination module determines that a block boundary exists between the two pixels when the first value is larger than the second value.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2009-270597, filed Nov. 27, 2009; the entire contents of which are incorporated herein by reference.
  • FIELD
  • Embodiments described herein relate generally to a block distortion removal technique suitable for an image processing apparatus which decompresses and decodes image data subjected to compression encoding compliant with, e.g., the H.264 standard.
  • BACKGROUND
  • For example, in a Moving Picture Experts Group (MPEG) 2 image compression method, because the processing unit is a block of 8×8 pixels, a boundary (block boundary) called a block distortion or the like appears in each block of 8×8 pixels. To make the block distortion less conspicuous, filtering processing (for a fixed position) is executed for the block boundary.
  • To the contrary, in the latest image compression methods such as H.264, the block size serving as a processing unit is not a fixed size of 8×8 pixels. In many cases, filtering processing for a fixed position is not effective.
  • Recently, it is popular to download, via the Internet, so called Internet contents such as video data posted to a video sharing website, and view them. Internet contents of this type include one obtained by temporarily decompressing a compressed image, changing the image size, and then compressing the image again, and one obtained by decompressing a recompressed image, changing the size, and then displaying the image. In many of these Internet contents, the block boundary does not appear in each unit of 8×8 pixels. Also in this case, filtering processing for a fixed position cannot remove a block distortion and the block distortion often remains.
  • To solve this problem, there have been proposed a video signal processing apparatus and the like capable of “detecting a plurality of block widths using a simple arrangement for a signal which has been encoded and decoded for each block, and the position and width of the block boundary of which are unknown” (for example, Jpn. Pat. Appln. KOKAI Publication No. 2008-124901).
  • The video signal processing apparatus in Jpn. Pat. Appln. KOKAI Publication No. 2008-124901, however, determines a block boundary based on the data difference value between adjacent pixels. The apparatus may therefore mistake a so called edge of a pattern or the like for a block boundary.
  • Further, the foregoing filtering processing has a disadvantage that the detail component (contrast component of a local region) of an original image is lost when filtering processing is executed for a block boundary to make a block distortion less conspicuous.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • A general architecture that implements the various feature of the embodiments will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate the embodiments and not to limit the scope of the invention.
  • FIG. 1 is an exemplary block diagram showing a schematic arrangement of an image processing apparatus according to an embodiment.
  • FIG. 2 is an exemplary block diagram showing detailed functional blocks of the image processing apparatus according to the embodiment.
  • FIG. 3 is an exemplary view showing an image of pixels aligned in the horizontal direction.
  • FIG. 4 is an exemplary flowchart showing the operation sequence of the image processing apparatus according to the embodiment.
  • FIG. 5 is an exemplary flowchart showing the sequence of block boundary detection processing executed by the image processing apparatus according to the embodiment.
  • DETAILED DESCRIPTION
  • Various embodiments will be described hereinafter with reference to the accompanying drawings.
  • In general, according to one embodiment, an image processing apparatus includes a block boundary detection module which detects a block boundary in input image data. The block boundary detection module includes a first calculator, a second calculator, and a determination module. The first calculator calculates a first value which is an absolute value of an adjacent pixel value difference between two adjacent pixels in the image data. The second calculator calculates a second value which is a value obtained by multiplying, by a predetermined coefficient, a sum value of absolute values of adjacent pixel value differences between pixels positioned in a direction in which the two adjacent pixels are aligned, the two adjacent pixels being excluded from calculation of the second value. The determination module determines that a block boundary exists between the two pixels when the first value is larger than the second value.
  • FIG. 1 is an exemplary block diagram showing the schematic arrangement of an image processing apparatus 1 according to the embodiment.
  • Assume that an input signal “a1” is a signal in which the size of a block processed in image compression is unknown and which contains block noise. The input signal “a1” is input to a block boundary detection circuit 10 and a detail addition circuit (1) 30. The block boundary detection circuit 10 detects a block boundary in the input signal “a1”. The block boundary detection method will be described later.
  • The block boundary detection circuit 10 sends the detected block boundary information to a detail extraction circuit 20 and a deblocking processing circuit 40. The detail extraction circuit 20 extracts the contrast component (to be also referred to as a detail component) of a local region so as not to cross a block boundary. As for pixels which sandwich the block boundary, the detail extraction circuit 20 performs smoothing processing. The detail component extraction method will also be described later.
  • The detail addition circuit (1) 30 adds a detail component to the input signal “a1” to compensate in advance for a detail component which may be lost in the subsequent deblocking processing circuit 40. An output from the detail addition circuit (1) 30 is input to the deblocking processing circuit 40. The deblocking processing circuit 40 executes deblocking processing based on the block boundary information sent from the block boundary detection circuit 10. In the deblocking processing, a boundary step is made inconspicuous using, for example, a low-pass filter. The deblocking processing circuit 40 dynamically switches the tap size of the filter and the number of pixels to be processed in accordance with the size of a step contained in block boundary information. A detail addition circuit (2) 50 adds a detail component again to the signal in which the block boundary has been made inconspicuous by the deblocking processing circuit 40, obtaining an output signal “a2”.
  • Note that FIG. 1 shows two detail addition circuits, i.e., the detail addition circuit (1) 30 which compensates in advance for a detail component that may be lost in the deblocking processing circuit 40, and the detail addition circuit (2) 50 which compensates for a detail component which has been lost in the deblocking processing circuit 40. However, it suffices to arrange either of the detail addition circuits.
  • FIG. 2 is an exemplary block diagram showing detailed functional blocks of the image processing apparatus 1 according to the embodiment.
  • As described above, the input signal “a1” is a signal in which the size of a block processed in image compression is unknown and which contains block noise. The input signal “a1” is input to a frame memory (1) 100, a horizontally adjacent pixel difference absolute value detection circuit 110, and a vertically adjacent pixel difference absolute value detection circuit 160. An output signal “b1” from the frame memory (1) 100 is input to a frame memory (2) 210, a horizontal detail detection circuit 130, and a vertical detail detection circuit 180.
  • The horizontally adjacent pixel difference absolute value detection circuit 110 processes all the horizontal pixels of an image in one frame, and outputs obtained information “b2” to a horizontal difference absolute value memory/boundary detection circuit 120. Data “b3” read from the horizontal difference absolute value memory/boundary detection circuit 120 is input to the horizontal detail detection circuit 130 and a frame memory (3) 230.
  • The horizontal detail detection circuit 130 receives the data “b3” output from the horizontal difference absolute value memory/boundary detection circuit 120, and the output signal “b1” from the frame memory (1) 100. The horizontal detail detection circuit 130 determines a block boundary based on information of the data “b3”, and extracts a detail component so as not to cross the block boundary. As for pixels which sandwich the block boundary, the horizontal detail detection circuit 130 performs smoothing processing for the pixels which sandwich the boundary after extracting detail components near the block boundary, and writes a horizontal detail component as final horizontal detail component data “b4” in a horizontal detail memory 140. An output signal “b5” from the horizontal detail memory 140 is input to a pre-addition horizontal coring/limiter/gain control circuit 150 and a frame memory (5) 270.
  • The pre-addition horizontal coring/limiter/gain control circuit 150 adjusts the addition level of the horizontal detail component. If the level is low, noise is generated, so the pre-addition horizontal coring/limiter/gain control circuit 150 stops addition by coring processing. If the level is excessively high, the pre-addition horizontal coring/limiter/gain control circuit 150 limits the addition amount by limiter processing.
  • The vertically adjacent pixel difference absolute value detection circuit 160 processes all the vertical pixels of an image in one frame, and outputs obtained information “b6” to a vertical difference absolute value memory/boundary detection circuit 170. Data “b7” read from the vertical difference absolute value memory/boundary detection circuit 170 is input to a vertical detail detection circuit 180 and a frame memory (4) 250.
  • The vertical detail detection circuit 180 receives the data “b7” output from the vertical difference absolute value memory/boundary detection circuit 170, and the output signal “b1” from the frame memory (1) 100. The vertical detail detection circuit 180 determines a block boundary based on information of the data “b7”, and extracts a detail component so as not to cross the block boundary. As for pixels which sandwich the block boundary, the vertical detail detection circuit 180 performs smoothing processing for the pixels which sandwich the boundary after extracting detail components near the block boundary, and writes a vertical detail component as final vertical detail component data “b8” in a vertical detail memory 190. An output signal “b9” from the vertical detail memory 190 is input to a pre-addition vertical coring/limiter/gain control circuit 200 and a frame memory (6) 290.
  • The pre-addition vertical coring/limiter/gain control circuit 200 adjusts the addition level of the vertical detail component. If the level is low, noise is generated, so the pre-addition vertical coring/limiter/gain control circuit 200 stops addition by coring processing. If the level is excessively high, the pre-addition vertical coring/limiter/gain control circuit 200 limits the addition amount by limiter processing.
  • An input signal “b10” whose delay time has been adjusted by the frame memory (2) 210 is input to the detail addition circuit (1) 30. The detail addition circuit (1) 30 adds, to the delayed input signal “b10”, an output signal “b11” from the pre-addition horizontal coring/limiter/gain control circuit 150 and an output signal “b12” from the pre-addition vertical coring/limiter/gain control circuit 200. In this way, the detail addition circuit (1) 30 compensates in advance for a detail component which may be lost in subsequent deblocking processing. A signal “b13” whose detail component has been compensated for by the detail addition circuit (1) 30 is input to a horizontal deblocking processing circuit 240.
  • In addition to the signal “b13” whose detail component has been compensated, the horizontal deblocking processing circuit 240 receives information “b14” about a horizontal block boundary that has been output from the horizontal difference absolute value memory/boundary detection circuit 120 and delayed by the frame memory (3) 230. The information “b14” contains positional information of the horizontal boundary, and step value information of the horizontal block boundary. Based on these pieces of information, the horizontal deblocking processing circuit 240 sets a position to undergo filtering processing, and selects a filter corresponding to the step value. A signal “b15” obtained by correcting a horizontal block boundary step by the horizontal deblocking processing circuit 240 is input to a vertical deblocking processing circuit 260.
  • In addition to the signal “b15” subjected to horizontal deblocking processing, the vertical deblocking processing circuit 260 receives information “b16” about a vertical block boundary that has been output from the vertical difference absolute value memory/boundary detection circuit 170 and delayed by the frame memory (4) 250. The information “b16” contains positional information of the vertical boundary, and step value information of the vertical block boundary. Based on these pieces of information, the vertical deblocking processing circuit 260 sets a position to undergo filtering processing, and selects a filter corresponding to the step value. A signal “b17” obtained by correcting a vertical block boundary step by the vertical deblocking processing circuit 260 is input to the detail addition circuit (2) 50.
  • The detail addition circuit (2) 50 adds a detail signal “b18” obtained by optimizing the level by a post-addition horizontal coring/limiter/gain control circuit 280 after the frame memory (5) 270 delays a detail component read from the horizontal detail memory 140, and a detail signal “b19” obtained by optimizing the level by a post-addition vertical coring/limiter/gain control circuit 300 after the frame memory (6) 290 delays a detail component read from the vertical detail memory 190. In this manner, the detail addition circuit (2) 50 compensates for a detail component which has been lost in deblocking processing. Note that the functions of the post-addition horizontal coring/limiter/gain control circuit 280 and the post-addition vertical coring/limiter/gain control circuit 300 are the same as those of the pre-addition horizontal coring/limiter/gain control circuit 150 and the pre-addition vertical coring/limiter/gain control circuit 200, and a description thereof will not be repeated.
  • By this processing, the output signal “a2” from the detail addition circuit (2) 50 becomes signal in which the block boundary step is suppressed and the detail component is compensated for.
  • Block boundary detection processing executed by the image processing apparatus 1 in the embodiment will be explained with reference to FIG. 3. FIG. 3 is an exemplary view showing an image of pixels aligned in the horizontal direction.
  • In FIG. 3, a circle represents a pixel, pn represents the number of each pixel, and do represents the detail component of each pixel. In the following description, a pixel number with a suffix “m” represents the pixel value of a pixel.
  • Assume that the horizontally adjacent pixel difference absolute value detection circuit 110 shown in FIG. 2 has already detected the absolute values of horizontally adjacent pixels. For example, letting dif be the difference absolute value between pixels p7 and p8 shown in FIG. 3,

  • dif=|p7m−p8m|  equation (1).
  • Letting sad be the sum of the difference absolute values between adjacent pixels p4 to p11 except for the difference absolute value between pixels p7 and p8,

  • sad=|p4m−p5m|+|p5m−p6m|+|p6m−p7m|+|p8m−p9m|+|p9m−p10m|+|p10m−p11m|  equation (2).
  • When dif and sad have a relationship:

  • dif>sad×k  equation (3),
  • the image processing apparatus 1 in the embodiment determines that a block boundary exists between pixels p7 and p8. In equation (3), k is a coefficient. The k value varies depending on the contents, compression ratio, image enlargement/reduction ratio, and the like. By appropriately setting the k value in accordance with the contents, compression ratio, image enlargement/reduction ratio, and the like, a block boundary can be detected at very high probability. The block boundary of an entire frame can be detected by performing this processing for all horizontal and vertical pixels.
  • A filter arrangement corresponding to the step value of a detected block boundary will be exemplified. The step value will be explained with reference to dif and FIG. 3 used in the above description.
  • Assume that a block boundary exists between pixels p7 and p8 shown in FIG. 3. Then, a corrected pixel value new_pxm can be calculated as follows.
  • (1) For dif<4: Smoothing Processing for Two Pixels Which Sandwich Boundary

  • new p7m=(p7m+p8m)/2  equation (4)

  • new p8m=(p7m+p8m)/2  equation (5)
  • (2) For 4<=dif<8: 4 pixel Processing Using 3 tap Filter

  • new p6m=(p5m+p62+p7m)/4  equation (6)

  • new p7m=(p6m+p72+p8m)/4  equation (7)

  • new p8m=(p7m+p82+p9m)/4  equation (8)

  • new p9m=(p8m+p92+p10m)/4  equation (9)
  • (3) For 8<=dif<20: 6 pixel Processing Using 5 tap Filter

  • new p5m=(p3m+p42+p54+p62+p7m)/10  equation (10)

  • new p6m=(p4m+p52+p64+p72+p8m)/10  equation (11)

  • new p7m=(p5m+p62+p74+p82+p9m)/10  equation (12)

  • new p8m=(p6m+p72+p84+p92+p10m)/10  equation (13)

  • new p9m=(p7m+p82+p94+p102+p11m)/10  equation (14)

  • new p10m=(p8m+p92+p104+p112+p12m)/10  equation (15)
  • (4) For 20<=dif
  • No deblocking processing is done.
  • Note that these dif value range settings are merely examples.
  • That is, the deblocking processing circuit 40 includes a function of selecting and applying an appropriate filter in accordance with the step value of a block boundary.
  • Next, the operation principles of the horizontal detail detection circuit 130 and the vertical detail detection circuit 180 shown in FIG. 2 will be explained. The horizontal detail detection circuit 130 and the vertical detail detection circuit 180 include the same function except for the difference between the horizontal and vertical directions. Thus, only an operation in the horizontal direction will be described. A method of obtaining a detail (local region contrast) component will be exemplified.
  • In the description of FIG. 2, the block boundary detection circuit 10 detects the block boundary of an entire image before detecting a detail component. Extraction of the detail components d5 to d10 of pixels p5 to p10 will be exemplified, assuming that a block boundary exists between pixels p7 and p8 shown in FIG. 3. The important point to note is that extracting detail components which sandwich the block boundary is not performed, and smoothing processing is performed for the detail components of pixels which sandwich a boundary.

  • d5=p5m−(p3m+p4m+p5m+p6m+p7m)/5  equation (16)

  • d6=p6m−(p5m+p6m+p7m)/3  equation (17)

  • d7=p7m−(p6m+p7m)/2  equation (18)

  • d8=p8m−(p8m+p9m)/2  equation (19)

  • d9=p9m−(p8m+p9m+p10m)/3  equation (20)

  • d10=p10m−(p8m+p9m+p10m+p11m+p12m)/5  equation (21)
  • In this case, d7 and d8 are detail components which sandwich the block boundary, and undergo smoothing processing. A detail component border_dx after smoothing processing is calculated by

  • border d7=(d7+d8)/2  equation (22)

  • border d8=(d7+d8)/2  equation (23)
  • The image processing apparatus 1 in the embodiment that executes the above described block boundary detection processing, detail detection processing, and detail addition processing can reduce a block distortion even when the block size used for image compression is not definite. Even a detail component which is lost by filtering in deblocking processing can be reconstructed, greatly improving the image quality.
  • FIG. 4 is an exemplary flowchart showing the operation sequence of the image processing apparatus 1 in the embodiment.
  • Upon receiving a signal in which the size of a block processed in image compression is unknown and which contains block noise, the image processing apparatus 1 in the embodiment first detects a block boundary (block A1). FIG. 5 is an exemplary flowchart showing the sequence of block boundary detection processing.
  • The image processing apparatus 1 calculates the absolute value of a pixel value difference between two adjacent pixels (block B1). The image processing apparatus 1 calculates a value by multiplying, by a predetermined coefficient, the sum of the absolute values of adjacent pixel value differences in the same direction as that in which these two pixels are aligned (block B2).
  • The image processing apparatus 1 compares the value calculated in block B1 with that calculated in block B2 (block B3). If the value calculated in block B1 is larger than that calculated in block B2 (YES in block B3), the image processing apparatus 1 determines that a block boundary exists between these two pixels (block B4).
  • Then, based on positional information of the detected block boundary, the image processing apparatus 1 extracts the contrast component of a local region so as not to cross the block boundary (block A2). Also, based on positional information of the detected block boundary, the image processing apparatus 1 smoothes contrast components which sandwich the block boundary (out of contrast components extracted in block A2) (block A3). The image processing apparatus 1 adds the extracted/smoothed contrast components to an original signal (before filtering processing in order to make a block distortion less conspicuous) (block A4).
  • Based on step value information of the detected block boundary, the image processing apparatus 1 selects a filter to be applied to filtering processing (block A5), and executes filtering processing (block A6). The image processing apparatus 1 adds the contrast components extracted and smoothed in blocks A2 and A3 to the signal subjected to filtering processing (block A7).
  • Note that FIG. 4 shows two blocks, i.e., the block (block A4) of adding extracted/smoothed contrast components to an original signal (before filtering processing), and the block (block A7) of adding extracted/smoothed contrast components to a signal subjected to filtering processing. However, it suffices to execute either of the blocks.
  • As described above, the image processing apparatus 1 according to the embodiment can accurately detect a block boundary and perform effective image processing for the block boundary.
  • The various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.
  • While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.

Claims (14)

1. An image processing apparatus comprising:
an input module configured to input image data obtained by decompressing and decoding image data which has been compressed and encoded for each block;
a block boundary detection module configured to detect a block boundary in the image data input by the input module;
a deblocking module configured to execute filtering processing for the input image data to remove a block distortion, based on the block boundary detected by the block boundary detection module; and
an output module configured to output the image data for which the filtering processing is executed by the deblocking module,
wherein the block boundary detection module comprises:
a first calculator configured to calculate an absolute value of an adjacent pixel value difference between two adjacent pixels in the image data;
a second calculator configured to calculate a value by multiplying, by a predetermined coefficient, a sum value of absolute values of adjacent pixel value differences between pixels positioned in a direction in which the two adjacent pixels used by the first calculator are aligned, the two adjacent pixels used by the first calculator being excluded from calculation by the second calculator; and
a determination module configured to determine that a block boundary exists between the two pixels when the value calculated by the first calculator is larger than the value calculated by the second calculator.
2. The apparatus of claim 1, further comprising:
a detail extraction module configured to extract a contrast component of a local region using pixel value information obtained from pixel values of neighboring pixels between which the block boundary detected by the block boundary detection module does not exist; and
a detail addition module configured to add the contrast component of the local region extracted by the detail extraction module to either of image data input to the deblocking module and image data output from the deblocking module.
3. The apparatus of claim 2, wherein the detail extraction module comprises a smoothing module configured to smooth respective contrast components of two local regions extracted for two pixels adjacent across the block boundary detected by the block boundary detection unit, by using the contrast components of the two local regions.
4. The apparatus of claim 2, wherein the pixel value information obtained from the pixel values of the neighboring pixels comprises difference information between an output value of a smoothing filter and a pixel value.
5. The apparatus of claim 1, wherein the deblocking module comprises a filter selection module configured to select one of filters having different characteristics in accordance with an absolute value of a pixel value difference between two pixels adjacent across the block boundary, and to apply the selected filter to filtering processing for the block boundary.
6. An image processing apparatus comprising:
an input module configured to input image data obtained by decompressing and decoding image data which has been compressed and encoded for each predetermined block;
a detail extraction module configured to extract a contrast component of a local region using pixel value information obtained from pixel values of neighboring pixels so as not to cross a block boundary in the image data input by the input module;
a deblocking module configured to execute filtering processing to remove a block distortion on the block boundary in the image data input by the input module;
an output module configured to output image data for which the filtering processing is executed by the deblocking module; and
a detail addition module configured to add the contrast component of the local region extracted by the detail extraction module to either of image data input to the deblocking module and image data output from the deblocking module.
7. The apparatus of claim 6, wherein the detail extraction module comprises a smoothing module configured to smooth respective contrast components of two local regions extracted for two pixels adjacent across the block boundary, by using the contrast components of the two local regions.
8. The apparatus of claim 6, wherein the pixel value information obtained from the pixel values of the neighboring pixels comprises difference information between an output value of a smoothing filter and a pixel value.
9. The apparatus of claim 6, wherein the deblocking module comprises a filter selection module configured to select one of filters having different characteristics in accordance with an absolute value of a pixel value difference between two pixels adjacent across the block boundary in filtering processing for the block boundary in the image data input by the input module.
10. An image processing method of an image processing apparatus, comprising:
inputting image data obtained by decompressing and decoding image data which has been compressed and encoded for each block;
detecting a block boundary in the input image data;
executing filtering processing for the input image data to remove a block distortion, based on the detected block boundary; and
outputting the image data subjected to the filtering processing,
wherein the detecting a block boundary comprises:
calculating a first value which is an absolute value of an adjacent pixel value difference between two adjacent pixels in the image data;
calculating a second value which is a value obtained by multiplying, by a predetermined coefficient, a sum value of absolute values of adjacent pixel value differences between pixels positioned in a direction in which the two adjacent pixels used by calculation of the first value are aligned, the two adjacent pixels used by calculation of the first value being excluded from calculation of the second value; and
determining that a block boundary exists between the two pixels when the first value is larger than the second value.
11. The method of claim 10, further comprising:
extracting a contrast component of a local region using pixel value information obtained from pixel values of neighboring pixels between which the detected block boundary does not exist; and
adding the extracted contrast component of the local region to either of image data before the executing filtering processing to remove a block distortion and image data after the executing filtering processing to remove a block distortion.
12. The method of claim 10, wherein the extracting a contrast component of a local region comprises smoothing respective contrast components of two local regions extracted for two pixels adjacent across the detected block boundary, by using the contrast components of the two local regions.
13. The method of claim 10, wherein the pixel value information obtained from the pixel values of the neighboring pixels comprises difference information between an output value of a smoothing filter and a pixel value.
14. The method of claim 10, wherein the executing filtering processing to remove a block distortion comprises selecting one of filters having different characteristics in accordance with an absolute value of a pixel value difference between two pixels adjacent across the block boundary, and applying the selected filter to filtering processing for the block boundary.
US12/891,423 2009-11-27 2010-09-27 Image processing apparatus and image processing method in the image processing apparatus Abandoned US20110129160A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009-270597 2009-11-27
JP2009270597A JP4703759B2 (en) 2009-11-27 2009-11-27 Image processing apparatus and image processing method in the same

Publications (1)

Publication Number Publication Date
US20110129160A1 true US20110129160A1 (en) 2011-06-02

Family

ID=44068962

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/891,423 Abandoned US20110129160A1 (en) 2009-11-27 2010-09-27 Image processing apparatus and image processing method in the image processing apparatus

Country Status (2)

Country Link
US (1) US20110129160A1 (en)
JP (1) JP4703759B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100086225A1 (en) * 2007-01-22 2010-04-08 Shoji Yachida Image re-encoding device, image re-encoding method, and image encoding program
US20110170609A1 (en) * 2010-01-08 2011-07-14 Nokia Corporation Apparatus, a method and a computer program for video processing
US20120275712A1 (en) * 2011-04-28 2012-11-01 Sony Corporation Image processing device, image processing method, and program

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7082529B2 (en) * 2018-06-06 2022-06-08 ルネサスエレクトロニクス株式会社 Semiconductor devices and processing methods using semiconductor devices

Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175596B1 (en) * 1997-02-13 2001-01-16 Sony Corporation Picture signal encoding method and apparatus
US6434275B1 (en) * 1997-05-28 2002-08-13 Sony Corporation Block distortion reduction method and device and encoding method and device
US6738528B1 (en) * 1998-05-22 2004-05-18 Matsushita Electric Industrial Co., Ltd. Block noise detector and block noise eliminator
US20040146210A1 (en) * 1997-03-13 2004-07-29 Ossi Kalevo Adaptive filter
US20050105622A1 (en) * 2003-11-14 2005-05-19 Realnetworks, Inc. High frequency emphasis in decoding of encoded signals
US20050117812A1 (en) * 2003-11-28 2005-06-02 Noritsu Koki Co., Ltd. Method of reducing noise in images
US20050196063A1 (en) * 2004-01-14 2005-09-08 Samsung Electronics Co., Ltd. Loop filtering method and apparatus
US6950562B2 (en) * 2000-12-26 2005-09-27 Koninklijke Philips Electronics N.V. Data processing method
US6965416B2 (en) * 2000-03-23 2005-11-15 Sony Corporation Image processing circuit and method for processing image
US20070071356A1 (en) * 2005-09-29 2007-03-29 Caviedes Jorge E Method and apparatus for blocking artifact detection and measurement in block-coded video
US20070104385A1 (en) * 2003-07-02 2007-05-10 Sony Corporation Block distortion detection apparatus, block distortion detection method and video signal processing apparatus
US20070140574A1 (en) * 2005-12-16 2007-06-21 Kabushiki Kaisha Toshiba Decoding apparatus and decoding method
US20080056602A1 (en) * 2001-11-29 2008-03-06 Matsushita Electric Industrial Co., Ltd. Coding distortion removal method, video encoding method, video decoding method, and apparatus and program for the same
US20080085061A1 (en) * 2006-10-03 2008-04-10 Vestel Elektronik Sanayi Ve Ticaret A.S. Method and Apparatus for Adjusting the Contrast of an Input Image
US20080199102A1 (en) * 2007-02-16 2008-08-21 Mitsubishi Electric Corporation Block noise detector and detection method, and block noise reducer and reduction method
US20090161947A1 (en) * 2007-12-21 2009-06-25 Sony Corporation Image processing device and method, learning device and method, program, and recording medium
US20090161972A1 (en) * 2000-12-07 2009-06-25 Ntt Docomo, Inc Image coding/decoding method, image coding apparatus and image decoding apparatus
US20090214133A1 (en) * 2008-02-27 2009-08-27 Koji Aoyama Image processing device and method and program
US20100040280A1 (en) * 2008-08-15 2010-02-18 Real D Enhanced ghost compensation for stereoscopic imagery
US20100061649A1 (en) * 2007-10-03 2010-03-11 Panasonic Corporation Method and apparatus for reducing block noise
US8248492B2 (en) * 2008-01-25 2012-08-21 Sony Corporation Edge preserving and tone correcting image processing apparatus and method
US20120230604A1 (en) * 2011-03-08 2012-09-13 Sony Corporation Image processing apparatus, image processing method and program

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002204457A (en) * 2000-12-28 2002-07-19 Matsushita Electric Ind Co Ltd Video signal processor
JP2005065098A (en) * 2003-08-19 2005-03-10 Sony Corp Signal processing apparatus and method, and program
JP4475196B2 (en) * 2005-07-21 2010-06-09 日本ビクター株式会社 Block noise detection device and block noise detection program
JP2007174403A (en) * 2005-12-22 2007-07-05 Toshiba Corp Video processing apparatus and method
JP2008124901A (en) * 2006-11-14 2008-05-29 Canon Inc Video signal processing apparatus

Patent Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6175596B1 (en) * 1997-02-13 2001-01-16 Sony Corporation Picture signal encoding method and apparatus
US20040146210A1 (en) * 1997-03-13 2004-07-29 Ossi Kalevo Adaptive filter
US6434275B1 (en) * 1997-05-28 2002-08-13 Sony Corporation Block distortion reduction method and device and encoding method and device
US6738528B1 (en) * 1998-05-22 2004-05-18 Matsushita Electric Industrial Co., Ltd. Block noise detector and block noise eliminator
US6965416B2 (en) * 2000-03-23 2005-11-15 Sony Corporation Image processing circuit and method for processing image
US20090161972A1 (en) * 2000-12-07 2009-06-25 Ntt Docomo, Inc Image coding/decoding method, image coding apparatus and image decoding apparatus
US6950562B2 (en) * 2000-12-26 2005-09-27 Koninklijke Philips Electronics N.V. Data processing method
US20080056602A1 (en) * 2001-11-29 2008-03-06 Matsushita Electric Industrial Co., Ltd. Coding distortion removal method, video encoding method, video decoding method, and apparatus and program for the same
US20070104385A1 (en) * 2003-07-02 2007-05-10 Sony Corporation Block distortion detection apparatus, block distortion detection method and video signal processing apparatus
US20050105622A1 (en) * 2003-11-14 2005-05-19 Realnetworks, Inc. High frequency emphasis in decoding of encoded signals
US20050117812A1 (en) * 2003-11-28 2005-06-02 Noritsu Koki Co., Ltd. Method of reducing noise in images
US7415163B2 (en) * 2003-11-28 2008-08-19 Noritsu Koki Co., Ltd. Method of reducing noise in images
US20050196063A1 (en) * 2004-01-14 2005-09-08 Samsung Electronics Co., Ltd. Loop filtering method and apparatus
US20070071356A1 (en) * 2005-09-29 2007-03-29 Caviedes Jorge E Method and apparatus for blocking artifact detection and measurement in block-coded video
US20070140574A1 (en) * 2005-12-16 2007-06-21 Kabushiki Kaisha Toshiba Decoding apparatus and decoding method
US7805016B2 (en) * 2005-12-16 2010-09-28 Kabushiki Kaisha Toshiba Decoding apparatus and decoding method
US20080085061A1 (en) * 2006-10-03 2008-04-10 Vestel Elektronik Sanayi Ve Ticaret A.S. Method and Apparatus for Adjusting the Contrast of an Input Image
US20080199102A1 (en) * 2007-02-16 2008-08-21 Mitsubishi Electric Corporation Block noise detector and detection method, and block noise reducer and reduction method
US20100061649A1 (en) * 2007-10-03 2010-03-11 Panasonic Corporation Method and apparatus for reducing block noise
US20090161947A1 (en) * 2007-12-21 2009-06-25 Sony Corporation Image processing device and method, learning device and method, program, and recording medium
US8248492B2 (en) * 2008-01-25 2012-08-21 Sony Corporation Edge preserving and tone correcting image processing apparatus and method
US20090214133A1 (en) * 2008-02-27 2009-08-27 Koji Aoyama Image processing device and method and program
US20100040280A1 (en) * 2008-08-15 2010-02-18 Real D Enhanced ghost compensation for stereoscopic imagery
US20120230604A1 (en) * 2011-03-08 2012-09-13 Sony Corporation Image processing apparatus, image processing method and program

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100086225A1 (en) * 2007-01-22 2010-04-08 Shoji Yachida Image re-encoding device, image re-encoding method, and image encoding program
US8326064B2 (en) * 2007-01-22 2012-12-04 Nec Corporation Image re-encoding method to decode image data which is orthogonally transformed per first block and encoded by a first encoding method
US20110170609A1 (en) * 2010-01-08 2011-07-14 Nokia Corporation Apparatus, a method and a computer program for video processing
US8848801B2 (en) * 2010-01-08 2014-09-30 Nokia Corporation Apparatus, a method and a computer program for video processing
US20120275712A1 (en) * 2011-04-28 2012-11-01 Sony Corporation Image processing device, image processing method, and program

Also Published As

Publication number Publication date
JP2011114704A (en) 2011-06-09
JP4703759B2 (en) 2011-06-15

Similar Documents

Publication Publication Date Title
JP4047879B2 (en) Motion vector detection apparatus and motion vector detection method
US7437013B2 (en) Directional spatial video noise reduction
US20090245755A1 (en) Method and system for image scaling detection
US8244054B2 (en) Method, apparatus and integrated circuit capable of reducing image ringing noise
JP4749377B2 (en) Block noise removal device
US20130121419A1 (en) Temporal luminance variation detection and correction for hierarchical level frame rate converter
JP2009212969A (en) Image processing apparatus, image processing method, and image processing program
US20110129160A1 (en) Image processing apparatus and image processing method in the image processing apparatus
JP5364264B2 (en) Location detection of block defect using neural network
US20150310593A1 (en) Noise removal system, noise removal method, and program
US20070285729A1 (en) Image processing apparatus and image processing method
JP4380498B2 (en) Block distortion reduction device
JP4475196B2 (en) Block noise detection device and block noise detection program
JP2007336075A (en) Block distortion reducing device
JP2005012641A (en) Block noise detecting device and block noise eliminating device using the same
US20080181530A1 (en) Image processing apparatus and method for reducing blocking effect and Gibbs effect
JP2010148015A (en) Noise reduction device and program therefor
US8180169B2 (en) System and method for multi-scale sigma filtering using quadrature mirror filters
KR20050013621A (en) Method of detecting blocking artefacts
JP2011029989A (en) Noise reduction apparatus, and noise reduction method
US7729556B2 (en) Method for improving image quality and image processor for same
JP2008124901A (en) Video signal processing apparatus
KR20050027271A (en) Dynamic detection of blocking artefacts
JPH11298898A (en) Block distortion reduction circuit
JP2007312369A (en) Block noise removal device

Legal Events

Date Code Title Description
AS Assignment

Owner name: KABUSHIKI KAISHA TOSHIBA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OBARA, EIKI;REEL/FRAME:025047/0743

Effective date: 20100907

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION