JP5488048B2 - Image processing apparatus and image processing program - Google Patents

Image processing apparatus and image processing program Download PDF

Info

Publication number
JP5488048B2
JP5488048B2 JP2010042634A JP2010042634A JP5488048B2 JP 5488048 B2 JP5488048 B2 JP 5488048B2 JP 2010042634 A JP2010042634 A JP 2010042634A JP 2010042634 A JP2010042634 A JP 2010042634A JP 5488048 B2 JP5488048 B2 JP 5488048B2
Authority
JP
Japan
Prior art keywords
component
edge
block distortion
image processing
mosquito noise
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2010042634A
Other languages
Japanese (ja)
Other versions
JP2011182093A (en
Inventor
優 櫻井
富朗 後藤
Original Assignee
国立大学法人 名古屋工業大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 国立大学法人 名古屋工業大学 filed Critical 国立大学法人 名古屋工業大学
Priority to JP2010042634A priority Critical patent/JP5488048B2/en
Publication of JP2011182093A publication Critical patent/JP2011182093A/en
Application granted granted Critical
Publication of JP5488048B2 publication Critical patent/JP5488048B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

本発明は、画像処理装置および画像処理プログラムに関し、特に画像の雑音除去を行うものに関する。   The present invention relates to an image processing apparatus and an image processing program, and more particularly to an apparatus for removing noise from an image.

画像信号処理において、Total Variation フィルタを用いた雑音除去は、低圧縮時の雑音を効率的に除去することができる。しかし、圧縮率を高くした場合、より多くの雑音が圧縮画像に含まれるため、画質を劣化させることなく雑音を除去することは困難である。   In image signal processing, noise removal using a Total Variation filter can efficiently remove noise during low compression. However, when the compression rate is increased, more noise is included in the compressed image, so it is difficult to remove the noise without degrading the image quality.

特開2009−20605号公報JP 2009-20605 A

F.Alter, S.Durand and J.Froment, "Adapted total variation for artifact free decompression of JPEG images",J.Mathematical Imaging and Vision,Vol.23,No.2,pp.199-211,Sep.2005.F. Alter, S. Durand and J. Froment, "Adapted total variation for artifact free decompression of JPEG images", J. Mathematical Imaging and Vision, Vol. 23, No. 2, pp. 199-211, Sep. 2005.

特許文献1による画像の雑音除去では、モスキート雑音の除去は可能であるが、ブロックひずみの除去は考慮できていない。また、非特許文献1のTotal Variation フィルタを用いた雑音除去では、DCT(Discrete Cosine Transform)係数に対する全変動を最小化するため、ブロックひずみ除去が不十分となる問題がある。また、DCT係数に対する全変動を最小化するため、テクスチャ成分が失われ、ぼけた画像となる問題がある。   In the image noise removal according to Patent Document 1, mosquito noise can be removed, but removal of block distortion cannot be considered. Further, noise removal using the Total Variation filter of Non-Patent Document 1 has a problem in that block distortion removal becomes insufficient because the total variation with respect to a DCT (Discrete Cosine Transform) coefficient is minimized. In addition, in order to minimize the total variation with respect to the DCT coefficient, there is a problem that a texture component is lost, resulting in a blurred image.

本発明は上記点に鑑みて、ブロックひずみおよびモスキート雑音の除去を適切に行うことを目的とする。   In view of the above points, an object of the present invention is to appropriately remove block distortion and mosquito noise.

上記目的を達成するため、請求項1に記載の発明は、
入力画像を骨格成分とテクスチャ成分に成分分離する成分分離手段と、
前記成分分離手段にて成分分離されたテクスチャ成分に対しブロックひずみ除去を行うブロックひずみ除去手段と、
前記成分分離手段にて成分分離された骨格成分よりエッジの検出を行うエッジ検出手段と、
前記エッジ検出手段にて検出されたエッジの周りの画素に対してモスキート雑音の除去を行うモスキート雑音除去手段と、
前記ブロックひずみおよび前記モスキート雑音が除去されたテクスチャ成分と前記骨格成分とを合成し復元画像を得る手段と、を備えた画像処理装置を特徴とする。
In order to achieve the above object, the invention described in claim 1
Component separation means for separating an input image into a skeleton component and a texture component;
Block distortion removing means for removing block distortion on the texture component separated by the component separating means;
Edge detection means for detecting an edge from the skeleton component separated by the component separation means;
Mosquito noise removing means for removing mosquito noise for pixels around the edge detected by the edge detecting means;
An image processing apparatus comprising: a texture component from which the block distortion and the mosquito noise are removed and a skeleton component are synthesized to obtain a restored image.

また請求項2に記載の発明は、
コンピュータを、
入力画像を骨格成分とテクスチャ成分に成分分離する成分分離手段と、
前記成分分離手段にて成分分離されたテクスチャ成分に対しブロックひずみ除去を行うブロックひずみ除去手段と、
前記成分分離手段にて成分分離された骨格成分よりエッジの検出を行うエッジ検出手段と、
前記エッジ検出手段にて検出されたエッジの周りの画素に対してモスキート雑音の除去を行うモスキート雑音除去手段と、
前記ブロックひずみおよび前記モスキート雑音が除去されたテクスチャ成分と前記骨格成分とを合成し復元画像を得る手段として機能させる画像処理プログラムを特徴とする。
The invention according to claim 2
Computer
Component separation means for separating an input image into a skeleton component and a texture component;
Block distortion removing means for removing block distortion on the texture component separated by the component separating means;
Edge detection means for detecting an edge from the skeleton component separated by the component separation means;
Mosquito noise removing means for removing mosquito noise for pixels around the edge detected by the edge detecting means;
An image processing program that combines a texture component from which the block distortion and the mosquito noise have been removed and the skeleton component to function as a means for obtaining a restored image is characterized.

本発明の一実施形態に係る画像処理装置の構成を示す図である。It is a figure which shows the structure of the image processing apparatus which concerns on one Embodiment of this invention.

以下、本発明を図に示す実施形態について説明する。図1に、本発明の一実施形態に係る画像処理装置の構成を示す。この画像処理装置は、入力画像としてのDCT圧縮画像を画像の骨格成分とテクスチャ成分に成分分離するTotal Variation フィルタ10と、成分分離されたテクスチャ成分に対しブロックひずみ除去を行うDEF(Deblocking Edge Filter)12と、骨格成分よりエッジの検出を行うSobelフィルタ14と、エッジの周りの画素に対してモスキート雑音の除去を行うGaussianフィルタ16と、ブロックひずみおよびモスキート雑音が除去されたテクスチャ成分と骨格成分とを合成し、復元画像を得る成分合成部18と、を備えている。
この画像処理装置は、次のように作動する。入力画像としてのDCT圧縮画像はTotal Variation フィルタ10によって骨格成分とテクスチャ成分に成分分離される。骨格成分には滑らかな輝度値変化をする信号とエッジ成分が含まれ、テクスチャ成分には細かく振動する信号が含まれる。DCT圧縮雑音は、テクスチャ成分に含まれる。
DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments shown in the drawings will be described below. FIG. 1 shows a configuration of an image processing apparatus according to an embodiment of the present invention. This image processing apparatus includes a Total Variation filter 10 that separates a DCT compressed image as an input image into a skeleton component and a texture component of the image, and a DEF (Deblocking Edge Filter) that performs block distortion removal on the texture component thus separated. 12, a Sobel filter 14 for detecting an edge from a skeleton component, a Gaussian filter 16 for removing mosquito noise from pixels around the edge, a texture component and a skeleton component from which block distortion and mosquito noise have been removed, And a component synthesizing unit 18 that obtains a restored image.
This image processing apparatus operates as follows. The DCT compressed image as an input image is separated into a skeleton component and a texture component by the Total Variation filter 10. The skeleton component includes a smooth luminance value change signal and an edge component, and the texture component includes a finely oscillating signal. DCT compression noise is included in the texture component.

分離されたテクスチャ成分に対しDEF12を通すことによりブロックひずみが除去される。このDEF12については、非特許文献である、ITU-T. "Video coding for low bit rate communication, 1998に開示されている。   Block distortion is removed by passing the DEF 12 through the separated texture components. This DEF12 is disclosed in ITU-T. “Video coding for low bit rate communication, 1998, which is a non-patent document.

モスキート雑音は、エッジ信号の周辺に現れるため、Sobelフィルタ14によって骨格成分からエッジ信号を検出し、検出されたエッジ信号の周りの画素をGaussianフィルタ16によってフィルタリングすることでモスキート雑音の除去を行う。   Since the mosquito noise appears around the edge signal, the edge signal is detected from the skeleton component by the Sobel filter 14, and the pixels around the detected edge signal are filtered by the Gaussian filter 16 to remove the mosquito noise.

ブロックひずみおよびモスキート雑音が除去されたテクスチャ成分と骨格成分は成分合成部18にて合成され、復元画像が得られる。   The texture component and the skeleton component from which block distortion and mosquito noise have been removed are synthesized by the component synthesis unit 18 to obtain a restored image.

この実施形態によれば、Total Variation フィルタによる成分分離後のテクスチャ成分に対してDEFを行うことでブロックひずみの除去を効果的に行うことができ、エッジ近辺に発生するモスキート雑音をGaussian フィルタを用いて効果的に除去でき、エッジの検出によってGaussian フィルタをかける画素を選択することで、雑音除去時にテクスチャ成分の除去が極力抑えられるため、復元画像においてぼけを発生しにくくすることができ、JPEG、MPEG、MPEG-II、H.264といったDCT圧縮画像に混入した雑音を効果的に除去することができる。  According to this embodiment, the block distortion can be effectively removed by performing DEF on the texture component after the component separation by the Total Variation filter, and the mosquito noise generated in the vicinity of the edge is removed using the Gaussian filter. By selecting the pixels to which the Gaussian filter is applied by detecting edges, the removal of texture components can be suppressed as much as possible when removing noise, making it less likely to cause blur in the restored image. Noise mixed in DCT compressed images such as MPEG, MPEG-II, and H.264 can be effectively removed.

なお、図1に示す画像処理装置は、コンピュータを用いたソフトウェアにより実現することができる。その際、図1に示す各構成部は、それぞれの機能を実現するための手段として把握され、それらにより画像処理プログラムが構成される。つまり、入力画像を骨格成分とテクスチャ成分に成分分離する成分分離手段と、成分分離手段にて成分分離されたテクスチャ成分に対しブロックひずみ除去を行うブロックひずみ除去手段と、成分分離手段にて成分分離された骨格成分よりエッジの検出を行うエッジ検出手段と、エッジ検出手段にて検出されたエッジの周りの画素に対してモスキート雑音の除去を行うモスキート雑音除去手段と、ブロックひずみおよびモスキート雑音が除去されたテクスチャ成分と骨格成分とを合成し復元画像を得る手段として、コンピュータを機能させる画像処理プログラムとして構成される。   The image processing apparatus shown in FIG. 1 can be realized by software using a computer. In that case, each component shown in FIG. 1 is grasped as a means for realizing each function, and an image processing program is constituted by them. That is, component separation means for separating the input image into skeleton components and texture components, block distortion removal means for removing block distortion from the texture components separated by the component separation means, and component separation by the component separation means Edge detection means for detecting edges from the detected skeleton components, mosquito noise removal means for removing mosquito noise for pixels around the edges detected by the edge detection means, and block distortion and mosquito noise are removed. As a means for synthesizing the texture component and the skeleton component thus obtained to obtain a restored image, the image processing program is configured to cause a computer to function.

また、本発明は上記した実施形態に記載のものに限定されるものではなく、成分分離手段、ブロックひずみ除去手段、エッジ検出手段、モスキート雑音除去手段としては、それぞれの機能を実現できるものであれば、Total Variation フィルタ、DEF、Sobelフィルタ、Gaussianフィルタ以外のものをそれぞれ用いてもよい。   Further, the present invention is not limited to the one described in the above embodiment, and the component separating means, the block distortion removing means, the edge detecting means, and the mosquito noise removing means can realize their respective functions. For example, filters other than the Total Variation filter, DEF, Sobel filter, and Gaussian filter may be used.

10 Total Variation フィルタ
12 DEF
14 Sobelフィルタ
16 Gaussianフィルタ
18 成分合成部
10 Total Variation Filter 12 DEF
14 Sobel Filter 16 Gaussian Filter 18 Component Synthesizer

Claims (2)

入力画像を骨格成分とテクスチャ成分に成分分離する成分分離手段と、
前記成分分離手段にて成分分離されたテクスチャ成分に対しブロックひずみ除去を行うブロックひずみ除去手段と、
前記成分分離手段にて成分分離された骨格成分よりエッジの検出を行うエッジ検出手段と、
前記エッジ検出手段にて検出されたエッジの周りの画素に対してモスキート雑音の除去を行うモスキート雑音除去手段と、
前記ブロックひずみおよび前記モスキート雑音が除去されたテクスチャ成分と前記骨格成分とを合成し復元画像を得る手段と、を備えたことを特徴とする画像処理装置。
Component separation means for separating an input image into a skeleton component and a texture component;
Block distortion removing means for removing block distortion on the texture component separated by the component separating means;
Edge detection means for detecting an edge from the skeleton component separated by the component separation means;
Mosquito noise removing means for removing mosquito noise for pixels around the edge detected by the edge detecting means;
An image processing apparatus comprising: a texture component from which the block distortion and the mosquito noise have been removed and a skeleton component to obtain a restored image.
コンピュータを、
入力画像を骨格成分とテクスチャ成分に成分分離する成分分離手段と、
前記成分分離手段にて成分分離されたテクスチャ成分に対しブロックひずみ除去を行うブロックひずみ除去手段と、
前記成分分離手段にて成分分離された骨格成分よりエッジの検出を行うエッジ検出手段と、
前記エッジ検出手段にて検出されたエッジの周りの画素に対してモスキート雑音の除去を行うモスキート雑音除去手段と、
前記ブロックひずみおよび前記モスキート雑音が除去されたテクスチャ成分と前記骨格成分とを合成し復元画像を得る手段として機能させることを特徴とする画像処理プログラム。
Computer
Component separation means for separating an input image into a skeleton component and a texture component;
Block distortion removing means for removing block distortion on the texture component separated by the component separating means;
Edge detection means for detecting an edge from the skeleton component separated by the component separation means;
Mosquito noise removing means for removing mosquito noise for pixels around the edge detected by the edge detecting means;
An image processing program that combines a texture component from which the block distortion and the mosquito noise have been removed and the skeleton component to function as means for obtaining a restored image.
JP2010042634A 2010-02-26 2010-02-26 Image processing apparatus and image processing program Expired - Fee Related JP5488048B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2010042634A JP5488048B2 (en) 2010-02-26 2010-02-26 Image processing apparatus and image processing program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2010042634A JP5488048B2 (en) 2010-02-26 2010-02-26 Image processing apparatus and image processing program

Publications (2)

Publication Number Publication Date
JP2011182093A JP2011182093A (en) 2011-09-15
JP5488048B2 true JP5488048B2 (en) 2014-05-14

Family

ID=44693161

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2010042634A Expired - Fee Related JP5488048B2 (en) 2010-02-26 2010-02-26 Image processing apparatus and image processing program

Country Status (1)

Country Link
JP (1) JP5488048B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106408519A (en) * 2015-11-10 2017-02-15 青岛大学 Non-local image restoration method based on total variation

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104156925B (en) * 2014-08-18 2017-10-27 飞依诺科技(苏州)有限公司 Speckle and the enhanced processing method in border and system are removed to ultrasonoscopy

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3825825B2 (en) * 1995-12-28 2006-09-27 キヤノン株式会社 Filter device
JP4937852B2 (en) * 2007-07-10 2012-05-23 オリンパス株式会社 Image processing apparatus, image processing program, and imaging apparatus
JP5097914B2 (en) * 2008-07-30 2012-12-12 オリンパス株式会社 Component extraction correction device, component extraction correction method, component extraction correction program, or electronic device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106408519A (en) * 2015-11-10 2017-02-15 青岛大学 Non-local image restoration method based on total variation
CN106408519B (en) * 2015-11-10 2019-06-21 青岛大学 Non-local image restoration method based on total variation

Also Published As

Publication number Publication date
JP2011182093A (en) 2011-09-15

Similar Documents

Publication Publication Date Title
KR100790980B1 (en) Post-processing circuit according to the frequency components of the image signal
KR101031438B1 (en) Content adaptive noise reduction filtering for image signals
JP4211838B2 (en) Imaging apparatus and image processing method
KR101641543B1 (en) Apparatus and method for reducing noise of color image
JP2010081368A (en) Image processor, moving image decoding device, moving image encoding device, image processing method, moving image decoding method, and, moving image encoding method
RU2009127749A (en) COMPRESSING AND REMOVING AN IMAGE COMPRESSION
CN112218097A (en) Loop filter device and image decoding device
WO2014208434A1 (en) Image processing device, image processing method, and image processing program
JP5191224B2 (en) Image processing device
JP5367667B2 (en) Image processing device
JP2006081156A (en) Image processing apparatus, method, and program
US10755399B2 (en) Image processing device, image processing method, and image processing program
KR20090013522A (en) Method for blur removing ringing-atifactless
JP2007251881A (en) Block noise eliminating apparatus, and electronic appliance
JP2007316983A (en) Image processor, image processing method and program
JP2008301336A (en) Image processing device, image encoding device and image decoding device
JP5488048B2 (en) Image processing apparatus and image processing program
KR20110117474A (en) Texture enhancement method and apparatus reflected human visual characteristic on spatial frequency
JP5062483B2 (en) Signal processing apparatus and method, and program
ITTO20100931A1 (en) "PROCEDURE AND DEVICE TO CLEAR A DIGITAL VIDEO SIGNAL, ITS RELATED PRODUCT, FROM THE NOISE"
JP2005141722A (en) Image signal processing method, image signal processing apparatus, and image signal program
JP5322704B2 (en) Image processing apparatus and image processing method
KR100777287B1 (en) apparatus for displaying video image
Shao et al. Coding artifacts robust resolution up-conversion
KR101780444B1 (en) Method for reducing noise of video signal

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20130220

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20131218

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20140204

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140210

R150 Certificate of patent or registration of utility model

Ref document number: 5488048

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees