JPH07121703A - Image processing method - Google Patents

Image processing method

Info

Publication number
JPH07121703A
JPH07121703A JP5287564A JP28756493A JPH07121703A JP H07121703 A JPH07121703 A JP H07121703A JP 5287564 A JP5287564 A JP 5287564A JP 28756493 A JP28756493 A JP 28756493A JP H07121703 A JPH07121703 A JP H07121703A
Authority
JP
Japan
Prior art keywords
image
function
degree
parameter
restoration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP5287564A
Other languages
Japanese (ja)
Inventor
Hiroyuki Urushiya
裕之 漆家
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to JP5287564A priority Critical patent/JPH07121703A/en
Publication of JPH07121703A publication Critical patent/JPH07121703A/en
Pending legal-status Critical Current

Links

Landscapes

  • Image Processing (AREA)

Abstract

PURPOSE:To restore an original image with high accuracy by finding a degradation function. CONSTITUTION:The output of an image input device 1 is connected to a computer 2, and an input device 3, image display device 4 and image preservation device 5 are connected to the computer 2. Inside the computer 2, a small area including one edge part at least is designated in an image inputted from the input device 1, a certain function such as a regular function containing a parameter is assumed as the degradation function, the image is restored while changing parameters T and (n), and degree of image restoration is calculated, and the entire image is restored by using the degradation functions of parameters Tmax and Nmax which improve most the degree of image restoration.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、デジタル画像処理の分
野に属し、劣化した画像に対してその劣化関数を推定し
復元する画像処理方法に関するものである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a field of digital image processing and relates to an image processing method for estimating and restoring a deterioration function of a deteriorated image.

【0002】[0002]

【従来の技術】画像復元の種々の手法であるWienerフィ
ルタ、一般逆フィルタ、制限付き最小二乗フィルタ等を
適用する際には、先ず劣化関数を決定する必要がある。
この劣化関数は劣化の原因となる物理現象から解析的に
求めたり、また測定装置が手元にある場合には、直接入
出力関係を測定して劣化特性を推定する方法が最も理想
的である。
2. Description of the Related Art When applying a Wiener filter, a general inverse filter, a restricted least squares filter, etc., which are various methods of image restoration, it is first necessary to determine a deterioration function.
The deterioration function is most ideally obtained by analytically obtaining from the physical phenomenon that causes the deterioration, or when the measuring device is at hand, by directly measuring the input-output relationship and estimating the deterioration characteristic.

【0003】しかし、これらの方法を用いることができ
ない場合には、劣化した画像から直接劣化関数を推定し
なければならない。この劣化関数の推定には、次の方法
が知られている。
However, when these methods cannot be used, the deterioration function must be estimated directly from the deteriorated image. The following method is known for estimating this deterioration function.

【0004】(イ) 点拡がり関数の推定 (ロ) 線拡がり関数からの推定 (ハ) 縁部拡がり関数からの推定(A) Estimation of point spread function (b) Estimation from line spread function (c) Estimation from edge spread function

【0005】特に(ハ) の場合には、原画像中に鋭い縁部
があれば、その縁部を微分して線拡がり関数を求め、画
像再構成手法を用いて劣化関数を決定する方法が知られ
ている。
Particularly in the case of (c), if there is a sharp edge portion in the original image, a method of differentiating the edge portion to obtain a line spread function and determining a deterioration function using an image reconstruction method is available. Are known.

【0006】[0006]

【発明が解決しようとする課題】しかしながら、原画像
中の縁部から劣化関数を求める場合には、原画像から縁
部を抽出する必要があるが、原画像は劣化しているため
縁部を抽出することが困難である。
However, when obtaining the deterioration function from the edge portion in the original image, it is necessary to extract the edge portion from the original image, but since the original image is deteriorated, the edge portion is removed. Difficult to extract.

【0007】また、抽出できた場合でも縁部は直線とは
限らないため、画像再構成手法を用いて劣化関数を求め
ることは難しく、精度も悪い。
Further, even if the edge can be extracted, the edge portion is not always a straight line, so that it is difficult and difficult to obtain the deterioration function using the image reconstruction method.

【0008】本発明の目的は、上述の問題点を解消し、
劣化関数を容易に求め高精度に原画像を復元することが
できる画像処理方法を提供することにある。
The object of the present invention is to solve the above-mentioned problems,
An object of the present invention is to provide an image processing method capable of easily obtaining a deterioration function and restoring an original image with high accuracy.

【0009】[0009]

【課題を解決するための手段】上述の目的を達成するた
めの本発明に係る画像処理方法は、劣化を受けた画像中
の少なくとも縁部を含む小領域を指定し、該小領域内を
パラメータを含む劣化関数を変化させながら画像復元を
行うと共に、前記パラメータに対応する画像復元度を求
め、前記画像復元度を基に前記パラメータを含む前記劣
化関数を選択して前記劣化を受けた画像全体の画像復元
を行うことを特徴とする。
According to an image processing method of the present invention for achieving the above object, a small area including at least an edge portion is designated in a deteriorated image, and a parameter is set in the small area. The image restoration is performed while changing the degradation function including the parameter, the image restoration degree corresponding to the parameter is obtained, and the degradation function including the parameter is selected based on the image restoration degree, and the entire image subjected to the degradation is selected. It is characterized by performing the image restoration of.

【0010】[0010]

【作用】上述の構成を有する画像処理方法は、劣化を受
けた画像中の少なくとも縁部を含む小領域を指定し、こ
の小領域内を或るパラメータの劣化関数を用いて画像復
元を行うと共にその画像復元度を求め、パラメータを変
化させながら画像復元と画像復元度を求める操作を繰り
返して行い、画像復元度が最良となるパラメータの劣化
関数を用いて劣化を受けた画像全体の画像復元を行う。
According to the image processing method having the above-described structure, a small area including at least an edge portion is specified in the deteriorated image, and the image restoration is performed in the small area by using the deterioration function of a certain parameter. The image restoration degree is obtained, and the image restoration and the operation for obtaining the image restoration degree are repeated while changing the parameters, and the image restoration of the entire image that has been deteriorated is performed by using the deterioration function of the parameter with the best image restoration degree. To do.

【0011】[0011]

【実施例】本発明を図示の実施例に基づいて詳細に説明
する。図1は実施例のブロック回路構成図であり、スラ
イドスキャナ等の画像入力装置1の出力はコンピュータ
2に接続され、このコンピュータ2には入力デバイス
3、ディスプレイ等の画像表示装置4、磁気ディスク等
の画像保存装置5が接続されている。
DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail based on the illustrated embodiments. FIG. 1 is a block circuit configuration diagram of an embodiment. The output of an image input device 1 such as a slide scanner is connected to a computer 2, and the computer 2 has an input device 3, an image display device 4 such as a display, a magnetic disk and the like. The image storage device 5 is connected.

【0012】画像入力装置1からコンピュータ2内に読
み込まれた画像は入力デバイス3からの指示により図2
のフローチャート図に示すような処理が施され、画像表
示装置4に表示される。また、処理を施された画像は必
要に応じて画像保存装置5に保存される。
The image read into the computer 2 from the image input device 1 is instructed by the input device 3 as shown in FIG.
The process shown in the flowchart of FIG. The processed image is stored in the image storage device 5 as needed.

【0013】図2のフローチャート図について説明する
と、先ずステップ11において図3に示すような入力画
像から、劣化が明瞭に識別可能である縁部R、或いは操
作者が最も復元したいと思う場所で少なくとも1個所の
縁部を含む領域Rを矩形ROI等で指定し、ステップ1
2においてステップ11で指定した領域を図4に示すよ
うに切り出す。次に、劣化関数として次式のような正規
分布を基にしたガウス窓関数ωG(x)を仮定し、ステップ
13において図5に示すように、ガウス窓関数ωG(x)の
ガウス窓の直径を示すパラメータT、及びガウス窓の形
状を示すパラメータnを用いて、Wienerフィルタを掛け
る。ここで、ωR (x) は幅がパラメータTである矩形窓
を示している。 ωG(x)=ωR (x) ・exp(−2n2 ・‖x‖2 /T2 )・・・(1)
Referring to the flow chart of FIG. 2, first, at step 11, from the input image as shown in FIG. 3, at least at the edge portion R where the deterioration can be clearly identified, or at the place where the operator most desires to restore the image. A region R including one edge is designated by a rectangular ROI or the like, and step 1
In step 2, the area designated in step 11 is cut out as shown in FIG. Next, assuming a Gaussian window function ω G (x) based on a normal distribution as the following equation as the deterioration function, in step 13, as shown in FIG. 5, the Gaussian window function ω G (x) of the Gaussian window function ω G (x) The Wiener filter is applied by using the parameter T indicating the diameter of n and the parameter n indicating the shape of the Gaussian window. Here, ω R (x) indicates a rectangular window whose width is the parameter T. ω G (x) = ω R (x) ・ exp (-2n 2 · ‖x‖ 2 / T 2 ) ・ ・ ・ (1)

【0014】次に、ステップ14において図6に示すよ
うに判別分析法により二値化を行い、分離度を算出す
る。この判別分析法による二値化は次のようにして行
う。
Next, in step 14, binarization is performed by the discriminant analysis method as shown in FIG. 6 to calculate the degree of separation. The binarization by this discriminant analysis method is performed as follows.

【0015】(a) 先ず、画像の濃度値のヒストグラムを
作成する。 (b) 所定の閾値をkとし、濃度値が閾値k以上の画素と
閾値kより小さい画素の2個のグループに分割し、それ
ぞれクラス1、2とする。 (c) それぞれのクラス1、2の画素数をω1 、ω2 、平
均濃度値をM1 、M2、分散をσ1 、σ2 とし、また全
画素の平均濃度値をMT として、クラス内分散σW 2及び
クラス間分散σB 2を計算する。なお、クラス内分散σW 2
及びクラス間分散σB 2は次式により与えられ、分離度を
これらの比σB 2/σW 2で定義する。
(A) First, a histogram of image density values is created. (b) The predetermined threshold value is set to k, and the pixel is divided into two groups of pixels whose density value is equal to or larger than the threshold value k and pixels whose density value is smaller than the threshold value k, and are classified into classes 1 and 2, respectively. the number of pixels omega 1 (c), each class 1,2, ω 2, the average density value of M 1, M 2, 1 a variance sigma, and sigma 2, also the average density value of all pixels as M T, Intraclass variance σ W 2 and interclass variance σ B 2 are calculated. Within-class variance σ W 2
And the interclass variance σ B 2 are given by the following equation, and the degree of separation is defined by the ratio σ B 2 / σ W 2 .

【0016】 σW 2=ω1 σ1 2+ω2 σ2 2 ・・・(2) σB 2=ω1 ・(M1 −MT2 +ω2 ・(M2 −MT2 =ω1 ・ω2 ・( M1 −M22 ・・・(3) Σ W 2 = ω 1 σ 1 2 + ω 2 σ 2 2 (2) σ B 2 = ω 1 · (M 1 −M T ) 2 + ω 2 · (M 2 −M T ) 2 = ω 1 · ω 2 · (M 1 -M 2) 2 ··· (3)

【0017】例えば、図7に示すような鋭い縁部を持つ
原画像に劣化が発生し、図8に示すようななだらかな縁
部の画像になった場合に、図7の画像と図8の画像の濃
度ヒストグラムを作成すると、それぞれ図9、図10に
示すようなグラフ図が得られる。原画像のヒストグラム
では2個のクラス1、2は明瞭に分かれており、クラス
間分散σB 2が大きく、分離度σB 2/σW 2も大きい。これ
に対して、劣化した画像のヒストグラムではクラス間分
散σB 2が小さく、分離度σB 2/σW 2も小さい。従って、
この分離度σB 2/σW 2は縁部を有する画像の復元の度合
を示す尺度となっている。
For example, when the original image having a sharp edge portion as shown in FIG. 7 is deteriorated and becomes an image with a smooth edge portion as shown in FIG. 8, the images of FIG. 7 and FIG. When a density histogram of an image is created, graphs as shown in FIGS. 9 and 10 are obtained. In the histogram of the original image, the two classes 1 and 2 are clearly separated, the interclass variance σ B 2 is large, and the separation σ B 2 / σ W 2 is also large. On the other hand, in the histogram of the deteriorated image, the interclass variance σ B 2 is small and the separation σ B 2 / σ W 2 is also small. Therefore,
The degree of separation σ B 2 / σ W 2 is a measure showing the degree of restoration of an image having an edge.

【0018】(d) (b) 、(c) を全ゆる閾値kについて繰
り返し、分離度σB 2/σW 2が最大となる閾値kと、その
時における分離度σB 2/σW 2が求められる。
(D) (b) and (c) are repeated for all thresholds k, and the threshold k at which the separation σ B 2 / σ W 2 is maximum and the separation σ B 2 / σ W 2 at that time are Desired.

【0019】更に、ステップ15においてガウス窓関数
ωG(x)のパラメータT、Nを所定の範囲でそれぞれ変化
させながら、ステップ13〜15の操作を繰り返す。パ
ラメータT、Nの動かし方としては、最初に大きな幅で
動かす粗サーチを行ってパラメータT、Nの概数を求
め、順次に幅を狭くして精細なサーチを行うことによっ
て、計算時間の短縮を図ることができる。更に、ステッ
プ16においてステップ15で得られた結果から、分離
度σB 2/σW 2が最大となるパラメータTmax 、Nmax
求める。
Further, in step 15, the operations of steps 13 to 15 are repeated while changing the parameters T and N of the Gaussian window function ω G (x) within a predetermined range. As a method of moving the parameters T and N, first, a rough search is performed in which the parameters are moved with a large width to obtain an approximate number of the parameters T and N, and the width is sequentially narrowed to perform a fine search, thereby reducing the calculation time. Can be planned. Further, in step 16, parameters T max and N max that maximize the degree of separation σ B 2 / σ W 2 are obtained from the result obtained in step 15.

【0020】ここで、ステップ13でWienerフィルタを
掛けた際に、ノイズを強調した場合等において、分離度
σB 2/σW 2だけを用いて評価しても良好に閾値kを求め
ることができないことがある。この場合には、ステップ
14で二値化した画像を連結成分によりラベリングし、
ラベル数が最小となるものの中で分離度σB 2/σW 2が最
大となるものを採用すればよい。
Here, when noise is emphasized when the Wiener filter is applied in step 13, the threshold value k can be satisfactorily obtained even if evaluation is performed using only the separation degree σ B 2 / σ W 2. There are things you can't do. In this case, the binarized image in step 14 is labeled with the connected components,
Among those having the smallest number of labels, the one having the largest degree of separation σ B 2 / σ W 2 may be adopted.

【0021】最後にステップ17において、図11に示
すようにステップ16で求めたパラメータTmax 、N
max を含むガウス窓関数ωG(x)により、例えばWienerフ
ィルタ等の従来の画像復元手法を用いて画像全体の復元
を行う。
Finally, in step 17, as shown in FIG. 11, the parameters T max and N obtained in step 16 are calculated.
The Gaussian window function ω G (x) including max is used to restore the entire image using a conventional image restoration method such as a Wiener filter.

【0022】本実施例では、劣化関数を直接求めるので
はなく、劣化関数として例えば正規関数等の或る関数を
仮定し、そのパラメータを変動させて決定することによ
り、復元度が最良となる劣化関数を決定することがで
き、効果の高い画像復元を行うことができる。
In this embodiment, instead of directly obtaining the deterioration function, a certain function such as, for example, a normal function is assumed as the deterioration function and the parameter is changed to determine the deterioration function, so that the deterioration degree with the best restoration is obtained. The function can be determined, and highly effective image restoration can be performed.

【0023】[0023]

【発明の効果】以上説明したように本発明に係る画像処
理方法は、原画像から縁部を抽出する必要がなく、縁部
を含む領域を指定するだけで劣化関数を求めることがで
き、高精度に原画像を復元することができる。また、再
構成法等の高度な技術を必要としない画像の復元が可能
となる。
As described above, in the image processing method according to the present invention, it is not necessary to extract the edge portion from the original image, and the deterioration function can be obtained only by designating the area including the edge portion. The original image can be accurately restored. Moreover, it is possible to restore an image that does not require a high-level technique such as a reconstruction method.

【図面の簡単な説明】[Brief description of drawings]

【図1】実施例のブロック構成図である。FIG. 1 is a block diagram of an embodiment.

【図2】処理手段を表すフローチャート図である。FIG. 2 is a flowchart showing processing means.

【図3】処理手段の説明図である。FIG. 3 is an explanatory diagram of processing means.

【図4】処理手段の説明図である。FIG. 4 is an explanatory diagram of processing means.

【図5】処理手段の説明図である。FIG. 5 is an explanatory diagram of processing means.

【図6】処理手段の説明図である。FIG. 6 is an explanatory diagram of processing means.

【図7】原画像の縁部の画像濃度を表すグラフ図であ
る。
FIG. 7 is a graph showing the image density at the edge of the original image.

【図8】劣化画像の縁部の画像濃度を表すグラフ図であ
る。
FIG. 8 is a graph showing the image density at the edge of the deteriorated image.

【図9】原画像の縁部の画像濃度のヒストグラムを表す
グラフ図である。
FIG. 9 is a graph showing a histogram of image density at an edge of an original image.

【図10】劣化画像の縁部の画像濃度のヒストグラムを
表すグラフ図である。
FIG. 10 is a graph showing a histogram of image density at the edge of a deteriorated image.

【図11】処理手段の説明図である。FIG. 11 is an explanatory diagram of processing means.

【符号の説明】[Explanation of symbols]

1 画像入力装置 2 コンピュータ 3 入力デバイス 4 画像表示装置 5 画像保存装置 1 image input device 2 computer 3 input device 4 image display device 5 image storage device

Claims (2)

【特許請求の範囲】[Claims] 【請求項1】 劣化を受けた画像中の少なくとも縁部を
含む小領域を指定し、該小領域内をパラメータを含む劣
化関数を変化させながら画像復元を行うと共に、前記パ
ラメータに対応する画像復元度を求め、前記画像復元度
を基に前記パラメータを含む前記劣化関数を選択して前
記劣化を受けた画像全体の画像復元を行うことを特徴と
する画像処理方法。
1. A small area including at least an edge portion in a degraded image is designated, image restoration is performed while changing a deterioration function including a parameter in the small area, and image restoration corresponding to the parameter is performed. The image processing method is characterized in that the deterioration function is obtained, the deterioration function including the parameter is selected based on the image restoration degree, and the entire image subjected to the degradation is restored.
【請求項2】 前記画像復元度は判別分析法のクラス分
離度を用いて求めるようにした請求項1に記載の画像処
理方法。
2. The image processing method according to claim 1, wherein the image restoration degree is obtained using a class separation degree of a discriminant analysis method.
JP5287564A 1993-10-22 1993-10-22 Image processing method Pending JPH07121703A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP5287564A JPH07121703A (en) 1993-10-22 1993-10-22 Image processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP5287564A JPH07121703A (en) 1993-10-22 1993-10-22 Image processing method

Publications (1)

Publication Number Publication Date
JPH07121703A true JPH07121703A (en) 1995-05-12

Family

ID=17718979

Family Applications (1)

Application Number Title Priority Date Filing Date
JP5287564A Pending JPH07121703A (en) 1993-10-22 1993-10-22 Image processing method

Country Status (1)

Country Link
JP (1) JPH07121703A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6822758B1 (en) 1998-07-01 2004-11-23 Canon Kabushiki Kaisha Image processing method, system and computer program to improve an image sensed by an image sensing apparatus and processed according to a conversion process
WO2007141863A1 (en) * 2006-06-08 2007-12-13 Nippon Computer System Co., Ltd Image processing program and computer readable recording medium with the program recorded therein and image processing device
CN100399355C (en) * 2004-06-10 2008-07-02 索尼株式会社 Image processing device and method, recording medium, and program
US7596273B2 (en) 2004-04-19 2009-09-29 Fujifilm Corporation Image processing method, image processing apparatus, and image processing program
US7599568B2 (en) 2004-04-19 2009-10-06 Fujifilm Corporation Image processing method, apparatus, and program
JP2010026977A (en) * 2008-07-24 2010-02-04 Nikon Corp Image restoration method, program and image restoration device
US7720302B2 (en) 2003-09-25 2010-05-18 Fujifilm Corporation Method, apparatus and program for image processing
JP2014132392A (en) * 2013-01-04 2014-07-17 Fujitsu Ltd Image processing apparatus, image processing method, and program
JP2017525037A (en) * 2014-07-14 2017-08-31 フィンガープリント カーズ アーベー Method and electronic apparatus for noise reduction

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6822758B1 (en) 1998-07-01 2004-11-23 Canon Kabushiki Kaisha Image processing method, system and computer program to improve an image sensed by an image sensing apparatus and processed according to a conversion process
US7720302B2 (en) 2003-09-25 2010-05-18 Fujifilm Corporation Method, apparatus and program for image processing
US7596273B2 (en) 2004-04-19 2009-09-29 Fujifilm Corporation Image processing method, image processing apparatus, and image processing program
US7599568B2 (en) 2004-04-19 2009-10-06 Fujifilm Corporation Image processing method, apparatus, and program
CN100399355C (en) * 2004-06-10 2008-07-02 索尼株式会社 Image processing device and method, recording medium, and program
WO2007141863A1 (en) * 2006-06-08 2007-12-13 Nippon Computer System Co., Ltd Image processing program and computer readable recording medium with the program recorded therein and image processing device
JP2010026977A (en) * 2008-07-24 2010-02-04 Nikon Corp Image restoration method, program and image restoration device
JP2014132392A (en) * 2013-01-04 2014-07-17 Fujitsu Ltd Image processing apparatus, image processing method, and program
JP2017525037A (en) * 2014-07-14 2017-08-31 フィンガープリント カーズ アーベー Method and electronic apparatus for noise reduction

Similar Documents

Publication Publication Date Title
Friedland et al. SIOX: Simple interactive object extraction in still images
JP4580183B2 (en) Generation of visually representative video thumbnails
KR100860988B1 (en) Method and apparatus for object detection in sequences
KR20000076565A (en) System and method for determining a level of similarity among more than one image and a segmented data structure for enabling such determination
KR20010033552A (en) Detection of transitions in video sequences
Horng et al. Using sorted switching median filter to remove high-density impulse noises
CN111104913B (en) Video PPT extraction method based on structure and similarity
US6701026B1 (en) Method and apparatus for cancelling lighting variations in object recognition
CN105550694B (en) Method for measuring fuzzy degree of face image
Nair et al. Direction based adaptive weighted switching median filter for removing high density impulse noise
JPH07121703A (en) Image processing method
Roy et al. Removal of ‘salt & pepper’noise from color images using adaptive fuzzy technique based on histogram estimation
US6408028B1 (en) Diffusion based peer group processing method for image enhancement and segmentation
Yoo et al. The nonlinear prefiltering and difference of estimates approaches to edge detection: Applications of stack filters
US20090041344A1 (en) Methods and Systems for Determining a Background Color in a Digital Image
CN111951254B (en) Edge-guided weighted-average-based source camera identification method and system
US20050238234A1 (en) Method for edge detection and contour stroke generation
KR100499121B1 (en) Apparatus and method for image segmentation using automatic thresholding technique
Chen et al. Image quality measurement based on statistics of activity regions
Chen et al. Animated non-photorealistic rendering in multiple styles
Manek et al. A soft weighted median filter for removing general purpose image noise
JP3118484B2 (en) Image segmentation method
Zain et al. Hybrid singular value decomposition based alpha trimmed mean-median filter in eliminating high density salt and pepper noise from grayscale image
Palenichka et al. Structure-adaptive image filtering using order statistics
CN116468977B (en) Method and device for evaluating antagonism robustness of visual detection model