TW201429227A - Noise estimation apparatus and method thereof - Google Patents

Noise estimation apparatus and method thereof Download PDF

Info

Publication number
TW201429227A
TW201429227A TW102100585A TW102100585A TW201429227A TW 201429227 A TW201429227 A TW 201429227A TW 102100585 A TW102100585 A TW 102100585A TW 102100585 A TW102100585 A TW 102100585A TW 201429227 A TW201429227 A TW 201429227A
Authority
TW
Taiwan
Prior art keywords
image
value
pixel data
block
distribution
Prior art date
Application number
TW102100585A
Other languages
Chinese (zh)
Other versions
TWI501628B (en
Inventor
Kuan-Kang Lai
Original Assignee
Novatek Microelectronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Novatek Microelectronics Corp filed Critical Novatek Microelectronics Corp
Priority to TW102100585A priority Critical patent/TWI501628B/en
Priority to US13/897,001 priority patent/US9031322B2/en
Publication of TW201429227A publication Critical patent/TW201429227A/en
Application granted granted Critical
Publication of TWI501628B publication Critical patent/TWI501628B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20076Probabilistic image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Image Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Picture Signal Circuits (AREA)

Abstract

A noise estimation apparatus and method thereof for calculating a noise estimation value of an image. The noise estimation apparatus comprises a calculating unit, a variance calculating unit, a distribution curve generating unit and a noise estimation unit. The calculating unit generates a pixel distribution according to a plurality of pixel data of an i<SP>th</SP> block of the image and a plurality of pixel data of the i<SP>th</SP> block of a previous image. The variance calculating unit combines the pixel data of an i<SP>th</SP> block of the image and the pixel data of an i<SP>th</SP> block of the previous image to correspondingly generate a variance value. The distribution curve generating unit generates a distribution curve according to the variance value, and compares the pixel distribution with the distribution curve to correspondingly generate a weighting value. The noise estimation unit outputs the noise estimation value according to the weighting value and the variance value corresponding to each of the blocks of the image.

Description

雜訊估測裝置及其方法 Noise estimation device and method thereof

本發明是有關於一種雜訊估測裝置及其方法,且特別是有關於一種計算影像之雜訊估測值之雜訊估測裝置及其方法。 The present invention relates to a noise estimation apparatus and method thereof, and more particularly to a noise estimation apparatus for calculating a noise estimation value of an image and a method thereof.

近年來,由於多媒體應用的快速發展,對於影像品質的要求也日漸提高。然而,多媒體影像常會受到雜訊的干擾,這些雜訊不僅會降低影像的品質,使其清晰度、銳利度因此而降低,物體輪廓也變得模糊。為了消除影像雜訊,雜訊估測(noise estimation)技術通常被應用於影像處理系統當中,以作為雜訊降低(noise reduction)處理的基準。 In recent years, due to the rapid development of multimedia applications, the requirements for image quality have also increased. However, multimedia images are often interfered with by noise. These noises not only degrade the quality of the image, but also reduce the sharpness and sharpness of the image, and the outline of the object becomes blurred. In order to eliminate image noise, noise estimation technology is commonly used in image processing systems as a benchmark for noise reduction processing.

然而,在執行雜訊估測時,影像中的細節部分或是動態的影像往往會被誤判為影像中的雜訊,倘若依此判斷結果而接著進行雜訊降低處理,如此將使得雜訊降低處理後的影像反而被減低了影像品質。 However, when performing noise estimation, the details or dynamic images in the image are often misjudged as noise in the image. If the result is judged and then the noise reduction processing is performed, the noise will be reduced. The processed image is instead reduced in image quality.

因此,如何提供一種可以有效地判斷影像內容受雜訊干擾程度的雜訊估測技術,以避免影像細節或是動態影像被誤判為雜訊,乃業界所致力的課題之一。 Therefore, how to provide a noise estimation technology that can effectively judge the degree of noise interference of image content to avoid image details or motion images being misjudged as noise is one of the topics of the industry.

本發明係有關於一種雜訊估測技術,可以有效地判斷影像內容受雜訊干擾的程度。 The invention relates to a noise estimation technology, which can effectively judge the degree of interference of image content by noise.

根據本發明之一方面,提出一種雜訊估測裝置。雜訊估測裝置用以計算一影像之一雜訊估測值,該影像具有M個區塊,該M個區塊可重疊或不重疊,每個區塊各自具有複數筆像素資料,該些像素資料中包括一目標像素資料,M係大於1之正整數,該雜訊估測裝置包括一分佈計算單元、一變異計算單元、一分佈曲線產生模組及一雜訊估測單元。分佈計算單元用以依據該影像之第i個區塊之該些像素資料,以及一先前影像之該第i個區塊之複數筆先前像素資料,計算複數筆像素值之所分別對應之像素個數,以產生一像素分佈,i係介於1至M之正整數。變異計算單元用以組合該影像之該第i個區塊之該些像素資料以及該先前影像之該第i個區塊之該些先前像素資料,並對應地產生一變異數。分佈曲線產生模組以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數產生一分佈曲線,並比較該像素分佈以及該分佈曲線,以對應地產生一權重值。雜訊估測單元用以依據該影像之每一個區塊所對應之該權重值及該變異數,輸出該雜訊估測值。 According to an aspect of the invention, a noise estimation apparatus is provided. The noise estimation device is configured to calculate a noise estimation value of an image, the image has M blocks, the M blocks may overlap or not overlap, and each block has a plurality of pixel data, and the blocks The pixel data includes a target pixel data, and the M system is a positive integer greater than 1. The noise estimation device includes a distribution calculation unit, a mutation calculation unit, a distribution curve generation module, and a noise estimation unit. The distribution calculation unit is configured to calculate pixels corresponding to the plurality of pixel values according to the pixel data of the i-th block of the image and the plurality of previous pixel data of the i-th block of a previous image. Number to produce a pixel distribution, i is a positive integer between 1 and M. The mutation calculation unit is configured to combine the pixel data of the i-th block of the image and the previous pixel data of the i-th block of the previous image, and correspondingly generate a variance. The distribution curve generation module generates a distribution curve based on the target pixel data of the i-th block of the image, and compares the pixel distribution and the distribution curve to correspondingly generate a weight value. The noise estimation unit is configured to output the noise estimation value according to the weight value and the variance corresponding to each block of the image.

根據本發明之另一方面,提出一種雜訊估測方法,係使用於一雜訊估測裝置,此方法用以計算一影像之一雜訊估測值,該影像具有M個區塊,該M個區塊可重疊或不重疊,每個區塊各自具有複數筆像素資料,該些像素資料中包括一目標像素資料,M係大於1之正整數,該雜訊估測方法包括:依據該影像之第i個區塊之該些像素資料,以及一先前影像之該第i個區塊之複數筆先前像素資料,計算複數筆像素值之所分別對應之像素個數,以產生一像 素分佈,i係介於1至M之正整數;組合該影像之該第i個區塊之該些像素資料以及該先前影像之該第i個區塊之該些先前像素資料,並對應地產生一變異數;以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數產生一分佈曲線,並比較該像素分佈以及該分佈曲線,以對應地產生一權重值;以及依據該影像之每一個區塊所對應之該權重值及該變異數,輸出該雜訊估測值。 According to another aspect of the present invention, a noise estimation method is provided for use in a noise estimation device for calculating a noise estimation value of an image having M blocks, The M blocks may overlap or not overlap, and each block has a plurality of pixel data, the pixel data includes a target pixel data, and the M system is a positive integer greater than 1. The noise estimation method includes: Calculating the pixel numbers of the i-th block of the image and the plurality of previous pixel data of the i-th block of the previous image, and calculating the number of pixels corresponding to the plurality of pixel values to generate an image a distribution of i, a positive integer between 1 and M; combining the pixel data of the i-th block of the image with the previous pixel data of the i-th block of the previous image, and correspondingly Generating a variogram; generating a distribution curve based on the target pixel data of the i-th block of the image, and comparing the pixel distribution and the distribution curve to correspondingly generate a weight value; And outputting the noise estimation value according to the weight value and the variance corresponding to each block of the image.

為了對本發明之上述及其他方面有更佳的瞭解,下文特舉實施例,並配合所附圖式,作詳細說明如下: In order to provide a better understanding of the above and other aspects of the present invention, the following detailed description of the embodiments and the accompanying drawings

請參照第1圖,第1圖繪示乃本發明一實施例之雜訊估測裝置100之方塊圖。雜訊估測裝置100用以計算影像之雜訊估測值σavg。此影像具有M個區塊,此M個區塊可重疊或不重疊。每個區塊各自具有多筆像素資料,此些像素資料中包括一目標像素資料,M係大於1之正整數。上述之多筆像素資料例如是對應至顯示面板上的多個像素點。 Please refer to FIG. 1. FIG. 1 is a block diagram of a noise estimation apparatus 100 according to an embodiment of the present invention. The noise estimation device 100 is configured to calculate the noise estimation value σ avg of the image. This image has M blocks that may or may not overlap. Each block has a plurality of pixel data, and the pixel data includes a target pixel data, and M is a positive integer greater than 1. The plurality of pieces of pixel data described above are, for example, corresponding to a plurality of pixel points on the display panel.

為方便理解,請同時參照第2A及2B圖。第2A及2B圖乃分別繪示影像之M個區塊可重疊及不重疊之示意圖。在第2A圖中,影像Ft中的每條橫列各表一像素列,而各橫列中的每個小方格各代表一個像素。各個像素係各自對應至一個區塊,目標像素資料係為所對應之區塊的一中心像素資料。進一步地說,假使影像中的區塊的大小為1×K的像素列,且K為大於零的奇數,當目標像素資料為 影像中的第i筆像素資料Pi,則對應於此像素資料Pi的影像中第i個區塊Ft(i)包括了像素資料Pi-(K-1)/2、Pi-(K-1)/2+1、...Pi...、Pi+(K-1)/2-1、Pi+(K-1)/2。而當目標像素資料為影像中的第i+1筆像素資料Pi+1,則對應於此像素資料Pi+1的影像中第i+1個區塊Ft(i+1)包括了像素資料Pi+1-(K-1)/2、Pi+1-(K-1)/2+1、...Pi+1...、Pi+1+(K-1)/2-1、Pi+1+(K-1)/2,以此類推。反之,在第2B圖中,影像中的區塊的大小例如為K×K的像素矩陣,影像Ft’被均分為多個彼此不重疊的區塊,每個區塊的目標像素資料例如為該區塊的中心像素資料。舉例來說,區塊Ft’(i)的目標像素資料例如為像素資料Pi,而區塊Ft’(i+1)的目標像素資料例如為像素資料Pi+K。然本發明並不以此為限,上述之區塊之大小以及目標像素資料相對於其對應區塊的位置皆可視不同的應用而調整。 For ease of understanding, please also refer to Figures 2A and 2B. 2A and 2B are schematic diagrams showing that M blocks of an image can be overlapped and not overlapped, respectively. In Fig. 2A, each row in the image Ft has a pixel column, and each small square in each row represents one pixel. Each pixel system corresponds to a block, and the target pixel data is a central pixel data of the corresponding block. Further, if the size of the block in the image is a pixel column of 1×K, and K is an odd number greater than zero, when the target pixel data is the i-th pixel data P i in the image, the pixel data corresponds to the pixel data. the i-th image blocks P i of Ft (i) comprises the pixel data P i- (K-1) / 2, P i- (K-1) / 2 + 1, ... P i ... , P i+(K-1)/2-1 , P i+(K-1)/2 . When the target pixel data is the i+1th pixel data P i +1 in the image, the i+1th block Ft(i+1) in the image corresponding to the pixel data Pi+1 includes the pixel data. P i+1-(K-1)/2 , P i+1-(K-1)/2+1 , ...P i+1 ..., P i+1+(K-1)/ 2-1 , P i+1+(K-1)/2 , and so on. On the other hand, in FIG. 2B, the size of the block in the image is, for example, a pixel matrix of K×K, and the image Ft′ is equally divided into a plurality of blocks that do not overlap each other, and the target pixel data of each block is, for example, The central pixel data of the block. For example, the target pixel data of the block Ft'(i) is, for example, the pixel data P i , and the target pixel data of the block Ft'(i+1) is, for example, the pixel data P i+K . However, the present invention is not limited thereto, and the size of the above block and the position of the target pixel data relative to its corresponding block may be adjusted according to different applications.

請再參照第1圖,雜訊估測裝置100包括分佈計算單元102、變異計算單元104、分佈曲線產生模組106及雜訊估測單元108。分佈計算單元102用以依據影像Ft之第i個區塊Ft(i)之多筆像素資料,以及先前影像Ft-1之第i個區塊Ft-1(i)之多筆先前像素資料,計算多筆像素值之所分別對應之像素個數,以產生一像素分佈h(i),i係介於1至M之正整數。上述之影像Ft之第i個區塊Ft(i)以及先前影像Ft-1之第i個區塊Ft-1(i)例如對應至畫面中相同的顯示位置,且於時間的排序上,先前影像Ft-1係表示早於影像Ft所顯示的影像。此外,上述之像素值例如為灰階值(gray scale level)。 Referring to FIG. 1 again, the noise estimation apparatus 100 includes a distribution calculation unit 102, a variation calculation unit 104, a distribution curve generation module 106, and a noise estimation unit 108. The distribution calculation unit 102 is configured to use the plurality of pieces of pixel data of the i-th block Ft(i) of the image Ft and the plurality of previous pixel data of the i-th block Ft-1(i) of the previous image Ft-1. The number of pixels corresponding to the plurality of pixel values is calculated to generate a pixel distribution h(i), and i is a positive integer between 1 and M. The i-th block Ft(i) of the image Ft and the i-th block Ft-1(i) of the previous image Ft-1 correspond, for example, to the same display position in the picture, and in time ordering, previously The image Ft-1 represents an image displayed earlier than the image Ft. Further, the above pixel value is, for example, a gray scale level.

變異計算單元104用以組合影像Ft之第i個區塊Ft(i)之多筆像素資料以及先前影像Ft-1之該第i個區塊Ft-1(i)之多筆先前像素資料,並對應地產生一變異數σ(i)。上述之變異數σ(i)例如代表統計學上的變異數(variance)。 The mutation calculation unit 104 is configured to combine the plurality of pieces of pixel data of the i-th block Ft(i) of the image Ft and the plurality of previous pixel data of the i-th block Ft-1(i) of the previous image Ft-1, And correspondingly produces a variance σ(i). The above-mentioned variation number σ(i) represents, for example, a statistical variation.

分佈曲線產生模組106以影像Ft之第i個區塊Ft(i)之目標像素資料為基準,根據變異數σ(i)產生一分佈曲線G(i),並比較像素分佈h(i)以及分佈曲線G(i),以對應地產生一權重值W(i)。 The distribution curve generation module 106 generates a distribution curve G(i) according to the variation number σ(i) based on the target pixel data of the i-th block Ft(i) of the image Ft, and compares the pixel distribution h(i). And a distribution curve G(i) to correspondingly generate a weight value W(i).

最後,雜訊估測單元108用以依據Ft影像之每一個區塊Ft(1)~Ft(M)所對應之權重值W(1)~W(M)及變異數σ(1)~σ(M),輸出雜訊估測值σavgFinally, the noise estimation unit 108 is configured to use the weight values W(1)~W(M) and the variance σ(1)~σ corresponding to each block Ft(1)~Ft(M) of the Ft image. (M), output noise estimation value σ avg .

請參照第3圖,其繪示乃上述分佈計算單元102之方塊圖之一例。分佈計算單元102包括第一計算單元302、第二計算單元304及合成單元306。第一計算單元302用以計算影像Ft之第i個區塊之多筆像素資料之對應至各該些像素值之像素個數,以輸出一第一分佈h1(i)。第二計算單元304用以計算先前影像Ft-1之第i個區塊之多筆先前像素資料之對應至各該些像素值之像素個數,以輸出一第二分佈h2(i)。合成單元306用以結合第一分佈h1(i)及第二分佈h2(i),以產生像素分佈h(i)。上述之第一分佈h1(i)、第二分佈h2(i)及像素分佈h(i)例如皆為直方圖(histogram)的形式。 Referring to FIG. 3, an example of a block diagram of the above-described distribution calculation unit 102 is shown. The distribution calculation unit 102 includes a first calculation unit 302, a second calculation unit 304, and a synthesis unit 306. The first calculating unit 302 is configured to calculate the number of pixels corresponding to each of the plurality of pixel data of the i-th block of the image Ft to output a first distribution h1(i). The second calculating unit 304 is configured to calculate the number of pixels corresponding to each of the plurality of previous pixel data of the i-th block of the previous image Ft-1 to output a second distribution h2(i). The synthesizing unit 306 is configured to combine the first distribution h1(i) and the second distribution h2(i) to generate a pixel distribution h(i). The first distribution h1(i), the second distribution h2(i), and the pixel distribution h(i) described above are, for example, in the form of a histogram.

請同時參照第4A圖及第4B圖。第4A圖繪示係為第一分佈h1(i)之一例之示意圖,第4B圖繪示係為第二分佈h2(i)之一例之示意圖。於第4A圖以及第4B圖中,座標之 橫軸表示灰階值,範圍例如由0至255;座標之縱軸表示像素個數。每一直方條分別表示對應於一灰階值之像素個數。 Please refer to both Figure 4A and Figure 4B. FIG. 4A is a schematic diagram showing an example of the first distribution h1(i), and FIG. 4B is a schematic diagram showing an example of the second distribution h2(i). In Figure 4A and Figure 4B, the coordinates of the coordinates The horizontal axis represents the grayscale value, and the range is, for example, 0 to 255; the vertical axis of the coordinates represents the number of pixels. Each straight square bar represents the number of pixels corresponding to a gray scale value.

合成單元306結合第一分佈h1(i)及第二分佈h2(i)的方式例如是將兩分佈進行疊合(superposition)。舉例來說,第一分佈h1(i)中每一像素值所對應的像素個數係與第二分佈h2(i)中每一像素值所對應的像素個數各別相加以產生對應至不同像素值之像素個數的像素分佈h(i)。如第4C圖所示,其繪示如第4A圖中的第一分佈h1(i)與第4B圖中的第二分佈h2(i)進行疊合後所產生的像素分佈h(i)之一例之示意圖。 The combination unit 306 combines the first distribution h1(i) and the second distribution h2(i), for example, to superposition the two distributions. For example, the number of pixels corresponding to each pixel value in the first distribution h1(i) is separately added to the number of pixels corresponding to each pixel value in the second distribution h2(i) to generate a corresponding difference. The pixel distribution h(i) of the number of pixels of the pixel value. As shown in FIG. 4C, the pixel distribution h(i) generated by superimposing the first distribution h1(i) in FIG. 4A and the second distribution h2(i) in FIG. 4B is shown. A schematic diagram of an example.

然,本發明並不限於上述之例示,分佈計算單元102亦可對多組分別對應至不同時間點的畫面Ft~Ft-k之第i個區塊之多筆像素資料進行處理,以對應地產生像素分佈h’(i),其中k為正整數。而引進多張分別對應至不同時間點的畫面Ft~Ft-k可提供影像處理上更多的取樣點。 However, the present invention is not limited to the above-described example, and the distribution calculation unit 102 may also process a plurality of sets of pixel data corresponding to the i-th block of the pictures Ft~Ft-k respectively corresponding to different time points, to correspondingly A pixel distribution h'(i) is generated, where k is a positive integer. The introduction of multiple pictures Ft~Ft-k corresponding to different time points respectively can provide more sampling points in image processing.

接著請參照第5圖,其繪示乃上述變異計算單元104之方塊圖之一例。變異計算單元104包括運算單元502及變異數取得單元504。運算單元502用以組合影像Ft之第i個區塊之多筆像素資料與先前影像Ft-1之第i個區塊之多筆先前像素資料,以對應輸出一合成像素資料S(i)。 Referring to FIG. 5, an example of a block diagram of the variation calculation unit 104 is shown. The mutation calculation unit 104 includes an operation unit 502 and a variation number acquisition unit 504. The computing unit 502 is configured to combine the plurality of pieces of pixel data of the i-th block of the image Ft with the plurality of pieces of previous pixel data of the i-th block of the previous image Ft-1 to correspondingly output a synthesized pixel data S(i).

請參照第6圖,其繪示上述合成像素資料S(i)之一例之示意圖。於第6圖中,影像Ft之第i個區塊之多筆像素資料Ft(i)係接續於先前影像Ft-1之第i個區塊之多筆先前像素資料Ft-1(i),以組合成一筆合成像素資料S(i)。然上 述之例示並非用以限定本發明,運算單元502亦可透過其他組合、排序之方式,以產生包括影像Ft之第i個區塊之多筆像素資料Ft(i)以及先前影像Ft-1之第i個區塊之多筆先前像素資料Ft-1(i)之合成像素資料S(i)。 Please refer to FIG. 6 , which illustrates a schematic diagram of an example of the synthesized pixel data S(i). In FIG. 6, the plurality of pieces of pixel data Ft(i) of the i-th block of the image Ft are connected to the plurality of previous pixel data Ft-1(i) of the i-th block of the previous image Ft-1, To combine into a single synthetic pixel data S(i). On The exemplification is not intended to limit the present invention, and the operation unit 502 may also generate other pieces of pixel data Ft(i) including the i-th block of the image Ft and the previous image Ft-1 through other combinations and sorting methods. The synthesized pixel data S(i) of the plurality of previous pixel data Ft-1(i) of the i-th block.

請再參照第5圖,變異數取得單元504用以依據此合成像素資料S(i)以產生變異數σ(i)。由於產生變異數σ(i)之方式例如可由一般影像處理軟體得出,故不在此贅述。然倘若分佈計算單元102依上述對多組分別對應至不同時間點的畫面Ft~Ft-k之第i個區塊之多筆像素資料進行處理,以對應地產生像素分佈h’(i),則變異計算單元104係對應地對此些不同時間點的畫面Ft~Ft-k之第i個區塊之多筆像素資料作計算,以產生變異數σ’(i)。簡言之,本發明實施例並不侷限於僅依據影像Ft及先前影像Ft-1作雜訊估測,亦可依據多組分別對應至不同時間點的畫面Ft~Ft-k來作雜訊估測。 Referring again to FIG. 5, the variance obtaining unit 504 is configured to generate the variation σ(i) based on the synthesized pixel data S(i). Since the manner in which the variation σ(i) is generated can be obtained, for example, by a general image processing software, it will not be described here. However, if the distribution calculation unit 102 processes the plurality of sets of pixel data corresponding to the i-th block of the pictures Ft~Ft-k respectively corresponding to different time points according to the above, to correspondingly generate the pixel distribution h'(i), Then, the mutation calculation unit 104 correspondingly calculates a plurality of pixel data of the i-th block of the pictures Ft~Ft-k at different time points to generate a variation σ'(i). In short, the embodiment of the present invention is not limited to the noise estimation based on the image Ft and the previous image Ft-1, and may also be used as the noise according to multiple groups of pictures Ft~Ft-k corresponding to different time points. Estimate.

請參照第7圖,其繪示乃上述分佈曲線產生模組106之方塊圖之一例。分佈曲線產生模組106包括分佈曲線產生單元702、差值計算單元704及權值計算單元706。分佈曲線產生單元702以影像Ft之第i個區塊之目標像素資料為基準,根據變異數σ(i),進行查表以輸出分佈曲線G(i)。 Please refer to FIG. 7 , which illustrates an example of a block diagram of the distribution curve generation module 106 . The distribution curve generation module 106 includes a distribution curve generation unit 702, a difference calculation unit 704, and a weight calculation unit 706. The distribution curve generation unit 702 performs a lookup table based on the target pixel data of the i-th block of the image Ft based on the variation number σ(i) to output a distribution curve G(i).

上述之分佈曲線G(i)例如為高斯分佈(Gaussian distribution)。選取高斯分佈作為例示的原因在於,申請人於研究時發現,一般的電視影像訊號當中,受到雜訊干擾的像素資料往往會以高斯分佈呈現;相對地,影像內容的 細節部分或是動態影像所對應的像素分佈則通常會和高斯分佈大不相同。因此,倘若經比較後得知影像內容中的像素分佈與高斯分佈越相近似,則表示此影像內容越可能是受雜訊所干擾。然本發明並不限於此,於另一實施例中,分佈曲線G(i)亦可例如為卜瓦松分佈(Poisson distribution)。總而言之,凡是分佈之曲線可對應至影像訊號中的雜訊模型,皆不脫離本發明實施例中所述分佈曲線G(i)之精神。 The above-described distribution curve G(i) is, for example, a Gaussian distribution. The reason why the Gaussian distribution is selected as an example is that the applicant found in the research that among the general TV image signals, the pixel data interfered by the noise is often presented in a Gaussian distribution; relatively, the content of the image The detail portion or the pixel distribution corresponding to the motion picture is usually quite different from the Gaussian distribution. Therefore, if the pixel distribution in the image content is more similar to the Gaussian distribution after comparison, it indicates that the image content is more likely to be interfered by the noise. However, the present invention is not limited thereto, and in another embodiment, the distribution curve G(i) may also be, for example, a Poisson distribution. In summary, the curve of the distribution can correspond to the noise model in the image signal without departing from the spirit of the distribution curve G(i) in the embodiment of the present invention.

此外,若以分佈曲線G(i)為高斯分佈為例,因高斯分佈具有分佈曲線下之涵蓋面積為固定之特性,透過此特性,可預先建立數組分別對應至不同變異數σ(i)之高斯分佈模型於分佈曲線產生單元702當中,以供之後的查表對應。 In addition, if the distribution curve G(i) is a Gaussian distribution, the Gaussian distribution has a fixed coverage area under the distribution curve. Through this characteristic, the array can be pre-established to correspond to different variograms σ(i). The Gaussian distribution model is included in the distribution curve generation unit 702 for subsequent lookup tables.

請同時參照第8圖,其繪示乃分佈曲線G(i)之一例之示意圖。於第8圖中,其座標之橫軸表示像素值,像素值例如為灰階值,其範圍例如由0至255,縱軸表示像素個數。曲線802表示以目標像素資料所對應之像素值Pv作為基準,依據變異數σ(i)所查表得出的分佈曲線G(i)。於此實施例中,由於分佈曲線產生單元702當中所預先建立的分佈模型(例如為高斯分佈模型)係以座標原點為基準(例如均值為零),為了呈現以目標像素資料為基準之雜訊模型,分佈曲線產生模組106進一步將目標像素資料所對應之像素值Pv設定為此分佈模型之基準以作為分佈曲線G(i)輸出。 Please also refer to Fig. 8, which is a schematic diagram showing an example of the distribution curve G(i). In Fig. 8, the horizontal axis of the coordinates represents a pixel value, and the pixel value is, for example, a grayscale value, the range of which is, for example, 0 to 255, and the vertical axis represents the number of pixels. A curve 802 represents a distribution curve G(i) obtained by looking up the table based on the variation σ(i) with the pixel value Pv corresponding to the target pixel data as a reference. In this embodiment, since the pre-established distribution model (for example, a Gaussian distribution model) among the distribution curve generation units 702 is based on the coordinate origin (for example, the mean value is zero), in order to present the reference pixel data as a reference. The distribution model, the distribution curve generation module 106 further sets the pixel value Pv corresponding to the target pixel data as the reference of the distribution model to be output as the distribution curve G(i).

請再參照第7圖,差值計算單元704用以比較分佈曲 線G(i)及像素分佈h(i),以輸出一差異值D(i)。差異值D(i)例如可由下式得出: Referring again to FIG. 7, the difference calculation unit 704 is configured to compare the distribution curve G(i) and the pixel distribution h(i) to output a difference value D(i). The difference value D(i) can be obtained, for example, by:

其中,參數k表示像素值,倘若像素值代表灰階值,則參數k的範圍例如為0至255;參數Sk表示分佈曲線G(i)於像素值k的像素個數減去像素分佈h(i)於像素值k的像素個數。當然,本發明並不限於此,凡是依據參數Sk所作之線性或非線性之組合,或是將分佈曲線G(i)及像素分佈h(i)間的差異進行量化所產生之的值,皆可作為本發明實施例之差異值D(i)。 Wherein, the parameter k represents a pixel value, and if the pixel value represents a grayscale value, the range of the parameter k is, for example, 0 to 255; the parameter Sk represents the number of pixels of the distribution curve G(i) at the pixel value k minus the pixel distribution h (i) The number of pixels at the pixel value k. Of course, the present invention is not limited thereto, and is a combination of a linear or non-linear combination of the parameters S k or a value obtained by quantizing the difference between the distribution curve G(i) and the pixel distribution h(i), Both can be used as the difference value D(i) of the embodiment of the present invention.

權值計算單元706用以依據此差異值D(i)以對應地產生權重值W(i)。請參照第9A圖,其繪示乃權重值W(i)與差異值D(i)之對應關係之一例之示意圖。由曲線902的變化可知,當差異值D(i)之大小介於第一閥值TH1與第二閥值TH2之間,且第二閥值TH2係大於該第一閥值TH1,當該差異值D(i)越大時,則所對應的該權重值W(i)越小。於此實施例中,權重值W(i)之大小係介於權重上限值WH及權重下限值WL之間,於曲線902中,介於第一閥值TH1至第二閥值TH2間的差異值D(i),係由點座標(TH1,WH)及點座標(TH2,WL)線性內插所得到。權重上限值WH及權重下限值WL例如分別為介於0至1的值,且權重上限值WH係大於權重下限值WL。曲線902的意義在於,權重值W(i)例如對應至雜訊的發生機率,當差異值D(i)越大,表示像素分佈h(i)與分佈曲線G(i)間的差異越大, 亦表示像素分佈h(i)越不近似於雜訊之分佈曲線(例如高斯曲線),雜訊的發生機率越低,故權重值W(i)對應地越小。然本發明並不以上述之例示為限,亦即,權重值(i)與差異值D(i)間的對應關係曲線並不限於兩點間的線性內插,只要權重值W(i)能依據差異值D(i)而反映雜訊的權重,皆屬於本發明精神所涵蓋之範圍。 The weight calculation unit 706 is configured to generate the weight value W(i) correspondingly according to the difference value D(i). Please refer to FIG. 9A, which is a schematic diagram showing an example of the correspondence between the weight value W(i) and the difference value D(i). As can be seen from the change of the curve 902, when the magnitude of the difference value D(i) is between the first threshold TH1 and the second threshold TH2, and the second threshold TH2 is greater than the first threshold TH1, the difference is When the value D(i) is larger, the corresponding weight value W(i) is smaller. In this embodiment, the weight value W(i) is between the weight upper limit value WH and the weight lower limit value WL. In the curve 902, between the first threshold TH1 and the second threshold TH2. The difference value D(i) is obtained by linear interpolation of the point coordinates (TH1, WH) and the point coordinates (TH2, WL). The weight upper limit value WH and the weight lower limit value WL are, for example, values of 0 to 1, respectively, and the weight upper limit value WH is greater than the weight lower limit value WL. The significance of the curve 902 is that the weight value W(i) corresponds, for example, to the probability of occurrence of noise. When the difference value D(i) is larger, the difference between the pixel distribution h(i) and the distribution curve G(i) is larger. , It also means that the less the pixel distribution h(i) is similar to the distribution curve of the noise (for example, the Gaussian curve), the lower the probability of occurrence of noise, so the weight value W(i) is correspondingly smaller. However, the present invention is not limited to the above examples, that is, the correspondence relationship between the weight value (i) and the difference value D(i) is not limited to linear interpolation between two points, as long as the weight value W(i) The weight of the noise can be reflected according to the difference value D(i), which is within the scope of the spirit of the present invention.

上述之第一閥值TH1與第二閥值TH2例如是分別根據變異數σ(i)以動態閥值(dynamic threshold)之方式產生。為清楚說明,請同時參照第9B圖及第9C圖,其分別繪示第一閥值TH1與第二閥值TH2分別與變異數σ(i)之對應關係之一例之示意圖。於第9B圖中,由曲線904的變化可知,當變異數σ(i)於下臨界值THa及上臨界值THb間變化時,第一閥值TH1係介於第一下限值TH1α及第一上限值TH1β之間,第一閥值TH1之值係可由點(THa,TH1α)及點(THb,TH1β)線性內插形成。類似地,於第9C圖中,由曲線906的變化可知,當變異數σ(i)於下臨界值THa及上臨界值THb間變化時,第二閥值TH2係介於第二下限值TH2α及第二上限值TH2β之間,第二閥值TH2之值係可由點(THa,TH2α)及點(THb,TH2β)線性內插所形成。上述之第一下限值TH1α、第一上限值TH1β、第二下限值TH2α、第二上限值TH2β、上臨界值THb及下臨界值THa皆可視不同的應用情況而設定,惟第二下限值TH2α及第二上限值TH2β皆須分別大於第一下限值TH1α及第一上限值TH1β。以動態閥值的方式產生第一閥值TH1與第二閥值TH2的好處在於,當所得出的變異數σ(i)過大 時,權值計算單元706同樣能夠依據差異值D(i)對應出適當的權重值W(i),以有效地判別出影像內容受雜訊干擾的程度。 The first threshold value TH1 and the second threshold value TH2 described above are generated, for example, by a dynamic threshold according to the variation number σ(i). For the sake of clarity, please refer to FIG. 9B and FIG. 9C simultaneously, which respectively show a schematic diagram of a correspondence relationship between the first threshold TH1 and the second threshold TH2 and the variation σ(i), respectively. In Fig. 9B, it can be seen from the change of the curve 904 that when the variation σ(i) varies between the lower threshold THa and the upper threshold THb, the first threshold TH1 is between the first lower limit TH1α and the first Between an upper limit value TH1β, the value of the first threshold TH1 can be formed by linear interpolation of points (THa, TH1α) and points (THb, TH1β). Similarly, in FIG. 9C, it can be seen from the change of the curve 906 that when the variation σ(i) varies between the lower threshold THa and the upper threshold THb, the second threshold TH2 is below the second lower limit. Between the TH2α and the second upper limit value TH2β, the value of the second threshold TH2 is formed by linear interpolation of the points (THa, TH2α) and the points (THb, TH2β). The first lower limit value TH1α, the first upper limit value TH1β, the second lower limit value TH2α, the second upper limit value TH2β, the upper limit value THb, and the lower limit value THa may be set according to different application conditions, but the first Both the lower limit value TH2α and the second upper limit value TH2β must be greater than the first lower limit value TH1α and the first upper limit value TH1β, respectively. The advantage of generating the first threshold TH1 and the second threshold TH2 in a dynamic threshold is that when the resulting variation σ(i) is too large At the same time, the weight calculation unit 706 can also determine the appropriate weight value W(i) according to the difference value D(i) to effectively determine the degree of noise interference of the video content.

接著請參照第10圖,其繪示乃上述雜訊估測單元108之一例之方塊圖。雜訊估測單元108包括雜訊估測器1002。雜訊估測器1002用以依據影像Ft之每一個區塊Ft(1)~Ft(M)所對應之權重值W(1)~W(M)及變異數σ(1)~σ(M)進行加權平均處理,以輸出雜訊估測值σavg。舉例來說,雜訊估測值σavg例如可由下式得出: Referring to FIG. 10, a block diagram of an example of the noise estimation unit 108 is shown. The noise estimation unit 108 includes a noise estimator 1002. The noise estimator 1002 is configured to use the weight values W(1)~W(M) and the variance σ(1)~σ(M) corresponding to each of the blocks Ft(1)~Ft(M) of the image Ft. A weighted averaging process is performed to output a noise estimation value σ avg . For example, the noise estimation value σ avg can be obtained, for example, by:

由上式可知,雜訊估測值σavg係表示整張影像Ft受雜訊干擾的程度。當雜訊估測值σavg越大,則表示影像Ft受雜訊干擾的程度越高,反之,當雜訊估測值σavg越小,則表示影像Ft受雜訊干擾的程度越低。然本發明並不限於此,只要是依據權重值W(i)及變異數σ(i)運算組合所得出的結果,皆可作為本發明中用以評估影像雜訊的參考值。 As can be seen from the above equation, the noise estimation value σ avg indicates the degree to which the entire image Ft is disturbed by noise. When the noise estimation value σ avg is larger, it indicates that the image Ft is disturbed by noise, and conversely, the smaller the noise estimation value σ avg , the lower the degree of noise interference of the image Ft. However, the present invention is not limited thereto, and any result obtained by combining the weight value W(i) and the variation number σ(i) can be used as a reference value for evaluating image noise in the present invention.

此外,雜訊估測單元108更可包括保護單元1004。保護單元1004用以於所有區塊Ft(1)~Ft(M)之權重值W(1)~W(M)之加總(即)低於一臨界值T時,對雜訊估測器1002所輸出之雜訊估測值σavg除以一低減值DN,以作為雜訊估測值σavg’輸出。由於當所有區塊 Ft(1)~Ft(M)之權重值W(1)~W(M)之加總過低時,所對應得出的雜訊估測值σavg是較不可靠(unreliable)的,故於此情況下,保護單元1004係透過對雜訊估測值σavg除以低減值DN,以適當地調整雜訊估測值σavg以作為輸出。 In addition, the noise estimation unit 108 may further include a protection unit 1004. The protection unit 1004 is used for summing the weight values W(1)~W(M) of all the blocks Ft(1)~Ft(M) (ie When the value is lower than a threshold value T, the noise estimation value σ avg outputted by the noise estimator 1002 is divided by a low-decrease DN to be output as the noise estimation value σ avg ' . Since the sum of the weight values W(1)~W(M) of all the blocks Ft(1)~Ft(M) is too low, the corresponding noise estimation value σ avg is less reliable ( Unreliable, in this case, the protection unit 1004 divides the noise estimation value σ avg by the low depreciation DN to appropriately adjust the noise estimation value σ avg as an output.

請參照第11圖,其繪示乃所有區塊Ft(1)~Ft(M)之權重值W(1)~W(M)之加總與低減值DN之對應關係之一例之示意圖。由曲線1102可知,當所有區塊Ft(1)~Ft(M)之權重值W(1)~W(M)之加總越低於臨界值T,則此低減值DN越大。低減值DN之範圍例如是介於低減上限值DNH至低減下限值DNL之間。低減上限值DNH的值例如為128,低減下限值DNL的值例如是1。 Please refer to FIG. 11 , which is a schematic diagram showing an example of the correspondence between the sum of the weight values W(1) to W(M) of all the blocks Ft(1) to Ft(M) and the low depreciation DN. As can be seen from the curve 1102, when the sum of the weight values W(1) to W(M) of all the blocks Ft(1) to Ft(M) is lower than the threshold value T, the lower the value of the DN is larger. The range of the low depreciation DN is, for example, between the low decrement upper limit value DNH and the low decrement lower limit value DNL. The value of the low-reduction upper limit value DNH is, for example, 128, and the value of the low-subtraction lower limit value DNL is, for example, 1.

本實施例更提出一種雜訊估測方法,雜訊估測方法用於本發明實施例之雜訊估測裝置100。請參照第12圖,其繪示乃本實施例之雜訊估測方法之流程圖。此方法包括步驟S1202、S1204、S1206與S1208。首先,於步驟S1202中,依據影像Ft之第i個區塊之多筆像素資料,以及先前影像Ft-1之第i個區塊之多筆先前像素資料,計算多筆像素值之所分別對應之像素個數,以產生一像素分佈h(i),i係介於1至M之正整數。 In this embodiment, a noise estimation method is further proposed, and the noise estimation method is used in the noise estimation apparatus 100 of the embodiment of the present invention. Please refer to FIG. 12, which is a flow chart of the noise estimation method of the embodiment. The method includes steps S1202, S1204, S1206, and S1208. First, in step S1202, according to the plurality of pixel data of the i-th block of the image Ft and the plurality of previous pixel data of the i-th block of the previous image Ft-1, the corresponding correspondences of the plurality of pixel values are respectively calculated. The number of pixels is used to produce a pixel distribution h(i), which is a positive integer between 1 and M.

接著,於步驟S1204中,組合影像Ft之第i個區塊之多筆像素資料以及先前影像Ft-1之第i個區塊之多筆先前像素資料,並對應地產生一變異數σ(i)。 Next, in step S1204, the plurality of pieces of pixel data of the i-th block of the image Ft and the plurality of previous pixel data of the i-th block of the previous image Ft-1 are combined, and a variation σ(i) is correspondingly generated. ).

然後,於步驟S1206中,以影像Ft之第i個區塊之目標像素資料為基準,根據變異數σ(i)產生一分佈曲線 G(i),並比較像素分佈h(i)以及分佈曲線G(i),以對應地產生一權重值W(i)。 Then, in step S1206, based on the target pixel data of the i-th block of the image Ft, a distribution curve is generated according to the variation σ(i). G(i), and compares the pixel distribution h(i) and the distribution curve G(i) to correspondingly generate a weight value W(i).

最後,於步驟S1208中,依據影像Ft之每一個區塊Ft(1)~Ft(M)所對應之權重值W(1)~W(M)及變異數σ(1)~σ(M),輸出雜訊估測值σavgFinally, in step S1208, the weight values W(1)~W(M) and the variance numbers σ(1)~σ(M) corresponding to each of the blocks Ft(1)~Ft(M) of the image Ft are obtained. , output noise estimation value σ avg .

本實施例之一種用以計算影像之雜訊估測值的雜訊估測裝置及其方法,可以有效地判斷影像內容受雜訊干擾的程度。 The noise estimation device and method for calculating the noise estimation value of the image in the embodiment can effectively determine the degree of noise interference of the image content.

綜上所述,雖然本發明已以實施例揭露如上,然其並非用以限定本發明。本發明所屬技術領域中具有通常知識者,在不脫離本發明之精神和範圍內,當可作各種之更動與潤飾。因此,本發明之保護範圍當視後附之申請專利範圍所界定者為準。 In conclusion, the present invention has been disclosed in the above embodiments, but it is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

100‧‧‧雜訊估測裝置 100‧‧‧ Noise Estimation Device

102‧‧‧分佈計算單元 102‧‧‧Distribution calculation unit

104‧‧‧變異計算單元 104‧‧‧variation calculation unit

106‧‧‧分佈曲線產生模組 106‧‧‧Distribution curve generation module

108‧‧‧雜訊估測單元 108‧‧‧ Noise Estimation Unit

302‧‧‧第一計算單元 302‧‧‧First calculation unit

304‧‧‧第二計算單元 304‧‧‧Second calculation unit

306‧‧‧合成單元 306‧‧‧Synthesis unit

502‧‧‧運算單元 502‧‧‧ arithmetic unit

504‧‧‧變異數取得單元 504‧‧‧variation acquisition unit

702‧‧‧分佈曲線產生單元 702‧‧‧Distribution curve generation unit

704‧‧‧差值計算單元 704‧‧‧ difference calculation unit

706‧‧‧權值計算單元 706‧‧‧ weight calculation unit

1002‧‧‧雜訊估測器 1002‧‧‧ Noise Estimator

1004‧‧‧保護單元 1004‧‧‧protection unit

第1圖繪示本發明一實施例之雜訊估測裝置之方塊圖。 FIG. 1 is a block diagram of a noise estimation apparatus according to an embodiment of the present invention.

第2A圖繪示影像之M個區塊可重疊之示意圖。 FIG. 2A is a schematic diagram showing that M blocks of an image can overlap.

第2B圖繪示影像之M個區塊不重疊之示意圖。 FIG. 2B is a schematic diagram showing that the M blocks of the image do not overlap.

第3圖繪示分佈計算單元之一例之方塊圖。 Figure 3 is a block diagram showing an example of a distributed calculation unit.

第4A圖繪示第一分佈之一例之示意圖。 FIG. 4A is a schematic diagram showing an example of the first distribution.

第4B圖繪示第二分佈之一例之示意圖。 FIG. 4B is a schematic diagram showing an example of the second distribution.

第4C圖繪示像素分佈之一例之示意圖。 FIG. 4C is a schematic diagram showing an example of a pixel distribution.

第5圖繪示變異計算單元之一例之方塊圖。 Figure 5 is a block diagram showing an example of a variation calculation unit.

第6圖繪示合成像素資料之一例之示意圖。 FIG. 6 is a schematic diagram showing an example of synthesized pixel data.

第7圖繪示分佈曲線產生模組之一例之方塊圖。 Figure 7 is a block diagram showing an example of a distribution curve generating module.

第8圖繪示分佈曲線之一例之示意圖。 Figure 8 is a schematic diagram showing an example of a distribution curve.

第9A圖繪示權重值與差異值之對應關係之一例之示意圖。 FIG. 9A is a schematic diagram showing an example of the correspondence between the weight value and the difference value.

第9B圖繪示第一閥值與變異數之對應關係之一例之示意圖。 FIG. 9B is a schematic diagram showing an example of the correspondence between the first threshold value and the variation number.

第9C圖繪示第二閥值與變異數之對應關係之一例之示意圖。 FIG. 9C is a schematic diagram showing an example of the correspondence between the second threshold value and the variation number.

第10圖繪示雜訊估測單元之一例之方塊圖。 Figure 10 is a block diagram showing an example of a noise estimation unit.

第11圖繪示所有區塊之權重值之加總與低減值之對應關係之一例之示意圖。 FIG. 11 is a schematic diagram showing an example of the correspondence between the sum of the weight values of all the blocks and the low depreciation.

第12圖繪示本實施例雜訊估測方法之流程圖。 FIG. 12 is a flow chart showing the method for estimating noise in the embodiment.

100‧‧‧雜訊估測裝置 100‧‧‧ Noise Estimation Device

102‧‧‧分佈計算單元 102‧‧‧Distribution calculation unit

104‧‧‧變異計算單元 104‧‧‧variation calculation unit

106‧‧‧分佈曲線產生模組 106‧‧‧Distribution curve generation module

108‧‧‧雜訊估測單元 108‧‧‧ Noise Estimation Unit

Claims (20)

一種雜訊估測裝置,用以計算一影像之一雜訊估測值,該影像具有M個區塊,該M個區塊可重疊或不重疊,每個區塊各自具有複數筆像素資料,該些像素資料中包括一目標像素資料,M係大於1之正整數,該雜訊估測裝置包括:一分佈計算單元,用以依據該影像之第i個區塊之該些像素資料,以及一先前影像之該第i個區塊之複數筆先前像素資料,計算複數筆像素值之所分別對應之像素個數,以產生一像素分佈,i係介於1至M之正整數;一變異計算單元,用以組合該影像之該第i個區塊之該些像素資料以及該先前影像之該第i個區塊之該些先前像素資料,並對應地產生一變異數;一分佈曲線產生模組,以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數產生一分佈曲線,並比較該像素分佈以及該分佈曲線,以對應地產生一權重值;以及一雜訊估測單元,用以依據該影像之每一個區塊所對應之該權重值及該變異數,輸出該雜訊估測值。 A noise estimation device for calculating a noise estimation value of an image, the image having M blocks, the M blocks may overlap or not overlap, and each block has a plurality of pixel data, The pixel data includes a target pixel data, and the M is a positive integer greater than 1. The noise estimation device includes: a distribution calculation unit configured to use the pixel data of the i-th block of the image, and a plurality of previous pixel data of the i-th block of a previous image, calculating a number of pixels corresponding to the plurality of pixel values to generate a pixel distribution, i is a positive integer from 1 to M; a variation a calculating unit, configured to combine the pixel data of the i-th block of the image and the previous pixel data of the i-th block of the previous image, and correspondingly generate a variance; a distribution curve is generated The module generates a distribution curve based on the target pixel data of the i-th block of the image, and compares the pixel distribution and the distribution curve to correspondingly generate a weight value; and Noise estimation list , Corresponding to the number and the weight value based on the variation of the image of each block, the output of the noise estimate. 如申請專利範圍第1項所述之雜訊估測裝置,其中該分佈計算單元包括:一第一計算單元,用以計算該影像之該第i個區塊之該些像素資料之對應至各該些像素值之像素個數,以輸出一第一分佈;一第二計算單元,用以計算該先前影像之該第i個區 塊之該些先前像素資料之對應至各該些像素值之像素個數,以輸出一第二分佈;以及一合成單元,用以結合該第一分佈及該第二分佈,以產生該像素分佈。 The noise estimation device of claim 1, wherein the distribution calculation unit comprises: a first calculation unit, configured to calculate corresponding to each of the pixel data of the i-th block of the image The number of pixels of the pixel values to output a first distribution; a second calculation unit for calculating the ith region of the previous image And the number of pixels of the previous pixel data of the block corresponding to each of the pixel values to output a second distribution; and a combining unit for combining the first distribution and the second distribution to generate the pixel distribution . 如申請專利範圍第1項所述之雜訊估測裝置,其中該變異計算單元包括:一運算單元,用以組合該影像之該第i個區塊之該些像素資料與該先前影像之該第i個區塊之該些先前像素資料,以對應輸出一合成像素資料;以及一變異數取得單元,用以依據該合成像素資料以產生該變異數。 The noise estimation device of claim 1, wherein the variation calculation unit comprises: an operation unit configured to combine the pixel data of the i-th block of the image with the previous image The previous pixel data of the i-th block is correspondingly outputted to a synthesized pixel data; and a variance obtaining unit is configured to generate the variation according to the synthesized pixel data. 如申請專利範圍第1項所述之雜訊估測裝置,其中該分佈曲線產生模組包括:一分佈曲線產生單元,以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數,進行查表以輸出該分佈曲線;一差值計算單元,用以比較該分佈曲線及該像素分佈,以輸出一差異值;以及一權值計算單元,用以依據該差異值以對應地產生該權重值。 The noise estimation device of claim 1, wherein the distribution curve generation module comprises: a distribution curve generation unit, based on the target pixel data of the i-th block of the image, The variation is performed by looking up the table to output the distribution curve; a difference calculation unit for comparing the distribution curve and the pixel distribution to output a difference value; and a weight calculation unit for using the difference value to The weight value is generated correspondingly. 如申請專利範圍第4項所述之雜訊估測裝置,其中該分佈曲線為高斯分佈(Gaussian distribution)。 The noise estimation device of claim 4, wherein the distribution curve is a Gaussian distribution. 如申請專利範圍第4項所述之雜訊估測裝置,其中當該差異值之大小介於一第一閥值與一第二閥值之間,該第二閥值係大於該第一閥值,當該差異值越大時,所對應 的該權重值越小。 The noise estimation device of claim 4, wherein when the magnitude of the difference is between a first threshold and a second threshold, the second threshold is greater than the first valve Value, when the difference value is larger, the corresponding The smaller the weight value. 如申請專利範圍第6項所述之雜訊估測裝置,其中該第一閥值與該第二閥值係分別根據該變異數以動態閥值(dynamic threshold)之方式產生。 The noise estimation device of claim 6, wherein the first threshold value and the second threshold value are respectively generated according to the dynamic threshold in a dynamic threshold. 如申請專利範圍第1項所述之雜訊估測裝置,其中該雜訊估測單元包括:一雜訊估測器,用以依據該影像之每一個區塊所對應之該權重值及該變異數進行加權平均處理,以輸出該雜訊估測值。 The noise estimation device of claim 1, wherein the noise estimation unit comprises: a noise estimator for determining the weight value corresponding to each block of the image and the The variance number is weighted and averaged to output the noise estimate. 如申請專利範圍第8項所述之雜訊估測裝置,其中該雜訊估測單元更包括:一保護單元,用以於所有區塊之該權重值之加總低於一臨界值時,對該雜訊估測器所輸出之該雜訊估測值除以一低減值,以作為該雜訊估測值輸出,其中當所有區塊之該權重值之加總越低於該臨界值,則該低減值越大。 The noise estimation device of claim 8, wherein the noise estimation unit further comprises: a protection unit, wherein when the sum of the weight values of all the blocks is lower than a critical value, The noise estimation value output by the noise estimator is divided by a low value as the noise estimation value output, wherein the sum of the weight values of all the blocks is lower than the threshold value , the lower the value of the lower value. 如申請專利範圍第1項所述之雜訊估測裝置,其中該影像具有M個像素,各個像素係各自對應至一個區塊,該目標像素資料係為所對應之該區塊的一中心像素資料。 The noise estimation device of claim 1, wherein the image has M pixels, each pixel system corresponding to a block, and the target pixel data is a central pixel of the corresponding block. data. 一種雜訊估測方法,用以計算一影像之一雜訊估測值,該影像具有M個區塊,該M個區塊可重疊或不重疊,每個區塊各自具有複數筆像素資料,該些像素資料中包括一目標像素資料,M係大於1之正整數,該雜訊估測方法包括:依據該影像之第i個區塊之該些像素資料,以及一先 前影像之該第i個區塊之複數筆先前像素資料,計算複數筆像素值之所分別對應之像素個數,以產生一像素分佈,i係介於1至M之正整數;組合該影像之該第i個區塊之該些像素資料以及該先前影像之該第i個區塊之該些先前像素資料,並對應地產生一變異數;以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數產生一分佈曲線,並比較該像素分佈以及該分佈曲線,以對應地產生一權重值;以及依據該影像之每一個區塊所對應之該權重值及該變異數,輸出該雜訊估測值。 A noise estimation method for calculating a noise estimation value of an image, the image having M blocks, the M blocks may overlap or not overlap, and each block has a plurality of pixel data, The pixel data includes a target pixel data, and the M system is a positive integer greater than 1. The noise estimation method includes: according to the pixel data of the i-th block of the image, and a first a plurality of previous pixel data of the i-th block of the pre-image, and calculating a number of pixels corresponding to the plurality of pixel values to generate a pixel distribution, i is a positive integer between 1 and M; combining the images The pixel data of the ith block and the previous pixel data of the ith block of the previous image, and correspondingly generating a variogram; the ith block of the image The target pixel data is used as a reference, a distribution curve is generated according to the variance, and the pixel distribution and the distribution curve are compared to correspondingly generate a weight value; and the weight value corresponding to each block of the image and the weight The number of variances, the noise estimate is output. 如申請專利範圍第11項所述之雜訊估測方法,其中該產生該像素分佈之步驟包括:計算該影像之該第i個區塊之該些像素資料之對應至各該些像素值之像素個數,以輸出一第一分佈;計算該先前影像之該第i個區塊之該些先前像素資料之對應至各該些像素值之像素個數,以輸出一第二分佈;以及結合該第一分佈及該第二分佈,以產生該像素分佈。 The method for estimating the noise according to claim 11, wherein the step of generating the pixel distribution comprises: calculating a correspondence between the pixel data of the ith block of the image to each of the pixel values a number of pixels to output a first distribution; calculating a number of pixels of the previous pixel data of the ith block of the previous image corresponding to each of the pixel values to output a second distribution; and combining The first distribution and the second distribution are to generate the pixel distribution. 如申請專利範圍第11項所述之雜訊估測方法,其中該產生該變異數之步驟包括:組合該影像之該第i個區塊之該些像素資料與該先前影像之該第i個區塊之該些先前像素資料,以對應輸出一合成像素資料;以及依據該合成像素資料以產生該變異數。 The method for estimating noise according to claim 11, wherein the step of generating the variation comprises: combining the pixel data of the i-th block of the image with the ith of the previous image The previous pixel data of the block is correspondingly outputted to a synthesized pixel data; and the synthesized pixel data is used to generate the variance. 如申請專利範圍第11項所述之雜訊估測方法,其中該產生該權重值之步驟包括:以該影像之該第i個區塊之該目標像素資料為基準,根據該變異數,進行查表以輸出該分佈曲線;比較該分佈曲線及該像素分佈,以輸出一差異值;以及依據該差異值以對應地產生該權重值。 The method for estimating a noise according to claim 11, wherein the step of generating the weight value comprises: using the target pixel data of the i-th block of the image as a reference, according to the variation Looking up the table to output the distribution curve; comparing the distribution curve and the pixel distribution to output a difference value; and correspondingly generating the weight value according to the difference value. 如申請專利範圍第14項所述之雜訊估測方法,其中該分佈曲線為高斯分佈。 The noise estimation method according to claim 14, wherein the distribution curve is a Gaussian distribution. 如申請專利範圍第14項所述之雜訊估測方法,其中當該差異值之大小介於一第一閥值與一第二閥值之間,該第二閥值係大於該第一閥值,當該差異值越大時,所對應的該權重值越小。 The method for estimating noise according to claim 14, wherein when the magnitude of the difference is between a first threshold and a second threshold, the second threshold is greater than the first valve. A value, when the difference value is larger, the corresponding weight value is smaller. 如申請專利範圍第16項所述之雜訊估測方法,其中該第一閥值與該第二閥值係分別根據該變異值以動態閥值(dynamic threshold)之方式產生。 The noise estimation method of claim 16, wherein the first threshold value and the second threshold value are respectively generated in a dynamic threshold according to the variation value. 如申請專利範圍第11項所述之雜訊估測方法,其中該輸出該雜訊估測值之步驟包括:依據該影像之每一個區塊所對應之該權重值及該變異數進行加權平均處理,以輸出該雜訊估測值。 The method for estimating noise according to claim 11, wherein the step of outputting the noise estimate comprises: weighting the weight according to the weight value corresponding to each block of the image and the variance Processing to output the noise estimate. 如申請專利範圍第18項所述之雜訊估測方法,其中該輸出該雜訊估測值之步驟更包括:於所有區塊之該權重值之加總低於一臨界值時,對該雜訊估測器所輸出之該雜訊估測值除以一低減值,以作為該雜訊估測值輸出,其中當所有區塊之該權重值之加總越 低於該臨界值,則該低減值越大。 The method for estimating noise according to claim 18, wherein the step of outputting the noise estimation value further comprises: when the sum of the weight values of all the blocks is lower than a critical value, The noise estimation value output by the noise estimator is divided by a low value as the noise estimation value output, wherein the total weight value of all the blocks is increased. Below this threshold, the lower the value is greater. 如申請專利範圍第11項所述之雜訊估測方法,其中該影像具有M個像素,各個像素係各自對應至一個區塊,該目標像素資料係為所對應之該區塊的一中心像素資料。 The method for estimating noise according to claim 11, wherein the image has M pixels, each pixel system corresponding to a block, and the target pixel data is a central pixel of the corresponding block. data.
TW102100585A 2013-01-08 2013-01-08 Noise estimation apparatus and method thereof TWI501628B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW102100585A TWI501628B (en) 2013-01-08 2013-01-08 Noise estimation apparatus and method thereof
US13/897,001 US9031322B2 (en) 2013-01-08 2013-05-17 Noise estimation apparatus and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW102100585A TWI501628B (en) 2013-01-08 2013-01-08 Noise estimation apparatus and method thereof

Publications (2)

Publication Number Publication Date
TW201429227A true TW201429227A (en) 2014-07-16
TWI501628B TWI501628B (en) 2015-09-21

Family

ID=51061007

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102100585A TWI501628B (en) 2013-01-08 2013-01-08 Noise estimation apparatus and method thereof

Country Status (2)

Country Link
US (1) US9031322B2 (en)
TW (1) TWI501628B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110858867A (en) * 2018-08-07 2020-03-03 瑞昱半导体股份有限公司 Image processing device and method thereof
CN111143190A (en) * 2018-11-05 2020-05-12 财团法人资讯工业策进会 Test data generating apparatus and test data generating method

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10511846B1 (en) 2016-09-01 2019-12-17 Google Llc Real-time adaptive video denoiser with moving object detection
US10674045B2 (en) * 2017-05-31 2020-06-02 Google Llc Mutual noise estimation for videos
RU2721188C2 (en) 2017-12-14 2020-05-18 Общество с ограниченной ответственностью "Аби Продакшн" Improved contrast and noise reduction on images obtained from cameras
CN112862753B (en) * 2020-12-31 2024-05-24 百果园技术(新加坡)有限公司 Noise intensity estimation method and device and electronic equipment
CN113674209A (en) * 2021-07-20 2021-11-19 浙江大华技术股份有限公司 Video noise detection method, terminal device and computer storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100356974B1 (en) 1994-03-07 2003-01-24 코닌클리케 필립스 일렉트로닉스 엔.브이. Noise measurement method and device
US7046307B1 (en) 1999-11-11 2006-05-16 Stmicroelectronics Asia Pacific Pte Ltd. Video signal noise level estimator
US7092579B2 (en) 2002-05-20 2006-08-15 Eastman Kodak Company Calculating noise estimates of a digital image using gradient analysis
US20050107982A1 (en) * 2003-11-17 2005-05-19 Zhaohui Sun Method and system for noise estimation from video sequence
US7715645B2 (en) * 2004-11-17 2010-05-11 Samsung Electronics Co., Ltd. Methods to estimate noise variance from a video sequence
US7714939B2 (en) 2005-04-05 2010-05-11 Samsung Electronics Co., Ltd. Reliability estimation of temporal noise estimation
US20070223839A1 (en) * 2006-03-22 2007-09-27 Pavel Kisilev Signal noise estimation
US8279345B2 (en) * 2009-07-21 2012-10-02 Qualcomm Incorporated System and method for random noise estimation in a sequence of images

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110858867A (en) * 2018-08-07 2020-03-03 瑞昱半导体股份有限公司 Image processing device and method thereof
CN110858867B (en) * 2018-08-07 2021-12-10 瑞昱半导体股份有限公司 Image processing device and method thereof
CN111143190A (en) * 2018-11-05 2020-05-12 财团法人资讯工业策进会 Test data generating apparatus and test data generating method
CN111143190B (en) * 2018-11-05 2023-03-14 财团法人资讯工业策进会 Test data generating apparatus and test data generating method

Also Published As

Publication number Publication date
US20140193070A1 (en) 2014-07-10
US9031322B2 (en) 2015-05-12
TWI501628B (en) 2015-09-21

Similar Documents

Publication Publication Date Title
TWI501628B (en) Noise estimation apparatus and method thereof
US8860829B2 (en) Image processing device, image processing method, and image processing program
KR101590767B1 (en) Image processing apparatus and method
JP5687553B2 (en) Image composition apparatus, image composition method, and image composition program
US20100142828A1 (en) Image matching apparatus and method
US20090040246A1 (en) Image processing device, display device, image processing method, and program
CN109963048B (en) Noise reduction method, noise reduction device and noise reduction circuit system
US9280828B2 (en) Image processing apparatus, image processing method, and program
US8675128B2 (en) Image processing method and system with repetitive pattern detection
CN108133463B (en) Noise reduction method and system for histogram equalization image
US8295647B2 (en) Compressibility-aware media retargeting with structure preserving
US9135676B2 (en) Image interpolation processing apparatus and method thereof
JP6017279B2 (en) Image processing apparatus, image processing method, and program
JP2013074571A (en) Image processing apparatus, image processing method, program, and recording medium
US8111325B2 (en) Image processing apparatus and method and program
CN111681236A (en) Target density estimation method with attention mechanism
US20130120461A1 (en) Image processor and image processing method
KR20060095173A (en) An illumination reflectance model based image distortion elimination method
US9008463B2 (en) Image expansion apparatus for performing interpolation processing on input image data, and image expansion method thereof
US9305336B2 (en) Apparatus and method for estimating noise
Wong et al. Improved flicker removal through motion vectors compensation
JP6236906B2 (en) Evaluation apparatus, evaluation method, and evaluation program
CN103945090B (en) Noise estimating apparatus and its method
JP2013218227A (en) Digital elevation model evaluation device and digital elevation model evaluation method
JP6931475B2 (en) Image processing device

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees