TW578117B - Apparatus and method of enhancing image resolution - Google Patents

Apparatus and method of enhancing image resolution Download PDF

Info

Publication number
TW578117B
TW578117B TW91124922A TW91124922A TW578117B TW 578117 B TW578117 B TW 578117B TW 91124922 A TW91124922 A TW 91124922A TW 91124922 A TW91124922 A TW 91124922A TW 578117 B TW578117 B TW 578117B
Authority
TW
Taiwan
Prior art keywords
image
resolution
analysis
interpolation
scope
Prior art date
Application number
TW91124922A
Other languages
Chinese (zh)
Inventor
Jin-Deng Lin
He-Jang Pu
Sheng-Fu Liang
Jia-Lin Chen
Original Assignee
Advanced & Wise Technology Cor
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Advanced & Wise Technology Cor filed Critical Advanced & Wise Technology Cor
Priority to TW91124922A priority Critical patent/TW578117B/en
Application granted granted Critical
Publication of TW578117B publication Critical patent/TW578117B/en

Links

Abstract

A kind of apparatus and method for enhancing image resolution are disclosed in the present invention. In the invention, the technique based on fuzzy system, which simulates human vision characteristic, and neural network, is used in the interpolating technique for the digital image. After a new original image is inputted, it is divided and sorted by image analysis module such that different kinds of image are processed individually by linear interpolation and neural network technique. Because the fuzzy system is formed according to human vision characteristic and the neural network is obtained after learning the real nature image, the vision effect of the image, which is processed and amplified by the invention, is extremely close to the real nature image.

Description

五、發明說明(1) 發明領域: 之果置ί 有關種可強化影像解析度(reSGluti〇n) =置與方法’制是關於—種利用模擬 ^ η) (human vision 优見特性 網路(ne丨丨/ )之模糊(fuzzy )分析及類神經 之褒技術為基礎,來強化影像解析度 發明背景: 隨者科技發展的曰新月異,數位影像的產品十分受到 ^例如數位相機、數位攝影機,投影機、多功能事務 史 然而所有數位影像產品都有共同的技術需求,就是 $像解析度的調整或轉換,故高品質的影像解析度增強技 術 直疋數位影像處理中的一個重要課題。 而所謂的影像内插(interpolation)技術是指將一 個低解析度影像,經由内插方式轉換到高解析度影像,.然 而一般常見的影像内插技術,例如雙線性内插法 (Bilinear interpolation)以及雙立方内插法 (Bicubic interpolation)等方式大部分都無法滿足需 求,此乃因習知之影像内插技術都會產生影像邊緣鋸齒化 (jaggedness)以及影像模糊(blurring)等兩種明顯的 缺點’有許多基於線性内插原理所衍生出的内插技術,大 部分也都具有此缺點。 由於人類的視覺系統的敏感程度對於影像中邊緣的部 分,會較影像中平滑或是結構的部分要來的敏銳,故目前 578117 五、發明說明(2) 有許多技術在處理影像内插時,都會特別考量影像邊緣的 部分,近年來針對影像解析度增強的問題已逐漸導入影像 輪廓的概念。例如,Pohsiang Hsu等人在1 999年所提出之 美國專利US5,991,464 的「Method and System for Adaptive Video Image Resolution Enhancement」,就 十分具有代表性。爾後,以影像中輪廓以及邊緣為依據的 數位影像的内插技術’成為了一種發展的趨勢,而突顯影 像中的邊緣以利人眼觀察也成為一重要的課題;由V. Description of the invention (1) Field of the invention: The relevant device can be enhanced image resolution (reSGluti〇n) = set and method 'system is about-a kind of use simulation ^ η) (human vision excellent feature network ( ne 丨 丨 /) based on fuzzy analysis and neural-like technology to enhance image resolution. BACKGROUND OF THE INVENTION: With the rapid development of technology, digital imaging products are very popular. For example, digital cameras, digital Cameras, projectors, and multi-function business history. However, all digital imaging products have a common technical requirement, which is the adjustment or conversion of image resolution. Therefore, high-quality image resolution enhancement technology directly addresses an important issue in digital image processing. The so-called image interpolation (interpolation) technology refers to converting a low-resolution image to a high-resolution image by interpolation. However, common image interpolation techniques, such as Bilinear interpolation (Bilinear interpolation) and Bicubic interpolation methods are mostly unable to meet the needs. This is because of the conventional image interpolation techniques. There are two obvious shortcomings such as jaggedness and blurring of the image. 'There are many interpolation techniques based on the linear interpolation principle, and most of them also have this disadvantage. Because of the human visual system's Sensitivity The edge part of the image will be sharper than the smooth or structured part of the image. Therefore, the current 578117 V. Description of the invention (2) There are many technologies that take special consideration into the edge of the image when processing image interpolation. In part, in recent years, the concept of image contour has been gradually introduced into the problem of image resolution enhancement. For example, Pohsiang Hsu et al., US Patent 5,991,464, "Method and System for Adaptive Video Image Resolution Enhancement" ", Is very representative. Later, the interpolation technology of digital images based on contours and edges in the image has become a development trend, and highlighting the edges in the image to facilitate human eyes observation has also become an important issue. ;by

Chien-Hsiu Huang 在 2001 年的美國專利[^6,175,659之 「Method and Apparatus for Image Scaling Using ,Chien-Hsiu Huang in the 2001 U.S. Patent [^ 6,175,659 "Method and Apparatus for Image Scaling Using,

Adaptive Edge Enhancement」便是一種以增強影像邊緣 為基礎的影像内插技術。而Kim與Sang Ye on在2 002年所提 出之美國專利案PUB· ΑΡΡ· NO· 20 020 1 2690 0 的「Image Interpolation Method and Apparatus Thereof」中則是 結合傳統的内插技術以及影像邊緣的方向,作為處理的方 式。“Adaptive Edge Enhancement” is an image interpolation technology based on enhancing the edge of an image. In the US Patent Case PUB · APP · NO · 20 020 1 2690 0 proposed by Kim and Sang Ye on in 2000, the "Image Interpolation Method and Apparatus Thereof" combines traditional interpolation technology and the direction of the edge of the image. As a way to deal with it.

然而,如何設計較佳的内插技術及如何評估處理之優 劣’都一直是相關技術發展之挑戰。因此,本發明係提出 利用類神經網路自我學習的能力,作為内插補償的設計基 礎’此外本發明亦利用人類視覺特性的概念,設計了一組 作為影像分析之用的模糊系統,以此系統作為影像分類的 裝置’同時結合雙線性内插法以及類神經網路内插方式並However, how to design better interpolation techniques and how to evaluate the pros and cons of processing have always been challenges for the development of related technologies. Therefore, the present invention proposes to use the ability of neural network-like self-learning as a design basis for interpolation compensation. In addition, the present invention also uses the concept of human visual characteristics to design a set of fuzzy systems for image analysis. System as a device for image classification 'simultaneously combines bilinear interpolation and neural network-like interpolation methods

r〇 、」I 用’以在影像的品質以及處理時間上取得平衡,並可得到 比習知放大技術產生的影像更好的品質,不論是在影像邊r〇, "I use’ to achieve a balance in image quality and processing time, and can obtain better quality than the image produced by the conventional magnification technology, whether it is on the side of the image

^/«117 五、發明說明(3) 緣的銳利度或是影像的 卞項耘度,都更為優異 發明目的與概述·· 本發明之主要目的係 經網路強化影像解析度之捉供一種利用模糊分析及類神 輸入之數位影像以及$放2置,方法,其係可將使用者所 自然影像的效果,使发 之衫像倍率,產生出相當接近 近。 、視覺效果與實際之自然影像十分接 本發明之另—^ 裝置與方法,其係以模擬、:2 ::種可強化影像解析度之 行分析,並以類神經網路握1見特性之模糊分析系統進 數位影像解析度的;1路搞擬貫際自然:影像的型態、,進行 本發明之再—目的 性之模糊分析系統進行一種利用模擬人類視覺特 ;插法或是神經網路内插上:二以藉此選擇利用雙線性 ”在影像品質以及處,處理數位影像的機制,使 本發明之又—、π砰間上取得平衡。 構,用以專門分析自:ί出一種特殊的類神經網路架 設計出一套訓 特徵,並針對此網路架 像猶如實際自然以::=法,使得 本發明之又一 』昇耳。 3與方法,其影像解析度之 異。 轉μ利度及影像的平順程度都更為優 第6頁 578117 五、發明說明(4) ^達到上述之目的,本發明係先取得一原始影 A後v果糊分析系統對該原始影像進行分析,並將 為具有邊緣特性及不具有邊緣特性;然後 :簞1:類為具有邊緣特性之區域’利用-角度計 捭.:户緣角度後,利用類神經網路内插技術進行 直接利影像中分類為不具有邊緣特性之區 始影像的ϊϊΐ内技術進行影像處理;在完成整 理後,即可得到-高解析度之數位影像 容易具體實施例配合所附的圖式詳加說明 :易瞭解本發明之目的、技術内容、特點及其所: 圖號說明: 1〇低解析度原始影像 像,再 該原始 在原始 算模組 影像處 域,則 個該原 〇 ,當更 成之功 14 18 22 26 30 34 40 44 46 48 分類模組 高解析度數位影像 角度計算模組 雙線性内插模組 影像遮罩 需補償像素的位置 類神經網路 隱藏層 隱藏層 輸出層神經元 影像分析模組 影像内插模組 模糊分析系統 類神經網路内插模 資料庫 原始影像(灰色部 黑色部分) 42 輸入層 442神經元 462神經元 12 16 20 24 28 32 組 分^ / «117 V. Description of the invention (3) The sharpness of the edge or the hard work of the image are more excellent. The purpose and overview of the invention ... The main purpose of the present invention is to enhance the resolution of the image via the network for a use The digital analysis of fuzzy analysis and god-like input and $ 2 placement, this method can make the effect of the natural image of the user, and make the image magnification of the shirt very close. The visual effects and actual natural images are very close to the other of the present invention. The device and method are based on simulation, analysis of 2: 2 :: enhanced image resolution, and neural network-like characteristics. The fuzzy analysis system enters the resolution of the digital image; one way is to implement the natural nature of the image: the type of the image, and to carry out the invention-the purpose of the fuzzy analysis system is to use a simulation of human visual characteristics; interpolation or neural network Interpolation on the road: Secondly, in order to choose to use the bilinear "in the image quality and process, the mechanism of processing digital images, so as to achieve a balance between the present invention and the pi bang. A special neural network-like framework is designed to design a set of training features, and the actual image of this network framework is like the actual natural :: = method, which makes the invention of the present invention "rare. 3 and methods, its image resolution The degree of conversion and the smoothness of the image are both better. Page 6 578117 V. Description of the invention (4) ^ To achieve the above purpose, the present invention first obtains an original image A and then the fruit paste analysis system Analysis of raw images It will have edge characteristics and no edge characteristics; then: 箪 1: class is a region with edge characteristics' use-angle meter 捭.: After the household edge angle, use neural network-like interpolation technology to directly benefit the image The internal technology, which is classified as a region-free image without edge characteristics, performs image processing; after finishing finishing, you can get-high-resolution digital images. It is easy to explain the specific embodiments with the accompanying drawings: easy to understand this The purpose, technical content, characteristics and features of the invention: Description of drawing number: 10 Low-resolution original image, and then the original is in the original computing module image area, then the original 0, when the success is 14 18 22 26 30 34 40 44 46 48 Classification module High-resolution digital image angle calculation module Bilinear interpolation module Image mask position to be compensated Pixel-like neural network Hidden layer Hidden layer Output layer Neuron image analysis model Group of image interpolation modules fuzzy analysis system neural network interpolation model database original image (grey part black part) 42 input layer 442 neuron 462 neuron 12 16 20 24 28 32 Group

578117578117

詳細說明: ^,明提出一種可強化自然影像解析度以及影像尺 #么#、 — 万法,其係利用模擬人類視覺特性之模糊分、 (ei、進行.衫像分析’並以影像中物體邊緣的方向 〇riented)以及類神經網路(neural-network) 技術為基礎’作為數位影像内插之用。 =第一圖所示,一張低解析度的原始影像1 0輸入後, =一影像分析模組12進行影像分割與分析,並透過一分類 ^組14根據影像分析模組12之分析結果,將該原始影像1〇 刀=為平滑/結構區域或是邊緣區域;最後經由一影像内, j模、、且1 6進行景々像處理,其係利用雙線性内插技術對原始 衫像之=滑/結構區域進行影像處理,並利用類神經網路 内插技術對原始影像之邊緣區域進行影像處理,以獲得 解析度之數位影像18輸出。 而第二圖為本發明使用模糊分析系統之架構示意圖, 汝圖所示,S —原始影像j 〇輸入至一模糊分析系統2 〇中, 此模糊分析系統20對該原始影像丨〇開始進行分析,並將原 =影像10分類為具有邊緣特性及不具有邊緣特性,以便將 影像1 0區分為該使用雙線性内插技術或是該使用神經網路 内插技術。在原始影像丨0中被分類為具有邊緣特性之區 域,則利用一角度計算模組22計算其邊緣角度後,再利用 類神經網路内插模組24對該原始影像1〇進行影像處理;若 在原始影像1 0中被分類為不具有邊緣特性之區域,則直接 利用雙線性内插模組26對該原始影像丨〇進行影像處理。原Detailed explanation: ^, Ming proposed a method to enhance the natural image resolution and image rule # 么 #, — Wanfa, which uses the fuzzy points that simulate human visual characteristics, (ei, perform. Shirt image analysis' and use objects in the image The direction of the edges is based on neural network-like technology and is used for digital image interpolation. = As shown in the first picture, after a low-resolution original image 10 is input, = an image analysis module 12 performs image segmentation and analysis, and a classification ^ group 14 is based on the analysis result of the image analysis module 12, The original image 10 knife = smooth / structure area or edge area; finally, through an image, j-mode and 16 are used for scene image processing, which uses the bilinear interpolation technology to the original shirt image Zhi = slip / structure area for image processing, and use neural network-like interpolation technology for image processing on the edge area of the original image to obtain a resolution digital image 18 output. The second figure is a schematic diagram of the architecture of the present invention using a fuzzy analysis system. As shown in the figure, S — the original image j 〇 is input into a fuzzy analysis system 2 0, and the fuzzy analysis system 20 starts analyzing the original image 丨 0. , And classify the original image 10 as having edge characteristics and not having edge characteristics, so as to distinguish the image 10 as whether it should use the bilinear interpolation technique or the neural network interpolation technique. The original image 丨 0 is classified as a region with edge characteristics, and then an angle calculation module 22 is used to calculate the edge angle, and then the neural network-like interpolation module 24 is used to perform image processing on the original image 10; If the original image 10 is classified as a region having no edge characteristics, the original image 10 is directly subjected to image processing by using the bilinear interpolation module 26. original

第8頁 578117 五、發明說明(6) =經ii述處理過後,即可獲得解析度增強後之數位 η 該類神經網路内插模組24係利用監督式學 ▲法訓練類神經網路,並將該類神經網路訓練完 相關參數儲存在一資料庫2 8中 、 本發明在進行影像處理之流程請參閱 之後,如步驟S10採用一_像;之:像遮 罩對μ原始衫像進行分割,以利後續之分析步驟丨再 一模糊分析系統對該原始影像進行分析判斷,如步驟 所不,,將該原始影像分類為具有邊緣特性及不具有邊 特性,若模糊分析系統之輸出變數(M〇 ) 預:臨界值(Th)日夺,則此區域像素係具有邊緣=於此 擇該類神經網路内插技術,並進行步驟s“計 异其邊、、彖角度後,如步驟S16利用類神經網路内插技術 該原=影像進行影像處理;若該輸出變數係小於該臨界值 時,則此區域像素係不具有邊緣特性,此表示應選擇步, S1 8之雙線性内插技術對該原始影像進行影像處理 $耆,如步驟32〇,獲得處理後的影像像素,而後如 步驊所不,判斷該原始影像的整張影像是否全部處理 完成,右否,則如步驟S24將該影像遮罩移動至下一處理 位置,,重複步驟S12至步驟S2〇 ;若整張影像已完全處理 完成μ P可侍到如步驟S26所示已處理完成之高解析度數 位影像,如此即可結束整個影像處理流程 f ^二本發明亦可先利用習知之影像邊緣抽取模組先 將該” α衫像中之邊緣部份擷取出來後,再利用一角度計 578117 五、發明說明(7) 算模組計算影像邊緣上的每一個 得的角度以及邊緣位置的資訊加以分析==將所 像區分為使用雙線性内插技斤:更將該原始影 術。 义11 X疋使用類神經網路内插技 當原始影像進入影像模糊分 _像數所組成的影像遮 糸;先之後將會被-個 此影像遮罩30會以一個像卓辛為斤移刀動割二如第四圖所示,而 影像,圖中的灰色部分32為原始影像的内 34為預什影像放大所需補償像素的位置,此:f邛分 尚未決定,圖中的OU # & $ a 、μ象素的值 代表原始影像,_代表參考像素 (reference pixel) ,〇M,, ^ ^ ^ t nelghb〇rh〇〇d pixel) , " 被補该其該有的像素值。由於影像遮罩3〇會在原=將 移動,故每一個待補償的像數值將會被決定,而^ =像上 内插的像素…由公式⑴中所;:二算被 公式中的表示每一個像素〇(i J)的權重值,而%…窃 用本發明所設計的神經網路訓練而得。 疋利 ρ—)=ΣΣ外,H·) i-0 j-0 . (1) 由於習知影像内插技術因其物理上的限制,會在3 輪廓以及邊緣的地帶產生模糊以及鋸齒狀的影像,因= 低了影像的品質,一個理想的放大技術因該考量影像中邊 緣的方向性,如此將可得到較清晰以及銳利的影像輪廓。Page 8 578117 V. Description of the invention (6) = After the processing described in ii, the digital η with enhanced resolution can be obtained. This type of neural network interpolation module 24 uses a supervised method to train a neural network. The relevant parameters of this type of neural network training are stored in a database 28. After referring to the image processing process of the present invention, please refer to step S10. An image is used in the step S10. Segmentation of the image to facilitate subsequent analysis steps 丨 Another fuzzy analysis system analyzes and judges the original image. As shown in the steps, the original image is classified as having edge characteristics and no edge characteristics. Output variable (M〇) Prediction: Threshold value (Th), then the pixels in this area have edges = select this type of neural network interpolation technology, and perform step s "differentiate its edges, and angles. If step S16 uses neural network-like interpolation technology, the original image is processed by the image. If the output variable is smaller than the critical value, the pixel in this area does not have edge characteristics. This means that step should be selected. double The linear interpolation technology performs image processing on the original image, as in step 32, to obtain the processed image pixels, and then, as in the step, determine whether the entire image of the original image has been completely processed. If not, then If the image mask is moved to the next processing position in step S24, repeat steps S12 to S2. If the entire image has been completely processed, μ P can serve the high-resolution digits processed as shown in step S26. Image, so that the entire image processing flow can be ended. F ^ 2 The present invention can also use a conventional image edge extraction module to first extract the edge portion of the "α shirt image, and then use an angle meter 578117. 7. Description of the invention (7) The calculation module calculates each angle and edge position information on the edge of the image and analyzes it. == Divides the image into a bilinear interpolation technique: the original shadow. Yi 11 X 疋 uses a neural network-like interpolation technique when the original image enters the image blurry image. The image is masked; it will be covered by this image mask. The second cut is shown in the fourth picture, and in the image, the gray part 32 in the picture is the inner 34 of the original image, which is the position of the compensation pixels required for the pre-image enlargement. # & $ a, μ pixel value represents the original image, _ stands for reference pixel (〇M ,, ^ ^ ^ t nelghb〇rh〇〇d pixel), " Pixel values. Since the image mask 30 will be shifted in the original =, each image value to be compensated will be determined, and ^ = the pixels interpolated on the image ... from the formula ⑴; A pixel has a weight value of 0 (i J), and% ... is obtained by stealing the neural network designed by the present invention.疋 利 ρ —) = ΣΣ, H ·) i-0 j-0. (1) Due to the physical limitations of the conventional image interpolation technology, blurs and jagged edges in 3 contours and edges are generated. Image, because the quality of the image is low, an ideal magnification technique should consider the directionality of the edges in the image, so that a clearer and sharper image contour can be obtained.

第10頁 :)/0丄丄/ 五、發明說明(8) 為了達到此一目標,本發 viSUal system)的特性作類視覺系統(Hu叫 人類的視覺系統對於影像中為二像二析的機制,原因在於 且可利用人眼的特性來分析;j分有較敏銳感知,並 乂八體原理摩巳例來驗證說明上 ^ 此項技術者將可參酌此 ^術内谷,並使热習 以實施。 ^例之描边而獲得足夠的知識而據 就模糊分析系統而言: Φ二覺特性,中可知,人類的眼睛對於影像 ,〔、t要比對焭度的感知來的更敏銳,❿人Page 10:) / 0 丄 丄 / 5. Description of the invention (8) In order to achieve this goal, the characteristics of the viSUal system of the present invention are used as visual systems (Hu called the human visual system. Mechanism, the reason is that the characteristics of the human eye can be used to analyze; j points have a more sensitive perception, and the eight-body principle friction examples to verify the description ^ This technology will be able to refer to this ^ intraoperative valley and make the heat The practice is to implement. ^ The stroke of the example has acquired sufficient knowledge and according to the fuzzy analysis system: Φ two perception characteristics, we can see that the human eye for the image, [, t is more than the perception of the degree. Keen

睛影像中物體以及背景之間差異的能力,則J 於其方二受度的平均值,如第五圖所示,圖中的縱軸表示 人類視見能見度的臨界值(visibiHty thresh〇id),而 橫軸表示影像中的平均背景亮度(BL ),由圖中可知,當 平均背景亮度在很暗以及很亮的區域時,能見度的臨界^ 變的很高,這意味著人類的視覺在此兩個區域辨別物體以 及背景的此力變差,而在此區域的物體與背景的顏色(或 亮度)必須差異很大,才容易被人眼所鑑別。反之,當平 均背景壳度落在7 0〜1 5 0之間時,則人眼對於物體以及背景 之間的差異將可以很輕易的分辨出來,換言之,在此區域 的物體以及其背景在顏色(或亮度)上不需要有很大的差 異。 除了對於物體以及背景的鑑別能力之外,人類的視覺 系統對於不同結構的影像也會有不同的反應,人眼對於高 IHI麵 第11頁 578117 五:發明說明(9) ^—- 對比度的範圍如結構、影像輪廓以及邊緣等合有 反應’而對於較平滑的影像區域則不然、。為;同;= 理後影像的品質以及快速的處理時間,本發明提出 、 人類視覺系統為基礎的模糊分析系統,此^統主 =,T 將輸入的影像内容分成具有邊緣特性以及不具有 纟力犯疋 兩類型,而影像中具有邊緣特性的部分將利;神經::性 内插技術處理,而不具有邊緣特性的部分將利用、錄=的 大技術來做處理,再配合參數的調整,使得本發日=性玫 影像品質以及處理速度上做最好的安排。 明可以在 在本發明的模糊分析系統架構中有= 為能見度叫、結構性叫以及㈡=數分别 出變數(Mo )則是所選擇的模式。如公式(2) ,而輪 V(BL) = 20.66e^3BL +e0008BL , 示’ (2 ) 利用非線性回歸的方式找出代表第五圖中的 .利 V(BL),此處的BL表示N*N影像遮罩中背景妁=: 用D以及V(BL)間的差異量即可以 =千均免度 VD=D-V(BL), 式(3) ’The difference between the object and the background in the eye image is the average value of the two squares, as shown in the fifth figure. The vertical axis in the figure represents the critical value of human visibility (visibiHty thresh〇id). The horizontal axis represents the average background brightness (BL) in the image. It can be seen from the figure that when the average background brightness is in very dark and bright areas, the threshold of visibility ^ becomes high, which means that human vision is The force of discriminating objects and background in these two areas becomes worse, and the color (or brightness) of objects in this area and the background must be very different in order to be easily discerned by the human eye. Conversely, when the average background shell degree falls between 70 and 150, the difference between the human eye and the background can be easily distinguished. In other words, the objects in this area and their backgrounds are in color. (Or brightness) doesn't need to be very different. In addition to the ability to identify objects and backgrounds, the human visual system will also respond differently to images of different structures. The human eye responds to high IHI surfaces. Page 11 578117 5: Description of the invention (9) ^ —- The range of contrast Such as structure, image contours, and edges all react, but not for smoother image areas. =; The same; = the quality of the image after processing and the fast processing time, the present invention proposes a human vision system-based fuzzy analysis system, which ^ = = T divides the input image content into having edge characteristics and not having 纟There are two types of force crimes, and the part with edge characteristics in the image will be beneficial; the nerve :: sexual interpolation technology will be used for processing, and the part without edge characteristics will be processed with large techniques such as recording, and coordinated with parameter adjustment. In order to make the best arrangement for the quality of the image quality and processing speed. It can be seen that in the framework of the fuzzy analysis system of the present invention, there are = for visibility calls, structural calls, and ㈡ = numbers. The variable (Mo) is the selected mode. As in formula (2), and the wheel V (BL) = 20.66e ^ 3BL + e0008BL, it is shown that (2) uses non-linear regression to find the .V (BL) in the fifth figure, where BL Represents the background in the N * N image mask 妁 =: The difference between D and V (BL) can be used = thousands of degrees of freedom VD = DV (BL), formula (3) '

其中,D為原始影像之最大像素 H 式(4 ), m京之差值,如公 D = max(〇(i j)) 0(ij)) 公式(3)係表示在某背景亮产 (4) 中是否有人眼可見的物體,若VD" ’ N*N的影像遮罩 的物體以及背景越易分辨,反之# |、二則表示在該範圍内 夂之右小於零則表示該範園屬Among them, D is the maximum pixel H of the original image (4), the difference between m Jing, such as common D = max (〇 (ij)) 0 (ij)) Formula (3) indicates that the light is produced in a certain background (4 ) Is there any object visible to the human eye, if the VD " 'N * N image masked objects and background are easier to distinguish, otherwise # |, two means that the right of the range is less than zero, which means that the Fanyuan

578117578117

於非視覺敏感的區域。此外,SD以及CD則是用於分析 遮罩中的像素是否屬於具有輪廓邊緣的特性,SD所反應的 是影像遮罩中是否具有明顯兩群的特性,如公式(5)所“ 示, max( , y)) - Σ J) + J)) SD =_ _ m^(〇(U·)) - min(0(U·))) (5)For non-visually sensitive areas. In addition, SD and CD are used to analyze whether the pixels in the mask have the characteristics of contour edges. SD reflects whether there are obvious two groups of characteristics in the image mask, as shown in formula (5), max (, y))-Σ J) + J)) SD = _ _ m ^ (〇 (U ·))-min (0 (U ·))) (5)

如SD得到一個較大的值,則表示該影像遮罩中不具有兩群 的特性’同時有可能是雜訊或者是平滑的區域,^之若仙 值趨近於零,則表示影像遮罩中具有兩群的特性,有可轉 包含影像邊緣或是結構的特性,由於此兩種特性在經由別 運算之後將會呈現相同的數值,故在此加入了 C D這個變 數,如式(6 )所示If SD obtains a large value, it means that the image mask does not have the characteristics of two groups. At the same time, it may be noise or a smooth area. If the fairy value approaches zero, it means the image mask. There are two groups of characteristics, including those that can include the edge or structure of the image. Since these two characteristics will show the same value after other operations, the variable CD is added here, as shown in equation (6) Shown

N N 1 (6) 在此本發明利用了微分對雜訊十分靈敏的觀念分析影像遮 罩中的型態,由公式(6)可以看出,若影像遮罩中包含的 是結構的型態,則CD值將會偏高,但若其内容包含了邊緣 的影像,則CD值將會偏低。NN 1 (6) Here, the present invention uses the concept that differential is very sensitive to noise to analyze the types in the image mask. According to formula (6), it can be seen that if the image mask contains the structure type, The CD value will be higher, but if its content contains images with edges, the CD value will be lower.

輸入變數之能見度VD包含兩個模糊集合(fuzzy set )’分別為負(N )以及正(P ),輸入變數之結構性SD包 含三個模糊集合,分別為小(S )、中(Μ )以及大(B ),而輸入變數之複雜度CD也包含三個模糊集合S、Μ及 Β ’輸出變數Mo則包含雙線性(b i 1 i near,BL )以及類神The visibility VD of the input variable contains two fuzzy sets (negative (N) and positive (P), respectively), and the structural SD of the input variable contains three fuzzy sets, small (S) and medium (M). And large (B), and the complexity of the input variable CD also includes three fuzzy sets S, M, and B '. The output variable Mo includes bilinear (bi 1 i near, BL) and god-like

第13頁 578117 五、發明說明(11) 經網路(neUral netw〇rk,NN)兩個模糊集合,而每一 變數所引用之成員函數分別如第六(a)圖至第六⑷圖所 二以i所敘述之模糊集合以及所使用之成員函數,將可 二、;所f用之不同做各種不同之改變,而以下的七個模糊 規則乃疋以上述所提的變數以及成員函數所舉的例子· 若VD =N,則M〇 =bl ; 若SD =B,則; 右CD — B,則M〇=BL· ; 若 VD =P 若 VD =P 若 VD =P 若 VD =P 其中 、SD =s 且CD =S,則Mo =NN ; 、SD =S 且 CD =M,則 Mo =NN ; 、SD=M 且 CD=S,則 Mo=NN ;及 、SD=M 且CD=M,則Mo=BL。 輸出變數Mo在經由解模糊化之後將备 :ι =0一〜1 〇,間的*字,☆此本發明可以依照處理個 叮疋一個臨界值(Th),當肋gTh時,本發明、,象 經網路内插技術,反之’若Mo <Th時,則選擇雙^類神 技術進行影像處理。 笑線性内插 就角度計算及類神經網路内插技術而言: 近年來有許多以影像輪廓方向為基礎的影 被提出纟’然而如何設計一個最合適的影内插技術 及如何評斷處理之後影像的品質,都是一個十八^街,以 題’而本發明係出一種結合雙線性内插以;,難的問 插技術,用以解決此-問題。當影像遮罩的内^士網路内 析系統分類為具有邊緣的特性時,其邊緣的角声=糊分 &所會被計 578117 五、發明說明(12) 算,請參閱第三圖所示,邶,力表示為此時影像遮罩中 0(~)的角度,他力的計算方式如公式(7 )所示, = - η fr. - -[tan (7) (8) 此處的办匕力a反⑽,j)則如公式(8)以及(9)所示 一(0(i +1,j — 1) + 20(i + 1,力 + 〇(Σ· + 1,」+ 1)) 办= — U — l)+20(i,j一 l) + 〇(i + U— 1) - (0(i -1,)+ 1) + 20(ί,」+ 1) + 〇(ί + ι,j + 1)) ( 9 ) 上式中i以及j的範圍為與,而所得之角度可’ 依需求任意的量化成所需要的等分。若參考像素被分類為 不具有方向性,則將應用雙線性内插技術,如公式(1〇)所 示’來處理需要被内插的像素以降低運算量, 〇(U)Page 13 578117 V. Description of the invention (11) Two fuzzy sets via the network (neUral netwrk, NN), and the member functions referenced by each variable are as shown in Figures 6 (a) to 6 (6). The fuzzy set described by i and the member functions used will make various changes according to the different uses of f; and the following seven fuzzy rules are based on the variables and member functions mentioned above. Examples: · If VD = N, then M0 = bl; If SD = B, then; Right CD — B, then M0 = BL ·; If VD = P If VD = P If VD = P If VD = P Where SD = s and CD = S, then Mo = NN;, SD = S and CD = M, then Mo = NN;, SD = M and CD = S, then Mo = NN; and SD = M and CD = M, then Mo = BL. The output variable Mo will be prepared after defuzzification: ι = 0 ~ 1 〇, the * character, ☆ This invention can deal with a critical value (Th) according to the bite, when the rib gTh, the present invention, As if via Internet interpolation technology, on the other hand, if Mo < Th, a double ^ type god technology is selected for image processing. Laughing linear interpolation In terms of angle calculation and neural network-like interpolation technology: In recent years, many shadows based on the contour direction of the image have been proposed. 'However, how to design the most appropriate shadow interpolation technology and how to judge the processing The quality of the image is an eighteenth street. The present invention is based on a combination of bilinear interpolation; a difficult interpolation technique to solve this problem. When the internal network analysis system of the image mask is classified as having the characteristics of edges, the angular sound of the edges = fuzzing & will be counted 578117 V. Description of the invention (12) For calculation, please refer to the third figure As shown, 邶, the force is expressed as the angle of 0 (~) in the image mask at this time. The calculation method of other forces is shown in formula (7), =-η fr.--[Tan (7) (8) this The force a at the counter a, j) is as shown in formulas (8) and (9)-(0 (i +1, j — 1) + 20 (i + 1, force + 〇 (Σ · + 1 "" + 1)) Do = — U — l) +20 (i, j-l) + 〇 (i + U— 1)-(0 (i -1,) + 1) + 20 (ί, ”+ 1) + 〇 (ί + ι, j + 1)) (9) In the above formula, the range of i and j is AND, and the resulting angle can be quantified to the required division according to the requirements. If the reference pixel is classified as non-directional, a bilinear interpolation technique will be applied, as shown in formula (10), to process the pixels that need to be interpolated to reduce the amount of computation, 〇 (U)

ΣΣ—_二一 V{m7n) = ^ M Stance {0{iJ\P{m9n)) ΣΣ~—^_ μ /-1 distance (〇(ifj)9P(mrK))ΣΣ—_two one V (m7n) = ^ M Stance (0 (iJ \ P (m9n)) ΣΣ ~ — ^ _ μ / -1 distance (〇 (ifj) 9P (mrK))

c ^ (10) /反之,參考像素若被分類為具有一主要的方向特性 則糸統將運用類神經網路内插技術進行處理, 在人類視覺系統為考量之下的品質。 ” 本發明係利用監督式學習法則訓練類神經網路,首 先,必須獲得網路的輸入以及輸出期望值(desiRd 〇實’如此即可藉由輸入資料進入網路而得 貫際輸出值’並且與輸出期望值相比較,其兩者間的差c ^ (10) / Conversely, if the reference pixel is classified as having a major directional characteristic, the system will use neural network-like interpolation technology to process it, considering the quality of the human visual system. The present invention uses a supervised learning rule to train a neural network. First of all, the input and output expectations of the network must be obtained (desiRd), so that the input data can be used to enter the network to obtain consistent output values. Output expected value compared, the difference between the two

第15頁 578117 五、發明說明(13) - 將成為本發明訓練網路的依據。詳言之,本發明係利用高 階的影像擷取裝置取得數張高解析度的數位影像,假設某 張而解析度的影像為ΙΝχΝ ,針對INxlT的内容做取樣處理並得 到一張新的影像ι·ΜχΜ ,在此M = N/k且办,7)=版,祕,也就是 說1即是ι·ΜχΜ在做k倍放大之後的理想影像,所以如此即 可在ι·ΜκΜ中得到神經網路的輸入值,以及在中得到期 望輸出值,在此權值訓練流程係如第七圖所示,當一個 解析度原始影像10進入類神經網路4〇之後,所得之肢 與高解析度數位影像18之内容作比較,其兩者之間::: 將作為修正類神經網路4G權值的依據,且:# 8則、美 儲存該類神經網路40訓練完成後之的相關參 = 明之系統中,影像中不具有邊緣輪廓特性 在本么 線性内插的技術處理,因此用以訓練類神經網2採取雙 料’將“…於邊緣輪廊的像素區:中尋7的:練資 圖可以得知’假設心為影像中的參考第四 _=加,且該像素經分析後屬於角产為 處的 可表示成叫…網路輪:二則=輪入的向量 的輸出期望值將可由原始高解析二類神經網路 為I(ki + m,kj+«) 〇 孓甲3又侍,並且表示 本發明係設計一個專門用來作 第八圖所示,此網路為包含—声= #的網路架構,如Page 15 578117 V. Description of the invention (13)-It will be the basis of the training network of the present invention. In detail, the present invention uses a high-level image capture device to obtain several high-resolution digital images. Assuming that a certain high-resolution image is ΙΝχΝ, the INxlT content is sampled and a new image is obtained. · MχΜ, where M = N / k and to do, 7) = edition, secret, that is to say 1 is the ideal image of ι · ΜχΜ after k times magnification, so you can get nerves in ι · ΜκΜ The input value of the network and the expected output value are obtained in it. The weight training process is shown in Figure 7. When a high-resolution original image 10 enters the neural network 4 0, the obtained limbs and high resolution Compare the content of the digital image 18, between the two :: will be used as the basis for the 4G weight of the modified neural network, and: # 8, the United States stores the correlation of this type of neural network 40 after training Reference = In the Ming system, the image does not have the edge contour feature in the linear interpolation technique. Therefore, it is used to train the neural network 2 to use the double material to "..." in the pixel area of the edge corridor: Zhong Xun 7: The training plan can learn that 'assuming the heart is The fourth reference in the image is _ = plus, and after the pixel is analyzed, it can be expressed as the… The path is I (ki + m, kj + «) 〇 孓 甲 3 and waiter, and said that the present invention is designed to be used as shown in the eighth figure, this network is a network architecture including — 声 = #, such as

第16頁 層輸入層42、二層隱藏層 578117 五'發明說明(14) 44 46及輸出層神經元48的四層類神經網路,網路的輸 入層4 2,3 了二個變數,分別為$ 、爪及n,而網路的第二 層為隱藏層_44,也就是隱藏層的第一層,包含τΜ個神經 = 442,由實驗經驗得知,Μ的數量大約在15〇〜3〇〇之間, 貫際應用不在此限;而在神經元44 2中,本發明使用了雙 極值作用函數(bip〇lar activati〇n functi〇n ),如公 式(1 1 )所不,做為本發明的作用函數(ad丨vati〇n fjnCt^〇n )之範例,除此之外,亦可根據不同應用採用其 他之作用函數。 一1 l+e' 、—在、’周路中輪入層42以及隱藏層44之間的權值,係表示 f二罔路之第二層為隱藏層46,此即為第二層隱藏 層’包含N * N個神經元4 β ?,η η接处 ^ ^ ^ 甲:兀462且同樣使用二元值作用函數做 4 6 Η的;估二而網路之第一二層隱藏層“與第三層之隱藏層 46間的核值向量則表示為p,隱藏層 462輸出則表示為地) ( ^ 70 ^ 此^)就疋表示公式(1)中的每一 網路第四層的輸出層則是-個神經元心,其 戶:代表的…内插的像素值⑽),而介於隱藏層财 神經兀48之間的權值向量被表示ζ 角度的夾老伤本而^表不為屬於某 ^四固;斤 ^ 近’個像素的像素值,請同時參 入,如公式(12)所示。 見為類砷經網路之額外輸 578117 五、發明說明(15) 且網路的輸出可表示為 iW7==Σχ^)·4 (12) (13) 同時相對的預期輸出值表示為, ^ = I(ki + (14) , 而參數、#與、eZ7的更新方式係如公式(15)及公 (1 6)所示,當類神經網路網路訓練完成之後,本發即' 藉由不同的輸入進而得到相對應的神經元462^(¾)作A y 意自然影像放大的工具。 馬 ^ (^+1)=^y(Sa)), 2]x g(Zj 〜+1)=〜糾 π 信⑽―Xgi)) v』j x[〇+g(^))(l-g(Z,))/2]/^ 本發明係選擇數張自然影像作為訓練樣本,发(1 6) 分包括利用高解析度數位取像設備所拍攝的自缺^:大部 =類神經網路樣,再利用了兩張的自然影以二完 對象··花叢以及螺旋槳。在本實驗中 士政D 作為貫驗 貫驗中’本發明將影像内插 (15) 第18頁 578117 五、發明說明(16) 技術與兩個傳統 方内插法做比較 的原始影像,而 立方内插法以及 像放大400%之後 明所提出的内插 度以及影像邊界 因此,本發明以 眼所能見到的影 之後’作為神經 定了影像中邊界 果’由上述實驗 糊分析系統中的 後的品質以及處 綜上所述, 技術,以及神經 的類神經網路影 習的方式,做為 知,利用類神經 類直觀對影像接 或是在影像中物 雙立方内插法處 用適當的變數或 平衡。 的線性内 ,在第九 (b)至(d) 本發明之 的結果。 技術所產 的銳利度 人類視覺 像邊緣輪 網路影像 成分的同 的結果可 各項參數 理所需的 本發明結 網路的學 像内插技 影像内插 網路影像 受度的角 體邊緣的 理的結果 參數值以 插技術 圖及第 圖分別 類神經 由實驗 生的影 都遠比 為基礎 廓,找 放大技 時也決 以得知 以及臨 時間, 合模糊 習特性 術,將 技術的 内插技 度來看 銳利度 優異許 便在影 :雙線 十圖中 為利用 網路内 結果可 像,不 該兩種 的模糊 出影像 術的參 定了該 ’本發 界值, 以達到 分析系 ,設計 自然影 基礎, 術所處 ’不論 ,都較 多,並 像品質 性内插法以及雙立 的(a)為未放大前 雙線性内插法、雙 插技術,將原始影 以看出,利用本發 管是在影像的清晰 方法來的優異。 分析系統,判斷人 中邊緣輪廓的特徵 考特徵,事實上決 張影像放大後的效 明係可藉由改變模 藉以調整影像處理 我們所需的要求。 統债測影像邊緣的 完成一有別於以往 像中的特性利用學 而由實驗結果得 理後的影像,以人 是在影像的清晰度 雙線性内插法或是 且針對不同應用採 及處理時間上取得On page 16, the input layer 42 and the second hidden layer 578117. The description of the invention (14) 44 46 and the output layer neuron 48 are four-layer neural networks. The input layer 4 2 and 3 of the network have two variables. They are $, claw, and n, and the second layer of the network is the hidden layer _44, which is the first layer of the hidden layer. It contains τM nerves = 442. According to experimental experience, the number of M is about 15. Between ~ 300, inter-applications are not limited to this; and in neuron 442, the present invention uses a bipolar function (bip〇lar ActivatiOn FunctiOn), as shown in formula (1 1) No, as an example of the function of the present invention (ad 丨 vati〇n fjnCt ^ 〇n), in addition, other function can be used according to different applications. A 1 l + e ', —the weight value between the round-in layer 42 and the hidden layer 44 in Zhou Road, which means that the second layer of f Erhuang Road is the hidden layer 46, which is the second hidden layer' Contains N * N neurons 4 β?, Η η junction ^ ^ ^ A: Wu 462 and also use the binary value function to do 4 6 Η; estimate the second and hidden layers of the network "and The kernel value vector between the hidden layer 46 of the third layer is represented as p, and the output of the hidden layer 462 is represented as ground) (^ 70 ^ this ^) represents the fourth layer of each network in formula (1). The output layer is a neuron's heart, which represents: interpolated pixel values ⑽), and the weight vector between the hidden layer and the neural network 48 is represented by the angle of the zeta angle ^ The table does not represent the pixel value of a certain ^ four solid; ^ ^ near 'pixels, please enter at the same time, as shown in formula (12). See arsenic-like additional input via the network 578117 V. Description of the invention (15) And the output of the network can be expressed as iW7 == Σχ ^) · 4 (12) (13) At the same time the relative expected output value is expressed as ^ = I (ki + (14), and the parameters, #and, and eZ7 are updated The method is as formula (15) And public (16), after the neural network-like network training is completed, this hair is' the corresponding neurons obtained through different inputs 462 ^ (¾) as a tool for A y intended natural image magnification ^ (^ + 1) = ^ y (Sa)), 2] xg (Zj ~ + 1) = ~ 纠 π Xin⑽―Xgi)) v 』jx [〇 + g (^)) (lg (Z ,)) / 2] / ^ The present invention selects several natural images as training samples, and sends (16) points including self-deficit shots using high-resolution digital imaging equipment ^: most = neural network-like , And then used the two natural shadows to complete the two objects, the flower bushes and the propeller. In this experiment, Shizheng D was used as the proof and test. The present invention interpolates the image (15) Page 18 578117 V. Description of the invention (16) The original image compared with the two traditional square interpolation methods, and the cubic interpolation method and the interpolation degree and image boundary proposed by Ming after the image is enlarged by 400%. Therefore, the present invention uses Afterwards, the “boundary fruit in the image is determined as a nerve” is described by the above-mentioned quality and techniques in the experimental paste analysis system, and the neural network-like shadow practice As a known method, use neural-like visual interface to connect the image or use the appropriate variable or balance in the bicubic interpolation of the object in the image. Within the linearity of the ninth (b) to (d) of the present invention The results of the sharpness produced by the technology are the same as the image components of the edge-wheel network image of the human visual image. The parameters of the network image interpolation technique of the present invention can be used for various parameters. The parameters of the results of the corpus perimeter are based on the interpolation technique map and the figure, respectively, and the experimental shadow ratios are based on the experiment. When looking for the magnification technique, you must know the knowledge and the time, combined with the fuzzy habit. Judging from the interpolation skill of the technology, the sharpness is excellent. It is in the shadows: the double-line ten pictures are visualized by using the network results. In order to achieve the analysis system, design the natural shadow foundation, there are many 'no matter where the technique is located, and like qualitative interpolation and dual (a) is the non-amplified front bilinear interpolation method, double interpolation technology, See the original video , Using the present invention is excellent in tube method of image clarity. The analysis system determines the characteristics of the edge contours in the person. In fact, the effect of the enlarged image on the final image can be adjusted by changing the model to adjust the image processing requirements. The completion of the unified measurement of the edge of the image is different from the previous image using the characteristics of science and the results obtained from the experimental results, based on the image's sharpness bilinear interpolation method or for different applications. Acquired in processing time

578117 五、發明說明(17) =上所述之實施例僅係為說明本發 點,其目的在使熟習此項技藝 ^技術心心及特 容並據以實施,當不能以夕pp 一 ^ 士此夠瞭解本發明之内 ^ ^ ^ 之限疋本發明之專利範圍,即大 t^ ^ 所揭不之精神所作之均等變化戍修飾,仍應涵 盍在本發明之專利範圍内。 i化戈/ % 第20頁 578117578117 V. Description of the invention (17) = The above-mentioned embodiment is only for the purpose of explaining this point. Its purpose is to familiarize yourself with this technique ^ technical heart and special content and implement it accordingly. It is enough to understand the limitations of the present invention ^ ^ ^ and the scope of the patent of the present invention, that is, equal changes and modifications made by the spirit disclosed by the big t ^ ^ should still be included in the scope of the patent of the present invention. iGo /% p. 20 578117

圖式簡單說明 圖式說明: 第一圖為本發明裝置之方塊示意圖。 第二圖為本發明使用模糊分析系統之架構示意圖。 第二圖為本發明在進行影像處理之流程示意圖。 第四圖為本發明所使用之影像遮罩示意圖。 第五圖為人類視覺特性的曲線示意圖。 第六(a)圖至第六(d)圖分別為本發明模糊分析系統之輸入 變數能見度、結構性與複雜度以及輸出變數的成員函數示, 意圖。 第七圖為本發明之類神經網 第八圖為本發明作為影像内 第九(a)圖至第九(d)圖分別 明與習知雙線性内插法及雙 結果不意圖。 第十(a)圖至第十(d)圖分別 發明與習知雙線性内插法及 的結果示意圖。 路之權值訓練流程示意圖。 插之類神經網路架構示意圖。 為花叢之原始影像及利用本發 立方内插法進行放大4 0 0 %後的 為螺旋槳之原始影像及利用本 立方内插法進行放大400%後Brief description of the drawings Brief description of the drawings: The first diagram is a schematic block diagram of the device of the present invention. The second figure is a schematic diagram of an architecture using a fuzzy analysis system according to the present invention. The second figure is a schematic flowchart of image processing in the present invention. The fourth figure is a schematic diagram of an image mask used in the present invention. The fifth figure is a curve diagram of human visual characteristics. Figures 6 (a) to 6 (d) are the member function illustrations of the input variable visibility, structure and complexity, and output variables of the fuzzy analysis system of the present invention, and their intentions are shown. The seventh diagram is a neural network of the present invention and the like. The eighth diagram is the image used in the present invention. The ninth (a) to ninth (d) diagrams respectively illustrate the conventional bilinear interpolation method and the double result. Figures ten (a) to ten (d) are the results of the invention and the conventional bilinear interpolation method, respectively. Road weight training process diagram. Schematic diagram of neural network architecture such as interpolation. The original image of the flower bush and the magnification of 400% by the cubic interpolation method of the present invention The original image of the propeller and the 400% magnification by the cubic interpolation method of the original

Claims (1)

578117 六、申請專利範圍 1、一種可強化影像解析度之裝置,包括· 一影像分析模組,其係擷取一依i · 進行分割與分析; -解析度之原始影像,並‘ 一分類模組,其係根據該影像分 該^始影像分類為平滑/結構區域或邊緣區^析^吉果,將 ^ I ΐ ^,1± " # ^ ^ 丨於心卞/月/ L構區域進行影像處理, 插技術對該原始影像之邊緣區域行珅經網路内 -高解析度之數位影像。 進仃“象處理,進而得到, 2署、如甘申^專利範®第1項所述之可強化^象解析度之裝, 置’其中該影像分析模組係包括: 取象ί緣抽取單元,其係將該原始影像之邊緣區域糊 性 3 置 系 4 置 一角^計算單元,其係利用該邊緣區域具有方向性之特 ’什异邊緣區域上每一像素所表示的角度。 — 如申請專利範圍第1項所述之可強化影像解析度之裝 ,其中該影像分析模組及該分類模組係利用一=糊^析 統進行影像分析與分類。578117 VI. Application for Patent Scope 1. A device capable of enhancing image resolution, including an image analysis module, which captures and performs segmentation and analysis according to i;-the original image of resolution, and a classification model Group, which is classified into smooth / structured area or edge area according to the image, and analyzes the ^ Gift, and ^ I ΐ ^, 1 ± "# ^ ^ 丨 in the heart / month / L structure area Image processing is performed, and the interpolation technique is applied to the edge area of the original image to pass through the network-high-resolution digital image. Into the "image processing, and then get, 2 units, as described in Gan Shen ^ Patent Fan® item 1 can enhance the ^ image resolution device, where the image analysis module system includes: fetch the image and extract the edge Unit, which is used to set the edge region of the original image to be viscous3 to 4 and set it to a corner ^ calculation unit, which uses the angle represented by each pixel on the edge region that has a directional characteristic of the edge region. — Such as The device capable of enhancing image resolution as described in item 1 of the scope of the patent application, wherein the image analysis module and the classification module perform image analysis and classification by using an analysis system. 影像内插模組利用該類神經網路内插技術對兮历與德套 緣區域進行影像處理之前,更可先利用一角^計^二組計 算該邊緣區域的角度。 如申請專利範圍第3項所述之可強化影像解析度之裝 ,其中在該模糊系統進行影像分析與分類之後,且在該 5、一種可強化影像解析度之方法,包括下列步驟The image interpolation module uses this type of neural network interpolation technology to image the marginal area of Xili and Detao before using the one-angle ^ count ^ two groups to calculate the angle of the marginal area. The device capable of enhancing image resolution as described in item 3 of the scope of patent application, wherein after the fuzzy system performs image analysis and classification, and in the 5, a method for enhancing image resolution, including the following steps 第22頁 578117 六、申請專利範圍 提供一原始影像; 對該原始影像進行分析,並將該原 〜像刀類為具有邊緣特性及不具有邊緣特性; 、軎i ϊ ΐ始影像中分類為具有邊緣特性之區域’,則叶瞀立 影像ii後’利用類神經網路内插技術對該原始影亍 =該原始影像中分類為不具有邊緣特性之區$ 用雙線性内插技術對該原始影像進行影像處理:及 影j成整個該原始影像的處理’以得到一高解析度之數位 ㈣5項所述之可強化影像解析度之方’ - fM象:ί= 統進行分析步驟之前,更可利用 驟二像遮軍對该原始影像進行分割’以利後續之分析步 法 8、 法 如^申請專利範圍第6項所述之可強化影像解析度之方— ’八中該影像遮罩係由像素所組成。 又 々口申請專利範圍第5項所述之可強化影像解析产之方 =中該該模糊分析系統係具有能見度、結構ς及複雜 又荨一個輸入變數,以根據該輸入變數進行分類。 ' 9、如^請專利範圍第5項所述之可強化影像解析产之方 ί於=模糊分析系統在進行分類日夺,若其輸:變數係 ΐ ΐ:;:預設臨界值時’將選擇該類神經網路内插技 術,^右该輸出變數係小於該臨界值時, 内插技術對該原始影像進行影像處理 、擇。亥雙線[生 第23頁 、、申請專利範圍 _____ f㉔專利範圍第9項所述之 去’其中今昨兴# 〃 強化衫像解析度之太 °丁定。 理之數位影像及條件而 如申請專利範圍第5項所述之 ^其中該類神經網路内插技術係1利強用化;;像解析度之方 =經網路,並將該類網路 2二I式子省法訓練 儲存在一資料庫中。 1,采疋成後之的相關參數 2 一種可強化影像解析度之方法,包衽下π止 提供-原始影像; 包括下列步驟: 將該原始影像中之邊緣部份擷取出來; 計算該影像邊緣區域上每一個像素所代表之·, 根據該影像邊緣區域位置與計算出又’ =便將該該原始影像分類為使用類以 或疋雙線性内插技術; 内插技術 利用該類神經網路内插技術及該雙線性内 始影像進行影像處理;及 议術對6玄原 完成整個該原始影像的處理,以得到一高解析卢之 立 影像。 X 1 3、如申請專利範圍第1 2項所述之可強化影像解析产之方 法,其中在擷取該影像邊緣區域步驟之前,更 X ^ 1利用一影 像遮罩對該原始影像進行分割,以利後續之分析步驟。 1 4、如申請專利範圍第1 2項所述之可強化影像解析产之方 法,其中該影像遮罩係由N*N像素所組成。 Λ 1 5、如申請專利範圍第1 2項所述之可強化影像解析产之方Page 22 578117 6. The scope of the patent application provides an original image; analyze the original image, and classify the original ~ image knife as having edge characteristics and not having edge characteristics; i ϊ ΐ ΐ ΐ image is classified as having Areas with edge characteristics ', then Ye Lili's image ii' uses the neural network-like interpolation technique to the original image = the region in the original image classified as having no edge characteristics $ The original image is bilinearly interpolated Perform image processing: and process the entire original image 'to obtain a high-resolution digital image, as described in item 5, which can enhance the image resolution'-fM 象 : ί = Before performing the analysis step, you can Use the second image masking army to segment the original image to facilitate the subsequent analysis. Step 8: Method to enhance the resolution of the image as described in item 6 of the scope of patent application — 'This image mask system Consists of pixels. In addition, the method for enhancing image analysis described in Item 5 of the scope of patent application for the application is that the fuzzy analysis system has visibility, structure, and complexity. There is also an input variable to classify according to the input variable. '9. As described in ^ Please refer to item 5 of the patent scope for enhancing image analysis. ΊYu = Fuzzy analysis system is performing classification, if it loses: variable system ΐ;:;: when preset threshold value' This type of neural network interpolation technique will be selected. When the output variable is smaller than the critical value, the interpolation technique performs image processing and selection on the original image. Hai Shuangxian [Health, page 23, patent application scope _____ f 所述 As described in item 9 of the patent scope ‘where today yesterdayxing # 〃 The resolution of the enhanced shirt image is too small. The digital image and conditions of the image are as described in Item 5 of the scope of the patent application, where the neural network interpolation technology is used in a powerful way; the square of the resolution = via the network, and the network The training method of Road 2 and I sub-provincial method is stored in a database. 1. Relevant parameters after mining. 2 A method that can enhance the resolution of the image, including the original image provided by π, including the following steps: Extract the edge part of the original image; calculate the image Each pixel on the edge region represents, according to the position and calculation of the edge region of the image, '= the original image is classified as using a class or 疋 bilinear interpolation technique; the interpolation technique uses this type of nerve The network interpolation technology and the bi-linear initiation image are used for image processing; and Yishu Shu completes the processing of the entire original image to obtain a high-resolution Lu Zhili image. X 1 3. The method for enhancing image analysis as described in item 12 of the scope of patent application, wherein before the step of capturing the edge region of the image, X ^ 1 uses an image mask to segment the original image. To facilitate subsequent analysis steps. 14. The method for enhancing image analysis as described in item 12 of the scope of patent application, wherein the image mask is composed of N * N pixels. Λ 1 5. The method that can enhance the image analysis as described in item 12 of the scope of patent application 第24頁 578117 六、申請專利範圍 法,其中該類神經網路内插技術係利用監督式學習法訓練 類神經網路,並將該類神經網路訓練完成後之的相關參數 儲存在一資料庫中。Page 24 578117 VI. Patent application scope method, in which this type of neural network interpolation technology uses a supervised learning method to train a neural network, and stores related parameters after training of this neural network in a data In the library. 第25頁Page 25
TW91124922A 2002-10-25 2002-10-25 Apparatus and method of enhancing image resolution TW578117B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW91124922A TW578117B (en) 2002-10-25 2002-10-25 Apparatus and method of enhancing image resolution

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW91124922A TW578117B (en) 2002-10-25 2002-10-25 Apparatus and method of enhancing image resolution

Publications (1)

Publication Number Publication Date
TW578117B true TW578117B (en) 2004-03-01

Family

ID=32847417

Family Applications (1)

Application Number Title Priority Date Filing Date
TW91124922A TW578117B (en) 2002-10-25 2002-10-25 Apparatus and method of enhancing image resolution

Country Status (1)

Country Link
TW (1) TW578117B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7693350B2 (en) 2004-12-27 2010-04-06 Casio Computer Co., Ltd. Pixel interpolation device and camera adapted to perform pixel interpolation of captured image
TWI402768B (en) * 2010-08-13 2013-07-21 Primax Electronics Ltd Method for generating high resolution image
US8704847B2 (en) 2005-04-04 2014-04-22 Samsung Display Co., Ltd. Pre-subpixel rendered image processing in display systems
US9343018B2 (en) 2009-04-08 2016-05-17 Semiconductor Energy Laboratory Co., Ltd. Method for driving a liquid crystal display device at higher resolution
TWI588777B (en) * 2015-12-29 2017-06-21 Method of Fuzzy Clustering Automated Contrast Change

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7693350B2 (en) 2004-12-27 2010-04-06 Casio Computer Co., Ltd. Pixel interpolation device and camera adapted to perform pixel interpolation of captured image
US8704847B2 (en) 2005-04-04 2014-04-22 Samsung Display Co., Ltd. Pre-subpixel rendered image processing in display systems
US9343018B2 (en) 2009-04-08 2016-05-17 Semiconductor Energy Laboratory Co., Ltd. Method for driving a liquid crystal display device at higher resolution
US9978320B2 (en) 2009-04-08 2018-05-22 Semiconductor Energy Laboratory Co., Ltd. Method for driving semiconductor device
US10657910B2 (en) 2009-04-08 2020-05-19 Semiconductor Energy Laboratory Co., Ltd. Method for driving semiconductor device
US11030966B2 (en) 2009-04-08 2021-06-08 Semiconductor Energy Laboratory Co., Ltd. Method for driving semiconductor device
US11450291B2 (en) 2009-04-08 2022-09-20 Semiconductor Energy Laboratory Co., Ltd. Method for driving semiconductor device
US11670251B2 (en) 2009-04-08 2023-06-06 Semiconductor Energy Laboratory Co., Ltd. Method for driving semiconductor device
TWI402768B (en) * 2010-08-13 2013-07-21 Primax Electronics Ltd Method for generating high resolution image
TWI588777B (en) * 2015-12-29 2017-06-21 Method of Fuzzy Clustering Automated Contrast Change

Similar Documents

Publication Publication Date Title
Ren et al. Low-light image enhancement via a deep hybrid network
Lv et al. Attention guided low-light image enhancement with a large scale low-light simulation dataset
Matern et al. Exploiting visual artifacts to expose deepfakes and face manipulations
US7187811B2 (en) Method for image resolution enhancement
WO2020192483A1 (en) Image display method and device
Li et al. Fast multi-exposure image fusion with median filter and recursive filter
JP5397059B2 (en) Image processing apparatus and method, program, and recording medium
US8692830B2 (en) Automatic avatar creation
WO2021063341A1 (en) Image enhancement method and apparatus
US20240062530A1 (en) Deep perceptual image enhancement
CN107958441A (en) Image split-joint method, device, computer equipment and storage medium
CN110136055A (en) Super-resolution method and device, storage medium, the electronic device of image
US20200035037A1 (en) Virtual display method, device, electronic apparatus and computer readable storage medium
CN111079864A (en) Short video classification method and system based on optimized video key frame extraction
KR102262671B1 (en) Method and storage medium for applying bokeh effect to video images
Lv et al. Low-light image enhancement via deep Retinex decomposition and bilateral learning
CN112434647A (en) Human face living body detection method
Feng et al. Low-light image enhancement algorithm based on an atmospheric physical model
CN115761791A (en) Human body semantic prediction module based on 2D image, virtual clothes changing model and method
TW578117B (en) Apparatus and method of enhancing image resolution
JP7443030B2 (en) Learning method, program, learning device, and method for manufacturing learned weights
US20220358752A1 (en) Apparatus and method for developing space analysis model based on data augmentation
CN116342519A (en) Image processing method based on machine learning
CN112839167B (en) Image processing method, device, electronic equipment and computer readable medium
CN113099121B (en) ISP implementation method based on weak supervised learning

Legal Events

Date Code Title Description
MK4A Expiration of patent term of an invention patent