TW201943269A - Dual-channel image scaling system and method thereof which have an efficient image scaling function - Google Patents

Dual-channel image scaling system and method thereof which have an efficient image scaling function Download PDF

Info

Publication number
TW201943269A
TW201943269A TW107111655A TW107111655A TW201943269A TW 201943269 A TW201943269 A TW 201943269A TW 107111655 A TW107111655 A TW 107111655A TW 107111655 A TW107111655 A TW 107111655A TW 201943269 A TW201943269 A TW 201943269A
Authority
TW
Taiwan
Prior art keywords
value
image
pixels
channel
gradient values
Prior art date
Application number
TW107111655A
Other languages
Chinese (zh)
Other versions
TWI673997B (en
Inventor
李宇軒
蔡芳旭
余念恩
Original Assignee
元智大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 元智大學 filed Critical 元智大學
Priority to TW107111655A priority Critical patent/TWI673997B/en
Application granted granted Critical
Publication of TWI673997B publication Critical patent/TWI673997B/en
Publication of TW201943269A publication Critical patent/TW201943269A/en

Links

Landscapes

  • Image Processing (AREA)

Abstract

The present invention relates to a dual-channel image scaling system comprising a texture classification circuit for performing a two-stage operation on a plurality of pixels of at least one image and storing a plurality of gradient values of a portion of pixels in one of a smoothing portion and an edge portion; a dual-channel interpolation module for capturing a plurality of gradient values of at least one image and outputting a first value and a second value; a plurality of sharpening filters for capturing the first value and the second value and performing at least two second-order partial differentiations on the second value to produce a third value; and an image output unit for coupling the first value and the third value and outputting at least one scaling image. The present invention further proposes a dual-channel image scaling method. The texture classification circuit includes a gradient value unit and a minimum perceptible difference unit, wherein the gradient value unit extracts the plurality of gradient values of the plurality of pixels by one of a first order derivative operation and a second order derivative operation, and the minimum perceptible difference unit stores a minimum perceptible difference value and extracts the plurality of gradient values corresponding to the plurality of pixels to be compared with the minimum perceptible difference value. The dual-channel image scaling system further includes at least one register respectively connected to the bilinear interpolation channel and the plurality of sharpening filters for temporarily storing the plurality of gradient values. The dual-channel image scaling system further includes a display and at least one image capturing unit, wherein the display is coupled to the image output unit for capturing and displaying the at least one scaled image. Each of the at least one image capturing unit is connected to the texture classification circuit for outputting at least one image to the texture classification circuit.

Description

雙通道影像縮放系統及其方法Dual-channel image zoom system and method

本發明係關於一種影像縮放系統及其方法,尤其是一種具備雙通道且可高效率進行影像縮放的雙通道影像縮放系統及其方法。The present invention relates to an image zoom system and method, and more particularly to a dual-channel image zoom system and method with dual channels and high-efficiency image zoom.

在現今的電子產品有許多附有顯示螢幕的產品充斥在我們生活的周遭,如一般的消費性電子產品:電視、平板電腦、手機、數位相機、桌上型電腦、以及醫療用的產品如內視鏡(Endoscopy)等等。而這些電子產品在實際應用時常常會遇到原始的影像與螢幕設定的解析度不相符的情況。因此不管是將高畫質的原始影像縮小解析度到手機上撥放,抑或是反過來將低畫質的影像增加解析度到大尺寸的LCD/LED 電視螢幕,皆需要使用到影像縮放這項技術。In today's electronics, there are many products with display screens flooding our lives, such as general consumer electronics: TVs, tablets, mobile phones, cameras, desktop computers, and medical products. Sight glass (Endoscopy) and so on. These electronic products often encounter situations in which the original image matches the resolution of the screen settings. Therefore, regardless of whether the original high-quality image is reduced and analyzed and played on the mobile phone, or the low-quality image is increased and analyzed to a large-sized LCD / LED TV screen, you need to use image scaling. technology.

隨著科技的進步,顯示裝置支援的解析度快速的提升,在現今的市面上已經有支援4K UHD (3840 x 2160, 2160p)解析度的螢幕問世,下一世代的8K UHD(7680 x 4320, 4320p)解析度標準,在電子展上也有一些螢幕大廠已經展示能夠支援此一解析度的電視螢幕原型(Prototype),預計不久之後也會開始量產。然而在顯示裝置影像或是圖像的發展速度卻受到多方的限制。不論是經由電視頻道、播放器亦或是網路上如youtube 之類的串流平台,4K 以上畫質的影像並不多見,現今Full HD(1980x1080, 1080p)的影像仍佔據主流,也就是說影像畫質(解析度)的發展跟不上顯示裝置的研發速度。這意味著在未來隨著兩邊的解析度差距越拉越大,影像縮放所使用的放大與縮小的倍率會進一步提高,演算法需要計算的像素值也就會跟著變得越來越多,對於影像縮放演算法的速度要求也就會跟著越來越高。With the advancement of technology, the resolution support for display devices has been rapidly improved. In the current market, there are already screens that support 4K UHD (3840 x 2160, 2160p) resolution. The next generation of 8K UHD (7680 x 4320, 4320p) resolution standard, and some screen manufacturers at the electronics show have already demonstrated prototypes of TV screens that can support this resolution. It is expected that production will begin in a long time. However, the development speed of the display device image or image is limited by many parties.经由 It is through TV channels, players, or online platforms such as YouTube. The image quality of 4K or higher is not large. Today, Full HD (1980x1080, 1080p) images still occupy the main frame, that is, 說The development of image quality (analysis) has kept pace with the rapid development of display devices. This means that in the future, as the edge resolution becomes larger and larger, the magnification and reduction ratios used for image scaling will be further increased, and the pixel values that the algorithm needs to calculate will become larger and larger. The speed requirements of the image scaling algorithm will also increase.

然而,現有技術的影像縮放相關硬體與軟體在處理高解析度影像如前述的4K UHD或8K UHD等影像的效率上仍受到現有技術如電路設計以及演算法的等等限制而具有處理效率不彰的問題,且為了達到更好的處理結果必須採用龐大演算機制或多次疊代運算而很可能會在既有的硬體上更增添其他成本。因此,要必要提出一種可高效率進行高解析度影像縮放的系統及方法,以解決現有技術效率不彰以及成本無法降低的技術問題。However, the efficiency of the related art image scaling related hardware and software in processing high-resolution images such as the aforementioned 4K UHD or 8K UHD images is still limited by the existing technologies such as circuit design and algorithms, and has processing efficiency. Problems, and in order to achieve better processing results, a huge calculation mechanism or multiple iterations must be used, and it is likely to add additional costs to the existing hardware. Therefore, it is necessary to propose a system and method that can perform high-resolution image scaling with high efficiency, in order to solve the technical problems of inefficient efficiency and cost that cannot be reduced in the prior art.

鑒於前述之習知技術的缺點,本發明之主要目的係提供一種雙通道影像縮放系統,其具備可高效率進行影像縮放的功能且免除了為多次疊代運算而添購硬體成本的必要性,而可以達到降低影像縮放成本的目的。In view of the shortcomings of the prior art, the main purpose of the present invention is to provide a dual-channel image zoom system, which has the function of image zoom with high efficiency and eliminates the need to purchase hardware costs for multiple iteration operations. It can reduce the cost of image scaling.

為了達到前述目的以及其他目的,本發明提供了一種雙通道影像縮放系統,包括:一紋理分類電路,係用以隊只少一多數個像素進行二階段運算而將部份該多數個像素的多數個梯度值儲存至一平滑部以及一邊緣部之其中一者;其中,該紋理分類電路包括一梯度值單元以及一最小可覺差單元;該梯度值單元係用以透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;該最小可覺差單元係儲存有一最小可覺差值,該最小可覺差單元擷取對應於該多數個像素的該多數個梯度值,並分別將其與該最小可覺差值比較大小;當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,則將部分該多數個梯度值儲存至該平滑部;當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,則將部分該多數個梯度值儲存至該邊緣部;一雙通道內插模組,係連接該紋理分類電路,且用以擷取該至少一影像的該多數個梯度值,並輸出一第一數值以及一第二數值;其中,該雙通道內插模組包括一最近相鄰內插法通道以及一雙線性內插法通道;該最近相鄰內插法通道係用以擷取儲存於該平滑部中的部分該多數個梯度值,並對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值;該雙線性內插法通道係用以擷取儲存於該邊緣部的部分該多數個梯度值,並對部分該多數個梯度值進行雙線性內插法處理而輸出該第二數值;多數個銳化濾波器,係連接該雙通道內插模組,該多數個銳化濾波器用以擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,每一該多數個銳化濾波器對應該多數個像素中的其中九個像素所形成的一方陣,且分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及一影像輸出單元,係連接該多數個銳化濾波器,該影像輸出單元耦合該第一數值以及該第三數值並輸出至少一縮放影像。In order to achieve the foregoing objectives and other objectives, the present invention provides a dual-channel image scaling system, including: a texture classification circuit, which is used to perform a two-stage operation with only a few pixels at most and a part of the pixels at most A plurality of gradient values are stored in one of a smoothing portion and an edge portion; wherein the texture classification circuit includes a gradient value unit and a minimum perceptible difference unit; the gradient value unit is used for first-order derivative calculation and One of the second derivative operations to capture the majority gradient values of the plurality of pixels; the minimum perceptible difference unit stores a minimum perceptible difference value, and the minimum perceptible difference unit capture corresponds to the majority pixel The majority gradient value and compare it with the minimum perceptible difference value respectively; when the portion corresponding to the majority pixel portion and the majority gradient value are smaller than the minimum perceptible difference value, the majority portion will be partially The gradient value is stored in the smoothing portion; when the corresponding portion of the plurality of pixels is greater than the minimum perceptible difference, the portion of the majority is Degree values are stored to the edge; a two-channel interpolation module is connected to the texture classification circuit and is used to capture the plurality of gradient values of the at least one image and output a first value and a second value ; Wherein the dual-channel interpolation module includes a nearest-neighbor interpolation method channel and a double-linear interpolation method channel; the nearest-neighbor interpolation method channel is used to capture a part stored in the smoothing part The plurality of gradient values, and performing nearest-neighbor interpolation on part of the plurality of gradient values to output the first value; the bilinear interpolation channel is used to retrieve a part of the edge portion stored in the edge portion; A plurality of gradient values, and bilinear interpolation is performed on part of the plurality of gradient values to output the second value; a plurality of sharpening filters are connected to the dual-channel interpolation module, and the plurality of sharpening The filter is used to capture the first value and the second value, and perform a second partial differential of the second value at least twice to generate a third value. Each of the majority sharpening filters corresponds to the majority. Nine of the pixels And a third value; and an image output unit connected to the plurality of sharpening filters to output the image. The unit couples the first value and the third value and outputs at least one zoomed image.

開始使用本發明之雙通道影像縮放系統時,該紋理分類電路先對該至少一影像的該多數個像素進行二階段運算而將部份該多數個像素的該多數個梯度值儲存至該平滑部以及該邊緣部之其中一者;即一開始先針對該至少一影像中依據梯度值而被判斷為平滑或邊緣部分的像素進行分類,以進行往後的進一步的處理(如針對人眼視覺較不敏感的平滑部分進行強度較強或較簡潔的處理以增進處理效能,而針對人眼視覺較敏感的邊緣部分進行強度較強或較縝密的處理以增進處理品質),在本發明中是透過將該多數個梯度值與該最小可覺差值的比較來判斷對應像素是屬於平滑或邊緣部分並進行分類;接著與該紋理分類電路連接的該雙通道內插模組自該紋理分類電路分別擷取儲存於該平滑部以及該邊緣部的部分該多數個梯度值,並分別針對儲存於該平滑部中的部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值,以及分別針對儲存於該邊緣部的部分該多數個梯度值進行雙線性內插法處理而輸出該第二數值;繼而與該雙通道內插模組連接的該多數個銳化濾波器自該雙通道內插模組中擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生該第三數值,每一該多數個銳化濾波器對應該多數個像素中的其中九個像素所形成的方陣,且分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值,即是透過對該第二數值進行至少二次的二次偏微分而產生該第三數值來使得對應於該第二數值的部分該多數個像素增強其對比度,以提升邊緣辨識度的手法來達到影像銳化效果;最後該影像輸出單元透過該多數個銳化濾波器以分別擷取對應平滑部分的部分該多數個像素的該第一數值以及對應邊緣部分的部分該多數個像素且已經過銳化處理的該第三數值,而輸出該至少一縮放影像。When the dual-channel image scaling system of the present invention is started, the texture classification circuit first performs a two-stage operation on the plurality of pixels of at least one image and stores the plurality of gradient values of the plurality of pixels to the smoothing section. And one of the edge portions; that is, first classify the pixels in the at least one image that are judged to be smooth or edge portions according to the gradient value for further processing in the future (such as for human visual comparison The insensitive smooth part is processed with stronger intensity or simpler to improve the processing efficiency, and the edge part which is more sensitive to human vision is processed with stronger intensity or more meticulous to improve the processing quality). Compare the plurality of gradient values with the minimum perceptible difference to determine whether the corresponding pixel belongs to a smooth or edge portion and classify it; then, the two-channel interpolation module connected to the texture classification circuit is separately from the texture classification circuit. Extracting the plurality of gradient values stored in the smooth portion and the edge portion, and respectively targeting the portions stored in the smooth portion The plurality of gradient values are processed by nearest-neighbor interpolation to output the first value, and the plurality of gradient values are stored in the edge portion, respectively, to perform bilinear interpolation processing to output the second value; then The plurality of sharpening filters connected to the two-channel interpolation module extracts the first value and the second value from the two-channel interpolation module, and performs at least a second two for the second value. The third partial value is generated by the second partial differentiation, and each of the plurality of sharpening filters corresponds to a square matrix formed by nine of the plurality of pixels, and the majority of the portion corresponding to the second value is respectively The pixel enhances the contrast, and the third value is generated, that is, the third value is generated by performing a second partial differential of the second value at least twice, so that a portion of the pixels corresponding to the second value enhances it. Contrast, to improve the sharpness of the image by improving the edge recognition method; finally, the image output unit passes the plurality of sharpening filters to capture the majority of the corresponding smooth portions respectively. And outputting the at least one zoomed image by the first value of the prime and the third value corresponding to a portion of the plurality of pixels of the edge portion and having been sharpened.

即是,本發明的雙通道影像縮放系統可根據影像中相對於人眼辨識度高以及辨識度低的部分像素分別進行不同的處理,透過針對該至少一影像中之部分該多數個像素進行的部分該多數個梯度值與該最小可覺差值進行比較大小來作為判斷該至少一影像中相對於人眼辨識度高以及辨識度低的部分,且進一步地針對人眼視覺較不敏感的平滑部分進行強度較強或較簡潔的處理以增進處理效能,而針對人眼視覺較敏感的邊緣部分進行強度較強或較縝密的處理以增進處理品質;進一步而言,在本發明中該至少一影像中相對於人眼辨識度高以及辨識度低的部分是可以同步進行處理的,是以雙通道方式處理該至少一影像的該多數個像素,其具備可高效率進行影像縮放的功能且免除了為多次疊代運算而添購硬體成本的必要性,而可以達到降低影像縮放成本的目的。That is, the dual-channel image scaling system of the present invention can perform different processing according to the partial pixels in the image with high recognition and low recognition with respect to the human eye. Part of the plurality of gradient values is compared with the minimum perceptible difference to determine the part of the at least one image that has high recognition and low recognition relative to the human eye, and further aims at smoothing that is less sensitive to human vision Some of them are processed with stronger or simpler processing to improve processing efficiency, while those with more sensitive edges of human eyes are processed with stronger or more meticulous processing to improve processing quality. Further, in the present invention, the at least one The parts of the image that have high recognition and low recognition with respect to the human eye can be processed synchronously. The plurality of pixels of the at least one image are processed in a dual-channel manner, which has the function of highly efficient image scaling and eliminates In order to reduce the cost of image scaling, it is necessary to purchase hardware cost for multiple iterations.

進一步而言,本發明的雙通道影像縮放系統更包括有至少一暫存器,該至少一暫存器係分別連接該雙線性內插法通道以及該多數個銳化濾波器,且用以暫存該多數個梯度值。Further, the dual-channel image zoom system of the present invention further includes at least one register, the at least one register is respectively connected to the bilinear interpolation method channel and the plurality of sharpening filters, and is used for The plurality of gradient values are temporarily stored.

進一步而言,本發明的雙通道影像縮放系統更包括用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器以及用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元;該顯示器係連接該影像輸出單元以擷取並顯示該至少一縮放影像;每一該至少一影像擷取單元係連接至該紋理分類電路以輸出該至少一影像至該紋理分類電路。Further, the dual-channel image zoom system of the present invention further includes a display for at least one of driving records, highway monitoring, aerial recording, medical endoscopes, and driving recording, highway monitoring, and aerial recording. And at least one image capturing unit of at least one of the medical endoscopes; the display is connected to the image output unit to capture and display the at least one zoomed image; each of the at least one image capturing unit is connected to the The texture classification circuit outputs the at least one image to the texture classification circuit.

鑒於前述之習知技術的缺點,本發明之另一目的係提供一種雙通道影像縮放系統,包括:一平滑像素電路,係用以對至少一影像的多數個像素進行二階段運算而擷取部份該多數個像素的多數個梯度值且輸出一第一數值;其中,該平滑像素電路包括一梯度值單元、一最小可覺差單元以及一最近相鄰內插法通道;該梯度值單元係用以透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;該最小可覺差單元係儲存有一最小可覺差值,該最小可覺差單元擷取對應於該多數個像素的該多數個梯度值,並分別將其與該最小可覺差值比較大小,當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,透過該最近相鄰內插法通道對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值;一邊緣像素電路,係包括一雙線性內插法通道以及多數個銳化濾波器,該邊緣像素電路用以當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,透過該雙線性內插法通道對部分該多數個梯度值進行雙線性內插法處理而輸出一第二數值;該多數個銳化濾波器用以擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,每一該多數個銳化濾波器對應該多數個像素中的其中九個像素所形成的一方陣,且分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及一影像輸出單元,係連接該多數個銳化濾波器,該影像輸出單元耦合該第一數值以及該第三數值並輸出至少一縮放影像。In view of the shortcomings of the foregoing conventional technology, another object of the present invention is to provide a dual-channel image scaling system, including: a smooth pixel circuit, which is used to perform a two-stage operation on a plurality of pixels of at least one image and an acquisition unit; Share a plurality of gradient values of the plurality of pixels and output a first value; wherein the smooth pixel circuit includes a gradient value unit, a minimum perceptible difference unit, and a nearest neighbor interpolation method channel; the gradient value unit is The first and second derivative operations are used to retrieve the plurality of gradient values of the plurality of pixels; the minimum perceptible difference unit stores a minimum perceptible difference unit, and the minimum perceptible difference unit. Extract the plurality of gradient values corresponding to the plurality of pixels, and compare them with the minimum perceptible difference, respectively, when the corresponding portion of the plurality of pixels is less than the minimum perceptible difference When the nearest neighbor interpolation method is applied to part of the plurality of gradient values through the nearest neighbor interpolation method to output the first value; an edge pixel circuit, It includes a pair of linear interpolation channels and a plurality of sharpening filters. The edge pixel circuit is used to pass through the two lines when the majority gradient value of the corresponding portion of the plurality of pixels is greater than the minimum perceptible difference. The linear interpolation channel performs a bilinear interpolation process on a part of the plurality of gradient values to output a second value; the plurality of sharpening filters are used to capture the first value and the second value, and target the The second value is subjected to at least two secondary partial differentiations to generate a third value. Each of the plurality of sharpening filters corresponds to a square matrix formed by nine of the plurality of pixels, and respectively corresponds to The plurality of pixels of the portion of the second value enhance the contrast to generate the third value; and an image output unit connected to the plurality of sharpening filters, the image output unit is coupled to the first value and the third Value and output at least one scaled image.

進一步而言,本發明的雙通道影像縮放系統更包括有至少一暫存器,該至少一暫存器係分別連接該雙線性內插法通道以及該多數個銳化濾波器,且用以暫存該多數個梯度值。Further, the dual-channel image zoom system of the present invention further includes at least one register, the at least one register is respectively connected to the bilinear interpolation method channel and the plurality of sharpening filters, and is used for The plurality of gradient values are temporarily stored.

進一步而言,本發明的雙通道影像縮放系統更包括用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器以及用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元;該顯示器係連接該影像輸出單元以擷取並顯示該至少一縮放影像;每一該至少一影像擷取單元係連接至該紋理分類電路以輸出該至少一影像至該紋理分類電路。Further, the dual-channel image zoom system of the present invention further includes a display for at least one of driving records, highway monitoring, aerial recording, medical endoscopes, and driving recording, highway monitoring, and aerial recording. And at least one image capturing unit of at least one of the medical endoscopes; the display is connected to the image output unit to capture and display the at least one zoomed image; each of the at least one image capturing unit is connected to the The texture classification circuit outputs the at least one image to the texture classification circuit.

鑒於前述之習知技術的缺點,本發明之又另一目的係提供一種雙通道影像縮放方法,包括下列步驟:對至少一影像的多數個像素進行二階段運算而將部份該多數個像素的多數個梯度值儲存至一平滑部以及一邊緣部之其中一者;其中,包括下列步驟:透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;擷取對應於該多數個像素的該多數個梯度值,並分別將其與一最小可覺差值比較大小;當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,則將部分該多數個梯度值儲存至該平滑部;當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,則將部分該多數個梯度值儲存至該邊緣部;擷取該至少一影像的該多數個梯度值,並輸出一第一數值以及一第二數值;其中,包括下列步驟:擷取儲存於該平滑部中的部分該多數個梯度值,並對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值;擷取儲存於該邊緣部的部分該多數個梯度值,並對部分該多數個梯度值進行雙線性內插法處理而輸出該第二數值;擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,其中,對應該多數個像素中的其中九個像素所形成的一方陣作為多數個銳化濾波器的其中之一,每一該多數個銳化濾波器分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及耦合該第一數值以及該第三數值而輸出至少一縮放影像。。In view of the shortcomings of the foregoing conventional technologies, another object of the present invention is to provide a dual-channel image scaling method, which includes the following steps: performing a two-stage operation on a plurality of pixels of at least one image and converting a part of the plurality of pixels. The plurality of gradient values are stored in one of a smooth portion and an edge portion, which includes the following steps: the plurality of gradient values of the plurality of pixels are retrieved through one of a first derivative operation and a second derivative operation. ; Capture the majority gradient values corresponding to the plurality of pixels and compare them with a minimum perceptible difference value; when the corresponding portion of the majority pixel portion the majority gradient value is less than the minimum perceptible difference When the value is equal to a value, the partial gradient value is stored in the smoothing portion; when the corresponding portion of the majority pixel portion is greater than the minimum perceptible difference value, the partial majority value is stored in The edge portion; capturing the plurality of gradient values of the at least one image, and outputting a first value and a second value; including the following steps: capturing Part of the plurality of gradient values stored in the smoothing part, and performing nearest-neighbor interpolation on part of the plurality of gradient values to output the first value; extracting part of the plurality of gradients stored in the edge part Value, and perform bilinear interpolation on part of the plurality of gradient values to output the second value; extract the first value and the second value, and perform at least two quadratic operations on the second value Partial differentiation generates a third value, where a matrix formed corresponding to nine of the plurality of pixels is used as one of the plurality of sharpening filters, and each of the plurality of sharpening filters uses The plurality of pixels corresponding to the part of the second value enhance the contrast to generate the third value; and the first value and the third value are coupled to output at least one zoomed image. .

進一步而言,本發明的雙通道影像縮放方法更包括一步驟:透過至少一暫存器暫存該多數個梯度值。Further, the dual-channel image scaling method of the present invention further includes a step of temporarily storing the plurality of gradient values through at least one register.

進一步而言,本發明的雙通道影像縮放方法更包括一步驟:藉由用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器擷取並顯示該至少一除霧影像。Further, the dual-channel image zooming method of the present invention further includes a step of capturing and displaying the at least one through a display for at least one of driving records, highway monitoring, aerial recording, and medical endoscopes. Defog image.

進一步而言,本發明的雙通道影像縮放方法更包括一步驟:藉由用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元輸出該至少一影像。Further, the dual-channel image zooming method of the present invention further includes a step of outputting the at least one image capturing unit through at least one image capturing unit for at least one of driving records, highway monitoring, aerial recordings, and medical endoscopes. An image.

以下係藉由特定的具體實施例說明本發明之實施方式,熟悉此技術之人士可由本說明書所揭示之內容輕易地瞭解本發明之其他優點及功效。本發明亦可藉由其他不同的具體實例加以施行或應用,本發明說明書中的各項細節亦可基於不同觀點與應用在不悖離本發明之精神下進行各種修飾與變更。The following is a description of specific embodiments of the present invention. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific examples, and various details in the description of the present invention can also be modified and changed based on different viewpoints and applications without departing from the spirit of the present invention.

須知,本說明書所附圖式繪示之結構、比例、大小、元件數量等,均僅用以配合說明書所揭示之內容,以供熟悉此技術之人士瞭解與閱讀,並非用以限定本發明可實施之限定條件,故不具技術上之實質意義,任何結構之修飾、比例關係之改變或大小之調整,在不影響本發明所能產生之功效及所能達成之目的下,均應落在本發明所揭示之技術內容得能涵蓋之範圍內。It should be noted that the structures, proportions, sizes, component numbers, etc. shown in the drawings in this specification are only used to match the content disclosed in the description for those familiar with this technology to understand and read, and are not intended to limit the present invention. The implementation of the conditions, so it does not have technical significance, any modification of the structure, the change of the proportional relationship or the adjustment of the size, without affecting the efficacy and the purpose that can be achieved by the present invention, should fall into this The technical content disclosed by the invention can be covered.

請參閱圖1、3以及4所示,其中,圖1為本發明第一實施例之雙通道影像縮放系統的架構示意圖;圖3、4為本發明之雙通道影像縮放系統的銳化濾波架構示意圖。Please refer to FIGS. 1, 3 and 4, wherein FIG. 1 is a schematic diagram of the architecture of a dual-channel image zoom system according to the first embodiment of the present invention; schematic diagram.

以下依據本發明之第一實施例,描述雙通道影像縮放系統,包括:紋理分類電路10、雙通道內插模組20多數個銳化濾波器30以及影像輸出單元40。The following describes a dual-channel image scaling system according to a first embodiment of the present invention, which includes a texture classification circuit 10, a dual-channel interpolation module 20, a plurality of sharpening filters 30, and an image output unit 40.

紋理分類電路係10用以對至少一影像100的多數個像素(圖中未示)進行二階段運算而將部份像素的多數個梯度值(圖中未示)儲存至一平滑部11以及一邊緣部12之其中一者;其中,紋理分類電路10包括一梯度值單元13以及一最小可覺差單元14;梯度值單元13係用以透過一階導數運算以及二階導數運算之其中一者而擷取多數個像素的多數個梯度值;最小可覺差單元14係儲存有一最小可覺差值141,最小可覺差單元14擷取對應於多數個像素的多數個梯度值,並分別將其與最小可覺差值141比較大小;當對應部分像素的部分梯度值小於最小可覺差值141時,則將部分梯度值儲存至平滑部11;當對應部分像素的部分梯度值大於最小可覺差值141時,則將部分梯度值儲存至邊緣部12。The texture classification circuit 10 is configured to perform a two-stage operation on a plurality of pixels (not shown) of at least one image 100 to store a plurality of gradient values (not shown) of some pixels to a smoothing section 11 and a One of the edge portions 12; wherein the texture classification circuit 10 includes a gradient value unit 13 and a minimum perceptible difference unit 14; the gradient value unit 13 is used for one of the first derivative operation and the second derivative operation. Capture the most gradient values of most pixels; the minimum perceptible difference unit 14 stores a minimum perceptible difference 141, and the minimum perceptible difference unit 14 captures the majority of the gradient values corresponding to the majority of pixels and separates them Compared with the minimum perceptible difference 141, when the partial gradient value of the corresponding partial pixel is smaller than the minimum perceptible difference 141, the partial gradient value is stored in the smoothing section 11; when the partial gradient value of the corresponding partial pixel is greater than the minimum perceptible difference When the difference is 141, a part of the gradient value is stored in the edge portion 12.

雙通道內插模組20係連接紋理分類電路10,且用以擷取至少一影像100的多數個梯度值,並輸出一第一數值200以及一第二數值300;其中,雙通道內插模組20包括一最近相鄰內插法(NNI)通道21以及一雙線性(BLI)內插法通道22。最近相鄰內插法通道21係用以擷取儲存於平滑部11中的部分梯度值,並對部分梯度值進行最近相鄰內插法處理而輸出第一數值200。雙線性內插法通道22係用以擷取儲存於邊緣部12的部分梯度值,並對部分梯度值進行雙線性內插法處理而輸出第二數值300。The two-channel interpolation module 20 is connected to the texture classification circuit 10 and is used to capture a plurality of gradient values of at least one image 100 and output a first value 200 and a second value 300. Among them, the two-channel interpolation module Group 20 includes a nearest neighbor interpolation (NNI) channel 21 and a bilinear (BLI) interpolation channel 22. The nearest-neighbor interpolation method 21 is used to capture a part of the gradient value stored in the smoothing section 11 and perform a nearest-neighbor interpolation method on the part of the gradient value to output a first value 200. The bilinear interpolation channel 22 is used to capture a portion of the gradient value stored in the edge portion 12 and perform a bilinear interpolation process on the portion of the gradient value to output a second value 300.

多數個銳化濾波器30係連接雙通道內插模組20,多數個銳化濾波器30用以擷取第一數值200以及第二數值300,並針對第二數值300進行至少二次的二次偏微分而產生一第三數值400,每一個銳化濾波器30對應多數個像素中的其中九個像素所形成的一方陣31(如圖5所示),且分別使對應於第二數值300的部分像素增強對比度,而產生第三數值400。The plurality of sharpening filters 30 are connected to the dual-channel interpolation module 20. The plurality of sharpening filters 30 are used to capture a first value 200 and a second value 300, and perform at least a second two for the second value 300. The second partial differentiation generates a third value 400. Each sharpening filter 30 corresponds to a matrix 31 formed by nine of the plurality of pixels (as shown in FIG. 5), and respectively corresponds to the second value. A portion of the pixels of 300 enhances the contrast, resulting in a third value of 400.

在本發明的雙通道影像縮放系統中更包括有至少一暫存器500,係分別連接雙線性內插法通道22以及多數個銳化濾波器30,且用以暫存多數個梯度值。The dual-channel image scaling system of the present invention further includes at least one register 500 connected to the bilinear interpolation method channel 22 and the plurality of sharpening filters 30, respectively, and used to temporarily store the plurality of gradient values.

影像輸出單元40係連接多數個銳化濾波器30,影像輸出單元40耦合第一數值以及第三數值並輸出至少一縮放影像41。The image output unit 40 is connected to a plurality of sharpening filters 30. The image output unit 40 is coupled to the first value and the third value and outputs at least one zoom image 41.

在本發明的所述實施例中,最小可覺差值(JND)是動態可變地,其計算方式如下述:接著將前述平均背景亮度遮罩縮小範圍後公式如下: In the embodiment of the present invention, the minimum perceptible difference (JND) is dynamically variable, and the calculation method is as follows: Next, the formula for reducing the aforementioned average background brightness mask is as follows:

由上述公式可得知,其灰階度以127 為分界點,當灰階度小於127 視為背景亮度較暗區域,反之大於127 為較亮區域。假設最後計算JND 閥值為4,代表在此區域兩者灰階度差異值必須超過4才能被肉眼所辨識察覺。It can be known from the above formula that the gray level is 127 as the cut-off point. When the gray level is less than 127, it is regarded as a darker area of the background brightness, otherwise it is lighter area. Assume that the final calculated JND threshold is 4, which means that the difference between the gray levels of the two in this area must exceed 4 to be recognized by the naked eye.

在本實施例中,雙通道影像縮放系統可更包括用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器600以及用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元700。顯示器600係連接影像輸出單元40以擷取並顯示至少一縮放影像41。每一影像擷取單元700係連接至紋理分類電路10以輸出至少一影像100至紋理分類電路10。In this embodiment, the dual-channel image zoom system may further include a display 600 for at least one of driving records, highway monitoring, aerial recording, medical endoscopes, and driving recording, highway monitoring, and aerial photography. At least one image capturing unit 700 for recording and recording at least one of the medical endoscopes. The display 600 is connected to the image output unit 40 to capture and display at least one zoomed image 41. Each image capturing unit 700 is connected to the texture classification circuit 10 to output at least one image 100 to the texture classification circuit 10.

參閱圖2所示,圖2為本發明第二實施例之雙通道影像縮放系統的架構示意圖。Referring to FIG. 2, FIG. 2 is a schematic structural diagram of a dual-channel image zoom system according to a second embodiment of the present invention.

在本發明的雙通道影像縮放系統中,其第二實施例與前述的第一實施例大致相同,惟將最近相鄰內插法通道21與梯度值單元13以及最小可決插單元14整合在一起為平滑像素電路10’;以及將雙線性內插法通道22與銳化濾波器30以及暫存器500整合在一起為邊緣像素電路20’。為此,可以在電路設計上具有較節省佈線面積以及製造成本的益處與功效。In the dual-channel image zoom system of the present invention, the second embodiment is substantially the same as the first embodiment described above, except that the nearest neighbor interpolation channel 21 is integrated with the gradient value unit 13 and the minimum determinable interpolation unit 14. To smooth the pixel circuit 10 ′; and integrate the bilinear interpolation method channel 22 with the sharpening filter 30 and the register 500 into an edge pixel circuit 20 ′. For this reason, it can have the benefits and efficacy of saving wiring area and manufacturing cost in circuit design.

參閱圖5所示,圖5為本發明第一實施例之雙通道影像縮放方法的流程圖。Referring to FIG. 5, FIG. 5 is a flowchart of a dual-channel image scaling method according to a first embodiment of the present invention.

開始使用本發明之雙通道影像縮放系統時,紋理分類電路10先對至少一影像100的多數個像素進行二階段運算而將部份像素的梯度值儲存至平滑部11以及邊緣部12之其中一者(步驟S01);即一開始先針對影像100中依據梯度值而被判斷為平滑或邊緣部分的像素進行分類,以進行往後的進一步的處理(如針對人眼視覺較不敏感的平滑部分進行強度較強或較簡潔的處理以增進處理效能,而針對人眼視覺較敏感的邊緣部分進行強度較強或較縝密的處理以增進處理品質),在本發明中是透過將多數個梯度值與最小可覺差值141的比較來判斷對應像素是屬於平滑或邊緣部分並進行分類;接著與紋理分類電路10連接的雙通道內插模組20自紋理分類電路10分別擷取儲存於平滑部11以及邊緣部12的部分梯度值,並分別針對儲存於平滑部11中的部分梯度值進行最近相鄰內插法(NNI)處理而輸出第一數值200,以及分別針對儲存於邊緣部12的部分梯度值進行雙線性內插法(BLI)處理而輸出第二數值300(步驟S02);繼而與雙通道內插模組20連接的多數個銳化濾波器30自雙通道內插模組20中擷取第一數值200以及第二數值300,並針對第二數值300進行至少二次的二次偏微分而產生第三數值400,每一個銳化濾波器30對應多數個像素中的其中九個像素所形成的方陣31,且分別使對應於第二數值300的部分像素增強對比度,而產生第三數值400(步驟S03),即是透過對第二數值300進行至少二次的二次偏微分而產生第三數值400來使得對應於第二數值300的部分像素增強其對比度,以提升邊緣辨識度的手法來達到影像銳化效果;最後影像輸出單元40透過多數個銳化濾波器30以分別擷取對應平滑部分的部分像素的第一數值200以及對應邊緣部分的部分像素且已經過銳化處理的第三數值400,而輸出至少一縮放影像41(步驟S04)。When starting to use the dual-channel image scaling system of the present invention, the texture classification circuit 10 first performs a two-stage operation on a plurality of pixels of at least one image 100 and stores the gradient values of some pixels to one of the smooth portion 11 and the edge portion 12 (Step S01); that is, first classify the pixels in the image 100 that are judged to be smooth or edge portions according to the gradient value for further processing in the future (such as for the smooth parts that are less sensitive to human vision) Stronger or simpler processing is performed to improve the processing efficiency, and stronger or more meticulous processing is performed on the edge parts that are more sensitive to human vision to improve the processing quality. In the present invention, the majority of gradient values are Compare with the minimum perceptible difference 141 to determine whether the corresponding pixel belongs to the smooth or edge portion and classify it; then the two-channel interpolation module 20 connected to the texture classification circuit 10 extracts and stores the texture classification circuit 10 in the smoothing section respectively Part of the gradient value of 11 and the edge part 12, and performing nearest neighbor interpolation (NNI) processing on the part of the gradient value stored in the smoothing part 11, respectively The first value 200 is output, and the second value 300 is output by performing bilinear interpolation (BLI) processing on the partial gradient values stored in the edge portion 12 (step S02); and then connected to the dual-channel interpolation module 20 The plurality of sharpening filters 30 extract a first value 200 and a second value 300 from the two-channel interpolation module 20, and perform at least two second-order partial differentiation on the second value 300 to generate a third value 400. , Each sharpening filter 30 corresponds to a square matrix 31 formed by nine of the plurality of pixels, and partially enhances the contrast of a portion of the pixels corresponding to the second value 300 to generate a third value 400 (step S03), That is, the third value 400 is generated by performing a second partial differentiation of the second value 300 at least twice to make some pixels corresponding to the second value 300 enhance its contrast and improve the edge recognition to achieve image sharpening. Effect; finally, the image output unit 40 passes through the plurality of sharpening filters 30 to respectively capture the first value 200 of the partial pixels corresponding to the smooth portion and the third value of the partial pixels corresponding to the edge portion and has been sharpened Value 400, and outputs at least a zoomed image 41 (step S04).

即是,本發明的雙通道影像縮放系統可根據影像中相對於人眼辨識度高以及辨識度低的部分像素分別進行不同的處理,透過針對該至少一影像100中之部分像素進行的部分梯度值與最小可覺差值141進行比較大小來作為判斷至少一影像100中相對於人眼辨識度高以及辨識度低的部分,且進一步地針對人眼視覺較不敏感的平滑部分進行強度較強或較簡潔的處理以增進處理效能,而針對人眼視覺較敏感的邊緣部分進行強度較強或較縝密的處理以增進處理品質;進一步而言,在本發明中該至少一影像100中相對於人眼辨識度高以及辨識度低的部分是可以同步進行處理的,是以雙通道方式處理該至少一影像100的多數個像素,其具備可高效率進行影像縮放的功能且免除了為多次疊代運算而添購硬體成本的必要性,而可以達到降低影像縮放成本的目的。That is, the dual-channel image scaling system of the present invention can perform different processing according to the partial pixels in the image with high recognition and low recognition with respect to the human eye, through partial gradients for partial pixels in the at least one image 100 The value is compared with the minimum perceptible difference 141 to determine the part of at least one image 100 that has high recognition and low recognition with respect to the human eye, and further strengthens the intensity of the smooth part that is less sensitive to human vision. Or a more concise process to improve the processing efficiency, and a more intensive or more meticulous process is performed on the more sensitive edge portion of the human eye to improve the processing quality; further, in the present invention, the at least one image 100 is relatively The parts with high human eye recognition and low human eye recognition can be processed simultaneously. The majority of the pixels of the at least one image 100 are processed in a dual-channel manner, which has the function of highly efficient image zooming and is saved for multiple times. The necessity of iterative computing and the purchase of hardware costs can reduce the cost of image scaling.

儘管已參考本申請的許多說明性實施例描述了實施方式,但應瞭解的是,本領域技術人員能夠想到多種其他改變及實施例,這些改變及實施例將落入本公開原理的精神與範圍內。尤其是,在本公開、圖式以及所附申請專利範圍的範圍內,對主題結合設置的組成部分及/或設置可作出各種變化與修飾。除對組成部分及/或設置做出的變化與修飾之外,可替代的用途對本領域技術人員而言將是顯而易見的。Although the embodiments have been described with reference to many illustrative embodiments of the present application, it should be understood that those skilled in the art can think of many other changes and embodiments that will fall within the spirit and scope of the principles of the present disclosure Inside. In particular, various changes and modifications can be made to the components and / or settings of the subject combination setting within the scope of the present disclosure, the drawings, and the scope of the attached patent application. In addition to variations and modifications in the component parts and / or arrangements, alternative uses will be apparent to those skilled in the art.

10‧‧‧紋理分類電路10‧‧‧ texture classification circuit

10’‧‧‧平滑像素電路10’‧‧‧ smooth pixel circuit

11‧‧‧平滑部11‧‧‧ smoothing section

12‧‧‧邊緣部12‧‧‧Edge

13‧‧‧梯度值單元13‧‧‧ gradient unit

14‧‧‧最小可覺差單元14‧‧‧Minimal Perceptible Difference Unit

141‧‧‧最小可覺差值141‧‧‧Minimal perceived difference

20‧‧‧雙通道內插模組20‧‧‧Dual-channel plug-in module

20’‧‧‧邊緣像素電路20’‧‧‧ edge pixel circuit

21‧‧‧最近相鄰內插法通道21‧‧‧nearest neighbor interpolation channel

22‧‧‧雙線性內插法通道22‧‧‧Bilinear interpolation channel

30‧‧‧銳化濾波器30‧‧‧Sharpening filter

31‧‧‧方陣31‧‧‧square

40‧‧‧影像輸出單元40‧‧‧Image output unit

41‧‧‧縮放影像41‧‧‧ Zoom image

100‧‧‧影像100‧‧‧ video

200‧‧‧第一數值200‧‧‧ first value

300‧‧‧第二數值300‧‧‧Second value

400‧‧‧第三數值400‧‧‧ third value

500‧‧‧暫存器500‧‧‧Register

600‧‧‧顯示器600‧‧‧ Display

700‧‧‧影像擷取單元700‧‧‧Image capture unit

S01~S04‧‧‧步驟S01 ~ S04‧‧‧step

圖1為本發明第一實施例之雙通道影像縮放系統的架構示意圖; 圖2為本發明第二實施例之雙通道影像縮放系統的架構示意圖; 圖3、4為本發明之雙通道影像縮放系統的銳化濾波架構示意圖;以及 圖5為本發明第一實施例之雙通道影像縮放方法的流程圖。1 is a schematic diagram of a dual-channel image zoom system according to a first embodiment of the present invention; FIG. 2 is a schematic diagram of a dual-channel image zoom system according to a second embodiment of the present invention; and FIGS. 3 and 4 are dual-channel image zooms according to the present invention. A schematic diagram of the system's sharpening filtering architecture; and FIG. 5 is a flowchart of a dual-channel image scaling method according to the first embodiment of the present invention.

Claims (10)

一種雙通道影像縮放系統,包括: 一紋理分類電路,係用以對至少一影像的多數個像素進行二階段運算而將部份該多數個像素的多數個梯度值儲存至一平滑部以及一邊緣部之其中一者;其中,該紋理分類電路包括一梯度值單元以及一最小可覺差單元;該梯度值單元係用以透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;該最小可覺差單元係儲存有一最小可覺差值,該最小可覺差單元擷取對應於該多數個像素的該多數個梯度值,並分別將其與該最小可覺差值比較大小;當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,則將部分該多數個梯度值儲存至該平滑部;當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,則將部分該多數個梯度值儲存至該邊緣部; 一雙通道內插模組,係連接該紋理分類電路,且用以擷取該至少一影像的該多數個梯度值,並輸出一第一數值以及一第二數值;其中,該雙通道內插模組包括一最近相鄰內插法通道以及一雙線性內插法通道;該最近相鄰內插法通道係用以擷取儲存於該平滑部中的部分該多數個梯度值,並對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值;該雙線性內插法通道係用以擷取儲存於該邊緣部的部分該多數個梯度值,並對部分該多數個梯度值進行雙線性內插法處理而輸出該第二數值; 多數個銳化濾波器,係連接該雙通道內插模組,該多數個銳化濾波器用以擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,每一該多數個銳化濾波器對應該多數個像素中的其中九個像素所形成的一方陣,且分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及 一影像輸出單元,係連接該多數個銳化濾波器,該影像輸出單元耦合該第一數值以及該第三數值並輸出至少一縮放影像。A dual-channel image scaling system includes: a texture classification circuit for performing a two-stage operation on a plurality of pixels of at least one image to store a plurality of gradient values of a portion of the plurality of pixels to a smoothing portion and an edge One of the parts; wherein the texture classification circuit includes a gradient value unit and a minimum perceptible difference unit; the gradient value unit is used to capture the majority through one of a first derivative operation and a second derivative operation The plurality of gradient values of the plurality of pixels; the minimum perceptible difference unit stores a minimum perceptible difference value, and the minimum perceptible difference unit captures the plurality of gradient values corresponding to the plurality of pixels, and respectively compares them with The minimum perceptible difference value is relatively large; when the majority gradient value of the corresponding portion of the plurality of pixels is smaller than the minimum perceptible difference value, a portion of the majority gradient value is stored in the smoothing portion; when the corresponding portion is When the plurality of gradient values of a plurality of pixels are larger than the minimum perceptible difference value, a portion of the plurality of gradient values are stored in the edge portion; a two-channel interpolation A set is connected to the texture classification circuit and is used to capture the plurality of gradient values of the at least one image and output a first value and a second value; wherein the dual-channel interpolation module includes a nearest phase A neighbor interpolation channel and a pair of linear interpolation channels; the nearest neighbor interpolation channel is used to capture a portion of the plurality of gradient values stored in the smoothing portion, and a portion of the plurality of gradient values Perform the nearest neighbor interpolation processing to output the first value; the bilinear interpolation channel is used to capture a portion of the plurality of gradient values stored in the edge portion, and perform a portion of the plurality of gradient values Bilinear interpolation processing to output the second value; a plurality of sharpening filters are connected to the dual-channel interpolation module, and the plurality of sharpening filters are used to capture the first value and the second value , And perform a second partial differential at least twice for the second value to generate a third value, each of the plurality of sharpening filters corresponds to a square formed by nine of the plurality of pixels, and Respectively corresponding to the second The plurality of pixels of the portion of the value enhance the contrast to generate the third value; and an image output unit is connected to the plurality of sharpening filters, the image output unit couples the first value and the third value and outputs At least one zoomed image. 如申請專利範圍第1項所述的雙通道影像縮放系統,更包括有至少一暫存器,該至少一暫存器係分別連接該雙線性內插法通道以及該多數個銳化濾波器,且用以暫存該多數個梯度值。The dual-channel image zoom system described in the first patent application scope further includes at least one register, which is connected to the bilinear interpolation method channel and the plurality of sharpening filters, respectively. And used to temporarily store the plurality of gradient values. 如申請專利範圍第1項所述的雙通道影像縮放系統,更包括用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器以及用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元;該顯示器係連接該影像輸出單元以擷取並顯示該至少一縮放影像;每一該至少一影像擷取單元係連接至該紋理分類電路以輸出該至少一影像至該紋理分類電路。The dual-channel image zoom system according to item 1 of the patent application scope further includes a display for at least one of driving records, highway monitoring, aerial recording, medical endoscopes, and driving records, highway monitoring. At least one image capturing unit of at least one of the aerial photography recorder and the medical endoscope; the display is connected to the image output unit to capture and display the at least one zoomed image; each of the at least one image capturing unit Is connected to the texture classification circuit to output the at least one image to the texture classification circuit. 一種雙通道影像縮放系統,包括: 一平滑像素電路,係用以對至少一影像的多數個像素進行二階段運算而擷取部份該多數個像素的多數個梯度值且輸出一第一數值;其中,該平滑像素電路包括一梯度值單元、一最小可覺差單元以及一最近相鄰內插法通道;該梯度值單元係用以透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;該最小可覺差單元係儲存有一最小可覺差值,該最小可覺差單元擷取對應於該多數個像素的該多數個梯度值,並分別將其與該最小可覺差值比較大小,當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,透過該最近相鄰內插法通道對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值; 一邊緣像素電路,係包括一雙線性內插法通道以及多數個銳化濾波器,該邊緣像素電路用以當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,透過該雙線性內插法通道對部分該多數個梯度值進行雙線性內插法處理而輸出一第二數值;該多數個銳化濾波器用以擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,每一該多數個銳化濾波器對應該多數個像素中的其中九個像素所形成的一方陣,且分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及 一影像輸出單元,係連接該多數個銳化濾波器,該影像輸出單元耦合該第一數值以及該第三數值並輸出至少一縮放影像。A dual-channel image scaling system includes: a smooth pixel circuit for performing a two-stage operation on a plurality of pixels of at least one image to capture a plurality of gradient values of a portion of the plurality of pixels and output a first value; The smooth pixel circuit includes a gradient value unit, a minimum perceptible difference unit, and a nearest-neighbor interpolation channel. The gradient value unit is used to extract one of a first derivative operation and a second derivative operation. Take the plurality of gradient values of the plurality of pixels; the minimum perceptible difference unit stores a minimum perceptible difference value, and the minimum perceptible difference unit captures the plurality of gradient values corresponding to the plurality of pixels, and respectively Compare it with the minimum perceptible difference. When the portion of the majority gradient corresponding to the portion of the plurality of pixels is smaller than the minimum perceptible difference, a portion of the plurality of gradients is passed through the nearest neighbor interpolation channel. The value is subjected to nearest-neighbor interpolation to output the first value. An edge pixel circuit includes a bilinear interpolation channel and a plurality of sharpening filters. The edge pixel circuit is configured to perform bilinear interpolation on a portion of the plurality of gradient values through the bilinear interpolation channel when a portion of the plurality of gradient values corresponding to the plurality of pixels is greater than the minimum perceptible difference. Processing to output a second value; the plurality of sharpening filters are used to capture the first value and the second value, and perform a second partial differential of the second value at least twice to generate a third value , Each of the plurality of sharpening filters corresponds to a matrix formed by nine of the plurality of pixels, and the plurality of pixels corresponding to the portion corresponding to the second value are respectively enhanced in contrast to generate the first Three values; and an image output unit connected to the plurality of sharpening filters, the image output unit is coupled to the first value and the third value and outputs at least one scaled image. 如申請專利範圍第4項所述的雙通道影像縮放系統,更包括有至少一暫存器,該至少一暫存器係分別連接該雙線性內插法通道以及該多數個銳化濾波器,且用以暫存該多數個梯度值。The dual-channel image scaling system described in item 4 of the scope of patent application, further includes at least one register, the at least one register is respectively connected to the bilinear interpolation method channel and the plurality of sharpening filters. And used to temporarily store the plurality of gradient values. 如申請專利範圍第4項所述的雙通道影像縮放系統,更包括用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器以及用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元;該顯示器係連接該影像輸出單元以擷取並顯示該至少一縮放影像;每一該至少一影像擷取單元係連接至該紋理分類電路以輸出該至少一影像至該紋理分類電路。The dual-channel image zoom system described in item 4 of the patent application scope further includes a display for at least one of driving records, highway monitoring, aerial recording, medical endoscopes, and driving records, highway monitoring. At least one image capturing unit of at least one of the aerial photography recorder and the medical endoscope; the display is connected to the image output unit to capture and display the at least one zoomed image; each of the at least one image capturing unit Is connected to the texture classification circuit to output the at least one image to the texture classification circuit. 一種雙通道影像縮放方法,包括下列步驟: 對至少一影像的多數個像素進行二階段運算而將部份該多數個像素的多數個梯度值儲存至一平滑部以及一邊緣部之其中一者;其中,包括下列步驟:透過一階導數運算以及二階導數運算之其中一者而擷取該多數個像素的該多數個梯度值;擷取對應於該多數個像素的該多數個梯度值,並分別將其與一最小可覺差值比較大小;當對應部分該多數個像素的部分該多數個梯度值小於該最小可覺差值時,則將部分該多數個梯度值儲存至該平滑部;當對應部分該多數個像素的部分該多數個梯度值大於該最小可覺差值時,則將部分該多數個梯度值儲存至該邊緣部; 擷取該至少一影像的該多數個梯度值,並輸出一第一數值以及一第二數值;其中,包括下列步驟:擷取儲存於該平滑部中的部分該多數個梯度值,並對部分該多數個梯度值進行最近相鄰內插法處理而輸出該第一數值;擷取儲存於該邊緣部的部分該多數個梯度值,並對部分該多數個梯度值進行雙線性內插法處理而輸出該第二數值; 擷取該第一數值以及該第二數值,並針對該第二數值進行至少二次的二次偏微分而產生一第三數值,其中,對應該多數個像素中的其中九個像素所形成的一方陣作為多數個銳化濾波器的其中之一,每一該多數個銳化濾波器分別使對應於該第二數值的該部分該多數個像素增強對比度,而產生該第三數值;以及 耦合該第一數值以及該第三數值而輸出至少一縮放影像。A two-channel image scaling method includes the following steps: performing a two-stage operation on a plurality of pixels of at least one image and storing a plurality of gradient values of a portion of the plurality of pixels to one of a smooth portion and an edge portion; The method includes the following steps: retrieving the plurality of gradient values of the plurality of pixels through one of a first derivative operation and a second derivative operation; acquiring the plurality of gradient values corresponding to the plurality of pixels, and respectively Compare it with a minimum perceptible difference value; when the portion of the majority gradient value corresponding to the portion of the plurality of pixels is smaller than the minimum perceptible difference value, store the portion of the majority gradient value to the smoothing portion; when When the portion of the plurality of pixels corresponding to the portion of the plurality of gradient values is greater than the minimum perceptible difference value, storing a portion of the plurality of gradient values to the edge portion; capturing the plurality of gradient values of the at least one image, and Outputting a first value and a second value; including the following steps: extracting a portion of the plurality of gradient values stored in the smoothing portion, and A plurality of gradient values are processed by nearest neighbor interpolation to output the first value; a portion of the plurality of gradient values stored in the edge portion is extracted, and a portion of the plurality of gradient values is processed by bilinear interpolation And outputting the second value; extracting the first value and the second value, and performing at least two second-order partial differentiations on the second value to generate a third value, where corresponding to the number of pixels A matrix formed by nine pixels is used as one of the plurality of sharpening filters, and each of the plurality of sharpening filters enhances the contrast of the part of the plurality of pixels corresponding to the second value, and generates The third value; and coupling the first value and the third value to output at least one zoomed image. 如申請專利範圍第7項所述的雙通道影像縮放方法,其中,更包括一步驟:透過至少一暫存器暫存該多數個梯度值。The dual-channel image scaling method described in item 7 of the scope of patent application, further comprising a step of temporarily storing the plurality of gradient values through at least one register. 如申請專利範圍第7項所述的雙通道影像縮放方法,更包括一步驟:藉由用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的一顯示器擷取並顯示該至少一除霧影像。The dual-channel image zooming method described in item 7 of the scope of patent application, further includes a step of: capturing and using a display for at least one of driving records, highway monitoring, aerial recording, and medical endoscopes. The at least one defogging image is displayed. 如申請專利範圍第7項所述的雙通道影像縮放方法,更包括一步驟:藉由用於行車記錄、公路監控、空拍記錄、醫療內視鏡之其中至少一者的至少一影像擷取單元輸出該至少一影像。The dual-channel image zooming method described in item 7 of the patent application scope further includes a step of acquiring at least one image from at least one of driving records, highway monitoring, aerial recordings, and medical endoscopes. The unit outputs the at least one image.
TW107111655A 2018-04-02 2018-04-02 Dual channel image zooming system and method thereof TWI673997B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107111655A TWI673997B (en) 2018-04-02 2018-04-02 Dual channel image zooming system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107111655A TWI673997B (en) 2018-04-02 2018-04-02 Dual channel image zooming system and method thereof

Publications (2)

Publication Number Publication Date
TWI673997B TWI673997B (en) 2019-10-01
TW201943269A true TW201943269A (en) 2019-11-01

Family

ID=69023684

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107111655A TWI673997B (en) 2018-04-02 2018-04-02 Dual channel image zooming system and method thereof

Country Status (1)

Country Link
TW (1) TWI673997B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI772043B (en) * 2021-05-31 2022-07-21 敦泰電子股份有限公司 Image resizing method with arbitrary magnification

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113852768A (en) * 2021-09-24 2021-12-28 中音讯谷科技有限公司 Audio and video image intelligent control system based on FPGA technology

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140355872A1 (en) * 2013-05-28 2014-12-04 Himax Imaging Limited Method for determining interpolating direction for color demosaicking
TWI543586B (en) * 2014-05-30 2016-07-21 國立交通大學 Method for image enhancement, and image processing apparatus and computer program product using the same
US20180018807A1 (en) * 2016-07-15 2018-01-18 Aspeed Technology Inc. Method and apparatus for generating panoramic image with texture mapping

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI772043B (en) * 2021-05-31 2022-07-21 敦泰電子股份有限公司 Image resizing method with arbitrary magnification

Also Published As

Publication number Publication date
TWI673997B (en) 2019-10-01

Similar Documents

Publication Publication Date Title
CN103428427B (en) Image size readjusts method and image size readjusts device
US9591237B2 (en) Automated generation of panning shots
TWI520598B (en) Image processing apparatus and image processing method
US9749541B2 (en) Method and apparatus for displaying and recording images using multiple image capturing devices integrated into a single mobile device
CN107851302A (en) Stable video
US8861846B2 (en) Image processing apparatus, image processing method, and program for performing superimposition on raw image or full color image
JP2009100373A (en) Noise reduction processing apparatus, noise reduction processing method, and electronic device
EP2573759A2 (en) Display apparatus and method
TW201445977A (en) Image processing method and image processing system
TWI673997B (en) Dual channel image zooming system and method thereof
Aides et al. Multiscale ultrawide foveated video extrapolation
TWI613904B (en) Stereo image generating method and electronic apparatus utilizing the method
JP6029294B2 (en) Video presentation apparatus and video presentation program
TWI703863B (en) Method for detecting video quality and image processing circuit thereof
US11202019B2 (en) Display control apparatus with image resizing and method for controlling the same
JP2010193154A (en) Image processor and method
CN115428009A (en) Content-based image processing
CN113228095A (en) Image processing method, display processing apparatus, and computer-readable storage medium
JP4936816B2 (en) Imaging apparatus and simultaneous display control method
CN110728631A (en) Image dynamic contrast enhancement method based on augmented reality and augmented reality glasses
TWI484816B (en) Passive 3d image system and image processing method thereof
JP5327199B2 (en) Image processing method and image processing apparatus
TWI493502B (en) Processing method for image rotating and apparatus thereof
JP7244661B2 (en) Imaging device and image processing method
CN112911262B (en) Video sequence processing method and electronic equipment