TW201032177A - Video image process device with function of preventing shake and the method thereof - Google Patents

Video image process device with function of preventing shake and the method thereof Download PDF

Info

Publication number
TW201032177A
TW201032177A TW98104899A TW98104899A TW201032177A TW 201032177 A TW201032177 A TW 201032177A TW 98104899 A TW98104899 A TW 98104899A TW 98104899 A TW98104899 A TW 98104899A TW 201032177 A TW201032177 A TW 201032177A
Authority
TW
Taiwan
Prior art keywords
frame
image
primary color
image processing
unit
Prior art date
Application number
TW98104899A
Other languages
Chinese (zh)
Other versions
TWI514321B (en
Inventor
Ming-Hui Peng
Han-Min Chang
Chih-Shih Yu
Original Assignee
Alpha Imaging Technology Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alpha Imaging Technology Corp filed Critical Alpha Imaging Technology Corp
Priority to TW098104899A priority Critical patent/TWI514321B/en
Publication of TW201032177A publication Critical patent/TW201032177A/en
Application granted granted Critical
Publication of TWI514321B publication Critical patent/TWI514321B/en

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The invention discloses a video image process device with function of preventing shake and the method thereof. The video image process device includes a sample unit, a motion estimation unit, a frame resolution storage unit, and an image process unit. The sample unit samples one-fundamental-color data from a Bayer pattern image. The motion estimation unit couples to the sample unit for comparing the one-fundamental-color data of two continuous frames to generate a motion vector. The frame resolution storage unit couples to the sample unit for storing the Bayer pattern image of a frame. The image process unit couples to the motion estimation unit and the frame resolution storage unit for correcting the Bayer pattern image according to the motion vector.

Description

201032177 六、發明說明: 【發明所屬之技術領域】 本發明係關於一種防手震之影像處理裝置,特別是 關於一種利用不同存取架構使得移動向量能直接對貝 • 爾圖樣影像做修正之影像處理裝置與方法。 • 【先前技術】 隨著手持式攝影裝置的普及,—般人在曰常生活中 〇 常常有機會使用這些裝置來紀錄影像,令人困擾的是一 般人並沒受過專業的攝影訓練,常常在需要較長時間的 拍攝時因為手的晃動造成拍攝影像的失焦、模糊,使得 所拍攝影像品質不佳。 習知技術中有許多方式來改善此現象,大致可分為 機械式補償以及電子式補償,後者大多是比較兩拍攝影 像間的差異或者是某塊特定影像區域與週遭背景的變 化來判斷兩影像間是不是有因手震而造成的晃動,其所 比較的對象是實際物體經感光元件擷取影像後經由影 O T處理元件處理過的影像,換句話說,其所比對的影像 是實際輸出至顯示器(例如LCD)之影像,或者說是已 - ’盈轉換成YUV域(YUV domain)之影像,此種影像資 料非常精確詳細,但是也因此而資料量非常龐大。 舉例來說,請參考第丨圖,第丨圖為習知技術之影 像處理裝置輸出端電路1〇〇的方塊圖,γυγ域影像信 號輸入輸出端電路1〇〇後會先儲存在影像緩衝器 4 201032177 中’影像緩衝器110再將信號傳送至輸出圖框缓衝器 120,以Full HD規格來說,一個輸出圖框的像素數目 是1920x1080 ’在實際應用時’輸出圖框緩衝器12〇的 揭取像素數目會稍大於實際的輸出圖框像素數目,以作 . 為读測到手震情形時補償移動向量之用,例如第1圖所 . 示,輸出圖框緩衝器120擷取的像素數目為(1920+64) X ( 1080+64),輸出圖框緩衝器12〇的虛線部份為實際 的輸出圖框121,而在實際的輸出圖框121周圍各取32 Φ 個像素作為補償移動向量之用。輸出圖框緩衝器120 接著將輸出圖框的影像資料傳送至輸出介面13〇,移動 判斷單元14〇亦將該圖框之移動向量資訊傳送至輸出 介面〗30,最後輸出介面13〇再將修正後之圖框畫面信 號輸出。 請參考第2a及2b圖,第2a圖為輸出圖框緩衝器 在未發生手震情形時之輸出圖框像素擷取範圍示 意圖,第2b圖為輸出圖框緩衝器12〇在發生 時之輪出圖框像素擷取範圍示意圖,若未發生手震情 i 形,攝影裝置鏡頭對準的畫面自然是所欲拍攝的晝面, 如第2a圖所不’輪出圖框像素掏取範圍位於輸出圖框 緩衝12G總像素範圍的巾央,若此時發生手震情形, '第21>圖所示,手震後整個攝影裝置鏡頭往右下方 f動因此輸出圖框緩衝器12〇接收到的圖框影像資料 疋攸原圖框影像往右下方移動,亦即從第2b圖虛線所 不之原輸出圖框緩衝11 120圖框範圍移至輸出圖框緩 5 201032177 衝器120’圖框範圍,此時若是仍擷取輪出圖框緩衝器 120’總像素範圍的中央,則會擷取到因手震而偏移的 畫面,事實上’正相梅取畫面仍應是手震前的輸出圖 框12卜因此移動判斷單元14〇偵測出因手震造成之移 • 動向量(dX、dY )後’會將輸出圖框從輸出圖框緩衝 器120’總像素範圍的中央往左上移動亦即修正 ^ (_dX、_dY),使得輸出圖框像素擷取範圍仍是手震前 之輸出圖框121,於是便抵銷了手震造成的影像晃動。 © 然而,輸出圖框緩衝器120所處理的圖框影像資料 疋以YUV域影像信號格式儲存,以Full HD規格來說, 一個圖框就須儲存(1920+64) x( 1080+64)個像素之 YUV域影像信號資料’再加上作移動向量補償時需 儲存前後數個連續難影像資料,所需的記憶體空間非 常大,造成成本及攝影裝置體積縮小時的限制。因此, 如何提供-種判斷手震以及補償該手震造成影響的影 像處理裝置使得所需處理的資料量減少,是本發明主要 的目的’所需處理的資料量愈少,處理的速度便愈快, 〇 所需的記憶體也愈少,對手持式攝影裝置的成本、尺寸 等都有正面助益。 【發明内容】 針對上述問題’本發明之目的在提供—種利用不同 =習知技術之影像存取架構使得移動向量能直接對貝 圖樣影像做修正之影像處理裝置與處理方法。 201032177 為達成上述目的,本發明揭露一種防手震影像處理 裝置,包含:一取樣單元,用來取樣一貝爾圖樣影像 (Bayer Pattern image)中一原色並將該原色轉換為_ 原色資料;一移動判斷單元,耦接於該取樣單元,用來 • 根據該原色資料比較前後圖框(Frame)並產生—移動向 a:,一圖框解析度(Resolution)儲存單元,耦接於該取 . 樣單元,用來儲存一圖框之該貝爾圖樣影像;以及—影 像處理單元,耦接於該圖框解析度儲存單元與該移動判 〇 斷單元,用來根據該移動向量修正該貝爾圖樣影像。 本發明另提出一種可防手震之影像處理方法包 含·取樣一貝爾圖樣影像中一原色並將該原色轉換為一 原色資料,根據該原色資料比較前後圖框並產生一移動 向量;比較前後兩圖框(frame)之該原色資料並產生— 移動向量;儲存一圖框之該貝爾圖樣影像;以及根據該 移動向量修正該貝爾圖樣影像。 藉由直接在影像處理流程前端的貝爾圖樣影像中 取樣三々色中的一種原色資料作為㈣連續兩圖框中 Ο 之影像是否移動的依據,移動判斷單元所需處理的資料 • 量大大減少,另外以另一記憶單元儲存連續兩圖框的貝 . 爾圖樣影像,利用移動向量直接修正貝爾圖樣影像後再 轉換成-般顯示裝置使用# Yuv域影像信冑,可省下 在yuv域執行移動向量修正影像所需的記憶體以㈣ HD規格來說,約可省下(192㈣4)χ(ι陳64)χ2個像 素的記憶空間。 7 201032177 【實施方式】 請參考第3圖,第3圖是本發明可防手震之影像處 理裝置300 —第一實施例方塊圖,本實施例包含有感測 單元310、取樣單元320、移動判斷單元33〇、圖框解 析度儲存單元340以及影像處理單元350,感測單元310 包含有CCD元件及濾光片等元件,擷取外界影像後形 成一貝爾圖樣影像(Bayer Pattern image ),亦即將搁取 到的外界影像分解成;6·干個像素,而每一像素包含有 紅、綠、藍(RGB )三種原色資料,此原色資料經取樣 單元320轉換後,其中一種原色被取樣並經〇&11111^轉 換過程成為一原色資料。請注意,原則上取樣紅、綠、 藍三種原色任一種皆可達到本發明之目的,但是由於肉 眼對綠色的感受最強烈,綠色的亮度對比分佈也最符合 實際上真實影像的亮度對比,因此以取樣綠色效果為最 佳,但實施範圍卻不以綠色為限。接下來,此像素與轉 換後綠原色亮度的對應資料會被傳送至移動判斷單元 330,移動判斷單元330會將前一個圖框的原色資料先 儲存下來,等到接收到下—個圖框的原色資料時,移動 判斷單元330 tb對這兩個連續_框巾相制像素的原 色資料以得出-移動向量,例如一圖框之某區塊中像素 的原色資料值皆與前一圖框該區塊左邊另一區塊中像 素的原色資料值相同,料推論在此:圖框取像時間中 攝影鏡頭向右晃動’此種移動向量的估算方式有很多 種,在此不再贅述,另外 乃卜取樣單70 320會將從感測單 8201032177 VI. Description of the Invention: [Technical Field] The present invention relates to an anti-shake image processing apparatus, and more particularly to an image using a different access architecture to enable a motion vector to directly correct a Bayer image. Processing device and method. • [Prior Art] With the popularity of handheld photographic devices, people often have the opportunity to use these devices to record images in their daily lives. It is disturbing that most people do not have professional photography training, often in need. When shooting for a long time, the image is out of focus and blurred due to the shaking of the hand, resulting in poor quality of the captured image. There are many ways to improve this phenomenon in the prior art, which can be roughly divided into mechanical compensation and electronic compensation. The latter mostly compares the difference between two captured images or the change of a specific image area and the surrounding background to judge the two images. Is there any sway caused by the shaking of the hand, and the object to be compared is the image processed by the actual object through the OT processing element after the image is captured by the photosensitive element, in other words, the image that is compared is the actual output. The image to the display (such as the LCD), or the image that has been converted into a YUV domain, is very accurate and detailed, but the amount of data is very large. For example, please refer to the second drawing. The figure is a block diagram of the output circuit of the image processing device of the prior art. The γυγ domain image signal input/output circuit 1 is first stored in the image buffer. 4 In 201032177, the 'image buffer 110 transmits the signal to the output frame buffer 120. In the Full HD specification, the number of pixels of one output frame is 1920x1080 'In actual application', the output frame buffer 12〇 The number of extracted pixels will be slightly larger than the actual number of output frame pixels, so as to compensate for the motion vector when reading the jitter condition, for example, as shown in FIG. 1, the pixel captured by the output frame buffer 120. The number is (1920+64) X (1080+64), the dotted line portion of the output frame buffer 12〇 is the actual output frame 121, and 32 Φ pixels are taken as compensation around the actual output frame 121. Use for moving vectors. The output frame buffer 120 then transmits the image data of the output frame to the output interface 13〇, and the movement determining unit 14〇 also transmits the motion vector information of the frame to the output interface 〖30, and finally the output interface 13〇 is corrected. The frame picture signal output is followed. Please refer to Figures 2a and 2b. Figure 2a is a schematic diagram of the output frame pixel extraction range when the output frame buffer is not in the case of jitter, and Figure 2b is the output frame buffer 12〇 when it occurs. The pixel capture range of the frame is taken out. If the hand-shake i-shape does not occur, the image of the lens of the camera is naturally the desired face. For example, the pixel capture range of the round-out frame is not shown in Figure 2a. The output frame buffers the center of the 12G total pixel range. If the jitter occurs at this time, the '21st> picture shows that the entire camera lens is moved to the lower right after the camera shake, so the output frame buffer 12 is received. The frame image data is moved to the lower right of the original frame image, that is, the original output frame buffer 11120 from the dotted line of the 2b figure is moved to the output frame buffer 5 201032177 Punch 120' frame Range, if the center of the total pixel range of the wheel buffer 120' is still captured, the picture shifted by the jitter will be captured. In fact, the picture of the positive phase should still be before the shock. The output frame 12 is thus detected by the movement judging unit 14 The movement caused by the jitter • After the motion vector (dX, dY), the output frame will move from the center of the total pixel range of the output frame buffer 120' to the upper left, that is, the correction ^ (_dX, _dY), so that the output frame The pixel capture range is still the output frame 121 before the jitter, thus offsetting the image shake caused by the jitter. © However, the frame image data processed by the output frame buffer 120 is stored in the YUV domain image signal format. In the Full HD format, one frame must be stored (1920+64) x (1080+64) The YUV-domain image signal data of the pixel is added to the number of consecutive difficult image data before and after the motion vector compensation. The required memory space is very large, which causes the cost and the limitation of the volume of the photographic device to be reduced. Therefore, how to provide an image processing device for judging the jitter and compensating for the impact of the jitter causes the amount of data to be processed to be reduced, which is the main object of the present invention. The less the amount of data to be processed, the faster the processing speed. Fast, the less memory you need, the positive impact on the cost and size of handheld cameras. SUMMARY OF THE INVENTION In view of the above problems, an object of the present invention is to provide an image processing apparatus and a processing method for directly correcting a Bayer image by using an image access architecture of different = conventional techniques. 201032177 In order to achieve the above object, the present invention discloses an anti-shake image processing apparatus, comprising: a sampling unit for sampling a primary color in a Bayer Pattern image and converting the primary color into _ primary color data; The determining unit is coupled to the sampling unit for: • comparing the front and rear frames according to the primary color data and generating a moving to a:, a resolution storage unit coupled to the sampling unit. The unit is configured to store the Bell pattern image of a frame; and the image processing unit is coupled to the frame resolution storage unit and the motion determination unit for modifying the Bell pattern image according to the motion vector. The invention further provides an anti-shake image processing method comprising: sampling a primary color in a Bell pattern image and converting the primary color into a primary color data, comparing the front and rear frames according to the primary color data and generating a motion vector; The primary color data of the frame generates a motion vector; stores the Bell pattern image of a frame; and corrects the Bell pattern image according to the motion vector. By sampling one of the three primary colors directly in the Bell pattern image at the front end of the image processing flow as the basis for (4) whether the image of the frame in the two consecutive frames is moved, the amount of data to be processed by the movement determining unit is greatly reduced. In addition, another memory unit stores the Bayer pattern image of two consecutive frames, and directly corrects the Bell pattern image by using the motion vector, and then converts it into a general display device using the #Yuv domain image signal, thereby saving movement in the yuv domain. The memory required for the vector correction image is (4) HD, which saves about 2 pixels of memory space (192(4)4)χ(ι陈64)χ. 7 201032177 [Embodiment] Please refer to FIG. 3, which is a block diagram of a first embodiment of the image processing apparatus 300 for preventing shaking in the present invention. The embodiment includes a sensing unit 310, a sampling unit 320, and a moving The determining unit 33, the frame resolution storage unit 340, and the image processing unit 350, the sensing unit 310 includes components such as a CCD component and a filter, and extracts an external image to form a Bayer Pattern image. The external image to be taken is decomposed into 6 pixels, and each pixel contains three primary color data of red, green, and blue (RGB). After the primary color data is converted by the sampling unit 320, one of the primary colors is sampled and The conversion process becomes a primary color data by the 〇&11111^ conversion process. Please note that in principle, sampling any of the three primary colors of red, green and blue can achieve the purpose of the present invention, but since the naked eye has the strongest feeling of green, the contrast distribution of green brightness is also in line with the brightness contrast of the actual image. The sampling green effect is the best, but the implementation range is not limited to green. Next, the corresponding data of the pixel and the converted green primary color brightness is transmitted to the movement determining unit 330, and the movement determining unit 330 stores the primary color data of the previous frame first, and waits until the primary color of the next frame is received. When the data is obtained, the movement determining unit 330 tb obtains a -shift vector for the primary color data of the two consecutive _frames, for example, the primary color data values of the pixels in a certain block of a frame are the same as the previous frame. The value of the primary color data of the pixels in the other block on the left side of the block is the same. It is inferred here: the photographic lens is swaying to the right during the frame taking time. There are many ways to estimate the motion vector. No further details are given here. Naibu sampling sheet 70 320 will be from the sensing list 8

201032177 元310接收到的該貝爾圖樣影像儲存在圖框解析度儲 存單元340,圖框解析度儲存單元34〇將—圖框之貝爾 圖樣影像傳送至影像處理單元35〇時移動判斷單元33〇 亦會將對應於該圖框之移動向量資料傳送至影像處理 早凡350’影像處理單元35〇利用移動向量值直接修正 遠貝爾圖樣影像’再將修正後的貝爾圖樣影像rgb域 信號轉換成YUV域之影像信號,以及作影像像素值放 大成後端顯示器所須之像素值、色彩調整、影像亮度、 對比度、色形飽和度等等的影像處理由於圖框的貝爾 圖樣影像RGB域信號㈣的像素資料數目遠小於同— 圖框轉換成YUV域影像信號後所需的像素資料數目, 因此本發明提出再將貝爾圖樣影像轉換成γυν域影像 信號前將移動向量偵測及補償的機制完成,其所需儲存 的資料量會遠小於習知對YUV域影像信號作移動向量 :測及補償所需之資料量’因此速度更快 容量也更小。 、瓶 ^參考第4圖,第4圖是本發明可防手震之影像處 4〇〇 —第二實施例方塊圖,其中感測單元3 1 〇、 :樣單元320及影像處理單元35()與第一實施例中的同 :兀件功能相同,不再贅述,移動判斷單元43()包 -個圖框緩衝器,圖框解析度儲存單元物則包含 個儲存單元’其實際操作情形為:取樣單元320將第— 貝爾圖樣影像資料存入圖框解析度儲存單元 樣成—储存單元442,同時將該貝㈣樣影像取 原色資料後將該原色資料存入移動判斷單元 9 201032177 430中的第一圖框緩衝器432 ;接著取樣單元32〇再將 一連續的第二圖框貝爾圖樣影像資料存入圖框解析度 儲存單元440中的第二儲存單元444,同時將該貝爾圖 樣影像取樣成一原色資料後將該原色資料存入移動判 斷單元430中的第二圖框緩衝器434;此時移動判斷單 元430根據第一圖框緩衝器432儲存的第—圖框原色資 料與第二圖框緩衝器434中儲存的第二圖框原色資料 作比對產生一第一移動向量;該第一移動向量與第—儲 存單元442儲存的第一圖框貝爾圖樣影像—起傳送至 影像處理單元350來修正第一圖框的手震現象,同時一 連績的第三圊框貝爾圖樣影像被取樣成一原色資料後 將該原色資料存入移動判斷單元430中的第三圖框緩 衝器436 ;移動判斷單元43〇根據第二圖框緩衝器々μ 儲存的第二圖框原色資料與第三圖框緩衝器436中儲 存的第二圖框原色資料作比對產生一第二移動向量該 第二移動向量與第二儲存單元444儲存的第二圖框貝 爾圖樣影像一起傳送至影像處理單元35〇來修正第二 圖框的手震現象,同時第三圖框貝爾圖樣影像資料存入 圖框解析度儲存單元440中的第一儲存單元442,第四 圖框貝爾圖樣影像被取樣成一原色資料後將該原色資 料存入移動判斷單元43〇中的第一圖框緩衝器434。如 此週而復始,用連續前後兩圖框的原色資料來修正前圖 框的貝爾圖樣影像資料’請注意,本實施例雖舉三個圖 框緩衝器與二個儲存單元為例,但實際應用_可依據本 發明原理視設計需要予以調整,仍屬本發明之揭露範 10 201032177 圍。 =考第5圖’第5圖是本發明可防手震之影像處 敗媒s 〇〇 —第三實施例方塊圖,丨中感測單元310、 勺^卓疋320 '圖框解析度儲存單元44Q以及其分別所 匕含之功能元件已於前述,移動判斷單元53〇除了包含 有上述—之圓框緩衝器組5 3 2外,另包含有一移動判斷器 移動向量產生器536以及一移動向量緩衝器 ,移動判斷器534比較儲存在圖框緩衝器組中之連 續圖框原色資料後產生比較值並輸入移動向量產生器 536/移動向量產生器536内含一移動向量表可由查 表得知不同比較值所對應的移動向量大小與方向,此初 始移動向量可經由影像穩定分析器調整並得出一圖框 之總合移動向量並輸入移動向量緩衝器538,最後,影 像處理單元550要輸出該圖框影像時會從移動向量缓 衝器5 3 8讀出該圖框之總和移動向量並藉此修正最後 輸出之影像,而影像處理單元55〇則包含有一影像信號 處理器55卜一縮放器(Scaler)552、一輸出緩衝器554、 輸出緩衝控制器553以及一輸出端電路555,圖框解 析度儲存單元440將儲存圖框之貝爾圓樣資料輸入至 影像處理單元550後影像信號處理器5 5丨會將此貝爾圖 樣影像轉換成一般顯示裝置能辨識的YUV域影像信 號’一般來說’ YUV域影像信號的資料量會遠大於貝 爾圖樣影像,而影像信號處理器5 5丨也另外會執行—些 與色彩、飽和度、對比度等影像效果,為了滿足不同解 析度的需求,影像信號處理器551將yuv域影像信號 201032177 輸入縮放器552,縮放器552會利用諸如内插法等將影 像解析度調整至適當大小,並根據移動向量的指示適當 擷取某一區域範圍像素作為輸出圖框,以補償手震造成 的畫面偏移·>處理好的影像圖框信號不會直接輸出而 會先儲存在輸出緩衝器554,輸出緩衝器554由輸出緩 衝控制器553控制,當緩衝控制器553控制輸出緩衝器 554輸出一影像圖框信號至輸出端電路555後,影像信 號便經由輸出端電@ 555輸出至顯示裝置或其他多‘ 體處理裝置。 、 准以上所述者,僅為本發明之較佳實施例而已當 不能以此限定本發明實施之範圍,即依本發明申請專: 範圍及發明說明内容所作之等效變化與修飾, 明專利可能涵蓋之範圍。 $ 【圖式簡單說明】 第 圖為習知技術之影像處理裝 方塊圖。 置輸出端電路的The image of the Bell pattern received by the 2010310177 element 310 is stored in the frame resolution storage unit 340, and the frame resolution storage unit 34 transmits the Bell pattern image of the frame to the image processing unit 35, and the movement determination unit 33 The motion vector data corresponding to the frame is transmitted to the image processing, and the 350' image processing unit 35 directly corrects the far-bel pattern image by using the motion vector value, and then converts the corrected Bell pattern image rgb domain signal into the YUV domain. The image signal, and the image processing required to enlarge the pixel value of the image into the pixel value, color adjustment, image brightness, contrast, color saturation, etc. of the back-end display, due to the pixel of the RGB domain signal (4) of the Bell pattern image of the frame The number of data is much smaller than the number of pixel data required after the image frame is converted into the YUV domain image signal. Therefore, the present invention proposes to complete the motion vector detection and compensation mechanism before converting the Bell pattern image into the γυν domain image signal. The amount of data to be stored will be much smaller than that of the conventional YUV domain image signal: the data needed for measurement and compensation. The quantity 'is therefore faster and the capacity is smaller. Referring to FIG. 4, FIG. 4 is a block diagram of a second embodiment of the image-preventing image of the present invention, wherein the sensing unit 3 1 〇, the sample unit 320, and the image processing unit 35 ( The same as in the first embodiment: the function of the element is the same, no further description, the movement determination unit 43 () package - a frame buffer, the frame resolution storage unit contains a storage unit 'the actual operation situation For example, the sampling unit 320 stores the first-Bell pattern image data into the frame resolution storage unit sample-storage unit 442, and simultaneously stores the primary color data in the shell-like image to the movement determination unit 9 201032177 430 The first frame buffer 432; then the sampling unit 32 存 stores a continuous second frame of the Bell pattern image data in the second storage unit 444 in the frame resolution storage unit 440, and simultaneously the Bell pattern After the image is sampled into a primary color data, the primary color data is stored in the second frame buffer 434 in the movement determining unit 430; at this time, the movement determining unit 430 is configured according to the first frame primary color data stored in the first frame buffer 432. Two pictures The second frame primary color data stored in the buffer 434 is compared to generate a first motion vector; the first motion vector is transmitted to the image processing unit 350 along with the first frame Bell pattern image stored by the first storage unit 442. To correct the hand shake phenomenon of the first frame, and at the same time, the third frame of the Bell pattern image is sampled into a primary color data and then stored in the third frame buffer 436 in the movement determining unit 430; The unit 43 比 generates a second motion vector according to the second frame primary color data stored in the second frame buffer 々μ and the second frame primary color data stored in the third frame buffer 436. The vector is transmitted to the image processing unit 35 together with the second frame Bell pattern image stored by the second storage unit 444 to correct the jitter phenomenon of the second frame, and the image data of the third frame of the Bell pattern is stored in the frame resolution. The first storage unit 442 in the storage unit 440, the fourth frame of the Bell pattern image is sampled into a primary color data, and the primary color data is stored in the first frame of the movement determining unit 43〇. 434. In this way, the original color data of the front and back frames are used to correct the Bell pattern image data of the front frame. Please note that although the three frame buffers and two storage units are taken as an example in this embodiment, the actual application may be The design needs to be adjusted in accordance with the principles of the present invention and remains within the scope of the disclosure of the present invention. = Test Figure 5 'Fig. 5 is a block diagram of the third embodiment of the anti-shock image of the present invention. The sensing unit 310, the scooping unit 320' frame resolution storage The unit 44Q and its respective functional elements are included in the foregoing, and the movement judging unit 53 includes a movement controller vector 536 and a movement in addition to the above-mentioned round frame buffer group 523. The vector buffer, the motion determiner 534 compares the continuous frame primary color data stored in the frame buffer group to generate a comparison value and inputs the motion vector generator 536/the motion vector generator 536 to include a motion vector table. Knowing the magnitude and direction of the motion vector corresponding to the different comparison values, the initial motion vector can be adjusted by the image stabilization analyzer and the combined motion vector of a frame is input and input into the motion vector buffer 538. Finally, the image processing unit 550 When the frame image is output, the sum vector movement vector of the frame is read from the motion vector buffer 538 and the final output image is corrected, and the image processing unit 55 includes one Like the signal processor 55, a scaler 552, an output buffer 554, an output buffer controller 553, and an output circuit 555, the frame resolution storage unit 440 inputs the Bell circle data of the storage frame to After the image processing unit 550, the image signal processor 5 5 converts the Bell pattern image into a YUV domain image signal that can be recognized by a general display device. [Generally, the amount of data of the YUV domain image signal is much larger than that of the Bell pattern image. The image signal processor 5 5 另外 also performs some image effects such as color, saturation, contrast, etc. In order to meet the needs of different resolutions, the image signal processor 551 inputs the yuv domain image signal 201032177 into the scaler 552, the scaler 552 will adjust the image resolution to an appropriate size by using interpolation, etc., and appropriately capture a certain range of pixels as an output frame according to the indication of the motion vector to compensate for the screen offset caused by the jitter [> The image frame signal is not directly output but is first stored in the output buffer 554, and the output buffer 554 is controlled by the output buffer controller 553. , When the buffer controller 553 controls the output buffer 554 outputs an image frame signal to the output of the circuit 555, the video signal will be output via an output terminal 555 to the device or other multiple @ 'display processing apparatus. The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, that is, according to the scope of the invention and the equivalent changes and modifications of the invention, the patent The range that may be covered. $ [Simple description of the diagram] The figure is a block diagram of the image processing equipment of the prior art. Output circuit

輸出 出圖 第2a圖為輸出圖框緩衝器在未發 圖框像素擷取範圍示意圖 月形時 第2b圖為輸出圖框緩衝器在發生 框像素擷取範圍示意圖 月/時之 實施^塊Γ本發明可时震之影像處理裝置-第 第4圖為本發明可防手震 實施例方塊圖。 之影像處理裝置— 第二 12 201032177 第5圖為本發明可防手震之影像處理裝置一第三 實施例方塊圖。 【主要元件符號說明】 100輸出端電路 110影像緩衝器 120、120’ 輸出圖框緩衝器 121輸出圖框 130輸出介面 140移動判斷單元 300、400、500影像處理裝置 3 1 0感測單元 320取樣單元 330、430、530移動判斷單元 340、440圖框解析度儲存單元 350、550影像處理單元 432、434、436圖框緩衝器 442、444儲存單元 532圖框緩衝器組 534移動判斷器 536移動向量產生器 538移動向量緩衝器 551影像信號處理器 552縮放器 13 201032177 5 5 3輸出緩衝控制器 554輸出緩衝器 555輸出端電路The output picture 2a is the output frame buffer in the unsent frame pixel capture range schematic form month 2b is the output frame buffer in the frame pixel capture range schematic month / hour implementation ^ block The image processing apparatus of the present invention is a block diagram of an anti-shake embodiment of the present invention. Image Processing Apparatus - Second 12 201032177 FIG. 5 is a block diagram showing a third embodiment of an image processing apparatus capable of preventing shaking in the present invention. [Description of main component symbols] 100 output circuit 110 image buffer 120, 120' output frame buffer 121 output frame 130 output interface 140 movement determination unit 300, 400, 500 image processing device 3 1 sensing unit 320 sampling Units 330, 430, 530 movement determination unit 340, 440 frame resolution storage unit 350, 550 image processing unit 432, 434, 436 frame buffer 442, 444 storage unit 532 frame buffer group 534 movement determiner 536 movement Vector generator 538 motion vector buffer 551 image signal processor 552 scaler 13 201032177 5 5 3 output buffer controller 554 output buffer 555 output circuit

1414

Claims (1)

201032177 七、申請專利範圍: 1.一種可防手震之影像處理裝置,包含有: 一取樣早元’用來取樣一貝爾圖樣影像(Bayer Pattern image) 中一原色並將該原色轉換為一原色資料; 一移動判斷單元’耦接於該取樣單元,用來根據該原色資料比 較前後圖框(Frame)並產生一移動向量; 一圖框解析度(Resolution)儲存單元,_接於該取樣單元,用 來儲存一圖框之該貝爾圖樣影像;以及 一影像處理單元,耦接於該圖框解析度儲存單元與該移動判斷 單元,用來根據該移動向量修正該貝爾圖樣影像。 2.如申睛專利範圍第丨項所述之可防手震之影像處理裝 置,另包含有-感測單元,絲產生—貝_樣影像。201032177 VII. Patent application scope: 1. An anti-shake image processing device, comprising: a sampling early element 'for sampling a primary color in a Bayer Pattern image and converting the primary color into a primary color Data is coupled to the sampling unit for comparing the front and rear frames according to the primary color data and generating a motion vector; a resolution storage unit, _ connected to the sampling unit And the image processing unit is coupled to the frame resolution storage unit and the movement determining unit for modifying the Bell pattern image according to the motion vector. 2. The anti-shake image processing device according to the scope of the patent application scope, further comprising a sensing unit, the wire generating - shell image. 3·如申請專利範圍第1項所述之可防手震之影像處理裝 置,其中該取樣單元包含有—轉換單it,絲 Gamma轉 換將該貝爾圖樣中該原色轉換為1色資料。 專利㈣第1項所述 &lt;可时震之影像處理裝 置,其中該移動判斷單元包含有: 一組圖框緩衝器,用來傲.*也如 ^ . 冑存複數個圖樞之該原色資料; , 接於3亥組圖樞緩衝器,用來比較該組圖 框緩衝中一篦—面一々 SU匡與一第二圖框之該原色資料,並產 15 201032177 生該移動向量。 == 項所述之可防手震之影像處理裝 置,儲存單以㈣存—第一圖框之一預設解 析度一預留空間像素數目與-第二圖框之-預 設解析度像素數目加上-職空間像素數目之像素資料。3. The image processing apparatus according to claim 1, wherein the sampling unit includes a conversion unit it, and the silk Gamma conversion converts the primary color in the bell pattern into one color data. The fourth aspect of the invention, wherein the movement judging unit comprises: a set of frame buffers for abundance. *also as ^. storing the plurality of maps of the primary color Data; , connected to the 3H group diagram buffer, used to compare the primary color data of one frame, the surface of the group, and the second frame of the frame buffer, and the production of the movement vector by 15 201032177. == The anti-shock image processing device described in the item, the storage list is (4) stored - the first frame is one of the preset resolution - the number of reserved space pixels and the second frame - the preset resolution pixel The number plus the pixel data of the number of pixels in the job space. 6.1 申請專利第4、5項所述之可防手震之影像處理 裝置’其中該影像處理單元係根據該移動向量修正該第一圖框 之該貝爾圖樣。 7.如申明專利!a圍第4、5項所述之可防手震之影像處理 裝置其中該組圖框緩衝器以及該圖框解析度儲存單元係為暫 存器。 8.如申明專利範圍第丨項所述之可防手震之影像處理裝 置,其中該影像處理單元包含有: 〇 &quot;影像信號處理11 ’用來將該貝關樣影像轉換成YUV域之 * 一影像信號; - 一縮放器(Scaler),耦接於該影像信號處理器,用來將該影像 心號轉換成所需之像素比例及根據該修正向量擷取該圖框 中適當之像素區域,並輸出一影像圖框信號;以及 一輸出介面控制器’耦接於該縮放器,用來輸出該影像圖框信 號。 16 201032177 9. 一種可防手震之影像處理方法,包含有: 取樣一貝爾圖樣影像(Bayer Pattern image)中一原色並將該原 色轉換為一原色資料; 根據該原色資料比較前後圖框(Frame)並產生一移動向量; 儲存一圖框之該貝爾圖樣影像;以及 根據該移動向量修正該貝爾圖樣影像。 10. 如申請專利範圍第9項所述之可防手震之影像處理 方法,另包含有: 產生一貝爾圖樣影像。 11. 如申請專利範圍第9項所述之可防手震之影像處理 方法,另包含有: 利用Gamma轉換將該貝爾圖樣中該原色轉換為一原色資料。 12. 如申請專利範圍第9項所述之可防手震之影像處理 方法,另包含有: 儲存複數個圖框之該原色資料;以及 比較一第一圖框與一第二圖框之該原色資料,並產生該移動向 量。 13. 如申請專利範圍第9項所述之可防手震之影像處理 方法,其中儲存一圖框之該貝爾圖樣影像之步驟係儲存一第一 17 201032177 圖框與之一預設解析度像素數目加上一預留空間像素數目與 一第二圖框之一預設解析度像素數目加上該預留空間像素數 目之像素資料。 14.如申請專利範圍第12、13項所述之可防手震之影像 處理方法,其係根據該移動向量修正該第一圖框之該貝爾圖 樣。6.1 The anti-shake image processing apparatus described in claim 4, wherein the image processing unit corrects the Bell pattern of the first frame according to the motion vector. 7. If you declare a patent! An image processing apparatus capable of preventing jitter in the items 4 and 5, wherein the set of frame buffers and the frame resolution storage unit are registers. 8. The anti-shake image processing apparatus according to claim </ RTI> wherein the image processing unit comprises: 〇&quot; image signal processing 11' for converting the image of the shell-like image into a YUV domain. * an image signal; - a scaler coupled to the image signal processor for converting the image heart number to a desired pixel ratio and extracting appropriate pixels in the frame based on the correction vector And outputting an image frame signal; and an output interface controller coupled to the scaler for outputting the image frame signal. 16 201032177 9. An anti-shake image processing method, comprising: sampling a primary color in a Bayer Pattern image and converting the primary color into a primary color data; comparing the front and rear frames according to the primary color data (Frame And generating a motion vector; storing the Bell pattern image of a frame; and modifying the Bell pattern image according to the motion vector. 10. The anti-shake image processing method described in claim 9 of the patent application, further comprising: generating a Bell pattern image. 11. The image processing method of the anti-shake method according to claim 9 of the patent application, further comprising: converting the primary color in the Bell pattern into a primary color data by using a Gamma conversion. 12. The anti-shake image processing method of claim 9, further comprising: storing the primary color data of the plurality of frames; and comparing the first frame with the second frame Primary color data and generate the motion vector. 13. The anti-shake image processing method according to claim 9, wherein the step of storing the image of the Bell pattern of the frame stores a first 17 201032177 frame and a preset resolution pixel. The number plus a reserved space pixel number and a second frame one of the preset resolution pixel numbers plus the pixel number of the reserved space pixel data. 14. The anti-shake image processing method of claim 12, wherein the Bell pattern of the first frame is corrected according to the motion vector. 15. 如申請專利範圍第9項所述之可防手震之影像處理 方法,另包含有: 將該貝爾圖樣影像轉換成YUV域之一影像信號; 將該影像信號轉換成所需之像素比例及根據該修正向量擷取 該圖框中適當之像素區域,並輸出一影像圖框信號15. The image processing method of the anti-shake method according to claim 9 of the patent application, further comprising: converting the Bell pattern image into one image signal of the YUV domain; converting the image signal into a desired pixel ratio And extracting an appropriate pixel area in the frame according to the correction vector, and outputting an image frame signal 1818
TW098104899A 2009-02-17 2009-02-17 Video image process device with function of preventing shake and the method thereof TWI514321B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW098104899A TWI514321B (en) 2009-02-17 2009-02-17 Video image process device with function of preventing shake and the method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW098104899A TWI514321B (en) 2009-02-17 2009-02-17 Video image process device with function of preventing shake and the method thereof

Publications (2)

Publication Number Publication Date
TW201032177A true TW201032177A (en) 2010-09-01
TWI514321B TWI514321B (en) 2015-12-21

Family

ID=44854810

Family Applications (1)

Application Number Title Priority Date Filing Date
TW098104899A TWI514321B (en) 2009-02-17 2009-02-17 Video image process device with function of preventing shake and the method thereof

Country Status (1)

Country Link
TW (1) TWI514321B (en)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1377040A1 (en) * 2002-06-19 2004-01-02 STMicroelectronics S.r.l. Method of stabilizing an image sequence
TW200729938A (en) * 2006-01-27 2007-08-01 Liteo On It Corp Digital image capture device and method of anti-shake

Also Published As

Publication number Publication date
TWI514321B (en) 2015-12-21

Similar Documents

Publication Publication Date Title
WO2020038069A1 (en) Exposure control method and device, and electronic apparatus
US9066013B2 (en) Content-adaptive image resizing method and related apparatus thereof
WO2020038072A1 (en) Exposure control method and device, and electronic device
US7826730B2 (en) Image capturing device having a hand shake correction function, hand shake correction method, and storage medium storing a hand shake correction process program
KR101661574B1 (en) Camera module for reducing sutter-delay
US20090316022A1 (en) Image resizing device and image resizing method
JP5950678B2 (en) Imaging apparatus, control method, and program
US20120307102A1 (en) Video creation device, video creation method and non-transitory computer-readable storage medium
EP2219366B1 (en) Image capturing device, image capturing method, and image capturing program
US20100073546A1 (en) Image Processing Device And Electric Apparatus
US20080212888A1 (en) Frame Region Filters
JP2008109336A (en) Image processor and imaging apparatus
JP2013074313A (en) Image processing device, image processing method, and program
CN110290325A (en) Image processing method, device, storage medium and electronic equipment
TWI520604B (en) Image pickup device and image preview system and image preview method thereof
JP6541501B2 (en) IMAGE PROCESSING APPARATUS, IMAGING APPARATUS, AND IMAGE PROCESSING METHOD
JP4953770B2 (en) Imaging device
US20130162863A1 (en) Imaging apparatus and evaluation value generation apparatus
US8908060B2 (en) Imaging apparatus generating evaluation values at a high frame rate and having a live view function of displaying a video smoothly at a low frame rate
JP5950755B2 (en) Image processing apparatus, control method, program, and storage medium
JP2009027223A (en) Image display device, image display method, and program
JP2020071354A (en) Projection system and projection method
US11206344B2 (en) Image pickup apparatus and storage medium
JP2015023514A (en) Information processing apparatus, imaging apparatus, control method and program
TW201032177A (en) Video image process device with function of preventing shake and the method thereof