TWI493963B - Image generating device and image adjusting method - Google Patents

Image generating device and image adjusting method Download PDF

Info

Publication number
TWI493963B
TWI493963B TW100139720A TW100139720A TWI493963B TW I493963 B TWI493963 B TW I493963B TW 100139720 A TW100139720 A TW 100139720A TW 100139720 A TW100139720 A TW 100139720A TW I493963 B TWI493963 B TW I493963B
Authority
TW
Taiwan
Prior art keywords
image
depth
groups
depth image
generate
Prior art date
Application number
TW100139720A
Other languages
Chinese (zh)
Other versions
TW201320715A (en
Inventor
Chueh Pin Ko
Original Assignee
Acer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Acer Inc filed Critical Acer Inc
Priority to TW100139720A priority Critical patent/TWI493963B/en
Priority to EP12190427.0A priority patent/EP2590417A1/en
Priority to US13/664,453 priority patent/US20130106845A1/en
Publication of TW201320715A publication Critical patent/TW201320715A/en
Application granted granted Critical
Publication of TWI493963B publication Critical patent/TWI493963B/en

Links

Description

影像產生裝置及影像調整方法Image generating device and image adjusting method

本發明係屬於影像處理,特別是將深度影像群組化以及自動調整立體影像以增進視覺效果之系統及方法。The present invention relates to image processing, and more particularly to systems and methods for grouping depth images and automatically adjusting stereo images to enhance visual effects.

隨著立體顯示器的發展,立體影像之處理亦愈來愈重要。一般而言,立體影像之取得可藉由幾種方式,例如利用可得到深度資訊的深度攝影機進行拍攝、由模擬人類雙眼視覺之雙攝影機進行拍攝、或是由二維影像經過適當的影像處理以得到立體影像。如第1A圖所示,由二維影像轉換至立體影像的處理過程可約略分為幾個步驟:影像縮小、邊緣偵測(edge detection)、線劃追蹤(line tracing)、深度指派(depth assignment)、深度影像放大及平滑化、橫向偏移(lateral shifting),當深度影像建立之後,即可與原本之二維影像結合以產生立體影像(stereoscopic image)。傳統由二維影像轉換為立體影像之演算法亦可透過建立空間模型、邊緣偵測、計算消失點等方式,透過對一張或多張影像的分析來建立深度影像。With the development of stereoscopic displays, the processing of stereoscopic images is becoming more and more important. In general, stereo image acquisition can be performed in several ways, such as by using a depth camera that can obtain depth information, by a dual camera that simulates human binocular vision, or by appropriate image processing from a two-dimensional image. To get a stereo image. As shown in FIG. 1A, the process of converting from a two-dimensional image to a stereo image can be roughly divided into several steps: image reduction, edge detection, line tracing, and depth assignment. ), depth image enlargement and smoothing, lateral shifting, when the depth image is created, can be combined with the original two-dimensional image to produce a stereoscopic image. The traditional algorithm for converting two-dimensional images into stereoscopic images can also establish depth images by analyzing spatial images, edge detection, and calculating vanishing points by analyzing one or more images.

如第1B圖所示,視覺深度感知因素可分為生理因素及心理因素。一般而言,二維影像轉換為立體影像之深度圖往往係針對幾項心理因素以進行演算法之運算,。舉例來說,在心理因素上往往會認為黃色物體、移動量大的物體或大物體之景深最淺,反過來說,在心理因素上亦會認為藍色物體、移動量小的物體或小物體之景深最深,而且材質接近會視為景深相同。As shown in Figure 1B, visual depth perception factors can be divided into physiological factors and psychological factors. In general, the depth map of a two-dimensional image converted into a stereo image is often calculated for several psychological factors. For example, psychological factors tend to think that yellow objects, large moving objects, or large objects have the shallowest depth of field. Conversely, blue objects, small moving objects, or small objects are also considered psychological factors. The depth of field is the deepest, and the material is close to being considered the same depth of field.

更進一步,景深資訊係為立體影像顯示技術中的關鍵,然而當深度圖產生之後,僅能定義出影像中之各物體的相對關係,但傳統立體影像顯示技術往往只著重於如何產生正確景深的產生方式,但卻鮮少利用景深資訊以進一步處理立體影像。Furthermore, depth of field information is the key to stereoscopic image display technology. However, when the depth map is generated, only the relative relationship of each object in the image can be defined. However, traditional stereoscopic image display technology tends to focus only on how to produce correct depth of field. The way it is produced, but the depth of field information is rarely used to further process stereoscopic images.

本發明係提供一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;以及對該第一深度影像中之各群組套用對應的的一深度參數,以據以產生一第二深度影像;以及依據第一影像及第二深度影像,產生一輸出影像。The present invention provides an image adjustment method, including: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; and grouping the first depth image Applying a corresponding depth parameter to generate a second depth image; and generating an output image according to the first image and the second depth image.

本發明更提供一種影像產生裝置,包括:一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分第一深度影像為至少二個群組;一影像調整器,用以對第一深度影像中之各群組分別套用對應的一深度參數,以產生一第二深度影像;以及一立體影像繪製器,用以依據第一影像及第二深度影像,產生一輸出影像。The present invention further provides an image generating device, comprising: an image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups; an image adjuster, The method includes: applying a corresponding depth parameter to each group in the first depth image to generate a second depth image; and a stereo image viewer for generating an output according to the first image and the second depth image. image.

本發明更提供一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;依據該第一深度影像之該等群組,將該第一影像對應地劃分為該等群組;對該第一影像中之該等群組套用的一影像參數,以產生一第二影像;以及依據該第二影像以產生一輸出影像。The present invention further provides an image adjustment method, including: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; according to the groups of the first depth image, The first image is correspondingly divided into the groups; an image parameter applied to the groups in the first image to generate a second image; and an output image is generated according to the second image.

本發明更提供一種影像產生裝置,包括:一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分該第一深度影像為至少二個群組,其中該影像分類器係依據該第一深度影像之該等群組,將該第一影像對應地劃分為該等群組;一影像調整器,用以對該第一影像中之該等群組分別套用對應的一影像調整參數,以產生一第二影像;以及一立體影像繪製器,依據該第二影像以產生一輸出影像。The present invention further provides an image generating device, comprising: an image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups, wherein the image classification The first image is correspondingly divided into the groups according to the groups of the first depth image; an image adjuster is configured to apply corresponding groups to the groups in the first image respectively. An image adjustment parameter to generate a second image; and a stereo image renderer to generate an output image according to the second image.

本發明更提供一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;接收一外部控制信號,其中該外部控制信號係表示一使用者與一顯示裝置的一相對位置;當該相對位置改變時,對該第一深度影像中之各群組分別套用一深度參數,以產生一第二深度影像;以及依據該第一影像及該第二深度影像,產生一輸出影像。The present invention further provides an image adjustment method, including: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; receiving an external control signal, wherein the external control signal is Determining a relative position of a user and a display device; when the relative position is changed, applying a depth parameter to each group in the first depth image to generate a second depth image; and according to the first The image and the second depth image generate an output image.

本發明更提供一種影像產生裝置,包括:一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分該第一深度影像為至少二個群組;一影像調整器,用以接收一外部控制信號,其中該外部控制信號係表示一使用者與一顯示裝置的一相對位置,其中當該相對位置改變時,該影像調整器對應地將該第一深度影像中之各群組套用一深度參數,以產生一第二深度影像;以及一立體影像繪製器,用以依據該第一影像及該第二深度影像,產生一輸出影像。The present invention further provides an image generating device, comprising: an image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups; an image adjuster For receiving an external control signal, wherein the external control signal indicates a relative position of a user and a display device, wherein when the relative position is changed, the image adjuster correspondingly displays the first depth image Each of the groups applies a depth parameter to generate a second depth image; and a stereo image viewer is configured to generate an output image according to the first image and the second depth image.

第2圖係顯示依據本發明一實施例之影像產生裝置200。影像產生裝置200更包括一深度分析器210及一立體影像繪製器220。深度分析器210係接收輸入影像(可為純二維影像或立體影像),並依據輸入影像產生一二維影像及對應的深度影像。立體影像繪製器220係接收由深度分析器210所產生的二維影像及對應的深度影像,以產生對應的立體影像。在一實施例中,影像產生裝置200更包括一深度分類器230及一影像調整器240,深度分類器230係依據深度影像中之影像特徵,將深度影像之影像內容劃分為複數個組別(或區域),其中各組別之內容包括分類組數,以及各組號對應的像素(或是各像素所對應的組數),影像調整器240並透過一判斷機制或接收一外部控制信號取得分類組數、深度參數以及影像參數。在立體影像繪製器220繪製立體影像前,影像調整器240依據所取得的深度參數及影像參數,分別對深度影像或二維影像進行調整,使得立體影像繪製器220所繪製出的立體影像具有不同變化。Figure 2 is a diagram showing an image generating apparatus 200 in accordance with an embodiment of the present invention. The image generating device 200 further includes a depth analyzer 210 and a stereo image viewer 220. The depth analyzer 210 receives an input image (which may be a pure two-dimensional image or a stereo image), and generates a two-dimensional image and a corresponding depth image according to the input image. The stereo image viewer 220 receives the two-dimensional image generated by the depth analyzer 210 and the corresponding depth image to generate a corresponding stereo image. In an embodiment, the image generating device 200 further includes a depth classifier 230 and an image adjuster 240. The depth classifier 230 divides the image content of the depth image into a plurality of groups according to image features in the depth image ( Or area), wherein the content of each group includes the number of classification groups, and the pixels corresponding to each group number (or the number of groups corresponding to each pixel), and the image adjuster 240 obtains through a judgment mechanism or receives an external control signal. The number of classification groups, depth parameters, and image parameters. Before the stereo image viewer 220 draws the stereo image, the image adjuster 240 adjusts the depth image or the two-dimensional image according to the obtained depth parameter and the image parameter, so that the stereo image drawn by the stereo image renderer 220 has different Variety.

在另一實施例中,深度分類器230具有三種方式將深度影像之影像內容劃分為複數個群組。第一種劃分方式為區域式,意即在深度影像中以二維空間直接劃分。舉例來說,若影像之大小為1920x1080,深度影像之群組劃分可為上方1/4、中間1/2、下方1/4共三個群組(如第3A圖之深度影像320),或是在深度影像的中間劃分出一寬度為800且高度為500的一區域,其餘部分為另一區(如第3A圖之深度影像300),亦或是依據一預定區域位置對深度影像進行劃分(如第3A圖中之深度影像310),但本發明不限於此。第二種劃分方式為深度式,意即對深度影像進行分析,抓取出特定灰階值所對應的群組。舉例來說,深度影像係為一灰階影像,在一實施例中,深度分類器230可擷取深度影像中之灰階值介於180至255的區域,並將其標示為一區域,深度影像之其他部分則另成一區域,第3B圖中之深度影像330、340及350係顯示不同灰階值範圍所對應的劃分區域,但本發明不限於此。In another embodiment, the depth classifier 230 has three ways to divide the image content of the depth image into a plurality of groups. The first type of division is regional, meaning that it is directly divided into two dimensions in the depth image. For example, if the size of the image is 1920×1080, the grouping of the depth image may be three groups of the upper 1/4, the middle 1/2, and the lower 1/4 (such as the depth image 320 of FIG. 3A), or In the middle of the depth image, a region having a width of 800 and a height of 500 is divided, and the remaining portion is another region (such as the depth image 300 of FIG. 3A), or the depth image is divided according to a predetermined region position. (The depth image 310 in Fig. 3A), but the invention is not limited thereto. The second division method is depth type, which means that the depth image is analyzed, and the group corresponding to the specific grayscale value is captured. For example, the depth image is a grayscale image. In an embodiment, the depth classifier 230 can capture an area of the depth image with a grayscale value between 180 and 255, and mark it as a region, depth. The other portions of the image are further divided into regions. The depth images 330, 340, and 350 in FIG. 3B display divided regions corresponding to different grayscale value ranges, but the present invention is not limited thereto.

第三種劃分方式為物件式,意即深度分類器230偵測深度影像中之全域的景深內容,並透過前景偵測(foreground detection)以劃分出前景物件及背景物件,亦或是結合前後二維影像所對應的複數張深度影像,偵測出灰階範圍相同之區域的移動,以分析出動態物件或重複物件,例如動態大的物件、動態小的物件及不動的物件。舉例來說,如第3C圖所示,深度分類器230可依據動態將不同的物件劃分為不同群組,在深度影像360、370及380中,人物、車子、地面可分別為前景物件。如第3D圖所示,物件A在深度影像中係遮住物件B及物件C,深度分類器230可由此相對關係得知物件A係為前景物件。物件之辨識方式可參考影像處理之相關技術,本發明僅採用遮擋辨識及動態程度辨識之方法為例,但本發明不限於此。The third type of division is the object type, that is, the depth classifier 230 detects the depth of field content in the depth image, and uses foreground detection to divide the foreground object and the background object, or combine the front and rear objects. The plurality of depth images corresponding to the dimensional image detect the movement of the area with the same gray range to analyze the dynamic object or the repeated object, such as a dynamic large object, a dynamic small object, and a stationary object. For example, as shown in FIG. 3C, the depth classifier 230 may divide different objects into different groups according to dynamics. In the depth images 360, 370, and 380, the characters, the car, and the ground may respectively be foreground objects. As shown in FIG. 3D, the object A blocks the object B and the object C in the depth image, and the depth classifier 230 can thereby know that the object A is a foreground object. For the identification method of the object, reference may be made to the related art of image processing. The present invention uses only the method of occlusion identification and dynamic degree identification as an example, but the present invention is not limited thereto.

在又一實施例中,深度分類器230更可結合區域式及深度式之劃分方式以劃分深度影像之群組,舉例來說,深度分類器230可在第3A圖中的深度影像300之中間區域尋找一特定深度範圍(例如灰階值介於150至200之間的深度範圍)以進一步劃分群組,深度分類器230亦可使用區域式及深度式所劃分區域之交集。又,深度分類器230更可交叉配合物件式、區域式及深度式之劃分方式,以劃分深度影像之群組,但本發明不限於此。In another embodiment, the depth classifier 230 can further divide the group of depth images by combining the regional and depth division modes. For example, the depth classifier 230 can be in the middle of the depth image 300 in FIG. 3A. The region looks for a specific depth range (eg, a depth range between gray and gray values between 150 and 200) to further divide the group, and the depth classifier 230 may also use the intersection of the regional and depth regions. Moreover, the depth classifier 230 can further intersect the object type, the area type, and the depth type to divide the group of depth images, but the present invention is not limited thereto.

在一實施例中,當深度分類器230將深度影像劃分為不同區域後,亦可得知於深度影像中所劃分之各群組於二維影像中亦有一對應群組(或對應的群組區域),影像調整器240即可對深度影像中的不同群組套用深度參數,及/或對深度影像所對應的二維影像之對應群組套用影像參數,意即影像調整器240可針對深度影像及/或二維影像進行調整。舉例來說,深度參數係為調整深度影像之對比、亮度、Gamma、銳利度(sharpness)或抑制雜訊(noise reduction)等參數,而影像參數係為調整二維影像之對比、亮度、Gamma、銳利度、抑制雜訊、飽和度、色調、R/G/B增益、R/G/B偏移、或是二維影像之移動及變焦(zoom),但本發明不限於此。在另一實施例中,深度影像及二維影像之調整參數係可為各區域各自獨立進行調整,意即各區域可具有一組獨立的調整參數,影像調整器240可依深度分析器210之分析結果或是外部訊號(例如縮放器scalar所輸出之訊號、外界感測使用者裝置或環境裝置(例如光感測器)所輸出之訊號、或是靜態影像偵測之外部訊號)以選擇特定或相對應的深度參數、影像參數或影像設定檔(image profile)。如第7A及7B圖所示,在不同的實施例中,針對深度影像及二維影像中的不同群組可分別套用不同群組調整參數(包括深度參數及影像參數),亦或是全部群組一起套用同一組群組調整參數,但本發明不限於此。In an embodiment, after the depth classifier 230 divides the depth image into different regions, it is also known that each group divided in the depth image also has a corresponding group (or corresponding group) in the two-dimensional image. The image adjuster 240 can apply depth parameters to different groups in the depth image, and/or apply image parameters to corresponding groups of the two-dimensional images corresponding to the depth image, that is, the image adjuster 240 can be used for depth. Adjust the image and/or 2D image. For example, the depth parameter is a parameter for adjusting the contrast, brightness, gamma, sharpness, or noise reduction of the depth image, and the image parameter is to adjust the contrast, brightness, gamma, Sharpness, noise suppression, saturation, hue, R/G/B gain, R/G/B offset, or movement and zoom of a two-dimensional image, but the invention is not limited thereto. In another embodiment, the adjustment parameters of the depth image and the two-dimensional image can be independently adjusted for each region, that is, each region can have a set of independent adjustment parameters, and the image adjuster 240 can be configured according to the depth analyzer 210. The result of the analysis is either an external signal (such as a signal output by a scaler scalar, an externally sensed signal output by a user device or an environmental device (such as a light sensor), or an external signal for static image detection) to select a specific one. Or the corresponding depth parameter, image parameter or image profile. As shown in FIGS. 7A and 7B, in different embodiments, different group adjustment parameters (including depth parameters and image parameters), or all groups, may be applied to different groups in the depth image and the 2D image respectively. The groups apply the same group group adjustment parameters together, but the invention is not limited thereto.

在一實施例中,當使用者觀賞立體影片(由二維影像轉換為立體影像所構成),深度分析器210會先分析各二維影像之影像內容的深度,當偵測到一主要物件(例如:車子)在第1至10張影像中持續地由右往左移動,且景深為中間深度,深度分類器230更偵測到另一物件(例如:人)之移動量少,因此可將主要物件定義為第一群組,另一主要物件(例如:人)定義為第二群組,深度影像之其餘部分則定義為第三群組。影像調整器240在第1至10張影像中,對於深度影像之不同區域分別使用各自的深度參數,例如將第一群組之灰階範圍由120至160調整為70至140,並維持10張影像;將第二群組之灰階範圍由0至40調整為20至40,並維持10張影像;將第三群組之灰階範圍由160至255調整為220至255,並維持10張影像。影像調整器240更對二維影像中之不同區域使用各自的二維影像參數,例如提昇第一群組之飽和度、第二群組不變、以及將第三群組模糊化。經由調整深度影像及二維影像,動態的車子在移動時的立體層次明顯且影像清晰,背景則較模糊且景深較深,人則畫質維持不變但深度略為往後移。In an embodiment, when the user views a stereoscopic movie (converted from a two-dimensional image to a stereoscopic image), the depth analyzer 210 first analyzes the depth of the image content of each of the two-dimensional images, and when a main object is detected ( For example: the car) continuously moves from right to left in the first to ten images, and the depth of field is the intermediate depth, and the depth classifier 230 detects that the movement of another object (for example, a person) is small, so The primary object is defined as the first group, the other primary object (eg, person) is defined as the second group, and the rest of the depth image is defined as the third group. In the first to ten images, the image adjuster 240 uses respective depth parameters for different regions of the depth image, for example, the gray scale range of the first group is adjusted from 120 to 160 to 70 to 140, and 10 sheets are maintained. Image; adjust the gray scale range of the second group from 0 to 40 to 20 to 40, and maintain 10 images; adjust the gray scale range of the third group from 160 to 255 to 220 to 255, and maintain 10 sheets image. The image adjuster 240 further uses respective two-dimensional image parameters for different regions in the two-dimensional image, such as increasing the saturation of the first group, changing the second group, and blurring the third group. By adjusting the depth image and the two-dimensional image, the dynamic car has a solid three-dimensional level and clear image, the background is blurred and the depth of field is deep, and the image quality remains unchanged but the depth is slightly moved backward.

在另一實施例中,當使用者觀賞三維遊戲(非二維影像轉換為立體影像)並暫停其影像時,當深度分析器210判斷出輸入影像為靜態影像時,深度分類器230則開始對深度影像進行區域劃分,例如將遊戲主角(近物)劃分為第一群組,其他部分則為第二群組。影像調整器240則進一步對不同群組套用各自的深度參數。舉例來說,在深度影像中,增加第一群組之Gamma值,並將第二群組之灰階值設定為0。在二維影像中,第一群組不進行調整,而將第二群組設定為灰階子影像。如此一來,暫停中的遊戲主角可凸出於螢幕,而其他內容則在螢幕最深處且為灰階子影像。In another embodiment, when the user views the three-dimensional game (non-two-dimensional image is converted into a stereo image) and pauses the image, when the depth analyzer 210 determines that the input image is a still image, the depth classifier 230 starts to The depth image is divided into regions, for example, the game protagonist (near object) is divided into a first group, and the other portion is a second group. Image adjuster 240 further applies respective depth parameters to different groups. For example, in the depth image, the gamma value of the first group is increased, and the gray level value of the second group is set to zero. In the two-dimensional image, the first group is not adjusted, and the second group is set as a gray-scale sub-image. In this way, the main character of the game in the pause can be highlighted on the screen, while the other content is at the deepest part of the screen and is a grayscale sub-image.

第4A-4C圖係顯示依據本發明一實施例之影像調整方法之流程圖。以第4A圖為例,在步驟S400,深度分析器210接收輸入影像,並依據輸入影像產生一第一影像(二維影像)及對應的一第一深度影像,其中輸入影像可為純二維影像或立體影像,立體影像例如是二維影像與對應的深度影像、或是左眼影像及對應的右眼影像,上述深度影像亦可藉由分析左眼/右眼影像所產生。在步驟S410,深度分類器230將第一深度影像劃分為至少2個群組,並依據第一深度影像之群組,對應地將第一影像劃分為上述群組,其中劃分群組的方式可為區域式、深度式或物件式。在步驟S420,影像調整器240對第一深度影像中之各群組分別套用一深度參數,以產生一第二深度影像。在步驟S430,影像調整器240對第一影像中之群組分別套用一影像參數,以產生一第二影像。在步驟S440,立體影像繪製器220依據第一影像及第二深度影像,產生一輸出影像,並將該輸出影像於一顯示裝置(第1圖未繪示)播放。4A-4C are flowcharts showing an image adjustment method according to an embodiment of the present invention. Taking the image of FIG. 4A as an example, in step S400, the depth analyzer 210 receives the input image, and generates a first image (two-dimensional image) and a corresponding first depth image according to the input image, wherein the input image can be pure two-dimensional image. The image or the stereoscopic image is, for example, a two-dimensional image and a corresponding depth image, or a left-eye image and a corresponding right-eye image. The depth image can also be generated by analyzing the left-eye/right-eye image. In step S410, the depth classifier 230 divides the first depth image into at least two groups, and correspondingly divides the first image into the group according to the group of the first depth image, wherein the grouping manner is For regional, deep or object type. In step S420, the image adjuster 240 applies a depth parameter to each group in the first depth image to generate a second depth image. In step S430, the image adjuster 240 applies an image parameter to each of the groups in the first image to generate a second image. In step S440, the stereoscopic image viewer 220 generates an output image according to the first image and the second depth image, and plays the output image on a display device (not shown in FIG. 1).

第4B圖係顯示依據本發明另一實施例之影像調整方法之流程圖。第4B圖與第4A圖差異之處在於第4B圖之流程僅對深度影像進行調整。故在步驟S450立體影像繪製器220係依據第一影像及第二深度影像,以產生一輸出影像。4B is a flow chart showing an image adjustment method according to another embodiment of the present invention. The difference between Fig. 4B and Fig. 4A is that the flow of Fig. 4B only adjusts the depth image. Therefore, the stereo image viewer 220 is configured to generate an output image according to the first image and the second depth image in step S450.

第4C圖係顯示依據本發明另一實施例之影像調整方法之流程圖。第4C圖與第4A圖差異之處在於第4C圖之流程僅對第一影像進行調整。故在步驟S450立體影像繪製器220係依據第二影像,以產生一輸出影像。值得注意的是,第4A~4C圖中的輸出影像係可為一二維影像或一立體影像,且播放輸出影像之顯示裝置係可接收二維影像及立體影像。FIG. 4C is a flow chart showing an image adjustment method according to another embodiment of the present invention. The difference between Fig. 4C and Fig. 4A is that the flow of Fig. 4C only adjusts the first image. Therefore, in step S450, the stereoscopic image viewer 220 is based on the second image to generate an output image. It should be noted that the output image in FIGS. 4A-4C can be a two-dimensional image or a stereo image, and the display device that plays the output image can receive the two-dimensional image and the stereo image.

第5A圖係顯示依據本發明一實施例之調整觀賞位置的示意圖。因使用者於顯示裝置所觀賞到的畫面之內容係為平面內容,當使用者在顯示裝置的正前方觀賞影片時,深度分類器230使用前述第4圖實施例之影像調整方法將影像中之內容物件進行劃分群組(或區域),然而當使用者與立體影像顯示裝置200之相對位置改變,例如使用者往左/右移或前後移動,或是螢幕的位置移動時,使用者所觀賞到的影像內容也會隨著相對位置的改變而移動,且本發明之影像調整器240更可針對劃分出的區域或群組,分別進行偏移量的調整。舉例來說,當使用者移動其位置時,深度較深的群組相對移動的距離較短,深度較淺的區域相對移動的距離較長。在一實施例中,影像調整器240係接收一外部控制信號以讓影像調整器240得知目前使用者與立體影像顯示裝置200之相對關係(例如:上下左右偏移量、角度及距離等)。在另一實施例中,外部控制信號係可由一影像偵測裝置(第2圖未繪示,例如攝影機)產生,影像偵測裝置係可偵測使用者與螢幕之間的相對移動,當相對移動大於一預定距離時,影像偵測裝置送出一外部控制信號至影像調整器240,並重複持續偵測的動作。Figure 5A is a schematic diagram showing the adjustment of the viewing position in accordance with an embodiment of the present invention. Since the content of the screen viewed by the user on the display device is a flat content, when the user views the movie directly in front of the display device, the depth classifier 230 uses the image adjustment method in the fourth embodiment to display the image. The content object is divided into groups (or regions), but when the relative position of the user and the stereoscopic image display device 200 is changed, for example, the user moves left/right or moves back and forth, or the position of the screen moves, the user views The image content to be moved also moves with the change of the relative position, and the image adjuster 240 of the present invention can further adjust the offset for each of the divided regions or groups. For example, when the user moves their position, the deeper group moves relatively shorter distances, and the shallower depth areas move relatively longer. In an embodiment, the image adjuster 240 receives an external control signal to allow the image adjuster 240 to know the relative relationship between the current user and the stereoscopic image display device 200 (eg, up, down, left and right offset, angle, distance, etc.) . In another embodiment, the external control signal can be generated by an image detecting device (not shown in FIG. 2, such as a camera), and the image detecting device can detect relative movement between the user and the screen when When the movement is greater than a predetermined distance, the image detecting device sends an external control signal to the image adjuster 240, and repeats the continuous detecting action.

在一實施例中,如第5A圖所示,深度影像520係表示使用者於立體影像顯示裝置200正前方觀賞到的畫面所對應的深度影像,且房子的景深最深、人的景深最淺,車子的景深則介於房子及人之間。如深度影像510及500所示,當使用者往左移動,則會看到畫面中的物體相對往右移動,且房子及車子的移動距離相對於人的移動距離較短。如深度影像530及540所示,當使用者往右移動,則會看到畫面中的物體相對往左移動。在另一實施例中,如第5B圖所示,深度影像560係為使用者位於正常距離所觀賞之畫面所對應的深度影像。如深度影像550所示,當使用者往後移動,影像調整器240則會將深度影像中的各群組縮小,使用者此時會看到畫面中的物體均相對地縮小。如深度影像570所示,當使用者往前移動,影像調整器240則會將深度影像中的各群組放大,使用者此時會看到畫面中的物體均相對地放大。上述實施例中,使用者之移動可視為沿著平行於立體影像顯示裝置之螢幕的法線移動或是垂直於法線移動,當使用者的移動方向係垂直於立體影像顯示裝置的法線時,外部控制信號亦會做出對應的調整以告知影像調整器240調整深度影像中的群組朝使用者移動方向的反方向移動。若使用者的移動方向係平行於立體影像顯示裝置的法線時,當使用者靠近立體影像顯示裝置時,外部控制信號亦會做出對應的調整以告知影像調整器240將深度影像中的群組放大。相反地,當使用者遠離立體影像顯示裝置時,外部控制信號亦會做出對應的調整以告知影像調整器240將深度影像中的群組縮小。上述實施例中,使用者之移動可能朝著上、下、左、右的方向,亦可能結合靠近或遠離立體影像顯示裝置,影像調整器240均可對深度影像中之群組進行對應的調整,但本發明不限於此。In an embodiment, as shown in FIG. 5A, the depth image 520 indicates a depth image corresponding to a screen viewed by the user directly in front of the stereoscopic image display device 200, and the depth of the house is the deepest and the depth of the person is the shallowest. The depth of the car is between the house and the person. As shown by the depth images 510 and 500, when the user moves to the left, the object in the screen is seen to move relatively to the right, and the moving distance of the house and the car is shorter than the moving distance of the person. As shown by the depth images 530 and 540, when the user moves to the right, the object in the screen is seen to move relatively to the left. In another embodiment, as shown in FIG. 5B, the depth image 560 is a depth image corresponding to a picture viewed by the user at a normal distance. As shown by the depth image 550, when the user moves backward, the image adjuster 240 will narrow down each group in the depth image, and the user will see that the objects in the screen are relatively reduced. As shown by the depth image 570, when the user moves forward, the image adjuster 240 will enlarge each group in the depth image, and the user will see that the objects in the screen are relatively enlarged. In the above embodiment, the movement of the user can be regarded as moving along a normal line parallel to the screen of the stereoscopic image display device or perpendicular to the normal line, when the moving direction of the user is perpendicular to the normal of the stereoscopic image display device. The external control signal also makes corresponding adjustments to inform the image adjuster 240 to adjust the movement of the group in the depth image in the opposite direction of the user's moving direction. If the moving direction of the user is parallel to the normal of the stereoscopic image display device, when the user approaches the stereoscopic image display device, the external control signal will also make corresponding adjustments to inform the image adjuster 240 of the group in the depth image. Group zoom in. Conversely, when the user is away from the stereoscopic image display device, the external control signal will also make corresponding adjustments to inform the image adjuster 240 to reduce the group in the depth image. In the above embodiment, the user may move in the upward, downward, left, and right directions, or may be combined with the stereoscopic image display device, and the image adjuster 240 may adjust the group in the depth image. However, the invention is not limited thereto.

第6A~6B圖係顯示依據本發明不同實施例之影像調整方法的流程圖。以第6A圖為例,在步驟S600,深度分析器210接收輸入影像,並依據輸入影像產生一第一影像(二維影像)及對應的一第一深度影像,其中輸入影像可為純二維影像或立體影像(二維影像與對應的深度影像)。在步驟S610,深度分類器230將第一深度影像劃分為至少2個群組,其中劃分群組的方式可為區域式、深度式或物件式。在步驟S620,影像調整器240接收一外部控制信號,其中外部控制信號係表示一使用者與顯示該第一深度影像之立體影像顯示裝置的一相對位置。在步驟S630,當相對位置改變時,影像調整器240對應地將該第一深度影像中之各群組分別套用一深度參數,以產生第二深度影像。在步驟S640,立體影像繪製器220依據第一影像及第二深度影像以產生一輸出影像。值得注意的是,立體影像繪製器220所產生的輸出影像係可為立體影像或二維影像。6A-6B are flowcharts showing an image adjustment method according to various embodiments of the present invention. Taking the image of FIG. 6A as an example, in step S600, the depth analyzer 210 receives the input image, and generates a first image (two-dimensional image) and a corresponding first depth image according to the input image, wherein the input image can be pure two-dimensional image. Image or stereo image (2D image and corresponding depth image). In step S610, the depth classifier 230 divides the first depth image into at least two groups, wherein the manner of grouping the groups may be regional, deep, or object-based. In step S620, the image adjuster 240 receives an external control signal, wherein the external control signal indicates a relative position of a user to the stereoscopic image display device displaying the first depth image. In step S630, when the relative position is changed, the image adjuster 240 correspondingly applies a depth parameter to each group in the first depth image to generate a second depth image. In step S640, the stereoscopic image viewer 220 generates an output image according to the first image and the second depth image. It should be noted that the output image generated by the stereo image viewer 220 can be a stereo image or a two-dimensional image.

第6B圖之步驟與第6A圖不同之處在於第6B圖之步驟S650中,影像調整器240係對第一影像中之各群組套用一影像參數以產生一第二影像,且立體影像繪製器220依據第二影像以產生輸出影像。熟習本發明領域之技藝者當了解,本發明係可對深度影像及/或二維影像中之群組進行調整,以產生一輸出影像(包括立體影像或二維影像),且亦可將立體影像及/或二維影像於至少一顯示裝置播放(意即可同時輸出立體影像及/或二維影像),且用於播放輸出影像之顯示裝置係可接收立體影像或二維影像。第6A、6B圖之流程係與第4A~4C圖之流程相似,差別在於第6A、6B圖係接收外部控制信號以對第一影像及/或第一深度影像進行調整。The step of FIG. 6B is different from that of FIG. 6A. In step S650 of FIG. 6B, the image adjuster 240 applies an image parameter to each group in the first image to generate a second image, and the stereo image is drawn. The device 220 generates an output image according to the second image. It will be appreciated by those skilled in the art that the present invention can adjust groups in depth images and/or two-dimensional images to produce an output image (including stereoscopic or two-dimensional images), and can also be stereoscopic The image and/or the two-dimensional image is played on at least one display device (meaning that the stereo image and/or the two-dimensional image are simultaneously output), and the display device for playing the output image can receive the stereo image or the two-dimensional image. The flow of FIGS. 6A and 6B is similar to the flow of FIGS. 4A-4C, except that the 6A and 6B images receive an external control signal to adjust the first image and/or the first depth image.

惟以上所述者,僅為本發明之較佳實施例而已,當不能以此限定本發明實施之範圍,即大凡依本發明申請專利範圍及發明說明內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。另外本發明的任一實施例或申請專利範圍不須達成本發明所揭露之全部目的或優點或特點。此外,摘要部分和標題僅是用以輔助專利文件搜尋之用,並非用以限制本發明之權利範圍。The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent. In addition, any of the objects or advantages or features of the present invention are not required to be achieved by any embodiment or application of the invention. In addition, the abstract sections and headings are only used to assist in the search of patent documents and are not intended to limit the scope of the invention.

200...影像產生裝置200. . . Image generating device

210...深度分析器210. . . Depth analyzer

220...立體影像繪製器220. . . Stereo imager

230...深度分類器230. . . Depth classifier

240...影像調整器240. . . Image adjuster

300~350、500~570...深度影像300~350, 500~570. . . Depth image

第1A圖係顯示將二維影像轉換為立體影像之傳統演算法的流程圖。Figure 1A is a flow chart showing a conventional algorithm for converting a two-dimensional image into a stereoscopic image.

第1B圖係顯示視覺深度感知因素的示意圖。Figure 1B is a schematic diagram showing visual depth perception factors.

第2圖係顯示依據本發明一實施例之影像產生裝置的方塊圖。2 is a block diagram showing an image generating apparatus according to an embodiment of the present invention.

第3A圖係顯示依據本發明一實施例之深度影像之區域式劃分的示意圖。3A is a schematic diagram showing the area division of a depth image according to an embodiment of the present invention.

第3B圖係顯示依據本發明一實施例之深度影像之深度式劃分的示意圖。Figure 3B is a schematic diagram showing the depth division of a depth image in accordance with an embodiment of the present invention.

第3C圖係顯示依據本發明一實施例之深度影像之物件式劃分的示意圖。FIG. 3C is a schematic diagram showing object division of a depth image according to an embodiment of the present invention.

第3D圖係顯示依據本發明一實施例之深度影像中之遮蔽物體之示意圖。3D is a schematic diagram showing a masked object in a depth image according to an embodiment of the invention.

第4A~4C圖係顯示依據本發明不同實施例之影像調整方法之流程圖。4A-4C are flowcharts showing an image adjustment method according to various embodiments of the present invention.

第5A~5B圖係顯示依據本發明一實施例之調整觀賞位置的示意圖。5A-5B are schematic views showing adjustment of an ornamental position according to an embodiment of the present invention.

第6A~6B圖係顯示依據本發明不同實施例之影像調整方法的流程圖。6A-6B are flowcharts showing an image adjustment method according to various embodiments of the present invention.

第7A~7B圖係顯示依據本發明一實施例之深度參數及影像參數之圖表。7A-7B are graphs showing depth parameters and image parameters in accordance with an embodiment of the present invention.

200...影像產生裝置200. . . Image generating device

210...深度分析器210. . . Depth analyzer

220...立體影像繪製器220. . . Stereo imager

230...深度分類器230. . . Depth classifier

240...影像調整器240. . . Image adjuster

Claims (32)

一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;以及對該第一深度影像中之各群組套用對應的一深度參數,以據以產生一第二深度影像;以及依據該第一影像及該第二深度影像,產生一輸出影像,其中產生該輸出影像之步驟更包括:接收一外部控制信號,該外部控制信號表示一使用者之一移動方向;當該移動方向係為上、下、左、右、前或後時,對應地調整該等群組沿著該移動方向之一反方向移動,藉以產生一第三深度影像;以及依據該第一影像及該第三深度影像,以產生該輸出影像。 An image adjustment method includes: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; and applying a corresponding one to each group in the first depth image a depth parameter for generating a second depth image; and generating an output image according to the first image and the second depth image, wherein the step of generating the output image further comprises: receiving an external control signal, the external control The signal indicates a moving direction of a user; when the moving direction is up, down, left, right, front or back, the group is correspondingly adjusted to move in a reverse direction along one of the moving directions, thereby generating a a third depth image; and generating the output image according to the first image and the third depth image. 如申請專利範圍第1項所述之影像調整方法,其中在接收該第一深度影像之步驟前包括:接收至少一輸入影像;以及依據該輸入影像,產生該第一影像及對應於該第一影像之該第一深度影像。 The image adjustment method of claim 1, wherein the step of receiving the first depth image comprises: receiving at least one input image; and generating the first image and corresponding to the first image according to the input image The first depth image of the image. 如申請專利範圍第1項所述之影像調整方法,其中劃分該第一深度影像為該等群組之步驟包括:依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image adjustment method of claim 1, wherein the dividing the first depth image into the groups comprises: dividing the first depth image according to a predetermined area position, a predetermined depth range, or a combination thereof For these groups. 如申請專利範圍第1項所述之影像調整方法,其 中劃分該第一深度影像為該等群組之步驟包括:偵測該第一深度影像中之至少一前景物件;以及依據該前景物件,劃分該第一深度影像為該等群組。 The image adjustment method according to claim 1, wherein The step of dividing the first depth image into the groups includes: detecting at least one foreground object in the first depth image; and dividing the first depth image into the groups according to the foreground object. 如申請專利範圍第2項所述之影像調整方法,更包括:依據於該第一深度影像中之該等群組,對應地劃分該第一影像為該等群組;對該第一影像中之該等群組分別套用對應的一影像參數,以產生一第二影像;以及依據該第二影像及該第二深度影像,產生一輸出影像。 The image adjustment method of claim 2, further comprising: correspondingly dividing the first image into the groups according to the groups in the first depth image; Each of the groups applies a corresponding image parameter to generate a second image; and generates an output image according to the second image and the second depth image. 一種影像產生裝置,包括:一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分該第一深度影像為至少二個群組;一影像調整器,用以對該第一深度影像中之各群組分別套用對應的一深度參數,以產生一第二深度影像;以及一立體影像繪製器,用以依據該第一影像及該第二深度影像,產生一輸出影像,其中該影像調整器更接收一外部控制信號,該外部控制信號表示一使用者之一移動方向,其中當該移動方向係為上、下、左、右、前或後時,該影像調整器係對應地調整該第一深度影像中之該等群組沿著該移動方向之一反方向移動,藉以產生一第三深度影像,且該立體影像繪製器更依據該第一影像及該第三深度影像,以 產生該輸出影像。 An image generating device includes: an image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups; and an image adjuster for Each of the first depth images is respectively applied with a corresponding depth parameter to generate a second depth image, and a stereo image viewer is configured to generate an output according to the first image and the second depth image. Image, wherein the image adjuster further receives an external control signal indicating a direction of movement of a user, wherein the image adjustment is when the moving direction is up, down, left, right, front or back Correspondingly adjusting the groups in the first depth image to move in a reverse direction along one of the moving directions, thereby generating a third depth image, and the stereo image viewer is further based on the first image and the first image Three depth images to This output image is produced. 如專利申請範圍第6項所述之影像產生裝置,更包括一深度分析器,用以接收至少一輸入影像,並依據該輸入影像,產生該第一影像及對應於該第一影像之該第一深度影像。 The image generating device of claim 6, further comprising a depth analyzer for receiving at least one input image, and generating the first image and the corresponding image corresponding to the first image according to the input image A depth image. 如專利申請範圍第6項所述之影像產生裝置,其中該影像分類器係依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image generating device of claim 6, wherein the image classifier divides the first depth image into the groups according to a predetermined area position, a predetermined depth range, or a combination thereof. 如專利申請範圍第6項所述之影像產生裝置,其中該影像分類器更偵測該第一深度影像中之至少一前景物件,並依據該前景物件,劃分該第一深度影像為該等群組。 The image generating device of claim 6, wherein the image classifier further detects at least one foreground object in the first depth image, and divides the first depth image into the groups according to the foreground object. group. 如專利申請範圍第7項所述之影像產生裝置,其中該影像分類器更依據於該第一深度影像中之該等群組,對應地劃分該第一影像為該等群組,該影像調整器更對該第一影像中之該等群組分別套用一影像參數,以產生一第二影像,且該立體影像繪製器,更依據該第二影像及該第二深度影像,以產生該輸出影像。 The image generating device of the seventh aspect of the invention, wherein the image classifier further divides the first image into the groups according to the groups in the first depth image, and the image is adjusted. The image data is further applied to the groups in the first image to generate a second image, and the stereo image viewer further generates the output according to the second image and the second depth image. image. 一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;依據該第一深度影像之該等群組,將該第一影像對應地劃分為該等群組;對該第一影像中之該等群組套用的一影像參數,以產生一第二影像; 接收一外部控制信號,該外部控制信號表示一使用者之一移動方向;當該移動方向係為上、下、左、右、前或後時,對應地調整該第一深度影像中之該等群組沿著該移動方向之一反方向移動,藉以產生一第三深度影像;以及依據該第二影像及該第三深度影像,以產生一輸出影像。 An image adjustment method includes: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; and according to the groups of the first depth image, the first The image is correspondingly divided into the groups; an image parameter applied to the groups in the first image to generate a second image; Receiving an external control signal indicating a moving direction of a user; when the moving direction is up, down, left, right, front or back, correspondingly adjusting the first depth image Moving the group in a reverse direction along one of the moving directions to generate a third depth image; and generating an output image according to the second image and the third depth image. 如申請專利範圍第11項所述之影像調整方法,其中在接收該第一深度影像之步驟前包括:接收至少一輸入影像;以及依據該輸入影像,產生該第一影像及對應於該第一影像之該第一深度影像。 The image adjustment method of claim 11, wherein the step of receiving the first depth image comprises: receiving at least one input image; and generating the first image and corresponding to the first image according to the input image The first depth image of the image. 如申請專利範圍第11項所述之影像調整方法,其中劃分該第一深度影像為該等群組之步驟包括:依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image adjustment method of claim 11, wherein the dividing the first depth image into the groups comprises: dividing the first depth image according to a predetermined area position, a predetermined depth range, or a combination thereof For these groups. 如申請專利範圍第11項所述之影像調整方法,其中劃分該第一深度影像為該等群組之步驟包括:偵測該第一深度影像中之至少一前景物件;以及依據該前景物件,劃分該第一深度影像為該等群組。 The image adjustment method of claim 11, wherein the step of dividing the first depth image into the groups comprises: detecting at least one foreground object in the first depth image; and according to the foreground object, The first depth image is divided into the groups. 如申請專利範圍第12項所述之影像調整方法,更包括:對該第一深度影像中之該等群組分別套用對應的一深度參數,以產生一第二深度影像;以及依據該第一影像及該第二深度影像,產生一立體影 像。 The image adjustment method of claim 12, further comprising: applying a corresponding depth parameter to the groups in the first depth image to generate a second depth image; and according to the first The image and the second depth image produce a stereoscopic image image. 一種影像產生裝置,包括:一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分該第一深度影像為至少二個群組,其中該影像分類器係依據該第一深度影像之該等群組,將該第一影像對應地劃分為該等群組;一影像調整器,用以對該第一影像中之該等群組分別套用對應的一影像調整參數,以產生一第二影像;以及一立體影像繪製器,依據該第二影像以產生一輸出影像,其中該影像調整器更接收一外部控制信號,該外部控制信號表示一使用者之一移動方向,其中當該移動方向係為上、下、左、右、前或後時,該影像調整器係對應地調整該第一深度影像中之該等群組沿著該移動方向之一反方向移動,藉以產生一第三深度影像,且該立體影像繪製器更依據該第一影像及該第三深度影像,以產生該輸出影像。 An image generating device includes: an image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups, wherein the image classifier is configured according to the The first image of the first image is correspondingly divided into the groups; an image adjuster is configured to apply a corresponding image adjustment parameter to the groups in the first image. And generating a second image; and a stereo image plotter, according to the second image to generate an output image, wherein the image adjuster further receives an external control signal, the external control signal indicating a direction of movement of the user The image adjuster correspondingly adjusts the group of the first depth image to move in a reverse direction along one of the moving directions when the moving direction is up, down, left, right, front, or back. The third image is generated according to the first image and the third depth image to generate the output image. 如專利申請範圍第16項所述之影像產生裝置,更包括一深度分析器,用以接收至少一輸入影像,並依據該輸入影像,產生該第一影像及對應於該第一影像之該第一深度影像。 The image generating device of claim 16, further comprising a depth analyzer for receiving at least one input image, and generating the first image and the corresponding image corresponding to the first image according to the input image A depth image. 如專利申請範圍第16項所述之影像產生裝置,其中該影像分類器係依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image generating device of claim 16, wherein the image classifier divides the first depth image into the groups according to a predetermined area position, a predetermined depth range, or a combination thereof. 如專利申請範圍第16項所述之影像產生裝置,其中該影像分類器更偵測該第一深度影像中之至少一前景物件,並依據該前景物件,劃分該第一深度影像為該等群組。 The image generating device of claim 16, wherein the image classifier further detects at least one foreground object in the first depth image, and divides the first depth image into the groups according to the foreground object. group. 如專利申請範圍第17項所述之影像產生裝置,其中該影像分類器更依據於該第一深度影像中之該等群組,對應地劃分該第一影像為該等群組,該影像調整器更對該第一影像中之該等群組分別套用一影像參數,以產生一第二影像,且該立體影像繪製器,更依據該第二影像及該第二深度影像,以產生該輸出影像。 The image generating device of claim 17, wherein the image classifier further divides the first image into the groups according to the groups in the first depth image, and the image is adjusted. The image data is further applied to the groups in the first image to generate a second image, and the stereo image viewer further generates the output according to the second image and the second depth image. image. 一種影像調整方法,包括:接收一第一影像及對應的一第一深度影像;劃分該第一深度影像為至少二個群組;接收一外部控制信號,其中該外部控制信號係表示一使用者與一顯示裝置的一相對位置;當該相對位置改變時,對該第一深度影像中之各群組分別套用一深度參數,以產生一第二深度影像;以及依據該第一影像及該第二深度影像,產生一輸出影像。 An image adjustment method includes: receiving a first image and a corresponding first depth image; dividing the first depth image into at least two groups; receiving an external control signal, wherein the external control signal indicates a user a relative position of a display device; when the relative position is changed, applying a depth parameter to each group in the first depth image to generate a second depth image; and according to the first image and the first Two depth images that produce an output image. 如申請專利範圍第21項所述之影像調整方法,其中劃分該第一深度影像為該等群組之步驟包括:依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image adjustment method of claim 21, wherein the dividing the first depth image into the groups comprises: dividing the first depth image according to a predetermined area position, a predetermined depth range, or a combination thereof For these groups. 如申請專利範圍第21項所述之影像調整方法,其中劃分該第一深度影像為該等群組之步驟包括: 偵測該第一深度影像中之至少一前景物件;以及依據該前景物件,劃分該第一深度影像為該等群組。 The image adjustment method of claim 21, wherein the step of dividing the first depth image into the groups comprises: Detecting at least one foreground object in the first depth image; and dividing the first depth image into the groups according to the foreground object. 如申請專利範圍第21項所述之影像調整方法,其中對應地調整在該第一深度影像中之該等群組之步驟包括:當該外部控制信號係表示該使用者往垂直於該顯示裝置之一法線的一方向移動時,對應地調整該等群組於該方向之一反方向移動,以產生該第二深度影像。 The image adjustment method of claim 21, wherein the step of correspondingly adjusting the groups in the first depth image comprises: when the external control signal indicates that the user is perpendicular to the display device When one of the normals moves in one direction, the groups are correspondingly adjusted to move in the opposite direction of the direction to generate the second depth image. 如申請專利範圍第21項所述之影像調整方法,其中對應地調整在該第一深度影像中之該等群組之步驟更包括:當該外部控制信號係表示該使用者沿著平行於該顯示裝置之一法線以遠離該顯示裝置時,對應地將該等群組縮小,以產生該第二深度影像;以及當該外部控制信號係表示該使用者沿著平行於該顯示裝置之該法線以靠近該顯示裝置時,對應地將該等群組放大,以產生該第二深度影像。 The image adjustment method of claim 21, wherein the step of correspondingly adjusting the groups in the first depth image further comprises: when the external control signal indicates that the user is parallel to the When one of the normals of the display device is away from the display device, the groups are correspondingly reduced to generate the second depth image; and when the external control signal indicates that the user is parallel to the display device When the normal is close to the display device, the groups are correspondingly enlarged to generate the second depth image. 如申請專利範圍第21項所述之影像調整方法,其中產生該輸出影像之步驟更包括:依據該第一深度影像中之該等群組,對應地將該第一影像劃分為該等群組;以及當該相對位置改變時,對該第一影像之該等群組分別套用一影像參數,以產生一第二影像,並據以產生該輸出影像。 The image adjustment method of claim 21, wherein the generating the output image further comprises: correspondingly dividing the first image into the groups according to the groups in the first depth image And when the relative position is changed, applying an image parameter to the groups of the first image to generate a second image, and generating the output image accordingly. 一種影像產生裝置,包括: 一影像分類器,用以接收一第一影像及對應的一第一深度影像,並劃分該第一深度影像為至少二個群組;一影像調整器,用以接收一外部控制信號,其中該外部控制信號係表示一使用者與一顯示裝置的一相對位置,其中當該相對位置改變時,該影像調整器對應地將該第一深度影像中之各群組套用一深度參數,以產生一第二深度影像;以及一立體影像繪製器,用以依據該第一影像及該第二深度影像,產生一輸出影像。 An image generating device comprising: An image classifier for receiving a first image and a corresponding first depth image, and dividing the first depth image into at least two groups; and an image adjuster for receiving an external control signal, wherein The external control signal indicates a relative position of the user and a display device, wherein when the relative position is changed, the image adjuster correspondingly applies a depth parameter to each group in the first depth image to generate a a second depth image; and a stereo image viewer for generating an output image according to the first image and the second depth image. 如申請專利範圍第27項所述之影像產生裝置,其中該影像分類器係依據一預定區域位置、一預定深度範圍或其組合,劃分該第一深度影像為該等群組。 The image generating device of claim 27, wherein the image classifier divides the first depth image into the groups according to a predetermined area position, a predetermined depth range, or a combination thereof. 如申請專利範圍第27項所述之影像產生裝置,其中其中該影像分類器更偵測該第一深度影像中之至少一前景物件,並依據該前景物件,劃分該第一深度影像為該等群組。 The image generating device of claim 27, wherein the image classifier further detects at least one foreground object in the first depth image, and according to the foreground object, the first depth image is divided into the first depth image. Group. 如申請專利範圍第27項所述之影像產生裝置,其中當該外部控制信號係表示該使用者往垂直於該影像產生裝置之一法線的一方向移動時,該影像調整器更對應地調整該等群組於該方向之一反方向移動,以產生該第二深度影像。 The image generating device of claim 27, wherein the image adjuster is more correspondingly adjusted when the external control signal indicates that the user moves in a direction perpendicular to a normal of the image generating device. The groups move in opposite directions in one of the directions to produce the second depth image. 如申請專利範圍第27項所述之影像產生裝置,其中當該外部控制信號係表示該使用者沿著平行於該顯示裝置之一法線以遠離該影像產生裝置時,該影像調整器對應地將該等群組縮小,以產生該第二深度影像,且 當該外部控制信號係表示該使用者沿著平行於該顯示裝置之該法線以靠近該顯示裝置時,該影像調整器對應地將該等群組放大,以產生該第二深度影像。 The image generating device of claim 27, wherein when the external control signal indicates that the user is away from the image generating device parallel to a normal line of the display device, the image adjuster correspondingly Reducing the groups to generate the second depth image, and When the external control signal indicates that the user is adjacent to the display device parallel to the normal of the display device, the image adjuster correspondingly enlarges the groups to generate the second depth image. 如申請專利範圍第27項所述之影像產生裝置,其中該影像分類器更依據該第一深度影像中之該等群組,對應地將該第一影像劃分為該等群組,且當該相對位置改變時,該影像調整器更對該第一影像之該等群組分別套用一影像參數,以產生一第二影像,且該立體影像繪製器並依據該第二影像以產生該輸出影像。The image generating device of claim 27, wherein the image classifier further divides the first image into the groups according to the groups in the first depth image, and when When the relative position is changed, the image adjuster applies an image parameter to the groups of the first image to generate a second image, and the stereo image renderer generates the output image according to the second image. .
TW100139720A 2011-11-01 2011-11-01 Image generating device and image adjusting method TWI493963B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
TW100139720A TWI493963B (en) 2011-11-01 2011-11-01 Image generating device and image adjusting method
EP12190427.0A EP2590417A1 (en) 2011-11-01 2012-10-29 Stereoscopic image display apparatus
US13/664,453 US20130106845A1 (en) 2011-11-01 2012-10-31 Stereoscopic image display apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW100139720A TWI493963B (en) 2011-11-01 2011-11-01 Image generating device and image adjusting method

Publications (2)

Publication Number Publication Date
TW201320715A TW201320715A (en) 2013-05-16
TWI493963B true TWI493963B (en) 2015-07-21

Family

ID=48872709

Family Applications (1)

Application Number Title Priority Date Filing Date
TW100139720A TWI493963B (en) 2011-11-01 2011-11-01 Image generating device and image adjusting method

Country Status (1)

Country Link
TW (1) TWI493963B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI736335B (en) * 2020-06-23 2021-08-11 國立成功大學 Depth image based rendering method, electrical device and computer program product

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017214A (en) * 2019-05-29 2020-12-01 多方科技(广州)有限公司 Method for judging foreground and background images

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1888814A (en) * 2006-07-25 2007-01-03 深圳大学 Multi-viewpoint attitude estimating and self-calibrating method for three-dimensional active vision sensor
WO2009091563A1 (en) * 2008-01-18 2009-07-23 Thomson Licensing Depth-image-based rendering
US20100046837A1 (en) * 2006-11-21 2010-02-25 Koninklijke Philips Electronics N.V. Generation of depth map for an image
US20100066732A1 (en) * 2008-09-16 2010-03-18 Microsoft Corporation Image View Synthesis Using a Three-Dimensional Reference Model
WO2010151279A1 (en) * 2009-06-25 2010-12-29 Thomson Licensing Depth map coding

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1888814A (en) * 2006-07-25 2007-01-03 深圳大学 Multi-viewpoint attitude estimating and self-calibrating method for three-dimensional active vision sensor
US20100046837A1 (en) * 2006-11-21 2010-02-25 Koninklijke Philips Electronics N.V. Generation of depth map for an image
WO2009091563A1 (en) * 2008-01-18 2009-07-23 Thomson Licensing Depth-image-based rendering
US20100066732A1 (en) * 2008-09-16 2010-03-18 Microsoft Corporation Image View Synthesis Using a Three-Dimensional Reference Model
WO2010151279A1 (en) * 2009-06-25 2010-12-29 Thomson Licensing Depth map coding

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI736335B (en) * 2020-06-23 2021-08-11 國立成功大學 Depth image based rendering method, electrical device and computer program product

Also Published As

Publication number Publication date
TW201320715A (en) 2013-05-16

Similar Documents

Publication Publication Date Title
JP5183277B2 (en) Stereoscopic image display device
US9485487B2 (en) Method and apparatus for generating a signal for a display
US9215452B2 (en) Stereoscopic video display apparatus and stereoscopic video display method
JP4793451B2 (en) Signal processing apparatus, image display apparatus, signal processing method, and computer program
US8606043B2 (en) Method and apparatus for generating 3D image data
EP2755187A2 (en) 3d-animation effect generation method and system
WO2011029209A2 (en) Method and apparatus for generating and processing depth-enhanced images
TW201320716A (en) Dynamic depth adjusting apparatus and method thereof
JP5178876B2 (en) 3D image display apparatus and 3D image display method
JP2015156607A (en) Image processing method, image processing apparatus, and electronic device
US20080238930A1 (en) Texture processing apparatus, method and program
JP2010152521A (en) Apparatus and method for performing stereographic processing to image
CN103108198A (en) Image generation device and image adjusting method
US8970670B2 (en) Method and apparatus for adjusting 3D depth of object and method for detecting 3D depth of object
TWI493963B (en) Image generating device and image adjusting method
US20120121163A1 (en) 3d display apparatus and method for extracting depth of 3d image thereof
EP2590417A1 (en) Stereoscopic image display apparatus
KR101177793B1 (en) Stereoscopic virtual experience apparatus and method
KR101779423B1 (en) Method and apparatus for processing image
KR101192121B1 (en) Method and apparatus for generating anaglyph image using binocular disparity and depth information
JP2012169822A (en) Image processing method and image processing device
CN103108201A (en) Stereo image display device and dynamic depth image generation method
US10475233B2 (en) System, method and software for converting images captured by a light field camera into three-dimensional images that appear to extend vertically above or in front of a display medium
TWI493962B (en) Multimedia processing system and audio signal adjusting method
TWI475898B (en) Multimedia processing system and audio signal adjusting method