TWI439962B - Intuitive image depth generation system and image depth generation method - Google Patents
Intuitive image depth generation system and image depth generation method Download PDFInfo
- Publication number
- TWI439962B TWI439962B TW99128140A TW99128140A TWI439962B TW I439962 B TWI439962 B TW I439962B TW 99128140 A TW99128140 A TW 99128140A TW 99128140 A TW99128140 A TW 99128140A TW I439962 B TWI439962 B TW I439962B
- Authority
- TW
- Taiwan
- Prior art keywords
- depth
- image
- generating
- instruction
- module
- Prior art date
Links
Landscapes
- Processing Or Creating Images (AREA)
Description
本發明係關於一種影像產生系統及影像生成方法,特別關於一種深度影像產生系統及深度影像生成方法。The present invention relates to an image generation system and an image generation method, and more particularly to a depth image generation system and a depth image generation method.
由於科技的進步,現今電子產品之發展,莫不以提昇產品的性能及品質為優先考量。其中,有關顯示裝置的設計,除了提供使用者更清晰、更舒適的顯示畫面之外,更有業者提出一種三維(three-dimension,3D)顯示裝置,以提供使用者另一種不同的視覺感受。Due to the advancement of technology, the development of today's electronic products is not a priority to improve the performance and quality of products. Among them, regarding the design of the display device, in addition to providing a clearer and more comfortable display screen for the user, a third-dimension (3D) display device has been proposed to provide the user with a different visual experience.
以現階段而言,由於缺乏可提供三維顯示裝置使用之3D影像內容,因此,由2D影像轉3D影像之技術在近年來已經成為業者及學術界共同探討與待解決之問題。其中,現有的3D影像生成系統是透過使用者鍵入特定之參考數值以產生2D影像之深度結果,再利用原始之2D影像與深度結果生成三維顯示裝置所支援的3D影像格式。然而,此種影像生成方式過於著重特定之參考數值的給定,因此,需要花費相當長的製作時間,且使用者亦無法輕易地進行3D影像生成的操作。At this stage, due to the lack of 3D image content that can be used in 3D display devices, the technology from 2D image to 3D image has become a problem that the industry and academia have jointly discussed and solved in recent years. The existing 3D image generation system generates a 3D image format supported by the 3D display device by inputting a specific reference value by the user to generate a depth result of the 2D image, and then using the original 2D image and the depth result. However, such an image generation method is too focused on a given reference value, and therefore, it takes a relatively long production time, and the user cannot easily perform 3D image generation operations.
因此,如何提供一種深度影像產生系統及深度影像生成方法,使其能夠讓使用者便於操作,進而提升影像生成之速度與品質,已成為重要課題之一。Therefore, how to provide a depth image generation system and a depth image generation method, which can make the user easy to operate, thereby improving the speed and quality of image generation, has become one of the important topics.
有鑑於上述課題,本發明之目的為提供一種能夠讓使用者便於操作,進而提升影像生成之速度與品質之深度影像產生系統及深度影像生成方法。In view of the above problems, an object of the present invention is to provide a depth image generation system and a depth image generation method that can facilitate operation by a user and thereby improve the speed and quality of image generation.
為達上述目的,依據本發明之一種深度影像產生系統與一電腦裝置搭配使用,其係包含一物件擷取模組及一物件深度產生模組。物件擷取模組選取一影像資料之一物件,並產生物件之輪廓圖。物件深度產生模組接收物件之輪廓圖,並產生物件之深度值。To achieve the above object, a depth image generating system according to the present invention is used in combination with a computer device, which comprises an object capturing module and an object depth generating module. The object capture module selects an object of an image data and generates an outline image of the object. The object depth generation module receives the contour map of the object and generates the depth value of the object.
在本發明一實施例中,物件擷取模組依據一使用者所輸入之一第一指令選取該物件。In an embodiment of the invention, the object capture module selects the object according to a first instruction input by a user.
在本發明一實施例中,物件深度產生模組依據一第二指令或物件與影像資料之一背景深度值之相對應關係產生物件之深度值,其中,第二指令包含指定物件之一位置參考點及或物件之一漸層參考點。In an embodiment of the invention, the object depth generation module generates a depth value of the object according to a second instruction or a corresponding relationship between the object and a background depth value of the image data, wherein the second instruction includes a position reference of the specified object. Point and or one of the gradient reference points of the object.
為達上述目的,依據本發明之一種深度影像產生系統的深度影像生成方法,其中深度影像產生系統與一電腦裝置搭配使用,且深度影像產生系統具有一物件擷取模組及一物件深度產生模組,深度影像生成方法包含下列步驟:由物件擷取模組選取一影像資料之一物件,並產生物件之輪廓圖;以及由物件深度產生模組,接收物件之輪廓圖,並產生物件之深度值。In order to achieve the above object, a depth image generating method for a depth image generating system according to the present invention, wherein the depth image generating system is used in combination with a computer device, and the depth image generating system has an object capturing module and an object depth generating module. The method for generating a depth image includes the following steps: selecting an object of an image data by the object capturing module, and generating a contour map of the object; and generating a module by the object depth generating module, receiving the contour map of the object, and generating the depth of the object. value.
在本發明一實施例中,物件擷取模組依據一使用者所輸入之一第一指令選取物件。In an embodiment of the invention, the object capture module selects an object according to a first instruction input by a user.
在本發明一實施例中,物件深度產生模組依據一第二指令或物件與影像資料之一背景深度值之相對應關係產生物件之深度值。In an embodiment of the invention, the object depth generation module generates the depth value of the object according to a second instruction or a corresponding relationship between the object and a background depth value of the image data.
為達上述目的,本發明亦揭露一種內儲用於深度影像生成之電腦程式產品,當一電腦裝置載入該電腦程式並執行後,可完成上述之深度影像生成方法。To achieve the above objective, the present invention also discloses a computer program product for storing deep image generation. When a computer device is loaded into the computer program and executed, the depth image generation method described above can be completed.
承上所述,因依據本發明之一種深度影像產生系統及深度影像生成方法,藉由使用物件擷取模組選取一影像資料之一物件,並產生該物件之輪廓圖,以使物件深度產生模組接收物件之輪廓圖,並產生物件之深度值。從而實現能夠讓使用者便於操作,進而提升影像生成之速度與品質。According to the present invention, a depth image generating system and a depth image generating method according to the present invention select an object of an image data by using the object capturing module, and generate a contour map of the object to make the object depth generated. The module receives the contour map of the object and produces the depth value of the object. Therefore, the user can operate easily, thereby improving the speed and quality of image generation.
以下將參照相關圖式,說明依據本發明較佳實施例之一種深度影像產生系統及深度影像生成方法。Hereinafter, a depth image generating system and a depth image generating method according to a preferred embodiment of the present invention will be described with reference to related drawings.
請參照圖1所示,圖1為本發明較佳實施例之一種深度影像產生系統及電腦裝置的示意圖。深度影像產生系統1與電腦裝置2搭配使用,且深度影像產生系統1包含一物件擷取模組11及一物件深度產生模組12。Please refer to FIG. 1. FIG. 1 is a schematic diagram of a depth image generating system and a computer device according to a preferred embodiment of the present invention. The depth image generation system 1 is used in conjunction with the computer device 2, and the depth image generation system 1 includes an object capture module 11 and an object depth generation module 12.
物件擷取模組11係用以選取電腦裝置2之顯示器21所顯示之一影像資料之一物件,並產生所選取之物件的輪廓圖。在本實施例中,物件擷取模組11是依據使用者所輸入之一第一指令C1選取影像資料中之物件。其中,前述之第一指令C1係可為一直接指定所要選取之物件的指令,或為一給定物件初始輪廓之指令。The object capture module 11 is configured to select one of the image data displayed by the display 21 of the computer device 2, and generate a contour map of the selected object. In this embodiment, the object capture module 11 selects an object in the image data according to a first command C1 input by the user. The first instruction C1 may be an instruction directly designating an object to be selected, or an instruction of an initial contour of a given object.
在實際運用上,物件擷取模組11在接收到第一指令C1後,將可採取不同的處理方式,以產生所指定之物件的輪廓圖,例如,於一般狀態下,採用索貝爾邊緣偵測法(Sobel edge detection)產生物件之輪廓圖,在需要特別強調直線之影像中使用坎尼邊緣偵測法(Canny Edge detection),以及當影像較為模糊時,採用同質邊緣偵測法(Homogeneous edge detection)來擴大影像資料之物件之間的差異,以產生物件之輪廓圖。In practical use, after receiving the first command C1, the object capturing module 11 can adopt different processing manners to generate a contour map of the specified object, for example, in a general state, using Sobel edge detection. Sobel edge detection produces contour maps of objects, uses Canny Edge detection in images that require special emphasis on straight lines, and uses homogenous edge detection when images are blurry. Detection) to expand the difference between the objects of the image data to produce a contour map of the object.
另外,值得一提的是,物件擷取模組11係可依據預先設定之一標準,以判斷影像資料及所指定之物件的狀態,例如是亮度、對比度及或解析度,進而自動選定所要採用之偵測法,或是依據使用者自行選取所需之偵測法,以產生物件之輪廓圖。In addition, it is worth mentioning that the object capture module 11 can determine the state of the image data and the specified object, such as brightness, contrast, and resolution, according to one of the preset criteria, and automatically select the desired image. The detection method, or the user selects the required detection method to generate the contour map of the object.
物件深度產生模組12接收物件之輪廓圖,並產生物件之深度值。在本實施例中,物件深度產生模組12是依據一第二指令C2產生物件之深度值,並將物件之輪廓圖及或深度值顯示於電腦裝置2之顯示器21。The object depth generation module 12 receives the contour map of the object and generates a depth value of the object. In this embodiment, the object depth generation module 12 generates the depth value of the object according to a second command C2, and displays the contour map and the depth value of the object on the display 21 of the computer device 2.
在實施上,第二指令C2係可為使用者所輸入之指令,且其係包含指定物件之一位置參考點及或物件之一漸層參考點。其中,位置參考點位於物件之輪廓圖的邊緣上或輪廓圖之中,物件深度產生模組12係以所指定之位置參考點為基準,產生位置參考點所在之一行的深度值,且此行之深度值皆相同,而為一相同式深度值。In practice, the second command C2 can be an instruction input by the user, and it includes a position reference point of one of the specified objects and a gradient reference point of the object. Wherein, the position reference point is located on the edge of the contour map of the object or in the contour map, and the object depth generation module 12 generates the depth value of one row of the position reference point based on the specified position reference point, and the line The depth values are all the same, but a similar depth value.
此外,漸層參考點係可為物件於影像資料中之各行的最低點或最高點,物件深度產生模組12是以所指定之漸層參考點作為起點或終點,產生漸層參考點所在之一行的深度值,且此行之深度值為一漸層式深度值。其中,漸層式深度值係為依據一函數而使整行之深度值具有變化。前述之函數例如是線性函數、指數函數、對數函數或其他非線性函數。In addition, the gradient reference point may be the lowest point or the highest point of each line in the image data, and the object depth generation module 12 uses the specified gradient reference point as a starting point or an end point to generate a gradient reference point. The depth value of a row, and the depth value of this row is a gradient depth value. Wherein, the gradient depth value is such that the depth value of the entire row has a change according to a function. The aforementioned functions are, for example, linear functions, exponential functions, logarithmic functions or other non-linear functions.
在實際運用上,深度影像產生系統1更可以包含一影像資料儲存模組(圖未示出)。其中,影像資料儲存模組係儲存複數筆背景影像及或複數組設定參數。物件深度產生模組12將可依據影像資料儲存模組中所儲存之各種資訊,透過比對及運算而判斷物件與影像資料之一背景深度值之相對應關係,進而產生物件擷取模組11所選取之物件的深度值。In actual use, the depth image generation system 1 may further include an image data storage module (not shown). The image data storage module stores a plurality of background images and a complex array setting parameter. The object depth generating module 12 can determine the corresponding relationship between the object and the background depth value of the image data by comparing and calculating various information stored in the image data storage module, thereby generating the object capturing module 11 The depth value of the selected object.
另外,值得一提的是,物件深度產生模組12亦可以依據影像資料中已經生成之物件的深度值,產生同一影像資料中之其餘物件的深度值。In addition, it is worth mentioning that the object depth generation module 12 can also generate the depth values of the remaining objects in the same image data according to the depth values of the objects already generated in the image data.
因而,藉由上述之深度影像產生系統1,使用者將不需輸入特定之參考數值,而可透過半自動之方式,以更為直覺及簡便地方式進行影像資料之處理。Therefore, with the above-described depth image generation system 1, the user can process the image data in a more intuitive and simple manner by inputting a specific reference value without using a specific reference value.
接著,請參照圖2所示,圖2為本發明較佳實施例之一種深度影像產生系統3。深度影像產生系統3與影像生成系統1的區別在於,深度影像產生系統3更包含一影像顯示模組13。其中,影像顯示模組13係用以顯示物件之輪廓圖及或物件之深度值,以利使用者於各處理階段觀察各種圖式,並決定後續之操作方式。此外,影像顯示模組13亦可依據影像資料之所有物件的深度值產生影像資料之一深度圖,以及利用原始之影像資料與影像資料之深度圖而產生一3D影像。Next, please refer to FIG. 2. FIG. 2 is a depth image generating system 3 according to a preferred embodiment of the present invention. The depth image generation system 3 differs from the image generation system 1 in that the depth image generation system 3 further includes an image display module 13. The image display module 13 is configured to display the contour map of the object and the depth value of the object, so that the user can observe various patterns in each processing stage and determine the subsequent operation mode. In addition, the image display module 13 can also generate a depth map of the image data according to the depth values of all the objects of the image data, and generate a 3D image by using the original image data and the depth map of the image data.
接著,請參照圖3所示,以下請參照圖3之流程圖並搭配圖1所示,以說明本發明之較佳實施例之深度影像生成方法,其係與例如上述之深度影像產生系統1搭配使用。深度影像生成方法的步驟係包含S01~S02。Next, please refer to FIG. 3 , which will be described below with reference to the flowchart of FIG. 3 and FIG. 1 to illustrate a depth image generating method according to a preferred embodiment of the present invention, which is related to, for example, the depth image generating system 1 described above. For use with. The steps of the depth image generation method include S01 to S02.
步驟S01係由物件擷取模組11選取一影像資料之一物件,並產生物件之輪廓圖。在本實施例中,物件擷取模組11依據使用者所輸入之第一指令選取影像資料中之物件,並產生所選取之物件的輪廓圖。In step S01, an object image is selected by the object capturing module 11 to generate an outline image of the object. In this embodiment, the object capturing module 11 selects an object in the image data according to the first instruction input by the user, and generates a contour map of the selected object.
步驟S02係由物件深度產生模組12,接收物件之輪廓圖,並產生物件之深度值。在本實施例中,物件深度產生模組12是依據第二指令或物件與影像資料之一背景深度值之相對應關係而產生物件之深度值。Step S02 is performed by the object depth generation module 12, which receives the contour map of the object and generates the depth value of the object. In this embodiment, the object depth generation module 12 generates the depth value of the object according to the second instruction or the corresponding relationship between the object and the background depth value of the image data.
在實施上,係可重複實施步驟S01~S02,以產生影像資料中之所有物件之深度值,進而生成影像資料之一深度圖。其中,前述之所有物件係包含影像資料之前景與背景。此外,使用者可採用一次選取一個物件而分別進行輪廓圖與深度值的生成,或是一次選取多個物件以同時進行輪廓圖與深度值的生成。In practice, steps S01-S02 may be repeatedly performed to generate depth values of all objects in the image data, thereby generating a depth map of the image data. Among them, all the aforementioned objects include the foreground and background of the image data. In addition, the user can select one object at a time to separately generate the contour map and the depth value, or select multiple objects at a time to simultaneously generate the contour map and the depth value.
接著,為了更清楚地說明依據本發明之深度影像產生系統及深度影像生成方法,請參照圖4A至圖4D之影像生成的示意圖。Next, in order to more clearly explain the depth image generation system and the depth image generation method according to the present invention, please refer to the schematic diagrams of image generation of FIGS. 4A to 4D.
如圖4A所示,電腦裝置係於其顯示器上顯示一影像資料。需特別注意的是,本實施例是以影像資料具有人物、交通工具、建築物與天空為例進行說明,並非以此為限。As shown in FIG. 4A, the computer device displays an image data on its display. It should be noted that the present embodiment is based on the fact that the image data has characters, vehicles, buildings, and the sky as an example, and is not limited thereto.
如圖4B所示,當第一指令為指定所要選取之物件為影像資料中的人物及交通工具時,物件擷取模組將依據第一指令選取該人物及該交通工具,並產生所選取之人物與交通工具的輪廓圖。As shown in FIG. 4B, when the first instruction specifies that the object to be selected is a character and a vehicle in the image data, the object capturing module selects the character and the vehicle according to the first instruction, and generates the selected object. Outline map of people and vehicles.
如圖4C所示,當第一指令依序指定所要選取之物件為影像資料中的建築物與天空時,物件擷取模組將依據第一指令選取所指定之物件。此外,在本實施例中,第二指令係分別指定人物、交通工具及天空之位置參考點,與建築物之漸層參考點。因此,物件深度產生模組將依據第二指令生成各物件之深度值。As shown in FIG. 4C, when the first instruction sequentially specifies that the object to be selected is the building and the sky in the image data, the object capturing module selects the specified object according to the first instruction. In addition, in the present embodiment, the second command specifies the position reference point of the person, the vehicle, and the sky, respectively, and the gradation reference point of the building. Therefore, the object depth generation module will generate the depth value of each object according to the second instruction.
如圖4D所示,當完成影像資料之所有物件的深度值後,影像顯示模組將生成影像資料之深度圖。此外,影像顯示模組係可利用原始之影像資料與影像資料之深度圖而產生一3D影像。As shown in FIG. 4D, after completing the depth values of all the objects of the image data, the image display module will generate a depth map of the image data. In addition, the image display module can generate a 3D image by using the original image data and the depth map of the image data.
需注意者,本發明亦揭露一種內儲用於影像生成之電腦程式產品,當電腦裝置載入電腦程式並執行後,可完成上述之深度影像生成方法。其中,電腦程式可以是儲存一記錄媒體中的程式碼,或是可以透過網路傳輸之程式碼,所以電腦裝置可以直接讀取記錄媒體或透過網路下載以載入程式碼,並進一步執行後完成上述之深度影像生成方法。It should be noted that the present invention also discloses a computer program product for storing image generation. When the computer device is loaded into a computer program and executed, the above-described depth image generation method can be completed. The computer program can store the code in a recording medium or a code that can be transmitted through the network, so the computer device can directly read the recording medium or download the code through the network to load the code, and further execute the program. The above method of generating a depth image is completed.
綜上所述,因依據本發明之一種深度影像產生系統及深度影像生成方法,藉由使用物件擷取模組選取一影像資料之一物件,並產生該物件之輪廓圖,以使物件深度產生模組接收物件之輪廓圖,並產生物件之深度值。從而實現能夠讓使用者便於操作,進而提升影像生成之速度與品質。In summary, according to the depth image generation system and the depth image generation method of the present invention, an object image is selected by using the object capture module, and an outline image of the object is generated to make the object depth generated. The module receives the contour map of the object and produces the depth value of the object. Therefore, the user can operate easily, thereby improving the speed and quality of image generation.
以上所述僅為舉例性,而非為限制性者。任何未脫離本發明之精神與範疇,而對其進行之等效修改或變更,均應包含於後附之申請專利範圍中。The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.
1、3...深度影像產生系統1, 3. . . Depth image generation system
11...物件擷取模組11. . . Object capture module
12...物件深度產生模組12. . . Object depth generation module
13...影像顯示模組13. . . Image display module
2...電腦裝置2. . . Computer device
21...顯示器twenty one. . . monitor
C1...第一指令C1. . . First instruction
C2...第二指令C2. . . Second instruction
S01~S02...深度影像生成方法的步驟S01~S02. . . Steps of the depth image generation method
圖1為依據本發明較佳實施例之一種深度影像產生系統的示意圖;1 is a schematic diagram of a depth image generating system in accordance with a preferred embodiment of the present invention;
圖2為依據本發明較佳實施例之一種深度影像產生系統的示意圖;2 is a schematic diagram of a depth image generation system in accordance with a preferred embodiment of the present invention;
圖3為依據本發明較佳實施例之一種深度影像產生系統之深度影像生成方法的流程圖;以及3 is a flowchart of a depth image generation method of a depth image generation system according to a preferred embodiment of the present invention;
圖4A至圖4D為依據本發明較佳實施例之深度影像生成方法之影像生成的示意圖。4A-4D are schematic diagrams showing image generation of a depth image generation method according to a preferred embodiment of the present invention.
1...深度影像產生系統1. . . Depth image generation system
11...物件擷取模組11. . . Object capture module
12...物件深度產生模組12. . . Object depth generation module
2...電腦裝置2. . . Computer device
21...顯示器twenty one. . . monitor
C1...第一指令C1. . . First instruction
C2...第二指令C2. . . Second instruction
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW99128140A TWI439962B (en) | 2010-08-23 | 2010-08-23 | Intuitive image depth generation system and image depth generation method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW99128140A TWI439962B (en) | 2010-08-23 | 2010-08-23 | Intuitive image depth generation system and image depth generation method |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201209757A TW201209757A (en) | 2012-03-01 |
TWI439962B true TWI439962B (en) | 2014-06-01 |
Family
ID=46763750
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW99128140A TWI439962B (en) | 2010-08-23 | 2010-08-23 | Intuitive image depth generation system and image depth generation method |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI439962B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI618031B (en) * | 2017-04-12 | 2018-03-11 | 和碩聯合科技股份有限公司 | Edge detection method of image |
-
2010
- 2010-08-23 TW TW99128140A patent/TWI439962B/en active
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI618031B (en) * | 2017-04-12 | 2018-03-11 | 和碩聯合科技股份有限公司 | Edge detection method of image |
Also Published As
Publication number | Publication date |
---|---|
TW201209757A (en) | 2012-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109670558B (en) | Digital image completion using deep learning | |
US10606533B2 (en) | Editing an image on a medium using a template including attribute information of an object in the image | |
KR102476294B1 (en) | Determining the Suitability of Digital Images for Creating AR/VR Digital Content | |
US9674425B2 (en) | Image acquisition method and apparatus | |
JP2005251166A5 (en) | ||
CN106997613B (en) | 3D model generation from 2D images | |
CN107621932B (en) | Local amplification method and device for display image | |
JP7213616B2 (en) | Information processing device, information processing program, and information processing method. | |
US9569888B2 (en) | Depth information-based modeling method, graphic processing apparatus and storage medium | |
TWI547853B (en) | System and method for displaying user interface | |
GB2523882A (en) | Hint based spot healing techniques | |
CN104731855A (en) | Method and device for displaying image resources of WeChat friend circle | |
US11238623B2 (en) | Automatic line drawing coloring program, automatic line drawing coloring apparatus, and graphical user interface program | |
CN111787240B (en) | Video generation method, apparatus and computer readable storage medium | |
US20020175923A1 (en) | Method and apparatus for displaying overlapped graphical objects using depth parameters | |
US11003467B2 (en) | Visual history for content state changes | |
TWI439962B (en) | Intuitive image depth generation system and image depth generation method | |
US20170017370A1 (en) | Device and method for processing data | |
CN106598315B (en) | Touch display device and background image replacement method thereof | |
JP2019221001A5 (en) | ||
JP6182930B2 (en) | Depth production support device, depth production method, and program | |
WO2016187769A1 (en) | Method and device for achieving multilayer smoke special effect in video | |
CN106527774B (en) | Processing method and device for non-contact input handwriting | |
AU2015271981A1 (en) | Method, system and apparatus for modifying a perceptual attribute for at least a part of an image | |
US8875035B2 (en) | Graphical representation of out-of-bound image selection |