TWI640744B - Depth sensing photography system - Google Patents

Depth sensing photography system Download PDF

Info

Publication number
TWI640744B
TWI640744B TW106136779A TW106136779A TWI640744B TW I640744 B TWI640744 B TW I640744B TW 106136779 A TW106136779 A TW 106136779A TW 106136779 A TW106136779 A TW 106136779A TW I640744 B TWI640744 B TW I640744B
Authority
TW
Taiwan
Prior art keywords
image
depth
unit
light source
photography system
Prior art date
Application number
TW106136779A
Other languages
Chinese (zh)
Other versions
TW201917347A (en
Inventor
許玄岳
陳家煌
傅韋翔
Original Assignee
合盈光電科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 合盈光電科技股份有限公司 filed Critical 合盈光電科技股份有限公司
Priority to TW106136779A priority Critical patent/TWI640744B/en
Application granted granted Critical
Publication of TWI640744B publication Critical patent/TWI640744B/en
Publication of TW201917347A publication Critical patent/TW201917347A/en

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

本發明有關於一種深度感測攝影系統,是一種結合雙重視覺影像與閃爍式結構光之雙重優點以獲取待測物之深度資訊的攝影系統,本發明包括光源單元、第一影像擷取單元、第二影像擷取單元、影像比對單元、影像處理單元與深度計算單元;藉此,本發明藉由立體雙視覺攝影方式以對抗環境光源並計算待測物的深度距離資訊,並結合具備主動式光源的閃爍式光學圖樣加強較微弱之紋理區域的特徵與距離擷取,有效解決傳統深度感測攝影機無法於黑暗環境中擷取待測物特徵點而導致無法量測深度資訊之缺點,確實達到提升待測物之深度距離量測的精準度等優勢。 The present invention relates to a depth-sensing photographic system, which is a photographic system that combines the dual advantages of dual visual images and flashing structured light to obtain depth information of an object to be measured. The present invention includes a light source unit, a first image capture unit, The second image capture unit, image comparison unit, image processing unit and depth calculation unit; thereby, the present invention uses stereo dual-vision photography to counter the ambient light source and calculate the depth distance information of the object to be measured, combined with the active The flashing optical pattern of the built-in light source enhances the feature and distance capture of the weaker texture area, effectively solving the disadvantage that the traditional depth sensing camera cannot capture the feature points of the object to be measured in a dark environment, resulting in the inability to measure depth information. To achieve the advantages of improving the accuracy of the depth and distance measurement of the object to be measured.

Description

深度感測攝影系統 Depth Sensing Photography System

本發明係有關於一種深度感測攝影系統,尤其是指一種結合雙重視覺影像與閃爍式結構光之雙重優點以獲取待測物之深度資訊的攝影系統。 The invention relates to a depth-sensing photography system, in particular to a photography system that combines the dual advantages of dual visual images and flashing structured light to obtain depth information of the object to be measured.

按,隨著3D攝影機的日益普及,立體視覺技術已經被廣泛應用到科學研究、文化解析或影音娛樂等相關領域;一般而言,形成立體影像可藉由下列幾種方式完成,例如利用可獲得深度資訊的深度攝影機進行目標物之拍攝,或是以模擬人類雙眼視覺的雙攝影機進行目標物拍攝,再將拍攝到目標物的二維影像經過適當的影像處理而得到三維的立體影像;所謂的立體影像即是除了一般的二維平面影像外,還要對影像中的物件賦予不同的深度資訊,在傳統以雙視覺呈現的二維影像轉換為三維影像的立體匹配(stereo matching)技術中,通常是將兩個影像中的一個影像作為參考圖像,而另一個影像作為目標圖像,並輸出目標圖像相對於參考圖像的視差圖(disparity map),且每一個像素的視差與被拍攝物體的距離係呈反比,故視差圖可以用來描述所拍攝之圖像的立體深度資訊;然而,雙視覺的影像擷取系統仍存在有一些缺點,例如在一大片白色的牆壁等目標物的影像擷取方面,由於其表面紋理較微弱,光是靠影像視覺是無法有效擷取目標物的深度資訊;此外,在極為黑暗的環境下,由於缺少光源的輔助, 雙視覺影像擷取系統在無法擷取任何影像的情況下,更遑論目標物之深度資訊的取得;因此,如何有效藉由創新的硬體設計,解決傳統深度感測攝影機無法於黑暗環境中或表面紋理較微弱之區域擷取待測物之特徵點而導致無法量測其深度資訊之缺點,仍是立體影像擷取系統等相關產業開發業者與相關研究人員需持續努力克服與解決之課題。 With the increasing popularity of 3D cameras, stereoscopic vision technology has been widely used in related fields such as scientific research, cultural analysis or audio-visual entertainment; generally speaking, the formation of stereoscopic images can be accomplished in the following ways, for example, by using The depth camera of the depth information is used to shoot the target object, or the dual-camera that simulates human binocular vision is used to shoot the target object, and then the two-dimensional image of the target object is processed through appropriate image processing to obtain a three-dimensional stereoscopic image; the so-called In addition to the general two-dimensional plane image, the stereoscopic image is also given different depth information to the objects in the image. In the traditional stereo matching technology where the two-dimensional image presented by dual vision is converted into a three-dimensional image , Usually one of the two images is used as the reference image, and the other image is used as the target image, and the disparity map of the target image relative to the reference image is output, and the disparity of each pixel is The distance of the object being shot is inversely proportional, so the parallax map can be used to describe the stereoscopic depth information of the captured image; however, the dual vision image capture system still has some shortcomings, such as a large white wall and other targets In terms of image capture of objects, due to the weak surface texture, it is impossible to effectively capture the depth information of the target object only by image vision; in addition, in extremely dark environments, due to the lack of light source assistance, The dual-vision image capture system can't capture the depth information of the target when it can't capture any images; therefore, how to effectively solve the problem that traditional depth-sensing cameras cannot be in a dark environment or through innovative hardware design The defect of capturing the feature points of the object to be measured in the area with weak surface texture and making it impossible to measure its depth information is still a problem that needs to be continuously overcome and solved by related industry developers and related researchers such as stereoscopic image capture systems.

今,發明人即是鑑於傳統雙視覺影像擷取系統於實際實施時仍存在有諸多缺失,於是乃一本孜孜不倦之精神,並藉由其豐富之專業知識及多年之實務經驗所輔佐,而加以改善,並據此研創出本發明。 Today, the inventor is considering that the traditional dual-vision image capture system still has many shortcomings in actual implementation, so it is a tireless spirit, supplemented by its rich professional knowledge and many years of practical experience. Improve, and research and create the present invention accordingly.

本發明主要目的為提供一種深度感測攝影系統,尤其是指一種結合雙重視覺影像與閃爍式結構光之雙重優點以獲取待測物之深度資訊的攝影系統,主要係藉由立體雙視覺攝影方式以對抗環境光源並計算待測物的深度距離資訊,並結合具備主動式光源的閃爍式光學圖樣加強較微弱之紋理區域的特徵與距離擷取,有效解決傳統深度感測攝影機無法於黑暗環境中擷取待測物特徵點而導致無法量測其深度資訊之缺點,確實達到提升待測物之深度距離量測的精準度等優勢者。 The main purpose of the present invention is to provide a depth-sensing photographic system, in particular to a photographic system that combines the dual advantages of dual visual images and flashing structured light to obtain depth information of an object to be measured, mainly by stereo dual-vision photography To counter the ambient light source and calculate the depth distance information of the object to be measured, combined with the flashing optical pattern with active light source to enhance the characteristics and distance of the weaker texture area, effectively solve the traditional depth sensing camera can not be in a dark environment The shortcomings of capturing the feature points of the object to be measured and making it impossible to measure its depth information have indeed achieved advantages such as improving the accuracy of the measurement of the depth of the object to be measured.

為了達到上述之實施目的,本發明人提出一種深度感測攝影系統,係至少包括有一光源單元、一第一影像擷取單元、一第二影像擷取單元、一影像比對單元、一影像處理單元,以及一深度計算單元;光源單元係發射一包括有至少一光學圖樣的閃爍式光束,其中光學圖樣係因照射於至少一待測物上而產生變化;第一影像擷取單元係設置於光源單元之一側部,第一影像擷取單元係包括有一第一光學鏡頭,以及一連接第一光學 鏡頭之第一感光元件,其中第一光學鏡頭係擷取待測物及/或光學圖樣之連續時間的第一影像與第二影像而分別於第一感光元件上成像;第二影像擷取單元係對應第一影像擷取單元而設置於光源單元之另一側部,第二影像擷取單元係包括有一第二光學鏡頭,以及一連接第二光學鏡頭之第二感光元件,其中第二光學鏡頭係擷取待測物及/或光學圖樣之連續時間的第三影像與第四影像而分別於該第二感光元件上成像;影像比對單元係分別以電性連接第一影像擷取單元與第二影像擷取單元,影像比對單元係接收第一影像、第二影像、第三影像,以及第四影像,並比對第一影像與第二影像之間的差異以獲得一第五影像,以及比對第三影像與第四影像之間的差異以獲得一第六影像;影像處理單元係分別以電性連接第一影像擷取單元、第二影像擷取單元,以及影像比對單元,影像處理單元係包括有一深度比對模組,以及一電性連接深度比對模組之深度計算模組,深度比對模組係接收第一影像、第二影像、第三影像、第四影像、第五影像,以及第六影像,並比對第一影像與第三影像、第二影像與第四影像,以及第五影像與第六影像之間至少一特徵點的差異,以各獲得一具有一第一深度值、一第二深度值,以及一第三深度值之待測物的第七影像、第八影像,以及第九影像,深度計算模組係接收第七影像、第八影像,以及第九影像,並計算影像之深度平均值,以獲得一具有一最終深度值之第十影像。 In order to achieve the above-mentioned implementation objective, the present inventor proposes a depth sensing photography system, which at least includes a light source unit, a first image capture unit, a second image capture unit, an image comparison unit, and an image processing Unit, and a depth calculation unit; the light source unit emits a scintillating light beam including at least one optical pattern, wherein the optical pattern is changed by being irradiated on at least one object to be measured; the first image capturing unit is provided at On one side of the light source unit, the first image capture unit includes a first optical lens and a connection to the first optical The first photosensitive element of the lens, wherein the first optical lens captures the first image and the second image of the test object and / or the optical pattern in continuous time to form images on the first photosensitive element; the second image capturing unit It is arranged on the other side of the light source unit corresponding to the first image capturing unit. The second image capturing unit includes a second optical lens and a second photosensitive element connected to the second optical lens, wherein the second optical The lens captures the third image and the fourth image of the continuous time of the object to be measured and / or the optical pattern to form images on the second photosensitive element; the image comparison unit is electrically connected to the first image capture unit With the second image capture unit, the image comparison unit receives the first image, the second image, the third image, and the fourth image, and compares the difference between the first image and the second image to obtain a fifth Image, and comparing the difference between the third image and the fourth image to obtain a sixth image; the image processing unit is electrically connected to the first image capturing unit, the second image capturing unit, and the image comparison, respectively Unit, the image processing unit includes a depth comparison module, and a depth calculation module electrically connected to the depth comparison module, the depth comparison module receives the first image, the second image, the third image, the first Four images, a fifth image, and a sixth image, and compare the difference between at least one characteristic point between the first image and the third image, the second image and the fourth image, and the fifth image and the sixth image, with each A seventh image, an eighth image, and a ninth image of the object to be measured with a first depth value, a second depth value, and a third depth value are obtained. The depth calculation module receives the seventh image, the first image The eight images and the ninth image, and the depth average of the images is calculated to obtain a tenth image with a final depth value.

如上所述的深度感測攝影系統,其中深度感測攝影系統係可進一步設置於一殼體。 The depth-sensing photography system as described above, wherein the depth-sensing photography system can be further disposed in a casing.

如上所述的深度感測攝影系統,其中光源單元、第一影像擷取單元,以及第二影像擷取單元係嵌設於殼體之一端面。 As described above in the depth-sensing photography system, the light source unit, the first image capturing unit, and the second image capturing unit are embedded on one end face of the housing.

如上所述的深度感測攝影系統,其中影像比對單元與影像處理單元,以及深度計算單元係設置於殼體之內部。 As described above, in the depth-sensing photography system, the image comparison unit, the image processing unit, and the depth calculation unit are disposed inside the housing.

如上所述的深度感測攝影系統,其中光源單元係為發光二極體(LED)、雷射或用以輸出一光束之發光元件等其中之一種裝置。 As described above in the depth sensing photography system, the light source unit is one of light emitting diode (LED), laser, or light emitting element for outputting a light beam.

如上所述的深度感測攝影系統,其中光學圖樣係為網格、直線、規則排列點或不規則排列點等其中之一種態樣。 In the depth sensing photography system as described above, the optical pattern is one of grid, straight line, regularly arranged points or irregularly arranged points.

如上所述的深度感測攝影系統,其中第一光學鏡頭與第二光學係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種裝置。 As described above in the depth sensing photography system, the first optical lens and the second optical system are one of fisheye lens, wide-angle lens or standard lens.

如上所述的深度感測攝影系統,其中第一感光元件與第二感光元件係為光電耦合元件(Charge Coupled Device,CCD)或互補金屬氧化物半導體(Complementary Metal-Oxide-Semiconductor,CMOS)等其中之一種裝置。 The depth sensing photography system as described above, wherein the first photosensitive element and the second photosensitive element are photocoupled devices (Charge Coupled Device, CCD) or complementary metal oxide semiconductor (Complementary Metal-Oxide-Semiconductor, CMOS), etc. A device.

如上所述的深度感測攝影系統,其中第一光學鏡頭與第二光學鏡頭擷取影像之頻率係等於光源單元之光束的閃爍頻率。 In the depth sensing photography system as described above, the frequency at which the first optical lens and the second optical lens capture images is equal to the flicker frequency of the light beam of the light source unit.

如上所述的深度感測攝影系統,其中第一影像係為光源單元恆亮時,第一光學鏡頭擷取待測物與光學圖樣之影像。 As described above in the depth sensing photography system, wherein the first image is when the light source unit is constantly bright, the first optical lens captures images of the object to be measured and the optical pattern.

如上所述的深度感測攝影系統,其中第二影像係為光源單元暗滅時,第一光學鏡頭擷取待測物之影像。 As described above in the depth sensing photography system, wherein the second image is when the light source unit is dimmed, the first optical lens captures the image of the object to be measured.

如上所述的深度感測攝影系統,其中第五影像係為第一影像與第二影像相減的差值,係僅具有光學圖樣之影像。 As described above in the depth-sensing photography system, the fifth image is the difference between the first image and the second image, and is an image with only optical patterns.

如上所述的深度感測攝影系統,其中第三影像係為光源單元恆亮時,第二光學鏡頭擷取待測物與光學圖樣之影像。 As described above in the depth sensing photography system, wherein the third image is when the light source unit is constantly on, the second optical lens captures images of the object to be measured and the optical pattern.

如上所述的深度感測攝影系統,其中第四影像係為光源單元暗滅時,第二光學鏡頭擷取待測物之影像。 As described above in the depth sensing photography system, wherein the fourth image is when the light source unit is dimmed, the second optical lens captures the image of the object to be measured.

如上所述的深度感測攝影系統,其中第六影像係為第三影像與第四影像相減的差值,係僅具有光學圖樣之影像。 In the above-mentioned depth-sensing photography system, the sixth image is the difference between the third image and the fourth image, and is an image with only optical patterns.

如上所述的深度感測攝影系統,其中影像處理單元係藉由第一光學鏡頭與第二光學鏡頭所擷取之影像的特徵點差異,利用視差與三角距離量測之方法,計算第一深度值、第二深度值,以及第三深度值。 The depth sensing photography system as described above, wherein the image processing unit calculates the first depth by measuring the difference between the characteristic points of the images captured by the first optical lens and the second optical lens, using the method of parallax and triangle distance measurement Value, second depth value, and third depth value.

藉此,本發明之深度感測攝影系統主要係藉由立體雙視覺攝影方式以對抗環境光源並計算待測物的深度距離資訊,並結合具備主動式光源的閃爍式光學圖樣加強較微弱之紋理區域的特徵與距離擷取,有效解決傳統深度感測攝影機無法於黑暗環境中擷取待測物特徵點而導致無法量測其深度資訊之缺點,確實達到提升待測物之深度距離量測的精準度等優勢者;此外,本發明之深度感測攝影系統主要係藉由光源單元發射至少一個特殊光學圖樣的方式,以加強表面紋理特徵較微弱之目標物的特徵點擷取,有效以光源單元提供之光束解決傳統深度攝影機於黑暗環境中無法精準量測目標物之距離等缺點,確實達到提供所需之光源並精確量測目標物之距離等優勢;最後,本發明之深度感測攝影系統主要係藉由光源單元發射之閃爍式光束,有效以前後兩張影像相減之方式,達到清楚辨識目標物對光學圖樣之形狀的微小變化,確實計算目標物之深度資訊以提供使用者參考之優勢。 In this way, the depth-sensing photography system of the present invention mainly uses stereo dual-vision photography to counter the ambient light source and calculate the depth distance information of the object to be tested, combined with the flickering optical pattern with active light source to strengthen the weaker texture The feature and distance capture of the area effectively solves the defect that the traditional depth-sensing camera cannot capture the feature point of the object to be measured in a dark environment, which can not measure its depth information, and indeed achieves the improvement of the depth of the object to be measured. Advantages such as accuracy; in addition, the depth-sensing photography system of the present invention mainly uses the light source unit to emit at least one special optical pattern to enhance the feature point extraction of the target with weak surface texture features, effectively using the light source The light beam provided by the unit solves the shortcomings of the traditional depth camera, such as the inability to accurately measure the distance of the target in a dark environment, and indeed achieves the advantages of providing the required light source and accurately measuring the distance of the target; finally, the depth sensing photography of the present invention The system mainly uses the flickering light beam emitted by the light source unit to effectively subtract the two images before and after, to clearly identify the slight change of the shape of the target object to the optical pattern, and indeed calculate the depth information of the target object for user reference Advantage.

(1)‧‧‧光源單元 (1) ‧‧‧Light source unit

(11)‧‧‧光學圖樣 (11) ‧‧‧Optical pattern

(111)‧‧‧光點 (111) ‧‧‧light spot

(2)‧‧‧待測物 (2) ‧‧‧ test object

(21)‧‧‧球體 (21) ‧‧‧Sphere

(3)‧‧‧第一影像擷取單元 (3) ‧‧‧First image capture unit

(31)‧‧‧第一光學鏡頭 (31) ‧‧‧First optical lens

(32)‧‧‧第一感光元件 (32) ‧‧‧The first photosensitive element

(4)‧‧‧第二影像擷取單元 (4) ‧‧‧Second image capture unit

(41)‧‧‧第二光學鏡頭 (41) ‧‧‧Second optical lens

(42)‧‧‧第二感光元件 (42) ‧‧‧Second photosensitive element

(5)‧‧‧影像比對單元 (5) ‧‧‧Image comparison unit

(6)‧‧‧影像處理單元 (6) ‧‧‧Image processing unit

(61)‧‧‧深度比對模組 (61) ‧‧‧Depth comparison module

(62)‧‧‧深度計算模組 (62) ‧‧‧Depth calculation module

(7)‧‧‧殼體 (7) ‧‧‧case

(A)‧‧‧特徵點 (A) ‧‧‧Feature points

(A1)‧‧‧第一特徵點 (A1) ‧‧‧First characteristic point

(A2)‧‧‧第二特徵點 (A2) ‧‧‧Second characteristic point

(P1)‧‧‧第一影像 (P1) ‧‧‧First image

(P2)‧‧‧第二影像 (P2) ‧‧‧Second image

(P5)‧‧‧第五影像 (P5) ‧‧‧ fifth image

第1圖:本發明深度感測攝影系統其一較佳實施例之系統架構方塊圖 Figure 1: Block diagram of the system architecture of a preferred embodiment of the depth sensing photography system of the present invention

第2圖(A)~(C):本發明深度感測攝影系統其一較佳實施例之第一影像擷取單元影像擷取示意圖 Figure 2 (A) ~ (C): A schematic diagram of image capture of a first image capture unit of a preferred embodiment of the depth sensing photography system of the present invention

為利 貴審查委員瞭解本發明之技術特徵、內容、優點,以及其所能達成之功效,茲將本發明配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的權利範圍,合先敘明。 In order to facilitate your examination committee to understand the technical features, content, advantages and achievable effects of the present invention, the present invention is described in detail in conjunction with the drawings and in the form of expressions of the embodiments, and the drawings used therein, Its purpose is only for illustration and supplementary description, and may not be the true scale and precise configuration after the implementation of the present invention, so it should not be interpreted and limited to the relationship between the scale and the configuration of the attached drawings, and the scope of the present invention in the actual implementation is limited , He Xianming.

首先,請參閱第1圖至第2圖(A)~(C)所示,為本發明深度感測攝影系統其一較佳實施例之系統架構方塊圖,以及第一影像擷取單元影像擷取示意圖;本發明之深度感測攝影系統係至少包括有:一光源單元(1),係發射一包括有至少一光學圖樣(11)的閃爍式光束(圖式未標示),其中光學圖樣(11)係因照射於至少一待測物(2)上而產生變化;此外,光源單元(1)係為發光二極體(LED)、雷射或用以輸出一光束之發光元件等其中之一種裝置;再者,光學圖樣(11)係為網格、直線、規則排列點或不規則排列點等其中之一種態樣;此外,深度感測攝影系統係可進一步設置於一殼體(7),而光源單元(1)係嵌設於殼體(7)之一端面;在本發明其一較佳實施例中,以雷射態樣呈現的光源單元(1)係嵌設於殼體(7)之一端面的中心點位置,以發射包括以規則排列點態樣呈現之光學圖樣(11)的光束,其中光束與光學圖樣(11)係具有相同的閃爍頻率,且光學圖樣(11)係因照射於位於光源單元(1)前方之至少一待測物(2)上而產生形狀之變化,其中 待測物(2)係可例如但不限定為置於一平面上之球體(21)等靜物;一第一影像擷取單元(3),係設置於光源單元(1)之一側部,第一影像擷取單元(3)係包括有一第一光學鏡頭(31),以及一連接第一光學鏡頭(31)之第一感光元件(32),其中第一光學鏡頭(31)係擷取待測物(2)及/或光學圖樣(11)之連續時間的第一影像(P1)與第二影像(P2)而分別於第一感光元件(32)上成像;此外,第一光學鏡頭(31)係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種態樣;再者,第一感光元件(32)係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)等其中之一種裝置;此外,第一光學鏡頭(31)擷取影像之頻率係等於光源單元(1)之光束的閃爍頻率;再者,第一影像(P1)係為光源單元(1)恆亮時,第一光學鏡頭(31)擷取待測物(2)與光學圖樣(11)之影像,而第二影像(P2)係為光源單元(1)暗滅時,第一光學鏡頭(31)擷取待測物(2)之影像;在本發明其一較佳實施例中,第一影像擷取單元(3)係對應光源單元(1)而嵌設於殼體(7)相同之端面且設置於光源單元(1)之右側部,且以魚眼鏡頭態樣呈現且內建於第一影像擷取單元(3)之第一光學鏡頭(31)擷取影像的頻率係等於光源單元(1)之光束閃爍的頻率,當第一時間之光束恆亮時,第一光學鏡頭(31)係同時擷取球體(21)之待測物(2)與光學圖樣(11)之影像,以形成第一影像(P1),而當接續之第二時間的光束暗滅時,第一光學鏡頭(31)係僅擷取球體(21)之待測物(2)影像,以形成第二影像(P2);一第二影像擷取單元(4),係對應第一影像擷取單元(3)而設置於光源單元(1)之另一側部,第二影像擷取單元(4)係包括有一第二光學鏡頭(41),以及一連接第二光學鏡頭(41)之第二感光元件(42),其中第二光學鏡頭(41)係擷取待測物(2)及/或光學圖樣(11)之連續時間的第三影像(圖式未 標示)與第四影像(圖式未標示)而分別於第二感光元件(42)上成像;此外,第二光學鏡頭(41)係為魚眼鏡頭、廣角鏡頭或標準鏡頭等其中之一種態樣;再者,第二感光元件(42)係為光電耦合元件(CCD)或互補金屬氧化物半導體(CMOS)等其中之一種裝置;此外,第二光學鏡頭(41)擷取影像之頻率係等於光源單元(1)之光束的閃爍頻率;再者,第三影像係為光源單元(1)恆亮時,第二光學鏡頭(41)擷取待測物(2)與光學圖樣(11)之影像,而第四影像係為光源單元(1)暗滅時,第二光學鏡頭(41)擷取待測物(2)之影像;在本發明其一較佳實施例中,亦即類似第2圖(A)~(C)所示,第二影像擷取單元(4)係相對於第一影像擷取單元(3)而設置於光源單元(1)之左側部,以魚眼鏡頭態樣呈現且內建於第二影像擷取單元(4)之第二光學鏡頭(41)擷取影像的頻率係等於光束的閃爍頻率,當第一時間之光束恆亮時,第二光學鏡頭(41)係同時擷取球體(21)之待測物(2)與光學圖樣(11)之影像,以形成第三影像,而當接續之第二時間的光束暗滅時,第二光學鏡頭(41)僅擷取球體(21)之待測物(2)之影像,以形成第四影像;一影像比對單元(5),係分別以電性連接第一影像擷取單元(3)與第二影像擷取單元(4),影像比對單元(5)係接收第一影像(P1)、第二影像(P2)、第三影像,以及第四影像,並比對第一影像(P1)與第二影像(P2)之間的差異以獲得一第五影像(P5),以及比對第三影像與第四影像之間的差異以獲得一第六影像(圖式未標示);此外,影像比對單元(5)係設置於殼體(7)之內部;再者,第五影像(P5)係為第一影像(P1)與第二影像(P2)相減的差值,係為僅具有光學圖樣(11)之影像;此外,第六影像係為第三影像與第四影像相減的差值,係為僅具有光學圖樣(11)之影像;在本發明其一較佳實施例 中,影像比對單元(5)係設置於殼體(7)之內部,主要功能係處理閃爍式光源單元(1)造成第一影像擷取單元(3)與第二影像擷取單元(4)所擷取之影像間的差異,亦即影像比對單元(5)係比對第一影像擷取單元(3)所擷取之第一影像(P1)與第二影像(P2)之間的差異,以獲得僅具有光學圖樣(11)的第五影像(P5),其中原始光學圖樣(11)係由40個規則排列的光點(111)所組成,當光學圖樣(11)打在待測物(2)上即變成第2圖(A)所示之不規則形狀,相同地,影像比對單元(5)亦比對第二影像擷取單元(4)所擷取之第三影像與第四影像之間的差異,以獲得僅具有光學圖樣(11)的第六影像;以及一影像處理單元(6),係分別以電性連接第一影像擷取單元(3)、第二影像擷取單元(4),以及影像比對單元(5),影像處理單元(6)係包括有一深度比對模組(61),以及一電性連接深度比對模組(61)之深度計算模組(62),深度比對模組(61)係接收第一影像(P1)、第二影像(P2)、第三影像、第四影像、第五影像(P5),以及第六影像,並比對第一影像(P1)與第三影像、第二影像(P2)與第四影像,以及第五影像(P5)與第六影像之間至少一特徵點(A)的差異,以各獲得一具有一第一深度值、一第二深度值,以及一第三深度值之待測物(2)的第七影像(圖式未標示)、第八影像(圖式未標示),以及第九影像(圖式未標示),深度計算模組(62)係接收第七影像、第八影像,以及第九影像,並計算影像之深度平均值,以獲得一具有一最終深度值之第十影像(圖式未標示);此外,影像處理單元(6)係設置於殼體(7)之內部;再者,影像處理單元(6)係藉由第一光學鏡頭(31)與第二光學鏡頭(41)所擷取之影像的特徵點(A)差異,利用視差與三角距離量測之方法,計算第一深度值、第二深度值,以及第三深度值;在本發明其一較佳實施例中,影像處理單 元(6)係設置於殼體(7)之內部,主要功能係比較第一影像擷取單元(3)與第二影像擷取單元(4)於光源單元(1)恆亮或暗滅時所擷取之影像間的特徵點(A)差異,亦即內建於影像處理單元(6)之深度比對模組(61)係於光源單元(1)恆亮時比對第一光學鏡頭(31)所擷取之第一影像(P1)中的第一特徵點(A1)與第二光學鏡頭(41)所擷取之第三影像中的第三特徵點(圖式未標示),以利用視差與三角距離量測之方法獲得具有第一深度值的第七影像,其中第一特徵點(A1)與第三特徵點係為球體(21)之待測物(2)上具有相同座標值之特徵點(A),且深度比對模組(61)亦於光源單元(1)暗滅時比對第一光學鏡頭(31)所擷取之第二影像(P2)中的第二特徵點(A2)與第二光學鏡頭(41)所擷取之第四影像中的第四特徵點(圖式未標示),同樣利用視差與三角距離量測之方法獲得具有第二深度值的第八影像,相同地,深度比對模組(61)亦比對同樣僅具有光學圖樣(11)影像之第五影像(P5)與第六影像之同一座標值之特徵點(A)的影像差異,並利用視差與三角距離量測之方法獲得具有第三深度值的第九影像;最後,內建於影像處理單元(6)之深度計算模組(62)係平均第一深度值、第二深度值,以及第三深度值,以獲得帶有球體(21)之待測物(2)最終深度值的第十影像,其中最終深度值即代表球體(21)之待測物(2)與本發明之深度感測攝影系統之間的距離。 First, please refer to FIGS. 1 to 2 (A) to (C), which is a block diagram of the system architecture of a preferred embodiment of the depth sensing photography system of the present invention, and the image capture of the first image capture unit Take a schematic diagram; the depth-sensing photography system of the present invention at least includes: a light source unit (1), which emits a scintillating light beam (not shown) including at least one optical pattern (11), wherein the optical pattern ( 11) The light source unit (1) is a light-emitting diode (LED), a laser, or a light-emitting element for outputting a light beam, etc. A device; furthermore, the optical pattern (11) is one of grid, line, regular arrangement point or irregular arrangement point, etc. In addition, the depth sensing photography system can be further provided in a casing (7 ), And the light source unit (1) is embedded in one end face of the casing (7); in a preferred embodiment of the present invention, the light source unit (1) presented in a laser form is embedded in the casing (7) The position of the center point of one of the end faces to emit the light beam including the optical pattern (11) presented in a regularly arranged dot pattern, wherein the beam and the optical pattern (11) have the same flicker frequency and the optical pattern (11 ) Is a change in shape due to irradiation on at least one object (2) in front of the light source unit (1), where The object to be measured (2) can be, for example but not limited to, a still life such as a sphere (21) placed on a plane; a first image capturing unit (3) is provided on one side of the light source unit (1), The first image capturing unit (3) includes a first optical lens (31) and a first photosensitive element (32) connected to the first optical lens (31), wherein the first optical lens (31) captures The first image (P1) and the second image (P2) of the continuous time of the test object (2) and / or the optical pattern (11) are respectively imaged on the first photosensitive element (32); in addition, the first optical lens (31) is one of the aspects such as fisheye lens, wide-angle lens or standard lens; furthermore, the first photosensitive element (32) is one of photoelectric coupling element (CCD) or complementary metal oxide semiconductor (CMOS), etc. A device; in addition, the frequency of the image captured by the first optical lens (31) is equal to the flashing frequency of the light beam of the light source unit (1); furthermore, the first image (P1) is when the light source unit (1) is constantly on, The first optical lens (31) captures images of the object to be measured (2) and the optical pattern (11), and the second image (P2) is when the light source unit (1) is dimmed, the first optical lens (31) captures Take an image of the object to be measured (2); in a preferred embodiment of the present invention, the first image capturing unit (3) corresponds to the light source unit (1) and is embedded on the same end surface of the housing (7) and The frequency of the first optical lens (31), which is arranged on the right side of the light source unit (1) and is presented in the form of a fisheye lens and built into the first image capture unit (3), is equal to the frequency of the light source unit ( 1) The frequency of the light beam flicker. When the light beam is constantly bright for the first time, the first optical lens (31) simultaneously captures the image of the object to be measured (2) and the optical pattern (11) of the sphere (21). The first image (P1) is formed, and when the beam of the second time continues to dim, the first optical lens (31) only captures the image of the object (2) of the sphere (21) to form the second image (P2); a second image capturing unit (4), corresponding to the first image capturing unit (3), is disposed on the other side of the light source unit (1), and the second image capturing unit (4) is It includes a second optical lens (41) and a second photosensitive element (42) connected to the second optical lens (41), wherein the second optical lens (41) captures the object to be measured (2) and / or optical The third continuous image of pattern (11) Marked) and the fourth image (not shown in the figure) are imaged on the second photosensitive element (42); in addition, the second optical lens (41) is one of the aspects such as fisheye lens, wide-angle lens or standard lens ; Furthermore, the second photosensitive element (42) is one of photoelectric coupling element (CCD) or complementary metal oxide semiconductor (CMOS) and other devices; in addition, the frequency of the second optical lens (41) to capture images is equal to The flicker frequency of the light beam of the light source unit (1); Furthermore, when the third image is the constant light of the light source unit (1), the second optical lens (41) captures the test object (2) and the optical pattern (11) Image, and the fourth image is when the light source unit (1) is dimmed, the second optical lens (41) captures the image of the object to be measured (2); in a preferred embodiment of the present invention, it is similar to the first 2 (A) ~ (C) shown, the second image capture unit (4) is located on the left side of the light source unit (1) relative to the first image capture unit (3), in a fisheye lens state The frequency of the image captured by the second optical lens (41) of the second image capturing unit (4) is equal to the flicker frequency of the beam. When the beam of the first time is constantly bright, the second optical lens ( 41) The images of the test object (2) and the optical pattern (11) of the sphere (21) are captured at the same time to form a third image, and when the beam of the second time continues to dim, the second optical lens ( 41) Only the image of the test object (2) of the sphere (21) is captured to form a fourth image; an image comparison unit (5) is electrically connected to the first image capture unit (3) and The second image capture unit (4) and the image comparison unit (5) receive the first image (P1), the second image (P2), the third image, and the fourth image, and compare the first image (P1) ) And the second image (P2) to obtain a fifth image (P5), and to compare the difference between the third image and the fourth image to obtain a sixth image (not shown); , The image comparison unit (5) is arranged inside the housing (7); furthermore, the fifth image (P5) is the difference between the first image (P1) and the second image (P2), it is It is an image with only an optical pattern (11); in addition, the sixth image is the difference between the third image and the fourth image, which is an image with only the optical pattern (11); Examples In the image comparison unit (5) is arranged inside the housing (7), the main function is to deal with the flashing light source unit (1) causing the first image capture unit (3) and the second image capture unit (4) ) The difference between the captured images, that is, the image comparison unit (5) compares the first image (P1) and the second image (P2) captured by the first image capture unit (3) To obtain the fifth image (P5) with only the optical pattern (11), where the original optical pattern (11) is composed of 40 regularly arranged light spots (111), when the optical pattern (11) hits The object under test (2) becomes an irregular shape as shown in Figure 2 (A). Similarly, the image comparison unit (5) also compares the third captured by the second image capture unit (4) The difference between the image and the fourth image to obtain the sixth image with only the optical pattern (11); and an image processing unit (6), which are electrically connected to the first image capturing unit (3) and the third Two image capturing units (4), and an image comparison unit (5), the image processing unit (6) includes a depth comparison module (61), and an electrical connection depth comparison module (61) The depth calculation module (62), the depth comparison module (61) receives the first image (P1), the second image (P2), the third image, the fourth image, the fifth image (P5), and the sixth Image, and compare the difference of at least one characteristic point (A) between the first image (P1) and the third image, the second image (P2) and the fourth image, and the fifth image (P5) and the sixth image, To obtain a seventh image (not shown in the figure) and an eighth image (not shown in the figure) of the object to be measured (2) each having a first depth value, a second depth value, and a third depth value , And the ninth image (not shown in the figure), the depth calculation module (62) receives the seventh image, the eighth image, and the ninth image, and calculates the depth average value of the image to obtain a final depth value The tenth image (not shown in the figure); in addition, the image processing unit (6) is provided inside the housing (7); furthermore, the image processing unit (6) is provided by the first optical lens (31) and The difference in feature points (A) of the image captured by the second optical lens (41), using the method of parallax and triangle distance measurement, to calculate the first depth value, the second depth value, and the third depth value; in the present invention In a preferred embodiment, the image processing unit The element (6) is arranged inside the casing (7), the main function is to compare the first image capturing unit (3) and the second image capturing unit (4) when the light source unit (1) is constantly on or off The feature point (A) difference between the captured images, that is, the depth comparison module (61) built in the image processing unit (6) is compared with the first optical lens when the light source unit (1) is constantly bright (31) The first feature point (A1) in the captured first image (P1) and the third feature point (not shown) in the third image captured by the second optical lens (41), A seventh image with a first depth value is obtained by using parallax and triangle distance measurement, where the first feature point (A1) and the third feature point are the same as the object to be measured (2) which is a sphere (21) The feature point (A) of the coordinate value, and the depth comparison module (61) also compares the second image (P2) in the second image (P2) captured by the first optical lens (31) when the light source unit (1) is dimmed The second feature point (A2) and the fourth feature point (not shown in the figure) in the fourth image captured by the second optical lens (41) also use the method of parallax and triangle distance measurement to obtain the second depth value The eighth image of the same, the depth comparison module (61) also compares the feature point (A) of the fifth image (P5) and the sixth image with the same coordinate value of the image with only the optical pattern (11) Image difference, and use the method of parallax and triangle distance measurement to obtain the ninth image with the third depth value; finally, the depth calculation module (62) built in the image processing unit (6) averages the first depth value, The second depth value and the third depth value to obtain the tenth image of the final depth value of the object (2) with the sphere (21), where the final depth value represents the object (2) of the sphere (21) ) And the depth sensing camera system of the present invention.

接著,為使 貴審查委員能進一步瞭解本發明之目的、特徵,以及所欲達成之功效,以下茲舉本發明深度感測攝影系統的具體實際實施例,進一步證明本發明之深度感測攝影系統可實際應用之範圍,但不意欲以任何形式限制本發明之範圍;當一使用者欲量測一待測物(2)之距離時,可使用本發明之深度感測攝影系統量測,主要係藉由立體雙視覺攝影方式 以對抗環境光源並計算待測物(2)的深度距離資訊,並結合具備主動式光源的閃爍式光學圖樣(11)加強較微弱之紋理區域的特徵與距離擷取,有效解決傳統深度感測攝影機無法於黑暗環境中擷取待測物特徵點而導致無法量測其深度資訊之缺點,確實達到提升待測物(2)之深度距離量測的精準度等優勢;首先,準備一光源單元(1),其中光源單元(1)係發射一包括有至少一光學圖樣(11)的閃爍式光束,而光學圖樣(11)係因照射於至少一待測物(2)上而產生變化;接著,準備一第一影像擷取單元(3),其中第一影像擷取單元(3)係設置於光源單元(1)之一側部,第一影像擷取單元(3)係包括有一第一光學鏡頭(31),以及一連接第一光學鏡頭(31)之第一感光元件(32),其中第一光學鏡頭(31)係擷取待測物(2)及/或光學圖樣(11)之連續時間的第一影像(P1)與第二影像(P2)而分別於第一感光元件(32)上成像;接續,準備一第二影像擷取單元(4),其中第二影像擷取單元(4)係對應第一影像擷取單元(3)而設置於光源單元(1)之另一側部,第二影像擷取單元(4)係包括有一第二光學鏡頭(41),以及一連接第二光學鏡頭(41)之第二感光元件(42),其中第二光學鏡頭(41)係擷取待測物(2)及/或光學圖樣(11)之連續時間的第三影像與第四影像而分別於第二感光元件(42)上成像;之後,準備一影像比對單元(5),其中影像比對單元(5)係分別以電性連接第一影像擷取單元(3)與第二影像擷取單元(4),影像比對單元(5)係接收第一影像(P1)、第二影像(P2)、第三影像(P3),以及第四影像,並比對第一影像(P1)與第二影像(P2)之間的差異以獲得一第五影像(P5),以及比對第三影像與第四影像之間的差異以獲得一第六影像;最後,準備一影像處理單元(6),其中影像處理單元(6)係分別以電性連接第一影像擷取單元(3)、第二影像擷取單元(4),以及影像比對單元(5),影像處 理單元(6)係包括有一深度比對模組(61),以及一電性連接深度比對模組(61)之深度計算模組(62),深度比對模組(61)係接收第一影像(P1)、第二影像(P2)、第三影像、第四影像、第五影像(P5),以及第六影像,並比對第一影像(P1)與第三影像、第二影像(P2)與第四影像,以及第五影像(P5)與第六影像之間至少一特徵點(A)的差異,以各獲得一具有一第一深度值、一第二深度值,以及一第三深度值之待測物(2)的第七影像、第八影像,以及第九影像,深度計算模組(62)係接收第七影像、第八影像,以及第九影像,並計算影像之深度平均值,以獲得一具有一最終深度值之第十影像;另外,本發明之深度感測攝影系統係組設於一殼體(7),主要係藉由第一影像擷取單元(3)與第二影像擷取單元(4)之立體雙視覺攝影方式,有效對抗環境光源並計算待測物(2)的深度距離資訊,並結合光源單元(1)之閃爍式光學圖樣(11)加強較微弱之紋理區域的特徵與距離擷取,確實達到提升待測物(2)之深度距離量測的精準度等優勢。 Next, in order to enable your reviewer to further understand the purpose, features, and desired effects of the present invention, the following specific practical embodiments of the depth-sensing photography system of the present invention are used to further prove the depth-sensing photography system of the present invention. The range of practical application, but it is not intended to limit the scope of the present invention in any form; when a user wants to measure the distance of an object (2), the depth sensing camera system of the present invention can be used to measure, mainly By stereoscopic dual vision photography To counter the ambient light source and calculate the depth distance information of the object to be measured (2), combined with the flashing optical pattern (11) with active light source to strengthen the feature and distance capture of the weaker texture area, effectively solve the traditional depth sensing The camera is unable to capture the feature points of the object to be measured in a dark environment, which results in the inability to measure the depth information. It does achieve the advantages of improving the accuracy of the depth measurement of the object to be measured (2); first, prepare a light source unit (1), wherein the light source unit (1) emits a scintillating light beam including at least one optical pattern (11), and the optical pattern (11) is changed by being irradiated on at least one object to be measured (2); Next, prepare a first image capturing unit (3), wherein the first image capturing unit (3) is disposed on a side of the light source unit (1), and the first image capturing unit (3) includes a first An optical lens (31) and a first photosensitive element (32) connected to the first optical lens (31), wherein the first optical lens (31) captures the object to be measured (2) and / or the optical pattern (11) ) Continuous time of the first image (P1) and the second image (P2) are imaged on the first photosensitive element (32); then, prepare a second image capture unit (4), wherein the second image capture The fetching unit (4) corresponds to the first image capturing unit (3) and is disposed on the other side of the light source unit (1). The second image capturing unit (4) includes a second optical lens (41). And a second photosensitive element (42) connected to the second optical lens (41), wherein the second optical lens (41) is the third in continuous time to capture the object to be measured (2) and / or the optical pattern (11) The image and the fourth image are respectively imaged on the second photosensitive element (42); after that, an image comparison unit (5) is prepared, wherein the image comparison unit (5) is electrically connected to the first image capture unit respectively (3) With the second image capture unit (4), the image comparison unit (5) receives the first image (P1), the second image (P2), the third image (P3), and the fourth image, and Comparing the difference between the first image (P1) and the second image (P2) to obtain a fifth image (P5), and comparing the difference between the third image and the fourth image to obtain a sixth image; Finally, prepare an image processing unit (6), wherein the image processing unit (6) is electrically connected to the first image capture unit (3), the second image capture unit (4), and the image comparison unit ( 5), Image Department The processing unit (6) includes a depth comparison module (61) and a depth calculation module (62) electrically connected to the depth comparison module (61). The depth comparison module (61) receives the first An image (P1), a second image (P2), a third image, a fourth image, a fifth image (P5), and a sixth image, and compare the first image (P1) with the third image and the second image (P2) the difference between at least one feature point (A) and the fourth image, and between the fifth image (P5) and the sixth image to obtain a first depth value, a second depth value, and a The seventh image, the eighth image, and the ninth image of the object to be measured (2) of the third depth value, the depth calculation module (62) receives the seventh image, the eighth image, and the ninth image, and calculates the image The average depth value to obtain a tenth image with a final depth value; in addition, the depth sensing camera system of the present invention is set in a housing (7), mainly by the first image acquisition unit ( 3) Stereo dual-vision photography with the second image capture unit (4), effectively counters the ambient light source and calculates the depth distance information of the test object (2), combined with the flashing optical pattern of the light source unit (1) ) Strengthen the feature and distance capture of the weaker texture area, and indeed achieve the advantages of improving the accuracy of the depth and distance measurement of the object (2).

由上述之實施說明可知,本發明之深度感測攝影系統與現有技術相較之下,本發明係具有以下優點: It can be seen from the above implementation description that the depth sensing photography system of the present invention has the following advantages compared with the prior art:

1.本發明之深度感測攝影系統主要係藉由立體雙視覺攝影方式以對抗環境光源並計算待測物的深度距離資訊,並結合具備主動式光源的閃爍式光學圖樣加強較微弱之紋理區域的特徵與距離擷取,有效解決傳統深度感測攝影機無法於黑暗環境中擷取待測物特徵點而導致無法量測其深度資訊之缺點,確實達到提升待測物之深度距離量測的精準度等優勢者。 1. The depth-sensing photography system of the present invention mainly uses stereo dual-vision photography to counter the ambient light source and calculate the depth distance information of the object to be tested, combined with the flashing optical pattern with active light source to strengthen the weaker texture area The feature and distance capture effectively solves the disadvantage that traditional depth sensing cameras cannot capture the feature points of the object to be measured in a dark environment, resulting in the inability to measure the depth information of the object. Degree advantage.

2.本發明之深度感測攝影系統主要係藉由光源單元發射至 少一個特殊光學圖樣的方式,以加強表面紋理特徵較微弱之目標物的特徵點擷取,有效以光源單元提供之光束解決傳統深度攝影機於黑暗環境中無法精準量測目標物之距離等缺點,確實達到提供所需之光源並精確量測目標物之距離等優勢。 2. The depth-sensing photography system of the present invention is mainly transmitted by the light source unit to One less special optical pattern is used to enhance the feature point acquisition of the target with weak surface texture features, effectively using the light beam provided by the light source unit to solve the shortcomings of the traditional depth camera, such as the inability to accurately measure the distance of the target in a dark environment. The advantages of providing the required light source and accurately measuring the distance of the target are indeed achieved.

3.本發明之深度感測攝影系統主要係藉由光源單元發射之閃爍式光束,有效以前後兩張影像相減之方式,達到清楚辨識目標物對光學圖樣之形狀的微小變化,確實計算目標物之深度資訊以提供使用者參考之優勢。 3. The depth-sensing photography system of the present invention mainly uses the flashing light beam emitted by the light source unit to effectively subtract the two images before and after, to clearly identify the small changes in the shape of the optical pattern of the target object, and indeed calculate the target In-depth information of objects to provide users with the advantage of reference.

綜上所述,本發明之深度感測攝影系統,的確能藉由上述所揭露之實施例,達到所預期之使用功效,且本發明亦未曾公開於申請前,誠已完全符合專利法之規定與要求。爰依法提出發明專利之申請,懇請惠予審查,並賜准專利,則實感德便。 In summary, the depth-sensing photography system of the present invention can indeed achieve the expected use effect through the embodiments disclosed above, and the present invention has not been disclosed before the application, and has fully complied with the provisions of the Patent Law With requirements. I filed an application for a patent for invention in accordance with the law, pleaded for the review, and granted the patent.

惟,上述所揭示之圖示及說明,僅為本發明之較佳實施例,非為限定本發明之保護範圍;大凡熟悉該項技藝之人士,其所依本發明之特徵範疇,所作之其它等效變化或修飾,皆應視為不脫離本發明之設計範疇。 However, the illustrations and descriptions disclosed above are only preferred embodiments of the present invention, and are not intended to limit the scope of protection of the present invention; those who are familiar with the art, according to the characteristic scope of the present invention, do other things Equivalent changes or modifications should be regarded as not departing from the design scope of the present invention.

Claims (16)

一種深度感測攝影系統,係至少包括有:一光源單元,係發射一包括有至少一光學圖樣的閃爍式光束,其中該光學圖樣係因照射於至少一待測物上而產生變化;一第一影像擷取單元,係設置於該光源單元之一側部,該第一影像擷取單元係包括有一第一光學鏡頭,以及一連接該第一光學鏡頭之第一感光元件,其中該第一光學鏡頭係擷取該待測物於連續時間之第一影像與第二影像,且分別於該第一感光元件上成像;一第二影像擷取單元,係對應該第一影像擷取單元而設置於該光源單元之另一側部,該第二影像擷取單元係包括有一第二光學鏡頭,以及一連接該第二光學鏡頭之第二感光元件,其中該第二光學鏡頭係擷取該待測物於連續時間之第三影像與第四影像,且分別於該第二感光元件上成像;一影像比對單元,係分別以電性連接該第一影像擷取單元與該第二影像擷取單元,該影像比對單元係接收該第一影像、該第二影像、該第三影像,以及該第四影像,並比對該第一影像與該第二影像之間的差異以獲得一該待測物之第五影像,以及比對該第三影像與該第四影像之間的差異以獲得一該待測物之第六影像;以及一影像處理單元,係分別以電性連接該第一影像擷取單元、該第二影像擷取單元,以及該影像比對單元,該影像處理單元係包括有一深度比對模組,以及一電性連接該深度比對模組之深度計算模組,該深度比對模組係接收該第一影像、該第二影像、該第三影像、該第四影像、該第五影像,以及該第六影像,並比對該第一影像與該第三影像、該第二影像與該第四影像,以及該第五影像與該第六影像之間至少一特徵點的差異,以各獲得一具有一第一深度值、一第二深度值,以及一第三深度值之該待測物的第七影像、第八影像,以及第九影像,該深度計算模組係接收該第七影像、該第八影像,以及該第九影像,並計算該等影像之深度平均值,以獲得一具有一最終深度值之第十影像。A depth-sensing photography system at least includes: a light source unit that emits a flashing light beam including at least one optical pattern, wherein the optical pattern is changed by being irradiated on at least one object to be measured; a first An image capturing unit is disposed on a side of the light source unit. The first image capturing unit includes a first optical lens and a first photosensitive element connected to the first optical lens, wherein the first The optical lens captures the first image and the second image of the object to be measured in continuous time, and images the first photosensitive element respectively; a second image capturing unit corresponds to the first image capturing unit and Located on the other side of the light source unit, the second image capturing unit includes a second optical lens and a second photosensitive element connected to the second optical lens, wherein the second optical lens captures the The third image and the fourth image of the object to be tested in continuous time are imaged on the second photosensitive element respectively; an image comparison unit is electrically connected to the first image acquisition unit and the second image respectively The capturing unit, the image comparison unit receives the first image, the second image, the third image, and the fourth image, and compares the difference between the first image and the second image to obtain A fifth image of the object to be tested, and a difference between the third image and the fourth image to obtain a sixth image of the object to be tested; and an image processing unit, which are electrically connected respectively The first image capturing unit, the second image capturing unit, and the image comparison unit, the image processing unit includes a depth comparison module, and a depth calculation electrically connected to the depth comparison module Module, the depth comparison module receives the first image, the second image, the third image, the fourth image, the fifth image, and the sixth image, and compares the first image with Differences of at least one feature point between the third image, the second image and the fourth image, and the fifth image and the sixth image to obtain a first depth value and a second depth value, respectively , And a third depth value of the seventh image, the eighth image, and the ninth image of the object to be measured, the depth calculation module receives the seventh image, the eighth image, and the ninth image, and The depth average of the images is calculated to obtain a tenth image with a final depth value. 如申請專利範圍第1項所述之深度感測攝影系統,其中該深度感測攝影系統係進一步設置於一殼體。The depth-sensing photography system as described in item 1 of the patent application scope, wherein the depth-sensing photography system is further provided in a casing. 如申請專利範圍第1或2項所述之深度感測攝影系統,其中該光源單元、該第一影像擷取單元,以及該第二影像擷取單元係嵌設於該殼體之一端面。The depth-sensing photography system as described in item 1 or 2 of the patent application scope, wherein the light source unit, the first image capturing unit, and the second image capturing unit are embedded on one end face of the housing. 如申請專利範圍第1或2項所述之深度感測攝影系統,其中該影像比對單元與該影像處理單元係設置於該殼體之內部。The depth sensing photography system as described in item 1 or 2 of the patent application scope, wherein the image comparison unit and the image processing unit are disposed inside the casing. 如申請專利範圍第1項所述之深度感測攝影系統,其中該光源單元係為發光二極體、雷射或用以輸出一光束之發光元件其中之一。The depth-sensing photography system as described in item 1 of the patent application scope, wherein the light source unit is one of a light-emitting diode, a laser, or a light-emitting element for outputting a light beam. 如申請專利範圍第1項所述之深度感測攝影系統,其中該光學圖樣係為網格、直線、規則排列點或不規則排列點其中之一。The depth sensing photography system as described in item 1 of the patent application scope, wherein the optical pattern is one of a grid, a straight line, a regularly arranged point or an irregularly arranged point. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第一光學鏡頭與該第二光學係為魚眼鏡頭、廣角鏡頭或標準鏡頭其中之一。The depth sensing photography system as described in item 1 of the patent application scope, wherein the first optical lens and the second optical system are one of a fisheye lens, a wide-angle lens, or a standard lens. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第一感光元件與該第二感光元件係為光電耦合元件或互補金屬氧化物半導體其中之一。The depth sensing photography system as described in item 1 of the patent application range, wherein the first photosensitive element and the second photosensitive element are one of a photoelectric coupling element or a complementary metal oxide semiconductor. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第一光學鏡頭與該第二光學鏡頭擷取影像之頻率係等於該光源單元之光束的閃爍頻率。The depth-sensing photography system as described in item 1 of the patent application range, wherein the frequency at which the first optical lens and the second optical lens capture images is equal to the flicker frequency of the light beam of the light source unit. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第一影像係為該光源單元恆亮時,該第一光學鏡頭擷取該待測物與該光學圖樣之影像。As described in item 1 of the patent application scope of the depth sensing photography system, wherein the first image is the light source unit is constantly bright, the first optical lens captures the image of the object to be measured and the optical pattern. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第二影像係為該光源單元暗滅時,該第一光學鏡頭擷取該待測物之影像。As described in item 1 of the patent application scope of the depth sensing photography system, wherein the second image is when the light source unit is dimmed, the first optical lens captures the image of the object to be measured. 如申請專利範圍第1、10、11項所述之深度感測攝影系統,其中該第五影像係為該第一影像與該第二影像相減的差值,係僅具有該光學圖樣之影像。The depth sensing photography system as described in items 1, 10, and 11 of the patent application scope, wherein the fifth image is the difference between the first image and the second image, and is the image with only the optical pattern . 如申請專利範圍第1項所述之深度感測攝影系統,其中該第三影像係為該光源單元恆亮時,該第二光學鏡頭擷取該待測物與該光學圖樣之影像。According to the depth sensing photography system described in item 1 of the patent application scope, wherein the third image is the constant light of the light source unit, the second optical lens captures images of the object to be measured and the optical pattern. 如申請專利範圍第1項所述之深度感測攝影系統,其中該第四影像係為該光源單元暗滅時,該第二光學鏡頭擷取該待測物之影像。As described in item 1 of the patent application scope of the depth sensing photography system, wherein the fourth image is when the light source unit is dimmed, the second optical lens captures the image of the object to be measured. 如申請專利範圍第1、13、14項所述之深度感測攝影系統,其中該第六影像係為該第三影像與該第四影像相減的差值,係僅具有該光學圖樣之影像。The depth sensing photography system as described in items 1, 13, and 14 of the patent application, wherein the sixth image is the difference between the third image and the fourth image, and is an image with only the optical pattern . 如申請專利範圍第1項所述之深度感測攝影系統,其中該影像處理單元係藉由該第一光學鏡頭與該第二光學鏡頭所擷取之影像的特徵點差異,利用視差與三角距離量測之方法,計算該第一深度值、該第二深度值,以及該第三深度值。The depth sensing photography system as described in item 1 of the patent application scope, wherein the image processing unit utilizes the difference between the characteristic points of the images captured by the first optical lens and the second optical lens, using the parallax and the triangular distance The measuring method calculates the first depth value, the second depth value, and the third depth value.
TW106136779A 2017-10-25 2017-10-25 Depth sensing photography system TWI640744B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106136779A TWI640744B (en) 2017-10-25 2017-10-25 Depth sensing photography system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106136779A TWI640744B (en) 2017-10-25 2017-10-25 Depth sensing photography system

Publications (2)

Publication Number Publication Date
TWI640744B true TWI640744B (en) 2018-11-11
TW201917347A TW201917347A (en) 2019-05-01

Family

ID=65034223

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106136779A TWI640744B (en) 2017-10-25 2017-10-25 Depth sensing photography system

Country Status (1)

Country Link
TW (1) TWI640744B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112781520A (en) * 2019-11-06 2021-05-11 奇景光电股份有限公司 Structured light imaging device
TWI795111B (en) * 2021-12-06 2023-03-01 財團法人金屬工業研究發展中心 Interlaced Light Source Imaging System

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103900532A (en) * 2012-12-27 2014-07-02 财团法人工业技术研究院 Depth image capturing device, and calibration method and measurement method thereof
TWI463244B (en) * 2011-04-14 2014-12-01 Ind Tech Res Inst System, device and method for acquiring depth image
US20160142700A1 (en) * 2014-11-19 2016-05-19 Ginni Grover Measuring Accuracy of Image Based Depth Sensing Systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI463244B (en) * 2011-04-14 2014-12-01 Ind Tech Res Inst System, device and method for acquiring depth image
CN103900532A (en) * 2012-12-27 2014-07-02 财团法人工业技术研究院 Depth image capturing device, and calibration method and measurement method thereof
TWI503618B (en) * 2012-12-27 2015-10-11 Ind Tech Res Inst Device for acquiring depth image, calibrating method and measuring method therefore
US20160142700A1 (en) * 2014-11-19 2016-05-19 Ginni Grover Measuring Accuracy of Image Based Depth Sensing Systems

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112781520A (en) * 2019-11-06 2021-05-11 奇景光电股份有限公司 Structured light imaging device
TWI795111B (en) * 2021-12-06 2023-03-01 財團法人金屬工業研究發展中心 Interlaced Light Source Imaging System

Also Published As

Publication number Publication date
TW201917347A (en) 2019-05-01

Similar Documents

Publication Publication Date Title
US11869139B2 (en) System and method for three-dimensional scanning and for capturing a bidirectional reflectance distribution function
US9392262B2 (en) System and method for 3D reconstruction using multiple multi-channel cameras
CN106550228B (en) The equipment for obtaining the depth map of three-dimensional scenic
JP6456156B2 (en) Normal line information generating apparatus, imaging apparatus, normal line information generating method, and normal line information generating program
CN104685318B (en) Motion sensor device, circuit, recording medium and image processing apparatus
CN104395694B (en) Motion sensor device with multiple light sources
EP3371779B1 (en) Systems and methods for forming models of three dimensional objects
WO2018028152A1 (en) Image acquisition device and virtual reality device
CN105004324B (en) A kind of monocular vision sensor with range of triangle function
Ferstl et al. Learning Depth Calibration of Time-of-Flight Cameras.
WO2017089826A1 (en) Systems and methods for forming three-dimensional models of objects
TWI640744B (en) Depth sensing photography system
US10325377B2 (en) Image depth sensing method and image depth sensing apparatus
JP5336325B2 (en) Image processing method
KR102185322B1 (en) System for detecting position using ir stereo camera
CN107392955B (en) Depth of field estimation device and method based on brightness
TWI480507B (en) Method and system for three-dimensional model reconstruction
Moreno et al. Three-dimensional measurement of light-emitting diode radiation pattern: a rapid estimation
CN108616753B (en) Naked eye three-dimensional display method and device
JP5503573B2 (en) Imaging apparatus and image processing information generation program
Zhou A study of microsoft kinect calibration
CN110542393B (en) Plate inclination angle measuring device and measuring method
KR101451792B1 (en) Image rendering apparatus and method thereof
Jin et al. Shadow-Based Lightsource Localization with Direct Camera-Lightsource Geometry
Ahmad et al. Improving photometric stereo through per-pixel light vector calculation