TWI680276B - Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning - Google Patents

Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning Download PDF

Info

Publication number
TWI680276B
TWI680276B TW107130791A TW107130791A TWI680276B TW I680276 B TWI680276 B TW I680276B TW 107130791 A TW107130791 A TW 107130791A TW 107130791 A TW107130791 A TW 107130791A TW I680276 B TWI680276 B TW I680276B
Authority
TW
Taiwan
Prior art keywords
structured light
projection
unit
light image
processing unit
Prior art date
Application number
TW107130791A
Other languages
Chinese (zh)
Other versions
TW202010996A (en
Inventor
陳駿瑋
Chun-Wei Chen
毛清龍
Ching-Lung Mao
楊錦峰
Chin-Feng Yang
Original Assignee
綠點高新科技股份有限公司
Taiwan Green Point Enterprises Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 綠點高新科技股份有限公司, Taiwan Green Point Enterprises Co., Ltd. filed Critical 綠點高新科技股份有限公司
Priority to TW107130791A priority Critical patent/TWI680276B/en
Application granted granted Critical
Publication of TWI680276B publication Critical patent/TWI680276B/en
Publication of TW202010996A publication Critical patent/TW202010996A/en

Links

Landscapes

  • Image Processing (AREA)

Abstract

一種結構光影像產生系統適用於一靜止的目標物件並包含一投影單元、一驅動單元、一拍攝單元及一處理單元。該處理單元控制該驅動單元驅動該投影單元活動至分別對應多個投影區域的多個預定位置,該目標物件位於該等投影區域的至少兩者內,該處理單元並控制該投影單元於每一預定位置將一結構光投影至對應的該投影區域且控制該拍攝單元對一涵蓋該等投影區域的預定拍攝範圍進行拍攝,以產生一對應該投影區域且具有一呈現出該結構光的目標部分的原始影像,該處理單元並根據該等目標部分產生一呈現出受到該結構光投影的該目標物件的結構光影像,以利用該結構光影像建立三維點雲模型,使得三維點雲模型的精細度不再受限於投影單元的性能。A structured light image generating system is suitable for a stationary target object and includes a projection unit, a driving unit, a photographing unit and a processing unit. The processing unit controls the driving unit to drive the projection unit to move to a plurality of predetermined positions respectively corresponding to a plurality of projection areas, the target object is located in at least two of the projection areas, and the processing unit controls the projection unit to each A predetermined position projects a structured light to the corresponding projection area and controls the shooting unit to shoot a predetermined shooting range covering the projection areas to generate a pair of corresponding projection areas and a target portion showing the structured light The processing unit generates a structured light image showing the target object which is projected by the structured light according to the target parts, so as to use the structured light image to establish a three-dimensional point cloud model, so that the three-dimensional point cloud model is fine. The degree is no longer limited by the performance of the projection unit.

Description

用於3D掃描的結構光影像產生方法及系統、數位程式產品及數位計算設備Method and system for generating structured light image for 3D scanning, digital program product and digital computing device

本發明是有關於一種結構光影像產生方法,特別是指一種關於三維點雲模型之建立的結構光影像產生方法。本發明還有關於能實施該結構光影像產生方法的一種結構光影像產生系統、一種數位程式產品及一種數位計算設備。 The invention relates to a method for generating a structured light image, in particular to a method for generating a structured light image related to the establishment of a three-dimensional point cloud model. The invention also relates to a structured light image generating system, a digital program product, and a digital computing device capable of implementing the structured light image generating method.

「結構光」(英文為structured light)泛指以特定的圖樣(Pattern)來呈現光線信息的方式,而常被運用於建立各種立體物件的三維點雲模型。 "Structured light" (structured light in English) generally refers to the way of presenting light information in a specific pattern, and is often used to create three-dimensional point cloud models of various three-dimensional objects.

一種現有的結構光影像產生方法是以一投影機將結構光投影於一目標物件上,接著,再以一相機對被投影結構光的該目標物件進行拍攝,而獲得一結構光影像。 An existing structured light image generating method uses a projector to project structured light onto a target object, and then uses a camera to shoot the target object to be projected structured light to obtain a structured light image.

該結構光影像能用於供一三維建模系統進行分析,具體而言,當結構光被投影於該目標物件上時,結構光的圖樣會因為 該目標物件之表面的深度變化而產生扭曲,而該三維建模系統便能根據結構光圖樣的扭曲情形,計算出該目標物件在該結構光影像中每一個位置的深度資料,進而根據該等深度資料建立該目標物件的三維點雲模型。 The structured light image can be used for analysis by a three-dimensional modeling system. Specifically, when the structured light is projected on the target object, the structured light pattern will be The target object's surface changes in depth to cause distortion, and the three-dimensional modeling system can calculate the depth data of the target object at each position in the structured light image according to the distortion of the structured light pattern, and then based on the The depth data is used to establish a 3D point cloud model of the target object.

由上述說明可知,三維點雲模型的精細度與該結構光影像的影像品質息息相關,也就是說,該投影機的投影性能及該相機的拍攝性能皆會直接影響三維點雲模型的品質,但是,現有的高解析度投影機不但價格昂貴,且其解析度仍遠小於高畫素相機的影像解析度,而導致三維點雲模型的精細度受限於投影機的性能。因此,現有技術仍存在改進的空間。 From the above description, it can be known that the fineness of the 3D point cloud model is closely related to the image quality of the structured light image, that is, the projection performance of the projector and the camera's shooting performance will directly affect the quality of the 3D point cloud model, but Existing high-resolution projectors are not only expensive, but their resolution is still much lower than the image resolution of high-pixel cameras, resulting in the fineness of the 3D point cloud model being limited by the performance of the projector. Therefore, there is still room for improvement in the prior art.

因此,本發明的其中一目的,在於提供一種能改進現有技術的結構光影像產生方法。 Therefore, one object of the present invention is to provide a structured light image generating method which can improve the prior art.

於是,本發明結構光影像產生方法由一結構光影像產生系統對一靜止的目標物件實施,該結構光影像產生系統包含一投影單元、一用於驅動該投影單元活動的驅動單元、一拍攝單元,以及一處理單元,該結構光影像產生方法包含下列步驟:(A)該處理單元控制該驅動單元驅動該投影單元活動至分別對應多個投影區域的多個預定位置,其中,該目標物件位於該等投影區域的其中至 少兩者內;(B)該處理單元控制該投影單元於每一預定位置將一結構光投影至對應的該投影區域;(C)該處理單元於該投影單元將該結構光投影至每一投影區域時,控制該拍攝單元對一涵蓋該等投影區域的預定拍攝範圍進行拍攝,以產生一對應受該投影單元投影之該投影區域的原始影像,每一原始影像具有一呈現出該結構光的目標部分;(D)該處理單元根據該等原始影像的該等目標部分產生一結構光影像,該結構光影像呈現出受到該結構光投影的該目標物件。 Therefore, the structured light image generating method of the present invention is implemented by a structured light image generating system on a stationary target object. The structured light image generating system includes a projection unit, a driving unit for driving the activity of the projection unit, and a photographing unit. And a processing unit, the structured light image generating method includes the following steps: (A) the processing unit controls the driving unit to drive the projection unit to move to a plurality of predetermined positions respectively corresponding to a plurality of projection areas, wherein the target object is located at Of these projection areas Less than two; (B) the processing unit controls the projection unit to project a structured light to the corresponding projection area at each predetermined position; (C) the processing unit projects the structured light to each of the projection units at the projection unit When projecting an area, controlling the shooting unit to shoot a predetermined shooting range covering the projection areas to generate an original image corresponding to the projection area projected by the projection unit. Each original image has a structured light. (D) The processing unit generates a structured light image according to the target portions of the original images, and the structured light image presents the target object projected by the structured light.

在本發明結構光影像產生方法的一些實施態樣中,在步驟(A)中,該等投影區域彼此呈矩陣排列,且每兩個彼此相鄰的該投影區域之間部分重疊,以使得在步驟(C)中,對應於該兩投影區域的該兩原始影像的該兩目標部分分別具有兩個彼此相符的共同區域,且在步驟(D)中,該處理單元是根據該等目標部分的該等共同區域而將該等目標部分以拼接的方式合併而產生該結構光影像。 In some embodiments of the structured light image generating method of the present invention, in step (A), the projection areas are arranged in a matrix with each other, and every two adjacent projection areas are partially overlapped, so that In step (C), the two target portions of the two original images corresponding to the two projection areas have two common areas that coincide with each other, and in step (D), the processing unit is based on the target portions. The common areas are merged with the target parts to generate the structured light image.

在本發明結構光影像產生方法的一些實施態樣中,在步驟(D)中,該處理單元是先擷取每一原始影像的該目標部分並作為一子結構光影像,再將該等子結構光影像以拼接的方式合併而產生該結構光影像。 In some implementation aspects of the structured light image generating method of the present invention, in step (D), the processing unit first captures the target portion of each original image as a substructured light image, and then The structured light images are merged in a stitching manner to produce the structured light images.

在本發明結構光影像產生方法的一些實施態樣中,該 結構光影像產生系統還包含一儲存N個圖樣的儲存單元,其中,N為大於1的整數。在步驟(B)中,該處理單元根據該N個圖樣控制該投影單元於每一預定位置將分別呈現出該N個圖樣的N種結構光依序投影至對應該預定位置的該投影區域。在步驟(C)中,該處理單元於該投影單元將該N種結構光中的每一種結構光投影至該投影區域時,控制該拍攝單元對該預定拍攝範圍進行拍攝,以產生對應受該投影單元投影之該投影區域且分別對應該N個圖樣的N個原始影像。在步驟(D)中,該處理單元產生分別對應該N個圖樣的N個該結構光影像,且每一結構光影像是該處理單元根據該等原始影像中,對應於該N個圖樣中的同一圖樣之該等原始影像的該等目標部分所產生。 In some embodiments of the structured light image generating method of the present invention, the The structured light image generation system further includes a storage unit that stores N patterns, where N is an integer greater than 1. In step (B), the processing unit controls the projection unit to sequentially project the N types of structured light representing the N patterns to the projection area corresponding to the predetermined position at each predetermined position according to the N patterns. In step (C), when the projection unit projects each of the N types of structured light onto the projection area, the processing unit controls the shooting unit to shoot the predetermined shooting range to generate a corresponding receiving area. The projection area projected by the projection unit corresponds to N original images of N patterns. In step (D), the processing unit generates N structured light images corresponding to N patterns, and each structured light image is corresponding to the N patterns in the processing unit according to the original images. Generated by the target portions of the original images of the same pattern.

本發明的另一目的,在於提供一種能實施該結構光影像產生方法的結構光影像產生系統。 Another object of the present invention is to provide a structured light image generation system capable of implementing the structured light image generation method.

本發明結構光影像產生系統適用於一靜止的目標物件,該結構光影像產生系統包含一投影單元、一用於驅動該投影單元活動的驅動單元、一拍攝單元,以及一電連接該投影單元、該驅動單元及該拍攝單元的處理單元。該處理單元控制該驅動單元驅動該投影單元活動至分別對應多個投影區域的多個預定位置,其中,該目標物件位於該等投影區域的其中至少兩者內,該處理單元並控制該投影單元於每一預定位置將一結構光投影至對應的該投影區 域,且於該投影單元將該結構光投影至每一投影區域時,控制該拍攝單元對一涵蓋該等投影區域的預定拍攝範圍進行拍攝,以產生一對應受該投影單元投影之該投影區域的原始影像,每一原始影像具有一呈現出該結構光的目標部分,該處理單元並根據該等原始影像的該等目標部分產生一結構光影像,該結構光影像呈現出受到該結構光投影的該目標物件。 The structured light image generation system of the present invention is suitable for a stationary target object. The structured light image generation system includes a projection unit, a driving unit for driving the projection unit, a photographing unit, and an electrical connection to the projection unit. The driving unit and the processing unit of the photographing unit. The processing unit controls the driving unit to drive the projection unit to move to a plurality of predetermined positions respectively corresponding to a plurality of projection areas, wherein the target object is located in at least two of the projection areas, and the processing unit controls the projection unit. Project a structured light at each predetermined position to the corresponding projection area And when the projection unit projects the structured light onto each projection area, control the shooting unit to shoot a predetermined shooting range covering the projection areas to generate a corresponding projection area projected by the projection unit Each original image has a target portion showing the structured light, the processing unit generates a structured light image according to the target portions of the original image, and the structured light image appears to be subject to the structured light projection The target object.

在本發明結構光影像產生系統的一些實施態樣中,該等投影區域彼此呈矩陣排列,且每兩個彼此相鄰的該投影區域之間部分重疊,以使得對應於該兩投影區域的該兩原始影像的該兩目標部分分別具有兩個彼此相符的共同區域,且該處理單元是根據該等目標部分的該等共同區域而將該等目標部分以拼接的方式合併而產生該結構光影像。 In some embodiments of the structured light image generation system of the present invention, the projection areas are arranged in a matrix with each other, and each two adjacent projection areas are partially overlapped, so that the corresponding projection areas correspond to the two projection areas. The two target parts of the two original images each have two common areas that coincide with each other, and the processing unit combines the target parts in a stitching manner to generate the structured light image according to the common areas of the target parts. .

在本發明結構光影像產生系統的一些實施態樣中,該處理單元是先擷取每一原始影像的該目標部分並作為一子結構光影像,再將該等子結構光影像以拼接的方式合併而產生該結構光影像。 In some embodiments of the structured light image generation system of the present invention, the processing unit first captures the target portion of each original image as a sub-structured light image, and then stitches the sub-structured light images in a stitching manner. Combined to produce the structured light image.

在本發明結構光影像產生系統的一些實施態樣中,該結構光影像產生系統還包含一儲存N個圖樣的儲存單元,且N為大於1的整數,其中,根據該N個圖樣控制該投影單元於每一預定位置將分別呈現出該N個圖樣的N種結構光依序投影至對應該預定位 置的該投影區域,且於該投影單元將該N種結構光中的每一種結構光投影至該投影區域時,控制該拍攝單元對該預定拍攝範圍進行拍攝,以產生對應受該投影單元投影之該投影區域且分別對應該N個圖樣的N個原始影像,且該處理單元是產生分別對應該N個圖樣的N個該結構光影像,且每一結構光影像是該處理單元根據該等原始影像中,對應於該N個圖樣中的同一圖樣之該等原始影像的該等目標部分所產生。 In some implementation forms of the structured light image generation system of the present invention, the structured light image generation system further includes a storage unit storing N patterns, and N is an integer greater than 1, wherein the projection is controlled according to the N patterns. At each predetermined position, the unit sequentially projects the N kinds of structured lights that show the N patterns to the corresponding predetermined positions. The projected area, and when the projection unit projects each of the N types of structured light onto the projection area, controlling the shooting unit to shoot the predetermined shooting range to generate a corresponding projection by the projection unit The projection area corresponds to N original images of N patterns, and the processing unit generates N structured light images corresponding to N patterns, and each structured light image is processed by the processing unit according to In the original image, the target portions of the original images corresponding to the same pattern in the N patterns are generated.

本發明的再一目的,在於提供一種令該結構光影像產生系統能實施該結構光影像產生方法的一種數位程式產品。 Another object of the present invention is to provide a digital program product that enables the structured light image generation system to implement the structured light image generation method.

本發明數位程式產品包含一特定演算法,當該特定演算法被一數位計算設備載入並執行時,能令該數位計算設備完成如前述任一態樣中所述的結構光影像產生方法。 The digital program product of the present invention includes a specific algorithm. When the specific algorithm is loaded and executed by a digital computing device, the digital computing device can complete the structured light image generating method described in any one of the foregoing aspects.

本發明的再一目的,在於提供該結構光影像產生系統中的一種數位計算設備。 Another object of the present invention is to provide a digital computing device in the structured light image generating system.

本發明數位計算設備包含一處理單元,該處理單元適用於電連接一投影單元、一用於驅動該投影單元活動的驅動單元,以及一拍攝單元,且該處理單元能完成如前述任一態樣中所述的結構光影像產生方法。 The digital computing device of the present invention includes a processing unit, which is suitable for electrically connecting a projection unit, a driving unit for driving the activity of the projection unit, and a photographing unit, and the processing unit can complete any of the foregoing aspects. Structured light image generation method as described in.

本發明之功效在於:該處理單元能控制該投影單元將結構光分別投影至該等投影區域,再控制該拍攝單元拍攝分別對應 該等投影區域的該等原始影像,並根據該等原始影像的該等目標部分產生該結構光影像。如此一來,即使該投影單元本身的投影解析度較低,但在該結構光影像中,該目標物件所受到的結構光投影的解析度是近似於該投影單元原本之解析度的數倍,藉此能使該結構光影像的影像品質相較於現有技術大幅地提升,以致利用該結構光影像所建立之三維點雲模型的精細度也能有明顯的改善,而使得三維點雲模型的精細度不再受限於該投影單元的性能。 The effect of the present invention is that the processing unit can control the projection unit to project the structured light to the projection areas respectively, and then control the shooting unit to correspondingly shoot The original images of the projection areas, and the structured light image is generated based on the target portions of the original images. In this way, even if the projection resolution of the projection unit itself is low, in the structured light image, the resolution of the structured light projection received by the target object is several times the original resolution of the projection unit. This can greatly improve the image quality of the structured light image compared with the prior art, so that the fineness of the three-dimensional point cloud model created by using the structured light image can also be significantly improved, which makes the three-dimensional point cloud model The fineness is no longer limited by the performance of the projection unit.

1‧‧‧結構光影像產生系統 1‧‧‧ Structured Light Image Generation System

11‧‧‧數位計算設備 11‧‧‧Digital Computing Equipment

111‧‧‧儲存單元 111‧‧‧Storage unit

112‧‧‧處理單元 112‧‧‧Processing unit

12‧‧‧投影單元 12‧‧‧ Projection Unit

121‧‧‧投影鏡頭 121‧‧‧ projection lens

13‧‧‧驅動單元 13‧‧‧Drive unit

14‧‧‧拍攝單元 14‧‧‧ filming unit

141‧‧‧拍攝鏡頭 141‧‧‧ shooting lens

5‧‧‧目標物件 5‧‧‧ target object

51‧‧‧第一物件部分 51‧‧‧First Object Part

52‧‧‧第二物件部分 52‧‧‧Second Object Section

53‧‧‧第三物件部分 53‧‧‧Third Object Section

54‧‧‧第四物件部分 54‧‧‧ Fourth Object Section

P‧‧‧預定拍攝範圍 P‧‧‧ Scheduled shooting range

A1‧‧‧第一投影區域 A1‧‧‧first projection area

A2‧‧‧第二投影區域 A2‧‧‧Second Projection Area

A3‧‧‧第三投影區域 A3‧‧‧ third projection area

A4‧‧‧第四投影區域 A4‧‧‧Fourth projection area

R12‧‧‧重疊部分 R12‧‧‧ Overlap

R13‧‧‧重疊部分 R13‧‧‧ Overlap

R14‧‧‧重疊部分 R14‧‧‧ Overlap

S1~S10‧‧‧步驟 S1 ~ S10‧‧‧step

本發明之其他的特徵及功效,將於參照圖式的實施方式中清楚地呈現,其中:圖1是本發明結構光影像產生系統之一實施例與一目標物件配合的一方塊圖;圖2是將該實施例用於該目標物件的一使用狀態示意圖;及圖3是一流程圖,示例性地說明該實施例如何對該目標物件實施一結構光影像產生方法。 Other features and effects of the present invention will be clearly presented in the embodiment with reference to the drawings, wherein: FIG. 1 is a block diagram of an embodiment of the structured light image generation system of the present invention and a target object; FIG. 2 It is a schematic diagram of the use state of the embodiment for the target object; and FIG. 3 is a flowchart illustrating how the embodiment implements a structured light image generating method for the target object.

在本發明被詳細描述之前應當注意,在本專利說明書中所指的「電連接」,是包含電子裝置或電子元件之間以導電材料 相連接而彼此傳輸電壓或電流信號的有線連接,以及透過無線通訊協定彼此進行無線通訊的無線連接。 Before the present invention is described in detail, it should be noted that "electrical connection" as referred to in this patent specification refers to the use of conductive materials between electronic devices or electronic components. Wired connections that are connected to transmit voltage or current signals to each other, and wireless connections that perform wireless communication with each other through wireless communication protocols.

參閱圖1,本發明結構光影像產生系統1的一實施例適於與一立體的目標物件5配合,且該結構光影像產生系統1包含一數位計算設備11、一投影單元12、一用於驅動該投影單元12活動的驅動單元13、以及一拍攝單元14。 Referring to FIG. 1, an embodiment of the structured light image generation system 1 of the present invention is suitable for cooperation with a three-dimensional target object 5. The structured light image generation system 1 includes a digital computing device 11, a projection unit 12, A driving unit 13 for driving the projection unit 12 and a photographing unit 14.

該數位計算設備11例如被實施為一台筆記型電腦,且包含一儲存單元111,以及一電連接該儲存單元111、該投影單元12、該驅動單元13及該拍攝單元14的處理單元112。在其他實施例中,該數位計算設備11也可被實施為一桌上型電腦、一平板電腦或者一特製的工業電腦,而不以本實施例為限。 The digital computing device 11 is implemented as, for example, a notebook computer, and includes a storage unit 111 and a processing unit 112 electrically connected to the storage unit 111, the projection unit 12, the driving unit 13, and the photographing unit 14. In other embodiments, the digital computing device 11 may also be implemented as a desktop computer, a tablet computer, or a special industrial computer, without being limited to this embodiment.

該投影單元12例如被實施為一單槍投影機,該驅動單元13例如被實施為一遙控三軸雲台,而該拍攝單元14則例如被實施為一數位相機。在本實施例中,該驅動單元13例如是以承載的方式連接該投影單元12,且能受該處理單元112控制地驅動該投影單元12以X軸、Y軸或Z軸為軸心地活動旋轉。補充說明的是,在其他的實施例中,該驅動單元13也可被實施為一滑軌雲台,並能受該處理單元112控制地驅動該投影單元12以平移的方式活動,或者,該驅動單元13也可被實施為一固持該投影單元12的機械手臂,並能受該處理單元112控制地驅動該投影單元12以旋轉混合平移的 方式活動,而不以本實施例為限。 The projection unit 12 is implemented as, for example, a single-gun projector, the driving unit 13 is implemented as, for example, a remote-controlled three-axis head, and the shooting unit 14 is implemented, for example, as a digital camera. In this embodiment, the driving unit 13 is connected to the projection unit 12 in a load-bearing manner, for example, and can be controlled by the processing unit 112 to drive the projection unit 12 to rotate around the X axis, Y axis, or Z axis. . It is added that, in other embodiments, the driving unit 13 can also be implemented as a sliding track head, and can be controlled by the processing unit 112 to drive the projection unit 12 to move in a translational manner, or The driving unit 13 can also be implemented as a robot arm holding the projection unit 12, and can be controlled by the processing unit 112 to drive the projection unit 12 to rotate and translate. Mode activities, but not limited to this embodiment.

該數位計算設備11的該儲存單元111儲存多個圖樣以及一筆驅動資料。更詳細地說,在本實施例中,該等圖樣是用於供該處理單元112控制該投影單元12投影出分別呈現該等圖樣的多種結構光。舉例來說,該等圖樣可例如是包含了點結構光圖樣、單線結構光圖樣、多線結構光圖樣、圓結構光圖樣、網格結構光圖樣、灰度編碼結構光及彩色結構光圖樣等態樣的組合,但不以此為限。此外,由於該等圖樣的數量愈多,針對該目標物件5所建立之三維點雲模型的精細度愈高,因此在本實施例中,該等圖樣的數量可例如為42個,但在其他實施例中,該等圖樣的數量也可為N個,且N只要為大於或等於1的整數即可實施,而不以本實施例為限。 The storage unit 111 of the digital computing device 11 stores a plurality of patterns and a piece of driving data. In more detail, in this embodiment, the patterns are used for the processing unit 112 to control the projection unit 12 to project a plurality of structured lights that respectively present the patterns. For example, the patterns may include, for example, a point structured light pattern, a single-line structured light pattern, a multi-line structured light pattern, a circle structured light pattern, a grid structured light pattern, a gray-coded structured light, and a color structured light pattern. The combination of aspects, but not limited to this. In addition, since the greater the number of these patterns, the higher the precision of the three-dimensional point cloud model established for the target object 5, so in this embodiment, the number of such patterns may be, for example, 42 but in other In the embodiment, the number of the patterns may also be N, and N may be implemented as long as it is an integer greater than or equal to 1, and is not limited to this embodiment.

該筆驅動資料例如是由一使用者所設定,且例如包含了四個以一預定順序排列的預定位置,而該處理單元112能根據該筆驅動資料控制該驅動單元13,以使該驅動單元13驅動該投影單元12以旋轉的方式依序活動至該四個預定位置,並使該投影單元12所具有的一投影鏡頭121依序對準彼此呈矩陣排列且分別對應該四個預定位置的四個投影區域。如此一來,藉由該驅動單元13的帶動,該投影單元12能對該四個投影區域進行投影。同時參閱圖1與圖2,為了便於說明,在此定義該四個預定位置分別為以該預定順序排列的一第一預定位置、一第二預定位置、一第三預定位置及 一第四預定位置,且如圖2所示地,該四個投影區域則分別為一對應該第一預定位置的第一投影區域A1、一對應該第二預定位置的第二投影區域A2、一對應該第三預定位置的第三投影區域A3,以及一對應該第四預定位置的第四投影區域A4,並且,該第一投影區域A1、該第二投影區域A2、該第三投影區域A3及該第四投影區域A4例如是呈現二乘二的矩陣排列,但不以此為限。附帶說明的是,圖2是示例性地繪示出該投影單元12對該第四投影區域A4投影(以假想線表示)的情形。 The pen driving data is set by a user, for example, and includes four predetermined positions arranged in a predetermined order, and the processing unit 112 can control the driving unit 13 according to the pen driving data, so that the driving unit 13 drives the projection unit 12 to sequentially move to the four predetermined positions in a rotating manner, and causes a projection lens 121 of the projection unit 12 to be sequentially aligned in a matrix arrangement with each other and corresponding to the four predetermined positions. Four projection areas. In this way, by the driving unit 13, the projection unit 12 can project the four projection areas. Referring to FIG. 1 and FIG. 2 at the same time, for convenience of explanation, the four predetermined positions are defined here as a first predetermined position, a second predetermined position, a third predetermined position, and A fourth predetermined position, and as shown in FIG. 2, the four projection areas are a pair of first projection areas A1 corresponding to the first predetermined position, and a pair of second projection areas A2 corresponding to the second predetermined position. A pair of third projection areas A3 corresponding to the third predetermined position and a pair of fourth projection areas A4 corresponding to the fourth predetermined position, and the first projection area A1, the second projection area A2, and the third projection area A3 and the fourth projection area A4 are, for example, a two-by-two matrix arrangement, but are not limited thereto. Incidentally, FIG. 2 exemplarily illustrates a case where the projection unit 12 projects (shown by an imaginary line) the fourth projection area A4.

值得注意的是,在本實施例中,每兩個彼此相鄰的該投影區域之間部分重疊,特別說明的是,此處所述的「相鄰」包含左右關係的相鄰、上下關係的相鄰以及對角關係的相鄰。更具體地說,如圖2所示且以該第一投影區域A1為例,該第一投影區域A1與該第二投影區域A2之間形成因左右相鄰而產生的一重疊部分R12,該第一投影區域A1與該第三投影區域A3之間形成因對角相鄰而產生的一重疊部分R13,而該第一投影區域A1與該第四投影區域A4之間形成因上下相鄰而產生的一重疊部分R14。 It is worth noting that, in this embodiment, each of the two projection areas adjacent to each other partially overlaps. It is specifically noted that the "adjacent" mentioned here includes the left-right relationship and the up-down relationship. Adjacent and diagonally adjacent. More specifically, as shown in FIG. 2 and taking the first projection area A1 as an example, an overlapping portion R12 is formed between the first projection area A1 and the second projection area A2 due to left and right adjacent. An overlapping portion R13 is formed between the first projection area A1 and the third projection area A3 due to diagonally adjacent, and the first projection area A1 and the fourth projection area A4 are formed due to the adjacent adjacent areas. An overlapping portion R14 is generated.

在本實施例中,該拍攝單元14適於被靜止地設置,且該拍攝單元14所具有的一拍攝鏡頭141是朝向該第一投影區域A1至該第四投影區域A4的方向,以使得該拍攝單元14的一預定拍攝範圍P是如圖2所示地涵蓋該第一投影區域A1、該第二投影區域 A2、該第三投影區域A3及該第四投影區域A4。特別說明的是,該目標物件5適於如圖2所示的被靜止地設置在該拍攝單元14的該預定拍攝範圍P內,而且,較佳地,該目標物件5所具有的一第一物件部分51、一第二物件部分52、一第三物件部分53及一第四物件部分54是分別位於該第一投影區域A1、該第二投影區域A2、該第三投影區域A3及該第四投影區域A4內。然而,在其他實施例中,根據該目標物件5的形狀不同,該目標物件5也可被擺置在該第一投影區域A1至該第四投影區域A4的其中兩者或三者中,而並不一定要被所有的該等投影區域所涵蓋,因此並不以本實施例為限。補充說明的是,該目標物件5可例如是一立體物件的整體或者部分,舉例來說,該目標物件5可例如是一人形雕像,或者也可以是該人形雕像所具有的一頭部,但不以此為限。 In this embodiment, the photographing unit 14 is adapted to be set statically, and a photographing lens 141 of the photographing unit 14 is directed toward the first projection area A1 to the fourth projection area A4, so that the A predetermined shooting range P of the shooting unit 14 covers the first projection area A1 and the second projection area as shown in FIG. 2. A2, the third projection area A3 and the fourth projection area A4. It is particularly noted that the target object 5 is suitable for being statically set within the predetermined shooting range P of the photographing unit 14 as shown in FIG. 2, and preferably, a first The object part 51, a second object part 52, a third object part 53, and a fourth object part 54 are respectively located in the first projection area A1, the second projection area A2, the third projection area A3, and the first Within four projection areas A4. However, in other embodiments, depending on the shape of the target object 5, the target object 5 may also be placed in two or three of the first projection area A1 to the fourth projection area A4, and It is not necessary to be covered by all such projection areas, so it is not limited to this embodiment. It is added that the target object 5 may be, for example, the whole or a part of a three-dimensional object. For example, the target object 5 may be, for example, a humanoid statue, or a head of the humanoid statue, but Not limited to this.

在本實施例中,當該數位計算設備11的該處理單元112載入並執行一數位程式產品所包含的一特定演算法時,該處理單元112能控制該投影單元12、該驅動單元13及該拍攝單元14共同對該目標物件5實施一結構光影像產生方法。該數位程式產品可例如是儲存有該特定演算法的光碟片、隨身碟,或也可以是儲存於網路空間而可供下載安裝的一套程式軟體,但不以此為限。 In this embodiment, when the processing unit 112 of the digital computing device 11 loads and executes a specific algorithm included in a digital program product, the processing unit 112 can control the projection unit 12, the driving unit 13 and The shooting unit 14 collectively implements a structured light image generating method for the target object 5. The digital program product may be, for example, a CD-ROM or a pen drive storing the specific algorithm, or may be a set of program software stored in the network space and available for download and installation, but is not limited thereto.

同時參閱圖1至圖3,以下示例性地說明該結構光影像產生系統1如何對該目標物件5實施該結構光影像產生方法。 Referring to FIG. 1 to FIG. 3 at the same time, the following exemplarily illustrates how the structured light image generation system 1 implements the structured light image generation method on the target object 5.

首先,在步驟S1中,該處理單元112根據該筆驅動資料控制該驅動單元13,以令該驅動單元13驅動該投影單元12活動至該第一預定位置,並使該投影單元12的該投影鏡頭121對準該第一投影區域A1。接著,進行步驟S2。 First, in step S1, the processing unit 112 controls the driving unit 13 according to the pen driving data, so that the driving unit 13 drives the projection unit 12 to move to the first predetermined position, and enables the projection of the projection unit 12. The lens 121 is aligned with the first projection area A1. Next, step S2 is performed.

在步驟S2中,該處理單元112控制該投影單元12進行一第一投影程序,並控制該拍攝單元14進行一第一拍攝程序。具體而言,在該第一投影程序中,該處理單元112根據該儲存單元111所儲存的該42個圖樣,控制該投影單元12將分別呈現出該42個圖樣的42種結構光依序投影至該第一投影區域A1。而在該第一拍攝程序中,每當該投影單元12將該42個圖樣的其中一者投影至該第一投影區域A1時,該處理單元112即控制該拍攝單元14對該預定拍攝範圍P進行拍攝,以產生一對應該第一投影區域A1且對應該42個圖樣的其中該者的原始影像,且該處理單元112將每一原始影像儲存至該儲存單元111。 In step S2, the processing unit 112 controls the projection unit 12 to perform a first projection program, and controls the photographing unit 14 to perform a first photographing program. Specifically, in the first projection program, based on the 42 patterns stored in the storage unit 111, the processing unit 112 controls the projection unit 12 to sequentially project 42 types of structured light representing the 42 patterns. To the first projection area A1. In the first shooting program, whenever the projection unit 12 projects one of the 42 patterns to the first projection area A1, the processing unit 112 controls the shooting unit 14 to the predetermined shooting range P Shooting is performed to generate a pair of original images corresponding to the first projection area A1 and corresponding to 42 of the patterns, and the processing unit 112 stores each original image to the storage unit 111.

換句話說,該投影單元12每將一種結構光投影至該第一投影區域A1時,該拍攝單元14就會拍攝一張對應的原始影像,也就是說,該第一投影程序與該第一拍攝程序是交錯進行的,如此一來,在步驟S2進行完畢時,該儲存單元111會儲存有對應於該第一投影區域A1且分別對應該42圖樣的42張原始影像。為了便於說明,在此將對應於該第一投影區域A1的該42張原始影像分別作為 42張第一原始影像。每一張第一原始影像具有一呈現出對應之該圖像的結構光的目標部分,且以本實施例而言,每一張第一原始影像的該目標部分例如是位於該第一原始影像偏向左上角的區域(亦即對應該投影區域A1),且該目標部分呈現出該第一原始影像所對應之該圖像的結構光,以及呈現出該目標物件5受到結構光投影的該第一物件部分51。 In other words, each time the projection unit 12 projects a kind of structured light onto the first projection area A1, the photographing unit 14 captures a corresponding original image, that is, the first projection program and the first The shooting process is performed in an interlaced manner. As a result, when step S2 is completed, the storage unit 111 stores 42 original images corresponding to the first projection area A1 and corresponding to 42 patterns. For convenience of explanation, the 42 original images corresponding to the first projection area A1 are used as 42 first original images. Each first original image has a target portion showing structured light corresponding to the image, and in this embodiment, the target portion of each first original image is, for example, located in the first original image It is biased toward the upper left corner (that is, corresponding to the projection area A1), and the target portion presents the structured light of the image corresponding to the first original image, and the target object 5 is projected by the structured light projection. One object part 51.

接著,進行步驟S3。 Next, step S3 is performed.

在步驟S3中,該處理單元112根據該筆驅動資料控制該驅動單元13,以令該驅動單元13驅動該投影單元12活動至該第二預定位置,並使該投影單元12的該投影鏡頭121對準該第二投影區域A2。接著,進行步驟S4。 In step S3, the processing unit 112 controls the driving unit 13 according to the pen driving data, so that the driving unit 13 drives the projection unit 12 to move to the second predetermined position, and makes the projection lens 121 of the projection unit 12 The second projection area A2 is aligned. Next, step S4 is performed.

在步驟S4中,該處理單元112控制該投影單元12進行一第二投影程序,並控制該拍攝單元14進行一與該第二投影程序交錯的第二拍攝程序。類似於步驟S2地,在該第二投影程序中,該處理單元112根據該儲存單元111所儲存的該42個圖樣控制該投影單元12將該42種結構光依序投影至該第二投影區域A2,而在該第二拍攝程序中,每當該投影單元12將該42個圖樣的其中一者投影至該第二投影區域A2時,該處理單元112控制該拍攝單元14對該預定拍攝範圍P進行拍攝,以產生一對應該第二投影區域A2且對應該42個圖樣之其中該者的原始影像。也就是說,在步驟S4中,該拍攝單 元14會產生另外42張應該第二投影區域A2且分別對應該42個圖樣的原始影像。為了便於說明,在此將對應於該第二投影區域A2的該42張原始影像分別作為42張第二原始影像。該處理單元112並將該42張第二原始影像儲存至該儲存單元111。 In step S4, the processing unit 112 controls the projection unit 12 to perform a second projection program, and controls the photographing unit 14 to perform a second photographing program interleaved with the second projection program. Similar to step S2, in the second projection program, the processing unit 112 controls the projection unit 12 to sequentially project the 42 kinds of structured light onto the second projection area according to the 42 patterns stored in the storage unit 111. A2, and in the second shooting procedure, whenever the projection unit 12 projects one of the 42 patterns to the second projection area A2, the processing unit 112 controls the shooting unit 14 to the predetermined shooting range P performs shooting to generate a pair of original images corresponding to the second projection area A2 and corresponding to one of the 42 patterns. That is, in step S4, the shooting list Yuan 14 will generate another 42 original images that should be the second projection area A2 and corresponding to 42 patterns. For convenience of explanation, the 42 original images corresponding to the second projection area A2 are used as 42 second original images, respectively. The processing unit 112 stores the 42 second original images into the storage unit 111.

每一張第二原始影像亦具有一呈現出對應之該圖像的結構光的目標部分,而該等第二原始影像與該等第一原始影像的不同之處在於,每一張第二原始影像的該目標部分例如是位於該第二原始影像右上角的區域(亦即對應該投影區域A2),且該目標部分呈現出該第二原始影像所對應之該圖像的結構光,以及呈現出該目標物件5受到結構光投影的該第二物件部分52。 Each second original image also has a target portion showing structured light corresponding to the image, and the second original images differ from the first original images in that each second original image The target portion of the image is, for example, an area located at the upper right corner of the second original image (that is, corresponding to the projection area A2), and the target portion presents the structured light of the image corresponding to the second original image, and presents The second object portion 52 where the target object 5 is projected by structured light is shown.

接著,進行步驟S5。 Then, step S5 is performed.

在步驟S5中,該處理單元112根據該筆驅動資料控制該驅動單元13,以令該驅動單元13驅動該投影單元12活動至該第三預定位置,並使該投影單元12的該投影鏡頭121對準該第三投影區域A3。接著,進行步驟S6。 In step S5, the processing unit 112 controls the driving unit 13 according to the pen driving data, so that the driving unit 13 drives the projection unit 12 to move to the third predetermined position, and makes the projection lens 121 of the projection unit 12 The third projection area A3 is aligned. Then, step S6 is performed.

在步驟S6中,該處理單元112控制該投影單元12進行一第三投影程序,並控制該拍攝單元14進行一與該第三投影程序交錯的第三拍攝程序。在該第三投影程序中,該處理單元112根據該儲存單元111所儲存的該42個圖樣控制該投影單元12將該42種結構光依序投影至該第三投影區域A3,而在該第三拍攝程序中,每 當該投影單元12將該42個圖樣的其中一者投影至該第三投影區域A3時,該處理單元112控制該拍攝單元14對該預定拍攝範圍P進行拍攝,以產生一對應該第三投影區域A3且對應該42個圖樣之其中該者的原始影像。也就是說,在步驟S6中,該拍攝單元14會產生另外42張應該第三投影區域A3且分別對應該42個圖樣的原始影像。為了便於說明,在此將對應於該第三投影區域A3的該42張原始影像分別作為42張第三原始影像。該處理單元112並將該42張第三原始影像儲存至該儲存單元111。 In step S6, the processing unit 112 controls the projection unit 12 to perform a third projection program, and controls the photographing unit 14 to perform a third photographing program interleaved with the third projection program. In the third projection program, the processing unit 112 controls the projection unit 12 to sequentially project the 42 types of structured light onto the third projection area A3 according to the 42 patterns stored in the storage unit 111, and in the first projection area, Three shooting programs, each When the projection unit 12 projects one of the 42 patterns to the third projection area A3, the processing unit 112 controls the shooting unit 14 to shoot the predetermined shooting range P to generate a pair of corresponding third projections. Region A3 corresponds to the original image of the 42 patterns. That is, in step S6, the photographing unit 14 generates another 42 original images corresponding to the third projection area A3 and corresponding to 42 patterns. For convenience of explanation, the 42 original images corresponding to the third projection area A3 are used as 42 third original images, respectively. The processing unit 112 stores the 42 third original images into the storage unit 111.

每一張第三原始影像亦具有一呈現出對應之該圖像的結構光的目標部分,且每一張第三原始影像的該目標部分例如是位於該第三原始影像右下角的區域(亦即對應該投影區域A3),且該目標部分呈現出該第三原始影像所對應之該圖像的結構光,以及呈現出該目標物件5受到結構光投影的該第三物件部分53。 Each third original image also has a target portion showing structured light corresponding to the image, and the target portion of each third original image is, for example, a region located in the lower right corner of the third original image (also That is, it corresponds to the projection area A3), and the target portion presents the structured light of the image corresponding to the third original image, and the third object portion 53 where the target object 5 is projected by the structured light.

接著,進行步驟S7。 Next, step S7 is performed.

在步驟S7中,該處理單元112根據該筆驅動資料控制該驅動單元13,以令該驅動單元13驅動該投影單元12活動至該第四預定位置,並使該投影單元12的該投影鏡頭121對準該第四投影區域A4。接著,進行步驟S8。 In step S7, the processing unit 112 controls the driving unit 13 according to the pen driving data, so that the driving unit 13 drives the projection unit 12 to move to the fourth predetermined position, and causes the projection lens 121 of the projection unit 12 to move. The fourth projection area A4 is aligned. Then, step S8 is performed.

在步驟S8中,該處理單元112控制該投影單元12進行一第四投影程序,並控制該拍攝單元14進行一與該第四投影程序交 錯的第四拍攝程序。在該第四投影程序中,該處理單元112根據該儲存單元111所儲存的該42個圖樣控制該投影單元12將該42種結構光依序投影至該第四投影區域A4,而在該第四拍攝程序中,每當該投影單元12將該42個圖樣的其中一者投影至該第四投影區域A4時,該處理單元112控制該拍攝單元14對該預定拍攝範圍P進行拍攝,以產生一對應該第四投影區域A4且對應該42個圖樣之其中該者的原始影像。為了便於說明,在此將步驟S8中所產生的該42張原始影像分別作為42張第四原始影像。該處理單元112並將該42張第四原始影像儲存至該儲存單元111。 In step S8, the processing unit 112 controls the projection unit 12 to perform a fourth projection program, and controls the photographing unit 14 to perform an interaction with the fourth projection program. Wrong fourth shooting procedure. In the fourth projection program, the processing unit 112 controls the projection unit 12 according to the 42 patterns stored in the storage unit 111 to sequentially project the 42 kinds of structured light onto the fourth projection area A4, and in the first projection area A4, In the four shooting procedures, whenever the projection unit 12 projects one of the 42 patterns to the fourth projection area A4, the processing unit 112 controls the shooting unit 14 to shoot the predetermined shooting range P to generate One pair corresponds to the fourth projection area A4 and corresponds to the original image of the 42 patterns. For convenience of explanation, the 42 original images generated in step S8 are used as 42 fourth original images, respectively. The processing unit 112 stores the 42 fourth original images in the storage unit 111.

每一張第四原始影像亦具有一呈現出對應之該圖像的結構光的目標部分,且每一張第四原始影像的該目標部分例如是位於該第四原始影像左下角的區域(亦即對應該投影區域A4),且該目標部分呈現出該第四原始影像所對應之該圖像的結構光,以及該目標物件5受到結構光投影的該第四物件部分54。 Each fourth original image also has a target portion showing structured light corresponding to the image, and the target portion of each fourth original image is, for example, a region located in the lower left corner of the fourth original image (also That is, corresponding to the projection area A4), and the target portion presents the structured light of the image corresponding to the fourth original image, and the fourth object portion 54 of the target object 5 subjected to the structured light projection.

在步驟S8進行完畢後,該儲存單元111已儲存了對應該第一投影區域A1的該42張第一原始影像、對應該第二投影區域A2的該42張第二原始影像、對應該第三投影區域A3的該42張第三原始影像,以及對應該第四投影區域A4的該42張第四原始影像。 After step S8 is completed, the storage unit 111 has stored the 42 first original images corresponding to the first projection area A1, the 42 second original images corresponding to the second projection area A2, and the third The 42 third original images in the projection area A3 and the 42 fourth original images corresponding to the fourth projection area A4.

接著,進行步驟S9。 Next, step S9 is performed.

在步驟S9中,該處理單元112擷取該42張第一原始影 像、該42張第二原始影像、該42張第三原始影像及該42張第四原始影像的該等目標部分,並將總共168個該等目標部分分別作為168張子結構光影像。更具體地說,該處理單元112是將該42張第一原始影像的該42個目標部分分別做為對應該第一投影區域A1且分別對應該42個圖樣的42張第一子結構光影像、將該42張第二原始影像的該42個目標部分分別做為對應該第二投影區域A2且分別對應該42個圖樣的42張第二子結構光影像、將該42張第三原始影像的該42個目標部分分別做為對應該第三投影區域A3且分別對應該42個圖樣的42張第三子結構光影像,以及將該42張第四原始影像的該42個目標部分分別做為對應該第四投影區域A4且分別對應該42個圖樣的42張第四子結構光影像。接著,進行步驟S10。 In step S9, the processing unit 112 captures the 42 first original images. Images, the 42 second original images, the 42 third original images, and the 42 fourth original images, and a total of 168 of these target portions are used as 168 sub-structured light images. More specifically, the processing unit 112 is to use the 42 target parts of the 42 first original images as 42 first sub-structured light images corresponding to the first projection area A1 and 42 patterns, respectively. 2. The 42 target parts of the 42 second original images are respectively 42 second sub-structured light images corresponding to the second projection area A2 and 42 patterns, and the 42 third original images. The 42 target parts corresponding to the 42 third sub-structured light images corresponding to the third projection area A3 and 42 patterns, respectively, and the 42 target parts corresponding to the 42 fourth original images, respectively Forty-two fourth sub-structured light images corresponding to the fourth projection area A4 and corresponding to 42 patterns. Next, step S10 is performed.

在步驟S10中,該處理單元112將該等第一子結構光影像、該等第二子結構光影像、該等第三子結構光影像及該等第四子結構光影像中,對應於該等圖案其中同一者的該第一子結構光影像至該第四子結構光影像以拼接(Image Stitching)的方式合併,而產生一對應該等圖案之其中該者的結構光影像,換句話說,該處理單元112會根據該等第一子結構光影像至該等第四子結構光影像而產生42張分別對應該42個圖樣的結構光影像,且該42張結構光影像分別呈現出受到該42種圖案之結構光投影的該目標物件5,而能用於建立該目標物件5的一個三維點雲模型。 In step S10, the processing unit 112 corresponds to the first sub-structured light image, the second sub-structured light image, the third sub-structured light image, and the fourth sub-structured light image. The first sub-structured light image to the fourth sub-structured light image of the same pattern are merged by Image Stitching to generate a pair of structured light images of the same pattern, in other words, , The processing unit 112 will generate 42 structured light images corresponding to 42 patterns according to the first substructured light image to the fourth substructured light image, and the 42 structured light images will be subjected to The target object 5 projected by the 42 types of structured light can be used to build a three-dimensional point cloud model of the target object 5.

更具體地說,假設該42個圖樣分別為一第一圖樣至一第四十二圖樣,則以該第一圖樣為例,該處理單元112是將同樣對應該第一圖樣的該第一子結構光影像、該第二子結構光影像、該第三子結構光影像及該第四子結構光影像以拼接的方式合併,而產生該42張結構光影像中對應於該第一圖樣的一第一結構光影像,且該第一結構光影像例如是呈現出受到該第一圖樣的該結構光投影的該目標物件5的全部。 More specifically, assuming that the 42 patterns are a first pattern to a forty-second pattern, taking the first pattern as an example, the processing unit 112 is the first sub-pattern that will also correspond to the first pattern. The structured light image, the second sub-structured light image, the third sub-structured light image, and the fourth sub-structured light image are merged in a stitching manner, and one of the 42 structured light images corresponding to the first pattern is generated. The first structured light image, and the first structured light image, for example, presents all of the target object 5 that is projected by the structured light of the first pattern.

值得注意的是,由於該第一投影區域A1與該第二投影區域A2、該第三投影區域A3及該第四投影區域A4之間分別存在該重疊部分R12、該重疊部分R13及該重疊部分R14,因此,以對應於該第一圖樣的該第一子結構光影像至該第四子結構光影像而言,其每兩者會分別具有兩個彼此相符的共同區域。 It is worth noting that since the first projection area A1 and the second projection area A2, the third projection area A3, and the fourth projection area A4 exist respectively the overlap portion R12, the overlap portion R13, and the overlap portion R14. Therefore, in terms of the first sub-structured light image to the fourth sub-structured light image corresponding to the first pattern, each of the two will have two common areas corresponding to each other.

更具體地舉例來說,以對應該第一圖樣的該第一子結構光影像而言,其最右側的區域會與對應該第一圖樣的該第二子結構光影像最左側的區域相符,其最右下角的區域會與對應該第一圖樣的該第三子結構光影像最左上角的區域相符,而其最下方的區域則會與對應該第一圖樣的該第四子結構光影像最上方的區域相符。也就是說,對應於該第一圖樣的該第一子結構光影像至該第四子結構光影像的每一者,皆會具有分別對應其他三者的三個共同區域,藉此,該處理單元112能根據該目標物件5在該等共同區域中 的輪廓,並藉由執行現有的一影像對準(image alignment)程序及一影像混合(image blending)程序,而將對應該第一圖樣的該第一子結構光影像至該第四子結構光影像拼接合併為對應該第一圖樣的該第一結構光影像。 More specifically, for example, for the first sub-structured light image corresponding to the first pattern, the rightmost region thereof corresponds to the leftmost region of the second sub-structured light image corresponding to the first pattern. The area at the bottom right corner will correspond to the area at the upper left corner of the third sub-structured light image corresponding to the first pattern, and the area at the bottom right corner will correspond to the fourth sub-structured light image corresponding to the first pattern. The top area matches. That is, each of the first sub-structured light image to the fourth sub-structured light image corresponding to the first pattern will have three common areas respectively corresponding to the other three, thereby, the processing The unit 112 can be in the common areas according to the target object 5 And executes an existing image alignment program and an image blending program to convert the first sub-structured light image corresponding to the first pattern to the fourth sub-structured light The image stitching is combined into the first structured light image corresponding to the first pattern.

該處理單元112產生其餘該等41張結構光影像的方式與產生該第一結構光影像的方式相同,故在此不再贅述。 The manner in which the processing unit 112 generates the remaining 41 structured light images is the same as the manner in which the first structured light image is generated, so it will not be repeated here.

補充說明的是,在另一實施例中,若該目標物件5的體積較為龐大,則該筆驅動資料也可例如是包含九個預定位置,且對應於該九個預定位置的九個投影區域例如是以九宮格的方式排列且共同涵蓋該目標物件5,且位於中央的該投影區域例如是與其他八個投影區域各存在一重疊部分,而不以本實施例為限。或者,在再一實施例中,若該目標物件5的體積較為狹長,則該投影區域的數量也可為三個,且該三投影區域例如可以是以由左至右或者由上至下的方式排列,並且每兩個彼此相鄰的該投影區域部分重疊。或者,在又一實施例中,該投影區域的數量例如為M個(M為大於1的整數),且該M個投影區域彼此之間並不限於是彼此對齊的矩陣狀排列,而可以是例如呈現斜向、彎曲或者不規則排列的分布,總而言之,只要該等投影區域的數量為多個,並且彼此之間存在重疊的部分即可實施,而不以本實施例為限。 It is added that, in another embodiment, if the volume of the target object 5 is relatively large, the driving data may also include, for example, nine predetermined positions and nine projection areas corresponding to the nine predetermined positions. For example, the target object 5 is arranged in a nine-grid manner and collectively covers the target object 5, and the projection area located in the center is, for example, an overlapping portion with each of the other eight projection areas, and is not limited to this embodiment. Or, in another embodiment, if the volume of the target object 5 is relatively narrow and long, the number of projection areas may also be three, and the three projection areas may be, for example, left to right or top to bottom. Arranged in such a manner that every two adjacent projection areas partially overlap each other. Or, in another embodiment, the number of the projection areas is, for example, M (M is an integer greater than 1), and the M projection areas are not limited to being aligned in a matrix arrangement with each other, but may be For example, the distribution is oblique, curved, or irregularly arranged. In short, as long as the number of such projection areas is multiple and there is an overlapping portion between each other, the implementation can be implemented without being limited to this embodiment.

綜上所述,本實施例的該結構光影像產生系統1藉由實 施該結構光影像產生方法,該處理單元112能控制該投影單元12將對應不同圖樣的結構光分別投影到該第一投影區域A1至該第四投影區域A4,接著,該處理單元112再控制該拍攝單元14拍攝對應各該投影區域及各該圖樣的原始影像,然後,該處理單元112能進一步擷取各該原始影像的該目標部分並將其作為子結構光影像,最後再將對應於相同圖樣的該等子結構光影像以拼接的方式合併,以產生對應各該圖樣的該等結構光影像。如此一來,以本實施例而言,即使該投影單元12本身的投影解析度較低,例如僅有800乘600,但在該等結構光影像中,該目標物件5所受到的結構光投影的解析度是近似於該投影單元12原本之解析度的四倍,例如近似於3200乘2400,藉此,即使利用低解析度的單槍投影機作為該投影單元12,仍能使該等結構光影像的影像品質相較於現有技術大幅地提升,以致利用該等結構光影像所建立之三維點雲模型的精細度也能有明顯的改善。除此之外,即使該目標物件5的體積龐大或者形狀較為狹長,使用者仍能藉由該筆驅動資料的設定,以不同數量及/或不同排列方式的該等投影區域涵蓋該目標物件5,以確保該等結構光影像的影像品質,而使得三維點雲模型的精細度不再受限於該投影單元12的性能,故確實能達成本發明之目的。 In summary, the structured light image generation system 1 of this embodiment is implemented by Applying the structured light image generating method, the processing unit 112 can control the projection unit 12 to project the structured light corresponding to different patterns to the first projection area A1 to the fourth projection area A4 respectively. Then, the processing unit 112 controls The shooting unit 14 captures an original image corresponding to each of the projection areas and each pattern. Then, the processing unit 112 can further capture the target portion of each original image and use it as a sub-structured light image. The sub-structured light images of the same pattern are combined in a stitching manner to generate the structured light images corresponding to each of the patterns. As such, according to this embodiment, even if the projection resolution of the projection unit 12 itself is low, for example, only 800 by 600, the structured light projection received by the target object 5 in the structured light images The resolution is approximately four times the original resolution of the projection unit 12, for example, approximately 3200 by 2400. Thus, even if a low-resolution single-gun projector is used as the projection unit 12, these structures can still be used. The image quality of light images is greatly improved compared to the prior art, so that the fineness of the three-dimensional point cloud model established by using these structured light images can also be significantly improved. In addition, even if the target object 5 is large or narrow in shape, the user can still use the setting of the driving data to cover the target object 5 in different numbers and / or different arrangements of the projection areas. In order to ensure the image quality of these structured light images, so that the precision of the three-dimensional point cloud model is no longer limited by the performance of the projection unit 12, it can indeed achieve the purpose of the invention.

惟以上所述者,僅為本發明之實施例而已,當不能以此限定本發明實施之範圍,凡是依本發明申請專利範圍及專利說明 書內容所作之簡單的等效變化與修飾,皆仍屬本發明專利涵蓋之範圍內。 However, the above are only examples of the present invention. When the scope of implementation of the present invention cannot be limited by this, any scope of patent application and patent description according to the present invention The simple equivalent changes and modifications made in the content of the book are still within the scope of the present invention patent.

Claims (10)

一種結構光影像產生方法,由一結構光影像產生系統對一靜止的目標物件實施,該結構光影像產生系統包含一投影單元、一用於驅動該投影單元活動的驅動單元、一拍攝單元,以及一處理單元,該結構光影像產生方法包含下列步驟:(A)該處理單元控制該驅動單元驅動該投影單元活動至分別對應多個投影區域的多個預定位置,其中,該目標物件位於該等投影區域的其中至少兩者內;(B)該處理單元控制該投影單元於每一預定位置將一結構光投影至對應的該投影區域;(C)該處理單元於該投影單元將該結構光投影至每一投影區域時,控制該拍攝單元對一涵蓋該等投影區域的預定拍攝範圍進行拍攝,以產生一對應受該投影單元投影之該投影區域的原始影像,每一原始影像具有一呈現出該結構光的目標部分;及(D)該處理單元根據該等原始影像的該等目標部分以拼接的方式產生一結構光影像,該結構光影像呈現出受到該結構光投影的該目標物件。A structured light image generation method implemented by a structured light image generation system on a stationary target object. The structured light image generation system includes a projection unit, a driving unit for driving the projection unit activity, a photographing unit, and A processing unit, the structured light image generating method includes the following steps: (A) the processing unit controls the driving unit to drive the projection unit to move to a plurality of predetermined positions respectively corresponding to a plurality of projection areas, wherein the target object is located in the Within at least two of the projection areas; (B) the processing unit controls the projection unit to project a structured light to the corresponding projection area at each predetermined position; (C) the processing unit controls the structured light at the projection unit When projecting onto each projection area, controlling the shooting unit to shoot a predetermined shooting range covering the projection areas to generate an original image corresponding to the projection area projected by the projection unit, each original image has a presentation Out the target portion of the structured light; and (D) the processing unit based on the target portion of the original images to Contact manner to produce a structured light image, showing the structured light image of the target object by the projection of structured light. 如請求項1所述的結構光影像產生方法,其中,在步驟(A)中,該等投影區域彼此呈矩陣排列,且每兩個彼此相鄰的該投影區域之間部分重疊,以使得在步驟(C)中,對應於該兩投影區域的該兩原始影像的該兩目標部分分別具有兩個彼此相符的共同區域,且在步驟(D)中,該處理單元是根據該等目標部分的該等共同區域而將該等目標部分以拼接的方式合併而產生該結構光影像。The method for generating a structured light image according to claim 1, wherein in step (A), the projection areas are arranged in a matrix with each other, and every two adjacent projection areas are partially overlapped so that In step (C), the two target portions of the two original images corresponding to the two projection areas have two common areas that coincide with each other, and in step (D), the processing unit is based on the target portions. The common areas are merged with the target parts to generate the structured light image. 如請求項1所述的結構光影像產生方法,其中,在步驟(D)中,該處理單元是先擷取每一原始影像的該目標部分並作為一子結構光影像,再將該等子結構光影像以拼接的方式合併而產生該結構光影像。The method for generating a structured light image according to claim 1, wherein in step (D), the processing unit first captures the target portion of each original image as a substructured light image, and then The structured light images are merged in a stitching manner to produce the structured light images. 如請求項1所述的結構光影像產生方法,其中:該結構光影像產生系統還包含一儲存N個圖樣的儲存單元,其中,N為大於1的整數;在步驟(B)中,該處理單元根據該N個圖樣控制該投影單元於每一預定位置將分別呈現出該N個圖樣的N種結構光依序投影至對應該預定位置的該投影區域;在步驟(C)中,該處理單元於該投影單元將該N種結構光中的每一種結構光投影至該投影區域時,控制該拍攝單元對該預定拍攝範圍進行拍攝,以產生對應受該投影單元投影之該投影區域且分別對應該N個圖樣的N個原始影像;及在步驟(D)中,該處理單元產生分別對應該N個圖樣的N個該結構光影像,且每一結構光影像是該處理單元根據該等原始影像中,對應於該N個圖樣中的同一圖樣之該等原始影像的該等目標部分所產生。The structured light image generating method according to claim 1, wherein: the structured light image generating system further includes a storage unit storing N patterns, where N is an integer greater than 1; in step (B), the processing The unit controls the projection unit according to the N patterns to sequentially project the N types of structured light representing the N patterns to the projection area corresponding to the predetermined position at each predetermined position; in step (C), the processing When the projection unit projects each of the N types of structured light onto the projection area, the unit controls the shooting unit to shoot the predetermined shooting range to generate the projection area corresponding to the projection area projected by the projection unit and respectively N original images corresponding to N patterns; and in step (D), the processing unit generates N structured light images corresponding to N patterns, and each structured light image is processed by the processing unit according to In the original image, the target portions of the original images corresponding to the same pattern in the N patterns are generated. 一種結構光影像產生系統,適用於一靜止的目標物件,該結構光影像產生系統包含:一投影單元;一驅動單元,用於驅動該投影單元活動;一拍攝單元;及一處理單元,電連接該投影單元、該驅動單元及該拍攝單元,該處理單元控制該驅動單元驅動該投影單元活動至分別對應多個投影區域的多個預定位置,其中,該目標物件位於該等投影區域的其中至少兩者內,該處理單元並控制該投影單元於每一預定位置將一結構光投影至對應的該投影區域,且於該投影單元將該結構光投影至每一投影區域時,控制該拍攝單元對一涵蓋該等投影區域的預定拍攝範圍進行拍攝,以產生一對應受該投影單元投影之該投影區域的原始影像,每一原始影像具有一呈現出該結構光的目標部分,該處理單元並根據該等原始影像的該等目標部分以拼接的方式產生一結構光影像,該結構光影像呈現出受到該結構光投影的該目標物件。A structured light image generation system suitable for a stationary target object. The structured light image generation system includes: a projection unit; a driving unit for driving the projection unit to move; a photographing unit; and a processing unit, electrically connected The projection unit, the driving unit and the photographing unit, the processing unit controls the driving unit to drive the projection unit to move to a plurality of predetermined positions respectively corresponding to a plurality of projection areas, wherein the target object is located in at least one of the projection areas. Within both, the processing unit controls the projection unit to project a structured light to the corresponding projection area at each predetermined position, and controls the photographing unit when the projection unit projects the structured light to each projection area. Shooting a predetermined shooting range covering the projection areas to generate an original image corresponding to the projection area projected by the projection unit, each original image having a target portion showing the structured light, the processing unit and Generate a structured light image based on the target portions of the original images by stitching, Structured light image of the target object by showing the structured light projection. 如請求項5所述的結構光影像產生系統,其中,該等投影區域彼此呈矩陣排列,且每兩個彼此相鄰的該投影區域之間部分重疊,以使得對應於該兩投影區域的該兩原始影像的該兩目標部分分別具有兩個彼此相符的共同區域,且該處理單元是根據該等目標部分的該等共同區域而將該等目標部分以拼接的方式合併而產生該結構光影像。The structured light image generation system according to claim 5, wherein the projection areas are arranged in a matrix with each other, and every two adjacent projection areas are partially overlapped, so that the corresponding projection areas correspond to the two projection areas. The two target parts of the two original images each have two common areas that coincide with each other, and the processing unit combines the target parts in a stitching manner to generate the structured light image according to the common areas of the target parts. . 如請求項5所述的結構光影像產生系統,其中,該處理單元是先擷取每一原始影像的該目標部分並作為一子結構光影像,再將該等子結構光影像以拼接的方式合併而產生該結構光影像。The structured light image generation system according to claim 5, wherein the processing unit first captures the target portion of each original image as a sub-structured light image, and then stitches the sub-structured light images in a stitching manner. Combined to produce the structured light image. 如請求項5所述的結構光影像產生系統,還包含一儲存N個圖樣的儲存單元,且N為大於1的整數,其中,根據該N個圖樣控制該投影單元於每一預定位置將分別呈現出該N個圖樣的N種結構光依序投影至對應該預定位置的該投影區域,且於該投影單元將該N種結構光中的每一種結構光投影至該投影區域時,控制該拍攝單元對該預定拍攝範圍進行拍攝,以產生對應受該投影單元投影之該投影區域且分別對應該N個圖樣的N個原始影像,且該處理單元是產生分別對應該N個圖樣的N個該結構光影像,且每一結構光影像是該處理單元根據該等原始影像中,對應於該N個圖樣中的同一圖樣之該等原始影像的該等目標部分所產生。The structured light image generating system according to claim 5, further comprising a storage unit storing N patterns, where N is an integer greater than 1, wherein controlling the projection unit at each predetermined position according to the N patterns will be separately The N kinds of structured light showing the N patterns are sequentially projected onto the projection area corresponding to a predetermined position, and when the projection unit projects each of the N kinds of structured light onto the projection area, the The shooting unit shoots the predetermined shooting range to generate N original images corresponding to the projection area projected by the projection unit and corresponding to N patterns, respectively, and the processing unit generates N corresponding to N patterns respectively The structured light image, and each structured light image is generated by the processing unit according to the target portions of the original images corresponding to the same pattern in the N patterns among the original images. 一種數位程式產品,包含一特定演算法,當該特定演算法被一數位計算設備載入並執行時,能令該數位計算設備完成如請求項1至4其中任一項所述的結構光影像產生方法。A digital program product includes a specific algorithm, and when the specific algorithm is loaded and executed by a digital computing device, the digital computing device can complete the structured light image according to any one of claims 1 to 4 Generate method. 一種數位計算設備,包含一處理單元,該處理單元適用於電連接一投影單元、一用於驅動該投影單元活動的驅動單元,以及一拍攝單元,且該處理單元能完成如請求項1至4其中任一項所述的結構光影像產生方法。A digital computing device includes a processing unit, which is suitable for electrically connecting a projection unit, a driving unit for driving the activity of the projection unit, and a photographing unit, and the processing unit can complete as requested items 1 to 4 The method for generating a structured light image according to any one of the above.
TW107130791A 2018-09-03 2018-09-03 Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning TWI680276B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107130791A TWI680276B (en) 2018-09-03 2018-09-03 Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107130791A TWI680276B (en) 2018-09-03 2018-09-03 Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning

Publications (2)

Publication Number Publication Date
TWI680276B true TWI680276B (en) 2019-12-21
TW202010996A TW202010996A (en) 2020-03-16

Family

ID=69582443

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107130791A TWI680276B (en) 2018-09-03 2018-09-03 Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning

Country Status (1)

Country Link
TW (1) TWI680276B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117146764A (en) * 2023-10-27 2023-12-01 江苏优创红外科技有限公司 Optical lens piece surface flatness detection equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7379193B2 (en) * 2002-02-09 2008-05-27 Lang Liu Sensing device for measuring the three-dimension shape and its measuring method
CN201876618U (en) * 2010-11-26 2011-06-22 西安盛世网络信息有限公司 Polarized light projector for assembly auxiliary equipment of 3D (three-dimensional) stereoscopic image projection and play system
TWM418495U (en) * 2011-04-12 2011-12-11 Shi-Liang Wang Image processing apparatus and system
CN103344196A (en) * 2013-07-11 2013-10-09 上海大学 Single lens structured light stereo imaging device and method for realizing stereo imaging of scenes in pipeline
TWI504931B (en) * 2014-02-19 2015-10-21 Coretronic Corp Projection system and projection method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7379193B2 (en) * 2002-02-09 2008-05-27 Lang Liu Sensing device for measuring the three-dimension shape and its measuring method
CN201876618U (en) * 2010-11-26 2011-06-22 西安盛世网络信息有限公司 Polarized light projector for assembly auxiliary equipment of 3D (three-dimensional) stereoscopic image projection and play system
TWM418495U (en) * 2011-04-12 2011-12-11 Shi-Liang Wang Image processing apparatus and system
CN103344196A (en) * 2013-07-11 2013-10-09 上海大学 Single lens structured light stereo imaging device and method for realizing stereo imaging of scenes in pipeline
TWI504931B (en) * 2014-02-19 2015-10-21 Coretronic Corp Projection system and projection method thereof

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117146764A (en) * 2023-10-27 2023-12-01 江苏优创红外科技有限公司 Optical lens piece surface flatness detection equipment
CN117146764B (en) * 2023-10-27 2024-01-05 江苏优创红外科技有限公司 Optical lens piece surface flatness detection equipment

Also Published As

Publication number Publication date
TW202010996A (en) 2020-03-16

Similar Documents

Publication Publication Date Title
JP7291244B2 (en) Projector Keystone Correction Method, Apparatus, System and Readable Storage Medium
JP5088018B2 (en) Image processing apparatus and control program
JP6747292B2 (en) Image processing apparatus, image processing method, and program
JP5465708B2 (en) Projection system and method
CN104024936A (en) Projection capture system, programming and method
CN106604003B (en) Method and system for realizing curved-surface curtain projection through short-focus projection
Tehrani et al. Automated geometric registration for multi-projector displays on arbitrary 3D shapes using uncalibrated devices
WO2016158166A1 (en) Projection system, projector device, and program
JP7163943B2 (en) INFORMATION GENERATION METHOD, INFORMATION GENERATION SYSTEM AND PROGRAM
JPH04281572A (en) Synthesizing system for photographic image with computer graphic in image processing system
US10133256B2 (en) Information processing apparatus and method for calculating inspection ranges
TWI680276B (en) Method and system for generating structured-light images, digital program product and digital computing device for 3d scanning
TWI703869B (en) Projector apparatus, projector system and an image calibration method
JP2019146155A (en) Image processing device, image processing method, and program
JP2006074805A (en) Multi-projection video display device
CN109323668A (en) 3 d shape testing device, robot system and three-dimensional shape measuring method
JP6428694B2 (en) Projection control apparatus, program, and projection system
JP6624942B2 (en) Projection system, projector device, and program
Staadt et al. A foveal inset for large display environments
JP2006323139A (en) Projector, camera server, and image projection method
JP2022554409A (en) Multispectral volumetric capture
WO2020067204A1 (en) Learning data creation method, machine learning model generation method, learning data creation device, and program
KR20180091794A (en) Method of projection mapping
JP2014163979A (en) Projector device, control method thereof, and control program
JP2013254999A (en) Image conversation system