TWI428856B - Device and method for detecting moving of object - Google Patents
Device and method for detecting moving of object Download PDFInfo
- Publication number
- TWI428856B TWI428856B TW98121927A TW98121927A TWI428856B TW I428856 B TWI428856 B TW I428856B TW 98121927 A TW98121927 A TW 98121927A TW 98121927 A TW98121927 A TW 98121927A TW I428856 B TWI428856 B TW I428856B
- Authority
- TW
- Taiwan
- Prior art keywords
- laser
- image sensing
- image
- detecting motion
- unit
- Prior art date
Links
Landscapes
- Length Measuring Devices By Optical Means (AREA)
Description
本發明涉及一種偵測物體運動的裝置,尤其是一種可以偵測物體三維軌跡的偵測物體運動的裝置及方法。The invention relates to a device for detecting motion of an object, in particular to a device and a method for detecting motion of an object by detecting a three-dimensional trajectory of the object.
隨著3D遊戲的發展,使用傳統的遙控器、鍵盤或滑鼠等來操縱遊戲有點落伍,越來越希望能身臨其境地參與到遊戲中去。With the development of 3D games, using a traditional remote control, keyboard or mouse to manipulate the game is a bit outdated, and more and more hope to be able to participate in the game in an immersive way.
為了取得物體的立體影像,先前技術之一是使用單一鏡頭加上周邊的反射鏡,以產生虛擬相機的多視角,然後藉由影像處理的方法建立出物體的3D輪廓。然此方法需在使用者或物體周邊架設反射鏡,使得該結構較為複雜、成本較高。In order to obtain a stereoscopic image of an object, one of the prior techniques is to use a single lens plus a peripheral mirror to create multiple views of the virtual camera, and then to create a 3D contour of the object by image processing. However, this method requires a mirror to be placed around the user or the object, which makes the structure more complicated and costly.
先前技術之二採用紅外線反射技術偵測物體的運動,其包括發射紅外光的發射器和一個接受紅外光的接收器,物體貼上具有反射紅外光功能的反射裝置。發光二極體發出的紅外光被物體上的反射裝置反射後被接收器所接收,根據接收到紅外光的時間差可以偵測到物體的運動方向和運動形態。但是,採用該方法需要發出紅外線,並且物體需要附帶反射裝置,從而使得該方法較為複雜。The second technique uses infrared reflection technology to detect the motion of an object, which includes an emitter that emits infrared light and a receiver that receives infrared light, and the object is attached with a reflecting device that reflects infrared light. The infrared light emitted by the light-emitting diode is reflected by the reflecting device on the object and received by the receiver, and the moving direction and the moving form of the object can be detected according to the time difference of the received infrared light. However, the use of this method requires the emission of infrared rays, and the object requires a reflection device, which makes the method more complicated.
有鑒於此,有必要提供一種結構簡單、成本較低的偵測物體運動的裝置及方法。In view of this, it is necessary to provide a device and method for detecting motion of an object with a simple structure and low cost.
一種偵測物體運動的裝置,其包括:一個鐳射掃描裝置,其發出鐳射照射至物體上且可以任意旋轉;兩個影像感測模組,其位於所述鐳射掃描裝置的兩側用來接收被所述物體反射的鐳射並成像,所述影像感測模組的光軸平行;數據處理單元,其用來接收所述影像感測模組輸入的影像資料並從影像資料中提取所述物體的三維資訊。A device for detecting motion of an object, comprising: a laser scanning device that emits laser light onto an object and can be arbitrarily rotated; and two image sensing modules located on both sides of the laser scanning device for receiving The laser reflected by the object is imaged, and the optical axis of the image sensing module is parallel; the data processing unit is configured to receive the image data input by the image sensing module and extract the object from the image data. Three-dimensional information.
一種偵測物體運動的方法,其包括:提供一個鐳射掃描裝置,其發出的鐳射投射到被測物體;利用兩個影像感測模組取得所述鐳射被所述被測物體上的一個點反射後的影像;利用數據處理單元從所述影像感測模組的影像資料中提取所述被測物體的三維資訊;取得所述鐳射被若干個點反射的影像,從而偵測物體的運動軌跡。A method for detecting motion of an object, comprising: providing a laser scanning device, wherein the emitted laser light is projected onto the object to be measured; and the two image sensing modules are used to obtain the laser to be reflected by a point on the object to be measured The image is processed by the data processing unit to extract the three-dimensional information of the measured object from the image data of the image sensing module; and the image that is reflected by the plurality of points is obtained, thereby detecting the motion track of the object.
與先前技術相比,本發明實施例的偵測物體運動的裝置利用鐳射掃描裝置掃描物體,影像感測模組接收被物體反射的光線並成像,數據處理單元從影像資料中提出物體的三維資訊,不需要在物體上設置反射裝置,因此,該裝置結構簡單、成本較低。Compared with the prior art, the apparatus for detecting object motion in the embodiment of the present invention scans an object by using a laser scanning device, and the image sensing module receives the light reflected by the object and images the data processing unit, and the data processing unit proposes the three-dimensional information of the object from the image data. There is no need to provide a reflecting device on the object, and therefore, the device has a simple structure and a low cost.
下面將結合附圖對本發明作進一步詳細說明。The invention will now be described in further detail with reference to the accompanying drawings.
請一併參閱圖1、圖2、圖3及圖4,本發明實施例的偵測物體運動的裝置10用來偵測物體20的三維空間運動狀態。偵測物體運動的裝置10包括第一影像感測模組110、第二影像感測模組120、鐳射掃描裝置130和數據處理單元140。Referring to FIG. 1 , FIG. 2 , FIG. 3 and FIG. 4 , the apparatus 10 for detecting object motion is used to detect the three-dimensional motion state of the object 20 . The device 10 for detecting object motion includes a first image sensing module 110, a second image sensing module 120, a laser scanning device 130, and a data processing unit 140.
第一影像感測模組110包括第一影像感測單元111和位元於第一影像感測單元111前的第一鏡頭模組112,第一鏡頭模組112的光軸計作L1 、幾何中心計作O1 。The first image sensing module 110 includes a first image sensing unit 111 and a first lens module 112 in front of the first image sensing unit 111. The optical axis of the first lens module 112 is counted as L 1 . The geometric center is counted as O 1 .
第二影像感測模組120與第一影像感測模組110具有相同的焦距且焦點在同一平面上。第二影像感測模組120包括第二影像感測單元121和位元於第二影像感測單元121前的第二鏡頭模組122,第二鏡頭模組122光軸計作L2 、幾何中心計作O2 ,其中,光軸L2 平行光軸L1 。The second image sensing module 120 has the same focal length as the first image sensing module 110 and the focus is on the same plane. The second image sensing module 120 includes a second image sensing unit 121 and a second lens module 122 in front of the second image sensing unit 121. The optical axis of the second lens module 122 is calculated as L 2 , geometry. The center is counted as O 2 , where the optical axis L 2 is parallel to the optical axis L 1 .
其中,第一影像感測單元111和第二影像感測單元121為CCD感測器或CMOS感測器。The first image sensing unit 111 and the second image sensing unit 121 are CCD sensors or CMOS sensors.
鐳射掃描裝置130位元於第一影像感測模組110和第二影像感測模組120之間,且到光軸L2 和到光軸L1 的距離相等。鐳射掃描裝置130包括可以任意旋轉的鐳射源131、圍繞鐳射源131的反射裝置132和光線調整裝置133。The laser scanning device 130 is between the first image sensing module 110 and the second image sensing module 120, and the distance from the optical axis L 2 to the optical axis L 1 is equal. The laser scanning device 130 includes a laser source 131 that can be arbitrarily rotated, a reflecting device 132 that surrounds the laser source 131, and a light adjusting device 133.
鐳射掃描裝置130發出的鐳射相對物體20可以作x-y方向的掃描,投射到物體20上的鐳射被反射後被第一影像感測模組110、第二影像感測模組120接收。鐳射源131可以為鐳射二極體或者發光二極體,其提供高亮度、低強度且具有良好空間特性的光線,旋轉的鐳射源131可以使得掃描的空間大為增大。The laser emitted from the laser scanning device 130 can be scanned in the x-y direction with respect to the object 20, and the laser projected onto the object 20 is reflected and received by the first image sensing module 110 and the second image sensing module 120. The laser source 131 may be a laser diode or a light emitting diode, which provides light with high brightness, low intensity, and good spatial characteristics, and the rotating laser source 131 can greatly increase the scanning space.
反射裝置132可以為反射鏡、或反射板等,光線調整裝置133可以為聚焦透鏡或者准直透鏡。鐳射源131發出的鐳射部分直接經過光線調整裝置133投射到物體20上,部分被反射裝置132反射後經過光線調整裝置133投射到物體20上。The reflecting device 132 may be a mirror, a reflecting plate or the like, and the light adjusting device 133 may be a focusing lens or a collimating lens. The laser portion emitted from the laser source 131 is directly projected onto the object 20 via the light adjusting device 133, partially reflected by the reflecting device 132, and then projected onto the object 20 through the light adjusting device 133.
由於光線調整裝置133對鐳射的聚焦或者准直,因此鐳射掃描裝置130可以提供高指向的鐳射用來掃描物體20。Due to the focusing or collimation of the laser by the light adjustment device 133, the laser scanning device 130 can provide a high pointing laser for scanning the object 20.
鐳射掃描裝置130發出的鐳射投射到物體20上,第一影像感測模組110和第二影像感測模組120在不同坐標系下分別取得鐳射點在物體20的影像P和P1 ,數據處理單元140將影像P和P1 進行融合,即將在不同坐標系下得到的該鐳射點的二維座標轉換到同一個三維座標內,從而可確定該鐳射點的座標。The laser generated by the laser scanning device 130 is projected onto the object 20, and the first image sensing module 110 and the second image sensing module 120 respectively obtain the images P and P 1 of the laser spot on the object 20 in different coordinate systems. the image processing unit 140 P and P 1 are fused, the two-dimensional coordinates of the laser spot is about to get in different coordinate system into a three-dimensional coordinate the same, so that the laser can be determined coordinate point.
下面詳細說明確定物體20上一個鐳射點D座標的過程。The process of determining the coordinates of a laser spot D on the object 20 is described in detail below.
三維坐標系的原點為O1 O2 的中心O、O1 O2 為x軸、L3 為z軸且經過O1 O2 的中心並與L2 、L1 平行、y軸經過O1 O2 的中心且與O1 O2 和L3 均垂直,a表示D到L3 的水平距離,b表示D到L3 的垂直距離,c表示D到O1 O2 的垂直距離,(u1 ,v1 )和(u2 ,v2 )為物體20上一個鐳射點D(a,b,c)分別在第一影像感測單元111和第二影像感測單元121上像點的座標,f為幾何中心O1 或O2 到第一影像感測單元111和第二影像感測單元121距離,光軸L2 與光軸L1 之間距離為2d,由於光軸L2 與光軸L1 平行,由外極限約束可知v1 =v2 。Origin of the three-dimensional coordinates of the center O of O 2. 1 O, O 1 O 2 x-axis, L 3 is a z-axis and passing through the center O 1 O 2 and the L 2, L 1 parallel, y-axis. 1 through O O hub 2 and with O. 1 O 2 and L 3 are vertical, a denotes D to L level 3 a distance, b represents D to L the vertical distance 3, c denotes D through O. 1 O vertical distance 2, (u 1 , v 1 ) and (u 2 , v 2 ) are coordinates of a point on the first image sensing unit 111 and the second image sensing unit 121 of a laser spot D (a, b, c) on the object 20 f is the geometric center O 1 or O 2 to the distance between the first image sensing unit 111 and the second image sensing unit 121, and the distance between the optical axis L 2 and the optical axis L 1 is 2d, due to the optical axis L 2 and the light The axis L 1 is parallel, and v 1 = v 2 is known from the outer limit constraint.
分別在xz、yz坐標系內利用三角形相似的原理得出下列公式:The following formula is obtained by using the principle of triangle similarity in the xz and yz coordinate systems:
, ,
, ,
由上述公式可以得出點a、b、c的的運算式:From the above formula, the expressions of points a, b, and c can be obtained:
,, , ,
分別在第一影像感測模組110和第二影像感測模組120所在坐標系中利用三角形相似原理可以得出a、b、c與f、d、u1 、u2 、v1 、v2 之間的的關係,通過多組影像可以獲得物體20的空間移動量,該等移動量記錄了物體20的運動軌跡。The triangle similarity principle can be used to obtain a, b, c and f, d, u 1 , u 2 , v 1 , v in the coordinate system of the first image sensing module 110 and the second image sensing module 120 respectively. The relationship between 2 , the amount of spatial movement of the object 20 can be obtained by a plurality of sets of images, the amount of movement recording the trajectory of the object 20.
另外,本領域技術人員還可以在本發明精神內做其他變化,當然,這些依據本發明精神所做的變化,都應包含在本發明所要求保護的範圍之內。In addition, those skilled in the art can make other changes in the spirit of the present invention. Of course, the changes made in accordance with the spirit of the present invention should be included in the scope of the present invention.
綜上所述,本發明確已符合發明專利之要件,遂依法提出專利申請。惟,以上所述者僅為本發明之較佳實施方式,自不能以此限制本案之申請專利範圍。舉凡熟悉本案技藝之人士援依本發明之精神所作之等效修飾或變化,皆應涵蓋於以下申請專利範圍內。In summary, the present invention has indeed met the requirements of the invention patent, and has filed a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and it is not possible to limit the scope of the patent application of the present invention. Equivalent modifications or variations made by persons skilled in the art in light of the spirit of the invention are intended to be included within the scope of the following claims.
10‧‧‧偵測物體運動的裝置
20‧‧‧物體
110‧‧‧第一影像感測模組
120‧‧‧第二影像感測模組
130‧‧‧鐳射掃描裝置
140‧‧‧數據處理單元
111‧‧‧第一影像感測單元
112‧‧‧第一鏡頭模組
121‧‧‧第二影像感測單元
122‧‧‧第二鏡頭模組
131‧‧‧鐳射源
132‧‧‧反射裝置
133‧‧‧光線調整裝置
10‧‧‧Devices for detecting the movement of objects
20‧‧‧ objects
110‧‧‧First Image Sensing Module
120‧‧‧Second image sensing module
130‧‧‧Laser scanning device
140‧‧‧Data Processing Unit
111‧‧‧First image sensing unit
112‧‧‧First lens module
121‧‧‧Second image sensing unit
122‧‧‧Second lens module
131‧‧‧Laser source
132‧‧‧Reflecting device
133‧‧‧Light adjustment device
圖1是本發明實施例偵測物體運動的裝置的示意圖。1 is a schematic diagram of an apparatus for detecting motion of an object according to an embodiment of the present invention.
圖2至圖4是本發明實施例物體三維座標的測量原理圖。2 to 4 are schematic diagrams showing the measurement of the three-dimensional coordinates of an object according to an embodiment of the present invention.
10‧‧‧物體運動的裝置 10‧‧‧Devices for motion of objects
20‧‧‧物體 20‧‧‧ objects
110‧‧‧第一影像感測模組 110‧‧‧First Image Sensing Module
120‧‧‧第二影像感測模組 120‧‧‧Second image sensing module
130‧‧‧鐳射掃描裝置 130‧‧‧Laser scanning device
140‧‧‧數據處理單元 140‧‧‧Data Processing Unit
111‧‧‧第一影像感測單元 111‧‧‧First image sensing unit
112‧‧‧第一鏡頭模組 112‧‧‧First lens module
121‧‧‧第二影像感測單元 121‧‧‧Second image sensing unit
122‧‧‧第二鏡頭模組 122‧‧‧Second lens module
131‧‧‧鐳射源 131‧‧‧Laser source
132‧‧‧反射裝置 132‧‧‧Reflecting device
133‧‧‧光線調整裝置 133‧‧‧Light adjustment device
Claims (9)
一個鐳射掃描裝置,其發出鐳射照射至被測物體上且可以旋轉;
兩個影像感測模組,其位於所述鐳射掃描裝置的兩側用來接收被所述被測物體反射的鐳射並成像,所述兩個影像感測模組的光軸平行;
數據處理單元,其用來接收所述影像感測模組輸入的影像資料並從影像資料中提取所述被測物體的三維資訊。A device for detecting motion of an object, comprising:
a laser scanning device that emits laser light onto the object to be measured and can be rotated;
Two image sensing modules are disposed on both sides of the laser scanning device for receiving and reflecting laser light reflected by the object to be measured, and optical axes of the two image sensing modules are parallel;
a data processing unit, configured to receive image data input by the image sensing module and extract three-dimensional information of the measured object from the image data.
提供一個鐳射掃描裝置,其發出的鐳射投射到被測物體;
利用兩個影像感測模組取得所述鐳射被所述被測物體上的一個點反射後的影像;
利用數據處理單元從所述影像感測模組的影像資料中提取所述被測物體的三維資訊;
取得所述鐳射被若干個點反射的影像,從而偵測物體的運動軌跡。A method of detecting motion of an object, comprising:
Providing a laser scanning device that emits a laser beam that is projected onto the object to be measured;
Obtaining, by the two image sensing modules, the image that the laser is reflected by a point on the object to be measured;
Extracting, by using a data processing unit, three-dimensional information of the measured object from image data of the image sensing module;
An image obtained by the laser being reflected by a plurality of points is obtained, thereby detecting a motion trajectory of the object.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW98121927A TWI428856B (en) | 2009-06-29 | 2009-06-29 | Device and method for detecting moving of object |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW98121927A TWI428856B (en) | 2009-06-29 | 2009-06-29 | Device and method for detecting moving of object |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201101236A TW201101236A (en) | 2011-01-01 |
TWI428856B true TWI428856B (en) | 2014-03-01 |
Family
ID=44836956
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW98121927A TWI428856B (en) | 2009-06-29 | 2009-06-29 | Device and method for detecting moving of object |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI428856B (en) |
-
2009
- 2009-06-29 TW TW98121927A patent/TWI428856B/en not_active IP Right Cessation
Also Published As
Publication number | Publication date |
---|---|
TW201101236A (en) | 2011-01-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2020500310A5 (en) | ||
KR100753885B1 (en) | Image obtaining apparatus | |
JP2020531848A (en) | Range finder for determining at least one piece of geometric information | |
CN102074044B (en) | System and method for reconstructing surface of object | |
CN105190235A (en) | Compensation of a structured light scanner that is tracked in six degrees-of-freedom | |
US20120056982A1 (en) | Depth camera based on structured light and stereo vision | |
JP2002139304A (en) | Distance measuring device and distance measuring method | |
EP3929626A1 (en) | Optical scanning probe and apparatus for generating three-dimensional data using the same | |
US20100207909A1 (en) | Detection module and an optical detection device comprising the same | |
US11467261B2 (en) | Distance measuring device and moving object | |
CN102074045A (en) | System and method for projection reconstruction | |
WO2018028152A1 (en) | Image acquisition device and virtual reality device | |
JP2008241643A (en) | Three-dimensional shape measuring device | |
WO2022050279A1 (en) | Three-dimensional measurement device | |
US9170471B2 (en) | Optical system having integrated illumination and imaging optical systems, and 3D image acquisition apparatus including the optical system | |
JP2007093412A (en) | Three-dimensional shape measuring device | |
JP2007508557A (en) | Device for scanning three-dimensional objects | |
JP2007327966A (en) | Light source module and position measuring system using it | |
TWI428856B (en) | Device and method for detecting moving of object | |
KR20100094422A (en) | System and method for performing optical navigation using a compact optical element | |
CN107743628A (en) | The luminous structured light in LED faces | |
CN108885260B (en) | Time-of-flight detector with single axis scanning | |
CN101930071A (en) | Device and method for detecting movement of object | |
KR20150018026A (en) | 3 demensional camera | |
TWI459243B (en) | Three dimensional optical sensing system and game player |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |