TWI428856B - Device and method for detecting moving of object - Google Patents

Device and method for detecting moving of object Download PDF

Info

Publication number
TWI428856B
TWI428856B TW98121927A TW98121927A TWI428856B TW I428856 B TWI428856 B TW I428856B TW 98121927 A TW98121927 A TW 98121927A TW 98121927 A TW98121927 A TW 98121927A TW I428856 B TWI428856 B TW I428856B
Authority
TW
Taiwan
Prior art keywords
laser
image sensing
image
detecting motion
unit
Prior art date
Application number
TW98121927A
Other languages
Chinese (zh)
Other versions
TW201101236A (en
Inventor
Chi Wei Chiu
Ping Han Ku
Original Assignee
Hon Hai Prec Ind Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hon Hai Prec Ind Co Ltd filed Critical Hon Hai Prec Ind Co Ltd
Priority to TW98121927A priority Critical patent/TWI428856B/en
Publication of TW201101236A publication Critical patent/TW201101236A/en
Application granted granted Critical
Publication of TWI428856B publication Critical patent/TWI428856B/en

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Description

偵測物體運動的裝置及方法Device and method for detecting object motion

本發明涉及一種偵測物體運動的裝置,尤其是一種可以偵測物體三維軌跡的偵測物體運動的裝置及方法。The invention relates to a device for detecting motion of an object, in particular to a device and a method for detecting motion of an object by detecting a three-dimensional trajectory of the object.

隨著3D遊戲的發展,使用傳統的遙控器、鍵盤或滑鼠等來操縱遊戲有點落伍,越來越希望能身臨其境地參與到遊戲中去。With the development of 3D games, using a traditional remote control, keyboard or mouse to manipulate the game is a bit outdated, and more and more hope to be able to participate in the game in an immersive way.

為了取得物體的立體影像,先前技術之一是使用單一鏡頭加上周邊的反射鏡,以產生虛擬相機的多視角,然後藉由影像處理的方法建立出物體的3D輪廓。然此方法需在使用者或物體周邊架設反射鏡,使得該結構較為複雜、成本較高。In order to obtain a stereoscopic image of an object, one of the prior techniques is to use a single lens plus a peripheral mirror to create multiple views of the virtual camera, and then to create a 3D contour of the object by image processing. However, this method requires a mirror to be placed around the user or the object, which makes the structure more complicated and costly.

先前技術之二採用紅外線反射技術偵測物體的運動,其包括發射紅外光的發射器和一個接受紅外光的接收器,物體貼上具有反射紅外光功能的反射裝置。發光二極體發出的紅外光被物體上的反射裝置反射後被接收器所接收,根據接收到紅外光的時間差可以偵測到物體的運動方向和運動形態。但是,採用該方法需要發出紅外線,並且物體需要附帶反射裝置,從而使得該方法較為複雜。The second technique uses infrared reflection technology to detect the motion of an object, which includes an emitter that emits infrared light and a receiver that receives infrared light, and the object is attached with a reflecting device that reflects infrared light. The infrared light emitted by the light-emitting diode is reflected by the reflecting device on the object and received by the receiver, and the moving direction and the moving form of the object can be detected according to the time difference of the received infrared light. However, the use of this method requires the emission of infrared rays, and the object requires a reflection device, which makes the method more complicated.

有鑒於此,有必要提供一種結構簡單、成本較低的偵測物體運動的裝置及方法。In view of this, it is necessary to provide a device and method for detecting motion of an object with a simple structure and low cost.

一種偵測物體運動的裝置,其包括:一個鐳射掃描裝置,其發出鐳射照射至物體上且可以任意旋轉;兩個影像感測模組,其位於所述鐳射掃描裝置的兩側用來接收被所述物體反射的鐳射並成像,所述影像感測模組的光軸平行;數據處理單元,其用來接收所述影像感測模組輸入的影像資料並從影像資料中提取所述物體的三維資訊。A device for detecting motion of an object, comprising: a laser scanning device that emits laser light onto an object and can be arbitrarily rotated; and two image sensing modules located on both sides of the laser scanning device for receiving The laser reflected by the object is imaged, and the optical axis of the image sensing module is parallel; the data processing unit is configured to receive the image data input by the image sensing module and extract the object from the image data. Three-dimensional information.

一種偵測物體運動的方法,其包括:提供一個鐳射掃描裝置,其發出的鐳射投射到被測物體;利用兩個影像感測模組取得所述鐳射被所述被測物體上的一個點反射後的影像;利用數據處理單元從所述影像感測模組的影像資料中提取所述被測物體的三維資訊;取得所述鐳射被若干個點反射的影像,從而偵測物體的運動軌跡。A method for detecting motion of an object, comprising: providing a laser scanning device, wherein the emitted laser light is projected onto the object to be measured; and the two image sensing modules are used to obtain the laser to be reflected by a point on the object to be measured The image is processed by the data processing unit to extract the three-dimensional information of the measured object from the image data of the image sensing module; and the image that is reflected by the plurality of points is obtained, thereby detecting the motion track of the object.

與先前技術相比,本發明實施例的偵測物體運動的裝置利用鐳射掃描裝置掃描物體,影像感測模組接收被物體反射的光線並成像,數據處理單元從影像資料中提出物體的三維資訊,不需要在物體上設置反射裝置,因此,該裝置結構簡單、成本較低。Compared with the prior art, the apparatus for detecting object motion in the embodiment of the present invention scans an object by using a laser scanning device, and the image sensing module receives the light reflected by the object and images the data processing unit, and the data processing unit proposes the three-dimensional information of the object from the image data. There is no need to provide a reflecting device on the object, and therefore, the device has a simple structure and a low cost.

下面將結合附圖對本發明作進一步詳細說明。The invention will now be described in further detail with reference to the accompanying drawings.

請一併參閱圖1、圖2、圖3及圖4,本發明實施例的偵測物體運動的裝置10用來偵測物體20的三維空間運動狀態。偵測物體運動的裝置10包括第一影像感測模組110、第二影像感測模組120、鐳射掃描裝置130和數據處理單元140。Referring to FIG. 1 , FIG. 2 , FIG. 3 and FIG. 4 , the apparatus 10 for detecting object motion is used to detect the three-dimensional motion state of the object 20 . The device 10 for detecting object motion includes a first image sensing module 110, a second image sensing module 120, a laser scanning device 130, and a data processing unit 140.

第一影像感測模組110包括第一影像感測單元111和位元於第一影像感測單元111前的第一鏡頭模組112,第一鏡頭模組112的光軸計作L1 、幾何中心計作O1The first image sensing module 110 includes a first image sensing unit 111 and a first lens module 112 in front of the first image sensing unit 111. The optical axis of the first lens module 112 is counted as L 1 . The geometric center is counted as O 1 .

第二影像感測模組120與第一影像感測模組110具有相同的焦距且焦點在同一平面上。第二影像感測模組120包括第二影像感測單元121和位元於第二影像感測單元121前的第二鏡頭模組122,第二鏡頭模組122光軸計作L2 、幾何中心計作O2 ,其中,光軸L2 平行光軸L1The second image sensing module 120 has the same focal length as the first image sensing module 110 and the focus is on the same plane. The second image sensing module 120 includes a second image sensing unit 121 and a second lens module 122 in front of the second image sensing unit 121. The optical axis of the second lens module 122 is calculated as L 2 , geometry. The center is counted as O 2 , where the optical axis L 2 is parallel to the optical axis L 1 .

其中,第一影像感測單元111和第二影像感測單元121為CCD感測器或CMOS感測器。The first image sensing unit 111 and the second image sensing unit 121 are CCD sensors or CMOS sensors.

鐳射掃描裝置130位元於第一影像感測模組110和第二影像感測模組120之間,且到光軸L2 和到光軸L1 的距離相等。鐳射掃描裝置130包括可以任意旋轉的鐳射源131、圍繞鐳射源131的反射裝置132和光線調整裝置133。The laser scanning device 130 is between the first image sensing module 110 and the second image sensing module 120, and the distance from the optical axis L 2 to the optical axis L 1 is equal. The laser scanning device 130 includes a laser source 131 that can be arbitrarily rotated, a reflecting device 132 that surrounds the laser source 131, and a light adjusting device 133.

鐳射掃描裝置130發出的鐳射相對物體20可以作x-y方向的掃描,投射到物體20上的鐳射被反射後被第一影像感測模組110、第二影像感測模組120接收。鐳射源131可以為鐳射二極體或者發光二極體,其提供高亮度、低強度且具有良好空間特性的光線,旋轉的鐳射源131可以使得掃描的空間大為增大。The laser emitted from the laser scanning device 130 can be scanned in the x-y direction with respect to the object 20, and the laser projected onto the object 20 is reflected and received by the first image sensing module 110 and the second image sensing module 120. The laser source 131 may be a laser diode or a light emitting diode, which provides light with high brightness, low intensity, and good spatial characteristics, and the rotating laser source 131 can greatly increase the scanning space.

反射裝置132可以為反射鏡、或反射板等,光線調整裝置133可以為聚焦透鏡或者准直透鏡。鐳射源131發出的鐳射部分直接經過光線調整裝置133投射到物體20上,部分被反射裝置132反射後經過光線調整裝置133投射到物體20上。The reflecting device 132 may be a mirror, a reflecting plate or the like, and the light adjusting device 133 may be a focusing lens or a collimating lens. The laser portion emitted from the laser source 131 is directly projected onto the object 20 via the light adjusting device 133, partially reflected by the reflecting device 132, and then projected onto the object 20 through the light adjusting device 133.

由於光線調整裝置133對鐳射的聚焦或者准直,因此鐳射掃描裝置130可以提供高指向的鐳射用來掃描物體20。Due to the focusing or collimation of the laser by the light adjustment device 133, the laser scanning device 130 can provide a high pointing laser for scanning the object 20.

鐳射掃描裝置130發出的鐳射投射到物體20上,第一影像感測模組110和第二影像感測模組120在不同坐標系下分別取得鐳射點在物體20的影像P和P1 ,數據處理單元140將影像P和P1 進行融合,即將在不同坐標系下得到的該鐳射點的二維座標轉換到同一個三維座標內,從而可確定該鐳射點的座標。The laser generated by the laser scanning device 130 is projected onto the object 20, and the first image sensing module 110 and the second image sensing module 120 respectively obtain the images P and P 1 of the laser spot on the object 20 in different coordinate systems. the image processing unit 140 P and P 1 are fused, the two-dimensional coordinates of the laser spot is about to get in different coordinate system into a three-dimensional coordinate the same, so that the laser can be determined coordinate point.

下面詳細說明確定物體20上一個鐳射點D座標的過程。The process of determining the coordinates of a laser spot D on the object 20 is described in detail below.

三維坐標系的原點為O1 O2 的中心O、O1 O2 為x軸、L3 為z軸且經過O1 O2 的中心並與L2 、L1 平行、y軸經過O1 O2 的中心且與O1 O2 和L3 均垂直,a表示D到L3 的水平距離,b表示D到L3 的垂直距離,c表示D到O1 O2 的垂直距離,(u1 ,v1 )和(u2 ,v2 )為物體20上一個鐳射點D(a,b,c)分別在第一影像感測單元111和第二影像感測單元121上像點的座標,f為幾何中心O1 或O2 到第一影像感測單元111和第二影像感測單元121距離,光軸L2 與光軸L1 之間距離為2d,由於光軸L2 與光軸L1 平行,由外極限約束可知v1 =v2Origin of the three-dimensional coordinates of the center O of O 2. 1 O, O 1 O 2 x-axis, L 3 is a z-axis and passing through the center O 1 O 2 and the L 2, L 1 parallel, y-axis. 1 through O O hub 2 and with O. 1 O 2 and L 3 are vertical, a denotes D to L level 3 a distance, b represents D to L the vertical distance 3, c denotes D through O. 1 O vertical distance 2, (u 1 , v 1 ) and (u 2 , v 2 ) are coordinates of a point on the first image sensing unit 111 and the second image sensing unit 121 of a laser spot D (a, b, c) on the object 20 f is the geometric center O 1 or O 2 to the distance between the first image sensing unit 111 and the second image sensing unit 121, and the distance between the optical axis L 2 and the optical axis L 1 is 2d, due to the optical axis L 2 and the light The axis L 1 is parallel, and v 1 = v 2 is known from the outer limit constraint.

分別在xz、yz坐標系內利用三角形相似的原理得出下列公式:The following formula is obtained by using the principle of triangle similarity in the xz and yz coordinate systems:

,

,

由上述公式可以得出點a、b、c的的運算式:From the above formula, the expressions of points a, b, and c can be obtained:

, ,

分別在第一影像感測模組110和第二影像感測模組120所在坐標系中利用三角形相似原理可以得出a、b、c與f、d、u1 、u2 、v1 、v2 之間的的關係,通過多組影像可以獲得物體20的空間移動量,該等移動量記錄了物體20的運動軌跡。The triangle similarity principle can be used to obtain a, b, c and f, d, u 1 , u 2 , v 1 , v in the coordinate system of the first image sensing module 110 and the second image sensing module 120 respectively. The relationship between 2 , the amount of spatial movement of the object 20 can be obtained by a plurality of sets of images, the amount of movement recording the trajectory of the object 20.

另外,本領域技術人員還可以在本發明精神內做其他變化,當然,這些依據本發明精神所做的變化,都應包含在本發明所要求保護的範圍之內。In addition, those skilled in the art can make other changes in the spirit of the present invention. Of course, the changes made in accordance with the spirit of the present invention should be included in the scope of the present invention.

綜上所述,本發明確已符合發明專利之要件,遂依法提出專利申請。惟,以上所述者僅為本發明之較佳實施方式,自不能以此限制本案之申請專利範圍。舉凡熟悉本案技藝之人士援依本發明之精神所作之等效修飾或變化,皆應涵蓋於以下申請專利範圍內。In summary, the present invention has indeed met the requirements of the invention patent, and has filed a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and it is not possible to limit the scope of the patent application of the present invention. Equivalent modifications or variations made by persons skilled in the art in light of the spirit of the invention are intended to be included within the scope of the following claims.

10‧‧‧偵測物體運動的裝置
20‧‧‧物體
110‧‧‧第一影像感測模組
120‧‧‧第二影像感測模組
130‧‧‧鐳射掃描裝置
140‧‧‧數據處理單元
111‧‧‧第一影像感測單元
112‧‧‧第一鏡頭模組
121‧‧‧第二影像感測單元
122‧‧‧第二鏡頭模組
131‧‧‧鐳射源
132‧‧‧反射裝置
133‧‧‧光線調整裝置
10‧‧‧Devices for detecting the movement of objects
20‧‧‧ objects
110‧‧‧First Image Sensing Module
120‧‧‧Second image sensing module
130‧‧‧Laser scanning device
140‧‧‧Data Processing Unit
111‧‧‧First image sensing unit
112‧‧‧First lens module
121‧‧‧Second image sensing unit
122‧‧‧Second lens module
131‧‧‧Laser source
132‧‧‧Reflecting device
133‧‧‧Light adjustment device

圖1是本發明實施例偵測物體運動的裝置的示意圖。1 is a schematic diagram of an apparatus for detecting motion of an object according to an embodiment of the present invention.

圖2至圖4是本發明實施例物體三維座標的測量原理圖。2 to 4 are schematic diagrams showing the measurement of the three-dimensional coordinates of an object according to an embodiment of the present invention.

10‧‧‧物體運動的裝置 10‧‧‧Devices for motion of objects

20‧‧‧物體 20‧‧‧ objects

110‧‧‧第一影像感測模組 110‧‧‧First Image Sensing Module

120‧‧‧第二影像感測模組 120‧‧‧Second image sensing module

130‧‧‧鐳射掃描裝置 130‧‧‧Laser scanning device

140‧‧‧數據處理單元 140‧‧‧Data Processing Unit

111‧‧‧第一影像感測單元 111‧‧‧First image sensing unit

112‧‧‧第一鏡頭模組 112‧‧‧First lens module

121‧‧‧第二影像感測單元 121‧‧‧Second image sensing unit

122‧‧‧第二鏡頭模組 122‧‧‧Second lens module

131‧‧‧鐳射源 131‧‧‧Laser source

132‧‧‧反射裝置 132‧‧‧Reflecting device

133‧‧‧光線調整裝置 133‧‧‧Light adjustment device

Claims (9)

一種偵測物體運動的裝置,其包括:
一個鐳射掃描裝置,其發出鐳射照射至被測物體上且可以旋轉;
兩個影像感測模組,其位於所述鐳射掃描裝置的兩側用來接收被所述被測物體反射的鐳射並成像,所述兩個影像感測模組的光軸平行;
數據處理單元,其用來接收所述影像感測模組輸入的影像資料並從影像資料中提取所述被測物體的三維資訊。
A device for detecting motion of an object, comprising:
a laser scanning device that emits laser light onto the object to be measured and can be rotated;
Two image sensing modules are disposed on both sides of the laser scanning device for receiving and reflecting laser light reflected by the object to be measured, and optical axes of the two image sensing modules are parallel;
a data processing unit, configured to receive image data input by the image sensing module and extract three-dimensional information of the measured object from the image data.
如申請專利範圍第1項所述之偵測物體運動的裝置,其中:所述影像感測模組包括影像感測單元和鏡頭模組,被所述物體反射的鐳射經過所述鏡頭模組成像在所述影像感測單元上。The apparatus for detecting motion of an object according to claim 1, wherein the image sensing module comprises an image sensing unit and a lens module, and the laser reflected by the object is imaged by the lens module. On the image sensing unit. 如申請專利範圍第1項所述之偵測物體運動的裝置,其中:所述鐳射掃描裝置包括反射單元、鐳射源和光線調節單元,所述鐳射源發出的鐳射被所述反射單元反射後經過所述光線調節單元照射至所述物體上。The apparatus for detecting motion of an object according to claim 1, wherein: the laser scanning device comprises a reflecting unit, a laser source and a light adjusting unit, wherein the laser emitted by the laser source is reflected by the reflecting unit The light adjustment unit is irradiated onto the object. 如申請專利範圍第3項所述之偵測物體運動的裝置,其中:所述鐳射源為發光二極體或鐳射二極體。The device for detecting motion of an object according to claim 3, wherein the laser source is a light emitting diode or a laser diode. 如申請專利範圍第3項所述之偵測物體運動的裝置,其中:所述反射單元為反射鏡或發射板。The apparatus for detecting motion of an object according to claim 3, wherein the reflecting unit is a mirror or a transmitting board. 如申請專利範圍第3項所述之偵測物體運動的裝置,其中:所述光線調節單元為聚焦透鏡獲准直透鏡。The apparatus for detecting motion of an object according to claim 3, wherein: the light adjusting unit is a focusing lens to obtain a collimating lens. 如申請專利範圍第1至6項任一項所述之偵測物體運動的裝置,其中:所述影像感測單元為CCD感測器或CMOS感測器。The device for detecting motion of an object according to any one of claims 1 to 6, wherein the image sensing unit is a CCD sensor or a CMOS sensor. 如申請專利範圍第7項所述之偵測物體運動的裝置,其中:所述三維資訊通過計算所述影像感測模組上的像點座標得到,所述像點所述鐳射掃描裝置發出的鐳射被所述被測物體上的一個點反射並經過所述鏡頭模組在所述影像感測單元的影像。The apparatus for detecting motion of an object according to claim 7, wherein: the three-dimensional information is obtained by calculating an image point coordinate on the image sensing module, and the image point is sent by the laser scanning device. The laser is reflected by a point on the object to be measured and passes through an image of the lens module in the image sensing unit. 一種偵測物體運動的方法,其包括:
提供一個鐳射掃描裝置,其發出的鐳射投射到被測物體;
利用兩個影像感測模組取得所述鐳射被所述被測物體上的一個點反射後的影像;
利用數據處理單元從所述影像感測模組的影像資料中提取所述被測物體的三維資訊;
取得所述鐳射被若干個點反射的影像,從而偵測物體的運動軌跡。
A method of detecting motion of an object, comprising:
Providing a laser scanning device that emits a laser beam that is projected onto the object to be measured;
Obtaining, by the two image sensing modules, the image that the laser is reflected by a point on the object to be measured;
Extracting, by using a data processing unit, three-dimensional information of the measured object from image data of the image sensing module;
An image obtained by the laser being reflected by a plurality of points is obtained, thereby detecting a motion trajectory of the object.
TW98121927A 2009-06-29 2009-06-29 Device and method for detecting moving of object TWI428856B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98121927A TWI428856B (en) 2009-06-29 2009-06-29 Device and method for detecting moving of object

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98121927A TWI428856B (en) 2009-06-29 2009-06-29 Device and method for detecting moving of object

Publications (2)

Publication Number Publication Date
TW201101236A TW201101236A (en) 2011-01-01
TWI428856B true TWI428856B (en) 2014-03-01

Family

ID=44836956

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98121927A TWI428856B (en) 2009-06-29 2009-06-29 Device and method for detecting moving of object

Country Status (1)

Country Link
TW (1) TWI428856B (en)

Also Published As

Publication number Publication date
TW201101236A (en) 2011-01-01

Similar Documents

Publication Publication Date Title
JP2020500310A5 (en)
KR100753885B1 (en) Image obtaining apparatus
JP2020531848A (en) Range finder for determining at least one piece of geometric information
CN102074044B (en) System and method for reconstructing surface of object
CN105190235A (en) Compensation of a structured light scanner that is tracked in six degrees-of-freedom
US20120056982A1 (en) Depth camera based on structured light and stereo vision
JP2002139304A (en) Distance measuring device and distance measuring method
EP3929626A1 (en) Optical scanning probe and apparatus for generating three-dimensional data using the same
US20100207909A1 (en) Detection module and an optical detection device comprising the same
US11467261B2 (en) Distance measuring device and moving object
CN102074045A (en) System and method for projection reconstruction
WO2018028152A1 (en) Image acquisition device and virtual reality device
JP2008241643A (en) Three-dimensional shape measuring device
WO2022050279A1 (en) Three-dimensional measurement device
US9170471B2 (en) Optical system having integrated illumination and imaging optical systems, and 3D image acquisition apparatus including the optical system
JP2007093412A (en) Three-dimensional shape measuring device
JP2007508557A (en) Device for scanning three-dimensional objects
JP2007327966A (en) Light source module and position measuring system using it
TWI428856B (en) Device and method for detecting moving of object
KR20100094422A (en) System and method for performing optical navigation using a compact optical element
CN107743628A (en) The luminous structured light in LED faces
CN108885260B (en) Time-of-flight detector with single axis scanning
CN101930071A (en) Device and method for detecting movement of object
KR20150018026A (en) 3 demensional camera
TWI459243B (en) Three dimensional optical sensing system and game player

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees