TWI497036B - Light tracing method and apparatus thereof - Google Patents
Light tracing method and apparatus thereof Download PDFInfo
- Publication number
- TWI497036B TWI497036B TW102121745A TW102121745A TWI497036B TW I497036 B TWI497036 B TW I497036B TW 102121745 A TW102121745 A TW 102121745A TW 102121745 A TW102121745 A TW 102121745A TW I497036 B TWI497036 B TW I497036B
- Authority
- TW
- Taiwan
- Prior art keywords
- light
- time
- energy
- sensing elements
- light source
- Prior art date
Links
Landscapes
- Position Input By Displaying (AREA)
Description
本發明有關一種光線尋跡方法與裝置,特別是一種採用同調光干涉圖案和二元採集成像作為移動軌跡判斷依據的一種光指示裝置。The invention relates to a light tracing method and device, in particular to a light indicating device which uses the same dimming interference pattern and binary acquisition imaging as the basis for judging the moving track.
圖1顯示一個光學滑鼠10的內部電路示意圖,光學滑鼠10於一表面11上移動,滑鼠外殼12內部電路的主要元件除了一些光學元件外,電路部份設有一電路板14,電路板14上設有一控制與運算發射與感測光的控制器18,以及一光源16與感測器19。1 shows an internal circuit diagram of an optical mouse 10. The optical mouse 10 moves on a surface 11. The main components of the internal circuit of the mouse housing 12 are provided with a circuit board 14 and a circuit board in addition to some optical components. A controller 18 for controlling and computing the emission and sensing light is provided, as well as a light source 16 and a sensor 19.
於此光學滑鼠10的外殼12上有一個朝向外部表面11的開槽17,此電路板14即設於此開槽(aperture)17附近,電路板14上設有如雷射或是發光二極體(LED)的光源16。當此光學滑鼠10運作時,光源16連續產生發射光,以特定角度射向表面11,如圖中虛線表示,經感測器19取得反射光的訊號,或是取得反射光強度的影像分佈(如感測器19可為CMOS或CCD影像感測器),控制器18即分析出光學滑鼠10的移動方向。The outer casing 12 of the optical mouse 10 has a slot 17 facing the outer surface 11. The circuit board 14 is disposed near the aperture 17, and the circuit board 14 is provided with a laser or a light emitting diode. Light source 16 of the body (LED). When the optical mouse 10 is in operation, the light source 16 continuously generates emitted light and is directed toward the surface 11 at a specific angle, as indicated by a broken line in the figure, the signal of the reflected light is obtained by the sensor 19, or the image distribution of the intensity of the reflected light is obtained. (If the sensor 19 can be a CMOS or CCD image sensor), the controller 18 analyzes the direction of movement of the optical mouse 10.
在前述之習知光學滑鼠10的軌跡判斷的技術中,相當倚賴由表面11取得的反射光的訊號,因此一般光學滑鼠10的效能將會隨著表面11的形式而有不同的表現。In the aforementioned technique for determining the trajectory of the optical mouse 10, the signal of the reflected light obtained by the surface 11 is quite relied upon, and therefore the performance of the optical mouse 10 will generally be different depending on the form of the surface 11.
比如,若表面11為透明或是不易反光的材質,則此光學滑鼠10將無法順利運作;若表面11包括起伏不均的非平面結構,此光 學滑鼠10也難以順利操作,比如一塊有皺摺的布。For example, if the surface 11 is a transparent or non-reflective material, the optical mouse 10 will not operate smoothly; if the surface 11 includes a non-planar structure with uneven undulations, the light It is also difficult to operate the mouse 10, such as a wrinkled cloth.
習知技術中,若欲讓採用前述光感測器的尋跡裝置在不同平面上仍保有一定尋跡的效能,在取得光線移動行徑的方式多使用額外的外部定位感測或是一些複雜的運算,但這些定位感測或是運算因為靈敏度的限制、高耗能與複雜的演算法等的原因而僅適用於有限的平面樣態上。這些習知的方式並不適用於所有高反射或是很低反射率的平面上,甚至根本就是無法達成光線尋跡的目的。In the prior art, if the tracing device using the above-mentioned photo sensor still has a certain tracing performance on different planes, an additional external positioning sensing or some complicated one is used in the manner of obtaining the light moving path. Operations, but these position sensing or operations are only applicable to finite planar states due to sensitivity limitations, high energy consumption, and complex algorithms. These conventional methods are not suitable for all planes with high reflection or low reflectivity, or even for the purpose of ray tracing.
有鑑於習知的光學滑鼠並不適用於所有高反射或是很低反射率的平面上,本揭露書則提出一種採用雷射光等空間同調性良好的光線進行尋跡的方法與裝置,根據此方法應用表面反射的光與原發射光之間的光建設性與破壞性干涉的圖像,作為尋跡識別的依據。In view of the fact that the conventional optical mouse is not suitable for all planes with high reflection or low reflectivity, the present disclosure proposes a method and apparatus for tracking light with good spatial coherence such as laser light, according to This method applies an image of light constructive and destructive interference between the surface reflected light and the original emitted light as a basis for tracking identification.
根據實施例之一,光線尋跡方法包括先以一感測器接收到自一表面反射的一反射光,實施例包括此感測器為一具有以陣列形式排列的感應元的感測器陣列,而光線可自一雷射光裝置所產生,射向表面而反射後,由此感測器陣列接收。According to one embodiment, the ray tracing method includes first receiving a reflected light reflected from a surface by a sensor, and the embodiment includes the sensor being a sensor array having sensing elements arranged in an array. The light can be generated from a laser light device, reflected toward the surface and reflected, thereby being received by the sensor array.
接著,主要步驟為根據感測器陣列中的各感應元在一採集時間前後接受的光線,光線之光源裝置較佳為產生一空間同調性良好的光線的裝置,再計算感應晶片中各感應元接收的能量,經計算此採集時間前後所有或部份感應元的能量狀態,以及根據感應晶片中感應元之間(比如至少兩個鄰近感應元)在採集時間前後能量狀態的變化,以判斷移動向量。經反覆上述光線尋跡方法的步驟計算多個採集時間的移動向量,據此可判斷出一移動軌跡。Then, the main step is that according to the light received by each sensor element in the sensor array before and after an acquisition time, the light source device preferably generates a light with good spatial homology, and then calculates each sensing element in the sensing chip. The received energy is calculated by calculating the energy state of all or part of the sensing elements before and after the acquisition time, and determining the movement according to the change of the energy state before and after the acquisition time according to the sensing elements in the sensing wafer (such as at least two adjacent sensing elements). vector. The moving vector of the plurality of acquisition times is calculated by repeating the steps of the above-described ray tracing method, and accordingly, a moving trajectory can be determined.
在計算採集時間前後所有或部份感應元能量狀態的步驟中,可以先計算各感應元間所接收的能量與至少兩個統計平均值的至 少兩個差異,此差異即可以能量狀態表示,再經前後時間的差異變化來判斷移動向量。前述毎一採集時間內計算感應元能量的統計平均值可以是陣列的行、列或任何幾何相關的統計平均所決定。In the step of calculating all or part of the energy state of the sensing element before and after the acquisition time, the energy received between the sensing elements and at least two statistical averages may be calculated first. There are two differences, the difference can be expressed in the energy state, and the motion vector can be judged by the difference of the time before and after. The statistical average of the calculated inductive element energies in the aforementioned acquisition time may be determined by the row, column, or any geometrically related statistical average of the array.
根據實施例之一,上述的採集時間若以第一時間與第二時間表示,則計算至少兩個鄰近感應元在採集時間前後的能量變化的步驟包括先判斷各感應元於第一時間能量狀態,以及判斷各感應元於第二時間能量狀態,經取得至少兩個鄰近感應元於第一時間至第二時間的能量狀態的變化後,可判斷移動向量。According to one embodiment, if the foregoing acquisition time is represented by the first time and the second time, the step of calculating the energy change of the at least two adjacent sensing elements before and after the acquisition time comprises first determining the energy state of each sensing element in the first time. And determining the energy state of each of the sensing elements in the second time, and determining the motion vector after obtaining the change of the energy state of the at least two adjacent sensing elements from the first time to the second time.
根據再一實施例,採用上述光線尋跡方法的光線尋跡裝置的主要電路包括有用以產生一入射表面光線的光源裝置、以陣列形式排列的多個感應元的晶片,以及一電路集成控制器,可耦接光源裝置與感測器陣列,用以取得感應晶片內多個感應元所接收的光訊號,並計算能量狀態,以及計算採集時間的能量狀態變化。According to still another embodiment, the main circuit of the ray tracing apparatus using the ray tracing method includes a light source device for generating an incident surface ray, a wafer of a plurality of sensing elements arranged in an array, and a circuit integrated controller. The light source device and the sensor array can be coupled to obtain the optical signals received by the plurality of sensing elements in the sensing chip, calculate the energy state, and calculate the energy state change of the acquisition time.
為了能更進一步瞭解本發明為達成既定目的所採取之技術、方法及功效,請參閱以下有關本發明之詳細說明、圖式,相信本發明之目的、特徵與特點,當可由此得以深入且具體之瞭解,然而所附圖式與附件僅提供參考與說明用,並非用來對本發明加以限制者。In order to further understand the technology, method and effect of the present invention in order to achieve the intended purpose, reference should be made to the detailed description and drawings of the present invention. The drawings and the annexed drawings are intended to be illustrative and not to limit the invention.
10‧‧‧光學滑鼠10‧‧‧ optical mouse
11‧‧‧表面11‧‧‧ surface
12‧‧‧滑鼠外殼12‧‧‧ Mouse shell
14‧‧‧電路板14‧‧‧ boards
18‧‧‧控制器18‧‧‧ Controller
16‧‧‧光源16‧‧‧Light source
19‧‧‧感測器19‧‧‧ Sensor
17‧‧‧開槽17‧‧‧ slotting
201‧‧‧入射光201‧‧‧ incident light
205‧‧‧表面結構205‧‧‧ surface structure
203‧‧‧反射光203‧‧‧ reflected light
30‧‧‧電路板30‧‧‧ boards
32‧‧‧感測器陣列32‧‧‧Sensor array
301‧‧‧感應元301‧‧‧Feeling element
34‧‧‧光源裝置34‧‧‧Light source device
303‧‧‧照射範圍303‧‧‧Scope of illumination
36‧‧‧控制器36‧‧‧ Controller
501,502,503,504,505‧‧‧感應元501, 502, 503, 504, 505 ‧ ‧ sensor elements
601,602,603,604,605,606‧‧‧感應元組合601,602,603,604,605,606‧‧‧ sensor combination
521,522,523,524,525‧‧‧比較器521,522,523,524,525‧‧‧ comparator
Vavg‧‧‧平均電壓訊號Vavg‧‧‧Average voltage signal
X,Y‧‧‧方向X, Y‧‧ direction
t0‧‧‧第一時間T0‧‧‧ first time
t1‧‧‧第二時間T1‧‧‧ second time
701,702‧‧‧感應元組合701,702‧‧‧ sensor combination
步驟S401~S411‧‧‧光線尋跡方法流程之一Step S401~S411‧‧‧One of the ray tracing method flow
步驟S801~S809‧‧‧光線尋跡方法流程之二Step S801~S809‧‧‧ ray tracing method flow 2
圖1顯示習知的光學滑鼠內部電路示意圖;圖2顯示入射平面與反射光的反射光徑示意圖;圖3所示為本發明光線尋跡裝置中封裝於一積體電路內的感測器陣列示意圖;圖4所示之流程描述本發明光線尋跡方法的實施例步驟;圖5顯示為本發明尋跡裝置採用之感測器陣列之實施例示意圖;圖6顯示為本發明所揭示裝置中感應元執行光線尋跡方法之 示範圖例之一;圖7顯示為本發明所揭示裝置中各感應元執行光線尋跡方法之示範圖例之二;圖8顯示之流程描述尋跡方法係根據能量變化的方向判斷移動向量的步驟。1 shows a schematic diagram of an internal circuit of a conventional optical mouse; FIG. 2 shows a schematic diagram of a reflected light path of an incident plane and reflected light; and FIG. 3 shows a sensor packaged in an integrated circuit in the ray tracing apparatus of the present invention; Array diagram; the flow shown in FIG. 4 describes the steps of the embodiment of the ray tracing method of the present invention; FIG. 5 shows a schematic diagram of an embodiment of the sensor array used in the tracing apparatus of the present invention; Medium sensing element performs ray tracing method One of the exemplary illustrations; FIG. 7 shows a second exemplary example of performing a ray tracing method for each sensing element in the device disclosed in the present invention; and FIG. 8 shows a flow chart describing the step of determining the motion vector according to the direction of the energy change.
採用非同調光(non-coherent light)作為移動位置判斷的技術通常需要複雜的資料運算程序,比如判斷滑鼠移動軌跡,這類的技術常限制在幾種平面(比如避免使用光反射率過低的平面)上才能有較好的效果。有鑑於此,本揭露書描述一種光線尋跡方法與裝置,實施例之一係採用了同調光(coherent light)或說是一種空間同調性(spatial coherence)良好的光線作為光源,藉此偵測移動方向,並可結合靈敏度補償(sensitivity compensation)的方式,利用一種光線尋跡演算法(movement recognition algorithm),相關採用此技術的裝置可以適用於各種態式的平面上。The use of non-coherent light as a technique for determining position of motion usually requires complex data calculation procedures, such as judging the movement of the mouse. Such techniques are often limited to several planes (such as avoiding low light reflectance). The plane can only have a good effect. In view of this, the present disclosure describes a ray tracing method and apparatus. One embodiment uses a coherent light or a spatial coherence light as a light source to detect The direction of movement, and in combination with sensitivity compensation, utilizes a motion recognition algorithm, and the device using this technique can be applied to various states of the plane.
值得一提的是,揭露書所提出的光線尋跡裝置內可以採用一種同調光源整合型封裝技術(coherent light source package integration),採用此類技術的裝置,如光學指示裝置,無須安裝額外的光學透鏡或特定影像感測器,如一種互補式金氧半場效電晶體影像感測器(CMOS image sensor,CIS)。It is worth mentioning that the light tracing device proposed by the disclosure can adopt a coherent light source package integration, and devices using such technologies, such as optical indicating devices, do not need to install additional optics. A lens or a specific image sensor, such as a complementary CMOS image sensor (CIS).
首先請先參看圖2所示由一特定光源裝置(未顯示於此圖)產生入射光(201)射向一平面再反射(203)形成多個反射光徑的示意圖,光源特別是採用一種如雷射的同調光(coherent light),此處所描述的「同調光」是指一種空間同調性良好的光線。First, please refer to FIG. 2 for a specific light source device (not shown) to generate incident light (201) to a plane and then reflect (203) to form a plurality of reflected light paths. The light source is particularly The coherent light of a laser, as described herein, "coherent light" refers to a light with good spatial coherence.
此圖顯示的多個光徑包括入射光201射向一個具有表面結構205的平面,再反射形成反射光203。由於微觀上表面結構205為不規則的結構,因此反射光203形成如圖示意顯示有不同射向的 光線。The plurality of optical paths shown in this figure include incident light 201 directed toward a plane having a surface structure 205, which is then reflected to form reflected light 203. Since the microscopic upper surface structure 205 is an irregular structure, the reflected light 203 is formed as shown in the figure to show different directions. Light.
光源裝置連續產生入射光201射向平面,並反射形成反射光203,過程中反射光203經由感測器(未顯示於此圖中)接收,各種光徑中產生了光建設性與破壞性干涉的圖像(pattern),此處特別使用同調光源的入射光可以增進此干涉效應(interference effect)。The light source device continuously generates incident light 201 to a plane, and reflects to form reflected light 203. In the process, the reflected light 203 is received through a sensor (not shown in the figure), and light constructive and destructive interference occurs in various optical paths. The pattern, where incident light from a coherent light source is used in particular, can enhance this interference effect.
當載有執行此尋跡方法的相關電路的裝置相對於感測平面(X-Y平面)進行移動時,其中光感測器接收到反射光203的訊息,再依據採集時間間隔(time slot)採集(sampling)其中訊息資料,以及取得平均能量值(反射光),並計算不同時間、不同位置的能量差異。特別的是,本揭露書所揭示的光線尋跡裝置較佳地採用一種感應器陣列(sensor array)以取得不同位置能量,以及與平均能量值的差異,即能判斷出移動軌跡。其中統計平均值的計算可以採用全部感應元(sensor cell)取得的能量的統計平均值,或是部份感應元取得的能量平均值,比如以行(如圖5的X方向)平均值或列(如圖5的Y方向)平均值為平均值的計算參考;亦可能採取週邊或中間部份的能量平均值作為參考平均值。When the device carrying the relevant circuit for performing the tracking method moves relative to the sensing plane (XY plane), the photo sensor receives the message of the reflected light 203 and collects according to the time slot (time slot) ( Sampling) The message data, as well as the average energy value (reflected light), and the energy difference at different times and positions. In particular, the ray tracing apparatus disclosed in the present disclosure preferably employs a sensor array to obtain energy at different positions and a difference from an average energy value, that is, a movement trajectory can be determined. The statistical average can be calculated by using the statistical average of the energy obtained by all the sensor cells, or the average of the energy obtained by the partial sensing elements, such as the average value or column of the rows (as shown in the X direction of FIG. 5). (The Y direction in Fig. 5) The average value is a calculation reference of the average value; it is also possible to take the average value of the energy of the peripheral or intermediate portion as the reference average value.
根據採用上述感應器陣列的實施例之一,若以同調光為光源,可以增進反射光線的干涉效應。同調光為一種在一波包(wave envelope)中具有非常小相位延遲(phase delay)的光源,其中雷射光即是一種同調光,不同於太陽光或LED光等非同調光。According to one of the embodiments using the above-described sensor array, if the same dimming is used as the light source, the interference effect of the reflected light can be enhanced. The same dimming is a kind of light source with a very small phase delay in a wave envelope, wherein the laser light is a kind of dimming light, which is different from the dimming light such as sunlight or LED light.
應用同調光於本揭露書揭示的尋跡裝置中,同調光可以改善感測反射光干擾的光學感測器的靈敏度。因為同調光有很小相位差(phase difference)的特性,相對於非同調光的反射光所產生的空間干擾(spatial interference),同調光會有較小的相位延遲(phase delay)現象。因此,採用同調光可以加強反射光空間干擾的優點,前述感測器陣列(針對光線)可以取得經一個平面反射光的空間干擾差異。With the same dimming as the tracing device disclosed in the present disclosure, the same dimming can improve the sensitivity of the optical sensor that senses the reflected light interference. Because the same dimming has a small phase difference characteristic, compared with the spatial interference caused by the non-coherent reflected light, the same dimming will have a small phase delay phenomenon. Therefore, the use of the same dimming can enhance the spatial interference of the reflected light, and the aforementioned sensor array (for the light) can obtain the spatial interference difference of the reflected light through one plane.
感測器陣列可參閱圖3所示本發明光線尋跡裝置中封裝於一積體電路(IC)內的感測器陣列的實施例之一。根據發明實施例之一,感測器陣列以及相關控制器電路係可集成於一半導體電路,而光線尋跡裝置之光源裝置、集成的感測器陣列以及控制器可封裝於此尋跡裝置內的一電路板上,因此,本發明無需特制光學採集裝置,如特定透鏡和特殊的半導體製程(如CIS)來提高感光靈敏度。The sensor array can be referred to one of the embodiments of the sensor array packaged in an integrated circuit (IC) in the ray tracing device of the present invention shown in FIG. According to one embodiment of the invention, the sensor array and the associated controller circuit can be integrated in a semiconductor circuit, and the light source device of the light tracing device, the integrated sensor array and the controller can be packaged in the tracing device On a circuit board, therefore, the present invention does not require special optical acquisition devices, such as specific lenses and special semiconductor processes (such as CIS) to improve sensitivity.
此例圖中顯示一個設於一裝置(如光學滑鼠或是特定指示裝置)內電路板30上的感測器陣列32,感測器陣列32包括有陣列形式排列的多個感應元301,可透過整合型封裝的技術(integrated optical sensor array on IC)同時製作感測器陣列32與電路集成的控制器36,感測器陣列32上的各個感應元301可以在固定的位置平均取得經平面反射的光線。示意如圖中由一光源裝置34發射光線到一個平面上的照射範圍303,之後光線經平面反射後射向感測器陣列32,其中各感應元301分別接收到不同方向的反射光,透過適當光電訊號轉換,裝置內的控制器36與相關電路取得訊號後可以計算出加總每個感應元301接收到的能量的統計平均值,再接著計算各個感應元301與平均值的差異,以取得由平面反射形成的空間干擾的能量差異(spatial interference difference),控制器36根據每個採集時間(time slot)前後累積計算的能量差異判斷出移動方向。In this example, a sensor array 32 is shown disposed on a circuit board 30 within a device (such as an optical mouse or a specific pointing device). The sensor array 32 includes a plurality of sensing elements 301 arranged in an array. The sensor array 32 and the circuit-integrated controller 36 can be simultaneously fabricated by an integrated optical sensor array on IC. Each of the sensing elements 301 on the sensor array 32 can obtain a warp plane at a fixed position. Reflected light. The illumination range 303 emitted by a light source device 34 to a plane is illustrated in the figure, and then the light is reflected by the plane and then directed to the sensor array 32, wherein each of the sensing elements 301 respectively receives reflected light in different directions. The photoelectric signal conversion, after the controller 36 and the related circuit in the device obtain the signal, can calculate the statistical average value of the energy received by each of the sensing elements 301, and then calculate the difference between each sensing element 301 and the average value to obtain The spatial interference difference caused by the planar reflection, the controller 36 determines the moving direction based on the accumulated energy difference before and after each time slot.
上述實施例所揭示的光線尋跡裝置中,所謂的空間干擾係因,當光線(特別是同調光,但發明不限於同調光)射向有不規則表面結構的表面後又反射產生不同方向的反射光而產生的光線干擾(interference),此光線經反射後產生建設性或破壞性的干擾圖案,之後,由感測器陣列取得因為相對運動(裝置與平面的相對運動)平面反射的空間資訊後,建立在X-Y平面上的移動資料。In the ray tracing device disclosed in the above embodiments, the so-called spatial interference is caused by light rays (especially, the same dimming, but the invention is not limited to the same dimming), which is reflected on the surface having the irregular surface structure and then reflected in different directions. Light interference caused by reflected light, which is reflected to produce a constructive or destructive interference pattern, after which the spatial information of the plane reflection due to relative motion (relative motion of the device and the plane) is obtained by the sensor array. After that, the mobile data is created on the XY plane.
特別於一實施例中,揭露書所揭示的光線尋跡裝置可為一以 雷射光為光源的光學指示裝置,如光學滑鼠,其中主要電路元件包括設於一電路板(30)上的光源裝置(34),用以產生一入射表面之光線,包括有感測器陣列(32),其中有以陣列形式排列的多個感應元(301),以及包括有前述之控制器(36),控制器(36)耦接光源裝置(34)與感測器陣列(32),用以取得多個感應元(301)內多個感應畫素所接收的光訊號,並計算能量狀態,以及計算採集時間前後的能量狀態變化。In particular, in an embodiment, the ray tracing device disclosed in the disclosure may be The laser light is an optical indicating device of the light source, such as an optical mouse, wherein the main circuit component comprises a light source device (34) disposed on a circuit board (30) for generating light of an incident surface, including a sensor array (32), wherein there are a plurality of sensing elements (301) arranged in an array, and a controller (36) including the foregoing, the controller (36) coupled to the light source device (34) and the sensor array (32) The optical signal received by the plurality of sensing pixels in the plurality of sensing elements (301) is used to calculate the energy state, and the energy state changes before and after the acquisition time are calculated.
圖4所示之流程描述本發明光線尋跡方法的實施例步驟。The flow shown in Figure 4 describes the steps of an embodiment of the ray tracing method of the present invention.
在此實施例流程中,步驟開始如S401,由設於光線尋跡裝置內的光源裝置發射光線,射向一個表面,之後如步驟S403,由裝置內的感測器接收反射光。In the flow of this embodiment, the step starts as S401, and the light source device provided in the light tracing device emits light to a surface, and then, as in step S403, the reflected light is received by the sensor in the device.
根據實施例,光源較佳如同調光,主要目的是利用同調光較小相位延遲的特性改善利用反射光干擾偵測移動方向的靈敏度。其中光源裝置可為設於光指示裝置內的雷射光裝置,而感測器則較佳採用如圖3顯示的感測器陣列。According to an embodiment, the light source is preferably like dimming, and the main purpose is to improve the sensitivity of detecting the moving direction by using the reflected light interference by utilizing the characteristic of the phase shift with less dimming. The light source device may be a laser light device disposed in the light indicating device, and the sensor preferably uses the sensor array as shown in FIG.
之後,本揭露書所揭示的光線尋跡方法係主要透過計算前述採集時間前後所有或部份感應元的能量狀態,再根據至少兩個鄰近感應元在採集時間前後能量狀態的變化而判斷一移動向量,其中之一實施方式的細節如下。Thereafter, the ray tracing method disclosed in the present disclosure mainly calculates the energy state of all or a part of the sensing elements before and after the acquisition time, and then determines a movement according to the change of the energy state of the at least two adjacent sensing elements before and after the acquisition time. The details of the vector, one of which is as follows.
經感測器接收反射光後,如步驟S405,裝置內控制電路計算一個採集時間間隔(time slot)前後的各感應元接收的能量,並如步驟S407,再計算所有或部份(可能非所有的感應元/感應畫素(sensor pixel)都接收到足以計算能量的光線,如圖6所載範例)感應元在該採集時間前後所取得的能量平均值(同一時間至少處理兩個值)。經前後不同時間計算各感應元的能量與所有或部份(比如以行平均值、列平均值、週邊平均值、中央平均值為參考平均值)的能量平均值後,可以計算出各感應元接收能量與統計平均值的差值(在一實施例中,此處之差值可表示各感應元的能 量狀態),其中分別處理該採集時間前後的至少兩個差值,如步驟S409。採集時間前後的兩組數值之間可存在一個差異,也就是前後時間的能量變化,之後可根據感應晶片內的多個(至少兩個)鄰近的感應元所計算的能量變化判斷出整體採用此尋跡技術的裝置的移動向量,如步驟S411。After the sensor receives the reflected light, in step S405, the in-device control circuit calculates the energy received by each of the sensing elements before and after a time slot, and then calculates all or part (may not be all) according to step S407. The sensor pixel receives the energy sufficient to calculate the energy, as shown in the example in Figure 6. The average value of the energy obtained by the sensor element before and after the acquisition time (at least two values are processed at the same time). After calculating the energy average of all the sensing elements and all or part of the sensing elements (for example, the average value of the row average, the column average, the peripheral average, and the central average as the reference average), the sensing elements can be calculated. The difference between the received energy and the statistical average (in an embodiment, the difference here can represent the energy of each sensing element) The quantity state), wherein at least two differences before and after the acquisition time are respectively processed, as by step S409. There may be a difference between the two sets of values before and after the acquisition time, that is, the energy change before and after the time, and then the overall energy adoption may be determined according to the energy change calculated by the plurality of (at least two) adjacent sensing elements in the sensing wafer. The motion vector of the device of the tracing technique is as in step S411.
經反覆上述光線尋跡方法的步驟可計算出多個採集時間的移動向量,據此判斷出在一定時間內的移動軌跡。其中根據各感應元中感測到的能量變化判斷裝置與表面的相對移動的方式,可以參考圖6、圖7所記載的範例,步驟可參考圖8所示的流程。The step of repeating the above-mentioned ray tracing method can calculate a movement vector of a plurality of acquisition times, and thereby determine a movement trajectory within a certain time. For the manner of judging the relative movement of the device and the surface according to the energy change sensed in each of the sensing elements, reference may be made to the examples described in FIG. 6 and FIG. 7, and the steps may refer to the flow shown in FIG. 8.
圖5則顯示光線尋跡裝置所採用的感測器陣列運作計算能量分佈的實施例示意圖,根據發明實施例,其中所提出的尋跡的演算方式透過此圖例所示的電路結構以及感測器陣列。FIG. 5 is a schematic diagram showing an embodiment of a sensor array operation calculation energy distribution used by the light tracing device. According to an embodiment of the invention, the proposed tracing calculation mode is through the circuit structure and the sensor shown in the legend. Array.
圖5顯示了感測器陣列的佈局,多個感應元分佈於X-Y平面上,形成NxM的感測器陣列,包括陣列形式排列的多個感應元501,502,503,504,505,分別沿著方向X,Y設置,實際數量並不限於此示意圖。鋪設這些感應元501,502,503,504,505的電路板上主要元件還有多個比較器521,522,523,524,525,各個比較器對應連接一個感應元,輸入值為各個感應元產生的能量的平均電壓訊號Vavg,用以比較感應元感測到光線後所得到的電壓訊號,可以比較得到高低電壓的訊號值。最後,尋跡方法即取得相鄰兩個感測器值比對結果,作出移動方向的判斷。Figure 5 shows the layout of the sensor array. A plurality of sensing elements are distributed on the XY plane to form an NxM sensor array, including a plurality of sensing elements 501, 502, 503, 504, 505 arranged in an array, respectively arranged along the direction X, Y, actually The number is not limited to this schematic. The main components on the circuit board on which these sensing elements 501, 502, 503, 504, 505 are laid are also a plurality of comparators 521, 522, 523, 524, 525. Each comparator is connected with a sensing element, and the input value is the average voltage signal Vavg of the energy generated by each sensing element for comparing the sensing element sensing. The voltage signal obtained after the light can be compared to obtain the signal value of the high and low voltage. Finally, the tracing method obtains the comparison results of two adjacent sensor values and makes a judgment of the moving direction.
比如圖中比較器521耦接於感應元501,其中一個輸入訊號即感應元501所感測產生的能量訊號,可以電壓訊號表示,另一輸入端則為平均電壓訊號Vavg,因此比較器521比對這兩個輸入訊號,可以輸出一個比較結果,本發明較佳地以一二元特徵值(binary characteristic value)表示此比較結果,比如圖6所示H或L分別表示的高低電壓訊號。For example, the comparator 521 is coupled to the sensing element 501. One of the input signals, that is, the energy signal generated by the sensing element 501, can be represented by a voltage signal, and the other input terminal is an average voltage signal Vavg, so the comparator 521 is compared. The two input signals can output a comparison result. The present invention preferably expresses the comparison result by a binary characteristic value, such as the high and low voltage signals respectively indicated by H or L in FIG.
根據揭露書所記載之光線尋跡方法中,尋跡的方式特徵在於 利用光線(較佳為同調光)經平面反射後形成的建設性與破壞性干擾圖案中顯示的能量分佈(energy pattern),透過不同時間的能量分佈變化判斷移動向量。其中實施方式比如採用非相關視點進行移動判斷(non-relative view points to do movement judgment)的方式,也就是引入周圍感應元的能量資訊,與平均感應能量進行比對判斷移動方向。值得一提的是,這不同於一般利用影像畫素(pixel)資訊判斷移動向量的方式,本發明是透過採用時間與計算能量變化而判斷出移動軌跡,而且能量變化可採取一種二元特徵值(如H與L),此二元特徵值為感應元的讀值與統計平均值的比較。According to the ray tracing method described in the disclosure, the manner of tracing is characterized by The energy pattern displayed in the constructive and destructive interference patterns formed by the light (preferably the same dimming) through the plane reflection is used to determine the motion vector through the energy distribution changes at different times. The implementation method is, for example, a method of non-relative view points to do movement judgment, that is, introducing energy information of surrounding sensing elements, and comparing with the average sensing energy to determine the moving direction. It is worth mentioning that this is different from the general method of judging the motion vector by using pixel information. The present invention determines the movement trajectory by using time and calculation energy changes, and the energy change can adopt a binary eigenvalue. (eg, H and L), this binary eigenvalue is a comparison of the readings of the sensing elements with the statistical average.
應用不同時間能量變化判斷移動方向的步驟如圖8顯示。步驟S801描述裝置先取得各感應元於前後時間(t0,t1)接收之能量,再計算前後時間能量之全部或部份感應元接收能量的統計平均值,如步驟S803。各感應元間不同時間所取得的能量數值(可以電壓訊號表示)與平均數值比對後,可以計算前後時間之能量變化,如步驟S805。The procedure for judging the direction of movement by applying different time energy changes is shown in FIG. Step S801 describes that the device first obtains the energy received by each sensor element in the front and rear time (t0, t1), and then calculates the statistical average value of all or part of the sensor element received energy before and after the time energy, as in step S803. After the energy values (which can be represented by voltage signals) obtained at different times between the sensing elements are compared with the average values, the energy changes of the time before and after can be calculated, as in step S805.
之後參考在不同時間(t0,t1)的鄰近感應元的能量變化,可以判斷前後時間能量變化的方向,如步驟S807。最後如步驟S809所載,可以透過多數個感應元的能量變化方向來判斷整體移動向量。Then, referring to the energy change of the adjacent sensing elements at different times (t0, t1), the direction of the energy change before and after the time can be judged, as in step S807. Finally, as shown in step S809, the overall motion vector can be determined by the direction of energy change of the plurality of sensing elements.
在圖8所述透過前後能量變化判斷移動向量的方式中,感應元在前後時間的能量可以一種以電壓形式表示的能量狀態,比如與整體同一時間的能量平均值比較後可以取得一個如圖6所示以二元特徵值H或L表示的能量狀態。因此,先判斷各感應元分別於第一時間(t0)與第二時間(t1)的能量狀態,之後取得至少兩個鄰近感應元於第一時間至第二時間的能量狀態的變化,可以判斷移動向量。In the manner of judging the motion vector by the change of the energy before and after, the energy of the sensing element in the front and back time may be an energy state expressed in the form of a voltage, for example, compared with the average energy value of the whole time at the same time, a figure can be obtained as shown in FIG. 6. The energy state represented by the binary eigenvalue H or L is shown. Therefore, first determining the energy state of each of the sensing elements at the first time (t0) and the second time (t1), and then obtaining the change of the energy state of the at least two adjacent sensing elements from the first time to the second time, can be judged Move the vector.
採用前述二位元採集成像執行移動向量的判斷可以參考圖6 所示本發明所揭示裝置中多個感應元執行光線尋跡方法之示範圖例。The judgment of performing the motion vector by using the foregoing two-bit acquisition imaging can refer to FIG. 6 An exemplary illustration of a plurality of sensing elements in the apparatus of the present invention is shown to perform a ray tracing method.
此例顯示有多個陣列排列的感應元組合601,602,603,604,605,606,此例僅示意列舉透過相鄰感應元在不同時間(如第一時間t0,第二時間t1)感測到的能量變化而辨識移動向量的範例。This example shows a plurality of arrays of sensing element combinations 601, 602, 603, 604, 605, 606. This example only illustrates the identification of the moving vector by the energy changes sensed by the adjacent sensing elements at different times (eg, the first time t0, the second time t1). example.
其中t0與t1為前後兩個採樣時間,H與L分別表示由前述比較器所輸出的高低電壓訊號,也就是可視為能量狀態(相較於平均能量為一個能量狀態,能量狀態可以二元特徵值表示),主要是透過前後時間的電壓訊號轉變判斷出一個整體的移動向量。圖6顯示為個別感應元中在前後兩個不同時間的能量變化。Where t0 and t1 are the two sampling times before and after, and H and L respectively represent the high and low voltage signals output by the aforementioned comparator, that is, can be regarded as the energy state (the energy state can be binary characteristic compared to the average energy being an energy state) The value indicates), mainly by determining the overall motion vector through the voltage signal transition of the time before and after. Figure 6 shows the energy changes in the individual sensing elements at two different times before and after.
比如感應元組合601中示意顯示幾個(至少兩個)感應元,其中左方顯示在第一時間t0時,兩個感應元分別感應到L與H兩個能量狀態;當進入第二時間t1時,兩個感應元的能量變化則轉變為H與H。當L、H(t0)轉變為H、H(t1)時,其中感應元的能量狀態由L轉變為H,表示由右方的H替補到左方的位置,因此可以初步判斷在此採集時間中有效感應的移動方向為向左。For example, the sensing element combination 601 schematically displays several (at least two) sensing elements, wherein the left side is displayed at the first time t0, and the two sensing elements respectively sense two energy states of L and H; when entering the second time t1 At the same time, the energy changes of the two sensing elements are converted into H and H. When L and H(t0) are converted to H and H(t1), the energy state of the sensing element is changed from L to H, indicating that the right side H is substituted to the left position, so the initial collection time can be determined. The direction of effective sensing in the middle is leftward.
而此感應元組合601之另一組感應元在第一時間t0時,能量狀態為H與L;到了第二時間t1,能量狀態則為L與L,其中有個感應元能量狀態的由H轉變為L,也是表示右方的L替補到左方的位置,因此可以判斷有個向左的移動方向。The other group of sensing elements of the sensing element combination 601 has an energy state of H and L at a first time t0; and an energy state of L and L at a second time t1, wherein the energy state of the sensing element is H The transition to L also indicates that the L substitute on the right is at the left position, so it can be judged that there is a leftward moving direction.
再如感應元組合602內左方的兩個感應元在第一時間t0的能量狀態為L與H,到了第二時間t1改變為L與L,可以看出其中的H經左方的L向右替補成為L,因此初步判斷有個向右的移動向量。For example, if the two sensing elements on the left side of the sensing element combination 602 have L and H energy values at the first time t0, and the second time t1 changes to L and L, it can be seen that the H direction of the left side is L. The right substitute becomes L, so it is initially determined that there is a rightward moving vector.
同理,感應元組合602內的右方有兩個感應元在第一時間t0的能量狀態為H與L,之後到了第二時間t1時變化成為H與H,其中右方的L經左方的H替補轉變為H,因此可以判斷出有個向右的移動向量。Similarly, the right side of the sensing element combination 602 has two sensing elements whose energy states are H and L at the first time t0, and then changes to H and H at the second time t1, wherein the right L passes to the left. The H substitute is converted to H, so it can be judged that there is a rightward moving vector.
圖中感應元組合605與606並沒有箭頭標示方向,經判斷為此例中多個感應元在第一時間t0與第二時間t1的採集時間中沒有能量變化,或是無法透過其中能量變化判斷出移動方向,比如感應元組合606在第一時間t0能量狀態為L與H,到了第二時間t1,能量狀態轉變為H與L,這是無法透過能量狀態變化來判斷移動方向的。因此,這兩種態樣是沒有有效輸出訊號的。In the figure, the sensing element combinations 605 and 606 have no arrow indicating direction, and it is judged that in this example, the plurality of sensing elements have no energy change during the acquisition time of the first time t0 and the second time t1, or cannot be judged by the energy change therein. In the moving direction, for example, the sensing element combination 606 is at the first time t0, the energy state is L and H, and by the second time t1, the energy state is changed to H and L, which is impossible to determine the moving direction through the energy state change. Therefore, these two aspects have no valid output signal.
當前後兩個時間的全部感應元都判斷了各自能量變化的方向時,可以整體判斷出一個總體的移動向量。When all the sensing elements of the last two times judge the direction of the respective energy changes, an overall motion vector can be determined as a whole.
另一個移動方向判斷的方式如圖7所示為本發明所揭示裝置中感應晶片執行光線尋跡方法之示意圖之二。此例透過不同時間的感應元能量狀態的轉換方向以辨識移動向量的方法示意圖,其中X為不在意的值,@為t0與t1所感應訊號的比對,藉此判斷移動向量。Another way of judging the direction of movement is as shown in FIG. 7 , which is a schematic diagram of a method for performing ray tracing on a sensing wafer in the device disclosed in the present invention. In this example, a schematic diagram of a method for recognizing a motion vector by changing the direction of the inductive meta-energy state at different times, where X is an unintentional value, @ is an alignment of the signals sensed by t0 and t1, thereby judging the motion vector.
經感應晶片接收到反射光時,感應晶片內的多個感應元在不同時間根據接收的訊號能量與平均能量比較時,產生有高低不同電壓訊號,如此例圖示為產生有感應訊號「@」;在一些情況下,仍有可能部份的感應元並沒有能量變化,或是無關電壓訊號的高低,此時如圖顯示為不在意的值「X」。When the reflected light is received by the sensing chip, the plurality of sensing elements in the sensing chip generate different high and low voltage signals according to the received signal energy and the average energy at different times. In this example, the sensing signal "@" is generated. In some cases, it is still possible that some of the sensing elements have no energy change, or that there is no difference in the voltage signal. At this time, the value shown as "X" is not shown.
根據圖式的實施態樣,在感應元組合701中,經前述比較器於第一時間t0取得相鄰感應元的能量變化,表示為狀態「X@@」,其中「X」為不在意值,「@」表示有高低電壓變化;在第二時間t1取得幾個相鄰感應元的能量變化,表示為狀態「@@X」。經第一時間t0與第二時間t1的各感應元的能量狀態變化,此例顯示狀態「X@@」轉變為「@@X」,可以判斷「@@」向左位移(shift),因此可以判斷這個感應元組合701有一個向左移動的變化,如圖中箭頭所示。According to the embodiment of the figure, in the sensing element combination 701, the energy change of the adjacent sensing element is obtained by the comparator at the first time t0, and is expressed as a state "X@@", wherein "X" is an unintentional value. "@" indicates that there is a high and low voltage change; at the second time t1, the energy change of several adjacent sensing elements is obtained, which is expressed as the state "@@X". The energy state of each sensor element at the first time t0 and the second time t1 changes, and in this example, the display state "X@@" is changed to "@@X", and it can be judged that "@@" is shifted to the left (shift), so It can be judged that this sensor element combination 701 has a change to the left movement as indicated by the arrow in the figure.
在感應元組合702中,其中相鄰的感應元在第一時間t0的能量變化表示為狀態「@@X」,在第二時間t1時,能量狀態表示為 「X@@」,此時可見經時間轉變(t0到t1)後,其中狀態「@@」顯示有向右位移的趨勢。因此,本揭露書所揭示的尋跡方法則利用此前後時間的能量變化判斷整體裝置的移動方向。In the sensing element combination 702, the energy change of the adjacent sensing element at the first time t0 is represented as the state "@@X", and at the second time t1, the energy state is represented as "X@@", at this time, after the time transition (t0 to t1) is seen, the state "@@" shows a tendency to shift to the right. Therefore, the tracing method disclosed in the present disclosure determines the moving direction of the overall device by utilizing the energy change of the time before and after.
值得一提的是,在判斷移動方向時,由於發明採取了感測器陣列,因此微小的誤差並不會影響整體判斷的結果。若尋跡方法應用於電腦光學滑鼠上,一般使用者操作滑鼠的移動頻率遠低於其中如控制電路的處理速度,一些緩慢改變的參考數值並不會影響整體判斷。It is worth mentioning that when the direction of movement is judged, since the invention adopts the sensor array, the slight error does not affect the result of the overall judgment. If the tracing method is applied to a computer optical mouse, the moving frequency of the general user operating the mouse is much lower than the processing speed of the control circuit, and some slowly changing reference values do not affect the overall judgment.
綜上所述,根據揭露書所載實施例,本發明係涉及一種根據反射干擾進行光線尋跡的方法與光線尋跡裝置,特別採用同調光干涉圖案和二元採集成像作為移動軌跡判斷依據,其中所揭示的光線尋跡裝置係整合於一半導體封裝內,藉此可以有效壓抑內部固有的噪聲(intrinsic noise),而應用其中尋跡方法的裝置則特別採用同調光作為光源,同調光可以改善感測反射光干擾的光學感測器的靈敏度。In summary, according to the embodiment disclosed in the disclosure, the present invention relates to a method for ray tracing according to reflection interference and a ray tracing device, in particular, using the same dimming interference pattern and binary acquisition imaging as the basis for judging the movement trajectory. The ray tracing device disclosed therein is integrated in a semiconductor package, thereby effectively suppressing internal intrinsic noise, and the device using the tracing method particularly uses the same dimming as the light source, and the same dimming can be improved. Sensing the sensitivity of the optical sensor that reflects the reflected light.
惟以上所述僅為本發明之較佳可行實施例,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖示內容所為之等效結構變化,均同理包含於本發明之範圍內,合予陳明。However, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, equivalent structural changes that are made by using the specification and the contents of the present invention are equally included in the present invention. Within the scope, it is combined with Chen Ming.
30‧‧‧電路板30‧‧‧ boards
32‧‧‧感測器陣列32‧‧‧Sensor array
301‧‧‧感應元301‧‧‧Feeling element
34‧‧‧光源裝置34‧‧‧Light source device
303‧‧‧照射範圍303‧‧‧Scope of illumination
36‧‧‧控制器36‧‧‧ Controller
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW102121745A TWI497036B (en) | 2013-06-19 | 2013-06-19 | Light tracing method and apparatus thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW102121745A TWI497036B (en) | 2013-06-19 | 2013-06-19 | Light tracing method and apparatus thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201500979A TW201500979A (en) | 2015-01-01 |
TWI497036B true TWI497036B (en) | 2015-08-21 |
Family
ID=52717959
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW102121745A TWI497036B (en) | 2013-06-19 | 2013-06-19 | Light tracing method and apparatus thereof |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI497036B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110515090A (en) * | 2018-05-22 | 2019-11-29 | 诚盟电科技股份有限公司 | Light sensing mould group and method for sensing |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8405613B2 (en) * | 2006-06-16 | 2013-03-26 | Em Microelectronic-Marin Sa | Optimization of statistical movement measurement for optical mouse, with particular application to laser-illuminated surfaces |
-
2013
- 2013-06-19 TW TW102121745A patent/TWI497036B/en active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8405613B2 (en) * | 2006-06-16 | 2013-03-26 | Em Microelectronic-Marin Sa | Optimization of statistical movement measurement for optical mouse, with particular application to laser-illuminated surfaces |
Also Published As
Publication number | Publication date |
---|---|
TW201500979A (en) | 2015-01-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11378390B2 (en) | CMOS image sensor for 2D imaging and depth measurement with ambient light rejection | |
CN102959494B (en) | An optical navigation module with capacitive sensor | |
JP6270813B2 (en) | Motion sensor device having a plurality of light sources | |
KR101149458B1 (en) | Touching device and light source structure thereof | |
US11002531B2 (en) | CMOS image sensor for RGB imaging and depth measurement with laser sheet scan | |
WO2021212917A1 (en) | Device and method for measuring tof depth | |
US9978148B2 (en) | Motion sensor apparatus having a plurality of light sources | |
TWI558982B (en) | Optical sensor and optical sensor system | |
TW201540066A (en) | Image sensor modules including primary high-resolution imagers and secondary imagers | |
KR20160132962A (en) | Optical imaging modules and optical detection modules including a time-of-flight sensor | |
WO2020066637A1 (en) | Depth acquisition device, depth acquisition method, and program | |
US20130002859A1 (en) | Information acquiring device and object detecting device | |
US20140035812A1 (en) | Gesture sensing device | |
US20130010292A1 (en) | Information acquiring device, projection device and object detecting device | |
CN103353790B (en) | Light autonomous tracing in intelligent vehicle and device | |
TWI497036B (en) | Light tracing method and apparatus thereof | |
US20150261329A1 (en) | Electronic device having optical indexing module | |
KR102473735B1 (en) | Operation method of imaging apparatus | |
TWI439906B (en) | Sensing system | |
JP6236150B2 (en) | Ray tracing method and apparatus | |
WO2014205705A1 (en) | Light sensor array device | |
US9804688B2 (en) | Light tracing method and apparatus thereof | |
US9804000B2 (en) | Optical sensor array apparatus | |
US9804695B2 (en) | Cursor control apparatus and method for the same | |
US20150193019A1 (en) | Mobile apparatus with optical indexer, and method for indexing using the same |