TW201445359A - Handheld pointer device and tilt angle adjustment method thereof - Google Patents

Handheld pointer device and tilt angle adjustment method thereof Download PDF

Info

Publication number
TW201445359A
TW201445359A TW102118058A TW102118058A TW201445359A TW 201445359 A TW201445359 A TW 201445359A TW 102118058 A TW102118058 A TW 102118058A TW 102118058 A TW102118058 A TW 102118058A TW 201445359 A TW201445359 A TW 201445359A
Authority
TW
Taiwan
Prior art keywords
image frame
reference point
acceleration
image
pointing device
Prior art date
Application number
TW102118058A
Other languages
Chinese (zh)
Inventor
Han-Ping Cheng
Chao-Chien Huang
Chia-Cheun Liang
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to TW102118058A priority Critical patent/TW201445359A/en
Priority to US14/273,523 priority patent/US10067576B2/en
Publication of TW201445359A publication Critical patent/TW201445359A/en

Links

Abstract

An exemplary embodiment of the present disclosure provides a pointer device and a tilt angle adjustment method thereof. The tilt angle adjustment method includes the following steps. Images corresponding to the position of a reference point are captured as the pointer device pointing toward the reference point to generate a plurality of frames. Whether the reference point has substantially moved is subsequently determined based on the plurality of frames. When determines that the reference point has not substantially moved, causes an accelerometer unit of the pointer device to detect accelerations thereof over various axes so as to update a first tilt angle being used currently to a second tilt angle, accordingly. The pointer device may thus accurately and efficiently calculate the position of the reference point with the appropriate tilt angle of the pointer device used.

Description

手持式指向裝置以及其傾斜角度校正方法 Hand-held pointing device and tilt angle correction method thereof

本發明有關於一種指向裝置以及其校正方法,且特別是一種手持式指向裝置及其傾斜角度校正方法。 The present invention relates to a pointing device and a method of correcting the same, and more particularly to a hand-held pointing device and a tilt angle correcting method thereof.

手持式指向裝置因其可藉由分析參考點在感測的影像區域的位置,計算出手持式指向裝置的指向點座標,並將此指向點座標傳送至遊戲主機,進行相關遊戲操作,已被廣泛地應用於各類互動式遙控遊戲,例如光槍遊戲、棒球遊戲以及網球遊戲等。 The handheld pointing device calculates the pointing point coordinate of the handheld pointing device by analyzing the position of the reference point in the sensed image area, and transmits the pointing point coordinate to the game host to perform related game operations, which has been Widely used in a variety of interactive remote control games, such as light gun games, baseball games and tennis games.

習知手持式指向裝置上的影像感測器與顯示螢幕的距離以及影像擷取時其旋轉角度,皆會影響指向點座標的計算。因此,若手持式指向裝置並未裝設偵測傾斜角度的相關設備時,當手持式指向裝置的影像感測器發生傾斜時,手持式指向裝置將因無法準確判斷手持式指向裝置與參考點之間的相對移動關係而發生誤判。 It is known that the distance between the image sensor on the handheld pointing device and the display screen and the angle of rotation when the image is captured may affect the calculation of the pointing point coordinates. Therefore, if the hand-held pointing device is not equipped with a device for detecting the tilt angle, when the image sensor of the hand-held pointing device is tilted, the hand-held pointing device cannot accurately determine the hand-held pointing device and the reference point. Misjudgment occurs between relative movements.

目前產業上主要是使用二個以上的參考點或是在手持式指向裝置上同時加設加速度計與陀螺儀作為判斷裝置上影像感測器之傾斜角度的依據,以解決因傾斜而發生誤定位的問題。然使用二個以上的參考點,除會增加手持式指向裝置在位置計算上的複雜度,手持式指向裝置上影像感測器也必須具備可感測二個以上的參考點位置範圍的視角。而使用加速度計與陀螺儀除了增加手持式指向裝置的製作成本外,亦會增加手持式指向裝置的能量消耗。 At present, the industry mainly uses two or more reference points or simultaneously adds an accelerometer and a gyroscope on the hand-held pointing device as a basis for judging the tilt angle of the image sensor on the device to solve the misalignment caused by the tilt. The problem. However, the use of more than two reference points, in addition to increasing the complexity of the positional calculation of the handheld pointing device, the image sensor on the handheld pointing device must also have a viewing angle that can sense more than two reference point position ranges. The use of accelerometers and gyroscopes, in addition to increasing the manufacturing cost of handheld pointing devices, also increases the energy consumption of handheld pointing devices.

有鑑於此,本發明實施例提供一種手持式指向裝置以及其傾斜角度校正方法,此傾斜角度校正方法可藉由主動校正手持式指向裝置的傾斜角度,提高參考點計算定位的精確性。 In view of this, the embodiment of the present invention provides a hand-held pointing device and a tilt angle correcting method thereof, which can improve the accuracy of the reference point calculation positioning by actively correcting the tilt angle of the hand-held pointing device.

本發明實施例提供一種手持式指向裝置的傾斜角度校正方法,此方法包括下列步驟。首先,於手持式指向裝置指向一參考點時,擷取對應參考點位置的影像,並依序產生多個影像框架。其次,根據該些影像框架判斷參考點是否大幅移動。若判斷參考點並未大幅移動,利用手持式指向裝置的加速度單元感測手持式指向裝置於多個軸向的多個加速度值,以根據該些加速度值計算並更新手持式指向裝置目前使用的第一傾斜角度為第二傾斜角度。 Embodiments of the present invention provide a tilt angle correction method for a hand-held pointing device, the method comprising the following steps. First, when the handheld pointing device points to a reference point, an image corresponding to the position of the reference point is captured, and a plurality of image frames are sequentially generated. Secondly, it is determined according to the image frames whether the reference point moves greatly. If it is determined that the reference point does not move substantially, the acceleration unit of the handheld pointing device senses the plurality of acceleration values of the handheld pointing device in the plurality of axial directions to calculate and update the current use of the handheld pointing device according to the acceleration values. The first tilt angle is a second tilt angle.

本發明實施例另提供一種手持式指向裝置的傾斜角度校正方法,所述方法包括下列步驟。首先,於手持式指向裝置指向一參考點時,擷取對應參考點位置的影像,並依序產生多個影像框架。其次,根據該些影像框架中的任三個連續影像框架,計算參考點在該等連續影像框架的成像位置的加速度變化值。接著,判斷加速度變化值是否等於零。隨後,若加速度變化值等於零,則利用手持式指向裝置的加速度單元感測手持式指向裝置於多軸向的多個加速度值,以根據該些加速度值計算並更新手持式指向裝置目前使用的第一傾斜角度為第二傾斜角度。 The embodiment of the invention further provides a tilt angle correction method for the handheld pointing device, the method comprising the following steps. First, when the handheld pointing device points to a reference point, an image corresponding to the position of the reference point is captured, and a plurality of image frames are sequentially generated. Secondly, based on any three consecutive image frames in the image frames, an acceleration change value of the reference point at the imaging position of the continuous image frames is calculated. Next, it is judged whether or not the acceleration change value is equal to zero. Then, if the acceleration change value is equal to zero, the acceleration unit of the handheld pointing device senses a plurality of acceleration values of the handheld pointing device in multiple axes to calculate and update the current use of the handheld pointing device according to the acceleration values. An angle of inclination is a second angle of inclination.

本發明實施例提供一種手持式指向裝置,此手持式指向裝置包括影像擷取單元、加速度單元以及處理單元。影像擷取單元用以擷取對應一參考點位置的影像,並依序產生多個影像框架。加速度單元用以感測手持式指向裝置於多軸向的多個加速度值,並產生加速度向量。處理單元耦接影像擷取單元以及加速度單元。處理單元並根據該些影像框架判斷參考點是否大幅移動。當處理單元判斷參考點並未大幅移動時,處理單元讀取加速度單元感測手持式指向裝置於多軸產生的該些加速度值,以根據該些加速度 值計算並更新手持式指向裝置目前使用的第一傾斜角度為第二傾斜角度。 Embodiments of the present invention provide a handheld pointing device that includes an image capturing unit, an acceleration unit, and a processing unit. The image capturing unit is configured to capture an image corresponding to a reference point position, and sequentially generate a plurality of image frames. The acceleration unit is configured to sense a plurality of acceleration values of the handheld pointing device in multiple axes and generate an acceleration vector. The processing unit is coupled to the image capturing unit and the acceleration unit. The processing unit determines whether the reference point moves substantially according to the image frames. When the processing unit determines that the reference point has not moved significantly, the processing unit reads the acceleration unit to sense the acceleration values generated by the handheld pointing device on the multi-axis, according to the accelerations. The value calculates and updates the first tilt angle currently used by the handheld pointing device as the second tilt angle.

本發明實施例提供一種手持式指向裝置,此手持式指向裝置包括影像擷取單元、加速度單元以及處理單元。影像擷取單元用以擷取對應一參考點位置的影像,並依序產生多個影像框架。加速度單元用以感測手持式指向裝置於多軸向的多個加速度值,並產生加速度向量。處理單元耦接影像擷取單元以及加速度單元。處理單元並根據該些影像框架中的任三個連續影像框架計算參考點在該等連續影像框架的成像位置的加速度變化值。當處理單元判斷加速度變化值為零時,處理單元判斷讀取加速度單元感測手持式指向裝置於多軸向產生的該些加速度值,以根據該些加速度值計算並更新手持式指向裝置目前使用的第一傾斜角度為第二傾斜角度。 Embodiments of the present invention provide a handheld pointing device that includes an image capturing unit, an acceleration unit, and a processing unit. The image capturing unit is configured to capture an image corresponding to a reference point position, and sequentially generate a plurality of image frames. The acceleration unit is configured to sense a plurality of acceleration values of the handheld pointing device in multiple axes and generate an acceleration vector. The processing unit is coupled to the image capturing unit and the acceleration unit. The processing unit calculates an acceleration change value of the reference point at the imaging position of the continuous image frames according to any three consecutive image frames in the image frames. When the processing unit determines that the acceleration change value is zero, the processing unit determines that the read acceleration unit senses the acceleration values generated by the handheld pointing device in multiple axes to calculate and update the current use of the handheld pointing device according to the acceleration values. The first tilt angle is the second tilt angle.

綜上所述,本發明實施例提供一種手持式指向裝置以及其傾斜角度校正方法,此手持式指向裝置以及其傾斜角度校正方法可透過分析參考點是否位移來決定是否校正手持式指向裝置的傾斜角度。所述手持式指向裝置可主動透過計算與分析參考點於影像框架的速度變化、參考點的加速度變化以及手持式指向裝置的加速度變化,來判斷參考點是否在一瞬間內大幅移動。從而,本發明之手持式指向裝置可在不須加設陀螺儀或是使用兩個參考點即可有效且精確地計算出參考點的位置,進而簡化手持式指向裝置的硬體架構與計算複雜度,降低手持式指向裝置的設計與製作成本。 In summary, the embodiment of the present invention provides a hand-held pointing device and a tilt angle correcting method thereof. The hand-held pointing device and the tilt angle correcting method thereof can determine whether to correct the tilt of the hand-held pointing device by analyzing whether the reference point is displaced. angle. The hand-held pointing device can actively determine whether the reference point moves substantially in an instant by calculating and analyzing the speed change of the reference frame in the image frame, the acceleration change of the reference point, and the acceleration change of the hand-held pointing device. Therefore, the hand-held pointing device of the present invention can effectively and accurately calculate the position of the reference point without adding a gyroscope or using two reference points, thereby simplifying the hardware structure and computational complexity of the hand-held pointing device. Reduce the design and manufacturing cost of the handheld pointing device.

為使能更進一步瞭解本發明之特徵及技術內容,請參閱以下有關本發明之詳細說明與附圖,但是此等說明與所附圖式僅是用來說明本發明,而非對本發明的權利範圍作任何的限制。 The detailed description of the present invention and the accompanying drawings are to be understood by the claims The scope is subject to any restrictions.

10‧‧‧手持式指向裝置 10‧‧‧Handheld pointing device

11‧‧‧影像擷取單元 11‧‧‧Image capture unit

13‧‧‧加速度單元 13‧‧‧Acceleration unit

15‧‧‧處理單元 15‧‧‧Processing unit

17‧‧‧傳輸單元 17‧‧‧Transmission unit

20‧‧‧主機 20‧‧‧Host

21‧‧‧參考點 21‧‧‧ Reference point

30‧‧‧影像顯示裝置 30‧‧‧Image display device

31‧‧‧游標 31‧‧‧ cursor

61、61’、61”‧‧‧參考點影像 61, 61', 61" ‧ ‧ reference point image

S301~S309‧‧‧步驟流程 S301~S309‧‧‧Step procedure

S401~S407‧‧‧步驟流程 S401~S407‧‧‧Step procedure

S501~S511‧‧‧步驟流程 S501~S511‧‧‧Step procedure

S701~S707‧‧‧步驟流程 S701~S707‧‧‧Step procedure

S801~S823‧‧‧步驟流程 S801~S823‧‧‧Step process

S901~S911‧‧‧步驟流程 S901~S911‧‧‧Step procedure

‧‧‧參考點影像的位置向量 , , ‧‧‧Location vector of reference point image

(x1,y1)、(x2,y2)、(x3,y3)‧‧‧參考點影像的座標 (x1, y1), (x2, y2), (x3, y3) ‧ ‧ coordinates of the reference point image

f1、f2、f3‧‧‧影像框架 F1, f2, f3‧‧‧ image frame

X、Y、Z‧‧‧影像框架的擷取時間 X, Y, Z‧‧‧ image frame acquisition time

圖1是本發明一實施例提供的手持式指向裝置應用於互動系 統的示意圖。 FIG. 1 is a diagram of a handheld pointing device applied to an interaction system according to an embodiment of the present invention. Schematic diagram of the system.

圖2是本發明一實施例提供的手持式指向裝置的功能方塊示意圖。 2 is a functional block diagram of a handheld pointing device according to an embodiment of the invention.

圖3是本發明一實施例提供的手持式指向裝置的傾斜角度校正方法的流程示意圖。 FIG. 3 is a schematic flow chart of a method for correcting a tilt angle of a hand-held pointing device according to an embodiment of the invention.

圖4是本發明一實施例提供的手持式指向裝置的參考點位移判斷方法的流程示意圖。 4 is a schematic flow chart of a method for judging a reference point displacement of a hand-held pointing device according to an embodiment of the present invention.

圖5是本發明另一實施例提供的手持式指向裝置的參考點位移判斷方法的流程示意圖。 FIG. 5 is a schematic flow chart of a method for judging a reference point displacement of a hand-held pointing device according to another embodiment of the present invention.

圖6A~圖6C分別是本發明一實施例提供的手持式指向裝置移動時感測的影像框架的示意圖。 6A-6C are schematic diagrams of image frames sensed when the handheld pointing device is moved according to an embodiment of the invention.

圖7是本發明又一實施例提供的手持式指向裝置的參考點位移判斷方法的流程示意圖。 FIG. 7 is a schematic flow chart of a method for judging a reference point displacement of a hand-held pointing device according to another embodiment of the present invention.

圖8是本發明另一實施例提供的手持式指向裝置的傾斜角度校正方法的流程示意圖。 FIG. 8 is a schematic flow chart of a method for correcting a tilt angle of a hand-held pointing device according to another embodiment of the present invention.

圖9是本發明又一實施例提供的手持式指向裝置的傾斜角度校正方法的流程示意圖。 FIG. 9 is a schematic flow chart of a method for correcting a tilt angle of a hand-held pointing device according to still another embodiment of the present invention.

在下文中,將藉由圖式說明本發明之各種例示實施例來詳細描述本發明。然而,本發明概念可能以許多不同形式來體現,且不應解釋為限於本文中所闡述之例示性實施例。此外,在圖式中相同參考數字可用以表示類似的元件。 In the following, the invention will be described in detail by way of illustration of various exemplary embodiments of the invention. However, the inventive concept may be embodied in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. In addition, the same reference numerals may be used in the drawings to represent similar elements.

〔手持式指向裝置的實施例〕 [Embodiment of Handheld Pointing Device]

所述手持式指向裝置可應用於影像顯示裝置(未繪示)的指向點定位。請參照圖1,圖1繪示本發明實施例提供的手持式指向裝置應用於互動系統的示意圖。所述互動系統包括手持式指向裝置10、主機20以及影像顯示裝置30。所述主機20用以讀取與執行軟體程式,例如遊戲軟體,並可將軟體程式的執行狀態顯示於影 像顯示裝置30,以供使用者瀏覽操控。所述主機20另提供參考點21,以供手持式指向裝置10擷取影像,以作為操控影像顯示裝置30顯示游標31的依據。 The hand-held pointing device can be applied to a pointing point positioning of an image display device (not shown). Please refer to FIG. 1 . FIG. 1 is a schematic diagram of a handheld pointing device according to an embodiment of the present invention applied to an interactive system. The interactive system includes a handheld pointing device 10, a host 20, and an image display device 30. The host 20 is configured to read and execute a software program, such as a game software, and display the execution status of the software program. Like the display device 30, for the user to browse and control. The host 20 further provides a reference point 21 for the handheld pointing device 10 to capture an image as a basis for controlling the image display device 30 to display the cursor 31.

值得注意的是,於本實施例中,所述主機20可例如為遊戲主機或電腦主機。所述影像顯示裝置30可例如為,但不限於投影顯示裝置、遊戲機顯示螢幕、電視螢幕以及電腦顯示螢幕。上述遊戲軟體可以是以程式碼儲存於光碟片、隨身碟或其他等效的記憶裝置。參考點21可以是由多個具特定波長的發光二極體,例如紅外線發光二極體(IR LED)、雷射二極體或紫外光發光二極體排列成各種形狀的參考點來實現。此外,該些發光二極體可以是電性連接主機20獲取發光所需電源,亦或是由獨立的電源自行供應發光所需電源。本實施例僅使用一參考點,但本發明領域具通常知識者亦可視設計需求自行設置參考點21的數量,例如為1個、2個或者是複數個。也就是說,圖1僅供用以說明手持式指向裝置10的運作,並非用以限定本發明。 It should be noted that, in this embodiment, the host 20 can be, for example, a game console or a computer host. The image display device 30 can be, for example, but not limited to, a projection display device, a game console display screen, a television screen, and a computer display screen. The above game software can be stored in a CD, a flash drive or other equivalent memory device. The reference point 21 can be realized by a plurality of light-emitting diodes having a specific wavelength, such as an infrared light-emitting diode (IR LED), a laser diode or an ultraviolet light-emitting diode, arranged in reference points of various shapes. In addition, the light-emitting diodes may be electrically connected to the host 20 for obtaining power required for illumination, or may be supplied by an independent power source to supply power for illumination. In this embodiment, only one reference point is used, but the number of reference points 21 can be set by the general knowledge in the field of the invention, for example, one, two or plural. That is, FIG. 1 is only for explaining the operation of the handheld pointing device 10, and is not intended to limit the present invention.

簡單來說,手持式指向裝置10會透過擷取參考點21的影像,判斷是否更新手持式指向裝置10目前計算使用的傾斜角度,亦即手持式指向裝置10的旋轉角度。手持式指向裝置10並根據參考點21的位置資訊以及手持式指向裝置10目前使用的旋轉角度精確地計算手持式指向裝置10與參考點21之間的相對移動資訊。手持式指向裝置10會將計算出手持式指向裝置10與參考點21之間的相對移動資訊,透過無線傳送方式傳送至主機20,以配合操控游標31進行軟體程式。據此,手持式指向裝置10可選擇性地更新或維持手持式指向裝置10目前計算參考點21位置的使用旋轉角度,以準確地計算手持式指向裝置10與參考點21之間的相對移動資訊。 Briefly, the hand-held pointing device 10 determines whether to update the tilt angle currently used by the hand-held pointing device 10, that is, the angle of rotation of the hand-held pointing device 10, by capturing the image of the reference point 21. The hand-held pointing device 10 accurately calculates the relative movement information between the hand-held pointing device 10 and the reference point 21 based on the positional information of the reference point 21 and the rotational angle currently used by the hand-held pointing device 10. The handheld pointing device 10 will calculate the relative movement information between the handheld pointing device 10 and the reference point 21 and transmit it to the host computer 20 via the wireless transmission mode to cooperate with the manipulation cursor 31 to perform the software program. Accordingly, the handheld pointing device 10 can selectively update or maintain the rotational angle of use of the handheld pointing device 10 to calculate the position of the reference point 21 to accurately calculate the relative movement information between the handheld pointing device 10 and the reference point 21. .

更進一步地說,手持式指向裝置10會於指向參考點21的位置時,擷取參考點21的影像並依序產生多個具參考點21影像的 影像框架。接著,手持式指向裝置10會根據該些影像框架判斷參考點21在該些影像框架的成像位置是否大幅移動,以決定是否更新手持式指向裝置10目前計算使用的傾斜角度。換言之,手持式指向裝置10會根據參考點21在該些影像框架的成像位置是否大幅移動來判斷手持式指向裝置10目前是處於靜止或移動狀態,並決定是否更新手持式指向裝置10目前計算使用的傾斜角度。 Furthermore, the hand-held pointing device 10 captures the image of the reference point 21 and sequentially generates a plurality of images with reference points 21 when pointing to the position of the reference point 21. Image frame. Then, the handheld pointing device 10 determines whether the reference point 21 is greatly moved at the imaging positions of the image frames according to the image frames to determine whether to update the tilt angle currently used by the handheld pointing device 10. In other words, the handheld pointing device 10 determines whether the handheld pointing device 10 is currently in a stationary or moving state according to whether the imaging position of the image frames is greatly moved according to the reference point 21, and determines whether to update the current pointing device 10 for current calculation. The angle of inclination.

所述大幅移動於本實施例是指參考點21瞬間(即短時間內,如幾秒、幾毫秒、相鄰兩張或多張影像框架內)的移動變化。也就是,參考點21在該些影像框架的成像位置的位移量(即位移變化值)、移動速度或加速度。具體地說,當參考點21在該些影像框架的成像位置的位移量大於預設的位移閥值、成像位置的移動速度大於預設速度變化閥值及/或成像位置的加速度大於預設加速度閥值時,即可判定參考點21在該些影像框架的成像位置大幅移動,而不更新手持式指向裝置10目前計算使用的傾斜角度。 The large movement in this embodiment refers to the movement change of the reference point 21 instantaneously (i.e., in a short time, such as several seconds, several milliseconds, or two or more adjacent image frames). That is, the amount of displacement (i.e., displacement change value), moving speed, or acceleration of the reference point 21 at the imaging position of the image frames. Specifically, when the displacement of the reference point 21 at the imaging position of the image frames is greater than a preset displacement threshold, the moving speed of the imaging position is greater than the preset speed change threshold and/or the acceleration of the imaging position is greater than the preset acceleration. At the threshold, it is determined that the reference point 21 is greatly moved at the imaging positions of the image frames without updating the tilt angle currently used by the hand-held pointing device 10.

接著,若判斷出參考點21在該些影像框架的成像位置並未大幅移動時(亦即參考點21在該些影像框架的成像位置之間的位移量小於預設的位移閥值、成像位置的移動速度小於預設速度變化閥值及/或成像位置的加速度小於預設加速度閥值),則根據該些影像框架判斷手持式指向裝置10與參考點21之間相對移動位置,以配合主機20所執行的軟體程式對應地控制游標31在影像顯示裝置30的動作。 Then, if it is determined that the reference point 21 does not move substantially at the imaging position of the image frames (that is, the displacement of the reference point 21 between the imaging positions of the image frames is less than a preset displacement threshold, an imaging position) The moving speed is less than the preset speed change threshold and/or the acceleration of the imaging position is less than the preset acceleration threshold, and the relative moving position between the handheld pointing device 10 and the reference point 21 is determined according to the image frames to match the host. The software program executed by 20 controls the operation of the cursor 31 in the video display device 30 correspondingly.

於一實施方式中,手持式指向裝置10可以是使用一慣性感測器來計算手持式指向裝置10的傾斜角度。然而,當使用者移動手持式指向裝置10時,使用者對手持式指向裝置10的施力會影響慣性感測器判斷重力方向的結果。因此,必須在排除使用者施力的影響之後,才可精確地計算並更新手持式指向裝置10的傾斜角度。 In one embodiment, the handheld pointing device 10 can use an inertial sensor to calculate the tilt angle of the handheld pointing device 10. However, when the user moves the hand-held pointing device 10, the user's application of the hand-held pointing device 10 affects the result of the inertial sensor determining the direction of gravity. Therefore, the tilt angle of the hand-held pointing device 10 must be accurately calculated and updated after the influence of the user's force is excluded.

而當手持式指向裝置10未被使用者大幅移動(即偵測到參考 點21並未大幅移動)時,通常可被視為未受外力影響。由於手持式指向裝置10是利用影像感測器(image sensor)感測手持式指向裝置10的指向位置,因此當手持式指向裝置10被大幅移動(即偵測到參考點21大幅移動)時,影像感測器亦會同步地改變參考點21在影像框架中的成像位置。從而,手持式指向裝置10可根據參考點21在影像感測器感應產生的影像框架中的成像位置判斷手持式指向裝置10是否被大幅移動。 And when the handheld pointing device 10 is not moved by the user (ie, the reference is detected) When point 21 does not move significantly, it can usually be considered as not being affected by external forces. Since the hand-held pointing device 10 senses the pointing position of the hand-held pointing device 10 by using an image sensor, when the hand-held pointing device 10 is largely moved (ie, the reference point 21 is detected to move largely), The image sensor also synchronously changes the imaging position of the reference point 21 in the image frame. Therefore, the handheld pointing device 10 can determine whether the handheld pointing device 10 is largely moved according to the imaging position of the reference point 21 in the image frame sensed by the image sensor.

更詳細地說,請參照圖2並同時參照圖1,圖2繪示本發明實施例提供的手持式指向裝置的功能方塊示意圖。手持式指向裝置10包括影像擷取單元11、加速度單元13、處理單元15以及傳輸單元17。影像擷取單元11、加速度單元13以及傳輸單元17分別耦接處理單元15。 In more detail, please refer to FIG. 2 and refer to FIG. 1 at the same time. FIG. 2 is a functional block diagram of a handheld pointing device according to an embodiment of the present invention. The handheld pointing device 10 includes an image capturing unit 11, an acceleration unit 13, a processing unit 15, and a transmission unit 17. The image capturing unit 11 , the acceleration unit 13 , and the transmission unit 17 are respectively coupled to the processing unit 15 .

影像擷取單元11用以擷取對應參考點21位置的影像,並依序產生多個影像框架(frame)。具體地說,影像擷取單元11可透過一濾光單元(未繪示),濾除特定光波之外的光線,使影像擷取單元11僅感測由參考點21發出的具特定光波的光線。影像擷取單元11並根據預設的影像擷取頻率(例如每秒200張影像框架)感測參考點21產生的光線,依序產生具該參考點21影像的多個影像框架。 The image capturing unit 11 is configured to capture an image corresponding to the position of the reference point 21, and sequentially generate a plurality of image frames. Specifically, the image capturing unit 11 can filter the light outside the specific light wave through a filter unit (not shown), so that the image capturing unit 11 senses only the light with a specific light wave emitted by the reference point 21. . The image capturing unit 11 senses the light generated by the reference point 21 according to a preset image capturing frequency (for example, 200 image frames per second), and sequentially generates a plurality of image frames having the reference point 21 image.

於本實施例中,影像擷取單元11可以是由電荷偶和元件(charge-coupled device,CCD)影像感測器或互補式金屬氧化物半導體(complementary metal oxide semiconductor,CMOS)影像感測器來實現,於所屬技術領域具有通常知識者可以依據實際使用情況來設計,本實施例在此不加以限制。 In this embodiment, the image capturing unit 11 may be a charge-coupled device (CCD) image sensor or a complementary metal oxide semiconductor (CMOS) image sensor. Implementations, those having ordinary knowledge in the technical field can be designed according to actual use, and the embodiment is not limited herein.

加速度單元13用以感測手持式指向裝置10於多軸向(例如X軸向、Y軸向以及Z軸向等)的多個加速度值,並產生加速度向量(acceleration vector)。本實施例的加速度單元13可例如為重力感測器(G-sensor)、加速度計(又稱為加速度規)(accelerometer),且是 內建於手持式指向裝置10。本發明技術領域具有通常知識者可以依據實際使用情況來設計,本實施例並不以此為限。 The acceleration unit 13 is configured to sense a plurality of acceleration values of the hand-held pointing device 10 in multiple axial directions (eg, X-axis, Y-axis, and Z-axis, etc.), and generate an acceleration vector. The acceleration unit 13 of the present embodiment may be, for example, a gravity sensor (G-sensor), an accelerometer (also called an accelerometer), and is Built into the handheld pointing device 10. The technical field of the present invention can be designed according to the actual use situation, and the embodiment is not limited thereto.

處理單元15可根據該些影像框架判斷參考點21是否大幅移動。當處理單元15判定參考點21並未大幅移動時,讀取加速度單元13感測手持式指向裝置10於多軸產生的該些加速度值,以根據該些加速度值計算並更新手持式指向裝置10目前使用的第一傾斜角度為第二傾斜角度。處理單元15並會利用第二傾斜角度計算參考點21在該些影像框架之一的成像位置,亦即參考點21的移動向量。 The processing unit 15 can determine whether the reference point 21 is greatly moved according to the image frames. When the processing unit 15 determines that the reference point 21 has not moved significantly, the reading acceleration unit 13 senses the acceleration values generated by the handheld pointing device 10 on multiple axes to calculate and update the handheld pointing device 10 according to the acceleration values. The first tilt angle currently used is the second tilt angle. The processing unit 15 uses the second tilt angle to calculate the imaging position of the reference point 21 in one of the image frames, that is, the motion vector of the reference point 21.

於一實施方式中,處理單元15可根據加速度單元13感測手持式指向裝置10於X軸向、Y軸向以及Z軸向的多個加速度值,並透過計算任兩軸向之間的夾角,計算出手持式指向裝置10目前的傾斜角度。處理單元15並根據第二傾斜角度與該些影像框架計算參考點21於該些影像框架之一的成像位置。 In an embodiment, the processing unit 15 can sense a plurality of acceleration values of the handheld pointing device 10 in the X axis, the Y axis, and the Z axis according to the acceleration unit 13 and calculate the angle between any two axes. The current tilt angle of the hand-held pointing device 10 is calculated. The processing unit 15 calculates the imaging position of the reference point 21 in one of the image frames according to the second tilt angle and the image frames.

當處理單元15判斷參考點21位移時,處理單元15即會因判斷加速度單元15無法準確量測手持式指向裝置10而決定不更新手持式指向裝置10目前使用的第一傾斜角度。換言之,處理單元15會繼續利用第一傾斜角度計算參考點21在該些影像框架之一的成像位置。處理單元15並將參考點21的移動向量資訊利用傳輸單元17以無線傳輸方式傳送至主機20,以配合主機20所形的軟體程式,相對控制游標31在影像顯示裝置30的動作。 When the processing unit 15 determines that the reference point 21 is displaced, the processing unit 15 may decide not to update the first tilt angle currently used by the hand-held pointing device 10 by determining that the acceleration unit 15 cannot accurately measure the hand-held pointing device 10. In other words, the processing unit 15 will continue to calculate the imaging position of the reference point 21 at one of the image frames using the first tilt angle. The processing unit 15 transmits the motion vector information of the reference point 21 to the host 20 by using the transmission unit 17 in a wireless transmission manner to cooperate with the software program of the host 20 to control the motion of the cursor 31 on the image display device 30.

以下針對處理單元15計算手持式指向裝置10的傾斜角度,如第一傾斜角度與第二傾斜角度的方式做進一步地說明。 The tilt angle of the hand-held pointing device 10, such as the first tilt angle and the second tilt angle, is further described below for the processing unit 15.

舉例來說,影像擷取單元11所產生對應參考點21位置的多個影像框架可為一矩形形狀,且影像框架的長邊是平行於X軸向,而影像框架的短邊是平行於Y軸向。當處理單元15判斷參考點21並未位移時,處理單元15可驅動加速度單元13分別感測手持式指向裝置10於圖1表示的三維空間(3D)中X軸向、Y軸向以 及Z軸向的加速度值VxVy以及Vz。加速度單元13並可根據感測結果對應產生加速度向量,以產生一加速度感測信號,其中加速度感測信號可代表任兩個加速度值的比,例如加速度值Vx以及加速度值Vy的比。處理單元15會在接收到加速度感測信號計算出手持式指向裝置10目前的傾斜角度。 For example, the image frames corresponding to the position of the reference point 21 generated by the image capturing unit 11 may have a rectangular shape, and the long sides of the image frame are parallel to the X axis, and the short sides of the image frame are parallel to Y. Axial. When the processing unit 15 determines that the reference point 21 is not displaced, the processing unit 15 can drive the acceleration unit 13 to respectively sense the X-axis, the Y-axis, and the Z-axis of the handheld pointing device 10 in the three-dimensional space (3D) shown in FIG. Acceleration values Vx , Vy, and Vz . The acceleration unit 13 can generate an acceleration vector according to the sensing result To generate an acceleration sensing signal, wherein the acceleration sensing signal can represent a ratio of any two acceleration values, such as a ratio of the acceleration value Vx and the acceleration value Vy . The processing unit 15 calculates the current tilt angle of the hand-held pointing device 10 upon receiving the acceleration sensing signal.

更詳細地說,處理單元15可利用下列公式(1)至(3)計算手持式指向裝置10的加速度向量與各軸向之間的夾角,以獲取手持式指向裝置10的目前的傾斜角度, In more detail, the processing unit 15 can calculate the acceleration vector of the hand-held pointing device 10 using the following formulas (1) to (3). An angle between each axial direction to obtain the current tilt angle of the hand-held pointing device 10,

其中,Vx表示加速度單元13於X軸向感測到的加速度值;Vy表示加速度單元13於Y軸向感測到的加速度值;|gxy|表示根據加速度值Vx以及加速度值Vy計算出的重力重力加速度值。 Wherein, Vx represents the acceleration value sensed by the acceleration unit 13 in the X-axis; Vy represents the acceleration value sensed by the acceleration unit 13 in the Y-axis; | gxy | represents the gravity calculated from the acceleration value Vx and the acceleration value Vy Gravity acceleration value.

處理單元15隨後利用公式(1)與公式(2)的計算結果校正影像框架以計算出參考點21在該些影像框架之一的成像位置。處理單元15可例如是透過公式(4)來校正影像框架, The processing unit 15 then corrects the image frame using the calculation results of equations (1) and (2) to calculate the imaging position of the reference point 21 in one of the image frames. The processing unit 15 can, for example, correct the image frame through the formula (4).

其中,x表示參考點21在該些影像框架之一的成像位置的X軸座標;y表示參考點21在該些影像框架之一的成像位置的Y軸座標;x'表示修正後參考點21在該些影像框架之一的成像位置的X軸座標;y'表示修正後參考點21在該些影像框架之一的成像位置的Y軸座標。處理單元15進而可根據x'以及y'計算出手持式指 向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊。 Where x represents the X-axis coordinate of the imaging point of the reference point 21 at one of the image frames; y represents the Y-axis coordinate of the reference point 21 at the imaging position of one of the image frames; x ' represents the corrected reference point 21 The X-axis coordinate of the imaging position of one of the image frames; y ' indicates the Y-axis coordinate of the corrected reference point 21 at the imaging position of one of the image frames. The processing unit 15 can in turn calculate the pointing coordinates or relative motion vector information of the handheld pointing device 10 relative to the reference point 21 or the image display device 30 based on x 'and y '.

接著,處理單元15可將計算出手持式指向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊利用傳輸單元17傳送至主機20,以控制游標31在影像顯示裝置30的動作。 Then, the processing unit 15 can calculate that the pointing coordinate or the relative motion vector information of the handheld pointing device 10 relative to the reference point 21 or the image display device 30 is transmitted to the host 20 by using the transmission unit 17 to control the cursor 31 on the image display device 30. Actions.

值得一提的是,本發明技術領域具有通常知識者應知本發明之手持式指向裝置10所採用的加速度單元13亦可僅用以感測二個維度的加速度值,例如僅用以感測加速度值VxVx。換言之,上述手持式指向裝置10的加速度感測方式僅為一實施方式,本發明並不以此為限。 It should be noted that the acceleration unit 13 used in the hand-held pointing device 10 of the present invention may also be used only to sense acceleration values of two dimensions, for example, only for sensing. Acceleration values Vx and Vx . In other words, the acceleration sensing method of the hand-held pointing device 10 is only an embodiment, and the invention is not limited thereto.

另外,處理單元15於本實施例中可以是以微控制器(microcontroller)或嵌入式控制器(embedded controller)等處理晶片利用程式碼編譯方式來實現,但本實施例並不限制。而傳輸單元17可以是利用藍芽傳輸方式將移動向量資訊傳送至主機20,但本實施例並不此為限。 In addition, in this embodiment, the processing unit 15 may be implemented by using a code controller such as a microcontroller or an embedded controller, but the embodiment is not limited. The transmission unit 17 may transmit the mobile vector information to the host 20 by using a Bluetooth transmission method, but the embodiment is not limited thereto.

要說明的是,影像擷取單元11、加速度單元13、處理單元15以及傳輸單元17的種類、實體架構及/或實施方式是依據手持式指向裝置10的種類、實體架構即/或實施方式來設置,本發明並不限定。 It should be noted that the types, physical architectures, and/or implementations of the image capturing unit 11, the acceleration unit 13, the processing unit 15, and the transmission unit 17 are based on the type, physical architecture, and/or implementation of the handheld pointing device 10. The setting is not limited to the present invention.

本實施例另提供用於手持式指向裝置10的傾斜角度校正方法,以對手持式指向裝置10的運作做進一步地說明。請參照圖3並同時參照圖1與圖2,圖3繪示本發明實施例提供的手持式指向裝置10的傾斜角度校正方法的流程示意圖。 This embodiment further provides a tilt angle correction method for the hand-held pointing device 10 to further illustrate the operation of the hand-held pointing device 10. Referring to FIG. 3 and FIG. 2 simultaneously, FIG. 3 is a schematic flow chart of a method for correcting the tilt angle of the handheld pointing device 10 according to an embodiment of the present invention.

首先,於步驟S301中,手持式指向裝置10的影像擷取單元11於手持式指向裝置10指向參考點21時,根據預設的影像擷取頻率(例如每秒200張影像框架)擷取對應參考點21位置的影像,並依序產生多個影像框架。 First, in step S301, the image capturing unit 11 of the handheld pointing device 10 captures the corresponding image capturing frequency (for example, 200 image frames per second) when the handheld pointing device 10 points to the reference point 21 The image at the position of the reference point 21 is used to sequentially generate a plurality of image frames.

其次,於步驟S303中,手持式指向裝置10的處理單元15根據該些影像框架判斷參考點21是否大幅移動。舉例來說,處理單元15可以透過分析參考點21在多個連續影像框架內成像位置的移動變化(例如參考點21的移動量、移動速度及/或加速度等),來判斷參考點21是否大幅移動。 Next, in step S303, the processing unit 15 of the hand-held pointing device 10 determines whether the reference point 21 is greatly moved according to the image frames. For example, the processing unit 15 can determine whether the reference point 21 is substantially large by analyzing the movement change of the imaging position in the plurality of consecutive image frames (for example, the amount of movement of the reference point 21, the moving speed, and/or the acceleration, etc.) of the reference point 21. mobile.

若手持式指向裝置10的處理單元15判斷參考點21並未大幅移動(亦即手持式指向裝置10目前處於靜止狀態)時,執行步驟S305。反之,若手持式指向裝置10的處理單元15判斷參考點21大幅移動(亦即手持式指向裝置10目前處於移動狀態)時,則執行步驟S309。 If the processing unit 15 of the hand-held pointing device 10 determines that the reference point 21 has not moved significantly (i.e., the hand-held pointing device 10 is currently in a stationary state), step S305 is performed. On the other hand, if the processing unit 15 of the hand-held pointing device 10 determines that the reference point 21 has moved largely (that is, the hand-held pointing device 10 is currently in a moving state), step S309 is performed.

接著,於步驟S305中,處理單元15利用手持式指向裝置10的加速度單元13感測手持式指向裝置10於多個軸向(例如X軸向、Y軸向以及Z軸向)的多個加速度值。隨後,於步驟S307中,處理單元15根據該些加速度值,更新手持式指向裝置10目前使用的第一傾斜角度為第二傾斜角度。所述第二傾斜角度為處理單元15利用上述公式(1)至(3)根據該些加速度值所計算出手持式指向裝置10目前的傾斜角度。 Next, in step S305, the processing unit 15 senses the plurality of accelerations of the hand-held pointing device 10 in a plurality of axial directions (for example, the X-axis, the Y-axis, and the Z-axis) by using the acceleration unit 13 of the hand-held pointing device 10. value. Then, in step S307, the processing unit 15 updates the first tilt angle currently used by the handheld pointing device 10 to the second tilt angle according to the acceleration values. The second tilt angle is calculated by the processing unit 15 using the above formulas (1) to (3) based on the acceleration values to calculate the current tilt angle of the hand-held pointing device 10.

於步驟S309中,因處理單元15判斷出參考點21位移,表示手持式指向裝置10目前處於移動狀態,故處理單元15不更新手持式指向裝置10的第一傾斜角度。處理單元15並且利用第一傾斜角度與該些影像框架,計算參考點21於該些影像框架之一的成像位置。 In step S309, since the processing unit 15 determines that the reference point 21 is displaced, indicating that the hand-held pointing device 10 is currently in the moving state, the processing unit 15 does not update the first tilting angle of the hand-held pointing device 10. The processing unit 15 calculates the imaging position of the reference point 21 in one of the image frames by using the first tilt angle and the image frames.

接著,處理單元15可將所計算參考點21於該些影像框架之一的位置向量透過傳輸單元17傳送給主機20,以相對應地控制影像顯示裝置30上游標31的動作。 Then, the processing unit 15 can transmit the position vector of the calculated reference point 21 to one of the image frames to the host 20 through the transmission unit 17, so as to correspondingly control the action of the upstream target 31 of the image display device 30.

此外,處理單元15並於執行步驟S307或步驟S309之後,重新執行步驟S301,擷取對應參考點21位置影像並判斷參考點21是否大幅移動,以決定是否更新手持式指向裝置10的第一傾斜角 度。 In addition, after performing step S307 or step S309, the processing unit 15 re-executes step S301, capturing the position image corresponding to the reference point 21 and determining whether the reference point 21 is greatly moved to determine whether to update the first tilt of the handheld pointing device 10. angle degree.

如前述,處理單元15可根據參考點21於該些影像框架中的連續移動變化,判斷參考點21是否大幅移動。以下針對處理單元15判斷參考點21是否位移的具體實施方式做進一步說明。 As described above, the processing unit 15 can determine whether the reference point 21 is greatly moved according to the continuous movement change of the reference point 21 in the image frames. The following is a further description of a specific embodiment in which the processing unit 15 determines whether the reference point 21 is displaced.

於一具體實施方式為根據參考點21的速度變化來判斷參考點是否位移。請參考圖4並同時參照圖1、圖2、圖6A以及圖6B,圖4繪示本發明一實施例提供的手持式指向裝置位移判斷方法的流程示意圖。圖4所示的步驟可以是執行於圖3的步驟S303中。 In a specific embodiment, it is determined whether the reference point is displaced according to the speed change of the reference point 21. Referring to FIG. 4 and FIG. 2, FIG. 2 is a schematic flowchart of a method for judging displacement of a hand-held pointing device according to an embodiment of the present invention. The step shown in FIG. 4 may be performed in step S303 of FIG.

於步驟S401中,處理單元15根據影像擷取單元11所產生對應參考點21在該些影像框架中的第一影像框架f1與第二影像框架f2的成像位置,計算參考點21的速度變化值。所述第一影像框架f1與第二影像框架f2為影像擷取單元11依序產生的兩個連續影像框架。也就是,第二影像框架f2的擷取時間是晚於第一影像框架f1的擷取時間。所述參考點21在第一影像框架f1的成像位置是以參考點影像61來表示,而參考點21在第二影像框架f2中的成像位置則是由參考點影像61’來表示。 In step S401, the processing unit 15 calculates the speed change value of the reference point 21 according to the imaging positions of the first image frame f1 and the second image frame f2 in the image frames corresponding to the reference point 21 generated by the image capturing unit 11. . The first image frame f1 and the second image frame f2 are two consecutive image frames sequentially generated by the image capturing unit 11. That is, the capture time of the second image frame f2 is later than the capture time of the first image frame f1. The imaging position of the reference point 21 in the first image frame f1 is represented by the reference point image 61, and the imaging position of the reference point 21 in the second image frame f2 is represented by the reference point image 61'.

更具體地說,處理單元15可透過公式(5)來計算參考點21的速度變化值: More specifically, the processing unit 15 can calculate the speed change value of the reference point 21 through the formula (5):

其中v表示速度變化值;表示參考點21於第一影像框架f1的成像位置向量,且為(x1,y1);表示參考點21於第二影像框架f2的成像位置向量,且為(x2,y2);t f1表示第一影像框架f1的擷取時間;t f2表示第二影像框架f2的擷取時間。具體地說,如圖6A與圖6B所示,所述對應參考點21於第一影像框架f1中成像位置的參考點影像61的位置(即),或對應參考點21於第二影像框架f2中成像位置的參考點影像61’的位置(即)是處理單元15根據影像擷取單元11中的感測陣列的中心(即第一影像框架 f1、第二影像框架f2的中心點”X”)來計算。 Where v represents the speed change value; An imaging position vector indicating the reference point 21 in the first image frame f1, and Is (x1, y1); An imaging position vector representing the reference point 21 in the second image frame f2, and (x2, y2); t f 1 represents the extraction time of the first image frame f1; t f 2 represents the extraction time of the second image frame f2. Specifically, as shown in FIG. 6A and FIG. 6B, the position of the reference point image 61 of the imaging position of the corresponding reference point 21 in the first image frame f1 (ie, ), or the position of the reference point image 61 ′ corresponding to the imaging position of the reference point 21 in the second image frame f 2 (ie, The processing unit 15 calculates based on the center of the sensing array in the image capturing unit 11 (i.e., the center point of the first image frame f1 and the second image frame f2).

接著,於步驟S403中,處理單元15根據計算的速度變化值v,判斷速度變化值v是否大於預設速度變化閥值(例如1個像素/單位時間)。所述單位時間可以是依據影像擷取單元的影像擷取頻率(例如根據影像擷取頻率計算每兩張連續影像框架的時間間隔)或是連續影像框架的數量(例如每兩張連續影像框架)來定義。 Next, in step S403, the processing unit 15 determines whether the speed change value v is greater than a preset speed change threshold (for example, 1 pixel/unit time) based on the calculated speed change value v . The unit time may be an image capturing frequency according to the image capturing unit (for example, calculating a time interval of each two consecutive image frames according to an image capturing frequency) or a number of continuous image frames (for example, every two consecutive image frames) To define.

當處理單元15判斷速度變化值v小於預設速度變化閥值,執行步驟S405。反之,當處理單元15判斷速度變化值v大於預設速度變化閥值,則執行步驟S407。其中所述預設速度變化閥值可依據實際應用需求以韌體方式預先設計於處理單元15。 When the processing unit 15 determines that the speed change value v is smaller than the preset speed change threshold, step S405 is performed. On the other hand, when the processing unit 15 determines that the speed change value v is greater than the preset speed change threshold, step S407 is performed. The preset speed change threshold may be pre-designed in the processing unit 15 in a firmware manner according to actual application requirements.

於步驟S405中,處理單元15判定參考點21於第一影像框架f1與第二影像框架f2中並未大幅移動。而於步驟S407中,處理單元15判定參考點21於第一影像框架f1與第二影像框架f2中發生大幅移動,處理單元15不更新手持式指向裝置10目前使用的第一傾斜角度。 In step S405, the processing unit 15 determines that the reference point 21 has not moved significantly in the first image frame f1 and the second image frame f2. In step S407, the processing unit 15 determines that the reference point 21 has moved substantially in the first image frame f1 and the second image frame f2, and the processing unit 15 does not update the first tilt angle currently used by the hand-held pointing device 10.

舉例來說,當處理單元15根據兩張連續影像框架(即第一影像框架f1、第二影像框架f2)所計算的速度變化值v大於1個像素時,處理單元15即可判定參考點21於第一影像框架f1與第二影像框架f2中發生大幅移動;當處理單元15所計算的速度變化值v小於1個像素時,處理單元15即可判定參考點21於第一影像框架f1與第二影像框架f2中並未大幅移動。 For example, when the speed change value v calculated by the processing unit 15 according to two consecutive image frames (ie, the first image frame f1 and the second image frame f2) is greater than one pixel, the processing unit 15 can determine the reference point 21 A large movement occurs in the first image frame f1 and the second image frame f2; when the speed change value v calculated by the processing unit 15 is less than 1 pixel, the processing unit 15 can determine the reference point 21 in the first image frame f1 and The second image frame f2 does not move significantly.

於另一具體實施方式為根據參考點21的位移變化來判斷參考點是否大幅移動。請複參照圖1、圖2、圖6A以及圖6B。處理單元15可根據該些影像框架中連續的第一影像框架f1與第二影像框架f2,計算參考點32在第一影像框架f1與第二影像框架f2的成像位置的位移變化值(即-)。而後,處理單元15可根據計算的位移變化值,判斷位移變化值是否小於預設的位移閥值(例如5個像素/單位時間)。 In another embodiment, it is determined whether the reference point is greatly moved according to the displacement change of the reference point 21. Please refer to FIG. 1, FIG. 2, FIG. 6A, and FIG. 6B. The processing unit 15 calculates a displacement change value of the reference point 32 at the imaging position of the first image frame f1 and the second image frame f2 according to the continuous first image frame f1 and the second image frame f2 in the image frames (ie, - ). Then, the processing unit 15 can determine whether the displacement change value is smaller than a preset displacement threshold (for example, 5 pixels/unit time) according to the calculated displacement change value.

若處理單元15判斷位移變化值小於所述的位移閥值(例如5個像素/單位時間),處理單元15可判定參考點21並未大幅移動。反之,若處理單元15判斷位移變化值大於所述的位移閥值,處理單元15可判定參考點21並未大幅移動,並不更新手持式指向裝置10目前使用的第一傾斜角度。 If the processing unit 15 determines that the displacement change value is less than the displacement threshold (e.g., 5 pixels/unit time), the processing unit 15 can determine that the reference point 21 has not moved significantly. On the other hand, if the processing unit 15 determines that the displacement change value is greater than the displacement threshold, the processing unit 15 can determine that the reference point 21 has not moved significantly and does not update the first tilt angle currently used by the hand-held pointing device 10.

舉例來說,當處理單元15根據兩張連續影像框架(即第一影像框架f1、第二影像框架f2)所計算的位移閥值大於5個像素時,處理單元15即可判定參考點21於第一影像框架f1與第二影像框架f2中發生大幅移動;當處理單元15所計算的位移閥值小於5個像素時,處理單元15即可判定參考點21於第一影像框架f1與第二影像框架f2中並未大幅移動。 For example, when the processing unit 15 calculates a displacement threshold greater than 5 pixels according to two consecutive image frames (ie, the first image frame f1 and the second image frame f2), the processing unit 15 can determine the reference point 21 A large movement occurs in the first image frame f1 and the second image frame f2; when the displacement threshold calculated by the processing unit 15 is less than 5 pixels, the processing unit 15 can determine the reference point 21 in the first image frame f1 and the second The image frame f2 does not move significantly.

所述預設速度變化閥值可依據實際應用需求以韌體方式預先設計於處理單元15。所述位移閥值可依據實際應用需求以韌體方式預先設計於處理單元15。 The preset speed change threshold may be pre-designed to the processing unit 15 in a firmware manner according to actual application requirements. The displacement threshold can be pre-designed to the processing unit 15 in a firmware manner according to actual application requirements.

於又一具體實施方式為根據參考點21的加速度變化來判斷參考點是否大幅移動。請參考圖5並同時參照圖1、圖2、圖6A、圖6B以及圖6C,圖5繪示本發明另一實施例提供的手持式指向裝置位移判斷方法的流程示意圖。圖5所示的步驟可以是執行於圖3的步驟S303中,且還可以是在手持式指向裝置10計算並根據參考點21的在該些影像框架的成像位置變化(亦即速度變化值)判斷參考點21是否大幅移動之後執行。 In still another embodiment, it is determined whether the reference point is greatly moved according to the acceleration change of the reference point 21. Referring to FIG. 5 and FIG. 2, FIG. 2, FIG. 6A, FIG. 6B and FIG. 6C, FIG. 5 is a schematic flow chart of a method for judging displacement of a hand-held pointing device according to another embodiment of the present invention. The steps shown in FIG. 5 may be performed in step S303 of FIG. 3, and may also be performed at the handheld pointing device 10 and according to the reference position 21, the imaging position changes (ie, speed change values) of the image frames. It is judged whether or not the reference point 21 is largely moved.

於步驟S501中,處理單元15根據影像擷取單元11所產生對應參考點21的該些影像框架中的第一影像框架f1、第二影像框架f2以及第三影像框架f3,計算對應參考點21的加速度變化值。所述第一影像框架f1、第二影像框架f2以及第三影像框架f3為影像擷取單元11依序產生的三個連續影像框架。也就是,第二影像框架f2的擷取時間是晚於第一影像框架f1的擷取時間,而第三影像框架f3的擷取時間是晚於第二影像框架f2的擷取時間。 In step S501, the processing unit 15 calculates the corresponding reference point 21 according to the first image frame f1, the second image frame f2, and the third image frame f3 in the image frames corresponding to the reference point 21 generated by the image capturing unit 11. The value of the acceleration change. The first image frame f1, the second image frame f2, and the third image frame f3 are three consecutive image frames sequentially generated by the image capturing unit 11. That is, the capture time of the second image frame f2 is later than the capture time of the first image frame f1, and the capture time of the third image frame f3 is later than the capture time of the second image frame f2.

處理單元15可分別於步驟S503與步驟S505中,透過公式(5)來分別計算參考點21於第一影像框架f1與第二影像框架f2之間以及第二影像框架f2與第三影像框架f3之間中移動的速度變化值。所述參考點21在第一影像框架f1中的成像位置是以參考點影像61來表示。所述參考點21在第二影像框架f2中的成像位置是以參考點影像61’來表示。所述參考點21在第三影像框架f3中的成像位置是以參考點影像61”來表示。 The processing unit 15 can respectively calculate the reference point 21 between the first image frame f1 and the second image frame f2 and the second image frame f2 and the third image frame f3 through the formula (5) in steps S503 and S505, respectively. The speed change value between the movements. The imaging position of the reference point 21 in the first image frame f1 is represented by a reference point image 61. The imaging position of the reference point 21 in the second image frame f2 is represented by a reference point image 61'. The imaging position of the reference point 21 in the third image frame f3 is represented by a reference point image 61".

舉例來說,處理單元15可利用公式(6)與公式(7)計算出參考點21於第一影像框架f1與第二影像框架f2之間的第一速度變化值以及參考點21於第二影像框架f2與第三影像框架f3之間的第二速度變化值。第一速度變化值的計算方式如下: 其中v 1表示第一速度變化值;表示參考點21於第一影像框架f1的成像位置,且為(x1,y1);表示參考點21於第二影像框架f2的成像位置,且為(x2,y2);t f1表示該第一影像框架的擷取時間;t f2表示第二影像框架f2的擷取時間。第二速度變化值的計算公式如下: 其中v 2表示第二速度變化值;表示參考點21於第二影像框架f2的成像位置;表示參考點21於第三影像框架f3的成像位置;t f2表示第二影像框架f2的擷取時間;t f3表示第三影像框架f3的擷取時間。如前述,所述對應參考點21於第一影像框架f1中成像位置的參考點影像61的位置(即)、對應參考點21於第二影像框架f2中成像位置的參考點影像61’的位置(即)以及對應參考點21於第三影像框架f3中成像位置的參考點影像61”的位置(即)是處理單元15根據影像擷取單元11中的感測陣列的中心(即 第一影像框架f1、第二影像框架f2及第三影像框架f3的中心點”X”)來計算。 For example, the processing unit 15 can calculate the first velocity change value of the reference point 21 between the first image frame f1 and the second image frame f2 and the reference point 21 in the second by using the formula (6) and the formula (7). a second speed change value between the image frame f2 and the third image frame f3. The first speed change value is calculated as follows: Where v 1 represents a first speed change value; Representing the imaging position of the reference point 21 in the first image frame f1, and Is (x1, y1); Representing the imaging position of the reference point 21 in the second image frame f2, and (x2, y2); t f 1 represents the extraction time of the first image frame; t f 2 represents the extraction time of the second image frame f2. The formula for calculating the second speed change value is as follows: Where v 2 represents a second speed change value; Representing the imaging position of the reference point 21 in the second image frame f2; Indicates the imaging position of the reference point 21 in the third image frame f3; t f 2 represents the extraction time of the second image frame f2; t f 3 represents the extraction time of the third image frame f3. As described above, the position of the reference point image 61 of the imaging position of the corresponding reference point 21 in the first image frame f1 (ie, ), corresponding to the position of the reference point image 61 ′ of the imaging position of the reference point 21 in the second image frame f 2 (ie, And the position of the reference point image 61" corresponding to the imaging position of the reference point 21 in the third image frame f3 (ie, The processing unit 15 calculates the center of the sensing array in the image capturing unit 11 (i.e., the center point "X" of the first image frame f1, the second image frame f2, and the third image frame f3).

隨後,於步驟S505中,處理單元15根據第一速度變化值v 1以及第二速度變化值v 2分別計算參考點21於第一影像框架f1、第二影像框架f2以及第三影像框架f3的成像位置影像(即參考點影像61、61’、61”)的加速度變化值。具體地說,處理單元15可透過計算第一速度變化值v 1以及第二速度變化值v 2之間的差值,獲取參考點21的加速度變化值。 Then, in step S505, the processing unit 15 calculates the reference point 21 in the first image frame f1, the second image frame f2, and the third image frame f3 according to the first speed change value v 1 and the second speed change value v 2 , respectively. The acceleration change value of the imaging position image (ie, the reference point image 61, 61', 61"). Specifically, the processing unit 15 can calculate the difference between the first speed change value v 1 and the second speed change value v 2 . Value, the acceleration change value of the reference point 21 is obtained.

而後,於步驟S507中,處理單元15根據加速度變化值,判斷加速度變化值是否大於預設加速度閥值(例如0g)。當處理單元15判斷加速度變化值小於預設加速度閥值(例如0g),執行步驟S509。反之,當處理單元15判斷加速度變化值v大於預設加速度閥值(例如0g),則執行步驟S511。所述預設加速度閥值可依據實際以韌體設計方式預先儲存於處理單元15。 Then, in step S507, the processing unit 15 determines whether the acceleration change value is greater than a preset acceleration threshold (for example, 0g) based on the acceleration change value. When the processing unit 15 determines that the acceleration change value is less than the preset acceleration threshold (for example, 0g), step S509 is performed. On the other hand, when the processing unit 15 determines that the acceleration change value v is greater than the preset acceleration threshold (for example, 0 g), step S511 is performed. The preset acceleration threshold value may be pre-stored in the processing unit 15 according to an actual firmware design.

於步驟S509中,處理單元15判定參考點21於第一影像框架f1、第二影像框架f2以及第三影像框架f3中並未大幅移動。而於步驟S511中,處理單元15判定參考點21於第一影像框架f1、第二影像框架f2以及第三影像框架f3中發生大幅移動時,處理單元15不更新手持式指向裝置10目前使用的第一傾斜角度。 In step S509, the processing unit 15 determines that the reference point 21 has not moved significantly in the first image frame f1, the second image frame f2, and the third image frame f3. In step S511, when the processing unit 15 determines that the reference point 21 has moved substantially in the first image frame f1, the second image frame f2, and the third image frame f3, the processing unit 15 does not update the current use of the handheld pointing device 10. The first angle of inclination.

於另一具體實施方式則是根據手持式指向裝置10的加速度變化來判斷參考點是否大幅移動。請參考圖7並同時參照圖1以及圖2,圖7繪示本發明又一實施例提供的手持式指向裝置位移判斷方法的流程示意圖。圖7所示的步驟可以是執行於圖3的步驟S303中,且還可以是在手持式指向裝置10根據所計算參考點21的位置變化(亦即速度變化與加速度變化)判斷參考點21是否大幅移動之後執行。 In another embodiment, it is determined whether the reference point is greatly moved according to the acceleration change of the hand-held pointing device 10. Please refer to FIG. 7 and FIG. 2 simultaneously. FIG. 7 is a schematic flow chart of a method for judging displacement of a hand-held pointing device according to another embodiment of the present invention. The step shown in FIG. 7 may be performed in step S303 of FIG. 3, and may further determine whether the reference point 21 is determined by the hand-held pointing device 10 according to the position change (ie, the speed change and the acceleration change) of the calculated reference point 21. Execute after a large move.

於步驟S701中,手持式指向裝置10的處理單元15利用手持式指向裝置10的加速度單元13感測手持式指向裝置10目前於多 軸向的加速度值,以產生加速度向量。 In step S701, the processing unit 15 of the handheld pointing device 10 senses that the handheld pointing device 10 is currently using the acceleration unit 13 of the handheld pointing device 10. The axial acceleration value to generate an acceleration vector.

接著,於步驟S703中,手持式指向裝置10的處理單元15根據加速度向量的大小,判斷加速度向量的大小是否等於手持式指向裝置10的重力加速度值,亦即判斷手持式指向裝置10是否處於靜止狀態。舉例來說,處理單元15可透過計算加速度向量內積的平方根來計算加速度向量的大小(magnitude)。當處理單元15判斷手持式指向裝置10的加速度向量的大小等於手持式指向裝置10的重力加速度值,例如一重力單位(g)時,執行步驟S707。反之,當處理單元15判斷手持式指向裝置10的加速度向量的大小不等於手持式指向裝置10的重力加速度值時,則執行步驟S705。 Next, in step S703, the processing unit 15 of the handheld pointing device 10 determines whether the magnitude of the acceleration vector is equal to the gravity acceleration value of the handheld pointing device 10 according to the magnitude of the acceleration vector, that is, whether the handheld pointing device 10 is at rest. status. For example, processing unit 15 may calculate the magnitude of the acceleration vector by calculating the square root of the product of the acceleration vectors. When the processing unit 15 determines that the magnitude of the acceleration vector of the hand-held pointing device 10 is equal to the gravitational acceleration value of the hand-held pointing device 10, such as a gravity unit (g), step S707 is performed. On the contrary, when the processing unit 15 determines that the magnitude of the acceleration vector of the hand-held pointing device 10 is not equal to the gravity acceleration value of the hand-held pointing device 10, step S705 is performed.

於步驟S705中,因手持式指向裝置10的加速度不等於手持式指向裝置10的重力加速度值,表示手持式指向裝置10處於移動狀態,處理單元15可判定參考點21大幅移動,而不更新手持式指向裝置10目前使用的第一傾斜角度。於步驟S707中,因手持式指向裝置10的加速度等於手持式指向裝置10的重力加速度值,表示手持式指向裝置10處於靜止狀態,處理單元15可判定參考點21並未大幅移動。 In step S705, since the acceleration of the hand-held pointing device 10 is not equal to the gravity acceleration value of the hand-held pointing device 10, indicating that the hand-held pointing device 10 is in the moving state, the processing unit 15 can determine that the reference point 21 moves substantially without updating the handheld. The first angle of inclination of the pointing device 10 is currently used. In step S707, since the acceleration of the hand-held pointing device 10 is equal to the gravity acceleration value of the hand-held pointing device 10, indicating that the hand-held pointing device 10 is in a stationary state, the processing unit 15 can determine that the reference point 21 has not moved significantly.

值得一提的是,於實務上,可藉由於微控制器或嵌入式控制器上設計對應圖3的傾斜度校正方法與圖4、圖5以及圖7所述的參考點位移判斷方法的程式碼,以由處理單元15,執行圖3的傾斜度校正方法與圖4、圖5以及圖7所述的參考點位移判斷方法,但本實施例並不限制。 It is worth mentioning that, in practice, the program corresponding to the tilt correction method of FIG. 3 and the reference point displacement judging method described in FIG. 4, FIG. 5 and FIG. 7 may be designed by using a microcontroller or an embedded controller. The code is used by the processing unit 15 to perform the tilt correction method of FIG. 3 and the reference point displacement determination method described in FIGS. 4, 5, and 7, but the embodiment is not limited.

此外,圖3僅用於描述手持式指向裝置10的一種傾斜度校正方法,故圖3並非用以限定本發明。同樣地,圖4、圖5以及圖7僅用於描述手持式指向裝置10判斷參考點是否位移的具體判斷方式並非用以限定本發明。如圖6A到圖6C所示,於本實施例中表示參考點21於第一影像框架f1、第二影像框架f2及第三影像框架f3成像位置的參考點影像61、61’、61”是以圓點來呈現,但於 實務上,亦可依據參考點21的實際形狀以星號、十字或三角形等形狀來表示。換言之,圖6A到圖6C僅用以配合圖4與圖5說明參考點21的速度變化與加速度變化的計算方式,亦並非用以限定本發明。 In addition, FIG. 3 is only used to describe a tilt correction method of the handheld pointing device 10, and FIG. 3 is not intended to limit the present invention. Similarly, FIG. 4, FIG. 5, and FIG. 7 are only used to describe the specific manner in which the hand-held pointing device 10 determines whether the reference point is displaced or not, and is not intended to limit the present invention. As shown in FIG. 6A to FIG. 6C, in the present embodiment, the reference point images 61, 61', 61" indicating the imaging positions of the reference point 21 in the first image frame f1, the second image frame f2, and the third image frame f3 are Presented as dots, but In practice, it can also be represented by a shape such as an asterisk, a cross or a triangle according to the actual shape of the reference point 21. In other words, FIG. 6A to FIG. 6C are only used to describe the calculation method of the speed change and the acceleration change of the reference point 21 in conjunction with FIG. 4 and FIG. 5, and are not intended to limit the present invention.

〔傾斜度校正方法之另一實施例〕 [Another embodiment of the inclination correction method]

由上述的實施例,本發明另可歸納出一種傾斜度校正方法,此方法可應用適用於上述實施例互動系統中的手持式指向裝置。所述傾斜度校正方法可根據參考點的速度變化、參考點的加速度變化以及手持式指向裝置的加速度變化,來決定是否更新手持式指向裝置目前使用的旋轉角度。 From the above-described embodiments, the present invention can further provide a tilt correction method which can be applied to a hand-held pointing device suitable for use in the interactive system of the above embodiment. The tilt correction method may determine whether to update the rotation angle currently used by the handheld pointing device according to the speed change of the reference point, the acceleration change of the reference point, and the acceleration change of the hand-held pointing device.

請參照圖8並同時參照圖1以及圖2,圖8繪示本發明另一實施例提供的手持式指向裝置的傾斜角度校正方法的流程示意圖。圖8所述執行於手持式指向裝置的傾斜角度校正方法可以韌體程式設計方式來實現,並透過手持式指向裝置10的處理單元15來執行。處理單元15可例如為微控制器或嵌入式控制器等處理晶片設置於手持式指向裝置,但本實施例並不限制。 Referring to FIG. 8 and FIG. 2 simultaneously, FIG. 8 is a schematic flow chart of a method for correcting a tilt angle of a hand-held pointing device according to another embodiment of the present invention. The tilt angle correction method performed by the handheld pointing device of FIG. 8 can be implemented in a firmware programming manner and executed by the processing unit 15 of the handheld pointing device 10. The processing unit 15 can be disposed on the handheld pointing device, for example, a processing chip such as a microcontroller or an embedded controller, but the embodiment is not limited.

首先,於步驟S801中,手持式指向裝置10的影像擷取單元11於手持式指向裝置10指向參考點21的位置時,根據預設的影像擷取頻率(例如每秒2000張影像框架)來擷取對應參考點21位置的影像,並依序產生多個影像框架。 First, in step S801, the image capturing unit 11 of the handheld pointing device 10 is based on a preset image capturing frequency (for example, 2000 image frames per second) when the handheld pointing device 10 is pointed to the reference point 21 position. An image corresponding to the position of the reference point 21 is captured, and a plurality of image frames are sequentially generated.

於步驟S803中,手持式指向裝置10的處理單元15根據該些影像框架中的第一影像框架與第二影像框架,利用前述之公式(6)計算參考點21的第一速度變化值。 In step S803, the processing unit 15 of the handheld pointing device 10 calculates the first velocity change value of the reference point 21 by using the above formula (6) according to the first image frame and the second image frame in the image frames.

於步驟S805中,處理單元15根據計算的第一速度變化值,判斷第一速度變化值是否大於預設速度變化閥值(例如1個像素/單位時間)。若處理單元15判斷第一速度變化值大於預設速度變化閥值,則執行步驟S821。反之,若處理單元15判斷第一速度變化值小於預設速度變化閥值,則執行步驟S807。 In step S805, the processing unit 15 determines whether the first speed change value is greater than a preset speed change threshold (for example, 1 pixel/unit time) based on the calculated first speed change value. If the processing unit 15 determines that the first speed change value is greater than the preset speed change threshold, step S821 is performed. On the other hand, if the processing unit 15 determines that the first speed change value is smaller than the preset speed change threshold, step S807 is performed.

值得一提的是,所述單位時間如前述可以是依據影像擷取單元的影像擷取頻率(例如根據影像擷取頻率計算每兩張連續影像框架的時間間隔)或是連續影像框架的數量(例如每兩張連續影像框架)來定義。 It is worth mentioning that the unit time may be based on the image capturing frequency of the image capturing unit (for example, calculating the time interval of each two consecutive image frames according to the image capturing frequency) or the number of consecutive image frames (for example, the time interval of the image capturing unit according to the image capturing frequency). For example, every two consecutive image frames) are defined.

於步驟S807中,處理單元15再根據該些影像框架中的第二影像框架與第三影像框架,利用前述之公式(7)計算參考點21的第二速度變化值。 In step S807, the processing unit 15 calculates the second speed change value of the reference point 21 by using the foregoing formula (7) according to the second image frame and the third image frame in the image frames.

於步驟S809中,處理單元15利用第一速度變化值與第二速度變化值計算參考點21的加速度變化值。也就是,處理單元15藉由計算第一速度變化值與第二速度變化值的差異,獲取參考點21在第一影像框架至第三影像框架的擷取時間內的加速度變化。 In step S809, the processing unit 15 calculates the acceleration change value of the reference point 21 using the first speed change value and the second speed change value. That is, the processing unit 15 acquires the acceleration change of the reference point 21 during the extraction time of the first image frame to the third image frame by calculating the difference between the first speed change value and the second speed change value.

接著,於步驟S811中,處理單元15判斷加速度變化值是否大於預設加速度閥值(例如0g)。若處理單元15判斷加速度變化值大於預設加速度閥值(例如0g),執行步驟S821。反之,若處理單元15判斷加速度變化值小於預設加速度閥值時,執行步驟S813。 Next, in step S811, the processing unit 15 determines whether the acceleration change value is greater than a preset acceleration threshold (for example, 0g). If the processing unit 15 determines that the acceleration change value is greater than the preset acceleration threshold (for example, 0 g), step S821 is performed. On the other hand, if the processing unit 15 determines that the acceleration change value is less than the preset acceleration threshold, step S813 is performed.

於步驟S813中,手持式指向裝置10的處理單元15利用手持式指向裝置10的加速度單元13感測手持式指向裝置10目前於多軸向的加速度值,以產生加速度向量。於步驟S815中,處理單元15判斷手持式指向裝置10的加速度向量的大小是否等於手持式指向裝置10的重力加速度值,例如一重力單位(g),以判斷手持式指向裝置10是否處於靜止狀態。詳細地說,處理單元15可透過計算加速度向量內積的平方根,來計算加速度向量的大小。 In step S813, the processing unit 15 of the hand-held pointing device 10 senses the current acceleration value of the hand-held pointing device 10 in multiple axes by using the acceleration unit 13 of the hand-held pointing device 10 to generate an acceleration vector. In step S815, the processing unit 15 determines whether the magnitude of the acceleration vector of the handheld pointing device 10 is equal to the gravity acceleration value of the handheld pointing device 10, such as a gravity unit (g), to determine whether the handheld pointing device 10 is at a standstill. . In detail, the processing unit 15 can calculate the magnitude of the acceleration vector by calculating the square root of the product of the acceleration vector.

當處理單元15判斷手持式指向裝置10的加速度向量的大小等於手持式指向裝置10的重力加速度值時,執行步驟S817。反之,當處理單元15判斷手持式指向裝置10的加速度向量的大小不等於手持式指向裝置10的重力加速度值時,則執行步驟S821。 When the processing unit 15 determines that the magnitude of the acceleration vector of the hand-held pointing device 10 is equal to the gravity acceleration value of the hand-held pointing device 10, step S817 is performed. On the other hand, when the processing unit 15 determines that the magnitude of the acceleration vector of the hand-held pointing device 10 is not equal to the gravity acceleration value of the hand-held pointing device 10, step S821 is performed.

於步驟S817,處理單元15判定參考點21並未大幅移動,亦即表示手持式指向裝置10目前處於靜止狀態。處理單元15隨後 於步驟S819中,根據加速度單元13感測產生的加速度向量利用公式(1)至(3),計算並更新手持式指向裝置10目前使用的第一傾斜角度為第二傾斜角度。處理單元15並利用第二傾斜角度與該些影像框架的其中之一計算手持式指向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊。 In step S817, the processing unit 15 determines that the reference point 21 has not moved significantly, that is, that the hand-held pointing device 10 is currently in a stationary state. Processing unit 15 then In step S819, the first tilt angle currently used by the hand-held pointing device 10 is calculated and updated to the second tilt angle using the equations (1) to (3) according to the acceleration vector sensed by the acceleration unit 13. The processing unit 15 calculates the pointing coordinate or relative motion vector information of the handheld pointing device 10 relative to the reference point 21 or the image display device 30 by using the second tilt angle and one of the image frames.

於步驟S821中,處理單元15判定參考點21大幅移動,亦即手持式指向裝置10目前處於移動狀態。於步驟S823中,處理單元15因已判定參考點21大幅移動,而不更新手持式指向裝置10目前使用的第一傾斜角度。處理單元15並利用第一傾斜角度與該些影像框架的其中之一計算手持式指向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊。 In step S821, the processing unit 15 determines that the reference point 21 is largely moved, that is, the hand-held pointing device 10 is currently in a moving state. In step S823, the processing unit 15 does not update the first tilt angle currently used by the hand-held pointing device 10 because it has been determined that the reference point 21 has moved substantially. The processing unit 15 calculates the pointing coordinates or relative motion vector information of the handheld pointing device 10 relative to the reference point 21 or the image display device 30 by using the first tilt angle and one of the image frames.

處理單元15隨後可控制傳輸單元17將計算手持式指向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊,以無線方式傳送至主機20以配合主機20執行的軟體程式,相應地控制影像顯示裝置30上游標31的動作。 The processing unit 15 can then control the transmission unit 17 to calculate the pointing coordinates or relative motion vector information of the handheld pointing device 10 relative to the reference point 21 or the image display device 30, and wirelessly transmit the information to the host 20 to cooperate with the software program executed by the host 20. Accordingly, the operation of the upstream target 31 of the image display device 30 is controlled accordingly.

處理單元15並於執行步驟S819或步驟S823之後,重新執行步驟S801,擷取對應參考點21位置影像並判斷參考點21是否位移,以決定是否更新手持式指向裝置10的第一傾斜角度。 After performing step S819 or step S823, the processing unit 15 re-executes step S801, captures the position image corresponding to the reference point 21, and determines whether the reference point 21 is displaced to determine whether to update the first tilt angle of the handheld pointing device 10.

此外,圖8僅用於描述手持式指向裝置10的一種傾斜度校正方法,故圖8並非用以限定本發明。於所屬技術領域具通常知識者亦可依據實際運作需求,選擇判斷參考點是否大幅移動的方式。換言之,於實務上,步驟S803~S805(即參考點21的速度變化)、步驟S807~S811(即參考點21的加速度變化)以及S813~S815(即手持式指向裝置10的加速度變化)可依據實際運作需求,選擇是否執行或略過。 In addition, FIG. 8 is only used to describe a tilt correction method of the handheld pointing device 10, and thus FIG. 8 is not intended to limit the present invention. Those with ordinary knowledge in the technical field can also choose the way to judge whether the reference point moves greatly according to the actual operation requirements. In other words, in practice, steps S803 to S805 (ie, the speed change of the reference point 21), steps S807 to S811 (ie, the acceleration change of the reference point 21), and S813 to S815 (ie, the acceleration change of the hand-held pointing device 10) may be based on Actual operational requirements, choose whether to execute or skip.

於所屬技術領域具通常知識者亦可在計算參考點21的速度變化之前,可藉由計算參考點21的位移變化來判斷參考點21是否大幅移動。詳細地說,於執行步驟S803之前,處理單元15可根 據第一影像框架與第二影像框架計算參考點21在第一影像框架與第二影像框架的成像位置的位移變化值。而後,處理單元15根據計算的位移變化值判斷位移變化值是否小於預設的位移閥值(例如5個像素/單位時間),來決定參考點21是否大幅移動。 Those skilled in the art can also determine whether the reference point 21 is greatly moved by calculating the displacement change of the reference point 21 before calculating the speed change of the reference point 21. In detail, before performing step S803, the processing unit 15 may The displacement change value of the reference point 21 at the imaging position of the first image frame and the second image frame is calculated according to the first image frame and the second image frame. Then, the processing unit 15 determines whether the displacement change value is smaller than a preset displacement threshold (for example, 5 pixels/unit time) based on the calculated displacement change value to determine whether the reference point 21 is largely moved.

另,上述預設速度變化閥值、預設加速度閥值以及位移閥值可依據實際手持式指向裝置10的應用自行設定,本實施例並不限制。 In addition, the preset speed change threshold, the preset acceleration threshold, and the displacement threshold may be set according to the application of the actual handheld pointing device 10, which is not limited in this embodiment.

〔傾斜度校正方法之又一實施例〕 [Another embodiment of the inclination correction method]

由上述的實施例,本發明另可歸納出一種傾斜度校正方法,此方法可應用適用於上述實施例互動系統中的手持式指向裝置。所述傾斜度校正方法可根據參考點的加速度變化,來決定是否更新手持式指向裝置目前使用的旋轉角度。 From the above-described embodiments, the present invention can further provide a tilt correction method which can be applied to a hand-held pointing device suitable for use in the interactive system of the above embodiment. The tilt correction method can determine whether to update the rotation angle currently used by the handheld pointing device according to the acceleration change of the reference point.

請參照圖9並同時參照圖1、圖2以及圖6A到圖6C,圖9繪示本發明另一實施例提供的手持式指向裝置的傾斜角度校正方法的流程示意圖。圖9所述執行於手持式指向裝置的傾斜角度校正方法可以韌體程式設計方式來實現,並透過手持式指向裝置的中的處理單元15來執行。處理單元15可例如為微控制器或嵌入式控制器等處理晶片設置於手持式指向裝置,但本實施例並不限制。 Referring to FIG. 9 and FIG. 1 and FIG. 6A to FIG. 6C, FIG. 9 is a schematic flow chart of a method for correcting a tilt angle of a hand-held pointing device according to another embodiment of the present invention. The tilt angle correction method performed by the hand-held pointing device of FIG. 9 can be implemented in a firmware programming manner and executed by the processing unit 15 in the hand-held pointing device. The processing unit 15 can be disposed on the handheld pointing device, for example, a processing chip such as a microcontroller or an embedded controller, but the embodiment is not limited.

於步驟S901中,手持式指向裝置10的影像擷取單元11於手持式指向裝置10指向參考點21的位置時,根據預設的影像擷取頻率擷取對應參考點21位置的影像,並依序產生多個影像框架。 In step S901, the image capturing unit 11 of the handheld pointing device 10 captures the image corresponding to the position of the reference point 21 according to the preset image capturing frequency when the handheld pointing device 10 points to the position of the reference point 21, and The sequence produces multiple image frames.

而後,於步驟S903中,手持式指向裝置10的處理單元15根據該些影像框架中的任三個連續的影像框架,計算參考點21在該些連續的影像框架中成像位置的加速度變化值。所述任三個連續的影像框架中的第三影像框架f3的擷取時間晚於第二影像框架f2的擷取時間,而第二影像框架f2的擷取時間晚於第一影像框架f1的擷取時間。 Then, in step S903, the processing unit 15 of the handheld pointing device 10 calculates the acceleration change value of the imaging position of the reference point 21 in the consecutive image frames according to any three consecutive image frames in the image frames. The capture time of the third image frame f3 in any three consecutive image frames is later than the capture time of the second image frame f2, and the capture time of the second image frame f2 is later than that of the first image frame f1. Take time.

具體地說,處理單元15可依據參考點21於三個連續的影像框架中第一影像框架f1與第二影像框架f2的成像位置,亦即參考點影像61、61’的位置向量,利用前述之公式(6)計算參考點21的第一速度變化值。接著,再根據參考點21於三個連續的影像框架中的第二影像框架f2及第三影像框架f3的成像位置,亦即參考點影像61’、61”的位置向量,利用前述之公式(7)計算參考點21的第二速度變化值。處理單元15隨後可利用第一速度變化值與第二速度變化值計算參考點21的加速度變化值。 Specifically, the processing unit 15 can use the foregoing imaging positions of the first image frame f1 and the second image frame f2 in the three consecutive image frames according to the reference point 21, that is, the position vectors of the reference point images 61, 61 ′, Equation (6) calculates the first speed change value of the reference point 21. Then, according to the imaging position of the second image frame f2 and the third image frame f3 in the three consecutive image frames according to the reference point 21, that is, the position vector of the reference point images 61', 61", the foregoing formula is used ( 7) Calculating a second speed change value of the reference point 21. The processing unit 15 may then calculate the acceleration change value of the reference point 21 using the first speed change value and the second speed change value.

於步驟S905中,處理單元15根據參考點21於三個連續的影像框架中成像位置(亦即參考點影像61、61’以及61”)的加速度變化值,判斷參考點21在三個連續的影像框架中的成像位置(亦即參考點影像61、61’以及61”)的加速度變化值是否等於零(即0g)。若處理單元15判斷參考點21在三個連續的影像框架中的成像位置(亦即參考點影像61、61’以及61”)的加速度變化值等於零時,執行步驟S907。反之,若處理單元15判斷參考點21在三個連續的影像框架中的成像位置(亦即參考點影像61、61’以及61”)的加速度變化值並不等於零時,則執行步驟S911。 In step S905, the processing unit 15 determines that the reference point 21 is in three consecutive directions according to the acceleration change values of the imaging positions (ie, the reference point images 61, 61', and 61" in the three consecutive image frames of the reference point 21. Whether the acceleration change value of the imaging position (that is, the reference point images 61, 61' and 61") in the image frame is equal to zero (ie, 0 g). If the processing unit 15 determines that the acceleration change value of the imaging position of the reference point 21 in the three consecutive image frames (ie, the reference point images 61, 61', and 61") is equal to zero, step S907 is performed. Otherwise, if the processing unit 15 When it is judged that the acceleration change value of the imaging position of the reference point 21 in the three consecutive image frames (that is, the reference point images 61, 61' and 61") is not equal to zero, step S911 is performed.

於步驟S907中,當處理單元15判定參考點21並未大幅移動,且處理單元15利用手持式指向裝置10的加速度單元13感測手持式指向裝置10目前於多軸向的加速度值,以產生加速度向量。接著,於步驟S909中,處理單元15可利用前述公式(1)至(3)計算並更新手持式指向裝置10目前使用的第一傾斜角度為第二傾斜角度。處理單元15並利用第二傾斜角度與該些三個連續影像框架的其中之一計算手持式指向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊。 In step S907, when the processing unit 15 determines that the reference point 21 has not moved significantly, and the processing unit 15 senses the acceleration value of the hand-held pointing device 10 in the multi-axis by the acceleration unit 13 of the handheld pointing device 10 to generate Acceleration vector. Next, in step S909, the processing unit 15 may calculate and update the first tilt angle currently used by the hand-held pointing device 10 as the second tilt angle using the aforementioned formulas (1) to (3). The processing unit 15 calculates the pointing coordinates or relative motion vector information of the handheld pointing device 10 with respect to the reference point 21 or the image display device 30 by using the second tilt angle and one of the three consecutive image frames.

於步驟S911中,當處理單元15判定參考點21大幅移動,且不更新手持式指向裝置10目前使用的第一傾斜角度。處理單元15並利用第一傾斜角度與該些影像框架的其中之一計算手持式指 向裝置10相對於參考點21或影像顯示裝置30的指向座標或相對移動向量資訊。 In step S911, the processing unit 15 determines that the reference point 21 has moved largely, and does not update the first tilt angle currently used by the hand-held pointing device 10. The processing unit 15 calculates the hand-held finger by using the first tilt angle and one of the image frames Pointing coordinates or relative motion vector information to device 10 relative to reference point 21 or image display device 30.

處理單元15隨後並可控制傳輸單元17將所計算參考點21手持式指向裝置10的指向座標或相對移動向量資訊以無線方式傳送至主機20以配合主機20執行的軟體程式,相應地控制影像顯示裝置30上游標31的動作。 The processing unit 15 can then control the transmission unit 17 to wirelessly transmit the pointing coordinates or relative motion vector information of the calculated reference point 21 hand-held pointing device 10 to the host 20 to cooperate with the software program executed by the host 20, and accordingly control the image display. The operation of the upstream tag 31 of the device 30.

處理單元15並於執行步驟S909或步驟S911之後,重新執行步驟S901,擷取對應參考點21位置影像並判斷參考點21是否位移,以決定是否更新手持式指向裝置10的第一傾斜角度。 After performing step S909 or step S911, the processing unit 15 re-executes step S901, extracts the position image corresponding to the reference point 21, and determines whether the reference point 21 is displaced to determine whether to update the first tilt angle of the handheld pointing device 10.

此外,圖9僅用於描述手持式指向裝置10的一種傾斜度校正方法,故圖9並非用以限定本發明。於所屬技術領域具通常知識者亦可依據實際運作需求,增加利用參考點21的移動變化(即位移變化與速度變化)的步驟來做為判斷參考點21是否位移的依據。 In addition, FIG. 9 is only used to describe a tilt correction method of the handheld pointing device 10, and FIG. 9 is not intended to limit the present invention. Those having ordinary knowledge in the technical field can also increase the step of using the movement change of the reference point 21 (ie, the displacement change and the speed change) according to the actual operational requirements as the basis for determining whether the reference point 21 is displaced.

〔實施例的可能功效〕 [Possible effects of the examples]

綜上所述,本發明實施例提供一種手持式指向裝置以及其傾斜角度校正方法,此手持式指向裝置及其傾斜角度校正方法可透過使用一個參考點與一加速度計計算參考點的位置在時間上的變化,並主動判斷是否使用手持式指向裝置上的加速度計產生的加速度資訊來校正手持式指向裝置的傾斜角度。本發明並可利用韌體設計方式,使手持式指向裝置藉由計算與分析參考點的速度變化、參考點的加速度變化以及手持式指向裝置的加速度變化,來判斷參考點是否大幅移動,並主動決定是否校正手持式指向裝置的傾斜角度。 In summary, the embodiment of the present invention provides a handheld pointing device and a tilt angle correcting method thereof. The handheld pointing device and the tilt angle correcting method thereof can calculate the position of the reference point at a time by using a reference point and an accelerometer. The above changes, and actively determine whether to use the acceleration information generated by the accelerometer on the handheld pointing device to correct the tilt angle of the handheld pointing device. The invention can utilize the firmware design method to make the handheld pointing device determine whether the reference point moves greatly by calculating and analyzing the speed change of the reference point, the acceleration change of the reference point, and the acceleration change of the hand-held pointing device. Decide whether to correct the tilt angle of the handheld pointing device.

據此,本發明之手持式指向裝置可在不須加設陀螺儀或是使用兩個參考點即可有效且精確地計算出參考點的位置,簡化手持式指向裝置的硬體架構,並降低手持式指向裝置的設計與製作成本。 Accordingly, the hand-held pointing device of the present invention can effectively and accurately calculate the position of the reference point without adding a gyroscope or using two reference points, simplifying the hardware structure of the hand-held pointing device, and reducing the hand-held The design and manufacturing cost of the pointing device.

以上所述僅為本發明之實施例,其並非用以侷限本發明之專 利範圍。 The above description is only an embodiment of the present invention, and is not intended to limit the invention. Benefit range.

S301~S309‧‧‧步驟流程 S301~S309‧‧‧Step procedure

Claims (28)

一種手持式指向裝置的傾斜角度校正方法,包括:於該手持式指向裝置指向一參考點時,擷取對應該參考點位置的影像,並依序產生多個影像框架(frame);根據該些影像框架判斷該參考點是否大幅移動;以及若判斷該參考點並未大幅移動,利用該手持式指向裝置的一加速度單元感測該手持式指向裝置於多個軸向的多個加速度值,以根據該些加速度值計算並更新該手持式指向裝置目前使用的一第一傾斜角度為一第二傾斜角度。 A method for correcting a tilt angle of a hand-held pointing device, comprising: capturing an image corresponding to a position of a reference point when the handheld pointing device is pointed to a reference point, and sequentially generating a plurality of image frames; The image frame determines whether the reference point moves substantially; and if it is determined that the reference point does not move substantially, an acceleration unit of the handheld pointing device senses a plurality of acceleration values of the handheld pointing device in multiple axial directions to Calculating and updating a first tilt angle currently used by the handheld pointing device according to the acceleration values is a second tilt angle. 如申請專利範圍第1項所述的傾斜角度校正方法,更包括:若判斷該參考點大幅移動,則不更新該手持式指向裝置的該第一傾斜角度,且利用該第一傾斜角度計算該參考點於該些影像框架之一的位置。 The tilt angle correction method of claim 1, further comprising: if the reference point is determined to move substantially, the first tilt angle of the handheld pointing device is not updated, and the first tilt angle is used to calculate the The reference point is at the position of one of the image frames. 如申請專利範圍第1項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動是判斷該參考點在該些影像框架中的成像位置是否大幅移動。 The tilt angle correction method according to claim 1, wherein determining whether the reference point is greatly moved is determining whether the imaging position of the reference point in the image frames is greatly moved. 如申請專利範圍第1項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動的該步驟中,包括:根據擷取該些影像框架中連續的一第一影像框架與一第二影像框架,計算該參考點在該第一影像框架與該第二影像框架的成像位置的一位移變化值;判斷該位移變化值是否小於一位移閥值;以及若該位移變化值小於該位移閥值,判定該參考點並未大幅移動。 The tilt angle correction method of claim 1, wherein the step of determining whether the reference point is greatly moved comprises: capturing a first image frame and a second image in the image frames according to the method a frame, calculating a displacement change value of the reference point at an imaging position of the first image frame and the second image frame; determining whether the displacement change value is less than a displacement threshold; and if the displacement change value is less than the displacement threshold , it is determined that the reference point does not move significantly. 如申請專利範圍第1項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動的該步驟中,包括:根據擷取該些影像框架中的一第一影像框架與一第二影像框架,計算該參考點在該第一影像框架與該第二影像框架的成像位 置的一速度變化值;判斷該速度變化值是否大於一預設速度變化閥值;以及若該速度變化值小於該預設速度變化閥值,判定該參考點並未大幅移動。 The tilt angle correction method of claim 1, wherein the step of determining whether the reference point is greatly moved comprises: capturing a first image frame and a second image frame in the image frames according to the method Calculating an imaging position of the reference point in the first image frame and the second image frame Setting a speed change value; determining whether the speed change value is greater than a preset speed change threshold; and if the speed change value is less than the preset speed change threshold, determining that the reference point does not move significantly. 如申請專利範圍第5項所述的傾斜角度校正方法,其中該速度變化值的計算公式如下: 其中v表示該速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間。 The tilt angle correction method according to claim 5, wherein the speed change value is calculated as follows: Where v represents the speed change value; Representing the reference point of the imaging position of the second image frame; Indicates the imaging position of the reference image in the first image frame; t f 2 represents the capturing time of the second image frame; t f 1 represents the capturing time of the first image frame. 如申請專利範圍第1項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動的該步驟中,包括:根據擷取的該些影像框架中的一第一影像框架與一第二影像框架,計算該參考點在該第一影像框架與該第二影像框架的成像位置的一第一速度變化值;根據擷取的該些影像框架中的該第二影像框架與一第三影像框架,計算該參考點在該第二影像框架與該第三影像框架的成像位置的一第二速度變化值;根據該第一速度變化值與該第二速度變化值之間的差值,獲取該參考點的一加速度變化值;判斷該加速度變化值是否大於一預設加速度閥值;以及若該加速度變化值小於該預設加速度閥值,判定該參考點並未大幅移動。 The tilt angle correction method of claim 1, wherein the step of determining whether the reference point is greatly moved comprises: selecting a first image frame and a second image in the captured image frames. a frame, calculating a first speed change value of the reference point at an imaging position of the first image frame and the second image frame; and selecting the second image frame and the third image frame in the image frames according to the captured image frame Calculating a second speed change value of the reference point at the imaging position of the second image frame and the third image frame; acquiring the difference according to the difference between the first speed change value and the second speed change value An acceleration change value of the reference point; determining whether the acceleration change value is greater than a preset acceleration threshold; and if the acceleration change value is less than the preset acceleration threshold, determining that the reference point does not move significantly. 如申請專利範圍第7項所述的傾斜角度校正方法,其中該第一速度變化值的計算公式如下: 其中v 1表示該第一速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間;其中該第二速度變化值的計算公式如下: 其中v 2表示該第二速度變化值;表示該參考點於該第三影像框架的成像位置;表示該參考點於該第二影像框架的成像位置;t f3表示該第三影像框架的擷取時間;t f2表示該第二影像框架的擷取時間。 The tilt angle correction method according to claim 7, wherein the first speed change value is calculated as follows: Where v 1 represents the first speed change value; Representing the reference point of the imaging position of the second image frame; Indicates an imaging position of the reference image in the first image frame; t f 2 represents a capture time of the second image frame; t f 1 represents a capture time of the first image frame; wherein the second speed change value Calculated as follows: Where v 2 represents the second speed change value; Representing the reference point of the imaging position of the third image frame; Indicates the imaging position of the reference image in the second image frame; t f 3 represents the capturing time of the third image frame; t f 2 represents the capturing time of the second image frame. 如申請專利範圍第7項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動的該步驟中,包括:利用該加速度單元感測該手持式指向裝置目前於多軸向的該些加速度值以產生一加速度向量(acceleration vector);判斷該加速度向量的大小是否等於該手持式指向裝置的重力加速度值;以及若該加速度向量的大小等於該手持式指向裝置的重力加速度值,判定該參考點並未大幅移動。 The tilt angle correction method according to claim 7, wherein the step of determining whether the reference point is greatly moved comprises: using the acceleration unit to sense the acceleration of the handheld pointing device currently in multiple axes a value to generate an acceleration vector; determining whether the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device; and determining the reference if the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device The point did not move significantly. 如申請專利範圍第1項所述的傾斜角度校正方法,其中判斷該參考點是否大幅移動的該步驟中,包括:利用該加速度單元感測該手持式指向裝置目前於多軸向的該些加速度值,以產生一加速度向量;判斷該加速度向量的大小是否等於該手持式指向裝置的重力加速度值;以及若該加速度向量的大小等於該手持式指向裝置的重力加速度值,判定該參考點並未大幅移動。 The tilt angle correction method according to claim 1, wherein the step of determining whether the reference point is greatly moved comprises: using the acceleration unit to sense the acceleration of the handheld pointing device currently in multiple axes a value to generate an acceleration vector; determining whether the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device; and if the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device, determining that the reference point is not Moved a lot. 一種手持式指向裝置的傾斜角度校正方法,包括:於該手持式指向裝置指向一參考點時,擷取對應該參考點位置的影像,並依序產生多個影像框架;根據該些影像框架中的任三個連續影像框架,計算該參考點在該等連續影像框架的成像位置的一加速度變化值;判斷該加速度變化值是否等於零;以及若該加速度變化值等於零,利用該手持式指向裝置的一加速度單元感測該手持式指向裝置於多軸向的多個加速度值,以根據該些加速度值計算並更新該手持式指向裝置目前使用的一第一傾斜角度為一第二傾斜角度。 A method for correcting a tilt angle of a handheld pointing device includes: capturing an image corresponding to a position of a reference point when the handheld pointing device is pointed to a reference point, and sequentially generating a plurality of image frames; according to the image frames Any three consecutive image frames, calculating an acceleration change value of the reference point at the imaging position of the continuous image frames; determining whether the acceleration change value is equal to zero; and if the acceleration change value is equal to zero, using the handheld pointing device An acceleration unit senses a plurality of acceleration values of the handheld pointing device in a plurality of axes to calculate and update a first tilt angle currently used by the handheld pointing device to be a second tilt angle according to the acceleration values. 如申請專利範圍第11項所述的傾斜角度校正方法,其中於判斷該加速度變化值等於零之後,更包括:利用該加速度單元感測該手持式指向裝置目前於多軸向的該些加速度值以產生一加速度向量;判斷該加速度向量的大小是否等於該手持式指向裝置的重力加速度值;若該加速度向量的大小等於該手持式指向裝置的重力加速度值,根據該些加速度值計算並更新該手持式指向裝置目前使用的該第一傾斜角度為該第二傾斜角度。 The tilt angle correction method of claim 11, wherein after determining that the acceleration change value is equal to zero, the method further comprises: using the acceleration unit to sense the acceleration values of the handheld pointing device currently in multiple axes Generating an acceleration vector; determining whether the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device; if the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device, calculating and updating the handheld according to the acceleration values The first tilt angle currently used by the pointing device is the second tilt angle. 如申請專利範圍第11項所述的傾斜角度校正方法,其中計算該參考點的該加速度變化值的該步驟包括:根據擷取任三個連續影像框架中的一第一影像框架與一第二影像框架,計算該參考點在該等連續影像框架的成像位置的一第一速度變化值;根據擷取任三個連續影像框架中的該第二影像框架與一第三影像框架,計算該參考點在該等連續影像框架的成像位置的一第二速度變化值;以及根據該第一速度變化值與該第二速度變化值之間的差值,獲 取該參考點在該等連續影像框架的成像位置的該加速度變化值。 The tilt angle correction method of claim 11, wherein the step of calculating the acceleration change value of the reference point comprises: capturing a first image frame and a second one of the three consecutive image frames according to the method An image frame, calculating a first velocity change value of the reference point at an imaging position of the continuous image frames; calculating the reference according to the second image frame and a third image frame in any three consecutive image frames a second velocity change value at an imaging position of the continuous image frames; and a difference between the first velocity change value and the second velocity change value Taking the acceleration change value of the reference point at the imaging position of the continuous image frames. 如申請專利範圍第12項所述的傾斜角度校正方法,其中該第一速度變化值的計算公式如下: 其中v 1表示該第一速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間;其中該第二速度變化值的計算公式如下: 其中v 2表示該第二速度變化值;表示該參考點於該第三影像框架的成像位置;表示該參考點於該第二影像框架的成像位置;t f3表示該第三影像框架的擷取時間;t f2表示該第二影像框架的擷取時間。 The tilt angle correction method according to claim 12, wherein the first speed change value is calculated as follows: Where v 1 represents the first speed change value; Representing the reference point of the imaging position of the second image frame; Indicates an imaging position of the reference image in the first image frame; t f 2 represents a capture time of the second image frame; t f 1 represents a capture time of the first image frame; wherein the second speed change value Calculated as follows: Where v 2 represents the second speed change value; Representing the reference point of the imaging position of the third image frame; Indicates the imaging position of the reference image in the second image frame; t f 3 represents the capturing time of the third image frame; t f 2 represents the capturing time of the second image frame. 一種手持式指向裝置,包括:一影像擷取單元,用以擷取對應一參考點位置的影像,並依序產生多個影像框架;一加速度單元,用以感測該手持式指向裝置於多軸向的多個加速度值,並產生一加速度向量;以及一處理單元,耦接該影像擷取單元以及該加速度單元,該處理單元並根據該些影像框架判斷該參考點是否大幅移動;其中當該處理單元判斷該參考點並未大幅移動時,讀取該加速度單元感測該手持式指向裝置於多軸產生的該些加速度值,以根據該些加速度值計算並更新該手持式指向裝置目前使用的一第一傾斜角度為一第二傾斜角度。 A handheld pointing device includes: an image capturing unit for capturing an image corresponding to a reference point position, and sequentially generating a plurality of image frames; and an acceleration unit for sensing the handheld pointing device a plurality of acceleration values in the axial direction, and generating an acceleration vector; and a processing unit coupled to the image capturing unit and the acceleration unit, the processing unit determining, according to the image frames, whether the reference point moves substantially; When the processing unit determines that the reference point does not move substantially, the reading the acceleration unit senses the acceleration values generated by the handheld pointing device on multiple axes, and calculates and updates the handheld pointing device according to the acceleration values. A first tilt angle used is a second tilt angle. 如申請專利範圍第15項所述的手持式指向裝置,其中當該處理單元判斷該參考點大幅移動時,該處理單元不更新該手持式指 向裝置目前使用的該第一傾斜角度,且利用該第一傾斜角度計算該參考點於該些影像框架之一的成像位置。 The hand-held pointing device of claim 15, wherein the processing unit does not update the hand-held finger when the processing unit determines that the reference point moves substantially To the first tilt angle currently used by the device, and using the first tilt angle to calculate an imaging position of the reference point to one of the image frames. 如申請專利範圍第15項所述的手持式指向裝置,其中該處理單元根據所擷取該些影像框架中的一第一影像框架與一第二影像框架計算該參考點在該第一影像框架與該第二影像框架的成像位置的一位移變化值,以根據該位移變化值判斷該參考點在該第一影像框架與該第二影像框架的成像位置是否大幅移動。 The hand-held pointing device of claim 15, wherein the processing unit calculates the reference point in the first image frame according to a first image frame and a second image frame captured in the image frames. And a displacement change value of the imaging position of the second image frame to determine whether the reference point is greatly moved at an imaging position of the first image frame and the second image frame according to the displacement change value. 如申請專利範圍第15項所述的手持式指向裝置,其中該處理單元根據所擷取該些影像框架中的一第一影像框架與一第二影像框架計算該參考點在該第一影像框架與該第二影像框架的成像位置的一速度變化值,以根據該速度變化值判斷該參考點在該第一影像框架與該第二影像框架的成像位置是否大幅移動。 The hand-held pointing device of claim 15, wherein the processing unit calculates the reference point in the first image frame according to a first image frame and a second image frame captured in the image frames. And a speed change value of the imaging position of the second image frame, to determine whether the reference point is greatly moved at an imaging position of the first image frame and the second image frame according to the speed change value. 如申請專利範圍第18項所述的手持式指向裝置,其中該處理單元是利用下列公式計算該速度變化值: 其中v表示該速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間。 The hand-held pointing device of claim 18, wherein the processing unit calculates the speed change value by using the following formula: Where v represents the speed change value; Representing the reference point of the imaging position of the second image frame; Indicates the imaging position of the reference image in the first image frame; t f 2 represents the capturing time of the second image frame; t f 1 represents the capturing time of the first image frame. 如申請專利範圍第15項所述的手持式指向裝置,其中該處理單元對該些影像框架中一第一影像框架與一第二影像框架進行演算,產生對應該參考點在該第一影像框架與該第二影像框架的成像位置的一第一速度變化值,該處理單元並對該些影像框架中該第二影像框架與一第三影像框架進行演算,產生對應該參考點在該第一影像框架與該第二影像框架的成像位置的一第二速度變化值;其中該處理單元計算該第一速度變化值與該第二速度變化值之間 的差值,獲得該參考點在該第一影像框架與該第二影像框架的成像位置的一加速度變化值,以根據該加速度變化值判斷該參考點的成像位置是否大幅移動。 The hand-held pointing device of claim 15, wherein the processing unit calculates a first image frame and a second image frame in the image frames to generate a corresponding reference point in the first image frame. And a first speed change value of the imaging position of the second image frame, the processing unit calculates the second image frame and the third image frame in the image frames, and generates a corresponding reference point at the first a second speed change value of the image frame and the image forming position of the second image frame; wherein the processing unit calculates the first speed change value and the second speed change value And a difference value of the acceleration of the reference image at the imaging position of the first image frame and the second image frame to determine whether the imaging position of the reference point is greatly moved according to the acceleration change value. 如申請專利範圍第20項所述的手持式指向裝置,其中該處理單元是利用下列公式計算該第一速度變化值, 其中v 1表示該第一速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間;其中該處理單元並利用下列公式計算該第二速度變化值, 其中v 2表示該第二速度變化值;表示該參考點於該第三影像框架的成像位置;表示該參考點於該第二影像框架的成像位置;t f3表示該第三影像框架的擷取時間;t f2表示該第二影像框架的擷取時間。 The hand-held pointing device of claim 20, wherein the processing unit calculates the first speed change value by using the following formula, Where v 1 represents the first speed change value; Representing the reference point of the imaging position of the second image frame; Representing the imaging position of the reference image in the first image frame; t f 2 indicating the capturing time of the second image frame; t f 1 indicating the capturing time of the first image frame; wherein the processing unit uses the following formula Calculating the second speed change value, Where v 2 represents the second speed change value; Representing the reference point of the imaging position of the third image frame; Indicates the imaging position of the reference image in the second image frame; t f 3 represents the capturing time of the third image frame; t f 2 represents the capturing time of the second image frame. 如申請專利範圍第15項所述的手持式指向裝置,其中該加速度單元為一加速度計或一重力感測器。 The hand-held pointing device of claim 15, wherein the acceleration unit is an accelerometer or a gravity sensor. 一種手持式指向裝置,包括:一影像擷取單元,用以擷取對應一參考點位置的影像,並依序產生多個影像框架;一加速度單元,用以感測該手持式指向裝置於多軸向的多個加速度值,並產生一加速度向量;以及一處理單元,耦接該影像擷取單元以及該加速度單元,該處理單元並根據該些影像框架中的任三個連續影像框架計算該參考點在該等連續影像框架的成像位置的一加速度變化值; 其中當該處理單元判斷該加速度變化值為零時,讀取該加速度單元感測該手持式指向裝置於多軸向產生的該些加速度值,以根據該些加速度值計算並更新該手持式指向裝置目前使用的一第一傾斜角度為一第二傾斜角度。 A handheld pointing device includes: an image capturing unit for capturing an image corresponding to a reference point position, and sequentially generating a plurality of image frames; and an acceleration unit for sensing the handheld pointing device a plurality of acceleration values in the axial direction and generating an acceleration vector; and a processing unit coupled to the image capturing unit and the acceleration unit, wherein the processing unit calculates the image according to any three consecutive image frames in the image frames An acceleration change value of the reference point at the imaging position of the continuous image frames; When the processing unit determines that the acceleration change value is zero, the reading the acceleration unit senses the acceleration values generated by the handheld pointing device in multiple axes to calculate and update the handheld pointing according to the acceleration values. A first tilt angle currently used by the device is a second tilt angle. 如申請專利範圍第23項所述的手持式指向裝置,其中當該處理單元判斷該加速度變化值為零時,該處理單元判斷該加速度向量的大小是否等於該手持式指向裝置的重力加速度值,且於該加速度向量的大小等於該手持式指向裝置的重力加速度值時,根據該些加速度值計算並更新該手持式指向裝置目前使用的該第一傾斜角度為該第二傾斜角度。 The hand-held pointing device of claim 23, wherein when the processing unit determines that the acceleration change value is zero, the processing unit determines whether the magnitude of the acceleration vector is equal to a gravity acceleration value of the handheld pointing device, And when the magnitude of the acceleration vector is equal to the gravity acceleration value of the handheld pointing device, the first tilt angle currently used by the handheld pointing device is calculated and updated according to the acceleration values as the second tilt angle. 如申請專利範圍第23項所述的手持式指向裝置,其中該處理單元對擷取的任三個連續影像框架中的一第一影像框架與一第二影像框架進行演算,產生對應該參考點在該第一影像框架與該第二影像框架的成像位置的一第一速度變化值,該處理單元並對擷取的該些影像框架中該第二影像框架與一第三影像框架進行演算,產生對應該參考點在該第二影像框架與該第三影像框架的成像位置的一第二速度變化值;其中該處理單元計算該第一速度變化值與該第二速度變化值之間的差值,獲得該參考點在該第一影像框架與該第三影像框架的成像位置的該加速度變化值。 The hand-held pointing device of claim 23, wherein the processing unit calculates a first image frame and a second image frame of any three consecutive image frames captured to generate a corresponding reference point. And processing, by the processing unit, the second image frame and the third image frame in the image frames captured by the first image frame and the image frame of the second image frame, Generating a second speed change value corresponding to the imaging position of the second image frame and the third image frame; wherein the processing unit calculates a difference between the first speed change value and the second speed change value And obtaining the acceleration change value of the reference point at the imaging position of the first image frame and the third image frame. 如申請專利範圍第25項所述的手持式指向裝置,其中該處理單元是利用下列公式計算該第一速度變化值, 其中v 1表示該第一速度變化值;表示該參考點於該第二影像框架的成像位置;表示該參考點於該第一影像框架的成像位置;t f2表示該第二影像框架的擷取時間;t f1表示該第一影像框架的擷取時間;其中該處理單元並利用下列公式計算該第二速度變化值, 其中v 2表示該第二速度變化值;表示該參考點於該第三影像框架的成像位置;表示該參考點於該第二影像框架的成像位置;t f3表示該第三影像框架的擷取時間;t f2表示該第二影像框架的擷取時間。 The hand-held pointing device of claim 25, wherein the processing unit calculates the first speed change value by using the following formula, Where v 1 represents the first speed change value; Representing the reference point of the imaging position of the second image frame; Representing the imaging position of the reference image in the first image frame; t f 2 indicating the capturing time of the second image frame; t f 1 indicating the capturing time of the first image frame; wherein the processing unit uses the following formula Calculating the second speed change value, Where v 2 represents the second speed change value; Representing the reference point of the imaging position of the third image frame; Indicates the imaging position of the reference image in the second image frame; t f 3 represents the capturing time of the third image frame; t f 2 represents the capturing time of the second image frame. 如申請專利範圍第23項所述的手持式指向裝置,其中該加速度單元為一加速度計或一重力感測器。 The hand-held pointing device of claim 23, wherein the acceleration unit is an accelerometer or a gravity sensor. 如申請專利範圍第23項所述的手持式指向裝置,其中當該處理單元判斷該參考點在該等連續影像框架的成像位置的該加速度變化值超過一預設加速度閥值時,該處理單元不更新該手持式指向裝置目前使用的該第一傾斜角度,且利用該第一傾斜角度計算該參考點於該些影像框架之一的位置。 The hand-held pointing device of claim 23, wherein the processing unit determines that the acceleration change value of the reference point in the imaging position of the continuous image frames exceeds a predetermined acceleration threshold when the processing unit determines The first tilt angle currently used by the handheld pointing device is not updated, and the position of the reference point to one of the image frames is calculated using the first tilt angle.
TW102118058A 2013-02-19 2013-05-22 Handheld pointer device and tilt angle adjustment method thereof TW201445359A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
TW102118058A TW201445359A (en) 2013-05-22 2013-05-22 Handheld pointer device and tilt angle adjustment method thereof
US14/273,523 US10067576B2 (en) 2013-02-19 2014-05-08 Handheld pointer device and tilt angle adjustment method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW102118058A TW201445359A (en) 2013-05-22 2013-05-22 Handheld pointer device and tilt angle adjustment method thereof

Publications (1)

Publication Number Publication Date
TW201445359A true TW201445359A (en) 2014-12-01

Family

ID=52707066

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102118058A TW201445359A (en) 2013-02-19 2013-05-22 Handheld pointer device and tilt angle adjustment method thereof

Country Status (1)

Country Link
TW (1) TW201445359A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI547788B (en) * 2014-11-14 2016-09-01 緯創資通股份有限公司 Electronic device and gravity sensing calibration method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI547788B (en) * 2014-11-14 2016-09-01 緯創資通股份有限公司 Electronic device and gravity sensing calibration method thereof

Similar Documents

Publication Publication Date Title
JP7326328B2 (en) Power Management for Optical Position Tracking Devices
US8237656B2 (en) Multi-axis motion-based remote control
US20100201808A1 (en) Camera based motion sensing system
US9086724B2 (en) Display control system, display control method, computer-readable storage medium having stored thereon display control program, and display control apparatus
CN107754310B (en) Handheld device and positioning method thereof
US9804689B2 (en) Handheld pointer device and pointer positioning method thereof
US11443540B2 (en) Information processing apparatus and information processing method
US11029753B2 (en) Human computer interaction system and human computer interaction method
US10067576B2 (en) Handheld pointer device and tilt angle adjustment method thereof
JP5766956B2 (en) Gesture input device
US10948978B2 (en) Virtual object operating system and virtual object operating method
US9126110B2 (en) Control device, control method, and program for moving position of target in response to input operation
EP3032380B1 (en) Image projection apparatus, and system employing interactive input-output capability
TW201445359A (en) Handheld pointer device and tilt angle adjustment method thereof
TWI522848B (en) Pointer device and pointer positioning method thereof
JP2003280813A (en) Pointing device, pointer controller, pointer control method and recording medium with the method recorded thereon
US20140132787A1 (en) Motion Detection Device and Motion Detection Method Having Rotation Calibration Function
JP6500159B1 (en) Program, information processing apparatus, information processing system, information processing method, and head mounted display
US9354706B2 (en) Storage medium having stored therein information processing program, information processing apparatus, information processing system, and method of calculating designated position
WO2017163647A1 (en) Head-mounted device
WO2021256310A1 (en) Information processing device, terminal device, information processing system, information processing method, and program
US11061469B2 (en) Head mounted display system and rotation center correcting method thereof
CN104216532B (en) Hand-held indicator device and its angle of inclination bearing calibration
EP3813018A1 (en) Virtual object operating system and virtual object operating method
JP6666121B2 (en) Information processing system, information processing apparatus, information processing method, and information processing program