5 5 經濟央標準局員工消費合作社印製 46 643 8 A7 B7 ------------- 五、發明説明（1 ) 本案是一種無實體滑鼠的電腦搡作，特别是藉著手产 或其他適當物品在攝影區内的影像’來操作電腦的構成方 法。 現有的電腦已普遍配設有一滑鼠，來控制勞幕上游押 的移動，並藉滑鼠上的按鍵(click)來選擇或執行工作。^ 有的滑鼠是藉一滾珠對應的(ΔΧ，ΔΥ)値來控制游標，由於 大量生產的關係，使價格相當便宜，但是對電腦工作者帶 來的手腕及手局部疲勞及職業性傷害，已逐漸廣泛且嚴 重，因此一種更斩的更符合人體工學的滑鼠有待開發。（ 曾有人企圖設計一種輸入攝影的訊息來控制電腦系統 的方法，該方法必須設定而且辨識整個手或特殊的發光筆 的形狀，並且藉著特製發光筆上的按鍵或傳統的鍵盤，來 執行傳統滑鼠上按鍵(click)的任務。構成的元件包括特製 的發支筆、聽器、影後靜虛.fgt路·、影像分離電路、 微處_、識乂分析、11蹤_電给、及程式括伞丨等， 將視頻訊號(VIDEO SIGNAL)在電腦外處理分析至類似滑 鼠輸出之信號至電腦，該轉捧哭分違作須：k—哥-計可、儲身 功能甚至超過主機電腦，故運作钂慢無法快±羡峰伸用者 且成本非常昂青故不Xf施推屠V JL在操作中，需藉著特 製的筆，而且手的變換，仍不符人體工學之 需I，最重ϋ按鍵選定功能更是沒有合理、方便之方法。 本案之目的，首先在提供一種不需實體滑鼠的手勢滑 鼠構成方法1 本案之谁一□的，在提供不需使用額I雪技戒電 本紙張尺度適用中國國家標準（CNS ) A4規格（2l〇X；Z97公釐） ί請先g-讀背Φ之注意事項再填焉木頁> 訂. 466438 A7 ----------B7_ 五、發明説明（2 ) - 的手勢滑氧樺忐贪达。 本案的又一目的’在提供一種只需藉著手的影像而不 需藉其他物品，即可達成一般滑鼠功效的方法。 5 ο 1 < 爲達到上述目的，本案係利用攝影器就攝影區内背景 上相开於着景且具指向功能的物品，譬如是手在電腦系統 中，设定：（1)該物品影像中的最大γ値之點爲游標，（2)最 大X値之點爲按鍵，（3)以所設定的游標及按鍵爲中心，各 設足一取像小範圍，以及(4)以所設定的游標及按键二座標 點之間，疼早位骑間内戒過設定允,維秦的距離改變狀凝, 鍵點之移動超過詁余仿_，按 鍵之動作。攝影器所攝取的影像由數位影像輸出端直接輸 出，或絰由類比/數位轉換器（卡）後輸入電腦進行如同滑鼠 般的演算及控制。 在攝影的背景區域中的物品影像可以隨機重新建立， 因此無論是手，或握持著筆的手，或其他可產生動作的物 时，背可滿足本案之需求。無論是任何影像皆是取兩個座 標値，如物件去緣相對以及物品外側緣相對的 經濟央標準局貝工消费合作社印製 亦可加或滅旦J來玆佘太同气产少庙直系。 (圖式之簡單説明） 茲以附圖説明本案之較佳實施例。 第1圖是應用本案之方珐操作電腦之示意圖。 第2圖疋本案以手的形狀建立游標點與按鍵點之示意圖。 第3圖是第2圖中擷取游標點八與按鍵點6的座標値之 説明圖。 ~ 3 - 本紙張尺度適用中國國家標牟（CNS ) A4規格（2丨~~ ------： 5 ο 11 5 1* 經濟央標準局員工消費合作社印製 A7 B7 五、發明説明（3 ) 第4圖類似於第3圖，但擷取之按鍵點B的座標値不同。 第5圖類似於圖3 ’但顯示傾斜0角，或使用不同手指之例。 第6圖顯示以手握持著筆時擷取A與B點之説明圖。 第7圖是本案方法之流程圖。 第8圖是本案之構成方塊圖，顯示應用影像輸出之攝影機。 第9圖類似於第8圖’但顯示數位訊號攝影機實施例。 第10圖顯示相對游標指向方式應用例，其動作如滑鼠。 第11圖顯示絶對游標指向方式應用例，其動作如數位板。 第12圖是應用本案之演算方法配合硬體實施例的方塊圖。 (主要元件代號） 1--勞幕11”游標符號I2—按鍵符號2--攝影器 3- -電腦 31--界面卡 32—輸入端 4- -資料檔 5--區域背景 6- -手 61—食指 62-姆指 63--中指 7- -筆 81-週邊或元件之驅動程式 82--應用或環境程式 83--影像處理電路 84--微處理器單元 85--圖場記憶體 86--滑鼠介面 如圖1所示’可以在電腦之螢幕（1)上緣装設一攝影器 (2)，該攝影器可應用目前各種形式的攝影機如第8圖所 示，攝影器(2)所輸出的是影像訊號，經影像捕獲界面卡 (VIDEO CAPTURE CARD)(31)後才輸入電腦(3)中，並輸出 對應於影像資料檔(IMAGE DATA FILE)(4)。第9圖則顯示 攝影器(2)直接輸出數位訊號，如COM，USB等模式，至電 月番(3)之數位訊號輸入端(32)，如COM，USB等，然後也是 -4- ---------—裳-- 一 - ' <請先閲讀背面之注意事項再填寫本頁)5 5 Printed by the Consumers' Cooperative of the Central Economic Standards Bureau 46 643 8 A7 B7 ------------- V. Description of the invention (1) This case is a computer operation without a physical mouse, especially A method of operating a computer based on images of handicrafts or other appropriate items in the photographic area. Existing computers have been generally equipped with a mouse to control the movement of the barrage, and to select or perform tasks by clicking on the mouse. ^ Some mice control the cursor by a ball corresponding to (ΔX, ΔΥ) 値. Due to mass production, the price is quite cheap, but the wrist and local fatigue and occupational injuries caused by computer workers, It has gradually become widespread and serious, so a more chopped and more ergonomic mouse needs to be developed. (There have been attempts to design a method of inputting photographic information to control a computer system. This method must set and recognize the shape of the entire hand or a special light pen, and perform the traditional by using the keys on a special light pen or a traditional keyboard. The task of clicking on the mouse. The components include a special hair pen, a hearing device, a quiet after-image. Fgt road, an image separation circuit, a micro office, an analysis, 11 traces, electricity, And programs including umbrellas, etc., processing and analyzing the video signal (VIDEO SIGNAL) outside the computer to a signal similar to the output of a mouse to the computer, the transfer of crying points is against the rules: k- brother-meter, storage function even exceeds Mainframe computer, so slow operation can not be fast ± Xianfeng stretches users and the cost is very high, so Xf does not push and push V JL In operation, a special pen is needed, and the hand conversion is still inconsistent with ergonomics Need I, there is no reasonable and convenient way to select the function of the most important button. The purpose of this case is to first provide a gesture mouse that does not require a physical mouse. 1 Whoever in this case does not need to use it Forehead snow skills Please note that the paper size of this paper applies the Chinese National Standard (CNS) A4 specification (2l0X; Z97 mm). Please note the g-reading Φ before filling in the rafter page ℴ 466438 A7 ----- ----- B7_ V. Description of the invention (2)-Gesture slippery oxygen. Another purpose of this case is to provide an image that only needs to be obtained by hand without borrowing other items to achieve general slippage. 5 ο 1 < In order to achieve the above purpose, this case is to use a camera on the background of the photographic area and the object with a pointing function, such as a hand in a computer system, set: ( 1) The maximum point of γ 値 in the image of the item is the cursor, (2) the point of maximum X 値 is the button, (3) the set cursor and button are used as the center, and each has a small image acquisition range, and ( 4) With the set cursor and the two coordinate points of the button, it is easy to quit the setting in the riding position in the early position, the distance of Wei Qin changes, the movement of the key point exceeds 诂 仿, the action of the button. Camera The captured image is directly output by the digital image output terminal, or is input by the analog / digital converter (card). Perform calculations and controls like a mouse. The image of the objects in the background area of the photography can be re-established randomly, so whether it is a hand, a hand holding a pen, or other objects that can generate motion, the back can meet the requirements of this case. Needs. Any image is taken from two coordinates, such as printed by the Central Bureau of Economics and Standards Co., Ltd., which is printed by the Central Bureau of Economics and Standards, and can also be added or destroyed. (Simplified description of the drawings) The preferred embodiment of this case will be described with the drawings. Figure 1 is a schematic diagram of the operation of a computer using the square enamel. Figure 2 疋 This case uses the shape of a hand to establish the cursor and key points Fig. 3 is an explanatory diagram of the coordinates 値 of cursor point eight and button point 6 in Fig. 2. ~ 3-This paper size applies to China National Standards (CNS) A4 specifications (2 丨 ~~ ------: 5 ο 11 5 1 * Printed by A7 B7, Consumer Cooperatives of the Central Bureau of Economic Standards. 5. Description of the invention ( 3) Figure 4 is similar to Figure 3, but the coordinates 撷 of the captured key point B are different. Figure 5 is similar to Figure 3 'but shows an example of a tilted 0 angle or using different fingers. Figure 6 shows the hand An illustration of capturing points A and B while holding the pen. Figure 7 is a flowchart of the method in this case. Figure 8 is a block diagram of this case, showing a camera that uses image output. Figure 9 is similar to Figure 8 ' However, an example of a digital camera is shown. Figure 10 shows an application example of the relative cursor pointing method, whose action is like a mouse. Figure 11 shows an application example of the absolute cursor pointing method, whose action is like a digital tablet. Figure 12 shows the calculation applied in this case. The method matches the block diagram of the hardware embodiment. (Code of main components) 1--Labor 11 ”cursor symbol I2—Key symbol 2--Camera 3--Computer 31--Interface card 32--Input terminal 4--Information Gear 5--area background 6--hand 61-index finger 62-thumb 63-middle finger 7--pen 81-peripheral or Driver program 82--application or environment program 83--image processing circuit 84--microprocessor unit 85--field memory 86--mouse interface as shown in Figure 1 'can be on the computer screen (1 A camera (2) is installed on the upper edge of the camera. The camera can be used with various types of cameras. As shown in Figure 8, the camera (2) outputs the image signal and passes the video capture interface card (VIDEO CAPTURE CARD). ) (31), then input it into the computer (3), and output the image data file (IMAGE DATA FILE) (4). Figure 9 shows the camera (2) directly output digital signals, such as COM, USB and other modes , To the digital signal input terminal (32) of Dianyuefan (3), such as COM, USB, etc., and then also -4- ----------- Shang-- one-'< Please read the back (Notes for filling in this page)
1T 本紙張尺度適用中國國家標準（CNS ) A4規格（210X297公釐） 4664381T This paper size applies to China National Standard (CNS) A4 (210X297 mm) 466438
A7 I "* ' ： ——___ B7 五、發明説明（4 ) 輸出對應之影像資料檔(4)。該資料檔(4)可進一步驅動程式 (81)，以及應用或環境程式（82)。 5 5 1 回顧圖1，進人攝影背景區域（5)内之物品，譬如是手 (6) ’或如圖6示持著筆的手，都會成爲攝取的影像藉著該 等影像構成無實體性滑鼠功能的方法，較佳地是包括以下 步驟：（a)以攝影器攝取參考背景之影像並建立其參數；（b) 如圖2與3所示，撷取相異於背景影像中之侵入影像，譬如 是手’的Y最大正値之點設爲游標A點，且以該A點爲中心 建立允許移動區RA，該區域可以設成圓形或方形，或其他 任何形狀，並最好是能於螢幕上顯示一游標符號（11);而 且（c)擷取影像中的X最大負値之點設爲按鍵b點，且以該b 點爲中心建立元許移動區RB，並最好是能於螢幕上顯示— 按鍵(click)符號（12);然後(d)最好是在單位時間τ中，建立 A點與B點之間的距離變化臨界値AAB，且（e)當A點與氏點 間的相對位置改變量大於AAB時，產生一個按鍵訊號 (click)，並最好在螢幕上顯示按鍵壓入之動作（on)及發 聲。 經濟央橾準局*:工消費合作杜印製A7 I " * ': ——___ B7 5. Invention description (4) Output the corresponding image data file (4). The data file (4) can further drive programs (81), as well as applications or environmental programs (82). 5 5 1 Looking back at Figure 1, objects that enter the background area (5) of a person's photography, such as the hand (6) 'or the hand holding a pen as shown in Figure 6, will become captured images. These images constitute non-substance. The method of mouse function preferably includes the following steps: (a) capturing a reference background image with a camera and establishing its parameters; (b) as shown in Figs. 2 and 3, capturing a difference from the background image Intrusion image, for example, the point of the largest positive point of Y of the hand 'is set as the cursor A point, and the permitted movement area RA is established around the A point. Fortunately, a cursor symbol (11) can be displayed on the screen; and (c) the point where the maximum negative value of X in the captured image is set as the button b point, and the Yuan Xu moving area RB is established with the b point as the center, and It is best to be displayed on the screen—click the symbol (12); then (d) it is best to establish the critical distance change point 値 AAB between point A and point B in unit time τ, and (e) When the relative position change between the A point and the Shi point is greater than AAB, a click is generated, and it is best to be on the screen Illustrates the operation button pressed (on) and the sound generation. Economic Central Bureau of quasi-government *: printed by industrial and consumer cooperation
n-l^i f - I is..... n 1 - D I _ n n T ' 、T (請先聞讀背面之注$項再填寫本頁) 以手形的影像爲例，是任取其中兩指之邊緣爲A及B 點’較佳地是取食指（61)的上緣爲YMAX，取拇指（62)的外側 緣爲xmax。圖3中顯示在習慣使用右手者，ΧΜΑχ是負値， 而在圖4中使用左手時，χΜΛχ是正値。第5圖則顯示可設定 —傾斜Θ角的座標系狀態，是以傾斜之座標系，藉相同之方 法取A，Β點之座標値。且顯示亦可以最長的中指（63)之 上緣爲ΥΜΑχ。 第6圖中1以相同的方式，可以取筆（7)的尖 -5- """ 说尺度用中關家棣準（cns )八4鄕_ (2似π7公董） 5 ο Λί 5 1 經濟央標隼局貝工消費合作社印装nl ^ if-I is ..... n 1-DI _ nn T ', T (please read the note on the back and fill in this page first) Take the hand-shaped image as an example. The edges are points A and B. Preferably, the upper edge of the index finger (61) is YMAX, and the outer edge of the thumb (62) is xmax. Fig. 3 shows that in the right-handed person, χΜχ is negative 値, and when using the left hand in Fig. 4, χΜΛχ is positive 値. Figure 5 shows the state of the coordinate system that can be set to the angle of inclination Θ. Based on the coordinate system of inclination, the coordinates 点 of points A and B can be obtained by the same method. The upper edge of the middle finger (63), which is also shown to be the longest, is ΥΜΑχ. In Figure 6, 1 is the same way, you can take the tip of the pen (7) -5- " " " Say that the scale is used in Zhongguanjia 棣 quasi (cns) eight 4 鄕 _ (2 like π7 公 董) 5 ο Λί 5 1 Printed by Shellfish Consumer Cooperative, Central Bureau of Economic Standards
46 643 B A7 B7 五、發明説明（5 )46 643 B A7 B7 V. Description of the invention (5)
上緣爲ΥΜΑχ。 、衣案控制之流程，其中-較佳之例如圖7所示。首先， 方塊㈤是攝取參考料之影像，並建立_程式與 Ρ3景心像：參冑再將背景中之影像相異之數位訊號⑽ 輸入驅動。„中在此之^最好先判別異物影像之單位點群 疋否已超過’叛後在方塊(73)中以異物影像之最大γ 値設爲游標Α點⑺），同時以影像之最大χ値設爲職按齡 點；接著’在方塊(74)中建立監測區依A點及B點建立（最好 是在羊位㈣巾）兩點啦檩改變之動就許値δαβ/τ(75)。 若A’ Β兩點間動作値大於ΔΑΒ/τ(ΔΙ<Κί)，爲按鍵動作， 輸出訊號(77)及聲音’並最好以圖像顯示，但當么而>^時 則重新建游標。當Αϋ移動且不超過監難時（其單位移 動量<K2)則移動游標(75)。當a點越過監測區（其單位移勤量 >Κ2)則重新建立游標。 本案的提供可讓操作者不必握持實體的滑鼠亦不必固 定在一個區域操作’且可隨機攝取在背景區域(5)中的形象 並重新建立程序，使手的姿勢和位置可輕鬆變化而不致僵 硬產生不適感。本案並且是擷取判讀以八及8點座標爲中心 的小範圍之圖形資料，來做爲處理之對象，因此處理之速 度可以非常快速’相對於硬體設備的需求亦極簡化而低 廉。Α點不動時以β(姆指）移動模擬壓按鍵(click)開關，非常 合人體工學及輕鬆，不像習有滑鼠之伸直指頭並下壓費 力。 第10圖顯示本案可應用座標相對値之方式，建立游標A 6- 本紙張尺度適用t國國家榡準（CNS ) A4规格（210X297公釐） I ί— I ^裝 — 訂 絲 (請先閱讀背面之注$項再填寫本頁) 4 6 6 4-38 5 10 15 A7 B7 五、發明説明（6 ) 點（ΔΧ，ΔΥ)，如同傳統滑鼠的模式（Mouse Mode);當然也 可如第U圖一樣，如傳统數位板的模式（Digital Table Mode)，以座標絶對値來建立游標A點(@X，@Y)。 再者’如圖I2所示的其中一種實施例顯示，本案演算 之方法可藉簡單的電路來實施，將攝影器所取之類比或數 位訊號’經影像處理路（83)送至微處理單元（84)，圖像訊 號送至圖場記憶體（85)中儲存比較，並隨著A，Β點移動之. 情形，產生ΔΧ，AY値或@χ，@丫値，形成啓動或按壓動作 由滑鼠介面（86)送給電腦，此是一種與現有電腦最能匹配的 一種實施例。由上所述可知，依本索的方法藉硬體電路所 實施的手段亦屬本案專利範圍所保護者。 本發明上述之説明呈現一些實用之較佳實施例，以具 體表明本發明技術手段的實施性，但可瞭解的是，熟悉此 藝者若依上述實施例做型式或細節的變異，將仍未脱離本 發明之精神與範圍。 —---；------!. 钉 〈請先閲讀背面之注意事項再填寫本頁」 絲· 經濟部中央標準局屬工消費合作社印製 紐The upper edge is ΥΜΑχ. The process of clothing case control, among which-a preferred example is shown in FIG. 7. First of all, the box 摄取 is to capture the image of the reference material, and create a _program and P3 scene heart image: the reference signal is then driven by the digital signal that is different from the image in the background. „In this ^, it is best to first determine whether the unit point group of the foreign object image has exceeded 'After the betrayal, the maximum gamma image of the foreign object image in the block (73) is set as the cursor A point ⑺), and at the same time the maximum image x値 Set as the age-based point; then, in the block (74), set up a monitoring area based on points A and B (preferably at the sheep's position). The change will allow δαβ / τ ( 75). If the action between two points of A'B is greater than ΔΑΒ / τ (ΔΙ < Κί), it is a keystroke action, output signal (77) and sound 'and it is best to display it as an image, but when > ^ The cursor is rebuilt. When Αϋ moves and does not exceed the prison (its unit movement amount < K2), it moves the cursor (75). When point a crosses the monitoring area (its unit movement amount > Κ2), it rebuilds the cursor. The provision of this case allows the operator not to hold the physical mouse or fixed to operate in one area ', and can randomly capture the image in the background area (5) and re-establish the program, so that the hand posture and position can be easily changed Without causing discomfort due to stiffness. This case is also an example of extracting and interpreting a small area centered on the eight and eight o'clock coordinates. Shape data is used as the processing object, so the processing speed can be very fast. Compared with the requirements of hardware equipment, it is extremely simplified and cheap. When the A point is not moved, the β (thumb finger) is used to move the analog push button (click) switch. Very ergonomic and easy, unlike the straight mouse that has been used to straighten your fingers and press down. Figure 10 shows that this case can be used to set the cursor A. 6- This paper scale is applicable to national standards (CNS) A4 specification (210X297 mm) I ί— I ^ installed—stitch (please read the note on the back before filling this page) 4 6 6 4-38 5 10 15 A7 B7 V. Description of the invention (6 ) Points (ΔX, ΔΥ), just like the traditional mouse mode (Mouse Mode); of course, as shown in Figure U, such as the traditional digital tablet mode (Digital Table Mode), the coordinates of the cursor A point (absolute 値) ( @ X ， @ Y). Furthermore, as shown in one of the embodiments shown in Figure I2, the calculation method of this case can be implemented by a simple circuit, and the analog or digital signal obtained by the camera is processed by the image processing circuit ( 83) Send to the micro processing unit (84), the image signal is sent to the field record The comparison is stored in the body (85), and it moves with points A and B. In the case, Δχ, AY 値 or @ χ, @ 丫 値 is generated, and a start or press action is sent to the computer by the mouse interface (86). It is an embodiment that can best match the existing computer. From the above, it can be known that the method implemented by the hardware circuit according to the method of Benso is also protected by the scope of this patent. The above description of the present invention presents some practical applications. The preferred embodiment specifically illustrates the practicality of the technical means of the present invention, but it can be understood that those skilled in the art who make variations in types or details according to the above embodiments will still not depart from the spirit and scope of the present invention. —---; ------ !. Nail 〈Please read the precautions on the back before filling in this page】 Silk · Printed by the Central Consumer Bureau of the Ministry of Economy
i用 'M 準 # ί家 |國 I釐 公 7 9 2 1i use 'M # # ί 家 | Country I Li 7 7 2 1