TW201313280A - Human-machine interactive approach through visually fingers touch - Google Patents
Human-machine interactive approach through visually fingers touch Download PDFInfo
- Publication number
- TW201313280A TW201313280A TW100134155A TW100134155A TW201313280A TW 201313280 A TW201313280 A TW 201313280A TW 100134155 A TW100134155 A TW 100134155A TW 100134155 A TW100134155 A TW 100134155A TW 201313280 A TW201313280 A TW 201313280A
- Authority
- TW
- Taiwan
- Prior art keywords
- game
- virtual
- touch
- human
- character
- Prior art date
Links
Abstract
Description
本發明涉及一種使遊戲玩家與遊戲機產生人機互動的方法,特別是一種使遊戲玩家透過手指與遊戲機中的虛擬角色肢體或手指接觸產生視覺上人機互動的方法。The present invention relates to a method for causing a game player to interact with a game machine, in particular, a method for causing a game player to interact with a virtual character's limb or finger in a game machine to create visual human-computer interaction.
如圖1所示,現有技術的遊戲機10,透過設定的遊戲邏輯、人工智慧邏輯或資料庫等,皆提供遊戲玩家50與遊戲機10中的虛擬角色扮演能夠產生間接式的人機互動模式。As shown in FIG. 1, the prior art gaming machine 10 provides an indirect human-computer interaction mode between the game player 50 and the virtual role playing in the gaming machine 10 through the set game logic, artificial intelligence logic or database. .
但,遊戲玩家50透過手指51操控遊戲機10的操縱介面11,例如操縱遊戲機10的鍵盤、滑鼠、按鍵或操縱桿,甚至是操縱遊戲機10的觸控螢幕15等,只能實現與遊戲機10中的虛擬角色60之間產生機械式刻板互動,在視覺感受上,總是缺少直接接觸虛擬角色60的肢體例如手指61的蕩漾感覺。However, the game player 50 manipulates the manipulation interface 11 of the game machine 10 through the finger 51, for example, manipulating the keyboard, the mouse, the button or the joystick of the game machine 10, or even the touch screen 15 of the game machine 10, etc. A mechanical stereotype interaction occurs between the virtual characters 60 in the gaming machine 10, and in the visual sense, there is always a lack of swaying feeling of the limbs such as the fingers 61 that directly contact the virtual character 60.
有鑑於此,本發明揭示一種透過手指接觸產生視覺上人機互動的方法,在視覺感受上,可以實現遊戲玩家與遊戲機中的虛擬角色產生肢體上的直接觸碰互動,令遊戲玩家有心神蕩漾的感覺。In view of this, the present invention discloses a method for generating visual human-computer interaction through finger contact. In visual perception, a direct contact interaction between a game player and a virtual character in a game machine can be realized, so that the game player has a heart. The feeling of rippling.
本發明的一種透過手指接觸產生視覺上人機互動的方法,包括以下步驟:A method for generating visual human-computer interaction through finger contact according to the present invention comprises the following steps:
a)以一種2D遊戲機、3D遊戲機或RPG遊戲機的觸控螢幕為人機介面;且所述觸控螢幕包括一觸控模組及一遊戲視窗;a) a touch screen of a 2D game machine, a 3D game machine or an RPG game machine; and the touch screen includes a touch module and a game window;
b)在遊戲視窗中出現虛擬角色且依照軟體程式編設邏輯表演;b) a virtual character appears in the game window and a logical performance is programmed according to the software program;
c)檢視虛擬角色的表演時間是否到達軟體程式編設邏輯的人機互動時段;c) checking whether the performance time of the virtual character reaches the human-computer interaction time of the software programming logic;
如果否,續繼執行步驟b);如果是,執行步驟d);If not, continue to perform step b); if yes, perform step d);
d)檢視遊戲玩家的手指是否點擊觸控螢幕的觸控模組及產生輸入訊號座標;如果否,執行步驟g);如果是,執行步驟e);d) checking whether the finger of the game player clicks on the touch module of the touch screen and generates an input signal coordinate; if not, executing step g); if yes, executing step e);
e)校正觸控模組的輸入訊號座標,且將之換算為對應遊戲視窗的第一座標;同步擷取虛擬實境中的虛擬角色的肢體或手指座標,且將之換算為映射至遊戲視窗的第二座標;e) correcting the input signal coordinates of the touch module and converting it into the first coordinate of the corresponding game window; synchronously capturing the limb or finger coordinates of the virtual character in the virtual reality and converting it to map to the game window Second coordinate
f)檢視遊戲視窗的第一座標與第二座標的相對位置是否落入軟體程式編設的誤差值範圍內;如果否,續繼執行步驟g);如果是,執行步驟h);f) checking whether the relative position of the first coordinate and the second coordinate of the game window falls within the error value range of the software programming; if not, the step g) is continued; if yes, step h);
g)虛擬角色的表情或肢體動作,依照軟體程式編設邏輯變化為失望、沮喪或生氣的負向表情表演;續繼執行步驟b);g) the expression or physical movement of the virtual character, according to the software program to change the logical change to a disappointing, frustrated or angry negative expression performance; continue to perform step b);
h)虛擬角色的表情或肢體動作,依照軟體程式編設邏輯變化為肢體語言變化為開心、喜悅或害羞等正向表情表演;視覺上,玩家的手指與虛擬角色的肢體或手指產生直接接觸效果;續繼執行步驟b)。h) The expression or physical movement of the virtual character, according to the software program to change the logic to change the body language into positive expressions such as happiness, joy or shyness; visually, the player's finger has direct contact with the virtual character's limb or finger. ; Continue to perform step b).
如圖2所示,本發明所揭示的一種透過手指接觸產生視覺上人機互動的方法(以下簡稱視覺上人機直接互動方法),是應用於2D遊戲機、3D遊戲機或RPG遊戲機(Role-Playing Game角色扮演遊戲機)等遊戲機10,且透過軟體程式編設的遊戲邏輯、人工智慧邏輯或資料庫等(以下通稱為軟體程式編設邏輯),可以提供遊戲玩家50的手指51與遊戲機10中的虛擬角色60的肢體例如手指61產生視覺上直接接觸,而達到視覺上人機直接互動的效果。As shown in FIG. 2, a method for generating visual human-computer interaction through finger contact (hereinafter referred to as visual human-machine direct interaction method) disclosed in the present invention is applied to a 2D game machine, a 3D game machine or an RPG game machine ( A game player 10 such as a Role-Playing Game (playing game) can provide a finger 51 of the game player 50 through game logic, artificial intelligence logic or a database (hereinafter referred to as software programming logic) programmed by the software program. A visual direct contact with a limb such as a finger 61 of the virtual character 60 in the gaming machine 10 achieves an effect of visually interacting directly with the human-machine.
如圖2及圖3所示,本發明的視覺上人機直接互動方法,是以遊戲機10的觸控螢幕15當作人機介面,配合軟體程式編設邏輯的遊戲企劃與腳本,在遊戲中的某些時間點或節奏點(以下通稱為人機互動時段),遊戲玩家50的手指51點擊觸控螢幕15上的設定位置時,遊戲中的虛擬角色60的肢體或手指61(在視覺上)會同時點擊該位置;在視覺上,宛如遊戲玩家50的手指51與遊戲中的虛擬角色60的手指61在觸控螢幕15上做即時觸碰;而且,觸碰後,依照軟體程式編設邏輯的設計,虛擬角色60會有直接動作或表情的反應,對遊戲玩家50來說,就像是與虛擬角色60直接接觸一般。As shown in FIG. 2 and FIG. 3, the visual human-machine direct interaction method of the present invention is that the touch screen 15 of the game machine 10 is used as a human-machine interface, and the game programming and scripts of the software programming logic are used in the game. Certain time points or rhythm points (hereinafter generally referred to as human-computer interaction periods), when the finger 51 of the game player 50 clicks on the set position on the touch screen 15, the limb or finger 61 of the virtual character 60 in the game (in the visual Up) click on the location; visually, the finger 51 of the game player 50 and the finger 61 of the virtual character 60 in the game make an instant touch on the touch screen 15; and, after the touch, according to the software program With a logical design, the virtual character 60 has a direct action or an expression response, which is like a direct contact with the virtual character 60 for the game player 50.
如圖3至圖5所示,所述遊戲機10的觸控螢幕15,包括一觸控模組20及一遊戲視窗30;當遊戲玩家50的手指51點擊觸控螢幕15上的設定位置時,觸控模組20接受點擊產生輸入訊號座標,在技術上,遊戲機10的微處理器(micro processor)將校正觸控模組20的輸入訊號座標,且將之換算為對應遊戲視窗30的第一座標31。As shown in FIG. 3 to FIG. 5, the touch screen 15 of the gaming machine 10 includes a touch module 20 and a game window 30; when the finger 51 of the game player 50 clicks on the set position on the touch screen 15 The touch module 20 receives the click to generate the input signal coordinates. Technically, the micro processor of the game machine 10 corrects the input signal coordinates of the touch module 20 and converts it into the corresponding game window 30. The first standard is 31.
同時,出現在遊戲視窗30中依照軟體程式編設邏輯進行虛擬實境表演的虛擬角色60,在軟體程式編設邏輯的人機互動時段,其身在虛擬實境中的肢體或手指61座標,可借助想像在虛擬實境中的擺放攝影機且在其前方放置一透明板子40,讓虛擬實境中的虛擬角色60的肢體或手指61觸碰到該透明板子40上的某個位置,再將此位置投射至遊戲視窗30上的第二座標32,當然攝影機是必須根據軟體程式編設邏輯的腳本及運鏡規劃即時隨著虛擬角色60移動。At the same time, the virtual character 60 appears in the game window 30 in accordance with the software programming logic to perform the virtual reality performance. In the human-computer interaction period of the software programming logic, the body or finger 61 coordinates in the virtual reality. The limb or finger 61 of the virtual character 60 in the virtual reality can be touched to a certain position on the transparent board 40 by placing the camera in a virtual reality and placing a transparent board 40 in front of it. This position is projected to the second coordinate 32 on the game window 30. Of course, the camera is a script that must be programmed according to the software program and the mirror plan to move immediately with the virtual character 60.
因此,在技術上,利用圖控程式或座標轉換程式,遊戲機10的微處理器(micro processor)將同步擷取在虛擬實境中的虛擬角色60的肢體或手指61座標,且將之換算為映射至遊戲視窗30的第二座標32。Therefore, technically, using the graphics control program or the coordinate conversion program, the micro processor of the gaming machine 10 will synchronously capture the coordinates of the limb or finger 61 of the virtual character 60 in the virtual reality and convert it. To map to the second coordinate 32 of the game window 30.
在軟體程式編設邏輯的人機互動時段,遊戲機10的微處理器同步擷取的遊戲視窗30的第一座標31及第二座標31,經過遊戲機10的微處理器運算後,其相對位置如果是落入軟體程式編設的誤差值範圍內,即表示:虛擬角色60的肢體或手指61投影在遊戲視窗30上的座標,與遊戲玩家50的手指51在觸控螢幕10的遊戲視窗30上的座標是一樣的或接近的,在視覺上,足以產生直接碰觸與互動的效果。During the human-computer interaction period of the software programming logic, the microprocessor of the gaming machine 10 synchronizes the first coordinate 31 and the second coordinate 31 of the captured game window 30, and after the microprocessor operation of the gaming machine 10, the relative If the position falls within the error value range of the software programming, it means that the limb or finger 61 of the virtual character 60 is projected on the coordinate of the game window 30, and the finger 51 of the game player 50 is in the game window of the touch screen 10. The coordinates on 30 are the same or close, visually enough to produce direct touch and interaction.
所述虛擬角色60得為2D虛擬人物、3D虛擬人物、2D虛擬卡通人物、3D虛擬卡通人物、2D虛擬動物、3D虛擬動物、2D虛擬卡通動物或3D虛擬卡通動物。The virtual character 60 is a 2D virtual character, a 3D virtual character, a 2D virtual cartoon character, a 3D virtual cartoon character, a 2D virtual animal, a 3D virtual animal, a 2D virtual cartoon animal, or a 3D virtual cartoon animal.
換言之,遊戲玩家50的手指51,在軟體程式編設邏輯的人機互動時段中,如果沒有點擊觸控螢幕15上的設定位置時或點擊位置偏離設定位置時,遊戲中的2D/3D虛擬角色60的表情將出現失望、沮喪、生氣、…等負向表情;反之,遊戲玩家50的手指51與2D/3D虛擬角色60的肢體或手指61投影在遊戲視窗30上產生視覺上直接觸碰後,3D人物(60)則可能會有開心、害羞…等正面表情,對遊戲玩家50而言,視覺上就像是與此2D/3D虛擬角色60直接接觸一般,顯然可以加強遊戲的情境效果。In other words, the finger 51 of the game player 50, in the human-computer interaction period of the software programming logic, the 2D/3D virtual character in the game if the set position on the touch screen 15 is not clicked or the click position deviates from the set position. The expression of 60 will appear negative expressions such as disappointment, frustration, anger, and the like; on the contrary, the finger 51 of the game player 50 and the limb or finger 61 of the 2D/3D virtual character 60 are projected onto the game window 30 to produce a visual direct contact. 3D characters (60) may have happy, shy... and other positive expressions. For game player 50, it is visually like direct contact with this 2D/3D virtual character 60, which obviously enhances the game's situational effect.
綜上所述,本發明的視覺上人機直接互動方法,如圖6所示,包括以下步驟:In summary, the visual human-machine direct interaction method of the present invention, as shown in FIG. 6, includes the following steps:
a)以一種遊戲機10(例如2D遊戲機、3D遊戲機或RPG遊戲機)的觸控螢幕15為人機介面;且所述觸控螢幕15包括一觸控模組20及一遊戲視窗30;a touch screen 15 of a game machine 10 (for example, a 2D game machine, a 3D game machine, or an RPG game machine) is a human-machine interface; and the touch screen 15 includes a touch module 20 and a game window 30. ;
b)在遊戲視窗30中出現虛擬角色60且依照軟體程式編設邏輯(劇本)表演;b) a virtual character 60 appears in the game window 30 and a logical (script) performance is programmed in accordance with the software program;
c)檢視虛擬角色60的表演時間是否到達軟體程式編設邏輯的人機互動時段?如果否,續繼執行步驟b);如果是,執行步驟d);c) Check if the performance time of the virtual character 60 reaches the human-computer interaction time of the software programming logic? If not, continue to perform step b); if yes, perform step d);
d)檢視遊戲玩家50的手指51是否點擊觸控螢幕15的觸控模組20及產生輸入訊號座標?如果否,執行步驟g);如果是,執行步驟e);d) Examining whether the finger 51 of the game player 50 clicks on the touch module 20 of the touch screen 15 and generates an input signal coordinate? If not, perform step g); if yes, perform step e);
e)校正觸控模組20的輸入訊號座標,且將之換算為對應遊戲視窗30的第一座標31;同步擷取虛擬實境中的虛擬角色60的肢體或手指61座標,且將之換算為映射至遊戲視窗30的第二座標32;e) correcting the input signal coordinates of the touch module 20 and converting it into the first coordinate 31 corresponding to the game window 30; synchronously capturing the coordinates of the limb or finger 61 of the virtual character 60 in the virtual reality and converting it To map to the second coordinate 32 of the game window 30;
f)檢視遊戲視窗30的第一座標31與第二座標32的相對位置是否落入軟體程式編設的誤差值範圍內?如果否,續繼執行步驟g);如果是,執行步驟h);f) Check whether the relative positions of the first coordinate 31 and the second coordinate 32 of the game window 30 fall within the error value range of the software programming. If not, continue to perform step g); if yes, perform step h);
g)虛擬角色60的表情或肢體動作,依照軟體程式編設邏輯變化為失望、沮喪或生氣的負向表情表演;之後,續繼執行步驟b);g) the expression or physical movement of the virtual character 60, according to the software program to change the logical change into a negative expression of disappointment, frustration or anger; after that, step b) is continued;
h)虛擬角色60的表情或肢體動作,依照軟體程式編設邏輯變化為肢體語言變化為開心、喜悅或害羞等正向表情表演;在視覺上,玩家50的手指51與虛擬角色60的手指61產生直接接觸效果;之後,續繼執行步驟b)。h) the expression or physical movement of the virtual character 60, according to the software programming logic change for the body language to change into a positive expression such as happy, joyful or shy; visually, the finger 51 of the player 50 and the finger 61 of the virtual character 60 A direct contact effect is produced; after that, step b) is continued.
此外,在本發明的視覺上人機直接互動方法中,所使用的觸控模組20,可選用單點或多點式觸控模組,或進一步選用紅外線式觸控模組、電容式觸控模組或電阻式觸控模組。其中,所選用的紅外線式觸控模組,可為陣列式紅外線模組或紅外線影像處理式觸控模組。而使用的遊戲視窗30,可選用LED背光螢幕、LCD背光、電漿電視螢幕或背投影螢幕。In addition, in the visual human-machine direct interaction method of the present invention, the touch module 20 used may be a single-point or multi-point touch module, or an infrared touch module or a capacitive touch. Control module or resistive touch module. The selected infrared touch module can be an array infrared module or an infrared image processing touch module. The game window 30 used may be an LED backlight screen, an LCD backlight, a plasma TV screen or a rear projection screen.
10...遊戲機10. . . Game machine
11...操縱介面11. . . Manipulation interface
15...觸控螢幕15. . . Touch screen
20...觸控模組20. . . Touch module
30...遊戲視窗30. . . Game window
31...第一座標31. . . First standard
32...第二座標32. . . Second coordinate
40...透明板子40. . . Transparent board
50...遊戲玩家50. . . game player
51...手指51. . . finger
60...虛擬角色60. . . Virtual role
61...肢體或手指61. . . Limb or finger
圖1為現有技術的遊戲機示意圖。1 is a schematic diagram of a prior art gaming machine.
圖2為遊戲機透過本發明的手指接觸產生視覺上人機互動方法達到人機直接互動效果的示意圖。FIG. 2 is a schematic diagram of a game machine generating a visual human-computer interaction method through the finger contact of the present invention to achieve a direct interaction effect between human and machine.
圖3為本發明的手指接觸產生視覺上人機互動方法達到人機直接互動效果的示意圖。FIG. 3 is a schematic diagram of the method for visually interacting with human hands by finger contact of the present invention to achieve direct interaction between human and machine.
圖4為本發明的虛擬角色肢體或手指座標與玩家手指座標轉換為遊戲視窗座標的說明圖。4 is an explanatory diagram of a virtual character limb or finger coordinate and a player finger coordinate converted into a game window coordinate according to the present invention.
圖5為本發明的虛擬角色肢體或手指座標與玩家手指座標轉換為遊戲視窗座標的流程圖。FIG. 5 is a flow chart of converting a virtual character limb or finger coordinate and a player finger coordinate into a game window coordinate according to the present invention.
圖6為本發明的一種透過手指接觸產生視覺上人機互動的方法流程圖。6 is a flow chart of a method for generating visual human-computer interaction through finger contact according to the present invention.
15...觸控螢幕15. . . Touch screen
20...觸控模組20. . . Touch module
50...遊戲玩家50. . . game player
51...手指51. . . finger
60...虛擬角色60. . . Virtual role
61...肢體或手指61. . . Limb or finger
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100134155A TWI457164B (en) | 2011-09-22 | 2011-09-22 | Human-machine interactive approach through visually fingers touch |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW100134155A TWI457164B (en) | 2011-09-22 | 2011-09-22 | Human-machine interactive approach through visually fingers touch |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201313280A true TW201313280A (en) | 2013-04-01 |
TWI457164B TWI457164B (en) | 2014-10-21 |
Family
ID=48802220
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW100134155A TWI457164B (en) | 2011-09-22 | 2011-09-22 | Human-machine interactive approach through visually fingers touch |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI457164B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103266690A (en) * | 2013-05-24 | 2013-08-28 | 广东伟业铝厂有限公司 | Glass interval with touch display and processing technology thereof |
CN107608522A (en) * | 2017-09-29 | 2018-01-19 | 广州云友网络科技有限公司 | Utilize the method and system of mobile device customizing virtual moving scene |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008087935A1 (en) * | 2007-01-17 | 2008-07-24 | Kabushiki Kaisha Sega Doing Business As Sega Corporation | Stationary vehicle game machine |
TW200909031A (en) * | 2007-08-31 | 2009-03-01 | Inventec Appliances Corp | A handheld electrical device controlled to interact with electrical pets and a method therefor |
US20090062004A1 (en) * | 2007-09-05 | 2009-03-05 | Nvidia Corporation | Input Terminal Emulator for Gaming Devices |
JP4583472B2 (en) * | 2008-04-28 | 2010-11-17 | 株式会社コナミデジタルエンタテインメント | GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM |
-
2011
- 2011-09-22 TW TW100134155A patent/TWI457164B/en not_active IP Right Cessation
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103266690A (en) * | 2013-05-24 | 2013-08-28 | 广东伟业铝厂有限公司 | Glass interval with touch display and processing technology thereof |
CN107608522A (en) * | 2017-09-29 | 2018-01-19 | 广州云友网络科技有限公司 | Utilize the method and system of mobile device customizing virtual moving scene |
CN107608522B (en) * | 2017-09-29 | 2020-12-25 | 广州云友网络科技有限公司 | Method and system for customizing virtual motion scene by utilizing mobile device |
Also Published As
Publication number | Publication date |
---|---|
TWI457164B (en) | 2014-10-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11221730B2 (en) | Input device for VR/AR applications | |
US10317989B2 (en) | Transition between virtual and augmented reality | |
KR101620777B1 (en) | Enhanced virtual touchpad and touchscreen | |
US10137363B2 (en) | Gesture based user interfaces, apparatuses and control systems | |
US10317997B2 (en) | Selection of optimally positioned sensors in a glove interface object | |
US20110304632A1 (en) | Interacting with user interface via avatar | |
US8232989B2 (en) | Method and apparatus for enhancing control of an avatar in a three dimensional computer-generated virtual environment | |
KR101338043B1 (en) | Cognitive Rehabilitation System and Method Using Tangible Interaction | |
KR20220062410A (en) | Projection Casting in Virtual Environments | |
US20120268359A1 (en) | Control of electronic device using nerve analysis | |
US20120133581A1 (en) | Human-computer interaction device and an apparatus and method for applying the device into a virtual world | |
CN111389003B (en) | Game role control method, device, equipment and computer readable storage medium | |
CN104460967A (en) | Recognition method of upper limb bone gestures of human body | |
CN102430244B (en) | Method for generating visual man-machine interaction by touching with finger | |
Chowdhury et al. | Wriarm: Leveraging wrist movement to design wrist+ arm based teleportation in vr | |
TWI457164B (en) | Human-machine interactive approach through visually fingers touch | |
WO2022180894A1 (en) | Tactile-sensation-expansion information processing system, software, method, and storage medium | |
CN105045390A (en) | Human upper limb skeleton gesture identification method | |
Liu | Analysis of Interaction Methods in VR Virtual Reality | |
Putra et al. | Navigating through Google Maps using an eye-gaze interface system | |
Wu et al. | Interface design for somatosensory interaction | |
Shultz et al. | Designing for haptics | |
CN109426338A (en) | A kind of New Virtual real garment | |
Worrallo | A multiple optical tracking based approach for enhancing hand-based interaction in virtual reality simulations | |
US11307762B2 (en) | Operating user interfaces |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
GD4A | Issue of patent certificate for granted invention patent | ||
MM4A | Annulment or lapse of patent due to non-payment of fees |