TW201246025A - Control method and electronic apparatus using gestures - Google Patents

Control method and electronic apparatus using gestures Download PDF

Info

Publication number
TW201246025A
TW201246025A TW100116694A TW100116694A TW201246025A TW 201246025 A TW201246025 A TW 201246025A TW 100116694 A TW100116694 A TW 100116694A TW 100116694 A TW100116694 A TW 100116694A TW 201246025 A TW201246025 A TW 201246025A
Authority
TW
Taiwan
Prior art keywords
gesture
application
touch screen
plug
user
Prior art date
Application number
TW100116694A
Other languages
Chinese (zh)
Other versions
TWI442278B (en
Inventor
Pei-Ling Yu
Szu-Wen Lin
Chuan-Wei Lee
Original Assignee
Acer Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Acer Inc filed Critical Acer Inc
Priority to TW100116694A priority Critical patent/TWI442278B/en
Publication of TW201246025A publication Critical patent/TW201246025A/en
Application granted granted Critical
Publication of TWI442278B publication Critical patent/TWI442278B/en

Links

Landscapes

  • Stored Programmes (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A control method and an electronic apparatus using gestures are provided. The electronic apparatus comprises a touch screen. In the present method, a plug-in is installed on an application of the electronic apparatus. When the application is activated, the plug-in is simultaneously activated to detect a gesture that a user touches the touch screen. Then, the plug-in is used to transform the detected gesture into a control command of a function of the application and send the control command to the application, so as to control the application to execute the function.

Description

201246025 六、發明說明: 【發明所屬之技術領域】 本發明是有關於—種手勢控制方法及電子裝置,且 $有_科掛程式_手勢並據以控制應用程 式執仃功能的方法及電子裝置。 【先前技術】 一現今消費者對於電子裝置外型的要求傾向輕、薄、 紐、小,此要求使得電子裝置的體積受到相當限制。對於 桌上型電腦、筆記型電腦或平板電腦等裝置而言,若要在 裝置上同時配置螢幕及鍵盤,勢必得要縮小螢幕的尺寸。 為了能夠在有限的空間中配置較大的螢幕,近來發展出一 種觸控螢幕,其可同時做為電子裝置的顯示及輸入介面, 而能夠省去配置傳統鍵盤的成本及所佔用的面積。 觸控螢幕的操作需要裝置本身作業系統(例如美國微 軟公司的視窗作業系統)的支援,而對於觸控螢幕上觸碰 點的偵測及其對應手勢的辨識則需要應用程式、作業系統 及觸控螢幕之間的相互配合才得以實現。 舉例來說,圖1繪示習知電子裝置的架構圖。請參照 圖1,電子裝置10是利用觸控硬體/韌體(即觸控螢幕) 11偵測由使用者觸碰的多個觸碰點,這些觸碰點在經由作 業系統12中多點觸碰軟體庫(multi-touch software stack) 的辨識後,即會轉換為作業系統12中預設的手勢。此手勢 在傳送給應用程式13後,即可控制應用程式13執行對應 201246025 的功能。 命述手勢操作得以運作的前提是顧程式1Λ 而0乍業系統註冊手勢操作 或是二 瘅用*。十 八式,否則即便使用者利用觸控螢幕在 ^式13的視窗中做出手勢,電子裝置H)也不有任何 【發明内容】 程'ϋΓίΓ「種手勢㈣方法及電子裝置’藉由外掛 私式辨識使用者觸碰觸控螢幕的 執行手勢對應的魏。 4賴用程式 ^明提供-種手勢控制方法,適用於具有觸控榮幕 、置。此方法係在電子裝置的助程式上安裝一個 外掛程式,而在此朗程式啟動時,同時啟動外掛程式以 谓測使用者觸_控螢幕的手勢,並利射卜掛程式將此手 勢轉換為執行應用程式之魏的控制指令,以及將此控制 指令傳送至應雜式,以㈣制程錢行該功能。 在本發明之-實施例中,上述啟動外掛程式以偵測使 用者觸碰難螢幕的手勢的步驟包_财卜掛程式開啟位 於觸控®幕最上層的全榮幕透明視窗,則貞測使用者觸碰 觸控螢幕的手勢。 在本發明之一實施例中,上述啟動外掛程式以偵測使 用者觸碰觸控螢幕的手勢的步驟包括利用外掛程式向電子 裝置的作業系統註冊一手勢功能,其中作業系統會接收觸 201246025 控螢幕所偵測之多個觸碰點的位置,並據以判斷使用 碰觸控榮幕的手勢,然後利用外掛程式接收作業系 收之觸碰點的位置以及所判斷之手勢。 在本發明之一實施例中,上述啟動外掛程式以偵 用者觸碰觸控螢幕的手勢的步驟更包括利用外掛程式福 應用程式的運作模式’而當偵測到應用程式的運作根* =為簡報減模式時,開始偵測使用者觸碰觸控螢幕^手 用者實施财,上述啟動外難式以偵測使 =者觸_控勞幕的手勢的步·包括姻外掛程 應用程式的視窗是否被致能 、/、 被致能時,開始侦測使用者觸式的視窗 组及夕 =出:f電子震置’其包括觸控勞幕、應用模 多幕係用以偵測使用者觸碰之 亦同時啟動以偵測使用者觸寺’外掛模組 勢轉換為執行應用模組之觸勢,並將此手 在本發明控·«組執行所述的功能。 觸控螢幕最上層的全】篡1/上,外掛模組係開啟位於 控螢幕的手勢f王 明視窗,以偵測使用者觸碰觸 系用一=顺子裝置更包括作業 係用w接收觸控螢幕所_之多個觸碰點的 201246025 位置,並據以判斷使用者觸碰觸控螢幕的手勢。其中,外 掛模、.且更向作業系統模組註冊—手勢功能,以接收作業系 統模組所接收之觸碰點的位置以及所判斷之手勢。 在本發明之一實施例中,上述的外掛模組更偵測應用 模組的運作模式當侧到助歡的運作 簡報播放模式時,開始偵測使用者觸碰觸控螢幕的手勢: ,本發明之—實施例中,上述的外掛模組更偵測應用 ^、、且的視®是碰缝,而視窗被致 能時,開始偵測使用者觸碰觸控螢幕的手勢。 基於上述’本發明之手勢控制方法及f子裝置係藉由 在應用程式上安裝外掛程式,並在顧程式啟動後,同時 ,動外掛程式則貞測使用者的手勢,並據以控制應用程 式,進而使得應用程式可支援手勢控制。 —為讓本發明之上述特徵和優點能更明顯易懂,下文特 舉實施例,並配合所附圖式作詳細說明如下。 、 【實施方式】 本發明係針對具有觸控螢幕的電子裝置提供手勢控 制功能,藉由在應用程式上安裝一個外掛程式,以在應^ 程式執行的過程中躺制者在職f幕上觸碰的手^, ,適時轉換為躺程式的控織令,*可控制制程式執 ^對應功能。藉此,對於沒有支援手勢㈣的應用程式而 吕,本發明可提供一種解決方案來實現手勢控制。 圖2是依照本發明一實施例所繪示之電子裝置架構的 201246025 示意圖。請參照圖2,本實施例的電子裝置20是利用觸控 硬體/韌體(即觸控螢幕)21偵測由使用者觸碰的多個觸 碰點’這些觸碰點可經由作業系統22中多點觸碰軟體庫 (multi-touch software stack)的辨識’轉換為作業系統22 預設的手勢。 與習知技術不同的是,本實施例除了讓應用程式23 可從作業系統22接收觸碰點的位置外,還在應用程式23 上安裝一個外掛程式24,藉以從作業系統22接收其所偵 測的手勢’或是從作業系統22接收觸碰點位置後再自行判 斷手勢。 經由外掛程式24的轉換,使用者在觸控榮幕上 ΪΓΓΠ轉換為應用程式23的㈣齡,划以控制庫 行對應的功能,進而達到手勢控制的功效。;I 下則舉貝知例詳細說明。 圖3是依照本發明一實施例所 圖。請泉昭圄2 1 1不乏罨千裝置的方塊 腦、卓貫施例的電子農置30例如是筆記型電 ”生電腦或平板電腦等裝置,1中可/ 憶體或固態儲左驻 /、中了C括硬碟、記201246025 VI. Description of the Invention: [Technical Field] The present invention relates to a gesture control method and an electronic device, and a method and an electronic device for controlling an application execution function according to a gesture . [Prior Art] A consumer's demand for the appearance of an electronic device tends to be light, thin, new, and small, and this requirement makes the size of the electronic device considerably limited. For devices such as desktops, notebooks, or tablets, it is necessary to reduce the size of the screen if you want to configure both the screen and the keyboard on the device. In order to be able to configure a larger screen in a limited space, a touch screen has recently been developed which can simultaneously serve as a display and input interface for an electronic device, thereby eliminating the cost and area occupied by a conventional keyboard. The operation of the touch screen requires the support of the operating system of the device itself (for example, the Windows operating system of Microsoft Corporation of the United States), and the detection of the touch point on the touch screen and the recognition of the corresponding gestures require the application, the operating system and the touch. The interaction between the control screens is achieved. For example, FIG. 1 is a block diagram of a conventional electronic device. Referring to FIG. 1 , the electronic device 10 detects a plurality of touch points touched by a user by using a touch hardware/firm body (ie, a touch screen) 11 , and the touch points are multi-pointed through the operating system 12 . After the identification of the multi-touch software stack is touched, it is converted into a preset gesture in the operating system 12. After the gesture is transmitted to the application 13, the application 13 can be controlled to perform the function corresponding to 201246025. The premise that the gestation gesture operation works is that the program is registered and the gesture is registered or used. Eighteen, otherwise even if the user uses the touch screen to make a gesture in the window of the type 13, the electronic device H) does not have any [invention content] Cheng 'ϋΓίΓ "a gesture (four) method and electronic device 'by plug-in The private identification recognizes the user's touch gesture corresponding to the touch screen. 4 The application program provides a gesture control method for the touch screen, which is applied to the electronic device. Install a plug-in program, and when the program starts, the plug-in program is started at the same time to measure the gesture of the user touching the control screen, and the gesture program converts the gesture into a control command for executing the application, and The control command is transmitted to the application mode, and the function is performed by the (4) process. In the embodiment of the present invention, the step of starting the plug-in to detect the user's gesture of touching the difficult screen is used. Turning on the full-width transparent window located at the top of the touch screen screen, the user's gesture of touching the touch screen is detected. In one embodiment of the present invention, the above-mentioned startup plug-in program is used for detecting The step of touching the gesture of the touch screen includes using a plug-in program to register a gesture function with the operating system of the electronic device, wherein the operating system receives the position of the touch points detected by the 201246025 control screen, and judges the use according to the use. Touching the gesture of the touch screen, and then using the plug-in program to receive the location of the touch point of the operation and the gesture determined. In an embodiment of the invention, the startup plug-in touches the touch screen with the detective The steps of the gesture include the use of the plug-in application mode of operation - and when detecting the operation root of the application * = for the briefing mode, the user is detected to touch the touch screen. The above-mentioned step of initiating the external difficulty to detect the gesture of causing the person to touch the screen, including whether the window of the external hanging application is enabled, and/or when enabled, starts detecting the user's touch. Windows group and eve = out: f electronically set 'including the touch screen, the application mode multi-screen system is used to detect the user's touch and also start to detect the user's touch temple' plug-in module potential is converted to Hold The application module's potential, and the hand in the invention control group «execute the function described. The top of the touch screen is full 篡 1 / on, the external module is to open the gesture on the control screen f king In the window, the user touches the touch system with a = straight device, and the operating system uses the w to receive the 201246025 position of the touch screen of the touch screen, and judges that the user touches the touch. a gesture of a screen, wherein the plug-in module, and the operator system module registers a gesture function to receive the location of the touch point received by the operating system module and the gesture determined. In an embodiment of the invention The above-mentioned plug-in module further detects the operation mode of the application module. When the operation mode of the assistant is played, the user starts to detect the user's gesture of touching the touch screen: In the embodiment of the present invention, the above The plug-in module detects the application ^, and the view is a seam, and when the window is enabled, it starts detecting the user's gesture of touching the touch screen. Based on the above-mentioned gesture control method and f-sub-device, the plug-in program is installed on the application, and after the program is started, the plug-in program detects the user's gesture and controls the application accordingly. This allows the application to support gesture control. The above-described features and advantages of the present invention will become more apparent from the following description. [Embodiment] The present invention provides a gesture control function for an electronic device having a touch screen. By installing a plug-in program on the application, the toucher touches the on-the-spot screen during the execution of the program. The hand ^, , timely conversion to the control program of the lying program, * can control the program to perform the corresponding function. Thereby, for an application that does not support gesture (4), the present invention can provide a solution to implement gesture control. FIG. 2 is a schematic diagram of 201246025 of an electronic device architecture according to an embodiment of the invention. Referring to FIG. 2, the electronic device 20 of the embodiment detects a plurality of touch points touched by a user by using a touch hardware/firm body (ie, a touch screen) 21, and the touch points can pass through the operating system. The identification of the multi-touch software stack in 22 is converted to the preset gesture of the operating system 22. Different from the prior art, in addition to the application 23 being able to receive the location of the touch point from the operating system 22, a plug-in 24 is also installed on the application 23 to receive the detected action from the operating system 22. The measured gesture 'either determines the gesture from the operating system 22 after receiving the touch point position. Through the conversion of the plug-in program 24, the user converts to the (fourth) age of the application program 23 on the touch screen, and controls the function corresponding to the library line to achieve the effect of gesture control. ; I will give details of the details. Figure 3 is a diagram of an embodiment of the invention. Please refer to Quan Zhaozhang 2 1 1. There is no shortage of the square brain of the thousand devices, and the electronic farm 30 of the Zhuo Guanshi example is a notebook type computer or tablet computer, 1 can be / memory or solid storage left station / In the middle of the C, including hard disk, remember

U心辟存裝置等儲存媒 U 存電子裝置3〇夕冼聲么h 、衣、魯不),而可用來儲 憎系、摘程式或其他應用程式。 組…t置控營幕31、應用模組32及外掛槿 他種類的觸碰❹'勞幕31例如是由電阻式、電容式或A 、《j嘴1¾感應元件盥 、人丹 裝置。應用模組32例如是二而成的顯示及輸入 疋女4在電子襄置3〇之作業系統 7 201246025 中的程式’其可經由使用者的操作,執行簡報播放 瀏覽、多媒體播放等各樣功能。外掛模组33例如 應用模組32上的辅助程式,其可辅助應用模組3 ^ 先無法支挺的功能,例如手勢控制功能。 ,、 β需說明的是,上述的應用模組32及外掛模組 疋以邏輯電路讀組合而成的硬體裝置,而可執行 制功能。這些模組也可以是儲存在電子裝置3()之記= ,中的程式’其可載人電子裝置3G的處理器, 勢控制功能。以下僅以軟體(即應用程式32轉掛 =的形式舉例說明電子裝置3G實現手勢控制的詳= 流裎:加师會示之手勢控制方法的 月參照圖4’本實施例的方法適用於圖3 控制方法子裝置%中的各項元件說明手勢 程式^ 3G糊程式32上絲—個外掛 隨身^ 設計的—種轉換程式,其可以光碟、 裝置供給❹者,而域用者自行安裝在電子 由電子齡料m制者手動下栽或 不設限 下载’以安裝在電子裝置3G上,在此 程式用程式32啟動時’電子裝置30即同時啟動外掛 ^ 偵測使用者觸碰觸控螢幕的手勢(步驟S42)。 201246025 〇羊σ之,電子裝置30例如是利用冰上 控螢幕Μ最上層的全榮幕透明視呈式 視窗是位於最上層,因此可以 因為此王螢幕透明 者觸碰觸控營幕3=收之觸㈣喻置’判斷出使用 勢韓2二ί 利用外掛程式33將所憤測之手 =換為^應用程式32之功能的控制指令(步驟叫 掛程式33例如會將所接收到的觸碰點原封不動 =ί、給應用程式32,而僅針對所接收到的手勢做轉換, 使其可以對應到應用程式32中的特定功能。 ,後’由電子裝置30利射卜掛程式33將轉換後的控 姐"傳送至應用程式32,以控制應用程式32執行所述 的功能(步驟S44)。藉此,即可達到手勢控制的效果。 舉例來說,微軟的文書處理軟體w〇rd目前仍不支援 向右輕彈(flick rightwards)與向左輕彈(fliekleftwards) 的手勢控制。本實補的外掛程式射接收並制使用者 所做出的柏種手勢’並轉換為使用者預先定義的操作功 能,藉以控制文書處理軟體執行對應功能,例如控制文書 處理軟體切換至前一個文件或下一個文件。 需說明的是,在上述實施例中,外掛程式是根據所接 收之觸碰點的位置自行判斷出使用者的手勢,而在另一實 把例中,外掛程式也可直接向電子裴置的作業系統註冊手 勢功迠,以取得作業系統辨識觸碰點所獲得的手勢偵測結 果,進而轉換為應用程式的控制指令。以下則再舉一實施 201246025 例詳細說明。 圖5是依照本發明一實施例所繪示之電子裝置的方塊 圖。請參照圖1,本實施例的電子裝置50例如是筆記型電 腦、桌上型電腦或平板電腦等裝置,其中可包括硬碟、記 憶體或固態儲存裝置等儲存媒體(未繪^),而可用來 存電子裝1: 50之作業系統或其他程式。 電子裝置50包括觸控螢幕51、應用模組52、外掛模 組53及作業系統模組54。其中,觸控螢幕31例如是由電 阻式、電容式或其他種類的觸碰感應元件與液晶螢幕整人 而成的顯示及輸入農置。應用模組52、外掛模組53及二 業系統模組54例如是以邏輯電路元件組合而成的硬體妒 置,而可執行手勢控制功能。這些模組也可以是儲存在電 子裝置50之記憶體或硬碟中的程式,其可載入電子 5〇的虎I®突、f 我复 °。,而執行手勢控制功能。以下僅以軟體(即應 私式52、外掛程式53及作業系統54)的形式舉例說^ 子裝置50執行手勢控制功能的詳細步驟。 、古。圖6是依照本發明一實施例所繪示之手勢控制方法的 耘圖。請參照圖6,本實施例的方法適用於圖5的電子 ^置5〇,以下即搭配電子裝置50中的各項元件說明手勢 控制方法的詳細步驟: 。、首先,在電子裝置50的應用程式52上安裝一個外掛 私式53 (步驟S61) ^其中,當應用程式52啟動時,電 置50即同時啟動外掛程式53來偵測使用者觸碰觸控 螢幕51的手勢。 10 1 201246025 與刖述實施例不同的是,本實施例在谓測手勢之 外掛程式53會先偵測應用程式52的運作模式(步胁 S62),並且在外掛程式53 _到應用程式52的運 式轉換為簡報播放模式時,才開始偵測使用者觸碰= 幕的手勢(步驟S63)。其中,外掛程式53例如$ 先向電子裝置5G的作業系統54註冊手勢功能,因此 測到應用喊52轉換為簡報播放模式時,即直接 偉 統54取得手勢偵測結果。 糸糸 需說明的是,外掛程式„可從作業系統54獲 的觸碰點及手勢,並可進—步偵測應用程式52的視窗= 被致能。而當债測到應用程式52的視窗被致能時,才^ 測使用者麻難縣M的手勢,㈣在躺程式^、 視窗未被致能的狀態下,就忽略不處理。 的 接著’由電子裝置5〇利用外掛程式Μ將所 勢轉換為執行應用程式52之功能的控制指令(步驟手 然後將轉換後的控熟令傳送至顧程式52,以控), 程式52執行所述的功能(步驟叫 =用 勢控制的效果。 ”達到手 舉例來說,微軟的簡報軟體P〇werP〇int目前在視窗^ 業系統Wind_ 7的環境下仍無法支援手勢控制,本= 幻的外掛程式則可解決此問題。此外掛程式會在簡報軟體 被啟動的同時也跟著啟動,而當簡報軟體進入全螢幕的簡 報播放模式時,外掛程式便會開始偵測使用者的手勢。〆 旦偵測到手勢,即立刻轉換為相對應的控制指令,並傳送 11 201246025 給簡報軟體,以控制簡報軟體執行對應的功能 。例如,當 外掛程式偵測到向上輕彈(flickup)的手勢時,即控制簡 報軟體翻到上一頁;而當外掛程式偵測到向下輕彈(flick down)的手勢時,則控制簡報軟體翻到下一頁。 紅上所述,本發明之手勢控制方法及電子裝置藉由在 應用程式上安裝外掛程式,並利用外掛程式偵測使用者的 手勢或是從作業系統接收其所偵測的手勢, 用程式的控制指令,藉此可將手勢控制應用== 應用程式上。 、 雖然本發明已以實施例揭露如上,然其並非用以限定 ^發月’任何所屬技術領域巾具有通常知識者,在不脫離 ^之精神和範#可作些許之更動與潤飾,故本 《明之保護範圍當視後附之ΐ請專利範圍所界定者為準。 【圖式簡單說明】 圖1繪示習知電子裝置的架構圖。 二立圖2是依照本發明一實施例所繪示之電子裝置架構的 圖3是依照本發明一實施例所繪示之電子裝置的方塊 圖。 圖4是依照本發明一實施例所繪示之手勢控制方法的 流程圖。 二 圖5是依照本發明一實施例所繪示之電子裝置的方塊 201246025 圖6是依照本發明一實施例所繪示之手勢控制方法的 流程圖。 【主要元件符號說明】 10、 20、30、50 :電子裝置 11、 21 :觸控硬體/韋刃體 12、 22 :作業系統 13、 23 :應用程式 24 :外掛程式 31、 51 :觸控螢幕 32、 52 :應用模組 33、 53 :外掛模組 54 :作業系統模組 S41〜S44 ··本發明一實施例之手勢控制方法的步驟 S61〜S65 :本發明一實施例之手勢控制方法的步驟 13U-hearted storage devices and other storage media U storage electronic devices 3 〇 冼 么 h h, clothing, Lu not), and can be used to store systems, programs or other applications. Group...t controllable camp 31, application module 32 and plug-in 槿 His type of touch ❹ 'The curtain 31 is made of resistive, capacitive or A, "j mouth 13⁄4 sensing element 、, 丹丹装置. The application module 32 is, for example, a program for displaying and inputting the prostitute 4 in the operating system 7 201246025 of the electronic device 3, which can perform various functions such as presentation play browsing and multimedia playback through the operation of the user. . The plug-in module 33, for example, an auxiliary program on the application module 32, can assist the application module 3 to perform functions such as gesture control. It should be noted that the above-mentioned application module 32 and the external module 读 are combined with a logical circuit to read and combine the hardware devices, and the functions are executable. These modules may also be a program stored in the electronic device 3(), which can carry the processor of the human electronic device 3G, and the potential control function. In the following, only the software (ie, the application 32 is hanged = the form of the electronic device 3G to implement the gesture control is detailed = rogue: the month of the gesture control method shown by the teacher is referred to FIG. 4'. The method of the embodiment is applicable to the figure. 3 control method sub-device % of the components description gesture program ^ 3G paste program 32 on the silk - a plug-in portable ^ design - a conversion program, which can be used to provide optical discs, devices, and domain users install themselves in electronics Manually downloading or unrestricted downloading by the electronic age material m is installed on the electronic device 3G, and when the program 32 is started, the electronic device 30 simultaneously activates the external plugging ^ detecting the user touching the touch screen The gesture of the step (step S42). 201246025 电子 σ , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Touch Camp 3=Receive Touch (4) Yu Set 'Judges the use of Han 2 2 ί Use the plug-in 33 to change the hand of the insult = to the control command of the function of the application 32 (step called the program 33, for example Will The received touch point is intact = ί, to the application 32, and only the received gesture is converted so that it can correspond to a specific function in the application 32. After the 'electronic device 30' The program 33 transfers the converted controller to the application 32 to control the application 32 to execute the function (step S44). Thereby, the effect of the gesture control can be achieved. For example, the Microsoft document The processing software w〇rd still does not support the gesture control of flick rightwards and fliekleftwards. The plug-in program of this real complement receives and accepts the cypress gesture made by the user. Converting to a user-defined operation function, thereby controlling the document processing software to perform a corresponding function, for example, controlling the document processing software to switch to the previous file or the next file. It should be noted that, in the above embodiment, the plug-in is based on the The position of the touched point is determined by the user's gesture, and in another example, the plug-in can also directly register with the operating system of the electronic device. In order to obtain the gesture detection result obtained by the operating system identification touch point, the result is converted into the application control command. The following is a detailed description of the implementation of 201246025. FIG. 5 is an embodiment of the present invention. The electronic device 50 of the present embodiment is, for example, a notebook computer, a desktop computer or a tablet computer, and may include a hard disk, a memory or a solid storage device, etc. The storage medium (not shown) can be used to store an electronic operating system or other program of 1.50. The electronic device 50 includes a touch screen 51, an application module 52, an external module 53 and an operating system module 54. The touch screen 31 is, for example, a display and input farm formed by a resistive, capacitive or other type of touch sensing element and a liquid crystal screen. The application module 52, the plug-in module 53, and the secondary system module 54 are, for example, hardware components combined with logic circuit elements, and can perform gesture control functions. These modules may also be programs stored in the memory or hard disk of the electronic device 50, which can load the electronic tiger's I®, f. And perform gesture control. The detailed steps of the gesture control function performed by the sub-device 50 are exemplified below only in the form of software (i.e., the private module 52, the plug-in program 53, and the operating system 54). ,ancient. FIG. 6 is a schematic diagram of a gesture control method according to an embodiment of the invention. Referring to FIG. 6, the method of the present embodiment is applied to the electronic device of FIG. 5, and the following detailed steps of the gesture control method are described in conjunction with the components in the electronic device 50: First, an external private module 53 is installed on the application 52 of the electronic device 50 (step S61). When the application 52 is activated, the external device 53 is activated to detect the user touching the touch. The gesture of the screen 51. 10 1 201246025 Different from the embodiment, in this embodiment, the pre-test gesture plug-in 53 first detects the operation mode of the application 52 (step threat S62), and the plug-in 53__ to the application 52 When the mode is converted to the presentation mode, the user's gesture of touching the screen is detected (step S63). The plug-in program 53, for example, first registers the gesture function with the operating system 54 of the electronic device 5G. Therefore, when it is detected that the application shout 52 is converted into the briefing play mode, the direct UI 54 obtains the gesture detection result. It should be noted that the plug-in „ can receive touch points and gestures from the operating system 54 and can further detect the window of the application 52= is enabled. When the debt is detected to the window of the application 52 When it is enabled, it will measure the gesture of the user's Mahjong County M. (4) In the state where the lying program is not enabled, the window will be ignored. Then the electronic device will use the plug-in. The potential is converted into a control command for executing the function of the application 52 (the step hand then transfers the converted control command to the program 52 for control), and the program 52 executes the function (step call = effect of the potential control) For example, Microsoft's newsletter software P〇werP〇int is still unable to support gesture control in the environment of Windows® system Wind_7. This is a magic plug-in that can solve this problem. When the newsletter software is started, it is also started. When the newsletter software enters the full-page briefing mode, the plug-in will start to detect the user's gesture. Once the gesture is detected, it is immediately converted to the corresponding one. Commands and transmits 11 201246025 to the presentation software to control the function of the presentation software. For example, when the plug-in detects a flickup gesture, the control brief software is turned to the previous page; When the plug-in detects a flick down gesture, the control briefing software flips to the next page. As described above, the gesture control method and the electronic device of the present invention install the plug-in on the application. And using the plug-in to detect the user's gesture or receive the detected gesture from the operating system, using the program's control commands, thereby enabling the gesture control application == application. Although the invention has been implemented For example, the disclosure of the above is not intended to limit the technical knowledge of any technical field in the field, and it can be modified and retouched without departing from the spirit and scope of the body. BRIEF DESCRIPTION OF THE DRAWINGS [Embodiment of the drawings] Figure 1 is a block diagram of a conventional electronic device. Figure 2 is a diagram of an embodiment of the present invention. FIG. 3 is a block diagram of an electronic device according to an embodiment of the invention. FIG. 4 is a flow chart of a gesture control method according to an embodiment of the invention. In the embodiment of the present invention, a block diagram of an electronic device is shown in FIG. 6 is a flow chart of a gesture control method according to an embodiment of the invention. [Description of main component symbols] 10, 20, 30, 50: electronic device 11 21: touch hardware/wei edge 12, 22: operating system 13, 23: application 24: plug-in 31, 51: touch screen 32, 52: application module 33, 53: plug-in module 54: Operation System Modules S41 to S44 · Steps S61 to S65 of the gesture control method according to an embodiment of the present invention: Step 13 of the gesture control method according to an embodiment of the present invention

Claims (1)

201246025 七、申請專利範圍: 1. 一種手勢控制方法,適用於具有一觸控螢幕的—電 子裝置,該方法包括下列步驟: 安裝一外掛程式於該電子裝置的一應用程式; 當該應用程式啟動時,同時啟動該外掛程式以偵測一 使用者觸碰該觸控螢幕的一手勢; 利用該外掛程式轉換該手勢為執行該應用程式之一 功能的一控制指令;以及 傳送該控制指令至該應用程式,以控制該應用程式執 行該功能。 2·如申請專利範圍第1項所述之手勢控制方法,其中 啟動該外掛程式以偵測該使用者觸碰該觸控螢幕的該手勢 的步驟包括: 利用該外掛程式開啟位於該觸控螢幕最上層的一全勞 幕透明視窗,以偵測該使用者觸碰該觸控螢幕的該手勢。 3·如申请專利範圍第1項所述之手勢控制方法,其中 啟動該外掛程式以偵測該使用者觸碰該觸控螢幕的該手勢 的步驟包括: 利用δ亥外掛程式向該電子裝置的—作業系統註冊一 手勢功能,其令該作業系統接收該觸控螢幕所偵測之多個 觸石亚點的位置’域以觸紐用者觸顧聰榮幕的該 手勢;以及 利用該外掛程式接收該作業系統所判斷之該手勢。 4·如申請專利範圍第丨項所述之手勢控制方法,其中 S 14 201246025 啟動該外掛程式以偵測該使用者觸碰該觸控螢幕的該手勢 的步驟更包括: 利用該外掛程式偵測該應用程式的一運作模式;以及 當偵測到該應用程式的該運作模式轉換為〆簡報播 放模式時,開始偵測該使用者觸碰該觸控螢幕的該手勢。 5.如申請專利範圍第1項所述之手勢控制方法’其中 啟動該外掛程式以偵測該使用者觸碰該觸控螢幕的該手勢 的步驟更包括: 利用該外掛程式偵測該應用程式的一視窗是否被致 能;以及 當偵測到該應用程式的該視窗被致能時,開始偵測該 使用者觸碰該觸控螢幕的該手勢。 6· —種電子裝置,包括: '丨只W Ί义巾石啊姚I夕個觸石並點; •應用模組’安裝於該電子裝置;以及 =外掛模組,安裝於該應用模組,其中 使用組啟動時,_啟動斜掛模組以偵測該 幕的一手勢,轉換該手勢為執行該應 應用模組’啸制該應闕_行該魏。 " 如申請專利範圍第6項所述之電子震置,其中贫冰 窗,、3括開啟位於該觸控螢幕最上層的一全螢幕透明〜見 貞測該使用者觸碰該觸控螢幕的該手勢。 8.如申請專利範圍第6項所述之電子裝置,更包括: 15 201246025 點的幕所偵測之多個觸碰 勢,其中域以_較用者觸碰該觸控勞幕的該^ 能,二1卜:模組更包括向該作業系統模組註冊-手執 接收該作業系統模組所判斷之該手勢。手勢功 9.如申請專利範圍第6項所述之 =組更包括偵測該應用模組的—運作模式、,而^ δ亥外 ;貞;㈣該運作模式轉換為一簡報播放模式; '、「使用者觸碰該觸控螢幕的該手勢。 歼。 外掛Ζ如申請專利範圍第6項所述之電子裝置,其中該 合 <貞、、、、'、更包括偵測該應用模組的一視窗是否被致能,而 本紙’則到邊應用模組的該視窗被致能時,開始偵測該使用 者觸,觸控f幕的該手勢。201246025 VII. Patent application scope: 1. A gesture control method for an electronic device having a touch screen, the method comprising the steps of: installing an external program on an application of the electronic device; when the application is started Simultaneously launching the plug-in to detect a gesture of a user touching the touch screen; using the plug-in to convert the gesture to a control command for executing a function of the application; and transmitting the control command to the An application to control the application to perform this function. 2. The gesture control method of claim 1, wherein the step of initiating the plug-in to detect the gesture of the user touching the touch screen comprises: using the plug-in to open the touch screen A full-screen transparent window on the top layer to detect the user's gesture of touching the touch screen. 3. The gesture control method of claim 1, wherein the step of initiating the plug-in to detect the gesture of the user touching the touch screen comprises: using the δ海 plug-in to the electronic device - the operating system registers a gesture function, which causes the operating system to receive the location 'fields of the plurality of touchstone sub-points detected by the touch screen to touch the gesture of the touch screen by the touch screen user; and receive the use of the plug-in The gesture judged by the operating system. 4. The gesture control method as described in the scope of the patent application, wherein the step of detecting the gesture of the user touching the touch screen by the S 14 201246025 further comprises: detecting by using the plugin An operation mode of the application; and detecting that the user touches the touch screen when detecting that the operation mode of the application is switched to the presentation mode. 5. The gesture control method of claim 1, wherein the step of initiating the plug-in to detect the gesture of the user touching the touch screen further comprises: detecting the application by using the plug-in Whether a window is enabled or not; and when the window detecting the application is enabled, detecting the gesture of the user touching the touch screen. 6·—A kind of electronic device, including: '丨 only W Ί 巾 啊 啊 姚 Yao Yao I touched the stone and point; • Application module 'installed on the electronic device; and = plug-in module, installed in the application module When the group is started, the swaying module is activated to detect a gesture of the screen, and the gesture is converted to execute the application module to scream the wei. " As claimed in the scope of claim 6, the electronic shock, wherein the ice window, 3 open a full screen transparent on the top of the touch screen ~ see the user touch the touch screen The gesture. 8. The electronic device as claimed in claim 6, further comprising: 15 201246025 points of the plurality of touches detected by the screen, wherein the domain is _ the user touches the touch screen Yes, the two modules: the module further includes registering with the operating system module - the hand accepting the gesture determined by the operating system module. Gesture function 9. As described in item 6 of the patent application scope, the group further includes detecting the operation mode of the application module, and ^ δ 亥 outside; 贞; (4) converting the operation mode to a presentation mode; The user touches the gesture of the touch screen. 外. The electronic device of claim 6, wherein the combination <贞,,,, ', further includes detecting the application mode Whether a window of the group is enabled, and the paper is used to detect the gesture of the user touch and touch the screen when the window of the application module is enabled.
TW100116694A 2011-05-12 2011-05-12 Control method and electronic apparatus using gestures TWI442278B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW100116694A TWI442278B (en) 2011-05-12 2011-05-12 Control method and electronic apparatus using gestures

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW100116694A TWI442278B (en) 2011-05-12 2011-05-12 Control method and electronic apparatus using gestures

Publications (2)

Publication Number Publication Date
TW201246025A true TW201246025A (en) 2012-11-16
TWI442278B TWI442278B (en) 2014-06-21

Family

ID=48094460

Family Applications (1)

Application Number Title Priority Date Filing Date
TW100116694A TWI442278B (en) 2011-05-12 2011-05-12 Control method and electronic apparatus using gestures

Country Status (1)

Country Link
TW (1) TWI442278B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI493437B (en) * 2013-06-19 2015-07-21 義隆電子股份有限公司 Method of opening window control bar by identification of edge swipe gesture and touch system using the method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI493437B (en) * 2013-06-19 2015-07-21 義隆電子股份有限公司 Method of opening window control bar by identification of edge swipe gesture and touch system using the method

Also Published As

Publication number Publication date
TWI442278B (en) 2014-06-21

Similar Documents

Publication Publication Date Title
AU2017202901B2 (en) Information display apparatus having at least two touch screens and information display method thereof
JP5980913B2 (en) Edge gesture
JP6038898B2 (en) Edge gesture
US20110050599A1 (en) Electronic device with touch input function and touch input method thereof
US20120304131A1 (en) Edge gesture
KR20140046346A (en) Multi display apparatus and method for contorlling thereof
JP2010020762A (en) Touch input on touch sensitive display device
US20140157128A1 (en) Systems and methods for processing simultaneously received user inputs
BR102013006388A2 (en) Computer reading method, device and medium for changing the size of the allowed touch region of a touchscreen
TW201428597A (en) Touch screen electronic device and control method thereof
US20110157015A1 (en) Method of generating multi-touch signal, dongle for generating multi-touch signal, and related control system
TW201329840A (en) Method and system for controlling display of electronic device
TW201433970A (en) Electronic device, controlling method thereof, and computer program product
TWI643117B (en) Secondary browsing system and method
US10678336B2 (en) Orient a user interface to a side
TW201246025A (en) Control method and electronic apparatus using gestures
US20120013551A1 (en) Method for interacting with an application in a computing device comprising a touch screen panel
WO2016095515A1 (en) Display method and display terminal
TW201101130A (en) Touch operation method and operation method of electronic device
Gomes et al. DisplayCover: A Tablet Keyboard with an Embedded Thin-Film Touchscreen Display
US9182823B2 (en) Actuating haptic element of a touch-sensitive device
TW201220024A (en) Portable electronic device
TW201118704A (en) Method for controlling a touch-sensitive display and portable device using the same
JP2017167846A (en) Display device, display method, and display program
TW201520880A (en) Method for adjusting user interface and electronic apparatus using the same