TW201201090A - Virtual keyboard input system - Google Patents

Virtual keyboard input system Download PDF

Info

Publication number
TW201201090A
TW201201090A TW99121391A TW99121391A TW201201090A TW 201201090 A TW201201090 A TW 201201090A TW 99121391 A TW99121391 A TW 99121391A TW 99121391 A TW99121391 A TW 99121391A TW 201201090 A TW201201090 A TW 201201090A
Authority
TW
Taiwan
Prior art keywords
virtual keyboard
finger
display
type
control module
Prior art date
Application number
TW99121391A
Other languages
Chinese (zh)
Inventor
kun-rong Wu
Xu-Yong Zheng
Zhi-Zhang Yu
Original Assignee
Chunghwa Telecom Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chunghwa Telecom Co Ltd filed Critical Chunghwa Telecom Co Ltd
Priority to TW99121391A priority Critical patent/TW201201090A/en
Publication of TW201201090A publication Critical patent/TW201201090A/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

A virtual keyboard input system is disclosed, in which the position of each key of a virtual keyboard is arranged corresponding to a certain position in a video camera screen, such that the position of a finger in the video camera screen represents pressing a corresponding key of the virtual keyboard; in addition, the size variation of a finger/palm in the video camera screen is used to determine whether the corresponding key is pressed or not.

Description

201201090 六、發明說明: 【發明所屬之技術領域】 本發明係有關於包含虛擬鍵盤的輸入系統,而特別是指利 用視頻訊號檢測所達成之輸入方式。 【先前技術】 電腦或電信設備之虛擬鍵盤,其習知技術為以電容性或 φ 電阻性感測器來檢測手指位置按壓動作;然該虛擬鍵盤屬 接觸式,因此在衛生考量上較不適宜,且易受到灰塵或水 分的影響而產生不正確的信號。 中華民國發明專利第146530號「對電子裝置輸入資料 的方法、包含有用以儲存指令之媒體的物品、以及影像處 理系統」,係以在一表面投射一影像並檢測使用者對於該 投射影像之動作;此發明由&係、對該投射影像及使用者動201201090 VI. Description of the Invention: TECHNICAL FIELD OF THE INVENTION The present invention relates to an input system including a virtual keyboard, and particularly to an input method achieved by video signal detection. [Prior Art] A virtual keyboard of a computer or a telecommunication device has a conventional technique of detecting a finger position pressing action by a capacitive or φ resistance sensor; however, the virtual keyboard is a contact type, and thus is not suitable for hygiene considerations. It is susceptible to dust or moisture and produces an incorrect signal. The Republic of China Invention Patent No. 146530 "Method for inputting data to an electronic device, an article containing a medium for storing instructions, and an image processing system" is to project an image on a surface and detect a user's action on the projected image. This invention is performed by &, the projected image and the user

由此可見,上 ’上述習用方式仍有諸多缺失 設計’而亟待加以改良。 以致檢測錯誤。 ’實非一良善之 生的各項缺點,乃亟 ’心研究後,終於成 本案發明人鑑於上述習用方式所衍生备 思加以改良創新,並經多年苦心孤詣潛心 功研發完成本件虛擬鍵盤輸入系 201201090 本發月之目的在於改良上述先前技術⑴接觸式檢測 方式的衛生問題及受灰塵或水分影響等缺點以及⑺以 投射影像及使用者動作的綜合效果來檢測的相互遮蔽之 缺點,以提出一種創新之虛擬鍵盤輸入系統。 【發明内容】 達成上述發明目的之虛擬鍵盤輸入系統,主要係由取像 攝影機、手指掌追蹤判斷與按鍵债測模組、虛擬鍵盤與攝 影機晝面座標對照模組、虛擬鍵盤控制模組、顯示裝置所 組成;主要係以虛擬鍵盤控制模組將虛擬鍵盤顯示於顯示 裝置上,一旦由手指掌追蹤判斷與按鍵偵測模組追蹤到手 指的初始後,就可設定手指初始位置在虛擬鍵盤的適當位 置,再以手指掌的動作指示移動手指所在虛擬鍵盤的位 置’在螢幕上更動顯示虛擬鍵盤的部位,再以檢測手指掌 在該攝影機晝面位置的大小變化情形來判斷使用者是否 按壓輸入該對應鍵。 【實施方式】 本系統架構如圖-所示,主要是由取像攝影機ι〇、手 指掌追蹤判斷與按鍵谓測模,组20、虛擬鍵盤與攝影機畫 面座標對照模組30、虛擬鍵盤控制模組4〇、顯示裝置5〇 所組成;其中,當使用者將手指掌置入取像攝影機10的 201201090 取像範圍時,手指掌追蹤判斷與按鍵偵測模組2〇 一旦追 蹤到手指的初始後’就可設定手指初始位置在虛擬鍵盤的 適當位置’再以手指掌的動作指示移動手指所在虛擬鍵盤 的位置,將此位置座標傳至虛擬鍵盤與攝影機晝面座標對 照模組30 ’虛擬鍵盤與攝影機畫面座標對照模組則將 手指座標位置所對應的虛擬鍵盤鍵位代號傳送給虛擬鍵 盤控制模組40;手指掌追蹤判斷與按鍵債測模組2〇並同 #時摘測是否有按鍵的動作並將偵測結果傳給虛擬鍵盤控 制模組40;虛擬鍵盤控制模組4〇對所接收到來自虛擬鍵 盤與攝影機畫面座標對照模組3〇之最新鍵位代號,若亦 接收到來自手指掌追蹤判斷與按鍵偵測模組的按鍵訊 息,則鍵位代號即為使用者輸入之結果。虛擬鍵盤控制模 組40並且依據來自虛擬鍵盤與攝影機畫面座標對照模组 3〇的鍵位代號來控制虛擬鍵盤的顯示方式如下:若接收 到來自手指掌追蹤判斷與按鍵㈣模組2q的按鍵訊息, 示裝置5。所顯示的虛擬鍵盤該鍵位以第一類顯示 ^顯不、其他鍵位以第三類顯示類型來顯示;若未接 息二自手指掌追蹤判斷與按㈣測模組2。的按鍵訊 。1將顯不裝置50所顯示的虛擬鍵盤該鍵位 顯示類型來顯示、其他鍵位以第--類顯示類型m 類.“類型來顯" 第一類顯不類型、第三類顯示類型可為顯 不區域邊緣加實線、顯示區域邊緣加虛線 :為顯 肩不區域顏色 201201090 加深、顯示區域顏色變淺、顯 匕埤反白、顯不區域 殊顏色呈現、顯示區域以浮水印呈 ' 見、員不區域以不 體或不同粗、細呈現等之任意Μ的三種。 取像攝影機ίο可為任意之攝影機;虚擬鍵盤與攝影機 畫面座標對照模組30可以是依照虛擬鍵盤配置方式來將 攝影機畫面依適當比例切割成—對一的對應區域;顯 置5〇可為任意種類及數量之顯示器或投影機。取像攝: 機與顯示裝置位於使用者科而十 ^ 使用者對面或者下方’以使用者觀看顯 不裝置而做出按鍵動作時,取像攝影機能拍取手指動作為 原則,圖二所示為取像攝影機架設位置實施例示意圖。·"、 圖三為手指掌追蹤錢與按鍵㈣模组2Q的實施例产 程圖’手指掌追蹤判斷與按㈣測模組2〇以谓測影像晝 面中像素的色彩值與膚色的色彩值接近的區塊做為手指 掌區域,再以此區塊上緣做為指定手指目前所對應虛擬鍵 盤位置之依據’並根據手指掌擺動動作來移動顯示虛擬鍵 盤之部位;上述手指掌區$面積在連續的幾個晝面中若有 從小明I員變大後又回復到小,且這段過程#時間長約略等 於預設的按鍵過程時間長,則視為使用者有按鍵的動作, 否則即無按鍵動作;以此判斷方式,則不經意的上下左右 前後移動抖動不易誤判為有按鍵的動作。 本發明所提供之虛擬鍵盤輪入系統,與其他習用技術相 互比較時,更具有下列之優點:i.屬於非接觸式的輸入方 201201090 式’因此沒有衛生問題。2·將虛擬鍵盤之影像顯示與使用 者動作之取像分開處理,因此不會有相互遮蔽之問題。 上列詳細說明乃針對本發明之一可行實施例進行具體 說明,惟該實施例並非用以限制本發明之專利範圍,凡未 脫離本發明技藝精神所為之等效實施或變更,均應包含於 本案之專利範圍中。 綜上所述,本案不僅於技術思想上確屬創新,並具備習 •用之傳統方法所不及之上述多項功效,已充分符合新賴性 及進步性之法定發明專利要件,爰依法提出申請,懇請 貴局核准本件發明專利申請案,以勵創作,至感德便。 【圖式簡單說明】 凊參閱以下有關本發明之詳細說明及其附圖,將可進一 步瞭解本發明之技術内容及其目的功效;有關附圖為: 鲁 圖一為本發明虛擬鍵盤輸入系統之架構圖; 圖二為本發明之取像攝影機架設位置實施例示意圖; 圖二為本發明虛擬鍵盤輸入系統之手指掌追縱判斷與 按鍵偵測模組的實施例流程圖。 【主要元件符號說明】 10 :取像攝影機 20 :手指掌追蹤判斷與按鍵偵測模組 7 201201090 30 :虛擬鍵盤與攝影機畫面座標對照模組 40 :虛擬鍵盤控制模組key pad模組 50 :顯示裝置 8It can be seen that there are still many missing designs in the above-mentioned conventional methods, which need to be improved. So that the error is detected. 'It’s not a shortcoming of a good life, but after the study of the heart, finally the inventor of the cost case made improvements and innovations based on the above-mentioned methods of use, and after years of painstaking efforts to complete the virtual keyboard input system 2010201090 The purpose of this month is to improve the above-mentioned prior art (1) the sanitary problems of the contact detection method and the disadvantages such as the influence of dust or moisture, and (7) the shortcomings of mutual shielding detected by the combined effect of the projected image and the user's motion, to propose an innovation. The virtual keyboard input system. SUMMARY OF THE INVENTION The virtual keyboard input system for achieving the above object is mainly composed of an image capturing camera, a finger palm tracking judgment and a button debt testing module, a virtual keyboard and a camera kneading coordinate control module, a virtual keyboard control module, and a display. The device is composed of a virtual keyboard control module to display the virtual keyboard on the display device. Once the finger palm tracking and the button detection module track the initiality of the finger, the initial position of the finger can be set on the virtual keyboard. In the appropriate position, the position of the virtual keyboard where the finger is moved is indicated by the action of the palm of the finger. The part of the virtual keyboard is displayed on the screen, and then the size of the position of the palm of the camera is detected to determine whether the user presses the input. The corresponding key. [Embodiment] The system architecture is shown in the figure--mainly by the camera ι〇, the finger palm tracking judgment and the button pre-measurement mode, the group 20, the virtual keyboard and the camera screen coordinate control module 30, and the virtual keyboard control mode. The group 4〇 and the display device 5〇 are composed; wherein, when the user places the palm of the finger into the image capturing range of the camera 10 of the image capturing camera 10, the finger palm tracking determination and the button detecting module 2 are tracked to the finger. After the initial 'set the initial position of the finger in the appropriate position of the virtual keyboard', the position of the virtual keyboard where the finger is moved is indicated by the action of the palm of the finger, and the position coordinate is transmitted to the virtual keyboard and the camera coordinate control module 30 'virtual The keyboard and camera screen coordinate control module transmits the virtual keyboard key code corresponding to the finger coordinate position to the virtual keyboard control module 40; when the finger tracking judgment and the button debt measurement module are the same as the #, it is checked whether there is The action of the button is transmitted to the virtual keyboard control module 40; the virtual keyboard control module 4 receives the picture from the virtual keyboard and the camera The key coordinate code of the face coordinate control module 3〇, if the button information from the finger palm tracking judgment and the button detection module is also received, the key code is the result of the user input. The virtual keyboard control module 40 controls the virtual keyboard according to the key code from the virtual keyboard and the camera screen coordinate control module 3〇 as follows: if the button information from the finger palm tracking judgment and the button (4) module 2q is received , display device 5. The displayed virtual keyboard key is displayed in the first category. The other keys are displayed in the third type of display type. If the information is not received, the finger tracking is judged and the (four) test module 2 is pressed. Button press. 1 will display the virtual keyboard displayed by the device 50. The key display type is displayed, and the other keys are displayed in the first class type m class. "Type to display", the first type of display type, the third type of display type A solid line may be added to the edge of the display area, and a dotted line may be added to the edge of the display area: the depth of the display area is not deepened, the color of the display area is darkened, the color of the display area is lightened, the color is highlighted, the color is not displayed, and the display area is watermarked. 'Seeing, not arranging, arranging, arranging, arranging, arranging, arranging, arranging, arranging, arranging, arranging, arranging, arranging Cut the camera screen into the corresponding area of the right one according to the appropriate ratio; display 5 〇 can be any type and number of displays or projectors. Take the image: the machine and display device are located in the user section and the user is opposite Below, when the user presses the display device to make a button action, the image capture camera can take the finger action as a principle, and the second embodiment shows the image capture frame position. Intention.·", Figure 3 is the finger palm tracking money and button (4) module 2Q embodiment production process diagram 'finger palm tracking judgment and press (four) test module 2 谓 to measure the color value and skin color of the pixel in the image The block whose color value is close to is used as the palm area, and then the upper edge of the block is used as the basis of the virtual keyboard position corresponding to the designated finger, and the part of the virtual keyboard is moved according to the swinging motion of the palm; the above finger palm If the area of the area is increased from Xiaoming I to a small number in several consecutive faces, and the process time is approximately equal to the preset button process time, it is considered that the user has a button. Action, otherwise there is no button action; in this way, the inadvertent movement of the up, down, left, and right movements is not easy to be mistaken for the action of having a button. The virtual keyboard wheeling system provided by the present invention has more comparison with other conventional technologies. The following advantages: i. is a non-contact input type 201201090 type 'There is no health problem. 2. Separate the image display of the virtual keyboard from the image of the user action The above detailed description is not intended to limit the scope of the invention, and is not intended to limit the scope of the invention. Equivalent implementation or change shall be included in the patent scope of this case. In summary, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of learning and use. Responsible and progressive statutory invention patent requirements, 提出 apply in accordance with the law, and ask your bureau to approve the invention patent application, to encourage creation, to the sense of convenience. [Simplified description] 凊 Refer to the following detailed description of the invention And the accompanying drawings, the technical contents of the present invention and the functions thereof can be further understood; the related drawings are: Lutu 1 is the architecture diagram of the virtual keyboard input system of the present invention; FIG. 2 is a flow chart of an embodiment of a finger-carrying judgment and a button detection module of a virtual keyboard input system according to the present invention; Fig. [Main component symbol description] 10: Image camera 20: Finger palm tracking judgment and button detection module 7 201201090 30: Virtual keyboard and camera screen coordinate control module 40: Virtual keyboard control module key pad module 50: Display Device 8

Claims (1)

201201090 七、申請專利範圍:201201090 VII. Patent application scope: .位规慨现篮榭入系統,主要包含取像攝影機、手指 掌追蹤判斷與按鍵偵測模組、虛擬鍵盤與攝影機畫面座 標對照模組、虛擬鍵盤控制模組、顯示裝置所組成;其 中’當使用者將手指掌置入取像攝影機的取像範圍時, 手指掌追縱判斷與按鍵偵測模組一旦追蹤到手指的初 始後’就可設定手指初始位置在虛擬鍵盤的適當位置, 再以手指掌的動作指示移動手指所在虛擬鍵盤的位 置’將此位置座標傳至虛擬鍵盤與攝影機晝面座標對照 模組,虛擬鍵盤與攝影機畫面座標對照模組則將手指座 標位置所對應的虛擬鍵盤鍵位代號傳送給虛擬鍵盤控 制模組;手指掌追蹤判斷與按鍵偵測模組並同時偵測是 有按鍵的動作並將偵測結果傳給虛擬鍵盤控制模 組;虛擬鍵盤控制模組對所接收到來自虛擬鍵盤與攝影 機畫面座標對照模組之最新鍵位代號,若亦接收到來自 口釦掌追蹤判斷與按鍵偵測模組的按鍵訊息,則鍵位代 號即為使用者輸入之結果。 2.如申請專利範圍第i項所述之虛擬鍵盤輪入系統,其 中之手指掌追蹤判斷與按鍵偵測模組以偵測影像晝面 中像素的色彩值與膚色的色彩值接近的區塊做為手指 掌區域,再以此區塊上緣做為指定手指目前所對應虛擬 201201090 鍵盤位置;上述手指掌區域面積在連續的幾個晝面中若 有從小明顯變大後又回復到小’且這段過程的時間長約 略等於預設的按鍵過程時間長,則視為使用者有按鍵的 動作’否則即無按鍵動作。 如申請專利範圍第1項所述之虛擬鍵盤輸入系統,其 中之虛擬鍵盤與攝影機畫面座標對照模組可以是依照 虛擬鍵盤配置方式來將攝影機畫面依適當比例切割成 一對一的對應區域。The position of the current basket into the system, mainly including image camera, finger palm tracking and key detection module, virtual keyboard and camera screen coordinate control module, virtual keyboard control module, display device; When the user puts the palm of the finger into the image capturing range of the image capturing camera, the finger palm tracking determination and the key detection module can track the initial position of the finger after setting the initial position of the finger on the virtual keyboard. The position of the virtual keyboard where the finger is moved is indicated by the action of the palm of the finger. The coordinates of the position are transmitted to the virtual keyboard and the camera coordinate control module, and the virtual keyboard and the camera screen coordinate control module are the virtual keyboard corresponding to the finger coordinate position. The key code is transmitted to the virtual keyboard control module; the finger palm tracking judgment and the button detection module simultaneously detect the action of the button and transmit the detection result to the virtual keyboard control module; the virtual keyboard control module Received the latest key code from the virtual keyboard and the camera screen coordinate control module, if received from the mouth button Tracking detection module determines the key message key, the result is the number of keys on behalf of the user input. 2. The virtual keyboard wheeling system of claim i, wherein the finger tracking determination and the button detection module detect a block in which the color value of the pixel in the image plane is close to the color value of the skin color. As the area of the palm of the finger, the upper edge of the block is used as the virtual keyboard 201020100 corresponding to the designated finger; the area of the finger palm area is significantly smaller from the small number of consecutive sides and then returns to the small ' And the length of this process is slightly equal to the length of the preset button process, it is regarded as the action of the user having the button 'otherwise, there is no button action. For example, in the virtual keyboard input system described in claim 1, the virtual keyboard and the camera screen coordinate control module may be configured to cut the camera screen into a one-to-one corresponding area according to a virtual keyboard configuration manner. 如申請專利範圍第1項所述之虛擬鍵盤輸入系統,其 之虛擬鍵盤控制模組依據來自虛擬鍵盤與攝影機晝 面座標對照模組的鍵位代號來控制虛擬鍵盤的顯示方 下右接收到來自手指掌追蹤判斷與按鍵偵測模組 的按鍵訊息,則將顯示裝置所顯示的虛擬鍵盤該鍵位以 第一類顯示類型來顯示、其他鍵位以第三類顯示類型來For example, in the virtual keyboard input system described in claim 1, the virtual keyboard control module controls the display of the virtual keyboard according to the key code from the virtual keyboard and the camera coordinate control module. When the finger palm tracks and judges the button information of the button detection module, the virtual keyboard displayed on the display device is displayed in the first type of display type, and the other keys are displayed in the third type of display type. 顯示;若未接收到來自手指掌追蹤判斷與按鍵偵測模組 的按鍵訊息’則將顯示裝置所顯示的虛擬鍵盤該鍵位以 第二類顯示類型來顯示、其他鍵位以第三類顯示類型來 顯示β 如申π專利圍第4項所述之虛擬鍵盤輸入系統,其 :第-類顯不類型、第二類顯示類型、第三類顯示類型 可為顯不區域邊緣加實線、顯示區域邊緣加虛線、顯示 區域顏色加深、顯示區域顏色變淺、顯示區域反白、顯 10 201201090 示區域以特殊顏色呈現、顯示區域以浮水印呈現、顯示 區域以不同字體或不同粗細呈現等之任意不同的三種。 6.如申請專利範圍第1項所述之虛擬鍵盤輸入系統,其 中之顯示裝置可為任意種類及數量之顯示器或投影機。Display; if the button message from the finger palm tracking judgment and the button detection module is not received, the virtual keyboard displayed on the display device is displayed in the second type of display type, and the other keys are displayed in the third category. The type is used to display the virtual keyboard input system as described in Item 4 of the patent application, which may be: a first type of display type, a second type of display type, and a third type of display type may be a solid area edge plus a solid line, The edge of the display area is dotted with a dotted line, the color of the display area is deepened, the color of the display area is lightened, and the display area is highlighted. The display area is displayed in a special color, the display area is rendered by a watermark, and the display area is presented in different fonts or different thicknesses. Any of the three different. 6. The virtual keyboard input system of claim 1, wherein the display device can be any type and number of displays or projectors. 1111
TW99121391A 2010-06-30 2010-06-30 Virtual keyboard input system TW201201090A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW99121391A TW201201090A (en) 2010-06-30 2010-06-30 Virtual keyboard input system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW99121391A TW201201090A (en) 2010-06-30 2010-06-30 Virtual keyboard input system

Publications (1)

Publication Number Publication Date
TW201201090A true TW201201090A (en) 2012-01-01

Family

ID=46755669

Family Applications (1)

Application Number Title Priority Date Filing Date
TW99121391A TW201201090A (en) 2010-06-30 2010-06-30 Virtual keyboard input system

Country Status (1)

Country Link
TW (1) TW201201090A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI493433B (en) * 2013-08-28 2015-07-21 Acer Inc Covered image projecting method and portable electronic apparatus using the same
US9857971B2 (en) 2013-12-02 2018-01-02 Industrial Technology Research Institute System and method for receiving user input and program storage medium thereof
TWI703507B (en) * 2016-06-23 2020-09-01 香港商阿里巴巴集團服務有限公司 Human hand detection and tracking method and device
TWI789283B (en) * 2022-03-31 2023-01-01 群光電子股份有限公司 Inputting system for children assisted teaching and teaching order inputting device thereof

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI493433B (en) * 2013-08-28 2015-07-21 Acer Inc Covered image projecting method and portable electronic apparatus using the same
US9857971B2 (en) 2013-12-02 2018-01-02 Industrial Technology Research Institute System and method for receiving user input and program storage medium thereof
TWI703507B (en) * 2016-06-23 2020-09-01 香港商阿里巴巴集團服務有限公司 Human hand detection and tracking method and device
US10885639B2 (en) 2016-06-23 2021-01-05 Advanced New Technologies Co., Ltd. Hand detection and tracking method and device
US10885638B2 (en) 2016-06-23 2021-01-05 Advanced New Technologies Co., Ltd. Hand detection and tracking method and device
TWI789283B (en) * 2022-03-31 2023-01-01 群光電子股份有限公司 Inputting system for children assisted teaching and teaching order inputting device thereof

Similar Documents

Publication Publication Date Title
US8988372B2 (en) Obtaining physiological measurements using a portable device
Gustafson et al. Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device
CN104246682B (en) Enhanced virtual touchpad and touch-screen
TWI476633B (en) Tactile communication system
JP4609557B2 (en) Information processing apparatus and information processing method
US9317130B2 (en) Visual feedback by identifying anatomical features of a hand
GB2498299B (en) Evaluating an input relative to a display
TW200951777A (en) Image recognizing device, operation judging method, and program
CN107066137A (en) The apparatus and method of user interface are provided
US9348466B2 (en) Touch discrimination using fisheye lens
JP2012027796A (en) Information processor and control method of the same
US11009949B1 (en) Segmented force sensors for wearable devices
US10888228B2 (en) Method and system for correlating anatomy using an electronic mobile device transparent display screen
Hu et al. Bare-fingers touch detection by the button's distortion in a projector–camera system
CN104951213B (en) The method for preventing false triggering boundary slip gesture
US20180268568A1 (en) Color analysis and control using an electronic mobile device transparent display screen
TW201201090A (en) Virtual keyboard input system
JP2015018413A (en) Portable terminal, image display method, and program
TW200947317A (en) Touch-screen apparatus and image-capturing system thereof
US20180125605A1 (en) Method and system for correlating anatomy using an electronic mobile device transparent display screen
Yeh et al. Expanding Side Touch Input on Mobile Phones: Finger Reachability and Two-Dimensional Taps and Flicks Using the Index and Thumb
TW201234239A (en) Device and method for proximity gesture detection
JP6022867B2 (en) Display control apparatus, display system, display method, display control program, and recording medium
Neshati et al. EdgeSelect: Smartwatch data interaction with minimal screen occlusion
US10606473B2 (en) Display method, display device, and program