BR112023003482A2 - Método de entrada de texto e aparelho baseado em teclado virtual - Google Patents

Método de entrada de texto e aparelho baseado em teclado virtual

Info

Publication number
BR112023003482A2
BR112023003482A2 BR112023003482A BR112023003482A BR112023003482A2 BR 112023003482 A2 BR112023003482 A2 BR 112023003482A2 BR 112023003482 A BR112023003482 A BR 112023003482A BR 112023003482 A BR112023003482 A BR 112023003482A BR 112023003482 A2 BR112023003482 A2 BR 112023003482A2
Authority
BR
Brazil
Prior art keywords
hand
virtual keyboard
finger
image
state
Prior art date
Application number
BR112023003482A
Other languages
English (en)
Inventor
Yuan Jiajie
Liu Siwei
Zhang Menghan
Wang Haitao
Zhang Peng
Original Assignee
Huawei Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Tech Co Ltd filed Critical Huawei Tech Co Ltd
Publication of BR112023003482A2 publication Critical patent/BR112023003482A2/pt

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1662—Details related to the integrated keyboard
    • G06F1/1673—Arrangements for projecting a virtual keyboard
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Biomedical Technology (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

MÉTODO DE ENTRADA DE TEXTO E APARELHO BASEADO EM TECLADO VIRTUAL. A presente invenção refere-se a um método e aparelho de entrada de texto com base em um teclado virtual, os quais referem ao campo de interação humano-computador, e resolvem um problema de como completar uma entrada de texto com base no teclado virtual. O método inclui: Um dispositivo eletrônico detecta pontos-chave de uma primeira mão com base em uma imagem que inclui a primeira mão após obter a imagem que inclui a primeira mão (301), e projeta um teclado virtual sobre a primeira mão com base nos pontos-chave da primeira mão (302). Ainda, após obter uma imagem que inclui a primeira mão e um dedo de uma segunda mão (303), o dispositivo eletrônico identifica, com base na imagem que inclui a primeira mão e o dedo da segunda mão, um estado de contato ou um estado de pressionamento entre o dedo da segunda mão e a primeira mão (304). Quando o dedo da segunda mão e a primeira mão estão no estado de contato ou no estado de pressionamento, o dispositivo eletrônico determina o texto inserido com base em uma localização na qual o dedo da segunda mão toca ou pressiona a primeira mão (305).
BR112023003482A 2020-08-26 2021-08-20 Método de entrada de texto e aparelho baseado em teclado virtual BR112023003482A2 (pt)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010874085.1A CN114115693B (zh) 2020-08-26 2020-08-26 一种基于虚拟键盘输入文本的方法及装置
PCT/CN2021/113839 WO2022042449A1 (zh) 2020-08-26 2021-08-20 一种基于虚拟键盘输入文本的方法及装置

Publications (1)

Publication Number Publication Date
BR112023003482A2 true BR112023003482A2 (pt) 2023-04-11

Family

ID=80352619

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112023003482A BR112023003482A2 (pt) 2020-08-26 2021-08-20 Método de entrada de texto e aparelho baseado em teclado virtual

Country Status (7)

Country Link
US (1) US20230195301A1 (pt)
EP (1) EP4195019A4 (pt)
JP (1) JP2023538687A (pt)
KR (1) KR20230051704A (pt)
CN (1) CN114115693B (pt)
BR (1) BR112023003482A2 (pt)
WO (1) WO2022042449A1 (pt)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20240028819A (ko) * 2022-08-25 2024-03-05 한국전자통신연구원 스마트 안경 및 그것의 동작 방법
CN115293938B (zh) * 2022-09-28 2023-07-28 深圳市卓帆技术有限公司 一种基于vr技术的考试方法和系统
US20240219997A1 (en) * 2023-01-03 2024-07-04 Meta Platforms Technologies, Llc Extended Reality User Interfaces for Hand-based Input
CN116400798A (zh) * 2023-01-31 2023-07-07 维沃移动通信有限公司 键盘显示方法、装置、电子设备及介质

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0554492B1 (en) * 1992-02-07 1995-08-09 International Business Machines Corporation Method and device for optical input of commands or data
US8228315B1 (en) * 2011-07-12 2012-07-24 Google Inc. Methods and systems for a virtual input device
US20150323998A1 (en) * 2014-05-06 2015-11-12 Qualcomm Incorporated Enhanced user interface for a wearable electronic device
CN104461004B (zh) * 2014-12-12 2018-04-10 北京奇宝科技有限公司 一种可穿戴智能设备
CN106095309A (zh) * 2016-06-03 2016-11-09 广东欧珀移动通信有限公司 终端的操作控制方法及装置
WO2019079790A1 (en) * 2017-10-21 2019-04-25 Eyecam, Inc ADAPTIVE GRAPHIC USER INTERFACE SYSTEM
CN110414393A (zh) * 2019-07-15 2019-11-05 福州瑞芯微电子股份有限公司 一种基于深度学习的自然交互方法及终端
CN111237985B (zh) * 2020-01-17 2022-02-01 宁波奥克斯电气股份有限公司 一种空调器的控制方法、激光投射控制系统和空调器

Also Published As

Publication number Publication date
WO2022042449A1 (zh) 2022-03-03
EP4195019A1 (en) 2023-06-14
US20230195301A1 (en) 2023-06-22
CN114115693B (zh) 2024-07-19
KR20230051704A (ko) 2023-04-18
EP4195019A4 (en) 2024-03-06
CN114115693A (zh) 2022-03-01
JP2023538687A (ja) 2023-09-08

Similar Documents

Publication Publication Date Title
BR112023003482A2 (pt) Método de entrada de texto e aparelho baseado em teclado virtual
US20070137901A1 (en) Micro-keyboard simulator
US20130207920A1 (en) Hand and finger registration for control applications
AU2003244973A1 (en) Automatically adaptable virtual keyboard
GB2440683A (en) Method and apparatus for data entry input
US20090326915A1 (en) Translation system, translation program, and bilingual data generation method
CN102645980A (zh) 触摸屏的软件辅助实体键盘
ATE521934T1 (de) Zellen- und zeileneingabefeld
ES2187556T3 (es) Detector de proximidad de varias entradas y sistema tectil.
BR112013006281A2 (pt) dispositivo para introdução de dados em braille, método correspondente e produto de programa de computador
CN106445369A (zh) 一种输入的方法和装置
JP2009009252A (ja) タッチ式入力装置
TW200638240A (en) Electronic device and its keyboard system and key status detecting method thereof
JP2010257163A (ja) タッチタイプが可能なタッチパネルの入力装置および入力補助具
US9785252B2 (en) Method for inputting multi-language texts
US20150309590A1 (en) Inputting method and associated electronic device
CN103777777A (zh) 具有文本输入功能的钢琴键盘及其文本输入法
MacKenzie et al. Reducing visual demand for gestural text input on touchscreen devices
TN2016000116A1 (en) An indian language keypad
LV15672A (lv) Ergonomiska tastatūra
US10884517B2 (en) Input device and electronic apparatus comprising same
CN104423614A (zh) 一种键盘布局方法、装置及电子设备
CN103076987A (zh) 手写输入法
KR101576931B1 (ko) 다단계 입력정보를 가지는 키보드
KR101263013B1 (ko) 문자 입력 방법