CA2970035C - Gaze based text input systems and methods - Google Patents

Gaze based text input systems and methods Download PDF

Info

Publication number
CA2970035C
CA2970035C CA2970035A CA2970035A CA2970035C CA 2970035 C CA2970035 C CA 2970035C CA 2970035 A CA2970035 A CA 2970035A CA 2970035 A CA2970035 A CA 2970035A CA 2970035 C CA2970035 C CA 2970035C
Authority
CA
Canada
Prior art keywords
user
gaze
text
display
icon
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2970035A
Other languages
English (en)
French (fr)
Other versions
CA2970035A1 (en
Inventor
Per Ola Kristensson
Keith VERTANEN
Morten MJELDE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tobii Dynavox AB
Original Assignee
Tobii AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tobii AB filed Critical Tobii AB
Publication of CA2970035A1 publication Critical patent/CA2970035A1/en
Application granted granted Critical
Publication of CA2970035C publication Critical patent/CA2970035C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0236—Character input methods using selection techniques to select from displayed items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0237—Character input methods using prediction or retrieval techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
CA2970035A 2014-09-02 2015-09-02 Gaze based text input systems and methods Active CA2970035C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462044817P 2014-09-02 2014-09-02
US62/044,817 2014-09-02
PCT/US2015/048154 WO2016036862A1 (en) 2014-09-02 2015-09-02 Gaze based text input systems and methods

Publications (2)

Publication Number Publication Date
CA2970035A1 CA2970035A1 (en) 2016-03-10
CA2970035C true CA2970035C (en) 2021-04-20

Family

ID=54140700

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2970035A Active CA2970035C (en) 2014-09-02 2015-09-02 Gaze based text input systems and methods

Country Status (6)

Country Link
US (2) US10082864B2 (es)
EP (1) EP3189398B1 (es)
CN (1) CN107209552B (es)
CA (1) CA2970035C (es)
ES (1) ES2788872T3 (es)
WO (1) WO2016036862A1 (es)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107209552B (zh) 2014-09-02 2020-10-27 托比股份公司 基于凝视的文本输入系统和方法
US10275023B2 (en) * 2016-05-05 2019-04-30 Google Llc Combining gaze input and touch surface input for user interfaces in augmented and/or virtual reality
WO2017221516A1 (ja) * 2016-06-21 2017-12-28 ソニー株式会社 情報処理装置及び情報処理方法
US10353475B2 (en) 2016-10-03 2019-07-16 Microsoft Technology Licensing, Llc Automated E-tran application
US10936872B2 (en) 2016-12-23 2021-03-02 Realwear, Inc. Hands-free contextually aware object interaction for wearable display
US11507216B2 (en) 2016-12-23 2022-11-22 Realwear, Inc. Customizing user interfaces of binary applications
US10620910B2 (en) 2016-12-23 2020-04-14 Realwear, Inc. Hands-free navigation of touch-based operating systems
US11099716B2 (en) 2016-12-23 2021-08-24 Realwear, Inc. Context based content navigation for wearable display
US10484530B2 (en) 2017-11-07 2019-11-19 Google Llc Sensor based component activation
CN110018733B (zh) * 2018-01-10 2025-11-21 北京三星通信技术研究有限公司 确定用户触发意图的方法、设备和存储器设备
AU2019210707B2 (en) * 2018-01-25 2024-09-19 Psykinetic Pty Ltd Eye-typing method, system and computer readable medium
US10528131B2 (en) * 2018-05-16 2020-01-07 Tobii Ab Method to reliably detect correlations between gaze and stimuli
US10650100B2 (en) * 2018-06-08 2020-05-12 International Business Machines Corporation Natural language generation pattern enhancement
CN112130786B (zh) * 2019-06-24 2023-02-17 上海博泰悦臻网络技术服务有限公司 一种双屏交互方法及交互装置
CN110457699B (zh) * 2019-08-06 2023-07-04 腾讯科技（深圳）有限公司 一种停用词挖掘方法、装置、电子设备及存储介质
KR102686451B1 (ko) 2020-10-09 2024-07-19 구글 엘엘씨 시선 데이터를 이용한 텍스트 레이아웃 해석
US11503998B1 (en) 2021-05-05 2022-11-22 Innodem Neurosciences Method and a system for detection of eye gaze-pattern abnormalities and related neurological diseases
CN113704623B (zh) * 2021-08-31 2024-04-16 平安银行股份有限公司 一种数据推荐方法、装置、设备及存储介质
US12501263B2 (en) 2022-04-29 2025-12-16 T-Mobile Usa, Inc. Authenticate a user before performing a sensitive operation associated with a UE in communication with a wireless telecommunication network
FR3136081A1 (fr) * 2022-05-31 2023-12-01 Orange Lecteur augmenté et procédé de lecture augmentée de textes

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1943583B1 (en) * 2005-10-28 2019-04-10 Tobii AB Eye tracker with visual feedback
CN101515199B (zh) * 2009-03-24 2011-01-05 北京理工大学 一种基于视线跟踪和p300脑电电位的字符输入装置
GB201003628D0 (en) * 2010-03-04 2010-04-21 Touchtype Ltd System and method for inputting text into electronic devices
US20120086645A1 (en) * 2010-10-11 2012-04-12 Siemens Corporation Eye typing system using a three-layer user interface
CN101968715B (zh) * 2010-10-15 2012-10-31 华南理工大学 一种基于脑机接口鼠标控制的因特网浏览方法
KR101891786B1 (ko) * 2011-11-29 2018-08-27 삼성전자주식회사 아이 트래킹 기반의 사용자 기능 운용 방법 및 이를 지원하는 단말기
US8955973B2 (en) * 2012-01-06 2015-02-17 Google Inc. Method and system for input detection using structured light projection
US8917238B2 (en) * 2012-06-28 2014-12-23 Microsoft Corporation Eye-typing term recognition
CN103885743A (zh) 2012-12-24 2014-06-25 大陆汽车投资（上海）有限公司 结合注视跟踪技术的语音文本输入方法和系统
US20150364140A1 (en) * 2014-06-13 2015-12-17 Sony Corporation Portable Electronic Equipment and Method of Operating a User Interface
CN107209552B (zh) 2014-09-02 2020-10-27 托比股份公司 基于凝视的文本输入系统和方法

Also Published As

Publication number Publication date
CN107209552B (zh) 2020-10-27
US20190073026A1 (en) 2019-03-07
CN107209552A (zh) 2017-09-26
US20160062458A1 (en) 2016-03-03
ES2788872T3 (es) 2020-10-23
CA2970035A1 (en) 2016-03-10
US10551915B2 (en) 2020-02-04
WO2016036862A1 (en) 2016-03-10
EP3189398B1 (en) 2020-03-18
EP3189398A1 (en) 2017-07-12
US10082864B2 (en) 2018-09-25

Similar Documents

Publication Publication Date Title
US10551915B2 (en) Gaze based text input systems and methods
US11848000B2 (en) Transcription revision interface for speech recognition system
Dudley et al. Fast and precise touch-based text entry for head-mounted augmented reality with variable occlusion
US11126794B2 (en) Targeted rewrites
US20140372122A1 (en) Determining Word Sequence Constraints for Low Cognitive Speech Recognition
KR101671837B1 (ko) 시선 추적형 입력 장치
US20220013117A1 (en) Information processing apparatus and information processing method
Zhao et al. Eyesaycorrect: Eye gaze and voice based hands-free text correction for mobile devices
Ghosh et al. Eyeditor: Towards on-the-go heads-up text editing using voice and manual input
US20180074583A1 (en) Input device using gaze tracking
US11899904B2 (en) Text input system with correction facility
Kristensson et al. Understanding adoption barriers to dwell-free eye-typing: Design implications from a qualitative deployment study and computational simulations
KR20190105175A (ko) 전자 장치 및 이의 자연어 생성 방법
CN106537489B (zh) 用于识别包括单词序列的语音的方法和系统
EP3131093B1 (en) Information processing device, information processing method, and program
Shen et al. Ringgesture: A ring-based mid-air gesture typing system powered by a deep-learning word prediction framework
US20250181829A1 (en) Grammatical error detection utilizing large language models
KR101671839B1 (ko) 시선 추적형 입력 장치
Alharbi Text entry and error correction on touchscreens
US20250342321A1 (en) Processing, using generative model, content of user input and temporal encoding for the user input
Zhao Intelligent Multimodal Input Technologies on Mobile Devices
Su et al. Multimodal Silent Speech-based Text Entry with Word-initials Conditioned LLM
Cui Intelligent Gesture Input Technologies
CN117762422A (zh) 代码生成方法、装置、电子设备和存储介质
WO2025222031A1 (en) Virtual assistant model using gaze context information

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20170913