IL303037B2 - System and method for enabling communication through eye feedback - Google Patents

System and method for enabling communication through eye feedback

Info

Publication number
IL303037B2
IL303037B2 IL303037A IL30303723A IL303037B2 IL 303037 B2 IL303037 B2 IL 303037B2 IL 303037 A IL303037 A IL 303037A IL 30303723 A IL30303723 A IL 30303723A IL 303037 B2 IL303037 B2 IL 303037B2
Authority
IL
Israel
Prior art keywords
user
eye
gesture
communication
option
Prior art date
Application number
IL303037A
Other languages
English (en)
Hebrew (he)
Other versions
IL303037B1 (en
IL303037A (en
Inventor
Rishoni Shay
Kellner Tal
Kornberg Itai
Retzkin Or
Original Assignee
Eyefree Assisting Communication Ltd
Rishoni Shay
Kellner Tal
Kornberg Itai
Retzkin Or
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyefree Assisting Communication Ltd, Rishoni Shay, Kellner Tal, Kornberg Itai, Retzkin Or filed Critical Eyefree Assisting Communication Ltd
Publication of IL303037A publication Critical patent/IL303037A/en
Publication of IL303037B1 publication Critical patent/IL303037B1/en
Publication of IL303037B2 publication Critical patent/IL303037B2/en

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0008—Apparatus for testing the eyes; Instruments for examining the eyes provided with illuminating means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
    • A61B3/032—Devices for presenting test symbols or characters, e.g. test chart projectors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0236—Character input methods using selection techniques to select from displayed items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
IL303037A 2015-03-10 2016-03-02 System and method for enabling communication through eye feedback IL303037B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562130637P 2015-03-10 2015-03-10
PCT/IL2016/050235 WO2016142933A1 (en) 2015-03-10 2016-03-02 System and method for enabling communication through eye feedback

Publications (3)

Publication Number Publication Date
IL303037A IL303037A (en) 2023-07-01
IL303037B1 IL303037B1 (en) 2025-02-01
IL303037B2 true IL303037B2 (en) 2025-06-01

Family

ID=56879968

Family Applications (2)

Application Number Title Priority Date Filing Date
IL303037A IL303037B2 (en) 2015-03-10 2016-03-02 System and method for enabling communication through eye feedback
IL254315A IL254315A0 (en) 2015-03-10 2017-09-04 A system and method of communication through visual feedback

Family Applications After (1)

Application Number Title Priority Date Filing Date
IL254315A IL254315A0 (en) 2015-03-10 2017-09-04 A system and method of communication through visual feedback

Country Status (6)

Country Link
US (1) US11883101B2 (enExample)
EP (2) EP3268847A4 (enExample)
JP (2) JP7016263B2 (enExample)
CN (2) CN121116061A (enExample)
IL (2) IL303037B2 (enExample)
WO (1) WO2016142933A1 (enExample)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TR201613586A2 (tr) * 2016-09-28 2016-11-21 Kuersat Cagiltay Göz hareketleri̇ i̇le kontrol edi̇len elektroni̇k ve motorlu tekerlekli̇ sandalye si̇stemi̇
US11402909B2 (en) * 2017-04-26 2022-08-02 Cognixion Brain computer interface for augmented reality
JP6460425B2 (ja) * 2017-06-02 2019-01-30 本田技研工業株式会社 車両制御システム、車両制御方法、およびプログラム
CN111656304B (zh) * 2017-12-07 2023-10-17 艾弗里协助通信有限公司 通信方法及系统
CN108245748A (zh) * 2017-12-21 2018-07-06 北京怡和嘉业医疗科技股份有限公司 面罩、呼吸机系统及该呼吸机系统执行的方法
EP3506055B1 (en) * 2017-12-28 2024-09-11 Vestel Elektronik Sanayi ve Ticaret A.S. Method for eye-tracking calibration with splash screen
CN109002186B (zh) * 2018-06-28 2020-12-25 北京金山安全软件有限公司 一种输入预测方法及装置
US10966007B1 (en) * 2018-09-25 2021-03-30 Apple Inc. Haptic output system
US11393318B2 (en) * 2018-10-05 2022-07-19 Cleveland State University Systems and methods for privacy-aware motion tracking with automatic authentication
WO2020159784A1 (en) * 2019-02-01 2020-08-06 Apple Inc. Biofeedback method of modulating digital content to invoke greater pupil radius response
US10809637B1 (en) * 2019-05-30 2020-10-20 Applied Materials, Inc. Learning based digital corrections to compensate variations on lithography systems with multiple imaging units
IL268575B2 (en) 2019-08-07 2023-02-01 Eyefree Assisting Communication Ltd System and method for patient monitoring
SE546455C2 (en) 2019-08-23 2024-11-05 Your Speech Factory Ab Electronic device and method for eye-contact training
CN110619303A (zh) * 2019-09-16 2019-12-27 Oppo广东移动通信有限公司 注视点追踪方法、装置、终端及计算机可读存储介质
KR102128894B1 (ko) * 2019-10-10 2020-07-01 주식회사 메디씽큐 스마트 안경의 시선 트래킹 시스템 및 그 방법
US10860098B1 (en) 2019-12-30 2020-12-08 Hulu, LLC Gesture-based eye tracking
US12226330B2 (en) * 2020-10-07 2025-02-18 Jay Curtis Beavers Systems, methods, and techniques for eye gaze control of seat and bed positioning
JP7507482B2 (ja) * 2020-10-29 2024-06-28 パナソニックオートモーティブシステムズ株式会社 視線入力装置
DE102021110109A1 (de) * 2021-04-21 2022-10-27 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zum Erkennen von Augengesten eines Auges
ES2988871T3 (es) * 2021-06-30 2024-11-22 Tobii Ab Sistema de seguimiento ocular
EP4373388B1 (en) 2021-07-22 2025-06-18 Eyefree Assisting Communication Ltd. A system for communication with a patient based on the determined sedation state
CN113589958A (zh) * 2021-08-05 2021-11-02 西交利物浦大学 文本输入方法、装置、设备及存储介质
US12111964B2 (en) * 2021-10-28 2024-10-08 Life Drive LLC Drive manager for power wheelchair and related methods
JP7568301B2 (ja) * 2022-03-01 2024-10-16 日新電機工作株式会社 情報処理システム、情報処理方法、及び情報処理プログラム
US12032156B2 (en) * 2022-04-08 2024-07-09 Mirza Faizan Apparatus to enable differently abled users to communicate and a method thereof
US11995231B2 (en) * 2022-07-21 2024-05-28 Dell Products Lp System and method for headset haptic or audio confirmation feedback for gaze activation
US12204689B2 (en) * 2022-09-27 2025-01-21 Tobii Dynavox Ab Method, system, and computer program product for drawing and fine-tuned motor controls
US12204687B2 (en) * 2023-04-11 2025-01-21 Jay Curtis Beavers Systems, methods, and techniques for safely controlling devices using eye gaze control
CN116421135A (zh) * 2023-04-27 2023-07-14 北京京东拓先科技有限公司 视力测试方法、装置、电子设备及存储介质
EP4465247A1 (en) * 2023-05-17 2024-11-20 Tata Consultancy Services Limited Method and system for predicting distance of gazed objects using infrared (ir) camera
CN116708974B (zh) * 2023-08-01 2023-10-17 清华大学 一种头戴式主动视觉相机的通用摄像头干扰方法及系统
JP2025051735A (ja) * 2023-09-22 2025-04-04 ソフトバンクグループ株式会社 システム

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US577A (en) 1838-01-20 Uvtachine for threshing grain and shelling corn
US8120A (en) 1851-05-27 Cabkiaorb
US4836670A (en) * 1987-08-19 1989-06-06 Center For Innovative Technology Eye movement detector
US4973149A (en) * 1987-08-19 1990-11-27 Center For Innovative Technology Eye movement detector
US4950069A (en) * 1988-11-04 1990-08-21 University Of Virginia Eye movement detector with improved calibration and speed
JPH0749744A (ja) 1993-08-04 1995-02-21 Pioneer Electron Corp 頭部搭載型表示入力装置
US5912721A (en) * 1996-03-13 1999-06-15 Kabushiki Kaisha Toshiba Gaze detection apparatus and its method as well as information display apparatus
US6351273B1 (en) * 1997-04-30 2002-02-26 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display or screen
JP2000137789A (ja) 1998-10-29 2000-05-16 Sharp Corp 画像処理装置
US6456262B1 (en) 2000-05-09 2002-09-24 Intel Corporation Microdisplay with eye gaze detection
US6943754B2 (en) * 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US20050045373A1 (en) * 2003-05-27 2005-03-03 Joseph Born Portable media device with audio prompt menu
JP3673834B2 (ja) * 2003-08-18 2005-07-20 国立大学法人山口大学 眼球運動を用いた視線入力コミュニケーション方法
AU2005229076B2 (en) 2004-04-01 2011-09-15 Google Llc Biosensors, communicators, and controllers monitoring eye movement and methods for using them
KR100594117B1 (ko) 2004-09-20 2006-06-28 삼성전자주식회사 Ｈｍｄ 정보 단말기에서 생체 신호를 이용하여 키를입력하는 장치 및 방법
JP4654434B2 (ja) * 2004-11-24 2011-03-23 国立大学法人佐賀大学 視線方向特定システム
EP1943583B1 (en) * 2005-10-28 2019-04-10 Tobii AB Eye tracker with visual feedback
CN101336089A (zh) * 2006-01-26 2008-12-31 诺基亚公司 眼睛跟踪器设备
WO2007113975A1 (ja) * 2006-03-31 2007-10-11 National University Corporation Shizuoka University 視点検出装置
JP4685708B2 (ja) 2006-05-22 2011-05-18 富士通株式会社 携帯端末装置
EP2081100B1 (en) * 2006-11-15 2012-08-08 Panasonic Corporation Adjusting device for brain wave identification method, adjusting method and computer program
US20100149073A1 (en) * 2008-11-02 2010-06-17 David Chaum Near to Eye Display System and Appliance
US8788977B2 (en) * 2008-11-20 2014-07-22 Amazon Technologies, Inc. Movement recognition as input mechanism
CN101893934A (zh) * 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 一种智能调整屏幕显示的方法和装置
US8593375B2 (en) 2010-07-23 2013-11-26 Gregory A Maltz Eye gaze user interface and method
JP2012048358A (ja) 2010-08-25 2012-03-08 Sony Corp 閲覧機器、情報処理方法およびプログラム
WO2012083415A1 (en) * 2010-11-15 2012-06-28 Tandemlaunch Technologies Inc. System and method for interacting with and analyzing media on a display using eye gaze tracking
US8888287B2 (en) * 2010-12-13 2014-11-18 Microsoft Corporation Human-computer interface system having a 3D gaze tracker
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
KR101355895B1 (ko) * 2011-10-20 2014-02-05 경북대학교 산학협력단 사용자 의도 판단 장치 및 그 방법
US8955973B2 (en) * 2012-01-06 2015-02-17 Google Inc. Method and system for input detection using structured light projection
US9171198B1 (en) * 2012-04-02 2015-10-27 Google Inc. Image capture technique
KR101850035B1 (ko) * 2012-05-02 2018-04-20 엘지전자 주식회사 이동 단말기 및 그 제어방법
US9823742B2 (en) * 2012-05-18 2017-11-21 Microsoft Technology Licensing, Llc Interaction and management of devices using gaze detection
US9261961B2 (en) * 2012-06-07 2016-02-16 Nook Digital, Llc Accessibility aids for users of electronic devices
US20140026101A1 (en) * 2012-07-20 2014-01-23 Barnesandnoble.Com Llc Accessible Menu Navigation Techniques For Electronic Devices
KR102163996B1 (ko) * 2013-04-03 2020-10-13 삼성전자 주식회사 사용자 기기의 비접촉식 인식 기능 성능 향상 방법 및 장치
KR102181897B1 (ko) * 2013-05-09 2020-11-23 에스케이플래닛 주식회사 눈동자 추적을 이용한 모바일 툴팁 방법 및 장치
US20140368442A1 (en) * 2013-06-13 2014-12-18 Nokia Corporation Apparatus and associated methods for touch user input
US20140375541A1 (en) * 2013-06-25 2014-12-25 David Nister Eye tracking via depth camera
US10976813B2 (en) * 2016-06-13 2021-04-13 Apple Inc. Interactive motion-based eye tracking calibration
US9779478B1 (en) * 2016-10-04 2017-10-03 Oculus Vr, Llc Rendering composite content on a head-mounted display including a high resolution inset

Also Published As

Publication number Publication date
EP3268847A1 (en) 2018-01-17
US11883101B2 (en) 2024-01-30
IL303037B1 (en) 2025-02-01
US20200022577A1 (en) 2020-01-23
IL303037A (en) 2023-07-01
CN121116061A (zh) 2025-12-12
EP3809241B1 (en) 2023-12-13
JP7153096B2 (ja) 2022-10-13
IL254315A0 (en) 2017-11-30
JP2018519601A (ja) 2018-07-19
EP3268847A4 (en) 2018-10-24
EP3809241C0 (en) 2023-12-13
JP7016263B2 (ja) 2022-02-04
EP3809241A1 (en) 2021-04-21
WO2016142933A1 (en) 2016-09-15
CN107850939A (zh) 2018-03-27
JP2021073589A (ja) 2021-05-13

Similar Documents

Publication Publication Date Title
US11883101B2 (en) System and method for enabling communication through eye feedback
US12322164B2 (en) UI for head mounted display system
US10747315B2 (en) Communication and control system and method
CN106471419B (zh) 管理信息显示
US12417596B2 (en) User interfaces for managing live communication sessions
US20240103678A1 (en) Devices, methods, and graphical user interfaces for interacting with extended reality experiences
US20240103616A1 (en) User interfaces for gaze tracking enrollment
US20240118746A1 (en) User interfaces for gaze tracking enrollment
US20240152244A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US20240103679A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US12277848B2 (en) Devices, methods, and graphical user interfaces for device position adjustment
US20250209902A1 (en) Devices, methods, and graphical user interfaces for device position adjustment
JP2000250699A (ja) 視線入力装置
JP7367041B2 (ja) 頭部装着型ディスプレイシステムのためのｕｉ
CA3117533A1 (en) Ui for head mounted display system
KR20250049408A (ko) 3차원 환경들과의 상호작용을 위한 디바이스들, 방법들 및 그래픽 사용자 인터페이스들