CN121116061A - 用于通过眼睛反馈实现通信的系统和方法 - Google Patents

用于通过眼睛反馈实现通信的系统和方法

Info

Publication number
CN121116061A
CN121116061A CN202511229956.3A CN202511229956A CN121116061A CN 121116061 A CN121116061 A CN 121116061A CN 202511229956 A CN202511229956 A CN 202511229956A CN 121116061 A CN121116061 A CN 121116061A
Authority
CN
China
Prior art keywords
eye
user
relative
orientation
pupil
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202511229956.3A
Other languages
English (en)
Chinese (zh)
Inventor
莎伊·里肖尼
塔尔·凯尔纳
伊泰·科恩伯格
奥尔·雷茨金
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eyefree Assisting Communication Ltd
Original Assignee
Eyefree Assisting Communication Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyefree Assisting Communication Ltd filed Critical Eyefree Assisting Communication Ltd
Publication of CN121116061A publication Critical patent/CN121116061A/zh
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/0008—Apparatus for testing the eyes; Instruments for examining the eyes provided with illuminating means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/02—Subjective types, i.e. testing apparatus requiring the active assistance of the patient
    • A61B3/028—Subjective types, i.e. testing apparatus requiring the active assistance of the patient for testing visual acuity; for determination of refraction, e.g. phoropters
    • A61B3/032—Devices for presenting test symbols or characters, e.g. test chart projectors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0236—Character input methods using selection techniques to select from displayed items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
CN202511229956.3A 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法 Pending CN121116061A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201562130637P 2015-03-10 2015-03-10
US62/130,637 2015-03-10
PCT/IL2016/050235 WO2016142933A1 (en) 2015-03-10 2016-03-02 System and method for enabling communication through eye feedback
CN201680026221.3A CN107850939A (zh) 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201680026221.3A Division CN107850939A (zh) 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法

Publications (1)

Publication Number Publication Date
CN121116061A true CN121116061A (zh) 2025-12-12

Family

ID=56879968

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202511229956.3A Pending CN121116061A (zh) 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法
CN201680026221.3A Pending CN107850939A (zh) 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201680026221.3A Pending CN107850939A (zh) 2015-03-10 2016-03-02 用于通过眼睛反馈实现通信的系统和方法

Country Status (6)

Country Link
US (1) US11883101B2 (https=)
EP (2) EP3268847A4 (https=)
JP (2) JP7016263B2 (https=)
CN (2) CN121116061A (https=)
IL (2) IL303037B2 (https=)
WO (1) WO2016142933A1 (https=)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TR201613586A2 (tr) * 2016-09-28 2016-11-21 Kuersat Cagiltay Göz hareketleri̇ i̇le kontrol edi̇len elektroni̇k ve motorlu tekerlekli̇ sandalye si̇stemi̇
US11402909B2 (en) * 2017-04-26 2022-08-02 Cognixion Brain computer interface for augmented reality
JP6460425B2 (ja) * 2017-06-02 2019-01-30 本田技研工業株式会社 車両制御システム、車両制御方法、およびプログラム
EP3721320B1 (en) * 2017-12-07 2022-02-23 Eyefree Assisting Communication Ltd. Communication methods and systems
CN108245748A (zh) 2017-12-21 2018-07-06 北京怡和嘉业医疗科技股份有限公司 面罩、呼吸机系统及该呼吸机系统执行的方法
EP3506055B1 (en) * 2017-12-28 2024-09-11 Vestel Elektronik Sanayi ve Ticaret A.S. Method for eye-tracking calibration with splash screen
CN109002186B (zh) 2018-06-28 2020-12-25 北京金山安全软件有限公司 一种输入预测方法及装置
US10966007B1 (en) * 2018-09-25 2021-03-30 Apple Inc. Haptic output system
US11393318B2 (en) * 2018-10-05 2022-07-19 Cleveland State University Systems and methods for privacy-aware motion tracking with automatic authentication
WO2020159784A1 (en) * 2019-02-01 2020-08-06 Apple Inc. Biofeedback method of modulating digital content to invoke greater pupil radius response
US10809637B1 (en) * 2019-05-30 2020-10-20 Applied Materials, Inc. Learning based digital corrections to compensate variations on lithography systems with multiple imaging units
IL268575B2 (en) * 2019-08-07 2023-02-01 Eyefree Assisting Communication Ltd System and method for patient monitoring
SE546455C2 (en) 2019-08-23 2024-11-05 Your Speech Factory Ab Electronic device and method for eye-contact training
CN110619303A (zh) * 2019-09-16 2019-12-27 Oppo广东移动通信有限公司 注视点追踪方法、装置、终端及计算机可读存储介质
KR102128894B1 (ko) * 2019-10-10 2020-07-01 주식회사 메디씽큐 스마트 안경의 시선 트래킹 시스템 및 그 방법
US10860098B1 (en) 2019-12-30 2020-12-08 Hulu, LLC Gesture-based eye tracking
US12226330B2 (en) * 2020-10-07 2025-02-18 Jay Curtis Beavers Systems, methods, and techniques for eye gaze control of seat and bed positioning
JP7507482B2 (ja) * 2020-10-29 2024-06-28 パナソニックオートモーティブシステムズ株式会社 視線入力装置
DE102021110109A1 (de) * 2021-04-21 2022-10-27 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren zum Erkennen von Augengesten eines Auges
IT202100013235A1 (it) * 2021-05-21 2022-11-21 Dico Tech S R L Sistema e metodo per la comunicazione non verbale
ES3058363T3 (es) * 2021-06-30 2026-03-10 Tobii Ab Sistema de seguimiento ocular
US20250095850A1 (en) 2021-07-22 2025-03-20 Eyefree Assisting Communication Ltd. System for communication with a patient based on the determined sedation state
CN113589958A (zh) * 2021-08-05 2021-11-02 西交利物浦大学 文本输入方法、装置、设备及存储介质
US20230092702A1 (en) 2021-09-20 2023-03-23 Salesforce, Inc. Database systems and methods of naming record groups
WO2023076573A1 (en) * 2021-10-28 2023-05-04 Lifedrive Llc Drive manager for power wheelchair and related methods
JP7568301B2 (ja) * 2022-03-01 2024-10-16 日新電機工作株式会社 情報処理システム、情報処理方法、及び情報処理プログラム
US12032156B2 (en) * 2022-04-08 2024-07-09 Mirza Faizan Apparatus to enable differently abled users to communicate and a method thereof
US11995231B2 (en) * 2022-07-21 2024-05-28 Dell Products Lp System and method for headset haptic or audio confirmation feedback for gaze activation
US12204689B2 (en) * 2022-09-27 2025-01-21 Tobii Dynavox Ab Method, system, and computer program product for drawing and fine-tuned motor controls
US12499319B2 (en) * 2022-12-12 2025-12-16 Salesforce, Inc. Database systems with user-configurable automated metadata assignment
US12524198B1 (en) * 2022-12-16 2026-01-13 Amazon Technologies, Inc. Gaze based device control
US12204687B2 (en) * 2023-04-11 2025-01-21 Jay Curtis Beavers Systems, methods, and techniques for safely controlling devices using eye gaze control
CN116421135A (zh) * 2023-04-27 2023-07-14 北京京东拓先科技有限公司 视力测试方法、装置、电子设备及存储介质
EP4465247A1 (en) * 2023-05-17 2024-11-20 Tata Consultancy Services Limited Method and system for predicting distance of gazed objects using infrared (ir) camera
CN116708974B (zh) * 2023-08-01 2023-10-17 清华大学 一种头戴式主动视觉相机的通用摄像头干扰方法及系统
JP2025051735A (ja) * 2023-09-22 2025-04-04 ソフトバンクグループ株式会社 システム

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US577A (en) 1838-01-20 Uvtachine for threshing grain and shelling corn
US8120A (en) 1851-05-27 Cabkiaorb
US4973149A (en) * 1987-08-19 1990-11-27 Center For Innovative Technology Eye movement detector
US4836670A (en) * 1987-08-19 1989-06-06 Center For Innovative Technology Eye movement detector
US4950069A (en) * 1988-11-04 1990-08-21 University Of Virginia Eye movement detector with improved calibration and speed
JPH0749744A (ja) 1993-08-04 1995-02-21 Pioneer Electron Corp 頭部搭載型表示入力装置
US5912721A (en) * 1996-03-13 1999-06-15 Kabushiki Kaisha Toshiba Gaze detection apparatus and its method as well as information display apparatus
US6351273B1 (en) * 1997-04-30 2002-02-26 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display or screen
JP2000137789A (ja) 1998-10-29 2000-05-16 Sharp Corp 画像処理装置
US6456262B1 (en) 2000-05-09 2002-09-24 Intel Corporation Microdisplay with eye gaze detection
US6943754B2 (en) * 2002-09-27 2005-09-13 The Boeing Company Gaze tracking system, eye-tracking assembly and an associated method of calibration
US20050045373A1 (en) 2003-05-27 2005-03-03 Joseph Born Portable media device with audio prompt menu
JP3673834B2 (ja) 2003-08-18 2005-07-20 国立大学法人山口大学 眼球運動を用いた視線入力コミュニケーション方法
MXPA06011168A (es) 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
KR100594117B1 (ko) 2004-09-20 2006-06-28 삼성전자주식회사 Ｈｍｄ 정보 단말기에서 생체 신호를 이용하여 키를입력하는 장치 및 방법
JP4654434B2 (ja) * 2004-11-24 2011-03-23 国立大学法人佐賀大学 視線方向特定システム
EP1943583B1 (en) * 2005-10-28 2019-04-10 Tobii AB Eye tracker with visual feedback
WO2007085682A1 (en) * 2006-01-26 2007-08-02 Nokia Corporation Eye tracker device
US7766479B2 (en) * 2006-03-31 2010-08-03 National University Corporation Shizuoka University View point detecting device
JP4685708B2 (ja) * 2006-05-22 2011-05-18 富士通株式会社 携帯端末装置
JP4272702B2 (ja) * 2006-11-15 2009-06-03 パナソニック株式会社 脳波識別方法の調整装置、方法およびコンピュータプログラム
US20100149073A1 (en) * 2008-11-02 2010-06-17 David Chaum Near to Eye Display System and Appliance
US8788977B2 (en) * 2008-11-20 2014-07-22 Amazon Technologies, Inc. Movement recognition as input mechanism
CN101893934A (zh) 2010-06-25 2010-11-24 宇龙计算机通信科技(深圳)有限公司 一种智能调整屏幕显示的方法和装置
US8593375B2 (en) 2010-07-23 2013-11-26 Gregory A Maltz Eye gaze user interface and method
JP2012048358A (ja) 2010-08-25 2012-03-08 Sony Corp 閲覧機器、情報処理方法およびプログラム
WO2012083415A1 (en) * 2010-11-15 2012-06-28 Tandemlaunch Technologies Inc. System and method for interacting with and analyzing media on a display using eye gaze tracking
US8888287B2 (en) * 2010-12-13 2014-11-18 Microsoft Corporation Human-computer interface system having a 3D gaze tracker
AU2011204946C1 (en) * 2011-07-22 2012-07-26 Microsoft Technology Licensing, Llc Automatic text scrolling on a head-mounted display
KR101355895B1 (ko) * 2011-10-20 2014-02-05 경북대학교 산학협력단 사용자 의도 판단 장치 및 그 방법
US8955973B2 (en) * 2012-01-06 2015-02-17 Google Inc. Method and system for input detection using structured light projection
US9171198B1 (en) * 2012-04-02 2015-10-27 Google Inc. Image capture technique
KR101850035B1 (ko) * 2012-05-02 2018-04-20 엘지전자 주식회사 이동 단말기 및 그 제어방법
US9823742B2 (en) * 2012-05-18 2017-11-21 Microsoft Technology Licensing, Llc Interaction and management of devices using gaze detection
US9261961B2 (en) * 2012-06-07 2016-02-16 Nook Digital, Llc Accessibility aids for users of electronic devices
US9658746B2 (en) * 2012-07-20 2017-05-23 Nook Digital, Llc Accessible reading mode techniques for electronic devices
KR102163996B1 (ko) * 2013-04-03 2020-10-13 삼성전자 주식회사 사용자 기기의 비접촉식 인식 기능 성능 향상 방법 및 장치
KR102181897B1 (ko) * 2013-05-09 2020-11-23 에스케이플래닛 주식회사 눈동자 추적을 이용한 모바일 툴팁 방법 및 장치
US20140368442A1 (en) * 2013-06-13 2014-12-18 Nokia Corporation Apparatus and associated methods for touch user input
US20140375541A1 (en) * 2013-06-25 2014-12-25 David Nister Eye tracking via depth camera
WO2017216118A1 (en) * 2016-06-13 2017-12-21 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and eye tracking system for performing a calibration procedure for calibrating an eye tracking device
US9779478B1 (en) * 2016-10-04 2017-10-03 Oculus Vr, Llc Rendering composite content on a head-mounted display including a high resolution inset

Also Published As

Publication number Publication date
US11883101B2 (en) 2024-01-30
JP2021073589A (ja) 2021-05-13
EP3809241C0 (en) 2023-12-13
JP7016263B2 (ja) 2022-02-04
WO2016142933A1 (en) 2016-09-15
IL303037A (en) 2023-07-01
EP3809241A1 (en) 2021-04-21
IL254315A0 (en) 2017-11-30
EP3268847A1 (en) 2018-01-17
EP3809241B1 (en) 2023-12-13
IL303037B1 (en) 2025-02-01
JP7153096B2 (ja) 2022-10-13
US20200022577A1 (en) 2020-01-23
EP3268847A4 (en) 2018-10-24
IL303037B2 (en) 2025-06-01
CN107850939A (zh) 2018-03-27
JP2018519601A (ja) 2018-07-19

Similar Documents

Publication Publication Date Title
JP7153096B2 (ja) アイフィードバックによるコミュニケーションを可能にするシステム及び方法
JP7487265B2 (ja) 外部条件に基づくウェアラブルディスプレイデバイスの自動制御
US12399599B2 (en) Devices, methods, and graphical user interfaces for improving accessibility of interactions with three-dimensional environments
US20240103617A1 (en) User interfaces for gaze tracking enrollment
US10747315B2 (en) Communication and control system and method
US20240152244A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US9916006B2 (en) Eye-wearable device user interface and method
US12417596B2 (en) User interfaces for managing live communication sessions
US20240153205A1 (en) Devices, Methods, and Graphical User Interfaces for Providing Computer-Generated Experiences
US12572198B2 (en) User interfaces for gaze tracking enrollment
JP2024012497A (ja) コミュニケーション方法及びシステム
KR20180083252A (ko) 실제 객체 및 가상 객체와 상호작용하기 위한 생체기계적 기반의 안구 신호를 위한 시스템 및 방법
US20240103608A1 (en) Devices, Methods, and Graphical User Interfaces for Providing Computer-Generated Experiences
US20240104860A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US20250341941A1 (en) Devices, Methods, and Graphical User Interfaces for Improving Accessibility of Interactions with Three-Dimensional Environments
US20240404210A1 (en) Devices, methods, and graphical user interfaces forgenerating reminders for a user experience session in an extended reality environment
KR20250049408A (ko) 3차원 환경들과의 상호작용을 위한 디바이스들, 방법들 및 그래픽 사용자 인터페이스들
WO2024064230A1 (en) Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination