CN106030458B - 用于基于凝视的媒体选择和编辑的系统和方法 - Google Patents

用于基于凝视的媒体选择和编辑的系统和方法 Download PDF

Info

Publication number
CN106030458B
CN106030458B CN201480075406.4A CN201480075406A CN106030458B CN 106030458 B CN106030458 B CN 106030458B CN 201480075406 A CN201480075406 A CN 201480075406A CN 106030458 B CN106030458 B CN 106030458B
Authority
CN
China
Prior art keywords
user
eye
image
media
eye tracking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201480075406.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN106030458A (zh
Inventor
L·J·马葛拉夫
E·德雷克
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Eye Com Corp
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eye Com Corp, Google LLC filed Critical Eye Com Corp
Publication of CN106030458A publication Critical patent/CN106030458A/zh
Application granted granted Critical
Publication of CN106030458B publication Critical patent/CN106030458B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
CN201480075406.4A 2013-12-31 2014-12-31 用于基于凝视的媒体选择和编辑的系统和方法 Active CN106030458B (zh)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US201361922724P 2013-12-31 2013-12-31
US61/922,724 2013-12-31
US201461991435P 2014-05-09 2014-05-09
US61/991,435 2014-05-09
US201462074927P 2014-11-04 2014-11-04
US201462074920P 2014-11-04 2014-11-04
US62/074,927 2014-11-04
US62/074,920 2014-11-04
PCT/US2014/073094 WO2015103444A1 (en) 2013-12-31 2014-12-31 Systems and methods for gaze-based media selection and editing

Publications (2)

Publication Number Publication Date
CN106030458A CN106030458A (zh) 2016-10-12
CN106030458B true CN106030458B (zh) 2020-05-08

Family

ID=53494037

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480075406.4A Active CN106030458B (zh) 2013-12-31 2014-12-31 用于基于凝视的媒体选择和编辑的系统和方法

Country Status (6)

Country Link
US (3) US9870060B2 (enExample)
EP (1) EP3090322A4 (enExample)
JP (1) JP6929644B2 (enExample)
KR (2) KR102182605B1 (enExample)
CN (1) CN106030458B (enExample)
WO (1) WO2015103444A1 (enExample)

Families Citing this family (121)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014089542A1 (en) 2012-12-06 2014-06-12 Eyefluence, Inc. Eye tracking wearable devices and methods for use
EP3041400A1 (en) * 2013-09-03 2016-07-13 Tobii AB Portable eye tracking device
CN104681048A (zh) * 2013-11-28 2015-06-03 索尼公司 多媒体读取控制装置、曲线获取装置、电子设备、曲线提供装置及方法
KR102182605B1 (ko) * 2013-12-31 2020-11-24 아이플루언스, 인크. 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
KR102404559B1 (ko) * 2014-03-19 2022-06-02 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 눈 시선 추적을 사용하는 의료 디바이스, 시스템, 및 방법
JP6326901B2 (ja) * 2014-03-26 2018-05-23 富士ゼロックス株式会社 画像処理装置およびプログラム
US10564714B2 (en) 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
JP6550460B2 (ja) 2014-05-09 2019-07-24 グーグル エルエルシー 眼信号を識別するためのシステムおよび方法、ならびに連続バイオメトリック認証
KR102240632B1 (ko) * 2014-06-10 2021-04-16 삼성디스플레이 주식회사 생체 효과 영상을 제공하는 전자 기기의 구동 방법
US10852838B2 (en) * 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
KR102253444B1 (ko) 2014-07-08 2021-05-20 삼성디스플레이 주식회사 사용자의 눈 깜빡임을 유도하는 유도 영상 표시 방법, 장치, 및 컴퓨터 판독 가능한 기록매체
US10282057B1 (en) * 2014-07-29 2019-05-07 Google Llc Image editing on a wearable device
US9720259B2 (en) * 2014-10-13 2017-08-01 William Hart Eyewear pupilometer
US12699286B2 (en) * 2014-10-13 2026-08-04 William Hart Augmented reality glasses with object recognition using artifical intelligence
US10567641B1 (en) * 2015-01-19 2020-02-18 Devon Rueckner Gaze-directed photography
US10921896B2 (en) * 2015-03-16 2021-02-16 Facebook Technologies, Llc Device interaction in augmented reality
CN104834446B (zh) * 2015-05-04 2018-10-26 惠州Tcl移动通信有限公司 一种基于眼球追踪技术的显示屏多屏控制方法及系统
US9939644B2 (en) * 2015-06-25 2018-04-10 Intel Corporation Technologies for controlling vision correction of a wearable computing device
US10222619B2 (en) * 2015-07-12 2019-03-05 Steven Sounyoung Yu Head-worn image display apparatus for stereoscopic microsurgery
US9852329B2 (en) * 2015-07-24 2017-12-26 International Business Machines Corporation Calculation of a characteristic of a hotspot in an event
CN105635561A (zh) * 2015-07-31 2016-06-01 宇龙计算机通信科技(深圳)有限公司 一种图像获取系统及方法
US20170102697A1 (en) * 2015-10-08 2017-04-13 General Motors Llc Selecting a vehicle function to control using a wearable electronic device
US10338677B2 (en) 2015-10-28 2019-07-02 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
US10137777B2 (en) 2015-11-03 2018-11-27 GM Global Technology Operations LLC Systems and methods for vehicle system control based on physiological traits
CN105245660A (zh) * 2015-11-05 2016-01-13 天津大学 一种基于手环的手机防盗追踪方法
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
JP6705206B2 (ja) * 2016-02-25 2020-06-03 セイコーエプソン株式会社 電子機器の制御装置および電子機器の制御プログラム
CN109154723B (zh) 2016-03-25 2021-08-17 奇跃公司 虚拟和增强现实系统和方法
US9864431B2 (en) * 2016-05-11 2018-01-09 Microsoft Technology Licensing, Llc Changing an application state using neurological data
US10395428B2 (en) * 2016-06-13 2019-08-27 Sony Interactive Entertainment Inc. HMD transitions for focusing on specific content in virtual-reality environments
CN106200901B (zh) * 2016-06-24 2019-03-29 联想(北京)有限公司 一种头戴式眼追踪装置的校正方法及头戴式眼追踪装置
US10223067B2 (en) 2016-07-15 2019-03-05 Microsoft Technology Licensing, Llc Leveraging environmental context for enhanced communication throughput
WO2018017751A1 (en) * 2016-07-19 2018-01-25 Supereye, Inc. Systems and methods for predictive visual rendering
WO2018020334A1 (en) * 2016-07-28 2018-02-01 Tata Consultancy Services Limited System and method for aiding communication
KR102548199B1 (ko) 2016-08-03 2023-06-28 삼성전자주식회사 전자 장치 및 전자 장치의 시선 추적 방법
CN106339668A (zh) * 2016-08-16 2017-01-18 信利光电股份有限公司 一种虹膜识别方法及虹膜识别系统
IL265734B (en) * 2016-10-05 2022-09-01 Magic Leap Inc Multi-eye test for mixed reality calibration
CN107957774B (zh) * 2016-10-18 2021-08-31 阿里巴巴集团控股有限公司 虚拟现实空间环境中的交互方法及装置
US10540491B1 (en) 2016-10-25 2020-01-21 Wells Fargo Bank, N.A. Virtual and augmented reality signatures
KR102697773B1 (ko) * 2016-11-01 2024-08-23 스냅 인코포레이티드 고속 비디오 캡처 및 센서 조절
CN109863502A (zh) * 2016-11-10 2019-06-07 纽诺创科技术公司 将图像拍摄设备与人类用户相关联以分析认知能力的方法和系统
US10591731B2 (en) 2016-12-06 2020-03-17 Google Llc Ocular video stabilization
US10484623B2 (en) * 2016-12-20 2019-11-19 Microsoft Technology Licensing, Llc Sensor with alternating visible and infrared sensitive pixels
US10088911B2 (en) 2016-12-30 2018-10-02 Manuel Saez Programmable electronic helmet
FR3061583B1 (fr) * 2017-01-04 2020-12-04 Oreal Dispositif d'acquisition d'une video d'alterations cutanees, systeme de caracterisation et procede de caracterisation associes
EP3381351B1 (en) * 2017-03-29 2026-05-06 Carl Zeiss Vision International GmbH System for assessing a health condition of a user
US10609025B2 (en) * 2017-04-06 2020-03-31 Htc Corporation System and method for providing simulated environment
US10401954B2 (en) * 2017-04-17 2019-09-03 Intel Corporation Sensory enhanced augmented reality and virtual reality device
DE102017108371B4 (de) * 2017-04-20 2020-08-27 Carl Zeiss Meditec Ag Medizinisch-optisches Darstellungssystem und Verfahren zum Betreiben desselben
WO2018222753A1 (en) * 2017-05-31 2018-12-06 Magic Leap, Inc. Eye tracking calibration techniques
US20180357670A1 (en) * 2017-06-07 2018-12-13 International Business Machines Corporation Dynamically capturing, transmitting and displaying images based on real-time visual identification of object
US10460527B2 (en) * 2017-06-30 2019-10-29 Tobii Ab Systems and methods for displaying images in a virtual world environment
CN107169338A (zh) * 2017-07-25 2017-09-15 上海闻泰电子科技有限公司 解锁方法及装置
KR102481884B1 (ko) 2017-09-22 2022-12-28 삼성전자주식회사 가상 영상을 표시하는 방법 및 장치
US10254832B1 (en) 2017-09-28 2019-04-09 Microsoft Technology Licensing, Llc Multi-item selection using eye gaze
WO2019069812A1 (ja) * 2017-10-05 2019-04-11 株式会社ソニー・インタラクティブエンタテインメント ヘッドマウントディスプレイの視線検出システム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイの視線検出方法
US10586360B2 (en) * 2017-11-21 2020-03-10 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze
US11282133B2 (en) 2017-11-21 2022-03-22 International Business Machines Corporation Augmented reality product comparison
KR102483781B1 (ko) * 2017-12-18 2023-01-03 광주과학기술원 도슨트 서비스를 제공하는 증강 현실 글래스의 동작 방법
US20190235621A1 (en) * 2018-01-26 2019-08-01 Snail Innovation Institute Method and apparatus for showing an expression of how an object has been stared at in a displayed video
US20190235246A1 (en) * 2018-01-26 2019-08-01 Snail Innovation Institute Method and apparatus for showing emoji on display glasses
CN110095866B (zh) * 2018-01-29 2020-07-28 京东方科技集团股份有限公司 增强现实装置、增强现实系统及其信息提示方法
CN116328317A (zh) * 2018-02-06 2023-06-27 日本聚逸株式会社 应用处理系统、应用处理方法以及应用处理程序
US10481403B2 (en) * 2018-02-15 2019-11-19 Tectus Corporation Contact lens with retinal camera
KR102495796B1 (ko) 2018-02-23 2023-02-06 삼성전자주식회사 시계(field of view)가 다른 복수의 카메라를 이용하여 생체 인증을 수행하는 방법 및 이를 위한 전자 장치
US10521013B2 (en) * 2018-03-01 2019-12-31 Samsung Electronics Co., Ltd. High-speed staggered binocular eye tracking systems
US10949969B1 (en) * 2018-03-20 2021-03-16 Welch Allyn, Inc. Pupil edge region removal in digital imaging
US10747500B2 (en) * 2018-04-03 2020-08-18 International Business Machines Corporation Aural delivery of environmental visual information
US10853014B2 (en) * 2018-04-17 2020-12-01 Rockwell Collins, Inc. Head wearable device, system, and method
US11262839B2 (en) * 2018-05-17 2022-03-01 Sony Interactive Entertainment Inc. Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
US11966055B2 (en) * 2018-07-19 2024-04-23 Magic Leap, Inc. Content interaction driven by eye metrics
US11568166B1 (en) * 2018-07-27 2023-01-31 Verily Life Sciences Llc Suggesting behavioral adjustments based on physiological responses to stimuli on electronic devices
CN109189222B (zh) * 2018-08-28 2022-01-11 广东工业大学 一种基于检测瞳孔直径变化的人机交互方法及装置
US20200082176A1 (en) * 2018-09-12 2020-03-12 Toyota Motor Engineering & Manufacturing North America, Inc. Systems and methods for extending detachable automobile sensor capabilities for identification of selected object types
US10833945B2 (en) * 2018-11-13 2020-11-10 International Business Machines Corporation Managing downloading of content
CN109451236A (zh) * 2018-11-13 2019-03-08 深圳龙图腾创新设计有限公司 一种基于瞳位跟踪的相机聚焦方法
US11282259B2 (en) 2018-11-26 2022-03-22 International Business Machines Corporation Non-visual environment mapping
CN109711286B (zh) * 2018-12-11 2022-11-11 中国科学院深圳先进技术研究院 一种基于人工视网膜空间感知的控制方法及装置
US10786729B1 (en) 2019-03-08 2020-09-29 Sony Interactive Entertainment Inc. Thermopile array fusion tracking
EP3906669B1 (en) * 2019-03-13 2024-06-05 Hewlett-Packard Development Company, L.P. Detecting eye tracking calibration errors
US10928647B2 (en) 2019-04-01 2021-02-23 Heidi Kershaw Therapeutic training device for autism
US10832733B1 (en) 2019-05-15 2020-11-10 International Business Machines Corporation Verbal command video editing
US10812771B1 (en) * 2019-06-12 2020-10-20 At&T Intellectual Property I, L.P. Methods, systems, and devices for adjusting image content for streaming panoramic video content
US12042240B2 (en) * 2019-07-16 2024-07-23 Asensus Surgical Us, Inc. Augmented reality using eye tracking in a robot assisted surgical system
JP7375373B2 (ja) * 2019-08-28 2023-11-08 セイコーエプソン株式会社 光学装置及び装着型表示装置
US11297224B2 (en) * 2019-09-30 2022-04-05 Snap Inc. Automated eyewear device sharing system
KR20220116238A (ko) * 2019-12-18 2022-08-22 콜러스, 인코포레이티드 디스플레이의 응시-기반 조명을 위한 시스템 및 방법
CN111158492B (zh) * 2019-12-31 2021-08-06 维沃移动通信有限公司 视频剪辑方法及头戴式设备
CN113079311B (zh) * 2020-01-06 2023-06-27 北京小米移动软件有限公司 图像获取方法及装置、电子设备、存储介质
US12044516B2 (en) 2020-02-06 2024-07-23 Austin Star Detonator Company Integrated detonator sensors
US11176751B2 (en) * 2020-03-17 2021-11-16 Snap Inc. Geospatial image surfacing and selection
RU2744548C1 (ru) * 2020-04-29 2021-03-11 федеральное государственное бюджетное образовательное учреждение высшего образования "Алтайский государственный университет" Устройство определения зрачковых реакций на визуальный стимул
CN111552076B (zh) * 2020-05-13 2022-05-06 歌尔科技有限公司 一种图像显示方法、ar眼镜及存储介质
CN111586459B (zh) 2020-05-22 2022-10-14 北京百度网讯科技有限公司 一种控制视频播放的方法、装置、电子设备及存储介质
US12478453B2 (en) 2020-05-29 2025-11-25 Medtronic, Inc. Presentation of patient information for cardiac blood flow procedures
WO2022055588A1 (en) 2020-09-08 2022-03-17 Medtronic, Inc. Imaging discovery utility for augmenting clinical image management
CN116507992A (zh) * 2020-09-23 2023-07-28 苹果公司 使用生理数据检测非预期用户界面行为
WO2022075983A1 (en) * 2020-10-07 2022-04-14 Hewlett-Packard Development Company, L.P. Operation of a configurable end-point device based on accessibility settings
US11908208B2 (en) * 2020-10-20 2024-02-20 Toyota Motor Engineering & Manufacturing North America, Inc. Interface sharpness distraction mitigation method and system
US20230344536A1 (en) * 2020-12-14 2023-10-26 Funai Electric Co., Ltd. Real-time immersion of multiple users
US11232644B1 (en) * 2020-12-31 2022-01-25 Facebook Technologies, Llc Systems and methods for providing spatial awareness in virtual reality
US12165771B2 (en) * 2021-04-27 2024-12-10 Oura Health Oy Method and system for supplemental sleep detection
US12558167B2 (en) 2021-05-12 2026-02-24 Medtronic, Inc. Extended intelligence for cardiac implantable electronic device (CIED) placement procedures
CN113509141A (zh) * 2021-06-29 2021-10-19 昆明依利科特科技有限公司 一种眼镜式涉毒行为瞳孔检测仪及检测方法
US12549436B2 (en) * 2021-08-10 2026-02-10 International Business Machines Corporation Internet of things configuration using eye-based controls
US20240185856A1 (en) * 2021-09-03 2024-06-06 Apple Inc. Gaze based dictation
US12135471B2 (en) 2021-09-10 2024-11-05 Tectus Corporation Control of an electronic contact lens using eye gestures
US20230119935A1 (en) * 2021-10-18 2023-04-20 Meta Platforms Technologies, Llc Gaze-guided image capture
US11592899B1 (en) 2021-10-28 2023-02-28 Tectus Corporation Button activation within an eye-controlled user interface
US12625544B2 (en) 2021-11-05 2026-05-12 Sesame Ai, Inc. Eye tracking system for determining user activity
US11619994B1 (en) 2022-01-14 2023-04-04 Tectus Corporation Control of an electronic contact lens using pitch-based eye gestures
US12118138B2 (en) 2022-02-14 2024-10-15 Tectus Corporation Vergence authentication
US11874961B2 (en) 2022-05-09 2024-01-16 Tectus Corporation Managing display of an icon in an eye tracking augmented reality device
US20250365485A1 (en) * 2022-06-17 2025-11-27 Hewlett-Packard Development Company, L.P. Image portion combination signals
CN115501609B (zh) * 2022-09-23 2025-12-02 不鸣科技(杭州)有限公司 实例的运行方法、装置、设备及介质
US12554323B2 (en) 2023-05-15 2026-02-17 Apple Inc. Head mountable display
JP2025044212A (ja) * 2023-09-19 2025-04-01 ソフトバンクグループ株式会社 システム
US12210679B1 (en) * 2024-01-08 2025-01-28 Rockwell Collins, Inc. Attention redirection within AR/XR immersive environments
WO2025150788A1 (ko) * 2024-01-09 2025-07-17 삼성전자 주식회사 웨어러블 전자 장치 및 상기 웨어러블 전자 장치의 제어 방법
US12405086B2 (en) 2024-01-18 2025-09-02 Styled Brands Inc. Adjustable reticles for sighting operations, and related methods, apparatus, and sight devices
CN118507013A (zh) * 2024-04-30 2024-08-16 南京鼓楼医院 一种基于眼动追踪技术的远程探视系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005094667A2 (en) * 2004-04-01 2005-10-13 Torch William C Biosensors, communicators, and controllers monitoring eye movement and methods for using them
CN1705454A (zh) * 2002-10-15 2005-12-07 沃尔沃技术公司 解释对象的头部和眼睛活动的方法和装置
CN102591016A (zh) * 2010-12-17 2012-07-18 微软公司 用于扩展现实显示的优化聚焦区
WO2013012603A2 (en) * 2011-07-20 2013-01-24 Google Inc. Manipulating and displaying an image on a wearable computing system

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6542081B2 (en) * 1996-08-19 2003-04-01 William C. Torch System and method for monitoring eye movement
USRE39539E1 (en) * 1996-08-19 2007-04-03 Torch William C System and method for monitoring eye movement
US7206022B2 (en) 2002-11-25 2007-04-17 Eastman Kodak Company Camera system with eye monitoring
US7574016B2 (en) * 2003-06-26 2009-08-11 Fotonation Vision Limited Digital image processing using face detection information
JP2005252734A (ja) 2004-03-04 2005-09-15 Olympus Corp 頭部装着型カメラ
US9269322B2 (en) * 2006-01-09 2016-02-23 Ignis Innovation Inc. Method and system for driving an active matrix display circuit
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
WO2009127065A1 (en) * 2008-04-18 2009-10-22 Ignis Innovation Inc. System and driving method for light emitting device display
JP5318503B2 (ja) * 2008-09-02 2013-10-16 ヤフー株式会社 画像検索装置
US20100128118A1 (en) * 2008-11-26 2010-05-27 Locarna Systems, Inc. Identification of visual fixations in a video stream
WO2010083853A1 (en) * 2009-01-26 2010-07-29 Tobii Technology Ab Detection of gaze point assisted by optical reference signals
EP2237237B1 (en) * 2009-03-30 2013-03-20 Tobii Technology AB Eye closure detection using structured illumination
US20110052012A1 (en) * 2009-03-31 2011-03-03 Myspace Inc. Security and Monetization Through Facial Recognition in Social Networking Websites
JP5613025B2 (ja) * 2009-11-18 2014-10-22 パナソニック株式会社 視線検出装置、視線検出方法、眼電位計測装置、ウェアラブルカメラ、ヘッドマウントディスプレイ、電子めがねおよび眼科診断装置
US9373123B2 (en) * 2009-12-30 2016-06-21 Iheartmedia Management Services, Inc. Wearable advertising ratings methods and systems
US20130012603A1 (en) 2010-03-15 2013-01-10 Farrell David H Methods for assessing the risk of cardiovascular disease
WO2012021967A1 (en) * 2010-08-16 2012-02-23 Tandemlaunch Technologies Inc. System and method for analyzing three-dimensional (3d) media content
EP2499963A1 (en) * 2011-03-18 2012-09-19 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and apparatus for gaze point mapping
US8510166B2 (en) * 2011-05-11 2013-08-13 Google Inc. Gaze tracking system
US9342610B2 (en) * 2011-08-25 2016-05-17 Microsoft Technology Licensing, Llc Portals: registered objects as virtualized, personalized displays
US9128520B2 (en) * 2011-09-30 2015-09-08 Microsoft Technology Licensing, Llc Service provision using personal audio/visual system
EP2774353A4 (en) * 2011-11-03 2015-11-18 Intel Corp PICTURES BASED ON EYE PERSONALIZATION
US20130239051A1 (en) * 2012-03-06 2013-09-12 Apple Inc. Non-destructive editing for a media editing application
US9096920B1 (en) * 2012-03-22 2015-08-04 Google Inc. User interface method
US9201512B1 (en) * 2012-04-02 2015-12-01 Google Inc. Proximity sensing for input detection
US20140328570A1 (en) * 2013-01-09 2014-11-06 Sri International Identifying, describing, and sharing salient events in images and videos
US20130328925A1 (en) * 2012-06-12 2013-12-12 Stephen G. Latta Object focus in a mixed reality environment
US20140176591A1 (en) * 2012-12-26 2014-06-26 Georg Klein Low-latency fusing of color image data
CA2942852C (en) * 2013-03-15 2023-03-28 Interaxon Inc. Wearable computing apparatus and method
US9213403B1 (en) * 2013-03-27 2015-12-15 Google Inc. Methods to pan, zoom, crop, and proportionally move on a head mountable display
US20140354533A1 (en) * 2013-06-03 2014-12-04 Shivkumar Swaminathan Tagging using eye gaze detection
US10089786B2 (en) * 2013-08-19 2018-10-02 Qualcomm Incorporated Automatic customization of graphical user interface for optical see-through head mounted display with user interaction tracking
US10114532B2 (en) * 2013-12-06 2018-10-30 Google Llc Editing options for image regions
KR102182605B1 (ko) * 2013-12-31 2020-11-24 아이플루언스, 인크. 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
JP6550460B2 (ja) * 2014-05-09 2019-07-24 グーグル エルエルシー 眼信号を識別するためのシステムおよび方法、ならびに連続バイオメトリック認証

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1705454A (zh) * 2002-10-15 2005-12-07 沃尔沃技术公司 解释对象的头部和眼睛活动的方法和装置
WO2005094667A2 (en) * 2004-04-01 2005-10-13 Torch William C Biosensors, communicators, and controllers monitoring eye movement and methods for using them
CN102591016A (zh) * 2010-12-17 2012-07-18 微软公司 用于扩展现实显示的优化聚焦区
WO2013012603A2 (en) * 2011-07-20 2013-01-24 Google Inc. Manipulating and displaying an image on a wearable computing system

Also Published As

Publication number Publication date
US20180173319A1 (en) 2018-06-21
KR20200133392A (ko) 2020-11-27
US20150220157A1 (en) 2015-08-06
CN106030458A (zh) 2016-10-12
EP3090322A1 (en) 2016-11-09
KR102182605B1 (ko) 2020-11-24
US10915180B2 (en) 2021-02-09
KR102246310B1 (ko) 2021-04-29
EP3090322A4 (en) 2017-07-19
US20190179418A1 (en) 2019-06-13
JP6929644B2 (ja) 2021-09-01
JP2017507400A (ja) 2017-03-16
US9870060B2 (en) 2018-01-16
US20200387226A9 (en) 2020-12-10
KR20160105439A (ko) 2016-09-06
WO2015103444A1 (en) 2015-07-09

Similar Documents

Publication Publication Date Title
US10915180B2 (en) Systems and methods for monitoring a user's eye
US12625546B2 (en) User interfaces for gaze tracking enrollment
US20250103132A1 (en) Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
US20240103678A1 (en) Devices, methods, and graphical user interfaces for interacting with extended reality experiences
EP4161387B1 (en) Sound-based attentive state assessment
EP3392739B1 (en) Eye-brain interface (ebi) system and method for controlling same
US10831268B1 (en) Systems and methods for using eye tracking to improve user interactions with objects in artificial reality
JP6184989B2 (ja) 目の動きをモニターするバイオセンサ、コミュニケーター及びコントローラー並びにそれらの使用方法
US12572198B2 (en) User interfaces for gaze tracking enrollment
CN112181152A (zh) 基于mr眼镜的广告推送管理方法、设备及应用
CN112034977A (zh) Mr智能眼镜内容交互、信息输入、应用推荐技术的方法
KR20240091224A (ko) 사용자의 표현을 생성 및 디스플레이하기 위한 디바이스들, 방법들, 및 그래픽 사용자 인터페이스들
US12517995B2 (en) Devices, methods, and graphical user interfaces for transitioning between multiple modes of operation
CN119856140A (zh) 基于保留预测的用户反馈
CN119200858A (zh) 扩展现实交互方法、装置、电子设备及存储介质
US12517576B2 (en) Gaze behavior detection
US11954249B1 (en) Head-mounted systems with sensor for eye monitoring
US12554609B2 (en) Devices, methods, and graphical user interfaces for providing environment tracking content
US12499629B1 (en) Extended-reality systems and methods for prioritizing display of object augments
US20260105136A1 (en) Devices, methods, and graphical user interfaces for transitioning between multiple modes of operation
US20260003475A1 (en) Extended-reality systems and methods for prioritizing display of object augments having multiple presentational states
WO2024054433A2 (en) Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20181102

Address after: American California

Applicant after: Google limited liability company

Address before: Nevada

Applicant before: EYEFLUENCE INC

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant