KR102246310B1 - 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들 - Google Patents

시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들 Download PDF

Info

Publication number
KR102246310B1
KR102246310B1 KR1020207033096A KR20207033096A KR102246310B1 KR 102246310 B1 KR102246310 B1 KR 102246310B1 KR 1020207033096 A KR1020207033096 A KR 1020207033096A KR 20207033096 A KR20207033096 A KR 20207033096A KR 102246310 B1 KR102246310 B1 KR 102246310B1
Authority
KR
South Korea
Prior art keywords
user
eye
camera
images
pupil
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207033096A
Other languages
English (en)
Korean (ko)
Other versions
KR20200133392A (ko
Inventor
루이스 제임스 마그래프
엘리엇 드레이크
Original Assignee
아이플루언스, 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 아이플루언스, 인크. filed Critical 아이플루언스, 인크.
Publication of KR20200133392A publication Critical patent/KR20200133392A/ko
Application granted granted Critical
Publication of KR102246310B1 publication Critical patent/KR102246310B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Eye Examination Apparatus (AREA)
KR1020207033096A 2013-12-31 2014-12-31 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들 Active KR102246310B1 (ko)

Applications Claiming Priority (9)

Application Number Priority Date Filing Date Title
US201361922724P 2013-12-31 2013-12-31
US61/922,724 2013-12-31
US201461991435P 2014-05-09 2014-05-09
US61/991,435 2014-05-09
US201462074927P 2014-11-04 2014-11-04
US201462074920P 2014-11-04 2014-11-04
US62/074,927 2014-11-04
US62/074,920 2014-11-04
PCT/US2014/073094 WO2015103444A1 (en) 2013-12-31 2014-12-31 Systems and methods for gaze-based media selection and editing

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020167020195A Division KR102182605B1 (ko) 2013-12-31 2014-12-31 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들

Publications (2)

Publication Number Publication Date
KR20200133392A KR20200133392A (ko) 2020-11-27
KR102246310B1 true KR102246310B1 (ko) 2021-04-29

Family

ID=53494037

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020207033096A Active KR102246310B1 (ko) 2013-12-31 2014-12-31 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
KR1020167020195A Active KR102182605B1 (ko) 2013-12-31 2014-12-31 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020167020195A Active KR102182605B1 (ko) 2013-12-31 2014-12-31 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들

Country Status (6)

Country Link
US (3) US9870060B2 (enExample)
EP (1) EP3090322A4 (enExample)
JP (1) JP6929644B2 (enExample)
KR (2) KR102246310B1 (enExample)
CN (1) CN106030458B (enExample)
WO (1) WO2015103444A1 (enExample)

Families Citing this family (117)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014089542A1 (en) 2012-12-06 2014-06-12 Eyefluence, Inc. Eye tracking wearable devices and methods for use
EP3041400A1 (en) * 2013-09-03 2016-07-13 Tobii AB Portable eye tracking device
CN104681048A (zh) * 2013-11-28 2015-06-03 索尼公司 多媒体读取控制装置、曲线获取装置、电子设备、曲线提供装置及方法
KR102246310B1 (ko) * 2013-12-31 2021-04-29 아이플루언스, 인크. 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
CN106456148B (zh) * 2014-03-19 2020-06-12 直观外科手术操作公司 使用眼球凝视跟踪的医疗装置、系统和方法
JP6326901B2 (ja) * 2014-03-26 2018-05-23 富士ゼロックス株式会社 画像処理装置およびプログラム
US10564714B2 (en) 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
WO2016018487A2 (en) 2014-05-09 2016-02-04 Eyefluene, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
KR102240632B1 (ko) * 2014-06-10 2021-04-16 삼성디스플레이 주식회사 생체 효과 영상을 제공하는 전자 기기의 구동 방법
US10852838B2 (en) * 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
KR102253444B1 (ko) 2014-07-08 2021-05-20 삼성디스플레이 주식회사 사용자의 눈 깜빡임을 유도하는 유도 영상 표시 방법, 장치, 및 컴퓨터 판독 가능한 기록매체
US10282057B1 (en) * 2014-07-29 2019-05-07 Google Llc Image editing on a wearable device
US9720259B2 (en) * 2014-10-13 2017-08-01 William Hart Eyewear pupilometer
US10567641B1 (en) * 2015-01-19 2020-02-18 Devon Rueckner Gaze-directed photography
US10921896B2 (en) * 2015-03-16 2021-02-16 Facebook Technologies, Llc Device interaction in augmented reality
CN104834446B (zh) * 2015-05-04 2018-10-26 惠州Tcl移动通信有限公司 一种基于眼球追踪技术的显示屏多屏控制方法及系统
US9939644B2 (en) * 2015-06-25 2018-04-10 Intel Corporation Technologies for controlling vision correction of a wearable computing device
US10222619B2 (en) * 2015-07-12 2019-03-05 Steven Sounyoung Yu Head-worn image display apparatus for stereoscopic microsurgery
US9852329B2 (en) * 2015-07-24 2017-12-26 International Business Machines Corporation Calculation of a characteristic of a hotspot in an event
CN105635561A (zh) * 2015-07-31 2016-06-01 宇龙计算机通信科技(深圳)有限公司 一种图像获取系统及方法
US20170102697A1 (en) * 2015-10-08 2017-04-13 General Motors Llc Selecting a vehicle function to control using a wearable electronic device
US10338677B2 (en) 2015-10-28 2019-07-02 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
US10137777B2 (en) 2015-11-03 2018-11-27 GM Global Technology Operations LLC Systems and methods for vehicle system control based on physiological traits
CN105245660A (zh) * 2015-11-05 2016-01-13 天津大学 一种基于手环的手机防盗追踪方法
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
JP6705206B2 (ja) * 2016-02-25 2020-06-03 セイコーエプソン株式会社 電子機器の制御装置および電子機器の制御プログラム
US9864431B2 (en) * 2016-05-11 2018-01-09 Microsoft Technology Licensing, Llc Changing an application state using neurological data
US10395428B2 (en) * 2016-06-13 2019-08-27 Sony Interactive Entertainment Inc. HMD transitions for focusing on specific content in virtual-reality environments
CN106200901B (zh) * 2016-06-24 2019-03-29 联想(北京)有限公司 一种头戴式眼追踪装置的校正方法及头戴式眼追踪装置
US10223067B2 (en) 2016-07-15 2019-03-05 Microsoft Technology Licensing, Llc Leveraging environmental context for enhanced communication throughput
WO2018017751A1 (en) * 2016-07-19 2018-01-25 Supereye, Inc. Systems and methods for predictive visual rendering
WO2018020334A1 (en) * 2016-07-28 2018-02-01 Tata Consultancy Services Limited System and method for aiding communication
KR102548199B1 (ko) 2016-08-03 2023-06-28 삼성전자주식회사 전자 장치 및 전자 장치의 시선 추적 방법
CN106339668A (zh) * 2016-08-16 2017-01-18 信利光电股份有限公司 一种虹膜识别方法及虹膜识别系统
US10573042B2 (en) * 2016-10-05 2020-02-25 Magic Leap, Inc. Periocular test for mixed reality calibration
CN107957774B (zh) * 2016-10-18 2021-08-31 阿里巴巴集团控股有限公司 虚拟现实空间环境中的交互方法及装置
US10540491B1 (en) 2016-10-25 2020-01-21 Wells Fargo Bank, N.A. Virtual and augmented reality signatures
WO2018085426A1 (en) 2016-11-01 2018-05-11 Snap Inc. Systems and methods for fast video capture and sensor adjustment
CN109863502A (zh) * 2016-11-10 2019-06-07 纽诺创科技术公司 将图像拍摄设备与人类用户相关联以分析认知能力的方法和系统
US10591731B2 (en) * 2016-12-06 2020-03-17 Google Llc Ocular video stabilization
US10484623B2 (en) * 2016-12-20 2019-11-19 Microsoft Technology Licensing, Llc Sensor with alternating visible and infrared sensitive pixels
US10088911B2 (en) 2016-12-30 2018-10-02 Manuel Saez Programmable electronic helmet
FR3061583B1 (fr) * 2017-01-04 2020-12-04 Oreal Dispositif d'acquisition d'une video d'alterations cutanees, systeme de caracterisation et procede de caracterisation associes
EP3381351A1 (en) * 2017-03-29 2018-10-03 Vivior AG System for assessing a health condition of a user
US10609025B2 (en) * 2017-04-06 2020-03-31 Htc Corporation System and method for providing simulated environment
US10401954B2 (en) * 2017-04-17 2019-09-03 Intel Corporation Sensory enhanced augmented reality and virtual reality device
DE102017108371B4 (de) * 2017-04-20 2020-08-27 Carl Zeiss Meditec Ag Medizinisch-optisches Darstellungssystem und Verfahren zum Betreiben desselben
EP3631567B1 (en) * 2017-05-31 2022-09-21 Magic Leap, Inc. Eye tracking calibration techniques
US20180357670A1 (en) * 2017-06-07 2018-12-13 International Business Machines Corporation Dynamically capturing, transmitting and displaying images based on real-time visual identification of object
US10460527B2 (en) * 2017-06-30 2019-10-29 Tobii Ab Systems and methods for displaying images in a virtual world environment
CN107169338A (zh) * 2017-07-25 2017-09-15 上海闻泰电子科技有限公司 解锁方法及装置
KR102481884B1 (ko) 2017-09-22 2022-12-28 삼성전자주식회사 가상 영상을 표시하는 방법 및 장치
US10254832B1 (en) 2017-09-28 2019-04-09 Microsoft Technology Licensing, Llc Multi-item selection using eye gaze
WO2019069812A1 (ja) * 2017-10-05 2019-04-11 株式会社ソニー・インタラクティブエンタテインメント ヘッドマウントディスプレイの視線検出システム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイの視線検出方法
US10586360B2 (en) * 2017-11-21 2020-03-10 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze
US11282133B2 (en) 2017-11-21 2022-03-22 International Business Machines Corporation Augmented reality product comparison
KR102483781B1 (ko) * 2017-12-18 2023-01-03 광주과학기술원 도슨트 서비스를 제공하는 증강 현실 글래스의 동작 방법
US20190235246A1 (en) * 2018-01-26 2019-08-01 Snail Innovation Institute Method and apparatus for showing emoji on display glasses
US20190235621A1 (en) * 2018-01-26 2019-08-01 Snail Innovation Institute Method and apparatus for showing an expression of how an object has been stared at in a displayed video
CN110095866B (zh) * 2018-01-29 2020-07-28 京东方科技集团股份有限公司 增强现实装置、增强现实系统及其信息提示方法
CN110115842B (zh) * 2018-02-06 2023-01-13 日本聚逸株式会社 应用处理系统、应用处理方法以及应用处理程序
US10481403B2 (en) * 2018-02-15 2019-11-19 Tectus Corporation Contact lens with retinal camera
KR102495796B1 (ko) 2018-02-23 2023-02-06 삼성전자주식회사 시계(field of view)가 다른 복수의 카메라를 이용하여 생체 인증을 수행하는 방법 및 이를 위한 전자 장치
US10521013B2 (en) * 2018-03-01 2019-12-31 Samsung Electronics Co., Ltd. High-speed staggered binocular eye tracking systems
US10949969B1 (en) * 2018-03-20 2021-03-16 Welch Allyn, Inc. Pupil edge region removal in digital imaging
US10747500B2 (en) * 2018-04-03 2020-08-18 International Business Machines Corporation Aural delivery of environmental visual information
US10853014B2 (en) * 2018-04-17 2020-12-01 Rockwell Collins, Inc. Head wearable device, system, and method
US11262839B2 (en) * 2018-05-17 2022-03-01 Sony Interactive Entertainment Inc. Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
WO2020018938A1 (en) * 2018-07-19 2020-01-23 Magic Leap, Inc. Content interaction driven by eye metrics
US11568166B1 (en) * 2018-07-27 2023-01-31 Verily Life Sciences Llc Suggesting behavioral adjustments based on physiological responses to stimuli on electronic devices
CN109189222B (zh) * 2018-08-28 2022-01-11 广东工业大学 一种基于检测瞳孔直径变化的人机交互方法及装置
US20200082176A1 (en) * 2018-09-12 2020-03-12 Toyota Motor Engineering & Manufacturing North America, Inc. Systems and methods for extending detachable automobile sensor capabilities for identification of selected object types
US10833945B2 (en) * 2018-11-13 2020-11-10 International Business Machines Corporation Managing downloading of content
CN109451236A (zh) * 2018-11-13 2019-03-08 深圳龙图腾创新设计有限公司 一种基于瞳位跟踪的相机聚焦方法
US11282259B2 (en) 2018-11-26 2022-03-22 International Business Machines Corporation Non-visual environment mapping
CN109711286B (zh) * 2018-12-11 2022-11-11 中国科学院深圳先进技术研究院 一种基于人工视网膜空间感知的控制方法及装置
US10786729B1 (en) 2019-03-08 2020-09-29 Sony Interactive Entertainment Inc. Thermopile array fusion tracking
EP3906669B1 (en) 2019-03-13 2024-06-05 Hewlett-Packard Development Company, L.P. Detecting eye tracking calibration errors
US10928647B2 (en) 2019-04-01 2021-02-23 Heidi Kershaw Therapeutic training device for autism
US10832733B1 (en) 2019-05-15 2020-11-10 International Business Machines Corporation Verbal command video editing
US10812771B1 (en) * 2019-06-12 2020-10-20 At&T Intellectual Property I, L.P. Methods, systems, and devices for adjusting image content for streaming panoramic video content
US12042240B2 (en) * 2019-07-16 2024-07-23 Asensus Surgical Us, Inc. Augmented reality using eye tracking in a robot assisted surgical system
JP7375373B2 (ja) * 2019-08-28 2023-11-08 セイコーエプソン株式会社 光学装置及び装着型表示装置
US11297224B2 (en) * 2019-09-30 2022-04-05 Snap Inc. Automated eyewear device sharing system
DE112020006208T5 (de) * 2019-12-18 2022-10-13 Korrus, Inc. System und Verfahren zur Blick-basierten Beleuchtung von Displays
CN111158492B (zh) * 2019-12-31 2021-08-06 维沃移动通信有限公司 视频剪辑方法及头戴式设备
CN113079311B (zh) * 2020-01-06 2023-06-27 北京小米移动软件有限公司 图像获取方法及装置、电子设备、存储介质
US12044516B2 (en) 2020-02-06 2024-07-23 Austin Star Detonator Company Integrated detonator sensors
US11176751B2 (en) 2020-03-17 2021-11-16 Snap Inc. Geospatial image surfacing and selection
RU2744548C1 (ru) * 2020-04-29 2021-03-11 федеральное государственное бюджетное образовательное учреждение высшего образования "Алтайский государственный университет" Устройство определения зрачковых реакций на визуальный стимул
CN111552076B (zh) * 2020-05-13 2022-05-06 歌尔科技有限公司 一种图像显示方法、ar眼镜及存储介质
EP3941077A4 (en) * 2020-05-22 2022-06-29 Beijing Baidu Netcom Science and Technology Co., Ltd. Method and apparatus for controlling video playing, and electronic device and storage medium
WO2021243311A1 (en) 2020-05-29 2021-12-02 Medtronic, Inc. Extended reality (xr) applications for cardiac arrhythmia procedures
WO2022055588A1 (en) 2020-09-08 2022-03-17 Medtronic, Inc. Imaging discovery utility for augmenting clinical image management
WO2022066476A1 (en) * 2020-09-23 2022-03-31 Sterling Labs Llc Detecting unexpected user interface behavior using physiological data
WO2022075983A1 (en) * 2020-10-07 2022-04-14 Hewlett-Packard Development Company, L.P. Operation of a configurable end-point device based on accessibility settings
US11908208B2 (en) * 2020-10-20 2024-02-20 Toyota Motor Engineering & Manufacturing North America, Inc. Interface sharpness distraction mitigation method and system
US20250306403A1 (en) * 2020-10-29 2025-10-02 William Hart Augmented reality glasses with object recognition using artifical intelligence
CN115398828A (zh) * 2020-12-14 2022-11-25 船井电机株式会社 多个用户的实时沉浸
US11232644B1 (en) * 2020-12-31 2022-01-25 Facebook Technologies, Llc Systems and methods for providing spatial awareness in virtual reality
US12165771B2 (en) * 2021-04-27 2024-12-10 Oura Health Oy Method and system for supplemental sleep detection
CN113509141A (zh) * 2021-06-29 2021-10-19 昆明依利科特科技有限公司 一种眼镜式涉毒行为瞳孔检测仪及检测方法
US20230050526A1 (en) * 2021-08-10 2023-02-16 International Business Machines Corporation Internet of things configuration using eye-based controls
US12135471B2 (en) 2021-09-10 2024-11-05 Tectus Corporation Control of an electronic contact lens using eye gestures
US20230119935A1 (en) * 2021-10-18 2023-04-20 Meta Platforms Technologies, Llc Gaze-guided image capture
US11592899B1 (en) 2021-10-28 2023-02-28 Tectus Corporation Button activation within an eye-controlled user interface
WO2023081297A1 (en) * 2021-11-05 2023-05-11 Zinn Labs, Inc. Eye tracking system for determining user activity
US11619994B1 (en) 2022-01-14 2023-04-04 Tectus Corporation Control of an electronic contact lens using pitch-based eye gestures
US12118138B2 (en) 2022-02-14 2024-10-15 Tectus Corporation Vergence authentication
US11874961B2 (en) 2022-05-09 2024-01-16 Tectus Corporation Managing display of an icon in an eye tracking augmented reality device
US20250365485A1 (en) * 2022-06-17 2025-11-27 Hewlett-Packard Development Company, L.P. Image portion combination signals
CN115501609B (zh) * 2022-09-23 2025-12-02 不鸣科技(杭州)有限公司 实例的运行方法、装置、设备及介质
JP2025044212A (ja) * 2023-09-19 2025-04-01 ソフトバンクグループ株式会社 システム
US12210679B1 (en) * 2024-01-08 2025-01-28 Rockwell Collins, Inc. Attention redirection within AR/XR immersive environments
WO2025150788A1 (ko) * 2024-01-09 2025-07-17 삼성전자 주식회사 웨어러블 전자 장치 및 상기 웨어러블 전자 장치의 제어 방법
US12405086B2 (en) 2024-01-18 2025-09-02 Styled Brands Inc. Adjustable reticles for sighting operations, and related methods, apparatus, and sight devices
CN118507013A (zh) * 2024-04-30 2024-08-16 南京鼓楼医院 一种基于眼动追踪技术的远程探视系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004180298A (ja) * 2002-11-25 2004-06-24 Eastman Kodak Co アイモニタリング機能を備えるカメラシステム
JP2007531579A (ja) 2004-04-01 2007-11-08 ウィリアム・シー・トーチ 目の動きをモニターするバイオセンサ、コミュニケーター及びコントローラー並びにそれらの使用方法

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USRE39539E1 (en) * 1996-08-19 2007-04-03 Torch William C System and method for monitoring eye movement
US6542081B2 (en) * 1996-08-19 2003-04-01 William C. Torch System and method for monitoring eye movement
US7460940B2 (en) * 2002-10-15 2008-12-02 Volvo Technology Corporation Method and arrangement for interpreting a subjects head and eye activity
US7574016B2 (en) * 2003-06-26 2009-08-11 Fotonation Vision Limited Digital image processing using face detection information
JP2005252734A (ja) 2004-03-04 2005-09-15 Olympus Corp 頭部装着型カメラ
US9269322B2 (en) * 2006-01-09 2016-02-23 Ignis Innovation Inc. Method and system for driving an active matrix display circuit
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
CN104299566B (zh) * 2008-04-18 2017-11-10 伊格尼斯创新公司 用于发光器件显示器的系统和驱动方法
JP5318503B2 (ja) * 2008-09-02 2013-10-16 ヤフー株式会社 画像検索装置
US20100128118A1 (en) * 2008-11-26 2010-05-27 Locarna Systems, Inc. Identification of visual fixations in a video stream
CN102292017B (zh) * 2009-01-26 2015-08-05 托比股份公司 由光学基准信号辅助的对凝视点的检测
EP2237237B1 (en) * 2009-03-30 2013-03-20 Tobii Technology AB Eye closure detection using structured illumination
US20110052012A1 (en) * 2009-03-31 2011-03-03 Myspace Inc. Security and Monetization Through Facial Recognition in Social Networking Websites
JP5613025B2 (ja) * 2009-11-18 2014-10-22 パナソニック株式会社 視線検出装置、視線検出方法、眼電位計測装置、ウェアラブルカメラ、ヘッドマウントディスプレイ、電子めがねおよび眼科診断装置
US9373123B2 (en) * 2009-12-30 2016-06-21 Iheartmedia Management Services, Inc. Wearable advertising ratings methods and systems
US20130012603A1 (en) 2010-03-15 2013-01-10 Farrell David H Methods for assessing the risk of cardiovascular disease
WO2012021967A1 (en) * 2010-08-16 2012-02-23 Tandemlaunch Technologies Inc. System and method for analyzing three-dimensional (3d) media content
US9690099B2 (en) 2010-12-17 2017-06-27 Microsoft Technology Licensing, Llc Optimized focal area for augmented reality displays
EP2499963A1 (en) * 2011-03-18 2012-09-19 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and apparatus for gaze point mapping
US8510166B2 (en) * 2011-05-11 2013-08-13 Google Inc. Gaze tracking system
US20130021374A1 (en) * 2011-07-20 2013-01-24 Google Inc. Manipulating And Displaying An Image On A Wearable Computing System
US9342610B2 (en) * 2011-08-25 2016-05-17 Microsoft Technology Licensing, Llc Portals: registered objects as virtualized, personalized displays
US9128520B2 (en) * 2011-09-30 2015-09-08 Microsoft Technology Licensing, Llc Service provision using personal audio/visual system
WO2013066334A1 (en) * 2011-11-03 2013-05-10 Intel Corporation Eye gaze based image capture
US10282055B2 (en) * 2012-03-06 2019-05-07 Apple Inc. Ordered processing of edits for a media editing application
US9096920B1 (en) * 2012-03-22 2015-08-04 Google Inc. User interface method
US9201512B1 (en) * 2012-04-02 2015-12-01 Google Inc. Proximity sensing for input detection
US20140328570A1 (en) * 2013-01-09 2014-11-06 Sri International Identifying, describing, and sharing salient events in images and videos
US20130328925A1 (en) * 2012-06-12 2013-12-12 Stephen G. Latta Object focus in a mixed reality environment
US20140176591A1 (en) * 2012-12-26 2014-06-26 Georg Klein Low-latency fusing of color image data
CA2942852C (en) * 2013-03-15 2023-03-28 Interaxon Inc. Wearable computing apparatus and method
US9213403B1 (en) * 2013-03-27 2015-12-15 Google Inc. Methods to pan, zoom, crop, and proportionally move on a head mountable display
US20140354533A1 (en) * 2013-06-03 2014-12-04 Shivkumar Swaminathan Tagging using eye gaze detection
US10089786B2 (en) * 2013-08-19 2018-10-02 Qualcomm Incorporated Automatic customization of graphical user interface for optical see-through head mounted display with user interaction tracking
US10114532B2 (en) * 2013-12-06 2018-10-30 Google Llc Editing options for image regions
KR102246310B1 (ko) * 2013-12-31 2021-04-29 아이플루언스, 인크. 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
WO2016018487A2 (en) * 2014-05-09 2016-02-04 Eyefluene, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004180298A (ja) * 2002-11-25 2004-06-24 Eastman Kodak Co アイモニタリング機能を備えるカメラシステム
JP2007531579A (ja) 2004-04-01 2007-11-08 ウィリアム・シー・トーチ 目の動きをモニターするバイオセンサ、コミュニケーター及びコントローラー並びにそれらの使用方法

Also Published As

Publication number Publication date
KR20160105439A (ko) 2016-09-06
KR20200133392A (ko) 2020-11-27
US9870060B2 (en) 2018-01-16
CN106030458A (zh) 2016-10-12
EP3090322A4 (en) 2017-07-19
JP2017507400A (ja) 2017-03-16
US20150220157A1 (en) 2015-08-06
US10915180B2 (en) 2021-02-09
EP3090322A1 (en) 2016-11-09
US20200387226A9 (en) 2020-12-10
JP6929644B2 (ja) 2021-09-01
US20190179418A1 (en) 2019-06-13
CN106030458B (zh) 2020-05-08
WO2015103444A1 (en) 2015-07-09
US20180173319A1 (en) 2018-06-21
KR102182605B1 (ko) 2020-11-24

Similar Documents

Publication Publication Date Title
KR102246310B1 (ko) 시선-기반 미디어 선택 및 편집을 위한 시스템들 및 방법들
US10831268B1 (en) Systems and methods for using eye tracking to improve user interactions with objects in artificial reality
CN112507799A (zh) 基于眼动注视点引导的图像识别方法、mr眼镜及介质
EP4161387B1 (en) Sound-based attentive state assessment
CN112181152A (zh) 基于mr眼镜的广告推送管理方法、设备及应用
US20180190011A1 (en) Content rendering systems for head-worn computers
US20120113209A1 (en) Non-Interference Field-of-view Support Apparatus for a Panoramic Facial Sensor
US20240164677A1 (en) Attention detection
CN115981000A (zh) 增强光学和感知数字护目镜
US12093457B2 (en) Creation of optimal working, learning, and resting environments on electronic devices
US20250208704A1 (en) Eye-gaze based biofeedback
US20240115831A1 (en) Enhanced meditation experience based on bio-feedback
WO2017143128A1 (en) Haptic systems for head-worn computers
US12210676B1 (en) User feedback based on retention prediction
US20230418372A1 (en) Gaze behavior detection
US12499629B1 (en) Extended-reality systems and methods for prioritizing display of object augments
US20240319789A1 (en) User interactions and eye tracking with text embedded elements

Legal Events

Date Code Title Description
A107 Divisional application of patent
PA0104 Divisional application for international application

Comment text: Divisional Application for International Patent

Patent event code: PA01041R01D

Patent event date: 20201117

Application number text: 1020167020195

Filing date: 20160722

PA0201 Request for examination
PG1501 Laying open of application
A302 Request for accelerated examination
PA0302 Request for accelerated examination

Patent event date: 20201218

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20210125

PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20210423

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20210426

End annual number: 3

Start annual number: 1

PG1601 Publication of registration