JP5885835B2 - ユーザの眼球の動きによって操作可能なコンピュータ装置、およびそのコンピュータ装置を操作する方法 - Google Patents

ユーザの眼球の動きによって操作可能なコンピュータ装置、およびそのコンピュータ装置を操作する方法 Download PDF

Info

Publication number
JP5885835B2
JP5885835B2 JP2014516161A JP2014516161A JP5885835B2 JP 5885835 B2 JP5885835 B2 JP 5885835B2 JP 2014516161 A JP2014516161 A JP 2014516161A JP 2014516161 A JP2014516161 A JP 2014516161A JP 5885835 B2 JP5885835 B2 JP 5885835B2
Authority
JP
Japan
Prior art keywords
eye movement
movement pattern
user
display
eyeball
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014516161A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014517429A (ja
JP2014517429A5 (enExample
Inventor
ソン，ウエンジユアン
ソン，ジアンピン
ドウ，リン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of JP2014517429A publication Critical patent/JP2014517429A/ja
Publication of JP2014517429A5 publication Critical patent/JP2014517429A5/ja
Application granted granted Critical
Publication of JP5885835B2 publication Critical patent/JP5885835B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00216—Electrical control of surgical instruments with eye tracking or head position tracking control
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
JP2014516161A 2011-06-24 2011-06-24 ユーザの眼球の動きによって操作可能なコンピュータ装置、およびそのコンピュータ装置を操作する方法 Active JP5885835B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2011/076288 WO2012174743A1 (en) 2011-06-24 2011-06-24 Computer device operable with user's eye movement and method for operating the computer device

Publications (3)

Publication Number Publication Date
JP2014517429A JP2014517429A (ja) 2014-07-17
JP2014517429A5 JP2014517429A5 (enExample) 2014-08-28
JP5885835B2 true JP5885835B2 (ja) 2016-03-16

Family

ID=47422002

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014516161A Active JP5885835B2 (ja) 2011-06-24 2011-06-24 ユーザの眼球の動きによって操作可能なコンピュータ装置、およびそのコンピュータ装置を操作する方法

Country Status (6)

Country Link
US (1) US9411416B2 (enExample)
EP (1) EP2724209B1 (enExample)
JP (1) JP5885835B2 (enExample)
KR (1) KR20140041570A (enExample)
CN (1) CN103782251A (enExample)
WO (1) WO2012174743A1 (enExample)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR112014012556A2 (pt) * 2011-12-23 2017-06-06 Thomson Licensing dispositivo de computador com o gerenciamento de consumo de energia e método para com o gerenciamento de consumo de energia do dispositivo de computador
WO2014111924A1 (en) 2013-01-15 2014-07-24 Poow Innovation Ltd. Dynamic icons
KR102081930B1 (ko) * 2013-03-21 2020-02-26 엘지전자 주식회사 시선 위치를 디텍트하는 디스플레이 디바이스 및 제어 방법
JP2015014938A (ja) * 2013-07-05 2015-01-22 由田新技股▲分▼有限公司 車内アイコントロール方法、およびその方法を実現する電子デバイス
JP6213027B2 (ja) * 2013-08-06 2017-10-18 富士通株式会社 精読判断装置、精読判断方法及び精読判断プログラム
US10310597B2 (en) 2013-09-03 2019-06-04 Tobii Ab Portable eye tracking device
US10686972B2 (en) 2013-09-03 2020-06-16 Tobii Ab Gaze assisted field of view control
CN105682539B (zh) 2013-09-03 2018-03-16 托比股份公司 便携式眼睛追踪设备
US10026095B2 (en) * 2013-09-10 2018-07-17 Chian Chiu Li Systems and methods for obtaining and utilizing user reaction and feedback
JP6115418B2 (ja) * 2013-09-11 2017-04-19 富士通株式会社 情報処理装置、方法及びプログラム
TWI550438B (zh) * 2013-10-04 2016-09-21 由田新技股份有限公司 記錄閱讀行爲的方法及裝置
US10878446B2 (en) * 2014-08-18 2020-12-29 Chian Chiu Li Systems and methods for obtaining and utilizing user reaction and feedback
JP6038089B2 (ja) * 2014-09-22 2016-12-07 京セラドキュメントソリューションズ株式会社 文書閲覧装置、文書閲覧装置の制御方法
CN104317396B (zh) * 2014-10-10 2017-11-17 宇龙计算机通信科技(深圳)有限公司 一种屏幕自动形变的方法、装置及终端设备
US9529432B2 (en) * 2014-12-22 2016-12-27 Rakuten Kobo, Inc. Progressive page transition feature for rendering e-books on computing devices
CN104793732A (zh) * 2015-01-04 2015-07-22 北京君正集成电路股份有限公司 一种智能眼镜的操作方法及智能眼镜
WO2016151956A1 (ja) * 2015-03-23 2016-09-29 ソニー株式会社 情報処理システムおよび情報処理方法
US11470365B2 (en) 2016-03-17 2022-10-11 Melanie Schulz Video reader with music word learning feature
CN106528689B (zh) * 2016-10-24 2019-11-01 北京小米移动软件有限公司 页面内容的展示方法及装置、电子设备
US11544359B2 (en) * 2016-11-08 2023-01-03 Proprius Technolgies S.A.R.L Unique patterns extracted from involuntary eye motions to identify individuals
KR102518653B1 (ko) * 2017-12-13 2023-04-06 현대자동차주식회사 사용자 사용 언어 방향에 따라 디스플레이 환경을 구성하는 디스플레이 제어 장치 및 그 방법
CN116507997A (zh) 2020-09-11 2023-07-28 苹果公司 在环境中显示用户界面的方法及对应电子设备和计算机可读存储介质
CN116420130A (zh) 2020-09-25 2023-07-11 苹果公司 用于调节和/或控制与用户界面相关联的沉浸度的方法
EP4200691A1 (en) 2020-09-25 2023-06-28 Apple Inc. Methods for navigating user interfaces
US11995230B2 (en) * 2021-02-11 2024-05-28 Apple Inc. Methods for presenting and sharing content in an environment
US12189845B2 (en) 2021-02-16 2025-01-07 Athena Accessible Technology, Inc. Systems and methods for hands-free scrolling based on a detected user reading activity
US11775060B2 (en) * 2021-02-16 2023-10-03 Athena Accessible Technology, Inc. Systems and methods for hands-free scrolling
JP7552510B2 (ja) * 2021-06-09 2024-09-18 トヨタ自動車株式会社 車両遠隔操作装置、車両遠隔操作システム、車両遠隔操作方法、車両遠隔操作プログラム
CN119960596A (zh) 2021-09-23 2025-05-09 苹果公司 用于内容应用的设备、方法和图形用户界面
US12456271B1 (en) 2021-11-19 2025-10-28 Apple Inc. System and method of three-dimensional object cleanup and text annotation
US12272005B2 (en) 2022-02-28 2025-04-08 Apple Inc. System and method of three-dimensional immersive applications in multi-user communication sessions

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4973149A (en) * 1987-08-19 1990-11-27 Center For Innovative Technology Eye movement detector
WO1993014454A1 (en) * 1992-01-10 1993-07-22 Foster-Miller, Inc. A sensory integrated data interface
US5360971A (en) * 1992-03-31 1994-11-01 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US5517021A (en) * 1993-01-19 1996-05-14 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
JP3359948B2 (ja) * 1993-03-31 2002-12-24 株式会社東芝 資料呈示装置及び方法
US5835083A (en) * 1996-05-30 1998-11-10 Sun Microsystems, Inc. Eyetrack-driven illumination and information display
JP2000010722A (ja) * 1998-06-18 2000-01-14 Mr System Kenkyusho:Kk 視線ユーザ・インタフェース装置、そのインタフェース方法、コンピュータ装置、その制御方法、およびプログラム記憶媒体
JP3567084B2 (ja) 1998-06-30 2004-09-15 シャープ株式会社 電子ブック装置
US6106119A (en) * 1998-10-16 2000-08-22 The Board Of Trustees Of The Leland Stanford Junior University Method for presenting high level interpretations of eye tracking data correlated to saved display images
US6195640B1 (en) 1999-01-29 2001-02-27 International Business Machines Corporation Audio reader
US6873314B1 (en) * 2000-08-29 2005-03-29 International Business Machines Corporation Method and system for the recognition of reading skimming and scanning from eye-gaze patterns
JP2003162356A (ja) * 2001-11-28 2003-06-06 Nec Corp スクロール制御装置及びその方法並びにそれを用いた通信端末
US7365738B2 (en) 2003-12-02 2008-04-29 International Business Machines Corporation Guides and indicators for eye movement monitoring systems
US7091471B2 (en) * 2004-03-15 2006-08-15 Agilent Technologies, Inc. Using eye detection for providing control and power management of electronic devices
US20110077548A1 (en) * 2004-04-01 2011-03-31 Torch William C Biosensors, communicators, and controllers monitoring eye movement and methods for using them
JP2006107048A (ja) 2004-10-04 2006-04-20 Matsushita Electric Ind Co Ltd 視線対応制御装置および視線対応制御方法
WO2006100645A2 (en) 2005-03-24 2006-09-28 Koninklijke Philips Electronics, N.V. Immersive reading experience using eye tracking
CN1293446C (zh) 2005-06-02 2007-01-03 北京中星微电子有限公司 一种非接触式目控操作系统和方法
US7438414B2 (en) * 2005-07-28 2008-10-21 Outland Research, Llc Gaze discriminating electronic control apparatus, system, method and computer program product
US9213404B2 (en) * 2006-02-01 2015-12-15 Tobii Technology Ab Generation of graphical feedback in a computer system
JP5129478B2 (ja) * 2006-03-24 2013-01-30 株式会社デンソーアイティーラボラトリ 画面表示装置
JP4685708B2 (ja) * 2006-05-22 2011-05-18 富士通株式会社 携帯端末装置
US10437459B2 (en) 2007-01-07 2019-10-08 Apple Inc. Multitouch data fusion
CN101308400A (zh) * 2007-05-18 2008-11-19 肖斌 基于眼动和头动检测的新型人机交互装置
US8122384B2 (en) * 2007-09-18 2012-02-21 Palo Alto Research Center Incorporated Method and apparatus for selecting an object within a user interface by performing a gesture
JP2009075937A (ja) * 2007-09-21 2009-04-09 Victor Co Of Japan Ltd 機器動作設定装置
JP4399513B2 (ja) 2008-01-25 2010-01-20 パナソニック株式会社 脳波インタフェースシステム、脳波インタフェース装置、方法およびコンピュータプログラム
CN101291364B (zh) 2008-05-30 2011-04-27 华为终端有限公司 一种移动通信终端的交互方法、装置及移动通信终端
KR20090127779A (ko) 2008-06-09 2009-12-14 김영규 동공 인식을 이용한 속독 기술
JP5289889B2 (ja) * 2008-10-24 2013-09-11 シャープ株式会社 表示装置、表示装置の制御方法、表示装置を制御するためのプログラム
WO2010051037A1 (en) * 2008-11-03 2010-05-06 Bruce Reiner Visually directed human-computer interaction for medical applications
CN101441513B (zh) 2008-11-26 2010-08-11 北京科技大学 一种利用视觉进行非接触式人机交互的系统
US20100182232A1 (en) 2009-01-22 2010-07-22 Alcatel-Lucent Usa Inc. Electronic Data Input System
US8255827B2 (en) * 2009-01-26 2012-08-28 Microsoft Corporation Dynamic feature presentation based on vision detection
US20120105486A1 (en) * 2009-04-09 2012-05-03 Dynavox Systems Llc Calibration free, motion tolerent eye-gaze direction detector with contextually aware computer interaction and communication methods
CN103081449B (zh) * 2010-09-13 2015-09-09 Lg电子株式会社 移动终端及其操作控制方法
JP5558983B2 (ja) 2010-09-15 2014-07-23 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 画面表示装置、画面表示制御方法及び画面表示制御プログラム並びに情報端末装置
US8655796B2 (en) * 2011-06-17 2014-02-18 Sanjay Udani Methods and systems for recording verifiable documentation
US8451246B1 (en) * 2012-05-11 2013-05-28 Google Inc. Swipe gesture classification

Also Published As

Publication number Publication date
EP2724209A4 (en) 2014-11-26
CN103782251A (zh) 2014-05-07
JP2014517429A (ja) 2014-07-17
WO2012174743A1 (en) 2012-12-27
KR20140041570A (ko) 2014-04-04
US9411416B2 (en) 2016-08-09
US20140125585A1 (en) 2014-05-08
EP2724209B1 (en) 2019-07-31
EP2724209A1 (en) 2014-04-30

Similar Documents

Publication Publication Date Title
JP5885835B2 (ja) ユーザの眼球の動きによって操作可能なコンピュータ装置、およびそのコンピュータ装置を操作する方法
US11650659B2 (en) User input processing with eye tracking
US9646200B2 (en) Fast pose detector
US9703373B2 (en) User interface control using gaze tracking
US9672421B2 (en) Method and apparatus for recording reading behavior
CN103336576B (zh) 一种基于眼动追踪进行浏览器操作的方法及装置
US20090284608A1 (en) Gaze tracking apparatus and method using difference image entropy
CN104331168A (zh) 显示调整方法和电子设备
CN110476141A (zh) 视线跟踪方法及用于执行该方法的用户终端
KR20140002007A (ko) 정보 처리 장치, 정보 처리 방법 및 기록 매체
JP2015153195A (ja) ジェスチャ認識装置およびジェスチャ認識装置の制御方法
CN104598019A (zh) 画面操作装置以及画面操作方法
Khamis et al. Understanding face and eye visibility in front-facing cameras of smartphones used in the wild
KR101631011B1 (ko) 제스처 인식 장치 및 제스처 인식 장치의 제어 방법
EP3699808B1 (en) Facial image detection method and terminal device
US20230305634A1 (en) Gesture recognition apparatus, head-mounted-type display apparatus, gesture recognition method, and non-transitory computer readable medium
CN106468944A (zh) 非接触式控制系统及方法
US11250242B2 (en) Eye tracking method and user terminal performing same
JP6304473B2 (ja) 画像処理システム、画像処理方法及びプログラム
US20150103205A1 (en) Method of controlling digital apparatus and image capture method by recognition of hand shape, and apparatus therefor
US20200285874A1 (en) Biometric authentication device and computer program product

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140618

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20140618

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20150226

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20150424

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20150520

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20150811

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20151021

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20151109

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160203

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160209

R150 Certificate of patent or registration of utility model

Ref document number: 5885835

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250