WO2009019760A1 - 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体 - Google Patents

動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体 Download PDF

Info

Publication number
WO2009019760A1
WO2009019760A1 PCT/JP2007/065404 JP2007065404W WO2009019760A1 WO 2009019760 A1 WO2009019760 A1 WO 2009019760A1 JP 2007065404 W JP2007065404 W JP 2007065404W WO 2009019760 A1 WO2009019760 A1 WO 2009019760A1
Authority
WO
WIPO (PCT)
Prior art keywords
moving object
cursor
user
pointing device
eyeball
Prior art date
Application number
PCT/JP2007/065404
Other languages
English (en)
French (fr)
Inventor
Takuya Niikawa
Original Assignee
Osaka Electro-Communication University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Osaka Electro-Communication University filed Critical Osaka Electro-Communication University
Priority to US12/666,222 priority Critical patent/US8717292B2/en
Priority to PCT/JP2007/065404 priority patent/WO2009019760A1/ja
Priority to JP2009526287A priority patent/JP4411387B2/ja
Publication of WO2009019760A1 publication Critical patent/WO2009019760A1/ja
Priority to US14/221,481 priority patent/US9632585B2/en
Priority to US15/495,741 priority patent/US9921663B2/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

 ユーザの眼球の運動に対応した視線の角度に応じてディスプレイ4上のユーザの注視点に対応させてカーソル表示させる視線入力によるポインティングデバイスを実現する。  ユーザが意図的に一点を注視しているつもりであるにも拘らず、ユーザの眼球が固視微動している場合でも、その微動をそのままカーソルの位置として再現することなくユーザが意図的に一点を注視していること、即ち眼球が停止していることを判別する。これにより、眼球が停止していると判断された場合は、固視微動に応じて注視点が微動していてもカーソルが停止して表示される。さらにカーソルが停止していることを判別することにより、カーソルが表示されている位置に表示されている他のアイコン等のオブジェクトが選択されていることを識別することができる。
PCT/JP2007/065404 2007-08-07 2007-08-07 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体 WO2009019760A1 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US12/666,222 US8717292B2 (en) 2007-08-07 2007-08-07 Moving object detecting apparatus, moving object detecting method, pointing device, and storage medium
PCT/JP2007/065404 WO2009019760A1 (ja) 2007-08-07 2007-08-07 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体
JP2009526287A JP4411387B2 (ja) 2007-08-07 2007-08-07 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体
US14/221,481 US9632585B2 (en) 2007-08-07 2014-03-21 Moving object detecting apparatus, moving object detecting method, pointing device, and storage medium
US15/495,741 US9921663B2 (en) 2007-08-07 2017-04-24 Moving object detecting apparatus, moving object detecting method, pointing device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2007/065404 WO2009019760A1 (ja) 2007-08-07 2007-08-07 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US12/666,222 A-371-Of-International US8717292B2 (en) 2007-08-07 2007-08-07 Moving object detecting apparatus, moving object detecting method, pointing device, and storage medium
US14/221,481 Continuation US9632585B2 (en) 2007-08-07 2014-03-21 Moving object detecting apparatus, moving object detecting method, pointing device, and storage medium

Publications (1)

Publication Number Publication Date
WO2009019760A1 true WO2009019760A1 (ja) 2009-02-12

Family

ID=40341008

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/065404 WO2009019760A1 (ja) 2007-08-07 2007-08-07 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体

Country Status (3)

Country Link
US (3) US8717292B2 (ja)
JP (1) JP4411387B2 (ja)
WO (1) WO2009019760A1 (ja)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014514658A (ja) * 2011-04-08 2014-06-19 アマゾン・テクノロジーズ、インコーポレイテッド 注視に基づくコンテンツディスプレイ
JP2015087921A (ja) * 2013-10-30 2015-05-07 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
US9563272B2 (en) 2012-05-31 2017-02-07 Amazon Technologies, Inc. Gaze assisted object recognition
US9921646B2 (en) 2013-03-25 2018-03-20 Seiko Epson Corporation Head-mounted display device and method of controlling head-mounted display device
JP2018530798A (ja) * 2015-08-15 2018-10-18 アイフルエンス, インコーポレイテッドEyefluence, Inc. 実在オブジェクトおよび仮想オブジェクトと対話するための生体力学に基づく視覚信号用のシステムおよび方法
WO2019230096A1 (ja) * 2018-05-31 2019-12-05 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
US10726575B2 (en) 2017-10-02 2020-07-28 Fujitsu Limited Information processing apparatus, recording medium recording line-of-sight detection program, and line-of-sight detection method
CN112860059A (zh) * 2021-01-08 2021-05-28 广州朗国电子科技有限公司 一种基于眼球追踪的图像识别方法、设备及存储介质

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8793620B2 (en) * 2011-04-21 2014-07-29 Sony Computer Entertainment Inc. Gaze-assisted computer interface
WO2011117776A1 (en) * 2010-03-22 2011-09-29 Koninklijke Philips Electronics N.V. System and method for tracking the point of gaze of an observer
JP5539945B2 (ja) * 2011-11-01 2014-07-02 株式会社コナミデジタルエンタテインメント ゲーム装置、及びプログラム
CN103096141B (zh) * 2011-11-08 2019-06-11 华为技术有限公司 一种获取视觉角度的方法、装置及系统
US20130188825A1 (en) * 2012-01-19 2013-07-25 Utechzone Co., Ltd. Image recognition-based startup method
US20130187845A1 (en) * 2012-01-20 2013-07-25 Visteon Global Technologies, Inc. Adaptive interface system
US8937591B2 (en) * 2012-04-06 2015-01-20 Apple Inc. Systems and methods for counteracting a perceptual fading of a movable indicator
US20140092018A1 (en) * 2012-09-28 2014-04-03 Ralf Wolfgang Geithner Non-mouse cursor control including modified keyboard input
US9342145B2 (en) * 2013-01-22 2016-05-17 Kabushiki Kaisha Toshiba Cursor control
USD737250S1 (en) 2013-03-14 2015-08-25 Select Comfort Corporation Remote control
WO2014162762A1 (ja) * 2013-04-02 2014-10-09 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
TW201445364A (zh) 2013-05-30 2014-12-01 Hon Hai Prec Ind Co Ltd 視訊終端設備及其判斷眼神意圖的方法
CN104219482B (zh) * 2013-05-30 2017-10-03 鸿富锦精密工业(深圳)有限公司 视频终端设备及其判断眼神意图的方法
US9311718B2 (en) * 2014-01-23 2016-04-12 Microsoft Technology Licensing, Llc Automated content scrolling
US9201578B2 (en) * 2014-01-23 2015-12-01 Microsoft Technology Licensing, Llc Gaze swipe selection
US10133346B2 (en) 2014-05-30 2018-11-20 Koç Üniversitesi Gaze based prediction device and method
CN106155288B (zh) * 2015-04-10 2019-02-12 北京智谷睿拓技术服务有限公司 信息获取方法、信息获取装置及用户设备
CN114758406B (zh) 2015-05-11 2024-02-23 奇跃公司 用于使用神经网络的生物特征用户识别的设备、方法和系统
EP3369091B1 (en) * 2015-10-26 2024-09-04 Pillantas Inc. Systems and methods for eye vergence control
KR101697286B1 (ko) * 2015-11-09 2017-01-18 경북대학교 산학협력단 사용자 스타일링을 위한 증강현실 제공 장치 및 방법
JP6097377B1 (ja) * 2015-11-27 2017-03-15 株式会社コロプラ 画像表示方法及びプログラム
CN107016270A (zh) * 2015-12-01 2017-08-04 由田新技股份有限公司 结合脸部认证或手部认证的动态图形眼动认证系统、方法
JP6691847B2 (ja) * 2016-07-20 2020-05-13 シュナイダーエレクトリックホールディングス株式会社 表示制御方法
JP6851745B2 (ja) * 2016-08-04 2021-03-31 富士通株式会社 画像制御方法、装置、及びプログラム
KR101896790B1 (ko) * 2016-11-08 2018-10-18 현대자동차주식회사 운전자 집중도 판정 장치, 그를 포함한 시스템 및 그 방법
EP3736666B1 (en) * 2018-01-04 2024-06-05 Sony Group Corporation Information processing device, information processing method and program
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
CN110456911B (zh) * 2019-08-09 2022-05-13 Oppo广东移动通信有限公司 电子设备控制方法和装置、电子设备、可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11110120A (ja) * 1997-10-07 1999-04-23 Canon Inc 視線情報入力装置及び視線情報入力方法
JPH11282617A (ja) * 1998-03-27 1999-10-15 Shimadzu Corp 視線入力装置
JP2006309291A (ja) * 2005-04-26 2006-11-09 National Univ Corp Shizuoka Univ 瞳孔検出に基づくポインティング装置及び方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6061064A (en) * 1993-08-31 2000-05-09 Sun Microsystems, Inc. System and method for providing and using a computer user interface with a view space having discrete portions
US6219034B1 (en) * 1998-02-23 2001-04-17 Kristofer E. Elbing Tactile computer interface
US6295049B1 (en) * 1999-03-03 2001-09-25 Richard T. Minner Computer system utilizing graphical user interface with hysteresis to inhibit accidental selection of a region due to unintended cursor motion and method
US6603491B2 (en) * 2000-05-26 2003-08-05 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display or screen
JP4652536B2 (ja) 2000-08-21 2011-03-16 三菱電機株式会社 動き情報検知装置及び動き情報検知方法及び動き情報検知プログラムを記録した記録媒体
JP4421121B2 (ja) 2001-02-06 2010-02-24 株式会社日立国際電気 侵入物体検出方法
JP4260715B2 (ja) 2004-09-24 2009-04-30 日本電信電話株式会社 視線測定方法および視線測定装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11110120A (ja) * 1997-10-07 1999-04-23 Canon Inc 視線情報入力装置及び視線情報入力方法
JPH11282617A (ja) * 1998-03-27 1999-10-15 Shimadzu Corp 視線入力装置
JP2006309291A (ja) * 2005-04-26 2006-11-09 National Univ Corp Shizuoka Univ 瞳孔検出に基づくポインティング装置及び方法

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014514658A (ja) * 2011-04-08 2014-06-19 アマゾン・テクノロジーズ、インコーポレイテッド 注視に基づくコンテンツディスプレイ
US9563272B2 (en) 2012-05-31 2017-02-07 Amazon Technologies, Inc. Gaze assisted object recognition
US9921646B2 (en) 2013-03-25 2018-03-20 Seiko Epson Corporation Head-mounted display device and method of controlling head-mounted display device
JP2015087921A (ja) * 2013-10-30 2015-05-07 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
JP2018530798A (ja) * 2015-08-15 2018-10-18 アイフルエンス, インコーポレイテッドEyefluence, Inc. 実在オブジェクトおよび仮想オブジェクトと対話するための生体力学に基づく視覚信号用のシステムおよび方法
US10726575B2 (en) 2017-10-02 2020-07-28 Fujitsu Limited Information processing apparatus, recording medium recording line-of-sight detection program, and line-of-sight detection method
WO2019230096A1 (ja) * 2018-05-31 2019-12-05 ソニー株式会社 情報処理装置、情報処理方法およびプログラム
US11487355B2 (en) 2018-05-31 2022-11-01 Sony Corporation Information processing apparatus and information processing method
CN112860059A (zh) * 2021-01-08 2021-05-28 广州朗国电子科技有限公司 一种基于眼球追踪的图像识别方法、设备及存储介质

Also Published As

Publication number Publication date
US9921663B2 (en) 2018-03-20
US20100201621A1 (en) 2010-08-12
US20170308172A1 (en) 2017-10-26
US20140204025A1 (en) 2014-07-24
JP4411387B2 (ja) 2010-02-10
JPWO2009019760A1 (ja) 2010-10-28
US8717292B2 (en) 2014-05-06
US9632585B2 (en) 2017-04-25

Similar Documents

Publication Publication Date Title
WO2009019760A1 (ja) 動体検出装置、動体検出方法、ポインティングデバイス、コンピュータプログラム及び記憶媒体
WO2012015625A3 (en) System with touch-based selection of data items
AU2019271873A1 (en) User interfaces for retrieving contextually relevant media content
US20130328775A1 (en) User Interface Elements Positioned for Display
WO2009120299A3 (en) Computer pointing input device
WO2010075136A3 (en) Touch-sensitive display screen with absolute and relative input modes
US20140198057A1 (en) Apparatus and method for an adaptive edge-to-edge display system for multi-touch devices
WO2012009444A3 (en) Systems and methods for dual use remote-control devices
WO2013010154A3 (en) Launcher for context based menus
WO2010029415A3 (en) Method and apparatus for providing finger touch layers in a user agent
WO2009142871A3 (en) Panning content utilizing a drag operation
WO2009103353A3 (en) Identifying and responding to multiple time-overlapping touches on a touch panel
WO2010107653A3 (en) Methods and graphical user interfaces for editing on a multifunction device with a touch screen display
JP2014528608A5 (ja)
WO2010138477A3 (en) User movement feedback via on-screen avatars
US10678303B2 (en) Method for controlling electronic device and electronic device
WO2013130203A3 (en) Methods and apparatuses for operating a display in a wearable electronic device
WO2013130202A3 (en) Methods and apparatuses for operating a display in an electronic device
WO2012083223A3 (en) Detecting gestures involving intentional movement of a computing device
WO2010148155A3 (en) Surface computer user interaction
WO2011159531A3 (en) Control selection approximation
WO2009146070A8 (en) System and method for streamlining user interaction with electronic content
WO2011084956A3 (en) User interface methods and systems for providing force-sensitive input
WO2008085739A3 (en) Method, system, and graphical user interface for viewing multiple application windows
WO2012134583A3 (en) Continued virtual links between gestures and user interface elements

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2009526287

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07792073

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 12666222

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07792073

Country of ref document: EP

Kind code of ref document: A1