JP5689850B2 - 映像解析装置、映像解析方法、および注視点表示システム - Google Patents

映像解析装置、映像解析方法、および注視点表示システム Download PDF

Info

Publication number
JP5689850B2
JP5689850B2 JP2012120124A JP2012120124A JP5689850B2 JP 5689850 B2 JP5689850 B2 JP 5689850B2 JP 2012120124 A JP2012120124 A JP 2012120124A JP 2012120124 A JP2012120124 A JP 2012120124A JP 5689850 B2 JP5689850 B2 JP 5689850B2
Authority
JP
Japan
Prior art keywords
user
movement
head
light source
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2012120124A
Other languages
English (en)
Japanese (ja)
Other versions
JP2013244212A5 (https=
JP2013244212A (ja
Inventor
善数 大貫
善数 大貫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Inc, Sony Computer Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Priority to JP2012120124A priority Critical patent/JP5689850B2/ja
Priority to CN201380025947.1A priority patent/CN104302226B/zh
Priority to PCT/JP2013/002483 priority patent/WO2013175701A1/ja
Priority to US14/400,979 priority patent/US9727130B2/en
Publication of JP2013244212A publication Critical patent/JP2013244212A/ja
Publication of JP2013244212A5 publication Critical patent/JP2013244212A5/ja
Application granted granted Critical
Publication of JP5689850B2 publication Critical patent/JP5689850B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3209—Monitoring remote activity, e.g. over telephone lines or network connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • General Health & Medical Sciences (AREA)
  • Eye Examination Apparatus (AREA)
  • Position Input By Displaying (AREA)
JP2012120124A 2012-05-25 2012-05-25 映像解析装置、映像解析方法、および注視点表示システム Active JP5689850B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2012120124A JP5689850B2 (ja) 2012-05-25 2012-05-25 映像解析装置、映像解析方法、および注視点表示システム
CN201380025947.1A CN104302226B (zh) 2012-05-25 2013-04-11 视频分析设备、视频分析方法和注视点显示系统
PCT/JP2013/002483 WO2013175701A1 (ja) 2012-05-25 2013-04-11 映像解析装置、映像解析方法、および注視点表示システム
US14/400,979 US9727130B2 (en) 2012-05-25 2013-04-11 Video analysis device, video analysis method, and point-of-gaze display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012120124A JP5689850B2 (ja) 2012-05-25 2012-05-25 映像解析装置、映像解析方法、および注視点表示システム

Publications (3)

Publication Number Publication Date
JP2013244212A JP2013244212A (ja) 2013-12-09
JP2013244212A5 JP2013244212A5 (https=) 2014-07-03
JP5689850B2 true JP5689850B2 (ja) 2015-03-25

Family

ID=49623416

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012120124A Active JP5689850B2 (ja) 2012-05-25 2012-05-25 映像解析装置、映像解析方法、および注視点表示システム

Country Status (4)

Country Link
US (1) US9727130B2 (https=)
JP (1) JP5689850B2 (https=)
CN (1) CN104302226B (https=)
WO (1) WO2013175701A1 (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2924540B1 (de) * 2014-03-27 2019-04-24 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Verfahren und System zum Betreiben einer Anzeigevorrichtung
WO2016100931A1 (en) * 2014-12-18 2016-06-23 Oculus Vr, Llc Method, system and device for navigating in a virtual reality environment
WO2016138969A1 (en) 2015-03-03 2016-09-09 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Head mounted eye tracking device and method for providing drift free eye tracking through a lens system
EP3353631A1 (en) 2015-09-24 2018-08-01 Tobii AB Eye-tracking enabled wearable devices
US10565446B2 (en) 2015-09-24 2020-02-18 Tobii Ab Eye-tracking enabled wearable devices
US10956544B1 (en) 2016-04-01 2021-03-23 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
US10733275B1 (en) * 2016-04-01 2020-08-04 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
JP2017211891A (ja) 2016-05-27 2017-11-30 ソニー株式会社 情報処理装置、情報処理方法および記録媒体
CN107357429B (zh) * 2017-07-10 2020-04-07 京东方科技集团股份有限公司 用于确定视线的方法、设备和计算机可读存储介质
TWI704501B (zh) * 2018-08-09 2020-09-11 宏碁股份有限公司 可由頭部操控的電子裝置與其操作方法
US11353952B2 (en) 2018-11-26 2022-06-07 Tobii Ab Controlling illuminators for optimal glints
CN110051319A (zh) * 2019-04-23 2019-07-26 七鑫易维(深圳)科技有限公司 眼球追踪传感器的调节方法、装置、设备及存储介质
JP7760391B2 (ja) * 2022-01-25 2025-10-27 キヤノン株式会社 光学装置、撮像装置、光学装置の制御方法、およびプログラム
CN116027887B (zh) * 2022-05-20 2024-03-29 荣耀终端有限公司 一种显示方法和电子设备

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1540992A (en) * 1975-04-22 1979-02-21 Smiths Industries Ltd Display or other systems and equipment for use in such systems
US5016282A (en) * 1988-07-14 1991-05-14 Atr Communication Systems Research Laboratories Eye tracking image pickup apparatus for separating noise from feature portions
US4852988A (en) * 1988-09-12 1989-08-01 Applied Science Laboratories Visor and camera providing a parallax-free field-of-view image for a head-mounted eye movement measurement system
JPH04288122A (ja) * 1991-03-18 1992-10-13 A T R Shichiyoukaku Kiko Kenkyusho:Kk 視線表示装置
JP2988178B2 (ja) * 1993-03-11 1999-12-06 日産自動車株式会社 視線方向計測装置
JP3185522B2 (ja) 1994-02-15 2001-07-11 日産自動車株式会社 車両用視線方向計測装置
FR2731896B1 (fr) * 1995-03-24 1997-08-29 Commissariat Energie Atomique Dispositif de mesure de la position du point de fixation d'un oeil sur une cible, procede d'eclairage de l'oeil et application a l'affichage d'images dont les images changent en fonction des mouvements de l'oeil
JPH09179062A (ja) * 1995-12-25 1997-07-11 Canon Inc コンピュータシステム
JP2000316811A (ja) 1999-05-14 2000-11-21 Sumitomo Osaka Cement Co Ltd 眼球運動測定装置
DE19953835C1 (de) * 1999-10-30 2001-05-23 Hertz Inst Heinrich Rechnerunterstütztes Verfahren zur berührungslosen, videobasierten Blickrichtungsbestimmung eines Anwenderauges für die augengeführte Mensch-Computer-Interaktion und Vorrichtung zur Durchführung des Verfahrens
JP2002143094A (ja) * 2000-11-07 2002-05-21 Nac Image Technology Inc 視線検出装置
US7963652B2 (en) * 2003-11-14 2011-06-21 Queen's University At Kingston Method and apparatus for calibration-free eye tracking
US8077914B1 (en) * 2006-08-07 2011-12-13 Arkady Kaplan Optical tracking apparatus using six degrees of freedom
WO2010003410A1 (en) * 2008-07-08 2010-01-14 It-University Of Copenhagen Eye gaze tracking
CN101872237B (zh) 2009-04-23 2012-04-18 由田新技股份有限公司 瞳孔追踪方法与系统及用于瞳孔追踪的校正方法与模组
EP2309307B1 (en) * 2009-10-08 2020-12-09 Tobii Technology AB Eye tracking using a GPU
CN101901485B (zh) 2010-08-11 2014-12-03 华中科技大学 3d自由头动式视线跟踪系统
FR2970576B1 (fr) * 2011-01-19 2013-02-08 Matchic Labs Procede de determination de la direction du regard et dispositif pour sa mise en oeuvre
US8929589B2 (en) * 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
US8913789B1 (en) * 2012-01-06 2014-12-16 Google Inc. Input methods and systems for eye positioning using plural glints

Also Published As

Publication number Publication date
US20150130714A1 (en) 2015-05-14
CN104302226A (zh) 2015-01-21
US9727130B2 (en) 2017-08-08
WO2013175701A1 (ja) 2013-11-28
JP2013244212A (ja) 2013-12-09
CN104302226B (zh) 2016-07-06

Similar Documents

Publication Publication Date Title
JP5689850B2 (ja) 映像解析装置、映像解析方法、および注視点表示システム
JP6902075B2 (ja) 構造化光を用いた視線追跡
US11861062B2 (en) Blink-based calibration of an optical see-through head-mounted display
JP6340503B2 (ja) 目追跡システム及び利き目を検出する方法
US6659611B2 (en) System and method for eye gaze tracking using corneal image mapping
US9398848B2 (en) Eye gaze tracking
US10025384B1 (en) Eye tracking architecture for common structured light and time-of-flight framework
Coutinho et al. Improving head movement tolerance of cross-ratio based eye trackers
CN104089606B (zh) 一种自由空间视线跟踪测量方法
WO2017053972A1 (en) Eye-tracking enabled wearable devices
WO2016204990A1 (en) Apparatus and method for hybrid eye tracking
US10433725B2 (en) System and method for capturing spatially and temporally coherent eye gaze and hand data during performance of a manual task
JP2016520917A (ja) 経時的な確率的オブジェクト追跡のためのシステムおよび方法
CN109634431B (zh) 无介质浮空投影视觉追踪互动系统
Tatler et al. Eye movement recordings in natural settings
JP2019021049A (ja) 情報処理装置、情報処理方法、及びプログラム
JP2019097675A (ja) 視線検出校正方法、システム、及びコンピュータプログラム
JP2019024608A (ja) 視線検出校正方法、システム、及びコンピュータプログラム
US10963046B1 (en) Drift corrected eye tracking
JP2015123262A (ja) 角膜表面反射画像を利用した視線計測方法及びその装置
Mantiuk Accuracy of high-end and self-build eye-tracking systems
US20250281085A1 (en) Systems and methods for performing a motor skills neurological test using augmented or virtual reality
US20240265574A1 (en) Method and system for determining direction of gaze
WO2024166116A1 (en) Retina image references for gaze tracking
Ibrahim et al. A Study towards Improving Eye Tracking Calibration Technique Using Support Vector Regression

Legal Events

Date Code Title Description
A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140519

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20140519

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20150120

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20150129

R150 Certificate of patent or registration of utility model

Ref document number: 5689850

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250