JP7472300B2 - 視線追跡 - Google Patents

視線追跡 Download PDF

Info

Publication number
JP7472300B2
JP7472300B2 JP2022550670A JP2022550670A JP7472300B2 JP 7472300 B2 JP7472300 B2 JP 7472300B2 JP 2022550670 A JP2022550670 A JP 2022550670A JP 2022550670 A JP2022550670 A JP 2022550670A JP 7472300 B2 JP7472300 B2 JP 7472300B2
Authority
JP
Japan
Prior art keywords
user
eye
calibration
optical device
virtual plane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022550670A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023514419A (ja
JP2023514419A5 (enExample
Inventor
トイヴァネン，ミイカ
ルカンダー，クリスチャン
ベドナリック，ローマン
バルトチャック，ピオトル
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seetrue Technologies Oy
Original Assignee
Seetrue Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Seetrue Technologies Oy filed Critical Seetrue Technologies Oy
Publication of JP2023514419A publication Critical patent/JP2023514419A/ja
Publication of JP2023514419A5 publication Critical patent/JP2023514419A5/ja
Application granted granted Critical
Publication of JP7472300B2 publication Critical patent/JP7472300B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G02B21/244—Devices for focusing using image analysis techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
  • Length Measuring Devices By Optical Means (AREA)
JP2022550670A 2020-02-21 2021-02-12 視線追跡 Active JP7472300B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FI20205182 2020-02-21
FI20205182A FI130748B1 (en) 2020-02-21 2020-02-21 Gaze tracking
PCT/FI2021/050098 WO2021165570A1 (en) 2020-02-21 2021-02-12 Gaze tracking

Publications (3)

Publication Number Publication Date
JP2023514419A JP2023514419A (ja) 2023-04-05
JP2023514419A5 JP2023514419A5 (enExample) 2024-02-02
JP7472300B2 true JP7472300B2 (ja) 2024-04-22

Family

ID=74673253

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022550670A Active JP7472300B2 (ja) 2020-02-21 2021-02-12 視線追跡

Country Status (6)

Country Link
US (1) US12086309B2 (enExample)
EP (1) EP4107603B1 (enExample)
JP (1) JP7472300B2 (enExample)
KR (1) KR102832232B1 (enExample)
FI (1) FI130748B1 (enExample)
WO (1) WO2021165570A1 (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12481355B2 (en) * 2022-03-18 2025-11-25 Htc Corporation Method for determining two-eye gaze point and host
CN116774815A (zh) * 2022-03-18 2023-09-19 宏达国际电子股份有限公司 用于确定双眼凝视点的方法和主机
DE102025126611A1 (de) * 2024-11-19 2026-05-21 Carl Zeiss Microscopy Gmbh Eye-Tracking-Kalibrierung

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005710A (en) 1994-10-26 1999-12-21 Leica Microsystems Ag Microscope, in particular for surgical operations, having autofocus responsive to gaze
US20160210503A1 (en) 2011-07-14 2016-07-21 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
JP2017111746A (ja) 2015-12-18 2017-06-22 国立大学法人静岡大学 視線検出装置及び視線検出方法
US20180335840A1 (en) 2017-05-22 2018-11-22 Htc Corporation Eye tracking method, electronic device, and non-transitory computer readable storage medium
US20190050664A1 (en) 2016-04-22 2019-02-14 SZ DJI Technology Co., Ltd. Systems and methods for processing image data based on region-of-interest (roi) of a user
WO2019190561A1 (en) 2018-03-30 2019-10-03 Tobii Ab Deep learning for three dimensional (3d) gaze prediction
CN110441901A (zh) 2019-08-14 2019-11-12 东北大学 一种可实时追踪注视位置的光学显微镜系统及方法
EP3129849B1 (en) 2014-04-11 2020-02-12 Facebook Technologies, LLC Systems and methods of eye tracking calibration

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006075348A (ja) * 2004-09-09 2006-03-23 Fuji Xerox Co Ltd 相互視分析装置、相互視分析方法および相互視分析プログラム
CA2750287C (en) 2011-08-29 2012-07-03 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
WO2015034560A1 (en) 2013-09-03 2015-03-12 Tobii Technology Ab Portable eye tracking device
CN103558909B (zh) * 2013-10-10 2017-03-29 北京智谷睿拓技术服务有限公司 交互投射显示方法及交互投射显示系统
US10698204B1 (en) * 2017-10-16 2020-06-30 Facebook Technologies, Llc Immersed hot mirrors for illumination in eye tracking
US11506888B2 (en) * 2019-09-20 2022-11-22 Nvidia Corp. Driver gaze tracking system for use in vehicles

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005710A (en) 1994-10-26 1999-12-21 Leica Microsystems Ag Microscope, in particular for surgical operations, having autofocus responsive to gaze
US20160210503A1 (en) 2011-07-14 2016-07-21 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
EP3129849B1 (en) 2014-04-11 2020-02-12 Facebook Technologies, LLC Systems and methods of eye tracking calibration
JP2017111746A (ja) 2015-12-18 2017-06-22 国立大学法人静岡大学 視線検出装置及び視線検出方法
US20190050664A1 (en) 2016-04-22 2019-02-14 SZ DJI Technology Co., Ltd. Systems and methods for processing image data based on region-of-interest (roi) of a user
US20180335840A1 (en) 2017-05-22 2018-11-22 Htc Corporation Eye tracking method, electronic device, and non-transitory computer readable storage medium
WO2019190561A1 (en) 2018-03-30 2019-10-03 Tobii Ab Deep learning for three dimensional (3d) gaze prediction
CN110441901A (zh) 2019-08-14 2019-11-12 东北大学 一种可实时追踪注视位置的光学显微镜系统及方法

Also Published As

Publication number Publication date
US12086309B2 (en) 2024-09-10
WO2021165570A1 (en) 2021-08-26
KR102832232B1 (ko) 2025-07-10
FI130748B1 (en) 2024-02-26
JP2023514419A (ja) 2023-04-05
EP4107603A1 (en) 2022-12-28
EP4107603B1 (en) 2025-05-21
FI20205182A1 (en) 2021-08-22
US20230104656A1 (en) 2023-04-06
EP4107603C0 (en) 2025-05-21
KR20220133314A (ko) 2022-10-04

Similar Documents

Publication Publication Date Title
US12102388B2 (en) Eye center of rotation determination, depth plane selection, and render camera positioning in display systems
CN104834381B (zh) 用于视线焦点定位的可穿戴设备及视线焦点定位方法
EP3973347B1 (en) Systems and techniques for estimating eye pose
US11868525B2 (en) Eye center of rotation determination with one or more eye tracking cameras
CN113614783A (zh) 使用具有不同曝光时间的图像的眼睛跟踪
KR102832232B1 (ko) 응시 추적
KR20240009543A (ko) 고정-거리 가상 및 증강 현실 시스템들 및 방법들
WO2015035822A1 (en) Pickup of objects in three-dimensional display
WO2018076202A1 (zh) 能够进行人眼追踪的头戴式可视设备及人眼追踪方法
WO2015051605A1 (zh) 图像采集定位方法及图像采集定位装置
EP4285204B1 (en) Eye tracking illumination
US20150009103A1 (en) Wearable Display, Computer-Readable Medium Storing Program and Method for Receiving Gesture Input
WO2021026948A1 (zh) 一种可实时追踪注视位置的光学显微镜系统及方法
WO2024137749A1 (en) Focus adjustments based on attention
CN119492521A (zh) 可切换的测试设备、方法、电子设备、存储介质及程序产品
US12505573B2 (en) Gaze tracking
WO2022267992A1 (zh) 在头戴式显示设备中获取注视目标的方法及装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240125

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240125

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20240125

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20240319

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240410

R150 Certificate of patent or registration of utility model

Ref document number: 7472300

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150