KR102832232B1 - 응시 추적 - Google Patents

응시 추적 Download PDF

Info

Publication number
KR102832232B1
KR102832232B1 KR1020227032591A KR20227032591A KR102832232B1 KR 102832232 B1 KR102832232 B1 KR 102832232B1 KR 1020227032591 A KR1020227032591 A KR 1020227032591A KR 20227032591 A KR20227032591 A KR 20227032591A KR 102832232 B1 KR102832232 B1 KR 102832232B1
Authority
KR
South Korea
Prior art keywords
user
gaze
calibration
optical device
virtual plane
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227032591A
Other languages
English (en)
Korean (ko)
Other versions
KR20220133314A (ko
Inventor
미이카 토이바넨
크리스티안 루칸데르
로만 베드나릭
피오트르 바트자크
Original Assignee
씨트루 테크놀로지스 오와이
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 씨트루 테크놀로지스 오와이 filed Critical 씨트루 테크놀로지스 오와이
Publication of KR20220133314A publication Critical patent/KR20220133314A/ko
Application granted granted Critical
Publication of KR102832232B1 publication Critical patent/KR102832232B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/24—Base structure
    • G02B21/241—Devices for focusing
    • G02B21/244—Devices for focusing using image analysis techniques
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes
    • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Analytical Chemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Eye Examination Apparatus (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
  • Position Input By Displaying (AREA)
  • Length Measuring Devices By Optical Means (AREA)
KR1020227032591A 2020-02-21 2021-02-12 응시 추적 Active KR102832232B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FI20205182 2020-02-21
FI20205182A FI130748B1 (en) 2020-02-21 2020-02-21 Gaze tracking
PCT/FI2021/050098 WO2021165570A1 (en) 2020-02-21 2021-02-12 Gaze tracking

Publications (2)

Publication Number Publication Date
KR20220133314A KR20220133314A (ko) 2022-10-04
KR102832232B1 true KR102832232B1 (ko) 2025-07-10

Family

ID=74673253

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227032591A Active KR102832232B1 (ko) 2020-02-21 2021-02-12 응시 추적

Country Status (6)

Country Link
US (1) US12086309B2 (enExample)
EP (1) EP4107603B1 (enExample)
JP (1) JP7472300B2 (enExample)
KR (1) KR102832232B1 (enExample)
FI (1) FI130748B1 (enExample)
WO (1) WO2021165570A1 (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12481355B2 (en) * 2022-03-18 2025-11-25 Htc Corporation Method for determining two-eye gaze point and host
CN116774815A (zh) * 2022-03-18 2023-09-19 宏达国际电子股份有限公司 用于确定双眼凝视点的方法和主机
DE102025126611A1 (de) * 2024-11-19 2026-05-21 Carl Zeiss Microscopy Gmbh Eye-Tracking-Kalibrierung

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160259406A1 (en) * 2013-10-10 2016-09-08 Beijing Zhigu Rui Tuo Tech Co., Ltd Interactive projection display
US20180335840A1 (en) * 2017-05-22 2018-11-22 Htc Corporation Eye tracking method, electronic device, and non-transitory computer readable storage medium
WO2019190561A1 (en) * 2018-03-30 2019-10-03 Tobii Ab Deep learning for three dimensional (3d) gaze prediction
CN110441901A (zh) * 2019-08-14 2019-11-12 东北大学 一种可实时追踪注视位置的光学显微镜系统及方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE59504515D1 (de) 1994-10-26 1999-01-21 Leica Mikroskopie Sys Ag Mikroskop, insbesondere operationsmikroskop
JP2006075348A (ja) * 2004-09-09 2006-03-23 Fuji Xerox Co Ltd 相互視分析装置、相互視分析方法および相互視分析プログラム
US8885882B1 (en) 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
CA2750287C (en) 2011-08-29 2012-07-03 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
WO2015034560A1 (en) 2013-09-03 2015-03-12 Tobii Technology Ab Portable eye tracking device
EP3129849B1 (en) 2014-04-11 2020-02-12 Facebook Technologies, LLC Systems and methods of eye tracking calibration
JP6631951B2 (ja) 2015-12-18 2020-01-15 国立大学法人静岡大学 視線検出装置及び視線検出方法
EP3475785A4 (en) 2016-04-22 2020-05-13 SZ DJI Technology Co., Ltd. Systems and methods for processing image data based on region-of-interest (roi) of a user
US10698204B1 (en) * 2017-10-16 2020-06-30 Facebook Technologies, Llc Immersed hot mirrors for illumination in eye tracking
US11506888B2 (en) * 2019-09-20 2022-11-22 Nvidia Corp. Driver gaze tracking system for use in vehicles

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160259406A1 (en) * 2013-10-10 2016-09-08 Beijing Zhigu Rui Tuo Tech Co., Ltd Interactive projection display
US20180335840A1 (en) * 2017-05-22 2018-11-22 Htc Corporation Eye tracking method, electronic device, and non-transitory computer readable storage medium
WO2019190561A1 (en) * 2018-03-30 2019-10-03 Tobii Ab Deep learning for three dimensional (3d) gaze prediction
CN110441901A (zh) * 2019-08-14 2019-11-12 东北大学 一种可实时追踪注视位置的光学显微镜系统及方法

Also Published As

Publication number Publication date
US12086309B2 (en) 2024-09-10
WO2021165570A1 (en) 2021-08-26
FI130748B1 (en) 2024-02-26
JP2023514419A (ja) 2023-04-05
EP4107603A1 (en) 2022-12-28
EP4107603B1 (en) 2025-05-21
FI20205182A1 (en) 2021-08-22
US20230104656A1 (en) 2023-04-06
EP4107603C0 (en) 2025-05-21
KR20220133314A (ko) 2022-10-04
JP7472300B2 (ja) 2024-04-22

Similar Documents

Publication Publication Date Title
US12102388B2 (en) Eye center of rotation determination, depth plane selection, and render camera positioning in display systems
US11822718B2 (en) Display systems and methods for determining vertical alignment between left and right displays and a user's eyes
US12566499B2 (en) Eye center of rotation determination with one or more eye tracking cameras
JP5887026B2 (ja) ヘッドマウントシステム及びヘッドマウントシステムを用いてディジタル画像のストリームを計算しレンダリングする方法
CN104834381B (zh) 用于视线焦点定位的可穿戴设备及视线焦点定位方法
KR101471488B1 (ko) 시선 추적 장치 및 방법
EP4160299B1 (en) Image display control method, image display control apparatus, and head-mounted display device
US12086309B2 (en) Gaze tracking
WO2018076202A1 (zh) 能够进行人眼追踪的头戴式可视设备及人眼追踪方法
US20150009103A1 (en) Wearable Display, Computer-Readable Medium Storing Program and Method for Receiving Gesture Input
CN107991775A (zh) 能够进行人眼追踪的头戴式可视设备及人眼追踪方法
EP4285204B1 (en) Eye tracking illumination
EP4616278A1 (en) Focus adjustments based on attention
JP2017191546A (ja) 医療用ヘッドマウントディスプレイ、医療用ヘッドマウントディスプレイのプログラムおよび医療用ヘッドマウントディスプレイの制御方法
RU2007117996A (ru) Способ измерения быстрых движений глаз и отклонений бинокулярного зрения и устройство для его реализации
US12505573B2 (en) Gaze tracking
Changyuan et al. The line of sight to estimate method based on stereo vision
US20260075181A1 (en) Electronic Devices with Gaze Tracking Circuitry
US20260050324A1 (en) Apparatus and method for generating a control signal for a medical instrument or a medical imaging device
US20250281085A1 (en) Systems and methods for performing a motor skills neurological test using augmented or virtual reality

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

U12 Designation fee paid

Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U12-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

Q13 Ip right document published

Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE)