WO2011117776A1 - System and method for tracking the point of gaze of an observer - Google Patents
System and method for tracking the point of gaze of an observer Download PDFInfo
- Publication number
- WO2011117776A1 WO2011117776A1 PCT/IB2011/051076 IB2011051076W WO2011117776A1 WO 2011117776 A1 WO2011117776 A1 WO 2011117776A1 IB 2011051076 W IB2011051076 W IB 2011051076W WO 2011117776 A1 WO2011117776 A1 WO 2011117776A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- marker
- gaze
- pupil
- observer
- eye
- Prior art date
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/12—Avionics applications
Definitions
- the invention further relates to a method for tracking the point of gaze of an observer observing an object, wherein the method comprises recording an image of an eye of the observer, providing a luminous marker on or associated with the observed object, and determining from the image a corneal reflection of the marker and the centre of the pupil.
- the invention is based on the insight that it is advantageous to establish a connection between the position of the marker and the point-of-gaze by way of a feedback control system.
- a control system adjusts the marker position until its reflection in the cornea coincides or nearly coincides with the pupil centre.
- the difference between the position of the corneal reflection and the centre of the pupil forms or is at the basis of a feedback signal that is used to reposition the marker.
- a further embodiment uses a known spatial shift of the IR-target to resolve relationship between the position of the IR-target in the real world and reflected position on the cornea.
- a feedback mechanism to control the IR-target position to finally match the point-of-gaze, in absence of a model, the point-of-gaze is typically found in consecutive iterative steps. Each iteration step requires a new- video frame, showing the reflection of a new position of the IR-target.
- the following method is intended to minimize the number of iterations, and therefore the latency in response.
- the relation between the coordinates and the reflected position on the cornea is not linear (affine or perspective) transformation, due to the curvature of the cornea.
- Figure 16 below illustrates the use of two separately acquired IR targets and their appearance as reflections on the cornea as a mean to estimate two proportionality constants, that serve as a first-order (linear) approximation of the true relationship.
- the invention can be embodied in many different ways.
- use is made of one marker.
- the detection of multiple eye-pairs indicates that multiple observers are detected; a situation typical to public displays and shop windows.
- the system adds an additional marker and updates the synchronisation with the camera such that detection and tracking is distributed in time over more observers.
- This system is illustrated in figure 17.
- the system of figure 17 allows to track the eye-gaze of multiple (N) observers by performing the IR-target presentation, image capture and gaze estimation in a time-sequential fashion.
- the arrows indicate the order in time and not the fiow of information. It is remarked that although different markers are used, there is a fundamental difference with the known system.
- the markers are movable and each marker has its own feedback and associated viewer. The advantage of this system is that the latency only increases when the number of
- the convergence angle of an eye pair can be used to estimate the distance from which an observer is looking at an object. This is especially useful in a monitoring scenario (e.g. monitoring the gaze of a truck driver, or a customer viewing a shop window).
- a monitoring scenario e.g. monitoring the gaze of a truck driver, or a customer viewing a shop window.
- the calculation of the difference between markers and pupil centres and the calculation of the move to be made by each marker and the signal to be send to move the markers can be processed on a central computer within the store, or even, in case the same is done in various stores throughout the country, at a central computer at head quarters or at a central server.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Biophysics (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Eye Examination Apparatus (AREA)
- Exposure Control For Cameras (AREA)
- Details Of Cameras Including Film Mechanisms (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
BR112012023787-0A BR112012023787B1 (en) | 2010-03-22 | 2011-03-15 | SYSTEM FOR TRACKING THE LOOKING POINT OF AN OBJECT WATCHING AN OBJECT AND METHOD FOR TRACKING THE LOOKING POINT OF AN OBJECT WATCHING AN OBJECT |
CN201180015519.1A CN102802502B (en) | 2010-03-22 | 2011-03-15 | For the system and method for the point of fixation of tracing observation person |
RU2012144651/14A RU2565482C2 (en) | 2010-03-22 | 2011-03-15 | System and method for tracing point of observer's look |
JP2013500623A JP5816257B2 (en) | 2010-03-22 | 2011-03-15 | System and method for tracking observer's line of sight |
EP11713088.0A EP2549914B1 (en) | 2010-03-22 | 2011-03-15 | System and method for tracking the point of gaze of an observer |
US13/582,582 US9237844B2 (en) | 2010-03-22 | 2011-03-15 | System and method for tracking the point of gaze of an observer |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP10157169 | 2010-03-22 | ||
EP10157169.3 | 2010-03-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011117776A1 true WO2011117776A1 (en) | 2011-09-29 |
Family
ID=44042611
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IB2011/051076 WO2011117776A1 (en) | 2010-03-22 | 2011-03-15 | System and method for tracking the point of gaze of an observer |
Country Status (7)
Country | Link |
---|---|
US (1) | US9237844B2 (en) |
EP (1) | EP2549914B1 (en) |
JP (1) | JP5816257B2 (en) |
CN (1) | CN102802502B (en) |
BR (1) | BR112012023787B1 (en) |
RU (1) | RU2565482C2 (en) |
WO (1) | WO2011117776A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014021169A1 (en) * | 2012-07-31 | 2014-02-06 | 独立行政法人科学技術振興機構 | Point of gaze detection device, point of gaze detection method, individual parameter computation device, individual parameter computation method, program, and computer-readable recording medium |
US20140240675A1 (en) * | 2013-02-28 | 2014-08-28 | Carl Zeiss Meditec, Inc. | Systems and methods for improved ease and accuracy of gaze tracking |
JP2015513833A (en) * | 2012-02-27 | 2015-05-14 | エー・テー・ハー・チューリッヒEth Zuerich | Method and system for image processing for gaze correction in video conferencing |
WO2016124668A1 (en) * | 2015-02-04 | 2016-08-11 | IT-Universitetet i København | A gaze tracker and a gaze tracking method |
CN106405873A (en) * | 2016-06-13 | 2017-02-15 | 金英子 | Navigation system |
TWI647472B (en) * | 2018-01-22 | 2019-01-11 | 國立臺灣大學 | Dual mode line of sight tracking method and system |
LU100354B1 (en) * | 2017-08-01 | 2019-02-06 | Starbreeze Ip Lux Ii S A R L | Eye tracking system for head-mounted display |
Families Citing this family (72)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
ES2911679T3 (en) * | 2011-10-22 | 2022-05-20 | Alcon Inc | Apparatus for monitoring one or more surgical parameters of the eye |
EP2812775A1 (en) * | 2012-02-06 | 2014-12-17 | Sony Mobile Communications AB | Gaze tracking with projector |
US8571851B1 (en) * | 2012-12-31 | 2013-10-29 | Google Inc. | Semantic interpretation using user gaze order |
US9699433B2 (en) | 2013-01-24 | 2017-07-04 | Yuchen Zhou | Method and apparatus to produce re-focusable vision with detecting re-focusing event from human eye |
KR102012254B1 (en) * | 2013-04-23 | 2019-08-21 | 한국전자통신연구원 | Method for tracking user's gaze position using mobile terminal and apparatus thereof |
US9582075B2 (en) * | 2013-07-19 | 2017-02-28 | Nvidia Corporation | Gaze-tracking eye illumination from display |
CN103366381A (en) * | 2013-08-06 | 2013-10-23 | 山东大学 | Sight line tracking correcting method based on space position |
KR102037417B1 (en) * | 2013-08-13 | 2019-10-28 | 삼성전자주식회사 | Method of capturing an iris image, Computer readable storage medium of recording the method and an iris image capture device |
US20150051508A1 (en) | 2013-08-13 | 2015-02-19 | Sync-Think, Inc. | System and Method for Cognition and Oculomotor Impairment Diagnosis Using Binocular Coordination Analysis |
US9958939B2 (en) * | 2013-10-31 | 2018-05-01 | Sync-Think, Inc. | System and method for dynamic content delivery based on gaze analytics |
US10180716B2 (en) * | 2013-12-20 | 2019-01-15 | Lenovo (Singapore) Pte Ltd | Providing last known browsing location cue using movement-oriented biometric data |
US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US20150302252A1 (en) * | 2014-04-16 | 2015-10-22 | Lucas A. Herrera | Authentication method using multi-factor eye gaze |
US9983668B2 (en) | 2014-04-29 | 2018-05-29 | Hewlett-Packard Development Company, L.P. | Gaze detector using reference frames in media |
KR102279681B1 (en) * | 2014-05-26 | 2021-07-20 | 에스케이플래닛 주식회사 | Apparatus and method for providing advertisement using pupil recognition |
KR20150144185A (en) * | 2014-06-16 | 2015-12-24 | 현대자동차주식회사 | Method for extracting eye center point |
US9958947B2 (en) | 2014-06-25 | 2018-05-01 | Comcast Cable Communications, Llc | Ocular focus sharing for digital content |
EP3210163B1 (en) * | 2014-10-23 | 2020-12-23 | Koninklijke Philips N.V. | Gaze-tracking driven region of interest segmentation |
KR102317237B1 (en) * | 2014-11-03 | 2021-10-26 | 현대모비스 주식회사 | Apparatus for driving impairment handling |
CN104352243B (en) * | 2014-11-26 | 2016-09-21 | 首都医科大学附属北京朝阳医院 | Measure the audiometric systems of sound localization ability |
RU2672502C1 (en) * | 2014-12-10 | 2018-11-15 | Телефонактиеболагет Лм Эрикссон (Пабл) | Device and method for forming cornea image |
US10496160B2 (en) | 2014-12-16 | 2019-12-03 | Koninklijke Philips N.V. | Gaze tracking system with calibration improvement, accuracy compensation, and gaze localization smoothing |
KR102347359B1 (en) * | 2015-01-14 | 2022-01-06 | 삼성전자주식회사 | Electronic device and method for tracking gaze in electronic device |
US9541998B2 (en) | 2015-01-29 | 2017-01-10 | Samsung Electronics Co., Ltd. | Electronic system with gaze alignment mechanism and method of operation thereof |
CN107533634A (en) * | 2015-03-23 | 2018-01-02 | 控制辐射系统有限公司 | Eyes tracking system |
EP3281149A4 (en) | 2015-04-08 | 2018-11-14 | ControlRad Systems, Inc. | Devices and methods for monitoring gaze |
US20180188830A1 (en) * | 2015-06-19 | 2018-07-05 | Lg Electronics Inc. | Electronic device |
EP3338136B1 (en) * | 2015-08-04 | 2022-09-14 | Yasrebi, Seyed-Nima | Augmented reality in vehicle platforms |
US9829976B2 (en) * | 2015-08-07 | 2017-11-28 | Tobii Ab | Gaze direction mapping |
JP6334477B2 (en) * | 2015-08-24 | 2018-05-30 | Necフィールディング株式会社 | Image display device, image display method, and program |
US10061383B1 (en) * | 2015-09-16 | 2018-08-28 | Mirametrix Inc. | Multi-feature gaze tracking system and method |
KR101745140B1 (en) * | 2015-09-21 | 2017-06-08 | 현대자동차주식회사 | Gaze tracker and method for tracking graze thereof |
US9785234B2 (en) * | 2015-12-26 | 2017-10-10 | Intel Corporation | Analysis of ambient light for gaze tracking |
JP6847124B2 (en) | 2016-03-21 | 2021-03-24 | コーニンクレッカ フィリップス エヌ ヴェKoninklijke Philips N.V. | Adaptive lighting systems for mirror components and how to control adaptive lighting systems |
CN108604125B (en) * | 2016-03-29 | 2021-08-27 | 谷歌有限责任公司 | System and method for generating virtual badges based on gaze tracking |
EP3242228A1 (en) * | 2016-05-02 | 2017-11-08 | Artag SARL | Managing the display of assets in augmented reality mode |
WO2018000020A1 (en) * | 2016-06-29 | 2018-01-04 | Seeing Machines Limited | Systems and methods for performing eye gaze tracking |
US9972134B2 (en) | 2016-06-30 | 2018-05-15 | Microsoft Technology Licensing, Llc | Adaptive smoothing based on user focus on a target object |
CN106339087B (en) * | 2016-08-29 | 2019-01-29 | 上海青研科技有限公司 | A kind of eyeball tracking method and device thereof based on multidimensional coordinate |
EP3305176A1 (en) | 2016-10-04 | 2018-04-11 | Essilor International | Method for determining a geometrical parameter of an eye of a subject |
US9898082B1 (en) | 2016-11-01 | 2018-02-20 | Massachusetts Institute Of Technology | Methods and apparatus for eye tracking |
US10181078B1 (en) | 2016-11-07 | 2019-01-15 | National Technology & Engineering Solutions Of Sandia, Llc | Analysis and categorization of eye tracking data describing scanpaths |
EP3537950A4 (en) * | 2016-11-10 | 2019-10-30 | Magic Leap, Inc. | Method and system for eye tracking using speckle patterns |
CN108664118B (en) * | 2017-03-27 | 2021-06-15 | 腾讯科技(深圳)有限公司 | Eyeball tracking method and device, contact lenses and virtual reality system |
CN107105215B (en) * | 2017-03-28 | 2020-02-21 | 联想(北京)有限公司 | Method and display system for presenting image |
JP6893607B2 (en) * | 2017-04-21 | 2021-06-23 | 達闥机器人有限公司 | Robot control method, robot device and robot equipment |
US10768696B2 (en) | 2017-10-05 | 2020-09-08 | Microsoft Technology Licensing, Llc | Eye gaze correction using pursuit vector |
KR102016308B1 (en) * | 2017-11-17 | 2019-08-30 | 포인드 주식회사 | Eye Tracking Method Using Movement of Pupil and Gap between Eyes and Edge of Face |
RU2696042C2 (en) * | 2017-12-11 | 2019-07-30 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Московский государственный университет имени М.В. Ломоносова" (МГУ) | Method and system for recording eye movement |
US11333902B2 (en) * | 2017-12-12 | 2022-05-17 | RaayonNova LLC | Smart contact lens with embedded display and image focusing system |
US20200341269A1 (en) * | 2017-12-21 | 2020-10-29 | Bae Systems Plc | Eye tracking for head-worn display |
WO2019170954A1 (en) * | 2018-03-07 | 2019-09-12 | Nokia Technologies Oy | An apparatus for use in a near eye display |
US10324529B1 (en) * | 2018-05-31 | 2019-06-18 | Tobii Ab | Method and system for glint/reflection identification |
US10795435B2 (en) * | 2018-07-19 | 2020-10-06 | Samsung Electronics Co., Ltd. | System and method for hybrid eye tracker |
DE102018214637A1 (en) * | 2018-08-29 | 2020-03-05 | Robert Bosch Gmbh | Method for determining a direction of view of an eye |
CN109343700B (en) * | 2018-08-31 | 2020-10-27 | 深圳市沃特沃德股份有限公司 | Eye movement control calibration data acquisition method and device |
JP7173836B2 (en) * | 2018-11-05 | 2022-11-16 | 京セラ株式会社 | Controller, position determination device, position determination system, display system, program, and recording medium |
CN109464118B (en) * | 2018-12-10 | 2021-07-27 | 西安米克跨界信息科技有限公司 | Vision detection and glasses preparation method based on mobile phone |
DE102019114005A1 (en) * | 2019-05-24 | 2020-11-26 | Bayerische Motoren Werke Aktiengesellschaft | Liquid crystal display device for a motor vehicle and method for its operation |
DE102019114004A1 (en) * | 2019-05-24 | 2020-11-26 | Bayerische Motoren Werke Aktiengesellschaft | Display device for a motor vehicle and method for its operation |
CN112114657B (en) * | 2019-06-21 | 2023-10-17 | 北京七鑫易维科技有限公司 | Method and system for collecting gaze point information |
US20220142473A1 (en) * | 2019-07-26 | 2022-05-12 | North Inc. | Method and system for automatic pupil detection |
CN112578903A (en) * | 2019-09-30 | 2021-03-30 | 托比股份公司 | Eye tracking method, eye tracker, and computer program |
US11455744B2 (en) * | 2020-02-07 | 2022-09-27 | Toyota Research Institute, Inc. | Systems and methods for determining a viewing direction of a user |
CN113815623B (en) * | 2020-06-11 | 2023-08-08 | 广州汽车集团股份有限公司 | Method for visually tracking eye point of gaze of human eye, vehicle early warning method and device |
RU2739519C1 (en) * | 2020-06-26 | 2020-12-25 | Общество С Ограниченной Ответственностью "Тотал Вижен" (Ооо "Тотал Вижен") | Device for displaying images in certain range of space, spaced from observer's sight line by given angle, and fixing response to that image |
US20220236795A1 (en) * | 2021-01-27 | 2022-07-28 | Facebook Technologies, Llc | Systems and methods for signaling the onset of a user's intent to interact |
CN114615394A (en) * | 2022-03-07 | 2022-06-10 | 云知声智能科技股份有限公司 | Word extraction method and device, electronic equipment and storage medium |
WO2024004416A1 (en) * | 2022-06-27 | 2024-01-04 | ソニーグループ株式会社 | Line-of-sight detection device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4973149A (en) * | 1987-08-19 | 1990-11-27 | Center For Innovative Technology | Eye movement detector |
US20030123027A1 (en) * | 2001-12-28 | 2003-07-03 | International Business Machines Corporation | System and method for eye gaze tracking using corneal image mapping |
US20060011008A1 (en) | 2004-07-15 | 2006-01-19 | Nissan Motor Co., Ltd. | Shift fork position detecting device for manual transmission |
US20060110008A1 (en) | 2003-11-14 | 2006-05-25 | Roel Vertegaal | Method and apparatus for calibration-free eye tracking |
US20100066975A1 (en) * | 2006-11-29 | 2010-03-18 | Bengt Rehnstrom | Eye tracking illumination |
Family Cites Families (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61172552A (en) * | 1985-01-28 | 1986-08-04 | 株式会社トプコン | Sight automatic following apparatus |
US5204703A (en) * | 1991-06-11 | 1993-04-20 | The Center For Innovative Technology | Eye movement and pupil diameter apparatus and method |
US6757422B1 (en) * | 1998-11-12 | 2004-06-29 | Canon Kabushiki Kaisha | Viewpoint position detection apparatus and method, and stereoscopic image display system |
JP2000312664A (en) * | 1999-04-30 | 2000-11-14 | Canon Inc | Device for detecting line of sight |
US6578962B1 (en) * | 2001-04-27 | 2003-06-17 | International Business Machines Corporation | Calibration-free eye gaze tracking |
GB0119859D0 (en) * | 2001-08-15 | 2001-10-10 | Qinetiq Ltd | Eye tracking system |
US7306337B2 (en) * | 2003-03-06 | 2007-12-11 | Rensselaer Polytechnic Institute | Calibration-free gaze tracking under natural head movement |
CA2545202C (en) * | 2003-11-14 | 2014-01-14 | Queen's University At Kingston | Method and apparatus for calibration-free eye tracking |
WO2005077259A1 (en) * | 2004-02-04 | 2005-08-25 | The Johns Hopkins University | Method and apparatus for three-dimensional video-oculography |
US8483567B2 (en) * | 2004-04-09 | 2013-07-09 | Immediate Response Technologies, Inc | Infrared communication system and method |
US7331929B2 (en) * | 2004-10-01 | 2008-02-19 | General Electric Company | Method and apparatus for surgical operating room information display gaze detection and user prioritization for control |
US7576757B2 (en) * | 2004-11-24 | 2009-08-18 | General Electric Company | System and method for generating most read images in a PACS workstation |
US7573439B2 (en) * | 2004-11-24 | 2009-08-11 | General Electric Company | System and method for significant image selection using visual tracking |
WO2006101943A2 (en) * | 2005-03-16 | 2006-09-28 | Lc Technologies, Inc. | System and method for eyeball surface topography as a biometric discriminator |
US7686451B2 (en) * | 2005-04-04 | 2010-03-30 | Lc Technologies, Inc. | Explicit raytracing for gimbal-based gazepoint trackers |
JP2007029126A (en) * | 2005-07-22 | 2007-02-08 | System Artware:Kk | Line-of-sight detecting device |
US7529772B2 (en) * | 2005-09-27 | 2009-05-05 | Scenera Technologies, Llc | Method and system for associating user comments to a scene captured by a digital imaging device |
US9213404B2 (en) * | 2006-02-01 | 2015-12-15 | Tobii Technology Ab | Generation of graphical feedback in a computer system |
US7766479B2 (en) * | 2006-03-31 | 2010-08-03 | National University Corporation Shizuoka University | View point detecting device |
KR100820639B1 (en) * | 2006-07-25 | 2008-04-10 | 한국과학기술연구원 | System and method for 3-dimensional interaction based on gaze and system and method for tracking 3-dimensional gaze |
US8077914B1 (en) * | 2006-08-07 | 2011-12-13 | Arkady Kaplan | Optical tracking apparatus using six degrees of freedom |
US7986816B1 (en) * | 2006-09-27 | 2011-07-26 | University Of Alaska | Methods and systems for multiple factor authentication using gaze tracking and iris scanning |
US7548677B2 (en) * | 2006-10-12 | 2009-06-16 | Microsoft Corporation | Interactive display using planar radiation guide |
CN101172034A (en) * | 2006-11-03 | 2008-05-07 | 上海迪康医学生物技术有限公司 | Eyeball moving track detecting method |
US8036917B2 (en) * | 2006-11-22 | 2011-10-11 | General Electric Company | Methods and systems for creation of hanging protocols using eye tracking and voice command and control |
US7808540B2 (en) | 2007-01-09 | 2010-10-05 | Eastman Kodak Company | Image capture and integrated display apparatus |
US8500278B2 (en) * | 2007-03-08 | 2013-08-06 | Liang Chen | Apparatus and method for objective perimetry visual field test |
RU2352244C2 (en) * | 2007-05-14 | 2009-04-20 | Государственное образовательное учреждение высшего профессионального образования Курский государственный технический университет | Method of measurement of fast movements of eyes and deviations of solid vision and device for its realisation |
EP2150170B1 (en) * | 2007-05-23 | 2016-05-11 | Mirametrix Inc. | Methods and apparatus for estimating point-of-gaze in three dimensions |
WO2009019760A1 (en) * | 2007-08-07 | 2009-02-12 | Osaka Electro-Communication University | Moving object detector, moving object detection method, pointing device, computer program and storage medium |
US7789510B2 (en) * | 2008-01-14 | 2010-09-07 | Sina Fateh | System and method for improving the peripheral vision of a subject |
US20090245696A1 (en) * | 2008-03-31 | 2009-10-01 | Sharp Laboratories Of America, Inc. | Method and apparatus for building compound-eye seeing displays |
CN102027388B (en) * | 2008-04-11 | 2013-08-28 | 瑞士联邦理工大学,洛桑(Epfl) | Time-of-flight based imaging system using a display as illumination source |
US8204340B2 (en) * | 2008-09-29 | 2012-06-19 | Two Pic Mc Llc | Methods and apparatus for dot marker matching |
US20100128118A1 (en) * | 2008-11-26 | 2010-05-27 | Locarna Systems, Inc. | Identification of visual fixations in a video stream |
JP4699536B2 (en) * | 2009-03-06 | 2011-06-15 | シャープ株式会社 | POSITION DETECTION DEVICE, CONTROL METHOD, CONTROL PROGRAM, AND RECORDING MEDIUM |
EP2236074B1 (en) * | 2009-04-01 | 2021-05-26 | Tobii AB | Visual display with illuminators for gaze tracking |
KR20130000401A (en) * | 2010-02-28 | 2013-01-02 | 오스터하우트 그룹 인코포레이티드 | Local advertising content on an interactive head-mounted eyepiece |
US20120127140A1 (en) * | 2010-11-19 | 2012-05-24 | John Ryan | Multi-mode liquid crystal display with auxiliary non-display components |
EP2499963A1 (en) * | 2011-03-18 | 2012-09-19 | SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH | Method and apparatus for gaze point mapping |
US8632182B2 (en) * | 2011-05-05 | 2014-01-21 | Sony Computer Entertainment Inc. | Interface using eye tracking contact lenses |
US8749396B2 (en) * | 2011-08-25 | 2014-06-10 | Satorius Stedim Biotech Gmbh | Assembling method, monitoring method, communication method, augmented reality system and computer program product |
CN103105926A (en) * | 2011-10-17 | 2013-05-15 | 微软公司 | Multi-sensor posture recognition |
US8937591B2 (en) * | 2012-04-06 | 2015-01-20 | Apple Inc. | Systems and methods for counteracting a perceptual fading of a movable indicator |
US8854447B2 (en) * | 2012-12-21 | 2014-10-07 | United Video Properties, Inc. | Systems and methods for automatically adjusting audio based on gaze point |
US10163049B2 (en) * | 2013-03-08 | 2018-12-25 | Microsoft Technology Licensing, Llc | Inconspicuous tag for generating augmented reality experiences |
-
2011
- 2011-03-15 JP JP2013500623A patent/JP5816257B2/en active Active
- 2011-03-15 CN CN201180015519.1A patent/CN102802502B/en active Active
- 2011-03-15 RU RU2012144651/14A patent/RU2565482C2/en active
- 2011-03-15 US US13/582,582 patent/US9237844B2/en active Active
- 2011-03-15 EP EP11713088.0A patent/EP2549914B1/en active Active
- 2011-03-15 BR BR112012023787-0A patent/BR112012023787B1/en active IP Right Grant
- 2011-03-15 WO PCT/IB2011/051076 patent/WO2011117776A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4973149A (en) * | 1987-08-19 | 1990-11-27 | Center For Innovative Technology | Eye movement detector |
US20030123027A1 (en) * | 2001-12-28 | 2003-07-03 | International Business Machines Corporation | System and method for eye gaze tracking using corneal image mapping |
US20060110008A1 (en) | 2003-11-14 | 2006-05-25 | Roel Vertegaal | Method and apparatus for calibration-free eye tracking |
US20060011008A1 (en) | 2004-07-15 | 2006-01-19 | Nissan Motor Co., Ltd. | Shift fork position detecting device for manual transmission |
US20100066975A1 (en) * | 2006-11-29 | 2010-03-18 | Bengt Rehnstrom | Eye tracking illumination |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9684953B2 (en) | 2012-02-27 | 2017-06-20 | Eth Zurich | Method and system for image processing in video conferencing |
JP2015513833A (en) * | 2012-02-27 | 2015-05-14 | エー・テー・ハー・チューリッヒEth Zuerich | Method and system for image processing for gaze correction in video conferencing |
JP5467303B1 (en) * | 2012-07-31 | 2014-04-09 | 独立行政法人科学技術振興機構 | Gaze point detection device, gaze point detection method, personal parameter calculation device, personal parameter calculation method, program, and computer-readable recording medium |
TWI489969B (en) * | 2012-07-31 | 2015-07-01 | Japan Science & Tech Agency | Point-of-gaze detection device, point-of-gaze detecting method, personal parameter calculating device, personal parameter calculating method, program, and computer-readable recording medium |
US9262680B2 (en) | 2012-07-31 | 2016-02-16 | Japan Science And Technology Agency | Point-of-gaze detection device, point-of-gaze detecting method, personal parameter calculating device, personal parameter calculating method, program, and computer-readable storage medium |
WO2014021169A1 (en) * | 2012-07-31 | 2014-02-06 | 独立行政法人科学技術振興機構 | Point of gaze detection device, point of gaze detection method, individual parameter computation device, individual parameter computation method, program, and computer-readable recording medium |
US20140240675A1 (en) * | 2013-02-28 | 2014-08-28 | Carl Zeiss Meditec, Inc. | Systems and methods for improved ease and accuracy of gaze tracking |
US9179833B2 (en) * | 2013-02-28 | 2015-11-10 | Carl Zeiss Meditec, Inc. | Systems and methods for improved ease and accuracy of gaze tracking |
US10376139B2 (en) | 2013-02-28 | 2019-08-13 | Carl Zeiss Meditec, Inc. | Systems and methods for improved ease and accuracy of gaze tracking |
US9872615B2 (en) | 2013-02-28 | 2018-01-23 | Carl Zeiss Meditec, Inc. | Systems and methods for improved ease and accuracy of gaze tracking |
DK201570064A1 (en) * | 2015-02-04 | 2016-08-22 | IT-Universitetet i København | A Gaze Tracker and a Gaze Tracking Method |
US10234940B2 (en) | 2015-02-04 | 2019-03-19 | Itu Business Development A/S | Gaze tracker and a gaze tracking method |
WO2016124668A1 (en) * | 2015-02-04 | 2016-08-11 | IT-Universitetet i København | A gaze tracker and a gaze tracking method |
CN106405873A (en) * | 2016-06-13 | 2017-02-15 | 金英子 | Navigation system |
LU100354B1 (en) * | 2017-08-01 | 2019-02-06 | Starbreeze Ip Lux Ii S A R L | Eye tracking system for head-mounted display |
WO2019025146A1 (en) * | 2017-08-01 | 2019-02-07 | Starbreeze Ip Lux Ii S.À.R.L. | Eye tracking system for head-mounted display |
TWI647472B (en) * | 2018-01-22 | 2019-01-11 | 國立臺灣大學 | Dual mode line of sight tracking method and system |
Also Published As
Publication number | Publication date |
---|---|
US9237844B2 (en) | 2016-01-19 |
EP2549914A1 (en) | 2013-01-30 |
JP5816257B2 (en) | 2015-11-18 |
BR112012023787B1 (en) | 2021-08-10 |
JP2013528406A (en) | 2013-07-11 |
BR112012023787A2 (en) | 2017-12-12 |
RU2565482C2 (en) | 2015-10-20 |
CN102802502B (en) | 2016-03-30 |
EP2549914B1 (en) | 2019-06-05 |
RU2012144651A (en) | 2014-04-27 |
US20130002846A1 (en) | 2013-01-03 |
CN102802502A (en) | 2012-11-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2549914B1 (en) | System and method for tracking the point of gaze of an observer | |
US11630315B2 (en) | Measuring content brightness in head worn computing | |
RU2709389C2 (en) | Display with reduced visual discomfort | |
JP6308940B2 (en) | System and method for identifying eye tracking scene reference position | |
EP3571673B1 (en) | Method for displaying virtual image, storage medium and electronic device therefor | |
JP4783018B2 (en) | Method and apparatus for detecting and tracking the eye and its gaze direction | |
US9532715B2 (en) | Eye imaging in head worn computing | |
US20160018641A1 (en) | Content presentation in head worn computing | |
WO2015109145A9 (en) | See-through computer display systems | |
EP3095026A1 (en) | See-through computer display systems | |
CN107077593A (en) | For the enhanced system and method for display screen | |
CN109923499B (en) | Portable eye tracking device | |
EP3749172A1 (en) | Devices, systems and methods for predicting gaze-related parameters | |
CN117215401A (en) | Hybrid pixel dynamic vision sensor tracking using IR and ambient light | |
CN103565399A (en) | Pupil detector | |
CN114761999A (en) | Image processing method, image processing apparatus, and image processing program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201180015519.1 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11713088 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011713088 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 7573/CHENP/2012 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13582582 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013500623 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012144651 Country of ref document: RU |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112012023787 Country of ref document: BR |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01E Ref document number: 112012023787 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112012023787 Country of ref document: BR Kind code of ref document: A2 Effective date: 20120920 |