IN2015DN01984A - - Google Patents

Info

Publication number
IN2015DN01984A
IN2015DN01984A IN1984DEN2015A IN2015DN01984A IN 2015DN01984 A IN2015DN01984 A IN 2015DN01984A IN 1984DEN2015 A IN1984DEN2015 A IN 1984DEN2015A IN 2015DN01984 A IN2015DN01984 A IN 2015DN01984A
Authority
IN
India
Prior art keywords
scene
structure representation
gaze
subject
determining
Prior art date
Application number
Inventor
Jan Hoffmann
Tom Sengelaub
Denis Williams
Original Assignee
Sensomotoric Instr Ges Für Innovative Sensorik Mbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sensomotoric Instr Ges Für Innovative Sensorik Mbh filed Critical Sensomotoric Instr Ges Für Innovative Sensorik Mbh
Publication of IN2015DN01984A publication Critical patent/IN2015DN01984A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20076—Probabilistic image processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Abstract

A system for determining the gaze endpoint of a subject the system comprising: a eye tracking unit adapted to determine the gaze direction of one or more eyes of the subject; a head tracking unit adapted to determine the position comprising location and orientation of the eye tracker with respect to a reference coordinate system; a 3D Structure representation unit that uses the 3D structure and position of objects of the scene in the reference coordinate system to provide a 3D structure representation of the scene; based on the gaze direction the eye tracker position and the 3D structure representation calculating the gaze endpoint on an object of the 3D structure representation of the scene or determining the object itself.
IN1984DEN2015 2012-09-17 2013-09-17 IN2015DN01984A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP12184725.5A EP2709060B1 (en) 2012-09-17 2012-09-17 Method and an apparatus for determining a gaze point on a three-dimensional object
PCT/EP2013/069236 WO2014041188A1 (en) 2012-09-17 2013-09-17 Method and an apparatus for determining a gaze point on a three-dimensional object

Publications (1)

Publication Number Publication Date
IN2015DN01984A true IN2015DN01984A (en) 2015-08-14

Family

ID=47010238

Family Applications (1)

Application Number Title Priority Date Filing Date
IN1984DEN2015 IN2015DN01984A (en) 2012-09-17 2013-09-17

Country Status (6)

Country Link
US (4) US10223808B2 (en)
EP (1) EP2709060B1 (en)
JP (2) JP6808320B2 (en)
CN (1) CN104685541B (en)
IN (1) IN2015DN01984A (en)
WO (1) WO2014041188A1 (en)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9811731B2 (en) * 2013-10-04 2017-11-07 Qualcomm Incorporated Dynamic extension of map data for object detection and tracking
WO2015117907A2 (en) * 2014-02-04 2015-08-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Selectively-adaptive data processor
JP2015219892A (en) * 2014-05-21 2015-12-07 大日本印刷株式会社 Visual line analysis system and visual line analysis device
KR20170041720A (en) * 2014-08-07 2017-04-17 포브, 아이엔씨. Algorithm for identifying three-dimensional point of gaze
US10228766B2 (en) * 2014-09-12 2019-03-12 Microsoft Technology Licensing, Llc Enhanced Display Rotation
JP6547268B2 (en) * 2014-10-02 2019-07-24 富士通株式会社 Eye position detection device, eye position detection method and eye position detection program
CN107249433B (en) * 2015-03-01 2019-12-20 诺瓦赛特有限公司 System and method for measuring ocular motility
WO2016151581A1 (en) 2015-03-23 2016-09-29 Controlrad Systems Inc. Eye tracking system
WO2016179825A1 (en) * 2015-05-14 2016-11-17 中国科学院深圳先进技术研究院 Navigation method based on three-dimensional scene
GB2539009A (en) * 2015-06-03 2016-12-07 Tobii Ab Gaze detection method and apparatus
US9829976B2 (en) * 2015-08-07 2017-11-28 Tobii Ab Gaze direction mapping
US10444972B2 (en) 2015-11-28 2019-10-15 International Business Machines Corporation Assisting a user with efficient navigation between a selection of entries with elements of interest to the user within a stream of entries
JP2017129898A (en) * 2016-01-18 2017-07-27 ソニー株式会社 Information processing apparatus, information processing method, and program
TWI589150B (en) * 2016-03-04 2017-06-21 液態三維系統有限公司 Three-dimensional auto-focusing method and the system thereof
WO2017153355A1 (en) * 2016-03-07 2017-09-14 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and device for carrying out eye gaze mapping
US10063560B2 (en) * 2016-04-29 2018-08-28 Microsoft Technology Licensing, Llc Gaze-based authentication
US10765314B2 (en) 2016-05-29 2020-09-08 Novasight Ltd. Display system and method
KR20190006553A (en) * 2016-06-16 2019-01-18 센소모토릭 인스트루멘츠 게젤샤프트 퓌어 이노바티브 센소릭 엠베하 Method and system for providing eye tracking based information on user behavior, client devices, servers and computer program products
JP2020509790A (en) 2016-09-23 2020-04-02 ノバサイト リミテッド Screening device and method
WO2018076202A1 (en) * 2016-10-26 2018-05-03 中国科学院深圳先进技术研究院 Head-mounted display device that can perform eye tracking, and eye tracking method
CN108338798B (en) * 2017-01-25 2020-11-06 北京数字新思科技有限公司 Attention measurement method and system
CN106840167B (en) * 2017-02-23 2019-12-20 周良辰 Two-dimensional quantity calculation method for geographic position of target object based on street view map
WO2018191970A1 (en) 2017-04-21 2018-10-25 深圳前海达闼云端智能科技有限公司 Robot control method, robot apparatus and robot device
CN108965687B (en) * 2017-05-22 2021-01-29 阿里巴巴集团控股有限公司 Shooting direction identification method, server, monitoring method, monitoring system and camera equipment
CN107369205B (en) * 2017-07-04 2020-10-16 东南大学 Mobile terminal city two-dimensional and three-dimensional linkage display method
CN107392853B (en) * 2017-07-13 2020-05-26 河北中科恒运软件科技股份有限公司 Method and system for video fusion distortion correction and viewpoint fine adjustment of double cameras
US10853965B2 (en) * 2017-08-07 2020-12-01 Standard Cognition, Corp Directional impression analysis using deep learning
CN107504917B (en) * 2017-08-17 2020-02-21 深圳市异方科技有限公司 Three-dimensional size measuring method and device
KR102495359B1 (en) 2017-10-27 2023-02-02 삼성전자주식회사 Method and apparatus for tracking object
WO2019097639A1 (en) * 2017-11-16 2019-05-23 株式会社ソニー・インタラクティブエンタテインメント Information processing device and image generation method
US11017551B2 (en) * 2018-02-15 2021-05-25 DMAI, Inc. System and method for identifying a point of interest based on intersecting visual trajectories
WO2019161200A1 (en) 2018-02-15 2019-08-22 DMAI, Inc. System and method for conversational agent via adaptive caching of dialogue tree
WO2019161229A1 (en) 2018-02-15 2019-08-22 DMAI, Inc. System and method for reconstructing unoccupied 3d space
CN112204564A (en) 2018-02-15 2021-01-08 得麦股份有限公司 System and method for speech understanding via integrated audio and visual based speech recognition
CN114935974A (en) 2018-03-30 2022-08-23 托比股份公司 Multi-trace gaze to object mapping for determining gaze targets
TWI719343B (en) * 2018-08-28 2021-02-21 財團法人工業技術研究院 Method and display system for information display
US11170212B2 (en) * 2018-09-28 2021-11-09 Apple Inc. Sensor fusion eye tracking
CN109491508B (en) * 2018-11-27 2022-08-26 北京七鑫易维信息技术有限公司 Method and device for determining gazing object
SE543121C2 (en) 2019-02-04 2020-10-13 Tobii Ab Method and system for determining a current gaze direction
SE1950580A1 (en) * 2019-05-15 2020-10-13 Tobii Ab Method and system for dwell-less, hands-free interaction with a selectable object
CN112013844B (en) * 2019-05-31 2022-02-11 北京小米智能科技有限公司 Method and device for establishing indoor environment map
US11181978B2 (en) 2019-06-17 2021-11-23 Hemy8 Sa System and method for gaze estimation
ES2961614T3 (en) * 2019-12-17 2024-03-12 John Cockerill Defense SA Intelligent system for controlling functions in a turret of a combat vehicle
CN112509007A (en) * 2020-12-14 2021-03-16 科大讯飞股份有限公司 Real fixation point positioning method and head-wearing sight tracking system
JP2023053631A (en) * 2021-10-01 2023-04-13 株式会社日立製作所 Gazing point analysis system and gazing point analysis method
WO2023189218A1 (en) * 2022-04-01 2023-10-05 ソニーグループ株式会社 Information processing device, information processing method, and recording medium
SE2250674A1 (en) 2022-06-03 2023-12-04 Tobii Ab Method of estimating a three-dimensional position of an object

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1978418A2 (en) * 1996-12-06 2008-10-08 Nippon Telegraph And Telephone Corporation Method and system for producing computer generated holograms realizing real time holographic video production and display
JPH10326071A (en) * 1997-03-27 1998-12-08 Nippon Telegr & Teleph Corp <Ntt> Computer hologram display method and device by high resolution of gazing point and record medium recording the method
WO2000015858A1 (en) 1998-09-14 2000-03-23 Kulicke & Soffa Investments, Inc. Wire-bonding alloy composites
US7046924B2 (en) * 2002-11-25 2006-05-16 Eastman Kodak Company Method and computer program product for determining an area of importance in an image using eye monitoring information
JP2005071041A (en) 2003-08-22 2005-03-17 Nissan Motor Co Ltd Device and system for detecting visual object of driver
CN102670163B (en) * 2004-04-01 2016-04-13 威廉·C·托奇 The system and method for controlling calculation device
JP4875843B2 (en) * 2004-10-20 2012-02-15 オリンパス株式会社 Information terminal equipment
JP5044237B2 (en) * 2006-03-27 2012-10-10 富士フイルム株式会社 Image recording apparatus, image recording method, and image recording program
JP4876687B2 (en) * 2006-04-19 2012-02-15 株式会社日立製作所 Attention level measuring device and attention level measuring system
JP2007319187A (en) * 2006-05-30 2007-12-13 Toyota Motor Corp Motion assisting device and control method for the same
US8781162B2 (en) * 2011-01-05 2014-07-15 Ailive Inc. Method and system for head tracking and pose estimation
KR100820639B1 (en) * 2006-07-25 2008-04-10 한국과학기술연구원 System and method for 3-dimensional interaction based on gaze and system and method for tracking 3-dimensional gaze
CN101945612B (en) * 2008-02-14 2013-09-25 诺基亚公司 Device and method for determining gaze direction
CN201307266Y (en) * 2008-06-25 2009-09-09 韩旭 Binocular sightline tracking device
CN101419672B (en) * 2008-12-03 2010-09-08 中国科学院计算技术研究所 Device and method for synchronistically acquiring human face image and gazing angle
CN102292017B (en) 2009-01-26 2015-08-05 托比股份公司 The detection to fixation point of being assisted by optical reference signal
US8553936B2 (en) * 2009-03-03 2013-10-08 The Ohio State University Gaze tracking measurement and training system and method
CN101943982B (en) 2009-07-10 2012-12-12 北京大学 Method for manipulating image based on tracked eye movements
JP5590487B2 (en) * 2010-07-30 2014-09-17 公立大学法人広島市立大学 Gaze measurement method and gaze measurement device
US8408706B2 (en) * 2010-12-13 2013-04-02 Microsoft Corporation 3D gaze tracker
JP5924862B2 (en) * 2010-12-15 2016-05-25 キヤノン株式会社 Information processing apparatus, information processing method, and program
JP5522799B2 (en) * 2011-02-18 2014-06-18 日本放送協会 Gaze position estimation system and gaze position estimation program
JP2013008365A (en) * 2011-06-23 2013-01-10 Ailive Inc Remote control with motion sensitive devices
US8885882B1 (en) * 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US9116926B2 (en) * 2012-12-20 2015-08-25 Google Inc. Sharing photos

Also Published As

Publication number Publication date
US20200334858A1 (en) 2020-10-22
US20150243036A1 (en) 2015-08-27
US20190272650A1 (en) 2019-09-05
JP6690041B2 (en) 2020-04-28
JP6808320B2 (en) 2021-01-06
CN104685541A (en) 2015-06-03
WO2014041188A1 (en) 2014-03-20
US20230206494A1 (en) 2023-06-29
US11948332B2 (en) 2024-04-02
CN104685541B (en) 2019-03-05
US11676302B2 (en) 2023-06-13
JP2019141620A (en) 2019-08-29
US10223808B2 (en) 2019-03-05
JP2015528359A (en) 2015-09-28
US10699439B2 (en) 2020-06-30
EP2709060B1 (en) 2020-02-26
EP2709060A1 (en) 2014-03-19

Similar Documents

Publication Publication Date Title
IN2015DN01984A (en)
GB2533520A (en) Gaze-controlled interface method and system
WO2014125380A3 (en) Systems and methods of eye tracking calibration
WO2014150405A3 (en) Context aware localization, mapping, and tracking
WO2016100931A8 (en) Method, system and device for navigating in a virtual reality environment
MX360923B (en) Facial expression tracking.
PH12016500524B1 (en) Display of a visual event notification
GB2564764B (en) Sonar sensor fusion and model based virtual and augmented reality systems and methods
WO2012107892A3 (en) Gaze detection in a 3d mapping environment
GB2511868B (en) Eye/gaze tracker and method of tracking the position of an eye and/or a gaze point of a subject
EP3777749A3 (en) System and method for preparing surgery on a patient at a target site defined by a virtual object
EP3076875A4 (en) An ultrasound system with stereo image guidance or tracking
GB201009249D0 (en) Entertainment device and entertainment methods
MX2016006229A (en) Image based search.
IN2014DN10462A (en)
MX346062B (en) Wide dynamic range using monochromatic sensor.
WO2012136345A3 (en) System and method for visually displaying information on real objects
IN2014DN10359A (en)
IN2014CN04458A (en)
MX2015017875A (en) Virtual object orientation and visualization.
WO2014197231A3 (en) Switching mode of operation in a head mounted display
WO2015042048A3 (en) Approaches for three-dimensional object display
WO2013166456A3 (en) Methods, systems and software programs for enhanced sports analytics and applications
MX357057B (en) User interface navigation.
WO2015047453A3 (en) Interactions of virtual objects with surfaces