SG11202000065TA - Gaze point determination method and apparatus, electronic device, and computer storage medium - Google Patents

Gaze point determination method and apparatus, electronic device, and computer storage medium

Info

Publication number
SG11202000065TA
SG11202000065TA SG11202000065TA SG11202000065TA SG11202000065TA SG 11202000065T A SG11202000065T A SG 11202000065TA SG 11202000065T A SG11202000065T A SG 11202000065TA SG 11202000065T A SG11202000065T A SG 11202000065TA SG 11202000065T A SG11202000065T A SG 11202000065TA
Authority
SG
Singapore
Prior art keywords
electronic device
storage medium
computer storage
determination method
point determination
Prior art date
Application number
SG11202000065TA
Inventor
Tinghao Liu
Quan Wang
Chen Qian
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Publication of SG11202000065TA publication Critical patent/SG11202000065TA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C9/00—Individual registration on entry or exit
    • G07C9/00174—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys
    • G07C9/00563—Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys using personal physical data of the operator, e.g. finger prints, retinal images, voicepatterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
SG11202000065TA 2018-09-28 2018-11-23 Gaze point determination method and apparatus, electronic device, and computer storage medium SG11202000065TA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811141352.3A CN109389069B (en) 2018-09-28 2018-09-28 Gaze point determination method and apparatus, electronic device, and computer storage medium
PCT/CN2018/117287 WO2020062523A1 (en) 2018-09-28 2018-11-23 Gaze point determination method and apparatus, and electronic device and computer storage medium

Publications (1)

Publication Number Publication Date
SG11202000065TA true SG11202000065TA (en) 2020-05-28

Family

ID=65418277

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202000065TA SG11202000065TA (en) 2018-09-28 2018-11-23 Gaze point determination method and apparatus, electronic device, and computer storage medium

Country Status (7)

Country Link
US (1) US11295474B2 (en)
JP (1) JP6900516B2 (en)
KR (1) KR102347336B1 (en)
CN (1) CN109389069B (en)
SG (1) SG11202000065TA (en)
TW (1) TWI714225B (en)
WO (1) WO2020062523A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018033137A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Method, apparatus, and electronic device for displaying service object in video image
US11113842B2 (en) * 2018-12-24 2021-09-07 Samsung Electronics Co., Ltd. Method and apparatus with gaze estimation
CN111435432B (en) * 2019-01-15 2023-05-26 北京市商汤科技开发有限公司 Network optimization method and device, image processing method and device and storage medium
CN110335306B (en) * 2019-04-23 2022-04-15 华中科技大学 Method and device for predicting fixation point
CN110051319A (en) * 2019-04-23 2019-07-26 七鑫易维(深圳)科技有限公司 Adjusting method, device, equipment and the storage medium of eyeball tracking sensor
CN110428390B (en) * 2019-07-18 2022-08-26 北京达佳互联信息技术有限公司 Material display method and device, electronic equipment and storage medium
CN110531853B (en) * 2019-08-23 2021-01-19 西安交通大学 Electronic book reader control method and system based on human eye fixation point detection
CN111126137B (en) * 2019-11-18 2021-02-19 珠海格力电器股份有限公司 Interaction control method, device, terminal and computer readable medium
CN111027492B (en) * 2019-12-12 2024-01-23 广东智媒云图科技股份有限公司 Animal drawing method and device for connecting limb characteristic points
CN113208591B (en) * 2020-01-21 2023-01-06 魔门塔(苏州)科技有限公司 Method and device for determining eye opening and closing distance
US11921917B2 (en) 2020-04-07 2024-03-05 Eyetech Digital Systems, Inc. Compact eye-tracking camera systems and methods
US10996753B1 (en) 2020-04-07 2021-05-04 Eyetech Digital Systems, Inc. Multi-mode eye-tracking with independently operable illuminators
CN111985384A (en) * 2020-08-14 2020-11-24 深圳地平线机器人科技有限公司 Method and device for acquiring 3D coordinates of face key points and 3D face model
CN112949551A (en) * 2021-03-19 2021-06-11 科大讯飞股份有限公司 Eye key information determination method, device, equipment and storage medium
CN113596345B (en) * 2021-08-09 2023-01-17 荣耀终端有限公司 Parameter adjustment method, display control method, electronic device, and medium
CN113885708A (en) * 2021-10-22 2022-01-04 Oppo广东移动通信有限公司 Screen control method and device of electronic equipment, electronic equipment and storage medium
KR102567390B1 (en) * 2021-11-03 2023-08-16 주식회사 유니온커뮤니티 Apparatus and Method for Recognizing Fake Iris By Detecting Movements of the Pupil of User's Eye
TWI819439B (en) 2021-12-21 2023-10-21 財團法人工業技術研究院 Gaze tracking method and gaze tracking device using the same

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4675492B2 (en) * 2001-03-22 2011-04-20 本田技研工業株式会社 Personal authentication device using facial images
US7306337B2 (en) * 2003-03-06 2007-12-11 Rensselaer Polytechnic Institute Calibration-free gaze tracking under natural head movement
JP4603975B2 (en) * 2005-12-28 2010-12-22 株式会社春光社 Content attention evaluation apparatus and evaluation method
JP2007265367A (en) * 2006-03-30 2007-10-11 Fujifilm Corp Program, apparatus and method for detecting line of sight
JP4829141B2 (en) * 2007-02-09 2011-12-07 株式会社東芝 Gaze detection apparatus and method
JP2010081480A (en) * 2008-09-29 2010-04-08 Fujifilm Corp Portable suspicious individual detecting apparatus, suspicious individual detecting method, and program
TWI476729B (en) * 2010-11-26 2015-03-11 Inst Information Industry Dimensional image and three - dimensional model of the combination of the system and its computer program products
EP3527121B1 (en) * 2011-02-09 2023-08-23 Apple Inc. Gesture detection in a 3d mapping environment
US8824779B1 (en) * 2011-12-20 2014-09-02 Christopher Charles Smyth Apparatus and method for determining eye gaze from stereo-optic views
JP2013252301A (en) * 2012-06-07 2013-12-19 Toyota Central R&D Labs Inc Device and program for estimating eyeball center position
KR101351745B1 (en) * 2012-06-29 2014-01-16 인텔렉추얼디스커버리 주식회사 Apparatus and method for generating 3 dimension face
TWI471808B (en) * 2012-07-20 2015-02-01 Pixart Imaging Inc Pupil detection device
CN103870796B (en) * 2012-12-13 2017-05-24 汉王科技股份有限公司 Eye sight evaluation method and device
JP6234762B2 (en) * 2013-10-09 2017-11-22 アイシン精機株式会社 Eye detection device, method, and program
US9727972B2 (en) * 2013-12-30 2017-08-08 Xiaomi Inc. Method and terminal for generating thumbnail of image
CN104978548B (en) * 2014-04-02 2018-09-25 汉王科技股份有限公司 A kind of gaze estimation method and device based on three-dimensional active shape model
JP6256165B2 (en) * 2014-04-09 2018-01-10 富士通株式会社 Gaze detection device, gaze detection program, and gaze detection method
KR102212209B1 (en) * 2014-04-10 2021-02-05 삼성전자주식회사 Method, apparatus and computer readable recording medium for eye gaze tracking
US9864430B2 (en) * 2015-01-09 2018-01-09 Microsoft Technology Licensing, Llc Gaze tracking via eye gaze model
CN105989326B (en) * 2015-01-29 2020-03-03 北京三星通信技术研究有限公司 Method and device for determining three-dimensional position information of human eyes
JP6525635B2 (en) * 2015-02-25 2019-06-05 キヤノン株式会社 Image processing apparatus, image processing method and program
US10769459B2 (en) * 2015-08-31 2020-09-08 Sri International Method and system for monitoring driving behaviors
EP3367214A4 (en) * 2015-10-19 2019-04-17 Orylab Inc. Line-of-sight input device, line-of-sight input method, and line-of-sight input program
CN105740846A (en) * 2016-03-02 2016-07-06 河海大学常州校区 Horizontal visual angle estimation and calibration method based on depth camera
CN106598221B (en) * 2016-11-17 2019-03-15 电子科技大学 3D direction of visual lines estimation method based on eye critical point detection
JP2018101212A (en) * 2016-12-19 2018-06-28 矢崎総業株式会社 On-vehicle device and method for calculating degree of face directed to front side
CN106843500B (en) * 2017-02-27 2020-07-07 南通大学 Cognitive level rehabilitation training system based on eye movement tracking technology
CN107679447A (en) * 2017-08-17 2018-02-09 平安科技（深圳）有限公司 Facial characteristics point detecting method, device and storage medium
CN107679448B (en) * 2017-08-17 2018-09-25 平安科技（深圳）有限公司 Eyeball action-analysing method, device and storage medium

Also Published As

Publication number Publication date
CN109389069A (en) 2019-02-26
KR20200037147A (en) 2020-04-08
US11295474B2 (en) 2022-04-05
JP2021502618A (en) 2021-01-28
KR102347336B1 (en) 2022-01-05
JP6900516B2 (en) 2021-07-07
CN109389069B (en) 2021-01-05
TWI714225B (en) 2020-12-21
US20200134868A1 (en) 2020-04-30
TW202013244A (en) 2020-04-01
WO2020062523A1 (en) 2020-04-02

Similar Documents

Publication Publication Date Title
SG11202000065TA (en) Gaze point determination method and apparatus, electronic device, and computer storage medium
EP3734447C0 (en) Application program processing method, apparatus, storage medium and computer device
GB2593005B (en) Video generating method, apparatus, electronic device and computer storage medium
SG11202009173YA (en) Image processing method and apparatus, computer device, and computer storage medium
EP3812920A4 (en) Blockchain certificate storage method and apparatus, and computer device
SG11202103527XA (en) Interactive plot implementation method, device, computer apparatus, and storage medium
EP3847958A4 (en) Arrhythmia detection method and apparatus, electronic device, and computer storage medium
EP3627429A4 (en) Information processing method and apparatus, electronic device, and storage medium
SG11202107392TA (en) Application starting method and apparatus, computer device and storage medium
EP3993436C0 (en) Data processing method and apparatus, computer-readable storage medium, and electronic device
EP3893513A4 (en) Video stitching method and apparatus, electronic device, and computer storage medium
EP3627461A4 (en) Information processing method and apparatus, electronic device, and storage medium
SG11202004541WA (en) Chatbot configuration method and apparatus, computer device, and storage medium
SG11202010510XA (en) Data processing method and apparatus, electronic device and storage medium
SG11201914055VA (en) Authentication method and apparatus, and electronic device, computer program, and storage medium
EP4044579A4 (en) Main body detection method and apparatus, and electronic device and computer readable storage medium
EP3633515A4 (en) Memory allocation method, apparatus, electronic device, and computer storage medium
EP3547088A4 (en) Noise detection method and device, electronic apparatus, and computer readable storage medium
SG11202003999QA (en) Video summary generation method and apparatus, electronic device, and computer storage medium
EP3843386A4 (en) Data processing method and apparatus, and electronic device and storage medium
EP3849178A4 (en) Data processing method and apparatus, and electronic device and storage medium
SG11202100040VA (en) Image processing method and apparatus, computer device and computer storage medium
EP3672223A4 (en) Data processing method, apparatus, electronic device, and computer-readable storage medium
SG11202004027SA (en) Linen information processing method and apparatus, computer device, and storage medium
EP3579541A4 (en) Data processing method, apparatus, computer-readable storage medium, and electronic device