CN111353506A - 自适应的视线估计方法和设备 - Google Patents

自适应的视线估计方法和设备 Download PDF

Info

Publication number
CN111353506A
CN111353506A CN201811582119.9A CN201811582119A CN111353506A CN 111353506 A CN111353506 A CN 111353506A CN 201811582119 A CN201811582119 A CN 201811582119A CN 111353506 A CN111353506 A CN 111353506A
Authority
CN
China
Prior art keywords
training
data
neural network
network model
calibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811582119.9A
Other languages
English (en)
Chinese (zh)
Inventor
郭天楚
张辉
刘夏冰
韩在濬
崔昌圭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Samsung Telecom R&D Center
Beijing Samsung Telecommunications Technology Research Co Ltd
Samsung Electronics Co Ltd
Original Assignee
Beijing Samsung Telecommunications Technology Research Co Ltd
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Samsung Telecommunications Technology Research Co Ltd, Samsung Electronics Co Ltd filed Critical Beijing Samsung Telecommunications Technology Research Co Ltd
Priority to CN201811582119.9A priority Critical patent/CN111353506A/zh
Priority to KR1020190116694A priority patent/KR20200079170A/ko
Priority to US16/722,221 priority patent/US11113842B2/en
Priority to EP19219452.0A priority patent/EP3674852B1/en
Publication of CN111353506A publication Critical patent/CN111353506A/zh
Priority to US17/394,653 priority patent/US11747898B2/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
    • G06V10/464—Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2155—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the incorporation of unlabelled data, e.g. multiple instance learning [MIL], semi-supervised techniques using expectation-maximisation [EM] or naïve labelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
CN201811582119.9A 2018-12-24 2018-12-24 自适应的视线估计方法和设备 Pending CN111353506A (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201811582119.9A CN111353506A (zh) 2018-12-24 2018-12-24 自适应的视线估计方法和设备
KR1020190116694A KR20200079170A (ko) 2018-12-24 2019-09-23 시선 추정 방법 및 시선 추정 장치
US16/722,221 US11113842B2 (en) 2018-12-24 2019-12-20 Method and apparatus with gaze estimation
EP19219452.0A EP3674852B1 (en) 2018-12-24 2019-12-23 Method and apparatus with gaze estimation
US17/394,653 US11747898B2 (en) 2018-12-24 2021-08-05 Method and apparatus with gaze estimation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811582119.9A CN111353506A (zh) 2018-12-24 2018-12-24 自适应的视线估计方法和设备

Publications (1)

Publication Number Publication Date
CN111353506A true CN111353506A (zh) 2020-06-30

Family

ID=71197921

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811582119.9A Pending CN111353506A (zh) 2018-12-24 2018-12-24 自适应的视线估计方法和设备

Country Status (2)

Country Link
KR (1) KR20200079170A (ko)
CN (1) CN111353506A (ko)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113391699A (zh) * 2021-06-10 2021-09-14 昆明理工大学 一种基于动态眼动指标的眼势交互模型方法
CN114399753A (zh) * 2022-03-25 2022-04-26 北京魔门塔科技有限公司 分心判断方法、装置、存储介质、电子设备及车辆
CN116052264A (zh) * 2023-03-31 2023-05-02 广州视景医疗软件有限公司 一种基于非线性偏差校准的视线估计方法及装置

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102384411B1 (ko) * 2020-07-29 2022-04-06 한국항공대학교산학협력단 Vr 영상 제공 시스템 및 방법
CN113538599A (zh) * 2021-07-30 2021-10-22 联合汽车电子有限公司 神经网络标定效能评估方法、装置、介质、设备及车辆
CN113743254B (zh) * 2021-08-18 2024-04-09 北京格灵深瞳信息技术股份有限公司 视线估计方法、装置、电子设备及存储介质
CN113762393B (zh) * 2021-09-08 2024-04-30 杭州网易智企科技有限公司 模型训练方法、注视点检测方法、介质、装置和计算设备
KR102640081B1 (ko) * 2021-12-16 2024-02-22 세종대학교산학협력단 시선 예측 방법 및 그 장치
CN116052261A (zh) * 2022-05-31 2023-05-02 荣耀终端有限公司 视线估计方法及电子设备
CN117133043A (zh) * 2023-03-31 2023-11-28 荣耀终端有限公司 注视点估计方法、电子设备及计算机可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040174496A1 (en) * 2003-03-06 2004-09-09 Qiang Ji Calibration-free gaze tracking under natural head movement
CN103870796A (zh) * 2012-12-13 2014-06-18 汉王科技股份有限公司 一种人眼视线估计的方法与装置
CN104951084A (zh) * 2015-07-30 2015-09-30 京东方科技集团股份有限公司 视线追踪方法及装置
CN106056092A (zh) * 2016-06-08 2016-10-26 华南理工大学 基于虹膜与瞳孔的用于头戴式设备的视线估计方法
CN107392156A (zh) * 2017-07-25 2017-11-24 北京七鑫易维信息技术有限公司 一种视线估计方法及装置
CN108171152A (zh) * 2017-12-26 2018-06-15 深圳大学 深度学习人眼视线估计方法、设备、系统及可读存储介质
US20180210546A1 (en) * 2014-06-02 2018-07-26 Xlabs Pty Ltd Pose-invariant eye-gaze tracking using a single commodity camera

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040174496A1 (en) * 2003-03-06 2004-09-09 Qiang Ji Calibration-free gaze tracking under natural head movement
CN103870796A (zh) * 2012-12-13 2014-06-18 汉王科技股份有限公司 一种人眼视线估计的方法与装置
US20180210546A1 (en) * 2014-06-02 2018-07-26 Xlabs Pty Ltd Pose-invariant eye-gaze tracking using a single commodity camera
CN104951084A (zh) * 2015-07-30 2015-09-30 京东方科技集团股份有限公司 视线追踪方法及装置
US20170031437A1 (en) * 2015-07-30 2017-02-02 Boe Technology Group Co., Ltd. Sight tracking method and device
CN106056092A (zh) * 2016-06-08 2016-10-26 华南理工大学 基于虹膜与瞳孔的用于头戴式设备的视线估计方法
CN107392156A (zh) * 2017-07-25 2017-11-24 北京七鑫易维信息技术有限公司 一种视线估计方法及装置
CN108171152A (zh) * 2017-12-26 2018-06-15 深圳大学 深度学习人眼视线估计方法、设备、系统及可读存储介质

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
孙兴华;陈国勇;赵春霞;杨静宇;: "基于Hough变换和梯度信息的人眼视线方向估计", 小型微型计算机系统, no. 06, 15 June 2007 (2007-06-15) *
朱博;张天侠;: "基于极限学习机(ELM)的视线落点估计方法", 东北大学学报(自然科学版), no. 03, 15 March 2013 (2013-03-15) *
金纯;李娅萍;高奇;曾伟;: "视线追踪系统中注视点估计算法研究", 科学技术与工程, no. 14, 18 May 2016 (2016-05-18) *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113391699A (zh) * 2021-06-10 2021-09-14 昆明理工大学 一种基于动态眼动指标的眼势交互模型方法
CN113391699B (zh) * 2021-06-10 2022-06-21 昆明理工大学 一种基于动态眼动指标的眼势交互模型方法
CN114399753A (zh) * 2022-03-25 2022-04-26 北京魔门塔科技有限公司 分心判断方法、装置、存储介质、电子设备及车辆
CN116052264A (zh) * 2023-03-31 2023-05-02 广州视景医疗软件有限公司 一种基于非线性偏差校准的视线估计方法及装置
CN116052264B (zh) * 2023-03-31 2023-07-04 广州视景医疗软件有限公司 一种基于非线性偏差校准的视线估计方法及装置

Also Published As

Publication number Publication date
KR20200079170A (ko) 2020-07-02

Similar Documents

Publication Publication Date Title
CN111353506A (zh) 自适应的视线估计方法和设备
KR102319177B1 (ko) 이미지 내의 객체 자세를 결정하는 방법 및 장치, 장비, 및 저장 매체
EP3674852B1 (en) Method and apparatus with gaze estimation
US11120254B2 (en) Methods and apparatuses for determining hand three-dimensional data
EP2856426B1 (en) Body measurement
KR102346320B1 (ko) 고속 3d 모델 피팅 및 인체 측정법
EP3992919B1 (en) Three-dimensional facial model generation method and apparatus, device, and medium
US10521919B2 (en) Information processing device and information processing method for applying an optimization model
US20220148333A1 (en) Method and system for estimating eye-related geometric parameters of a user
US9613404B2 (en) Image processing method, image processing apparatus and electronic device
CN106709404A (zh) 图像处理装置及图像处理方法
CN111815768B (zh) 三维人脸重建方法和装置
CN112329699A (zh) 一种像素级精度的人眼注视点定位方法
CN108509830B (zh) 一种视频数据处理方法及设备
CN113469091B (zh) 人脸识别方法、训练方法、电子设备及存储介质
US9924865B2 (en) Apparatus and method for estimating gaze from un-calibrated eye measurement points
Cvejic et al. A nonreference image fusion metric based on the regional importance measure
CN116580169B (zh) 一种数字人驱动方法及装置、电子设备和存储介质
WO2022079794A1 (ja) 画像選択装置、画像選択方法、及びプログラム
Kang et al. A novel depth image enhancement method based on the linear surface model
CN112188075A (zh) 抓拍机、图像处理设备及图像处理方法
Choi et al. Gmm-based saliency aggregation for calibration-free gaze estimation
Zhang et al. A binocular vision system with attentive saccade and spatial variant vergence control
CN113378777A (zh) 基于单目摄像机的视线检测的方法和装置
CN115661401A (zh) 一种展示整形效果的方法及装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination