JP7309116B2 - 視線方向特定方法、装置、電子機器及び記憶媒体 - Google Patents

視線方向特定方法、装置、電子機器及び記憶媒体 Download PDF

Info

Publication number
JP7309116B2
JP7309116B2 JP2022524710A JP2022524710A JP7309116B2 JP 7309116 B2 JP7309116 B2 JP 7309116B2 JP 2022524710 A JP2022524710 A JP 2022524710A JP 2022524710 A JP2022524710 A JP 2022524710A JP 7309116 B2 JP7309116 B2 JP 7309116B2
Authority
JP
Japan
Prior art keywords
features
feature
eye
facial
line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022524710A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022553776A (ja
Inventor
▲飛▼ 王
晨 ▲銭▼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Lingang Jueying Intelligent Technology Co Ltd
Original Assignee
Shanghai Lingang Jueying Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Lingang Jueying Intelligent Technology Co Ltd filed Critical Shanghai Lingang Jueying Intelligent Technology Co Ltd
Publication of JP2022553776A publication Critical patent/JP2022553776A/ja
Application granted granted Critical
Publication of JP7309116B2 publication Critical patent/JP7309116B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/197Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2022524710A 2019-12-30 2020-12-04 視線方向特定方法、装置、電子機器及び記憶媒体 Active JP7309116B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201911403648.2A CN111178278B (zh) 2019-12-30 2019-12-30 视线方向确定方法、装置、电子设备及存储介质
CN201911403648.2 2019-12-30
PCT/CN2020/134049 WO2021135827A1 (zh) 2019-12-30 2020-12-04 视线方向确定方法、装置、电子设备及存储介质

Publications (2)

Publication Number Publication Date
JP2022553776A JP2022553776A (ja) 2022-12-26
JP7309116B2 true JP7309116B2 (ja) 2023-07-18

Family

ID=70646509

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022524710A Active JP7309116B2 (ja) 2019-12-30 2020-12-04 視線方向特定方法、装置、電子機器及び記憶媒体

Country Status (4)

Country Link
JP (1) JP7309116B2 (zh)
KR (1) KR20210140763A (zh)
CN (1) CN111178278B (zh)
WO (1) WO2021135827A1 (zh)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2996269A1 (en) * 2014-09-09 2016-03-16 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio splicing concept
CN111178278B (zh) * 2019-12-30 2022-04-08 上海商汤临港智能科技有限公司 视线方向确定方法、装置、电子设备及存储介质
CN113743172B (zh) * 2020-05-29 2024-04-16 魔门塔(苏州)科技有限公司 一种人员注视位置检测方法及装置
CN113807119B (zh) * 2020-05-29 2024-04-02 魔门塔(苏州)科技有限公司 一种人员注视位置检测方法及装置
CN112183200B (zh) * 2020-08-25 2023-10-17 中电海康集团有限公司 一种基于视频图像的眼动追踪方法和系统
CN112749655A (zh) * 2021-01-05 2021-05-04 风变科技(深圳)有限公司 视线追踪方法、装置、计算机设备和存储介质
CN112766163B (zh) * 2021-01-13 2022-05-31 北京航空航天大学 一种基于对抗优化的视线方向确定方法
CN113361441B (zh) * 2021-06-18 2022-09-06 山东大学 基于头部姿态和空间注意力的视线区域估计方法及系统
CN113705550B (zh) * 2021-10-29 2022-02-18 北京世纪好未来教育科技有限公司 一种训练方法、视线检测方法、装置和电子设备
CN116052264B (zh) * 2023-03-31 2023-07-04 广州视景医疗软件有限公司 一种基于非线性偏差校准的视线估计方法及装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193383A (zh) 2017-06-13 2017-09-22 华南师范大学 一种基于人脸朝向约束的二级视线追踪方法
JP2019028843A (ja) 2017-08-01 2019-02-21 オムロン株式会社 人物の視線方向を推定するための情報処理装置及び推定方法、並びに学習装置及び学習方法
CN110503068A (zh) 2019-08-28 2019-11-26 Oppo广东移动通信有限公司 视线估计方法、终端及存储介质

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101489467B (zh) * 2006-07-14 2011-05-04 松下电器产业株式会社 视线方向检测装置和视线方向检测方法
JP4966816B2 (ja) * 2007-10-25 2012-07-04 株式会社日立製作所 視線方向計測方法および視線方向計測装置
CN102547123B (zh) * 2012-01-05 2014-02-26 天津师范大学 基于人脸识别技术的自适应视线跟踪系统及其跟踪方法
CN103246044B (zh) * 2012-02-09 2017-03-22 联想(北京)有限公司 一种自动对焦方法、系统及具有该系统的照相机和摄像机
US9563805B2 (en) * 2014-09-02 2017-02-07 Hong Kong Baptist University Method and apparatus for eye gaze tracking
EP3511803B1 (en) * 2018-01-10 2021-11-03 Samsung Electronics Co., Ltd. Method and apparatus to determine trigger intent of user
CN108615014B (zh) * 2018-04-27 2022-06-21 京东方科技集团股份有限公司 一种眼睛状态的检测方法、装置、设备和介质
CN109508679B (zh) * 2018-11-19 2023-02-10 广东工业大学 实现眼球三维视线跟踪的方法、装置、设备及存储介质
CN111178278B (zh) * 2019-12-30 2022-04-08 上海商汤临港智能科技有限公司 视线方向确定方法、装置、电子设备及存储介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107193383A (zh) 2017-06-13 2017-09-22 华南师范大学 一种基于人脸朝向约束的二级视线追踪方法
JP2019028843A (ja) 2017-08-01 2019-02-21 オムロン株式会社 人物の視線方向を推定するための情報処理装置及び推定方法、並びに学習装置及び学習方法
CN110503068A (zh) 2019-08-28 2019-11-26 Oppo广东移动通信有限公司 视线估计方法、终端及存储介质

Also Published As

Publication number Publication date
JP2022553776A (ja) 2022-12-26
KR20210140763A (ko) 2021-11-23
CN111178278B (zh) 2022-04-08
WO2021135827A1 (zh) 2021-07-08
CN111178278A (zh) 2020-05-19

Similar Documents

Publication Publication Date Title
JP7309116B2 (ja) 視線方向特定方法、装置、電子機器及び記憶媒体
Chen et al. Fsrnet: End-to-end learning face super-resolution with facial priors
EP3674852B1 (en) Method and apparatus with gaze estimation
EP3779774B1 (en) Training method for image semantic segmentation model and server
US20210012093A1 (en) Method and apparatus for generating face rotation image
CN112368719A (zh) 神经网络的梯度对抗性训练
EP4207053A1 (en) Occlusion detection model training method and facial image beautification method
CN112040834A (zh) 眼球跟踪方法及系统
JP7093427B2 (ja) オブジェクト追跡方法および装置、電子設備並びに記憶媒体
JP5098739B2 (ja) シミュレーション装置、シミュレーションプログラムおよびシミュレーションプログラムを記録した記録媒体
WO2022137603A1 (ja) 判定方法、判定装置、及び判定プログラム
KR20180060559A (ko) 동공 거리 결정 방법 및 장치
CN111259713A (zh) 一种基于自适应加权的视线跟踪方法
US9904843B2 (en) Information processing device, information processing method, and program
CN111723707A (zh) 一种基于视觉显著性的注视点估计方法及装置
CN112446322A (zh) 眼球特征检测方法、装置、设备及计算机可读存储介质
CN114187624A (zh) 图像生成方法、装置、电子设备及存储介质
WO2021217937A1 (zh) 姿态识别模型的训练方法及设备、姿态识别方法及其设备
US20160110909A1 (en) Method and apparatus for creating texture map and method of creating database
CN112766163A (zh) 一种基于对抗优化的视线方向确定方法
JP7238998B2 (ja) 推定装置、学習装置、制御方法及びプログラム
WO2022262209A1 (zh) 一种神经网络训练方法、装置、计算机设备及存储介质
CN112400148A (zh) 使用离轴相机执行眼睛跟踪的方法和系统
US20230064242A1 (en) Electronic device for predicting pose and operating method thereof
JP2011232845A (ja) 特徴点抽出装置および方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220426

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220426

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230228

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230517

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230530

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230612

R150 Certificate of patent or registration of utility model

Ref document number: 7309116

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150