JP7164047B2 - 注視点検出装置及び注視点検出方法 - Google Patents

注視点検出装置及び注視点検出方法 Download PDF

Info

Publication number
JP7164047B2
JP7164047B2 JP2021530421A JP2021530421A JP7164047B2 JP 7164047 B2 JP7164047 B2 JP 7164047B2 JP 2021530421 A JP2021530421 A JP 2021530421A JP 2021530421 A JP2021530421 A JP 2021530421A JP 7164047 B2 JP7164047 B2 JP 7164047B2
Authority
JP
Japan
Prior art keywords
image
imaging unit
target person
depth information
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021530421A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2021005742A1 (https=
JPWO2021005742A5 (https=
Inventor
亮 高本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Publication of JPWO2021005742A1 publication Critical patent/JPWO2021005742A1/ja
Publication of JPWO2021005742A5 publication Critical patent/JPWO2021005742A5/ja
Application granted granted Critical
Publication of JP7164047B2 publication Critical patent/JP7164047B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/97—Determining parameters from multiple pictures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Ophthalmology & Optometry (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Position Input By Displaying (AREA)
  • Eye Examination Apparatus (AREA)
JP2021530421A 2019-07-10 2019-07-10 注視点検出装置及び注視点検出方法 Active JP7164047B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/027305 WO2021005742A1 (ja) 2019-07-10 2019-07-10 注視点検出装置及び注視点検出方法

Publications (3)

Publication Number Publication Date
JPWO2021005742A1 JPWO2021005742A1 (https=) 2021-01-14
JPWO2021005742A5 JPWO2021005742A5 (https=) 2022-03-04
JP7164047B2 true JP7164047B2 (ja) 2022-11-01

Family

ID=74115021

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021530421A Active JP7164047B2 (ja) 2019-07-10 2019-07-10 注視点検出装置及び注視点検出方法

Country Status (3)

Country Link
US (1) US12067162B2 (https=)
JP (1) JP7164047B2 (https=)
WO (1) WO2021005742A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2026022882A1 (ja) * 2024-07-22 2026-01-29 株式会社Ｎｔｔドコモ 情報出力制御装置および情報出力制御方法

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021005742A1 (ja) * 2019-07-10 2021-01-14 日本電気株式会社 注視点検出装置及び注視点検出方法
JP7374057B2 (ja) * 2020-09-16 2023-11-06 日立Astemo株式会社 信号処理装置
US20240277255A1 (en) * 2023-02-21 2024-08-22 Hillrom Services, Inc. Systems and methods for monitoring subjects
CN117011925B (zh) * 2023-07-05 2026-04-07 上海大学 一种基于注意力机制和深度先验的注视点检测方法
EP4664244A1 (en) * 2024-06-13 2025-12-17 Auki Matterless Limited Determining a gaze location of a human interacting with products in a store

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130188054A1 (en) 2011-07-21 2013-07-25 Lee S. Weinblatt Monitoring Technique Utilizing an Array of Cameras for Eye Movement Recording
JP2015032237A (ja) 2013-08-06 2015-02-16 株式会社京三製作所 横断歩道用信号システム
JP2017538990A (ja) 2014-10-07 2017-12-28 マイクロソフト テクノロジー ライセンシング，エルエルシー 共有される空間的拡張現実感経験を生成するためのプロジェクターの駆動

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5477777B2 (ja) 2010-03-31 2014-04-23 サクサ株式会社 画像取得装置
US9514538B2 (en) * 2012-05-25 2016-12-06 National University Corporation Shizuoka University Pupil detection method, corneal reflex detection method, facial posture detection method, and pupil tracking method
US9137524B2 (en) * 2012-11-27 2015-09-15 Qualcomm Incorporated System and method for generating 3-D plenoptic video images
EP2995241B1 (en) * 2013-05-08 2021-04-14 National University Corporation Shizuoka University Pupil detection light source device, pupil detection device and pupil detection method
US9437038B1 (en) * 2013-09-26 2016-09-06 Amazon Technologies, Inc. Simulating three-dimensional views using depth relationships among planes of content
WO2016164859A1 (en) * 2015-04-10 2016-10-13 Bespoke, Inc. Systems and methods for creating eyewear with multi-focal lenses
EP3479293A4 (en) * 2016-06-29 2020-03-04 Seeing Machines Limited SYSTEMS AND METHODS FOR LOOK TRACKING
EP3499462B1 (en) * 2016-08-12 2021-03-10 National University Corporation Shizuoka University Line-of-sight detection device
US10433725B2 (en) * 2016-09-15 2019-10-08 The Governors Of The University Of Alberta System and method for capturing spatially and temporally coherent eye gaze and hand data during performance of a manual task
CN109716268B (zh) * 2016-09-22 2022-05-17 苹果公司 眼部和头部跟踪
US11009715B2 (en) * 2018-09-12 2021-05-18 Google Llc Methods and systems for fitting heads-up display to user
CN110969061A (zh) * 2018-09-29 2020-04-07 北京市商汤科技开发有限公司 神经网络训练、视线检测方法和装置及电子设备
US11475592B2 (en) * 2019-02-12 2022-10-18 Google Llc Systems and methods for determining an ear saddle point of a user to produce specifications to fit a wearable apparatus to the user's head
US10871823B1 (en) * 2019-05-23 2020-12-22 Facebook Technologies, Llc Systems and methods for using scene understanding for calibrating eye tracking
WO2021005742A1 (ja) * 2019-07-10 2021-01-14 日本電気株式会社 注視点検出装置及び注視点検出方法
SE2150387A1 (en) * 2021-03-30 2022-10-01 Tobii Ab System and method for determining reference gaze data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130188054A1 (en) 2011-07-21 2013-07-25 Lee S. Weinblatt Monitoring Technique Utilizing an Array of Cameras for Eye Movement Recording
JP2015032237A (ja) 2013-08-06 2015-02-16 株式会社京三製作所 横断歩道用信号システム
JP2017538990A (ja) 2014-10-07 2017-12-28 マイクロソフト テクノロジー ライセンシング，エルエルシー 共有される空間的拡張現実感経験を生成するためのプロジェクターの駆動

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2026022882A1 (ja) * 2024-07-22 2026-01-29 株式会社Ｎｔｔドコモ 情報出力制御装置および情報出力制御方法

Also Published As

Publication number Publication date
WO2021005742A1 (ja) 2021-01-14
JPWO2021005742A1 (https=) 2021-01-14
US12067162B2 (en) 2024-08-20
US20220244779A1 (en) 2022-08-04

Similar Documents

Publication Publication Date Title
JP7164047B2 (ja) 注視点検出装置及び注視点検出方法
JP7250443B2 (ja) 画像処理装置
US9164583B2 (en) Method and apparatus for gaze point mapping
US9684928B2 (en) Foot tracking
JP6273685B2 (ja) 追尾処理装置及びこれを備えた追尾処理システム並びに追尾処理方法
US11715236B2 (en) Method and system for re-projecting and combining sensor data for visualization
US20080175448A1 (en) Face authentication system and face authentication method
CN106572298A (zh) 显示控制装置以及显示控制方法
WO2012012555A1 (en) Methods and systems for audience digital monitoring
US10521965B2 (en) Information processing apparatus, method and non-transitory computer-readable storage medium
WO2014021169A1 (ja) 注視点検出装置、注視点検出方法、個人パラメータ算出装置、個人パラメータ算出方法、プログラム、及びコンピュータ読み取り可能な記録媒体
US12412367B2 (en) Operating room objects and workflow tracking using depth cameras
KR20150093532A (ko) 정보 관리를 위한 장치 및 방법
EP3074844A1 (en) Estimating gaze from un-calibrated eye measurement points
US20190026909A1 (en) Monitoring device and monitoring system
KR100960269B1 (ko) 눈동자 시선 추정 장치 및 추정 방법
JP6244960B2 (ja) 物体認識装置、物体認識方法及び物体認識プログラム
US20250308211A1 (en) Automatic de-identification of operating room (or) videos based on depth images
CN113542670B (zh) 检测方法、检测装置和检测系统
CN112532874B (zh) 生成平面热力图的方法、装置、存储介质和电子设备
WO2022212804A1 (en) System and method for scene rectification via homography estimation
JP2003079577A (ja) 視線測定装置及びその方法と、視線測定プログラム及びそのプログラムを記録した記録媒体
US12061736B2 (en) Information processing apparatus
US20240428276A1 (en) Processing apparatus, control method of processing apparatus, and program recording medium
US11399778B2 (en) Measuring instrument attachment assist device and measuring instrument attachment assist method

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211207

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211207

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220920

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20221003

R151 Written notification of patent or utility model registration

Ref document number: 7164047

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151