JP7118697B2 - 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル - Google Patents

注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル Download PDF

Info

Publication number
JP7118697B2
JP7118697B2 JP2018068120A JP2018068120A JP7118697B2 JP 7118697 B2 JP7118697 B2 JP 7118697B2 JP 2018068120 A JP2018068120 A JP 2018068120A JP 2018068120 A JP2018068120 A JP 2018068120A JP 7118697 B2 JP7118697 B2 JP 7118697B2
Authority
JP
Japan
Prior art keywords
image
point
estimation
regard
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018068120A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019179390A5 (enExample
JP2019179390A (ja
Inventor
田 昌 昭 福
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Preferred Networks Inc
Original Assignee
Preferred Networks Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Preferred Networks Inc filed Critical Preferred Networks Inc
Priority to JP2018068120A priority Critical patent/JP7118697B2/ja
Priority to US16/370,528 priority patent/US11341680B2/en
Publication of JP2019179390A publication Critical patent/JP2019179390A/ja
Publication of JP2019179390A5 publication Critical patent/JP2019179390A5/ja
Priority to US17/732,056 priority patent/US11748904B2/en
Application granted granted Critical
Publication of JP7118697B2 publication Critical patent/JP7118697B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/269—Analysis of motion using gradient-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Image Analysis (AREA)
  • Controls And Circuits For Display Device (AREA)
JP2018068120A 2018-03-30 2018-03-30 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル Active JP7118697B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2018068120A JP7118697B2 (ja) 2018-03-30 2018-03-30 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
US16/370,528 US11341680B2 (en) 2018-03-30 2019-03-29 Gaze point estimation processing apparatus, gaze point estimation model generation apparatus, gaze point estimation processing system, and gaze point estimation processing method
US17/732,056 US11748904B2 (en) 2018-03-30 2022-04-28 Gaze point estimation processing apparatus, gaze point estimation model generation apparatus, gaze point estimation processing system, and gaze point estimation processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018068120A JP7118697B2 (ja) 2018-03-30 2018-03-30 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル

Publications (3)

Publication Number Publication Date
JP2019179390A JP2019179390A (ja) 2019-10-17
JP2019179390A5 JP2019179390A5 (enExample) 2021-09-09
JP7118697B2 true JP7118697B2 (ja) 2022-08-16

Family

ID=68056486

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018068120A Active JP7118697B2 (ja) 2018-03-30 2018-03-30 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル

Country Status (2)

Country Link
US (2) US11341680B2 (enExample)
JP (1) JP7118697B2 (enExample)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7118697B2 (ja) * 2018-03-30 2022-08-16 株式会社Preferred Networks 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
EP3660733B1 (en) * 2018-11-30 2023-06-28 Tata Consultancy Services Limited Method and system for information extraction from document images using conversational interface and database querying
CN110728256A (zh) * 2019-10-22 2020-01-24 上海商汤智能科技有限公司 基于车载数字人的交互方法及装置、存储介质
EP3944159A1 (en) * 2020-07-17 2022-01-26 Tata Consultancy Services Limited Method and system for defending universal adversarial attacks on time-series data
JP7481205B2 (ja) * 2020-08-26 2024-05-10 川崎重工業株式会社 ロボットシステム、ロボットの制御方法、情報処理装置、コンピュータプログラム、学習装置、及び学習済みモデルの生成方法
GB2599900B (en) * 2020-10-09 2023-01-11 Sony Interactive Entertainment Inc Data processing system and method for image enhancement
JP7599319B2 (ja) * 2020-12-03 2024-12-13 京セラ株式会社 電子機器、情報処理装置、集中度算出プログラム、集中度算出方法、コンピュータの学習方法
CN116965010A (zh) * 2021-02-26 2023-10-27 索尼集团公司 投射系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017155663A1 (en) 2016-03-11 2017-09-14 Qualcomm Incorporated Recurrent networks with motion-based attention for video understanding
JP2018022360A (ja) 2016-08-04 2018-02-08 株式会社リコー 画像解析装置、画像解析方法およびプログラム

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7515173B2 (en) * 2002-05-23 2009-04-07 Microsoft Corporation Head pose tracking system
US7306337B2 (en) * 2003-03-06 2007-12-11 Rensselaer Polytechnic Institute Calibration-free gaze tracking under natural head movement
US8885882B1 (en) * 2011-07-14 2014-11-11 The Research Foundation For The State University Of New York Real time eye tracking for human computer interaction
US9025880B2 (en) * 2012-08-29 2015-05-05 Disney Enterprises, Inc. Visual saliency estimation for images and video
US9965860B2 (en) 2013-02-27 2018-05-08 Thomson Licensing Method and device for calibration-free gaze estimation
JP6187155B2 (ja) 2013-10-28 2017-08-30 株式会社デンソーアイティーラボラトリ 注視対象物推定装置
CN105765513B (zh) 2013-11-01 2020-02-21 索尼公司 信息处理装置、信息处理方法和程序
US9684827B2 (en) * 2014-03-26 2017-06-20 Microsoft Technology Licensing, Llc Eye gaze tracking based upon adaptive homography mapping
WO2015172124A1 (en) 2014-05-09 2015-11-12 Eyefluence, Inc. Systems and methods for using eye signals with secure mobile communications
CN104951084B (zh) * 2015-07-30 2017-12-29 京东方科技集团股份有限公司 视线追踪方法及装置
JP6713434B2 (ja) 2016-05-30 2020-06-24 日本電信電話株式会社 注目範囲推定装置、学習装置、それらの方法およびプログラム
US9898082B1 (en) * 2016-11-01 2018-02-20 Massachusetts Institute Of Technology Methods and apparatus for eye tracking
US10325396B2 (en) * 2017-02-14 2019-06-18 Linden Research, Inc. Virtual reality presentation of eye movement and eye contact
JP7118697B2 (ja) * 2018-03-30 2022-08-16 株式会社Preferred Networks 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
US20190324528A1 (en) * 2018-04-20 2019-10-24 Microsoft Technology Licensing, Llc Adjusting gaze point based on determined offset adjustment

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017155663A1 (en) 2016-03-11 2017-09-14 Qualcomm Incorporated Recurrent networks with motion-based attention for video understanding
JP2018022360A (ja) 2016-08-04 2018-02-08 株式会社リコー 画像解析装置、画像解析方法およびプログラム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
TILKE Judd et al.，Learning to predict where humans look，2009 IEEE 12th International Conference on Computer Vision，IEEE，2009年09月29日，pp. 2106-2113，https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5459462
渡辺 隆，シグモイド型パルスジェネレータを取り入れたＰｕｌｓｅ－Ｃｏｕｐｌｅｄ Ｎｅｕｒａｌ Ｎｅｔｗｏｒｋによる注視点探索法，計測自動制御学会論文集 第３８巻 第８号，日本，計測自動制御学会，2002年08月31日，pp. 726-732

Also Published As

Publication number Publication date
JP2019179390A (ja) 2019-10-17
US11748904B2 (en) 2023-09-05
US11341680B2 (en) 2022-05-24
US20220254063A1 (en) 2022-08-11
US20190304136A1 (en) 2019-10-03

Similar Documents

Publication Publication Date Title
JP7118697B2 (ja) 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
US10573313B2 (en) Audio analysis learning with video data
Yang et al. Benchmarking commercial emotion detection systems using realistic distortions of facial image datasets
US11206450B2 (en) System, apparatus and method for providing services based on preferences
US10779761B2 (en) Sporadic collection of affect data within a vehicle
US20170319123A1 (en) Systems and Methods for Using Mobile and Wearable Video Capture and Feedback Plat-Forms for Therapy of Mental Disorders
JP6617013B2 (ja) ロボット広告システム、ロボット、ロボット広告方法及びプログラム
CN121116125A (zh) 用于通过迭代生成增强输出内容的设备、方法和程序
WO2020204948A1 (en) Methods and systems that provide emotion modifications during video chats
US11327320B2 (en) Electronic device and method of controlling the same
CN116484318A (zh) 一种演讲训练反馈方法、装置及存储介质
US20250363825A1 (en) Emotion Detection
KR102396794B1 (ko) 전자 장치 및 이의 제어 방법
KR20210051349A (ko) 전자장치 및 그 제어방법
US20240342901A1 (en) Learning device, learning method, and program
CN112087590A (zh) 图像处理方法、装置、系统及计算机存储介质
KR102675910B1 (ko) 자율 주행 기반의 안내 로봇 시스템 및 그 제어 방법
EP4213105A1 (en) Gaze estimation system and method thereof
KR20220151596A (ko) 나이 추정 장치 및 나이를 추정하는 방법
JP7685660B1 (ja) 情報処理装置、表示装置、テレビジョン受像機、及び情報処理システム
JP7150688B2 (ja) コンテンツの顕著性を考慮してユーザの属性を推定する装置、プログラム及び方法
JP7354344B2 (ja) 画像解析装置、画像解析方法、およびプログラム
CN120672401A (zh) 一种基于人脸识别的多模态vr广告推送方法及系统
Pandey Lip Reading as an Active Mode of Interaction with Computer Systems
KR20240016815A (ko) 얼굴 인식 기반 상호작용 상대방에 대한 사용자의 관계 감정 지수를 측정하는 시스템 및 방법

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210127

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210127

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210726

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220124

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220218

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220418

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220715

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220803

R150 Certificate of patent or registration of utility model

Ref document number: 7118697

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250