JP6558388B2 - 画像処理装置 - Google Patents

画像処理装置 Download PDF

Info

Publication number
JP6558388B2
JP6558388B2 JP2017048535A JP2017048535A JP6558388B2 JP 6558388 B2 JP6558388 B2 JP 6558388B2 JP 2017048535 A JP2017048535 A JP 2017048535A JP 2017048535 A JP2017048535 A JP 2017048535A JP 6558388 B2 JP6558388 B2 JP 6558388B2
Authority
JP
Japan
Prior art keywords
information
learning
face
learner
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017048535A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018151938A5 (enExample
JP2018151938A (ja
Inventor
智浩 籔内
智浩 籔内
航一 木下
航一 木下
相澤　知禎
知禎 相澤
匡史 日向
匡史 日向
初美 青位
初美 青位
芽衣 上谷
芽衣 上谷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Omron Corp
Original Assignee
Omron Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Omron Corp filed Critical Omron Corp
Priority to JP2017048535A priority Critical patent/JP6558388B2/ja
Priority to DE112017007247.6T priority patent/DE112017007247B4/de
Priority to PCT/JP2017/036279 priority patent/WO2018168041A1/ja
Priority to CN201780086071.XA priority patent/CN110268416B/zh
Publication of JP2018151938A publication Critical patent/JP2018151938A/ja
Publication of JP2018151938A5 publication Critical patent/JP2018151938A5/ja
Application granted granted Critical
Publication of JP6558388B2 publication Critical patent/JP6558388B2/ja
Priority to US16/544,968 priority patent/US11222439B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Computation (AREA)
  • Human Computer Interaction (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
JP2017048535A 2017-03-14 2017-03-14 画像処理装置 Active JP6558388B2 (ja)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2017048535A JP6558388B2 (ja) 2017-03-14 2017-03-14 画像処理装置
DE112017007247.6T DE112017007247B4 (de) 2017-03-14 2017-10-05 Bildverarbeitungsvorrichtung
PCT/JP2017/036279 WO2018168041A1 (ja) 2017-03-14 2017-10-05 画像処理装置
CN201780086071.XA CN110268416B (zh) 2017-03-14 2017-10-05 图像处理装置
US16/544,968 US11222439B2 (en) 2017-03-14 2019-08-20 Image processing apparatus with learners for detecting orientation and position of feature points of a facial image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017048535A JP6558388B2 (ja) 2017-03-14 2017-03-14 画像処理装置

Publications (3)

Publication Number Publication Date
JP2018151938A JP2018151938A (ja) 2018-09-27
JP2018151938A5 JP2018151938A5 (enExample) 2019-04-04
JP6558388B2 true JP6558388B2 (ja) 2019-08-14

Family

ID=63521958

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017048535A Active JP6558388B2 (ja) 2017-03-14 2017-03-14 画像処理装置

Country Status (5)

Country Link
US (1) US11222439B2 (enExample)
JP (1) JP6558388B2 (enExample)
CN (1) CN110268416B (enExample)
DE (1) DE112017007247B4 (enExample)
WO (1) WO2018168041A1 (enExample)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107622240B (zh) * 2017-09-21 2023-10-13 百度在线网络技术（北京）有限公司 人脸检测方法和装置
CN111558945A (zh) * 2020-05-26 2020-08-21 天津市微卡科技有限公司 一种基于图像处理技术的学习效率监测陪伴机器人
CN115867949A (zh) * 2020-06-19 2023-03-28 京瓷株式会社 脸部构造推定装置、脸部构造推定方法以及脸部构造推定程序
CN112001872B (zh) * 2020-08-26 2021-09-14 北京字节跳动网络技术有限公司 信息显示方法、设备及存储介质
CN112036311A (zh) * 2020-08-31 2020-12-04 北京字节跳动网络技术有限公司 基于眼部状态检测的图像处理方法、装置及存储介质

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8254674B2 (en) * 2004-10-28 2012-08-28 DigitalOptics Corporation Europe Limited Analyzing partial face regions for red-eye detection in acquired digital images
JP2005056231A (ja) * 2003-08-06 2005-03-03 Matsushita Electric Ind Co Ltd 画像処理装置
EP1811456B1 (en) 2004-11-12 2011-09-28 Omron Corporation Face feature point detector and feature point detector
JP2007066010A (ja) 2005-08-31 2007-03-15 Fujifilm Corp 判別器学習方法および対象判別装置ならびにプログラム
JP4757598B2 (ja) * 2005-10-13 2011-08-24 富士フイルム株式会社 顔検出方法および装置並びにプログラム
US7889892B2 (en) 2005-10-13 2011-02-15 Fujifilm Corporation Face detecting method, and system and program for the methods
JP4696857B2 (ja) 2005-11-02 2011-06-08 オムロン株式会社 顔照合装置
JP4093273B2 (ja) 2006-03-13 2008-06-04 オムロン株式会社 特徴点検出装置、特徴点検出方法および特徴点検出プログラム
JP5176572B2 (ja) * 2008-02-05 2013-04-03 ソニー株式会社 画像処理装置および方法、並びにプログラム
JP5127583B2 (ja) * 2008-06-20 2013-01-23 株式会社豊田中央研究所 対象物判定装置及びプログラム
US7742623B1 (en) * 2008-08-04 2010-06-22 Videomining Corporation Method and system for estimating gaze target, gaze sequence, and gaze map from video
CN101763636B (zh) * 2009-09-23 2012-07-04 中国科学院自动化研究所 视频序列中的三维人脸位置和姿态跟踪的方法
WO2011065952A1 (en) 2009-11-30 2011-06-03 Hewlett-Packard Development Company, L.P. Face recognition apparatus and methods
JP5554984B2 (ja) * 2009-12-24 2014-07-23 キヤノン株式会社 パターン認識方法およびパターン認識装置
JP5618686B2 (ja) * 2010-08-03 2014-11-05 キヤノン株式会社 視線検出装置、視線検出方法及びプログラム
CN102985302A (zh) * 2011-07-11 2013-03-20 丰田自动车株式会社 车辆的紧急避险装置
JP5795979B2 (ja) * 2012-03-15 2015-10-14 株式会社東芝 人物画像処理装置、及び人物画像処理方法
AU2013205535B2 (en) * 2012-05-02 2018-03-15 Samsung Electronics Co., Ltd. Apparatus and method of controlling mobile terminal based on analysis of user's face
US11017211B1 (en) * 2012-09-07 2021-05-25 Stone Lock Global, Inc. Methods and apparatus for biometric verification
JP6099232B2 (ja) * 2013-08-22 2017-03-22 ビスポーク， インコーポレイテッド カスタム製品を創作するための方法及びシステム
JP6351243B2 (ja) * 2013-11-28 2018-07-04 キヤノン株式会社 画像処理装置、画像処理方法
CN104751108B (zh) * 2013-12-31 2019-05-17 汉王科技股份有限公司 人脸图像识别装置和人脸图像识别方法
US20150243031A1 (en) * 2014-02-21 2015-08-27 Metaio Gmbh Method and device for determining at least one object feature of an object comprised in an image
WO2015144209A1 (en) * 2014-03-25 2015-10-01 Metaio Gmbh Method and system for representing a virtual object in a view of a real environment
JP6410450B2 (ja) * 2014-03-31 2018-10-24 キヤノン株式会社 オブジェクト識別装置、オブジェクト識別方法及びプログラム
US9639742B2 (en) * 2014-04-28 2017-05-02 Microsoft Technology Licensing, Llc Creation of representative content based on facial analysis
US10296783B2 (en) * 2014-06-06 2019-05-21 Sharp Kabushiki Kaisha Image processing device and image display device
US9846807B1 (en) * 2014-12-31 2017-12-19 Morphotrust Usa, Llc Detecting eye corners
JP6624794B2 (ja) * 2015-03-11 2019-12-25 キヤノン株式会社 画像処理装置、画像処理方法及びプログラム
JP6606849B2 (ja) * 2015-04-06 2019-11-20 大日本印刷株式会社 識別器生成装置、識別器生成方法、推定装置、推定方法、およびプログラム
US10303973B2 (en) * 2015-04-15 2019-05-28 Canon Kabushiki Kaisha Image processing apparatus, image processing method, and storage medium for lighting processing on image using model data
WO2017029488A2 (en) * 2015-08-14 2017-02-23 Metail Limited Methods of generating personalized 3d head models or 3d body models
JP7011578B2 (ja) * 2015-08-31 2022-01-26 エスアールアイ インターナショナル 運転行動を監視する方法及びシステム
US10546185B2 (en) * 2015-12-01 2020-01-28 Casio Computer Co., Ltd. Image processing apparatus for performing image processing according to privacy level
DE112016005939B4 (de) * 2016-02-18 2020-02-27 Mitsubishi Electric Corporation Fahrgasterkennungsvorrichtung, Fahrgasterkennungssystem und Fahrgasterkennungsverfahren
US10157477B2 (en) * 2016-04-27 2018-12-18 Bellus 3D, Inc. Robust head pose estimation with a depth camera
US10055880B2 (en) * 2016-12-06 2018-08-21 Activision Publishing, Inc. Methods and systems to modify a two dimensional facial image to increase dimensional depth and generate a facial image that appears three dimensional

Also Published As

Publication number Publication date
WO2018168041A1 (ja) 2018-09-20
US20190370996A1 (en) 2019-12-05
US11222439B2 (en) 2022-01-11
CN110268416B (zh) 2023-06-09
DE112017007247B4 (de) 2023-07-06
CN110268416A (zh) 2019-09-20
DE112017007247T5 (de) 2019-12-19
JP2018151938A (ja) 2018-09-27

Similar Documents

Publication Publication Date Title
US11829858B2 (en) Method of training neural network by selecting data to be used in a subsequent training process and identifying a cluster corresponding to a feature vector
JP6558388B2 (ja) 画像処理装置
EP3674852B1 (en) Method and apparatus with gaze estimation
US10546201B2 (en) Method and apparatus for determining abnormal object
JP6573193B2 (ja) 判定装置、判定方法、および判定プログラム
EP2597597B1 (en) Apparatus and method for calculating three dimensional (3D) positions of feature points
CN104573623B (zh) 人脸检测装置、方法
JP5227639B2 (ja) オブジェクト検出方法、オブジェクト検出装置、およびオブジェクト検出プログラム
JP2010033305A (ja) 画像情報処理方法、及び装置
EP3480729B1 (en) System and method for face position tracking and alerting user
CN106919254B (zh) 一种头戴式虚拟现实设备及安全保护方法
JP2009064395A (ja) ポインティングデバイス、操作者の注視位置とカーソルの位置との誤差の補正をコンピュータに実行させるためのプログラムおよびそのプログラムを記録したコンピュータ読み取り可能な記録媒体
US10964046B2 (en) Information processing apparatus and non-transitory computer readable medium storing information processing program for estimating face orientation by using an omni-directional camera
WO2012121137A1 (ja) 画像処理装置および画像処理プログラム
Rangesh et al. Gaze preserving CycleGANs for eyeglass removal and persistent gaze estimation
WO2018168038A1 (ja) 運転者の着座判定装置
CN116758628B (zh) 一种基于多模态融合的人体动作识别方法及装置
JP5448952B2 (ja) 同一人判定装置、同一人判定方法および同一人判定プログラム
EP4210006A1 (en) Apparatus and method with liveness consideration
EP3651114B1 (en) Analysis device, analysis method, and program
KR102781755B1 (ko) 영유아 표정 인식 알고리즘 개선 방법
JP7361342B2 (ja) 学習方法、学習装置、及び、プログラム
CN117859039A (zh) 信息处理装置、信息处理方法和程序
KR20210152720A (ko) 이미지 처리 방법, 및 이를 이용하는 장치 및 프로그램
JP7544019B2 (ja) 手領域検出装置、手領域検出方法及び手領域検出用コンピュータプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190221

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190221

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20190221

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20190228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190312

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190329

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190618

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190701

R150 Certificate of patent or registration of utility model

Ref document number: 6558388

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250