CN101334839B - 图像处理装置及图像处理方法 - Google Patents

图像处理装置及图像处理方法 Download PDF

Info

Publication number
CN101334839B
CN101334839B CN2008101261944A CN200810126194A CN101334839B CN 101334839 B CN101334839 B CN 101334839B CN 2008101261944 A CN2008101261944 A CN 2008101261944A CN 200810126194 A CN200810126194 A CN 200810126194A CN 101334839 B CN101334839 B CN 101334839B
Authority
CN
China
Prior art keywords
facial expression
value
state
image processing
facial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2008101261944A
Other languages
English (en)
Chinese (zh)
Other versions
CN101334839A (zh
Inventor
金田雄司
森克彦
佐藤博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Publication of CN101334839A publication Critical patent/CN101334839A/zh
Application granted granted Critical
Publication of CN101334839B publication Critical patent/CN101334839B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
CN2008101261944A 2007-06-29 2008-06-27 图像处理装置及图像处理方法 Expired - Fee Related CN101334839B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2007173112 2007-06-29
JP2007173112A JP4974788B2 (ja) 2007-06-29 2007-06-29 画像処理装置、画像処理方法、プログラム、及び記憶媒体
JP2007-173112 2007-06-29

Publications (2)

Publication Number Publication Date
CN101334839A CN101334839A (zh) 2008-12-31
CN101334839B true CN101334839B (zh) 2013-08-14

Family

ID=39645597

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008101261944A Expired - Fee Related CN101334839B (zh) 2007-06-29 2008-06-27 图像处理装置及图像处理方法

Country Status (5)

Country Link
US (1) US8538091B2 (https=)
EP (1) EP2009577B1 (https=)
JP (1) JP4974788B2 (https=)
CN (1) CN101334839B (https=)
DE (1) DE602008005958D1 (https=)

Families Citing this family (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5262243B2 (ja) * 2008-03-31 2013-08-14 アイシン精機株式会社 眼開閉判別装置、及びプログラム
JP5127067B2 (ja) * 2009-03-06 2013-01-23 パナソニック株式会社 画像検索装置及び画像検索方法
JP5431083B2 (ja) * 2009-09-16 2014-03-05 オリンパスイメージング株式会社 撮影装置および撮影装置の制御方法
JP5385759B2 (ja) * 2009-10-30 2014-01-08 キヤノン株式会社 画像処理装置及び画像処理方法
JP5424819B2 (ja) * 2009-11-04 2014-02-26 キヤノン株式会社 画像処理装置、画像処理方法
US8604772B2 (en) 2010-03-31 2013-12-10 General Electric Company MEMS-based resonant tunneling devices and arrays of such devices for electric field sensing
US10108852B2 (en) * 2010-06-07 2018-10-23 Affectiva, Inc. Facial analysis to detect asymmetric expressions
US10869626B2 (en) * 2010-06-07 2020-12-22 Affectiva, Inc. Image analysis for emotional metric evaluation
JP2012038106A (ja) * 2010-08-06 2012-02-23 Canon Inc 情報処理装置、情報処理方法、およびプログラム
US9025835B2 (en) 2011-10-28 2015-05-05 Intellectual Ventures Fund 83 Llc Image recomposition from face detection and facial features
US8811747B2 (en) 2011-10-28 2014-08-19 Intellectual Ventures Fund 83 Llc Image recomposition from face detection and facial features
US9008436B2 (en) * 2011-10-28 2015-04-14 Intellectual Ventures Fund 83 Llc Image recomposition from face detection and facial features
US9025836B2 (en) 2011-10-28 2015-05-05 Intellectual Ventures Fund 83 Llc Image recomposition from face detection and facial features
US8938100B2 (en) 2011-10-28 2015-01-20 Intellectual Ventures Fund 83 Llc Image recomposition from face detection and facial features
KR101901591B1 (ko) * 2011-11-01 2018-09-28 삼성전자주식회사 얼굴 인식 장치 및 그 제어방법
CN102842033A (zh) * 2012-08-17 2012-12-26 苏州两江科技有限公司 基于人脸识别进行人物表情情感语义识别方法
US9530072B2 (en) * 2013-03-15 2016-12-27 Dropbox, Inc. Duplicate/near duplicate detection and image registration
JP5999013B2 (ja) * 2013-04-12 2016-09-28 株式会社デンソー 開眼状態判定装置
US10176456B2 (en) 2013-06-26 2019-01-08 Amazon Technologies, Inc. Transitioning items from a materials handling facility
US10268983B2 (en) 2013-06-26 2019-04-23 Amazon Technologies, Inc. Detecting item interaction and movement
US10176513B1 (en) * 2013-06-26 2019-01-08 Amazon Technologies, Inc. Using gestures and expressions to assist users
US9400925B2 (en) * 2013-11-15 2016-07-26 Facebook, Inc. Pose-aligned networks for deep attribute modeling
JP6127214B2 (ja) 2013-11-30 2017-05-10 ペキン センスタイム テクノロジー ディベロップメント カンパニー リミテッド 顔画像認識のための方法とシステム
US9614724B2 (en) 2014-04-21 2017-04-04 Microsoft Technology Licensing, Llc Session-based device configuration
US9639742B2 (en) 2014-04-28 2017-05-02 Microsoft Technology Licensing, Llc Creation of representative content based on facial analysis
US9773156B2 (en) 2014-04-29 2017-09-26 Microsoft Technology Licensing, Llc Grouping and ranking images based on facial recognition data
US9384334B2 (en) 2014-05-12 2016-07-05 Microsoft Technology Licensing, Llc Content discovery in managed wireless distribution networks
US10111099B2 (en) 2014-05-12 2018-10-23 Microsoft Technology Licensing, Llc Distributing content in managed wireless distribution networks
US9430667B2 (en) 2014-05-12 2016-08-30 Microsoft Technology Licensing, Llc Managed wireless distribution network
US9384335B2 (en) 2014-05-12 2016-07-05 Microsoft Technology Licensing, Llc Content delivery prioritization in managed wireless distribution networks
CN103971131A (zh) * 2014-05-13 2014-08-06 华为技术有限公司 一种预设表情识别方法和装置
US9576175B2 (en) * 2014-05-16 2017-02-21 Verizon Patent And Licensing Inc. Generating emoticons based on an image of a face
US9874914B2 (en) 2014-05-19 2018-01-23 Microsoft Technology Licensing, Llc Power management contracts for accessory devices
US10037202B2 (en) 2014-06-03 2018-07-31 Microsoft Technology Licensing, Llc Techniques to isolating a portion of an online computing service
US9367490B2 (en) 2014-06-13 2016-06-14 Microsoft Technology Licensing, Llc Reversible connector for accessory devices
US9373179B2 (en) 2014-06-23 2016-06-21 Microsoft Technology Licensing, Llc Saliency-preserving distinctive low-footprint photograph aging effect
US9717006B2 (en) 2014-06-23 2017-07-25 Microsoft Technology Licensing, Llc Device quarantine in a wireless network
CN104881639B (zh) * 2015-05-14 2018-06-26 江苏大学 一种基于层次tdp模型的人脸检测、分割和表情识别方法
US20160378112A1 (en) * 2015-06-26 2016-12-29 Intel Corporation Autonomous vehicle safety systems and methods
US10007845B2 (en) 2015-07-06 2018-06-26 Pixart Imaging Inc. Eye state detecting method and eye state detecting system
US20170017841A1 (en) * 2015-07-17 2017-01-19 Nokia Technologies Oy Method and apparatus for facilitating improved biometric recognition using iris segmentation
US10860887B2 (en) * 2015-11-16 2020-12-08 Samsung Electronics Co., Ltd. Method and apparatus for recognizing object, and method and apparatus for training recognition model
CN108701323B (zh) 2016-03-21 2023-11-10 宝洁公司 用于提供定制的产品推荐的系统和方法
KR101887637B1 (ko) * 2016-11-15 2018-08-10 주식회사 로보러스 로봇 시스템
CN106599800A (zh) * 2016-11-25 2017-04-26 哈尔滨工程大学 一种基于深度学习的人脸微表情识别方法
KR101910158B1 (ko) * 2016-12-09 2018-12-19 동국대학교 산학협력단 회선 신경망 기반 눈 개폐 분류 장치 및 방법
CN107180225A (zh) * 2017-04-19 2017-09-19 华南理工大学 一种针对卡通人物面部表情的识别方法
JP6932987B2 (ja) * 2017-05-11 2021-09-08 オムロン株式会社 画像処理装置、画像処理プログラム、画像処理システム
EP3631679B1 (en) 2017-05-31 2023-09-13 The Procter & Gamble Company Systems and methods for determining apparent skin age
JP6849824B2 (ja) * 2017-05-31 2021-03-31 ザ プロクター アンド ギャンブル カンパニーＴｈｅ Ｐｒｏｃｔｅｒ ＆ Ｇａｍｂｌｅ Ｃｏｍｐａｎｙ セルフィーを撮影するためにユーザをガイドするためのシステム及び方法
GB201713829D0 (en) * 2017-08-29 2017-10-11 We Are Human Ltd Image data processing system and method
WO2019119396A1 (zh) * 2017-12-22 2019-06-27 中国科学院深圳先进技术研究院 人脸表情识别方法及装置
CN108564007B (zh) * 2018-03-27 2021-10-22 深圳市智能机器人研究院 一种基于表情识别的情绪识别方法和装置
JP6941800B2 (ja) 2018-04-04 2021-09-29 パナソニックＩｐマネジメント株式会社 感情推定装置、感情推定方法及びプログラム
JP7350735B2 (ja) 2018-06-22 2023-09-26 株式会社半導体エネルギー研究所 画像表示装置
JP6992693B2 (ja) * 2018-07-23 2022-01-13 トヨタ自動車株式会社 乗員状態認識装置
CN109192275A (zh) 2018-08-06 2019-01-11 百度在线网络技术（北京）有限公司 人物精神状态的确定方法、装置及服务器
CN110909561A (zh) * 2018-09-14 2020-03-24 虹软科技股份有限公司 眼睛状态检测系统及眼睛状态检测系统的操作方法
US11933974B2 (en) * 2019-02-22 2024-03-19 Semiconductor Energy Laboratory Co., Ltd. Glasses-type electronic device
WO2020197537A1 (en) * 2019-03-22 2020-10-01 Hewlett-Packard Development Company, L.P. Detecting eye measurements
US10423773B1 (en) * 2019-04-12 2019-09-24 Coupang, Corp. Computerized systems and methods for determining authenticity using micro expressions
JP7548914B2 (ja) 2019-09-06 2024-09-10 株式会社半導体エネルギー研究所 情報処理装置
US12511940B2 (en) * 2021-03-30 2025-12-30 Nec Corporation Information processing apparatus, information processing method, and recording medium
JP7608385B2 (ja) * 2022-03-02 2025-01-06 キヤノン株式会社 撮像装置およびその制御方法、プログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1830389A (zh) * 2006-04-21 2006-09-13 太原理工大学 疲劳驾驶状态监控装置及方法
EP1700567A1 (en) * 2005-03-10 2006-09-13 Delphi Technologies, Inc. System and method for determining eye closure state
CN1839410A (zh) * 2003-07-18 2006-09-27 佳能株式会社 图像处理设备、摄像设备、图像处理方法
CN1940965A (zh) * 2005-09-26 2007-04-04 佳能株式会社 信息处理设备及其控制方法

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2822799B2 (ja) 1992-07-18 1998-11-11 日産自動車株式会社 運転者の状態検出装置
JP3018865B2 (ja) 1993-10-07 2000-03-13 富士ゼロックス株式会社 感情表出装置
JP3296118B2 (ja) * 1994-11-17 2002-06-24 トヨタ自動車株式会社 顔位置判定装置及び瞬き検出装置
US5909543A (en) * 1994-11-30 1999-06-01 Canon Kabushiki Kaisha Communication conference system and communication conference apparatus
JPH08294100A (ja) * 1995-04-20 1996-11-05 Canon Inc 通信端末及び監視システム
JP3658087B2 (ja) * 1995-07-04 2005-06-08 キヤノン株式会社 端末装置及び端末装置の制御方法
JP2962549B2 (ja) 1997-03-11 1999-10-12 株式会社エイ・ティ・アール知能映像通信研究所 顔動画像からの表情認識方法
JPH10336705A (ja) * 1997-06-02 1998-12-18 Canon Inc 複眼カメラ
JP3556439B2 (ja) * 1997-08-12 2004-08-18 三菱電機株式会社 顔画像処理装置
US6466685B1 (en) * 1998-07-14 2002-10-15 Kabushiki Kaisha Toshiba Pattern recognition apparatus and method
JP4087953B2 (ja) 1998-07-14 2008-05-21 株式会社東芝 パターン認識装置及びその方法
JP2000137792A (ja) 1998-10-30 2000-05-16 Toyota Motor Corp 眼部検出装置
US6704042B2 (en) * 1998-12-10 2004-03-09 Canon Kabushiki Kaisha Video processing apparatus, control method therefor, and storage medium
WO2000044580A1 (en) * 1999-01-27 2000-08-03 Compumedics Sleep Pty. Ltd. Vigilance monitoring system
US6243015B1 (en) * 1999-06-17 2001-06-05 Hyundai Motor Company Driver's drowsiness detection method of drowsy driving warning system
JP4161659B2 (ja) * 2002-02-27 2008-10-08 日本電気株式会社 画像認識システム及びその認識方法並びにプログラム
JP4123050B2 (ja) * 2003-05-16 2008-07-23 日産自動車株式会社 覚醒度レベル判定装置
EP1650711B1 (en) * 2003-07-18 2015-03-04 Canon Kabushiki Kaisha Image processing device, imaging device, image processing method
JP4612806B2 (ja) 2003-07-18 2011-01-12 キヤノン株式会社 画像処理装置、画像処理方法、撮像装置
JP2006287749A (ja) * 2005-04-01 2006-10-19 Canon Inc 撮像装置、及びその制御方法
EP1748378B1 (en) * 2005-07-26 2009-09-16 Canon Kabushiki Kaisha Image capturing apparatus and image capturing method
JP4799105B2 (ja) * 2005-09-26 2011-10-26 キヤノン株式会社 情報処理装置及びその制御方法、コンピュータプログラム、記憶媒体
CN102231801B (zh) * 2005-11-25 2013-07-10 株式会社尼康 电子摄像机及图像处理装置
JP4845755B2 (ja) * 2007-01-30 2011-12-28 キヤノン株式会社 画像処理装置、画像処理方法、プログラム及び記憶媒体

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1839410A (zh) * 2003-07-18 2006-09-27 佳能株式会社 图像处理设备、摄像设备、图像处理方法
EP1700567A1 (en) * 2005-03-10 2006-09-13 Delphi Technologies, Inc. System and method for determining eye closure state
CN1940965A (zh) * 2005-09-26 2007-04-04 佳能株式会社 信息处理设备及其控制方法
CN1830389A (zh) * 2006-04-21 2006-09-13 太原理工大学 疲劳驾驶状态监控装置及方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
2006.09.13,

Also Published As

Publication number Publication date
EP2009577A1 (en) 2008-12-31
JP4974788B2 (ja) 2012-07-11
US20090003709A1 (en) 2009-01-01
CN101334839A (zh) 2008-12-31
DE602008005958D1 (de) 2011-05-19
EP2009577B1 (en) 2011-04-06
US8538091B2 (en) 2013-09-17
JP2009015372A (ja) 2009-01-22

Similar Documents

Publication Publication Date Title
CN101334839B (zh) 图像处理装置及图像处理方法
JP4999570B2 (ja) 表情認識装置及び方法、並びに撮像装置
CN101236600B (zh) 图像处理设备和图像处理方法
KR102147052B1 (ko) 얼굴 영상 기반의 감정 인식 시스템 및 방법
US8797448B2 (en) Rapid auto-focus using classifier chains, MEMS and multiple object focusing
CN100389600C (zh) 摄像装置及摄像方法
US7986346B2 (en) Image capturing apparatus, control method therefor, program, and storage medium
US8659697B2 (en) Rapid auto-focus using classifier chains, MEMS and/or multiple object focusing
US8624994B2 (en) Information processing apparatus, eye open/closed degree determination method, computer-readable storage medium, and image sensing apparatus
KR101539043B1 (ko) 인물 구도 제안 영상 촬영 장치 및 방법
JP2009163555A (ja) 顔照合装置
CN1839410B (zh) 图像处理设备、摄像设备、图像处理方法
WO2005008593A1 (ja) 画像処理装置、撮像装置、画像処理方法
JP2005149370A (ja) 画像撮影装置、個人認証装置及び画像撮影方法
KR102439216B1 (ko) 인공지능 딥러닝 모델을 이용한 마스크 착용 얼굴 인식 방법 및 서버
CN105744179A (zh) 摄像装置、摄像控制方法
Gadkar et al. Online examination auto-proctoring system
JP2007074142A (ja) 撮像装置及びその制御方法、及び画像処理装置及び方法
Findling Pan shot face unlock: Towards unlocking personal mobile devices using stereo vision and biometric face information from multiple perspectives
Tomionko et al. Blur and Motion Blur Influence on Recognition Performance of Color Face
JP2002117408A (ja) 顔画像処理方法及び装置
JP2009278287A (ja) 撮像装置及び撮像方法

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130814