JP5423379B2 - 画像処理装置および画像処理方法、並びにプログラム - Google Patents

画像処理装置および画像処理方法、並びにプログラム Download PDF

Info

Publication number
JP5423379B2
JP5423379B2 JP2009284807A JP2009284807A JP5423379B2 JP 5423379 B2 JP5423379 B2 JP 5423379B2 JP 2009284807 A JP2009284807 A JP 2009284807A JP 2009284807 A JP2009284807 A JP 2009284807A JP 5423379 B2 JP5423379 B2 JP 5423379B2
Authority
JP
Japan
Prior art keywords
face
parameter
unit
user
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2009284807A
Other languages
English (en)
Japanese (ja)
Other versions
JP2011070623A (ja
JP2011070623A5 (OSRAM
Inventor
彰彦 貝野
小林　　直樹
直之 尾上
潤一 山下
大介 望月
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to JP2009284807A priority Critical patent/JP5423379B2/ja
Priority to US12/829,870 priority patent/US8634658B2/en
Priority to CN2010102420292A priority patent/CN102004897B/zh
Priority to EP10173731.0A priority patent/EP2293221B1/en
Publication of JP2011070623A publication Critical patent/JP2011070623A/ja
Publication of JP2011070623A5 publication Critical patent/JP2011070623A5/ja
Application granted granted Critical
Publication of JP5423379B2 publication Critical patent/JP5423379B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/175—Static expression

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
JP2009284807A 2009-08-31 2009-12-16 画像処理装置および画像処理方法、並びにプログラム Expired - Fee Related JP5423379B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2009284807A JP5423379B2 (ja) 2009-08-31 2009-12-16 画像処理装置および画像処理方法、並びにプログラム
US12/829,870 US8634658B2 (en) 2009-08-31 2010-07-02 Apparatus, method, and program for processing image
CN2010102420292A CN102004897B (zh) 2009-08-31 2010-07-29 用于处理图像的装置和方法
EP10173731.0A EP2293221B1 (en) 2009-08-31 2010-08-23 Apparatus, method, and program for processing image

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2009201028 2009-08-31
JP2009201028 2009-08-31
JP2009284807A JP5423379B2 (ja) 2009-08-31 2009-12-16 画像処理装置および画像処理方法、並びにプログラム

Publications (3)

Publication Number Publication Date
JP2011070623A JP2011070623A (ja) 2011-04-07
JP2011070623A5 JP2011070623A5 (OSRAM) 2013-01-17
JP5423379B2 true JP5423379B2 (ja) 2014-02-19

Family

ID=43304648

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009284807A Expired - Fee Related JP5423379B2 (ja) 2009-08-31 2009-12-16 画像処理装置および画像処理方法、並びにプログラム

Country Status (4)

Country Link
US (1) US8634658B2 (OSRAM)
EP (1) EP2293221B1 (OSRAM)
JP (1) JP5423379B2 (OSRAM)
CN (1) CN102004897B (OSRAM)

Families Citing this family (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8359642B1 (en) * 2010-06-25 2013-01-22 Sprint Communications Company L.P. Restricting mature content
US20110316697A1 (en) * 2010-06-29 2011-12-29 General Electric Company System and method for monitoring an entity within an area
KR20120011920A (ko) * 2010-07-27 2012-02-09 삼성전자주식회사 디지털 영상 신호 처리 장치, 디지털 영상 신호 처리 방법 및 상기 방법을 기록한 기록 매체
JP2012244526A (ja) * 2011-05-23 2012-12-10 Sony Corp 情報処理装置、情報処理方法及びコンピュータプログラム
US9088426B2 (en) 2011-12-13 2015-07-21 Google Inc. Processing media streams during a multi-user video conference
WO2013097139A1 (en) * 2011-12-29 2013-07-04 Intel Corporation Communication using avatar
US9888171B2 (en) * 2012-02-13 2018-02-06 Htc Corporation Mobile camera device capable of improving facial patterns of a captured image
US9060095B2 (en) 2012-03-14 2015-06-16 Google Inc. Modifying an appearance of a participant during a video conference
JP5880182B2 (ja) * 2012-03-19 2016-03-08 カシオ計算機株式会社 画像生成装置、画像生成方法及びプログラム
US9595298B2 (en) 2012-07-18 2017-03-14 Microsoft Technology Licensing, Llc Transforming data to create layouts
JP2014068107A (ja) * 2012-09-25 2014-04-17 Zenrin Datacom Co Ltd 画像処理装置、画像処理システム、画像処理方法およびコンピュータプログラム
CN104737209A (zh) * 2012-11-22 2015-06-24 索尼公司 信息处理装置、系统、信息处理方法和程序
CN103903292B (zh) * 2012-12-27 2017-04-19 北京新媒传信科技有限公司 一种实现头像编辑界面的方法和系统
JP6268722B2 (ja) * 2013-03-06 2018-01-31 日本電気株式会社 表示装置、表示方法、及び、プログラム
WO2014187917A1 (en) * 2013-05-23 2014-11-27 bioMérieux Method, system and computer program product for improving the quality of an image
US9202119B2 (en) * 2013-10-18 2015-12-01 Daon Holdings Limited Methods and systems for determining user liveness
US20150317511A1 (en) * 2013-11-07 2015-11-05 Orbeus, Inc. System, method and apparatus for performing facial recognition
CN104657974A (zh) * 2013-11-25 2015-05-27 腾讯科技（上海）有限公司 一种图像处理方法及装置
US9614724B2 (en) 2014-04-21 2017-04-04 Microsoft Technology Licensing, Llc Session-based device configuration
US9639742B2 (en) 2014-04-28 2017-05-02 Microsoft Technology Licensing, Llc Creation of representative content based on facial analysis
US9773156B2 (en) * 2014-04-29 2017-09-26 Microsoft Technology Licensing, Llc Grouping and ranking images based on facial recognition data
US10111099B2 (en) 2014-05-12 2018-10-23 Microsoft Technology Licensing, Llc Distributing content in managed wireless distribution networks
US9874914B2 (en) 2014-05-19 2018-01-23 Microsoft Technology Licensing, Llc Power management contracts for accessory devices
US10037202B2 (en) 2014-06-03 2018-07-31 Microsoft Technology Licensing, Llc Techniques to isolating a portion of an online computing service
US9460493B2 (en) 2014-06-14 2016-10-04 Microsoft Technology Licensing, Llc Automatic video quality enhancement with temporal smoothing and user override
US9373179B2 (en) 2014-06-23 2016-06-21 Microsoft Technology Licensing, Llc Saliency-preserving distinctive low-footprint photograph aging effect
US9717006B2 (en) 2014-06-23 2017-07-25 Microsoft Technology Licensing, Llc Device quarantine in a wireless network
JP6476608B2 (ja) * 2014-06-30 2019-03-06 カシオ計算機株式会社 動作処理装置、動作処理方法及びプログラム
US9444999B2 (en) * 2014-08-05 2016-09-13 Omnivision Technologies, Inc. Feature detection in image capture
US9626768B2 (en) * 2014-09-30 2017-04-18 Microsoft Technology Licensing, Llc Optimizing a visual perspective of media
US10282069B2 (en) 2014-09-30 2019-05-07 Microsoft Technology Licensing, Llc Dynamic presentation of suggested content
US20180025175A1 (en) 2015-01-15 2018-01-25 Nec Corporation Information output device, camera, information output system, information output method, and program
DE102015223175A1 (de) * 2015-11-24 2017-05-24 Conti Temic Microelectronic Gmbh Fahrerassistenzsystem mit adaptiver Umgebungsbilddatenverarbeitung
WO2017137952A1 (en) * 2016-02-10 2017-08-17 Vats Nitin Intelligent chatting on digital communication network
JP6794144B2 (ja) * 2016-06-03 2020-12-02 東芝テック株式会社 操作入力装置、販売データ処理装置及びプログラム
US10452896B1 (en) * 2016-09-06 2019-10-22 Apple Inc. Technique for creating avatar from image data
DK179471B1 (en) 2016-09-23 2018-11-26 Apple Inc. IMAGE DATA FOR ENHANCED USER INTERACTIONS
JP2018055619A (ja) * 2016-09-30 2018-04-05 株式会社ブイシンク 画像表示装置
JP6266736B1 (ja) 2016-12-07 2018-01-24 株式会社コロプラ 仮想空間を介して通信するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
CN108268227B (zh) * 2017-01-04 2020-12-01 京东方科技集团股份有限公司 显示设备
EP3557865A4 (en) 2017-01-23 2020-01-08 NTT DoCoMo, Inc. INFORMATION PROCESSING SYSTEM AND PROCESSING PROCESS
US10380228B2 (en) 2017-02-10 2019-08-13 Microsoft Technology Licensing, Llc Output generation based on semantic expressions
KR102798516B1 (ko) 2017-05-16 2025-04-23 애플 인크. 이모지 레코딩 및 전송
KR101966384B1 (ko) * 2017-06-29 2019-08-13 라인 가부시키가이샤 영상 처리 방법 및 시스템
US10870056B2 (en) * 2017-11-01 2020-12-22 Sony Interactive Entertainment Inc. Emoji-based communications derived from facial features during game play
US11068141B1 (en) * 2018-02-02 2021-07-20 Snap Inc. Device-based image modification of depicted objects
WO2019155735A1 (ja) * 2018-02-07 2019-08-15 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
KR102661019B1 (ko) 2018-02-23 2024-04-26 삼성전자주식회사 얼굴에 대응하는 3차원 아바타를 이용하여 얼굴의 움직임이 반영된 3차원 아바타를 포함하는 이미지를 생성하는 전자 장치 및 그 동작 방법
JP2019164614A (ja) * 2018-03-20 2019-09-26 株式会社ＶｉＲＤ アバター制御プログラム
WO2019193781A1 (ja) 2018-04-04 2019-10-10 パナソニックＩｐマネジメント株式会社 感情推定装置、感情推定方法及びプログラム
DK201870374A1 (en) 2018-05-07 2019-12-04 Apple Inc. AVATAR CREATION USER INTERFACE
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
KR102530264B1 (ko) * 2018-08-08 2023-05-09 삼성전자 주식회사 아바타에 대응하는 속성에 따른 아이템을 제공하는 방법 및 장치
CN109447894A (zh) * 2018-08-20 2019-03-08 广州市久邦数码科技有限公司 一种基于数据分析的图像处理方法及其系统
CN111079479A (zh) 2018-10-19 2020-04-28 北京市商汤科技开发有限公司 小孩状态分析方法和装置、车辆、电子设备、存储介质
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
CN111488759A (zh) * 2019-01-25 2020-08-04 北京字节跳动网络技术有限公司 动物脸部的图像处理方法和装置
KR102664688B1 (ko) * 2019-02-19 2024-05-10 삼성전자 주식회사 가상 캐릭터 기반 촬영 모드를 제공하는 전자 장치 및 이의 동작 방법
JP7295388B2 (ja) * 2019-03-08 2023-06-21 フリュー株式会社 画像処理装置、画像処理方法及び画像処理プログラム
WO2020193439A1 (en) * 2019-03-22 2020-10-01 Essilor International Device for simulating a physiological behaviour of a mammal using a virtual mammal, process and computer program
DK201970530A1 (en) 2019-05-06 2021-01-28 Apple Inc Avatar integration with multiple applications
CN110674765A (zh) * 2019-09-27 2020-01-10 上海依图网络科技有限公司 摄像系统以及视频处理方法
JP7319172B2 (ja) * 2019-11-13 2023-08-01 富士フイルム株式会社 画像処理装置、画像処理方法及び画像処理システム
CN111698552A (zh) * 2020-05-15 2020-09-22 完美世界(北京)软件科技发展有限公司 一种视频资源的生成方法和装置
WO2021252160A1 (en) 2020-06-08 2021-12-16 Apple Inc. Presenting avatars in three-dimensional environments
CN111833418B (zh) * 2020-07-14 2024-03-29 北京百度网讯科技有限公司 动画交互方法、装置、设备以及存储介质
CN112001932B (zh) * 2020-09-01 2023-10-31 腾讯科技（深圳）有限公司 人脸识别方法、装置、计算机设备和存储介质
US11438551B2 (en) * 2020-09-15 2022-09-06 At&T Intellectual Property I, L.P. Virtual audience using low bitrate avatars and laughter detection
JP7217838B2 (ja) * 2020-09-24 2023-02-03 三菱電機株式会社 開口度算出装置
JP7613906B2 (ja) * 2020-12-18 2025-01-15 トヨタ自動車株式会社 画像処理システム
CA3222267A1 (en) * 2021-06-10 2022-12-15 Ofer Saban System and method for digital measurements of subjects
KR102826023B1 (ko) * 2022-11-30 2025-06-27 주식회사 케이티 음성 데이터에 기초하여 얼굴 이미지를 생성하는 장치, 방법 및 컴퓨터 프로그램

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6332123B1 (en) * 1989-03-08 2001-12-18 Kokusai Denshin Denwa Kabushiki Kaisha Mouth shape synthesizing
JPH0744727A (ja) 1993-07-27 1995-02-14 Sony Corp 画像作成方法およびその装置
JP2000306095A (ja) * 1999-04-16 2000-11-02 Fujitsu Ltd 画像照合・検索システム
IT1320002B1 (it) * 2000-03-31 2003-11-12 Cselt Centro Studi Lab Telecom Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio.
JP2002108382A (ja) * 2000-09-27 2002-04-10 Sony Corp リップシンクを行うアニメーション方法および装置
JP2002232783A (ja) 2001-02-06 2002-08-16 Sony Corp 画像処理装置および画像処理方法、並びにプログラム記憶媒体
US20030007700A1 (en) * 2001-07-03 2003-01-09 Koninklijke Philips Electronics N.V. Method and apparatus for interleaving a user image in an original image sequence
GB2382289B (en) * 2001-09-28 2005-07-06 Canon Kk Method and apparatus for generating models of individuals
JP3822828B2 (ja) * 2002-03-20 2006-09-20 沖電気工業株式会社 ３次元画像生成装置およびその画像生成方法ならびにその画像生成プログラムを記録したコンピュータ読取り可能な記録媒体
JP2003308533A (ja) * 2002-04-17 2003-10-31 Mitsubishi Electric Corp ドライバの顔画像処理装置
US7133535B2 (en) * 2002-12-21 2006-11-07 Microsoft Corp. System and method for real time lip synchronization
US7711155B1 (en) * 2003-04-14 2010-05-04 Videomining Corporation Method and system for enhancing three dimensional face modeling using demographic classification
KR100839772B1 (ko) * 2003-07-15 2008-06-20 오므론 가부시키가이샤 대상 결정 장치 및 촬상 장치
JP4517633B2 (ja) 2003-11-25 2010-08-04 ソニー株式会社 対象物検出装置及び方法
JP4482796B2 (ja) 2004-03-26 2010-06-16 ソニー株式会社 情報処理装置および方法、記録媒体、並びにプログラム
JP2006064973A (ja) * 2004-08-26 2006-03-09 Crimson Technology Inc 制御システム
US7634106B2 (en) * 2004-09-22 2009-12-15 Fujifilm Corporation Synthesized image generation method, synthesized image generation apparatus, and synthesized image generation program
DE602006009191D1 (de) * 2005-07-26 2009-10-29 Canon Kk Bildaufnahmegerät und -verfahren
US20070080967A1 (en) * 2005-10-11 2007-04-12 Animetrics Inc. Generation of normalized 2D imagery and ID systems via 2D to 3D lifting of multifeatured objects
US7728866B2 (en) * 2005-11-03 2010-06-01 Broadcom Corp. Video telephony image processing
JP2007156650A (ja) 2005-12-01 2007-06-21 Sony Corp 画像処理装置
JP2007213182A (ja) * 2006-02-08 2007-08-23 Fujifilm Corp 対象物状態認識方法および装置並びにプログラム
JP4093273B2 (ja) * 2006-03-13 2008-06-04 オムロン株式会社 特徴点検出装置、特徴点検出方法および特徴点検出プログラム
JP2008021266A (ja) * 2006-07-14 2008-01-31 Matsushita Electric Ind Co Ltd 顔向き検出装置、顔向き検出方法、および顔向き検出プログラム
JP4424364B2 (ja) * 2007-03-19 2010-03-03 ソニー株式会社 画像処理装置、画像処理方法
JP4569670B2 (ja) * 2008-06-11 2010-10-27 ソニー株式会社 画像処理装置、画像処理方法およびプログラム

Also Published As

Publication number Publication date
EP2293221B1 (en) 2018-11-28
JP2011070623A (ja) 2011-04-07
EP2293221A2 (en) 2011-03-09
CN102004897A (zh) 2011-04-06
CN102004897B (zh) 2013-11-27
EP2293221A3 (en) 2014-04-23
US8634658B2 (en) 2014-01-21
US20110052081A1 (en) 2011-03-03

Similar Documents

Publication Publication Date Title
JP5423379B2 (ja) 画像処理装置および画像処理方法、並びにプログラム
US10559111B2 (en) Systems and methods for generating computer ready animation models of a human head from captured data images
US10169905B2 (en) Systems and methods for animating models from audio data
US20240013462A1 (en) Audio-driven facial animation with emotion support using machine learning
US12192619B2 (en) Electronic device and controlling method of electronic device
US10607065B2 (en) Generation of parameterized avatars
US10198845B1 (en) Methods and systems for animating facial expressions
US8692830B2 (en) Automatic avatar creation
US8150205B2 (en) Image processing apparatus, image processing method, program, and data configuration
US8233789B2 (en) Dynamic exposure metering based on face detection
US20180121733A1 (en) Reducing computational overhead via predictions of subjective quality of automated image sequence processing
KR20120005587A (ko) 컴퓨터 시스템에서 얼굴 애니메이션 생성 방법 및 장치
WO2023279713A1 (zh) 特效展示方法、装置、计算机设备、存储介质、计算机程序和计算机程序产品
CN112684881B (zh) 化身面部表情生成系统及化身面部表情生成方法
CN110910479A (zh) 视频处理方法、装置、电子设备及可读存储介质
KR101913811B1 (ko) 얼굴 표현 및 심리 상태 파악과 보상을 위한 얼굴 정보 분석 방법 및 얼굴 정보 분석 장치
USRE50538E1 (en) Automatic avatar creation
CN105303596A (zh) 动作处理装置及动作处理方法
US20250378643A1 (en) Mesh generation using prompts
US20250391112A1 (en) Mesh estimation using head mounted display images
US20250363702A1 (en) Composite avatar
WO2025259492A1 (en) Texture generation using prompts
KR20210153502A (ko) 전자 장치 및 전자 장치의 제어 방법
CN121236242A (zh) 面部动画生成方法、电子设备及可读存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121126

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20121126

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20130801

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20130813

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20131002

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20131029

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20131111

R151 Written notification of patent or utility model registration

Ref document number: 5423379

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees