CN102004897B - 用于处理图像的装置和方法 - Google Patents

用于处理图像的装置和方法 Download PDF

Info

Publication number
CN102004897B
CN102004897B CN2010102420292A CN201010242029A CN102004897B CN 102004897 B CN102004897 B CN 102004897B CN 2010102420292 A CN2010102420292 A CN 2010102420292A CN 201010242029 A CN201010242029 A CN 201010242029A CN 102004897 B CN102004897 B CN 102004897B
Authority
CN
China
Prior art keywords
face
image
parameter
user
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2010102420292A
Other languages
English (en)
Chinese (zh)
Other versions
CN102004897A (zh
Inventor
尾上直之
山下润一
望月大介
小林直树
贝野彰彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN102004897A publication Critical patent/CN102004897A/zh
Application granted granted Critical
Publication of CN102004897B publication Critical patent/CN102004897B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/175—Static expression

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
CN2010102420292A 2009-08-31 2010-07-29 用于处理图像的装置和方法 Expired - Fee Related CN102004897B (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2009201028 2009-08-31
JP2009-201028 2009-08-31
JP2009284807A JP5423379B2 (ja) 2009-08-31 2009-12-16 画像処理装置および画像処理方法、並びにプログラム
JP2009-284807 2009-12-16

Publications (2)

Publication Number Publication Date
CN102004897A CN102004897A (zh) 2011-04-06
CN102004897B true CN102004897B (zh) 2013-11-27

Family

ID=43304648

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010102420292A Expired - Fee Related CN102004897B (zh) 2009-08-31 2010-07-29 用于处理图像的装置和方法

Country Status (4)

Country Link
US (1) US8634658B2 (enExample)
EP (1) EP2293221B1 (enExample)
JP (1) JP5423379B2 (enExample)
CN (1) CN102004897B (enExample)

Families Citing this family (72)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8359642B1 (en) * 2010-06-25 2013-01-22 Sprint Communications Company L.P. Restricting mature content
US20110316697A1 (en) * 2010-06-29 2011-12-29 General Electric Company System and method for monitoring an entity within an area
KR20120011920A (ko) * 2010-07-27 2012-02-09 삼성전자주식회사 디지털 영상 신호 처리 장치, 디지털 영상 신호 처리 방법 및 상기 방법을 기록한 기록 매체
JP2012244526A (ja) * 2011-05-23 2012-12-10 Sony Corp 情報処理装置、情報処理方法及びコンピュータプログラム
US9088426B2 (en) 2011-12-13 2015-07-21 Google Inc. Processing media streams during a multi-user video conference
WO2013097139A1 (en) * 2011-12-29 2013-07-04 Intel Corporation Communication using avatar
US9888171B2 (en) * 2012-02-13 2018-02-06 Htc Corporation Mobile camera device capable of improving facial patterns of a captured image
WO2013138531A1 (en) 2012-03-14 2013-09-19 Google, Inc. Modifying an appearance of a participant during a video conference
JP5880182B2 (ja) * 2012-03-19 2016-03-08 カシオ計算機株式会社 画像生成装置、画像生成方法及びプログラム
US9595298B2 (en) 2012-07-18 2017-03-14 Microsoft Technology Licensing, Llc Transforming data to create layouts
JP2014068107A (ja) * 2012-09-25 2014-04-17 Zenrin Datacom Co Ltd 画像処理装置、画像処理システム、画像処理方法およびコンピュータプログラム
JP6102939B2 (ja) * 2012-11-22 2017-03-29 ソニー株式会社 情報処理装置、システム、情報処理方法およびプログラム
CN103903292B (zh) * 2012-12-27 2017-04-19 北京新媒传信科技有限公司 一种实现头像编辑界面的方法和系统
JP6268722B2 (ja) * 2013-03-06 2018-01-31 日本電気株式会社 表示装置、表示方法、及び、プログラム
WO2014187919A1 (en) * 2013-05-23 2014-11-27 bioMérieux Method, system and computer program product for producing a raised relief map from images of an object
US9202119B2 (en) * 2013-10-18 2015-12-01 Daon Holdings Limited Methods and systems for determining user liveness
US20150317511A1 (en) * 2013-11-07 2015-11-05 Orbeus, Inc. System, method and apparatus for performing facial recognition
CN104657974A (zh) * 2013-11-25 2015-05-27 腾讯科技（上海）有限公司 一种图像处理方法及装置
US9614724B2 (en) 2014-04-21 2017-04-04 Microsoft Technology Licensing, Llc Session-based device configuration
US9639742B2 (en) 2014-04-28 2017-05-02 Microsoft Technology Licensing, Llc Creation of representative content based on facial analysis
US9773156B2 (en) * 2014-04-29 2017-09-26 Microsoft Technology Licensing, Llc Grouping and ranking images based on facial recognition data
US10111099B2 (en) 2014-05-12 2018-10-23 Microsoft Technology Licensing, Llc Distributing content in managed wireless distribution networks
US9874914B2 (en) 2014-05-19 2018-01-23 Microsoft Technology Licensing, Llc Power management contracts for accessory devices
US10037202B2 (en) 2014-06-03 2018-07-31 Microsoft Technology Licensing, Llc Techniques to isolating a portion of an online computing service
US9460493B2 (en) 2014-06-14 2016-10-04 Microsoft Technology Licensing, Llc Automatic video quality enhancement with temporal smoothing and user override
US9717006B2 (en) 2014-06-23 2017-07-25 Microsoft Technology Licensing, Llc Device quarantine in a wireless network
US9373179B2 (en) 2014-06-23 2016-06-21 Microsoft Technology Licensing, Llc Saliency-preserving distinctive low-footprint photograph aging effect
JP6476608B2 (ja) * 2014-06-30 2019-03-06 カシオ計算機株式会社 動作処理装置、動作処理方法及びプログラム
US9444999B2 (en) * 2014-08-05 2016-09-13 Omnivision Technologies, Inc. Feature detection in image capture
US10282069B2 (en) 2014-09-30 2019-05-07 Microsoft Technology Licensing, Llc Dynamic presentation of suggested content
US9626768B2 (en) * 2014-09-30 2017-04-18 Microsoft Technology Licensing, Llc Optimizing a visual perspective of media
US20180025175A1 (en) 2015-01-15 2018-01-25 Nec Corporation Information output device, camera, information output system, information output method, and program
DE102015223175A1 (de) * 2015-11-24 2017-05-24 Conti Temic Microelectronic Gmbh Fahrerassistenzsystem mit adaptiver Umgebungsbilddatenverarbeitung
WO2017137952A1 (en) * 2016-02-10 2017-08-17 Vats Nitin Intelligent chatting on digital communication network
JP6794144B2 (ja) * 2016-06-03 2020-12-02 東芝テック株式会社 操作入力装置、販売データ処理装置及びプログラム
US10452896B1 (en) * 2016-09-06 2019-10-22 Apple Inc. Technique for creating avatar from image data
DK179978B1 (en) 2016-09-23 2019-11-27 Apple Inc. IMAGE DATA FOR ENHANCED USER INTERACTIONS
JP2018055619A (ja) * 2016-09-30 2018-04-05 株式会社ブイシンク 画像表示装置
JP6266736B1 (ja) * 2016-12-07 2018-01-24 株式会社コロプラ 仮想空間を介して通信するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
CN108268227B (zh) * 2017-01-04 2020-12-01 京东方科技集团股份有限公司 显示设备
US11010947B2 (en) 2017-01-23 2021-05-18 Ntt Docomo, Inc. Information processing system and information processing apparatus
US10380228B2 (en) 2017-02-10 2019-08-13 Microsoft Technology Licensing, Llc Output generation based on semantic expressions
KR102798516B1 (ko) 2017-05-16 2025-04-23 애플 인크. 이모지 레코딩 및 전송
KR101966384B1 (ko) * 2017-06-29 2019-08-13 라인 가부시키가이샤 영상 처리 방법 및 시스템
US10870056B2 (en) * 2017-11-01 2020-12-22 Sony Interactive Entertainment Inc. Emoji-based communications derived from facial features during game play
US11068141B1 (en) * 2018-02-02 2021-07-20 Snap Inc. Device-based image modification of depicted objects
JP7279646B2 (ja) * 2018-02-07 2023-05-23 ソニーグループ株式会社 情報処理装置、情報処理方法及びプログラム
KR102661019B1 (ko) 2018-02-23 2024-04-26 삼성전자주식회사 얼굴에 대응하는 3차원 아바타를 이용하여 얼굴의 움직임이 반영된 3차원 아바타를 포함하는 이미지를 생성하는 전자 장치 및 그 동작 방법
JP2019164614A (ja) * 2018-03-20 2019-09-26 株式会社ＶｉＲＤ アバター制御プログラム
JP6941800B2 (ja) 2018-04-04 2021-09-29 パナソニックＩｐマネジメント株式会社 感情推定装置、感情推定方法及びプログラム
DK201870374A1 (en) 2018-05-07 2019-12-04 Apple Inc. AVATAR CREATION USER INTERFACE
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
KR102530264B1 (ko) * 2018-08-08 2023-05-09 삼성전자 주식회사 아바타에 대응하는 속성에 따른 아이템을 제공하는 방법 및 장치
CN109447894A (zh) * 2018-08-20 2019-03-08 广州市久邦数码科技有限公司 一种基于数据分析的图像处理方法及其系统
CN111079479A (zh) 2018-10-19 2020-04-28 北京市商汤科技开发有限公司 小孩状态分析方法和装置、车辆、电子设备、存储介质
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
CN111488759A (zh) * 2019-01-25 2020-08-04 北京字节跳动网络技术有限公司 动物脸部的图像处理方法和装置
KR102664688B1 (ko) 2019-02-19 2024-05-10 삼성전자 주식회사 가상 캐릭터 기반 촬영 모드를 제공하는 전자 장치 및 이의 동작 방법
JP7295388B2 (ja) * 2019-03-08 2023-06-21 フリュー株式会社 画像処理装置、画像処理方法及び画像処理プログラム
EP3942544A1 (en) * 2019-03-22 2022-01-26 Essilor International Device for simulating a physiological behaviour of a mammal using a virtual mammal, process and computer program
DK201970531A1 (en) 2019-05-06 2021-07-09 Apple Inc Avatar integration with multiple applications
CN110674765A (zh) * 2019-09-27 2020-01-10 上海依图网络科技有限公司 摄像系统以及视频处理方法
JP7319172B2 (ja) * 2019-11-13 2023-08-01 富士フイルム株式会社 画像処理装置、画像処理方法及び画像処理システム
CN111698552A (zh) * 2020-05-15 2020-09-22 完美世界(北京)软件科技发展有限公司 一种视频资源的生成方法和装置
KR20250130851A (ko) 2020-06-08 2025-09-02 애플 인크. 3차원 환경들에서 아바타들의 제시
CN111833418B (zh) * 2020-07-14 2024-03-29 北京百度网讯科技有限公司 动画交互方法、装置、设备以及存储介质
CN112001932B (zh) * 2020-09-01 2023-10-31 腾讯科技（深圳）有限公司 人脸识别方法、装置、计算机设备和存储介质
US11438551B2 (en) * 2020-09-15 2022-09-06 At&T Intellectual Property I, L.P. Virtual audience using low bitrate avatars and laughter detection
JP7217838B2 (ja) * 2020-09-24 2023-02-03 三菱電機株式会社 開口度算出装置
JP7613906B2 (ja) * 2020-12-18 2025-01-15 トヨタ自動車株式会社 画像処理システム
US12310663B2 (en) * 2021-06-10 2025-05-27 EyesMatch Ltd. System and method for digital optician measurements
KR102826023B1 (ko) * 2022-11-30 2025-06-27 주식회사 케이티 음성 데이터에 기초하여 얼굴 이미지를 생성하는 장치, 방법 및 컴퓨터 프로그램

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7257239B2 (en) * 2001-09-28 2007-08-14 Canon Kabushiki Kaisha Method and apparatus for generating models of individuals
US7433490B2 (en) * 2002-12-21 2008-10-07 Microsoft Corp System and method for real time lip synchronization

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6332123B1 (en) * 1989-03-08 2001-12-18 Kokusai Denshin Denwa Kabushiki Kaisha Mouth shape synthesizing
JPH0744727A (ja) 1993-07-27 1995-02-14 Sony Corp 画像作成方法およびその装置
JP2000306095A (ja) * 1999-04-16 2000-11-02 Fujitsu Ltd 画像照合・検索システム
IT1320002B1 (it) * 2000-03-31 2003-11-12 Cselt Centro Studi Lab Telecom Procedimento per l'animazione di un modello sintetizzato di voltoumano pilotata da un segnale audio.
JP2002108382A (ja) * 2000-09-27 2002-04-10 Sony Corp リップシンクを行うアニメーション方法および装置
JP2002232783A (ja) 2001-02-06 2002-08-16 Sony Corp 画像処理装置および画像処理方法、並びにプログラム記憶媒体
US20030007700A1 (en) * 2001-07-03 2003-01-09 Koninklijke Philips Electronics N.V. Method and apparatus for interleaving a user image in an original image sequence
JP3822828B2 (ja) * 2002-03-20 2006-09-20 沖電気工業株式会社 ３次元画像生成装置およびその画像生成方法ならびにその画像生成プログラムを記録したコンピュータ読取り可能な記録媒体
JP2003308533A (ja) * 2002-04-17 2003-10-31 Mitsubishi Electric Corp ドライバの顔画像処理装置
US7711155B1 (en) * 2003-04-14 2010-05-04 Videomining Corporation Method and system for enhancing three dimensional face modeling using demographic classification
EP1653279B1 (en) * 2003-07-15 2019-02-06 Omron Corporation Object decision device and imaging device
JP4517633B2 (ja) 2003-11-25 2010-08-04 ソニー株式会社 対象物検出装置及び方法
JP4482796B2 (ja) 2004-03-26 2010-06-16 ソニー株式会社 情報処理装置および方法、記録媒体、並びにプログラム
JP2006064973A (ja) * 2004-08-26 2006-03-09 Crimson Technology Inc 制御システム
US7634106B2 (en) * 2004-09-22 2009-12-15 Fujifilm Corporation Synthesized image generation method, synthesized image generation apparatus, and synthesized image generation program
DE602006009191D1 (de) * 2005-07-26 2009-10-29 Canon Kk Bildaufnahmegerät und -verfahren
US20070080967A1 (en) * 2005-10-11 2007-04-12 Animetrics Inc. Generation of normalized 2D imagery and ID systems via 2D to 3D lifting of multifeatured objects
US7728866B2 (en) * 2005-11-03 2010-06-01 Broadcom Corp. Video telephony image processing
JP2007156650A (ja) 2005-12-01 2007-06-21 Sony Corp 画像処理装置
JP2007213182A (ja) * 2006-02-08 2007-08-23 Fujifilm Corp 対象物状態認識方法および装置並びにプログラム
JP4093273B2 (ja) * 2006-03-13 2008-06-04 オムロン株式会社 特徴点検出装置、特徴点検出方法および特徴点検出プログラム
JP2008021266A (ja) * 2006-07-14 2008-01-31 Matsushita Electric Ind Co Ltd 顔向き検出装置、顔向き検出方法、および顔向き検出プログラム
JP4424364B2 (ja) * 2007-03-19 2010-03-03 ソニー株式会社 画像処理装置、画像処理方法
JP4569670B2 (ja) * 2008-06-11 2010-10-27 ソニー株式会社 画像処理装置、画像処理方法およびプログラム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7257239B2 (en) * 2001-09-28 2007-08-14 Canon Kabushiki Kaisha Method and apparatus for generating models of individuals
US7433490B2 (en) * 2002-12-21 2008-10-07 Microsoft Corp System and method for real time lip synchronization

Also Published As

Publication number Publication date
US8634658B2 (en) 2014-01-21
JP2011070623A (ja) 2011-04-07
EP2293221A3 (en) 2014-04-23
EP2293221B1 (en) 2018-11-28
EP2293221A2 (en) 2011-03-09
JP5423379B2 (ja) 2014-02-19
CN102004897A (zh) 2011-04-06
US20110052081A1 (en) 2011-03-03

Similar Documents

Publication Publication Date Title
CN102004897B (zh) 用于处理图像的装置和方法
US10559111B2 (en) Systems and methods for generating computer ready animation models of a human head from captured data images
US10169905B2 (en) Systems and methods for animating models from audio data
US8692830B2 (en) Automatic avatar creation
Chuang et al. Mood swings: expressive speech animation
CN114863533B (zh) 数字人生成方法和装置及存储介质
JP7642253B2 (ja) コンピュータプログラム、サーバ装置、端末装置及び表示方法
CN113449590B (zh) 说话视频生成方法及装置
CN110910479B (zh) 视频处理方法、装置、电子设备及可读存储介质
KR20120005587A (ko) 컴퓨터 시스템에서 얼굴 애니메이션 생성 방법 및 장치
JP2011159329A (ja) 自動３ｄモデリングシステム及び方法
CN101401129B (zh) 用于创建脸部动画的方法和设备
USRE50538E1 (en) Automatic avatar creation
Mattos et al. Multi-view mouth renderization for assisting lip-reading
Theobald et al. Relating objective and subjective performance measures for aam-based visual speech synthesis
JP6476608B2 (ja) 動作処理装置、動作処理方法及びプログラム
Hwang et al. Audio-driven facial animation: A survey
Chung et al. Audio2Face-3D: Audio-driven Realistic Facial Animation For Digital Avatars
JP4459415B2 (ja) 画像処理装置、画像処理方法およびコンピュータ読み取り可能な情報記憶媒体
JP5529299B2 (ja) 顔の口をアニメーション化するコンピュータ実施方法及び装置
Sundararaman et al. Seeing Voices: Generating A-Roll Video from Audio with Mirage
Yang et al. Speech-Driven 3D Facial Animation with Regional Attention for Style Capture
CN121078290A (zh) 虚拟人视频生成方法、装置、电子设备及介质
CN118212355A (zh) 一种三维人脸分数预测及美化方法
Kalberer et al. Modeling and synthesis of realistic visual speech in 3d

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20131127

Termination date: 20150729

EXPY Termination of patent right or utility model