JP4037455B2 - 画像合成 - Google Patents

画像合成 Download PDF

Info

Publication number
JP4037455B2
JP4037455B2 JP53413797A JP53413797A JP4037455B2 JP 4037455 B2 JP4037455 B2 JP 4037455B2 JP 53413797 A JP53413797 A JP 53413797A JP 53413797 A JP53413797 A JP 53413797A JP 4037455 B2 JP4037455 B2 JP 4037455B2
Authority
JP
Japan
Prior art keywords
vowel
consonant
phoneme
mouth shape
transition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP53413797A
Other languages
English (en)
Japanese (ja)
Other versions
JP2000507377A (ja
JP2000507377A5 (https=
Inventor
ブリーン、アンドリュー・ポール
ボウアーズ、エマ・ジェーン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
British Telecommunications PLC
Original Assignee
British Telecommunications PLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by British Telecommunications PLC filed Critical British Telecommunications PLC
Publication of JP2000507377A publication Critical patent/JP2000507377A/ja
Publication of JP2000507377A5 publication Critical patent/JP2000507377A5/ja
Application granted granted Critical
Publication of JP4037455B2 publication Critical patent/JP4037455B2/ja
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/20—Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/205—Three-dimensional [3D] animation driven by audio data
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Processing Or Creating Images (AREA)
JP53413797A 1996-03-26 1997-03-24 画像合成 Expired - Fee Related JP4037455B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP96302060.7 1996-03-26
EP96302060 1996-03-26
PCT/GB1997/000818 WO1997036288A1 (en) 1996-03-26 1997-03-24 Image synthesis

Publications (3)

Publication Number Publication Date
JP2000507377A JP2000507377A (ja) 2000-06-13
JP2000507377A5 JP2000507377A5 (https=) 2004-11-25
JP4037455B2 true JP4037455B2 (ja) 2008-01-23

Family

ID=8224860

Family Applications (1)

Application Number Title Priority Date Filing Date
JP53413797A Expired - Fee Related JP4037455B2 (ja) 1996-03-26 1997-03-24 画像合成

Country Status (8)

Country Link
EP (1) EP0890168B1 (https=)
JP (1) JP4037455B2 (https=)
KR (1) KR20000005183A (https=)
CN (1) CN1214784A (https=)
AU (1) AU2167097A (https=)
CA (1) CA2249016C (https=)
DE (1) DE69715175T2 (https=)
WO (1) WO1997036288A1 (https=)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2346527B (en) * 1997-07-25 2001-02-14 Motorola Inc Virtual actor with set of speaker profiles
AU2998099A (en) * 1998-03-11 1999-09-27 Entropic, Inc. Face synthesis system and methodology
WO1999046732A1 (fr) * 1998-03-11 1999-09-16 Mitsubishi Denki Kabushiki Kaisha Dispositif de generation d'images en mouvement et dispositif d'apprentissage via reseau de controle d'images
IT1314671B1 (it) * 1998-10-07 2002-12-31 Cselt Centro Studi Lab Telecom Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.
SG87837A1 (en) 1998-10-08 2002-04-16 Sony Computer Entertainment Inc Portable toy, portable information terminal, intertainment system, and recording medium
KR20010072936A (ko) * 1999-06-24 2001-07-31 요트.게.아. 롤페즈 정보 스트림의 포스트-동기화
KR100395491B1 (ko) * 1999-08-16 2003-08-25 한국전자통신연구원 아바타 기반 음성 언어 번역 시스템에서의 화상 통신 방법
US6766299B1 (en) * 1999-12-20 2004-07-20 Thrillionaire Productions, Inc. Speech-controlled animation system
GB0008537D0 (en) 2000-04-06 2000-05-24 Ananova Ltd Character animation
GB0030148D0 (en) * 2000-12-11 2001-01-24 20 20 Speech Ltd Audio and video synthesis method and system
JP4067762B2 (ja) 2000-12-28 2008-03-26 ヤマハ株式会社 歌唱合成装置
US6661418B1 (en) 2001-01-22 2003-12-09 Digital Animations Limited Character animation system
DE10214431B4 (de) * 2002-03-30 2005-11-10 Ralf Dringenberg Verfahren und Vorrichtung zur Visualisierung von Audiodaten
KR100754430B1 (ko) * 2004-10-08 2007-08-31 비쥬텍쓰리디(주) 음성 기반 자동 립싱크 애니메이션 장치와 방법 및 기록매체
CN1991982A (zh) * 2005-12-29 2007-07-04 摩托罗拉公司 一种使用语音数据激励图像的方法
GB2468140A (en) 2009-02-26 2010-09-01 Dublin Inst Of Technology A character animation tool which associates stress values with the locations of vowels
JP2018091954A (ja) * 2016-12-01 2018-06-14 オリンパス株式会社 音声認識装置、及び音声認識方法
CN108847234B (zh) * 2018-06-28 2020-10-30 广州华多网络科技有限公司 唇语合成方法、装置、电子设备及存储介质
CN111260761B (zh) * 2020-01-15 2023-05-09 北京猿力未来科技有限公司 一种生成动画人物口型的方法及装置
AU2021204758A1 (en) * 2020-11-20 2022-06-16 Soul Machines Autonomous animation in embodied agents
CN113205797B (zh) * 2021-04-30 2024-03-05 平安科技（深圳）有限公司 虚拟主播生成方法、装置、计算机设备及可读存储介质

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4913539A (en) * 1988-04-04 1990-04-03 New York Institute Of Technology Apparatus and method for lip-synching animation
JP2518683B2 (ja) * 1989-03-08 1996-07-24 国際電信電話株式会社 画像合成方法及びその装置
US5313522A (en) * 1991-08-23 1994-05-17 Slager Robert P Apparatus for generating from an audio signal a moving visual lip image from which a speech content of the signal can be comprehended by a lipreader
US5608839A (en) * 1994-03-18 1997-03-04 Lucent Technologies Inc. Sound-synchronized video system

Also Published As

Publication number Publication date
DE69715175T2 (de) 2003-05-15
CN1214784A (zh) 1999-04-21
KR20000005183A (ko) 2000-01-25
DE69715175D1 (de) 2002-10-10
JP2000507377A (ja) 2000-06-13
EP0890168B1 (en) 2002-09-04
CA2249016A1 (en) 1997-10-02
AU2167097A (en) 1997-10-17
EP0890168A1 (en) 1999-01-13
CA2249016C (en) 2002-12-03
WO1997036288A1 (en) 1997-10-02

Similar Documents

Publication Publication Date Title
JP4037455B2 (ja) 画像合成
US6208356B1 (en) Image synthesis
Ezzat et al. Miketalk: A talking facial display based on morphing visemes
US6250928B1 (en) Talking facial display method and apparatus
JP2518683B2 (ja) 画像合成方法及びその装置
CN112734889A (zh) 一种2d角色的口型动画实时驱动方法和系统
KR100300962B1 (ko) 음성합성을위한립싱크방법및그장치
KR101089184B1 (ko) 캐릭터의 발화와 감정표현 제공 시스템 및 방법
US6839672B1 (en) Integration of talking heads and text-to-speech synthesizers for visual TTS
Cosatto et al. Audio-visual unit selection for the synthesis of photo-realistic talking-heads
Ezzat et al. Videorealistic talking faces: a morphing approach.
Breen et al. An investigation into the generation of mouth shapes for a talking head
KR20080018408A (ko) 음성 사운드 소스를 이용한 얼굴 표정 변화 프로그램을기록한 컴퓨터에서 읽을 수 있는 기록매체
JP2003058908A (ja) 顔画像制御方法および装置、コンピュータプログラム、および記録媒体
JPH06162167A (ja) 合成画像表示システム
EP0982684A1 (en) Moving picture generating device and image control network learning device
JP4631077B2 (ja) アニメーション作成装置
JP3298076B2 (ja) 画像作成装置
EP0960389B1 (en) A method and apparatus for synchronizing a computer-animated model with an audio wave output
Morishima et al. A facial image synthesis system for human-machine interface
Morishima et al. Facial expression synthesis based on natural voice for virtual face-to-face communication with machine
Morishima et al. Image synthesis and editing system for a multi-media human interface with speaking head
CN121236244A (zh) 一种基于文本驱动的三维说话人面部动画生成方法
JP3830200B2 (ja) 人物画像合成装置
JPH09265253A (ja) 口唇アニメーション合成方法及び装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20040220

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20040220

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070213

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20070514

A602 Written permission of extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A602

Effective date: 20070625

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070813

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20071002

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20071101

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101109

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111109

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111109

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121109

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20121109

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131109

Year of fee payment: 6

LAPS Cancellation because of no payment of annual fees