CN111833418B - 动画交互方法、装置、设备以及存储介质 - Google Patents

动画交互方法、装置、设备以及存储介质 Download PDF

Info

Publication number
CN111833418B
CN111833418B CN202010676929.1A CN202010676929A CN111833418B CN 111833418 B CN111833418 B CN 111833418B CN 202010676929 A CN202010676929 A CN 202010676929A CN 111833418 B CN111833418 B CN 111833418B
Authority
CN
China
Prior art keywords
animation
image
character image
user
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010676929.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN111833418A (zh
Inventor
陈睿智
彭昊天
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202010676929.1A priority Critical patent/CN111833418B/zh
Publication of CN111833418A publication Critical patent/CN111833418A/zh
Priority to KR1020210031673A priority patent/KR102503413B1/ko
Priority to EP21162971.2A priority patent/EP3882860A3/en
Priority to JP2021043207A priority patent/JP2021192222A/ja
Priority to US17/204,345 priority patent/US20210201550A1/en
Application granted granted Critical
Publication of CN111833418B publication Critical patent/CN111833418B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/205—Three-dimensional [3D] animation driven by audio data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/80—Two-dimensional [2D] animation, e.g. using sprites
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/647—Three-dimensional [3D] objects by matching two-dimensional images to three-dimensional objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/63—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for estimating an emotional state

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Graphics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Psychiatry (AREA)
  • Hospice & Palliative Care (AREA)
  • Child & Adolescent Psychology (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
CN202010676929.1A 2020-07-14 2020-07-14 动画交互方法、装置、设备以及存储介质 Active CN111833418B (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN202010676929.1A CN111833418B (zh) 2020-07-14 2020-07-14 动画交互方法、装置、设备以及存储介质
KR1020210031673A KR102503413B1 (ko) 2020-07-14 2021-03-10 애니메이션 인터랙션 방법, 장치, 기기 및 저장 매체
EP21162971.2A EP3882860A3 (en) 2020-07-14 2021-03-16 Method, apparatus, device, storage medium and program for animation interaction
JP2021043207A JP2021192222A (ja) 2020-07-14 2021-03-17 動画インタラクティブ方法と装置、電子デバイス、コンピュータ可読記憶媒体、及び、コンピュータプログラム
US17/204,345 US20210201550A1 (en) 2020-07-14 2021-03-17 Method, apparatus, device and storage medium for animation interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010676929.1A CN111833418B (zh) 2020-07-14 2020-07-14 动画交互方法、装置、设备以及存储介质

Publications (2)

Publication Number Publication Date
CN111833418A CN111833418A (zh) 2020-10-27
CN111833418B true CN111833418B (zh) 2024-03-29

Family

ID=72923241

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010676929.1A Active CN111833418B (zh) 2020-07-14 2020-07-14 动画交互方法、装置、设备以及存储介质

Country Status (5)

Country Link
US (1) US20210201550A1 (https=)
EP (1) EP3882860A3 (https=)
JP (1) JP2021192222A (https=)
KR (1) KR102503413B1 (https=)
CN (1) CN111833418B (https=)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116235208A (zh) * 2020-07-22 2023-06-06 安尼派恩有限公司 用于制作动画的方法、系统及非暂时性计算机可读记录介质
CN112435313A (zh) * 2020-11-10 2021-03-02 北京百度网讯科技有限公司 播放帧动画的方法、装置、电子设备及可读存储介质
CN112328088B (zh) * 2020-11-23 2023-08-04 北京百度网讯科技有限公司 图像的呈现方法和装置
CN112508161A (zh) * 2020-11-26 2021-03-16 珠海格力电器股份有限公司 陪伴数字替身的控制方法、系统和存储介质
CN112527105B (zh) * 2020-11-27 2023-07-21 北京百度网讯科技有限公司 人机互动方法、装置、电子设备及存储介质
CN112527115B (zh) * 2020-12-15 2023-08-04 北京百度网讯科技有限公司 用户形象生成方法、相关装置及计算机程序产品
CN113014471B (zh) * 2021-01-18 2022-08-19 腾讯科技（深圳）有限公司 会话处理方法，装置、终端和存储介质
CN112799575A (zh) * 2021-01-20 2021-05-14 深圳市金大智能创新科技有限公司 一种基于智能音箱的语音交互方法、智能音箱及智能终端
CN113050794A (zh) * 2021-03-24 2021-06-29 北京百度网讯科技有限公司 用于虚拟形象的滑块处理方法及装置
CN113240781A (zh) * 2021-05-20 2021-08-10 东营友帮建安有限公司 基于语音驱动及图像识别的影视动画制作方法、系统
CN113593013A (zh) * 2021-07-21 2021-11-02 吴浩诚 基于vr逝者仿真的交互方法、系统、终端及vr设备
CN113744374B (zh) * 2021-09-03 2023-09-22 浙江大学 一种基于表情驱动的3d虚拟形象生成方法
CN114140560B (zh) * 2021-11-26 2025-06-20 乐融致新电子科技(天津)有限公司 动画生成方法、装置、设备和存储介质
CN114201043A (zh) * 2021-12-09 2022-03-18 北京百度网讯科技有限公司 内容交互的方法、装置、设备和介质
CN114445528B (zh) * 2021-12-15 2022-11-11 北京百度网讯科技有限公司 虚拟形象生成方法、装置、电子设备及存储介质
CN114422740A (zh) * 2021-12-25 2022-04-29 在秀网络科技(深圳)有限公司 一种用于即时通讯及视频的虚似场景互动方法与系统
CN114760431A (zh) * 2022-04-14 2022-07-15 京东科技信息技术有限公司 视频通话的画面处理方法及装置、存储介质及电子设备
CN114972589B (zh) * 2022-05-31 2024-11-26 北京百度网讯科技有限公司 虚拟数字形象的驱动方法及其装置
CN115116468A (zh) * 2022-06-16 2022-09-27 虹软科技股份有限公司 一种视频生成方法、装置、存储介质及电子设备
CN115686194A (zh) * 2022-09-09 2023-02-03 张俊卿 一种虚拟影像实时可视化及交互的方法、系统及装置
CN115601485B (zh) * 2022-12-15 2023-04-07 阿里巴巴（中国）有限公司 任务处理模型的数据处理方法及虚拟人物动画生成方法
CN116708905A (zh) * 2023-08-07 2023-09-05 海马云（天津）信息技术有限公司 在电视盒子上实现数字人交互的方法和装置
US12543985B2 (en) * 2023-08-15 2026-02-10 Disney Enterprises, Inc. Enhancing emotional accessibility of media content
CN118226954A (zh) * 2024-03-11 2024-06-21 浙江棱镜全息科技有限公司 基于全息显示设备的智能交互系统和方法
CN118113811B (zh) * 2024-03-14 2024-09-27 北京乐开科技有限责任公司 一种基于虚拟形象的人机交互方法及系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108573527A (zh) * 2018-04-18 2018-09-25 腾讯科技（深圳）有限公司 一种表情图片生成方法及其设备、存储介质
CN110189754A (zh) * 2019-05-29 2019-08-30 腾讯科技（深圳）有限公司 语音交互方法、装置、电子设备及存储介质
CN110262665A (zh) * 2019-06-26 2019-09-20 北京百度网讯科技有限公司 用于输出信息的方法和装置
CN110362666A (zh) * 2019-07-09 2019-10-22 邬欣霖 应用虚拟人物的交互处理方法、装置、存储介质和设备
CN110674398A (zh) * 2019-09-05 2020-01-10 深圳追一科技有限公司 虚拟人物形象交互方法、装置、终端设备及存储介质
CN111028330A (zh) * 2019-11-15 2020-04-17 腾讯科技（深圳）有限公司 三维表情基的生成方法、装置、设备及存储介质
CN111145322A (zh) * 2019-12-26 2020-05-12 上海浦东发展银行股份有限公司 用于驱动虚拟形象的方法、设备和计算机可读存储介质
CN111383642A (zh) * 2018-12-27 2020-07-07 Tcl集团股份有限公司 基于神经网络的语音应答方法、存储介质以终端设备

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4917920B2 (ja) * 2007-03-05 2012-04-18 日本放送協会 コンテンツ生成装置及びコンテンツ生成プログラム
JP5423379B2 (ja) * 2009-08-31 2014-02-19 ソニー株式会社 画像処理装置および画像処理方法、並びにプログラム
US20120130717A1 (en) * 2010-11-19 2012-05-24 Microsoft Corporation Real-time Animation for an Expressive Avatar
WO2017137947A1 (en) * 2016-02-10 2017-08-17 Vats Nitin Producing realistic talking face with expression using images text and voice
US10943596B2 (en) * 2016-02-29 2021-03-09 Panasonic Intellectual Property Management Co., Ltd. Audio processing device, image processing device, microphone array system, and audio processing method
US10249089B2 (en) * 2016-08-01 2019-04-02 Dell Products, Lp System and method for representing remote participants to a meeting
JP6683864B1 (ja) * 2019-06-28 2020-04-22 株式会社ドワンゴ コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108573527A (zh) * 2018-04-18 2018-09-25 腾讯科技（深圳）有限公司 一种表情图片生成方法及其设备、存储介质
CN111383642A (zh) * 2018-12-27 2020-07-07 Tcl集团股份有限公司 基于神经网络的语音应答方法、存储介质以终端设备
CN110189754A (zh) * 2019-05-29 2019-08-30 腾讯科技（深圳）有限公司 语音交互方法、装置、电子设备及存储介质
CN110262665A (zh) * 2019-06-26 2019-09-20 北京百度网讯科技有限公司 用于输出信息的方法和装置
CN110362666A (zh) * 2019-07-09 2019-10-22 邬欣霖 应用虚拟人物的交互处理方法、装置、存储介质和设备
CN110674398A (zh) * 2019-09-05 2020-01-10 深圳追一科技有限公司 虚拟人物形象交互方法、装置、终端设备及存储介质
CN111028330A (zh) * 2019-11-15 2020-04-17 腾讯科技（深圳）有限公司 三维表情基的生成方法、装置、设备及存储介质
CN111145322A (zh) * 2019-12-26 2020-05-12 上海浦东发展银行股份有限公司 用于驱动虚拟形象的方法、设备和计算机可读存储介质

Also Published As

Publication number Publication date
EP3882860A2 (en) 2021-09-22
KR20220008735A (ko) 2022-01-21
US20210201550A1 (en) 2021-07-01
KR102503413B1 (ko) 2023-02-23
EP3882860A3 (en) 2021-10-20
CN111833418A (zh) 2020-10-27
JP2021192222A (ja) 2021-12-16

Similar Documents

Publication Publication Date Title
CN111833418B (zh) 动画交互方法、装置、设备以及存储介质
TWI778477B (zh) 互動方法、裝置、電子設備以及儲存媒體
EP3889912B1 (en) Method and apparatus for generating video
JP7592170B2 (ja) ヒューマンコンピュータインタラクション方法、装置、システム、電子機器、コンピュータ可読媒体及びプログラム
CN105190699B (zh) 基于面部运动数据的卡拉ok化身动画
Le et al. Live speech driven head-and-eye motion generators
KR101306221B1 (ko) 3차원 사용자 아바타를 이용한 동영상 제작장치 및 방법
CN112562045B (zh) 生成模型和生成3d动画的方法、装置、设备和存储介质
US20160071024A1 (en) Dynamic hybrid models for multimodal analysis
CN111445561B (zh) 虚拟对象的处理方法、装置、设备及存储介质
CN111862277A (zh) 用于生成动画的方法、装置、设备以及存储介质
CN112667068A (zh) 虚拟人物的驱动方法、装置、设备及存储介质
WO2023284435A1 (zh) 生成动画的方法及装置
CN112634413B (zh) 生成模型和生成3d动画的方法、装置、设备和存储介质
CN114245099B (zh) 视频生成方法、装置、电子设备以及存储介质
CN112330781A (zh) 生成模型和生成人脸动画的方法、装置、设备和存储介质
CN106791032A (zh) 静态图像转换为动态影像的方法和装置
CN111414506A (zh) 基于人工智能情绪处理方法、装置、电子设备及存储介质
CN116775179A (zh) 虚拟对象配置方法、电子设备及计算机可读存储介质
CN117041651A (zh) 弹幕处理方法及相关设备
WO2024066549A1 (zh) 一种数据处理方法及相关设备
Guo et al. Pathway to future symbiotic creativity
CN116740788A (zh) 虚拟人说话视频生成方法、服务器、设备及存储介质
CN111274489B (zh) 信息处理方法、装置、设备及存储介质
CN118250523A (zh) 数字人视频生成方法、装置、存储介质及电子设备

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant