JPWO2020247590A5 - - Google Patents

Download PDF

Info

Publication number
JPWO2020247590A5
JPWO2020247590A5 JP2021569969A JP2021569969A JPWO2020247590A5 JP WO2020247590 A5 JPWO2020247590 A5 JP WO2020247590A5 JP 2021569969 A JP2021569969 A JP 2021569969A JP 2021569969 A JP2021569969 A JP 2021569969A JP WO2020247590 A5 JPWO2020247590 A5 JP WO2020247590A5
Authority
JP
Japan
Prior art keywords
virtual character
user device
information
characteristic
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2021569969A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022534708A5 (https=
JP2022534708A (ja
Publication date
Application filed filed Critical
Priority claimed from PCT/US2020/036068 external-priority patent/WO2020247590A1/en
Publication of JP2022534708A publication Critical patent/JP2022534708A/ja
Publication of JP2022534708A5 publication Critical patent/JP2022534708A5/ja
Publication of JPWO2020247590A5 publication Critical patent/JPWO2020247590A5/ja
Pending legal-status Critical Current

Links

JP2021569969A 2019-06-06 2020-06-04 動的に反応する仮想キャラクターのためのマルチモーダルモデル Pending JP2022534708A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201962858234P 2019-06-06 2019-06-06
US62/858,234 2019-06-06
PCT/US2020/036068 WO2020247590A1 (en) 2019-06-06 2020-06-04 Multi-modal model for dynamically responsive virtual characters

Publications (3)

Publication Number Publication Date
JP2022534708A JP2022534708A (ja) 2022-08-03
JP2022534708A5 JP2022534708A5 (https=) 2023-06-13
JPWO2020247590A5 true JPWO2020247590A5 (https=) 2023-06-13

Family

ID=73652134

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021569969A Pending JP2022534708A (ja) 2019-06-06 2020-06-04 動的に反応する仮想キャラクターのためのマルチモーダルモデル

Country Status (8)

Country Link
US (2) US11501480B2 (https=)
EP (1) EP3980865A4 (https=)
JP (1) JP2022534708A (https=)
KR (1) KR20220039702A (https=)
CN (1) CN114303116A (https=)
AU (1) AU2020287622A1 (https=)
CA (1) CA3137927A1 (https=)
WO (1) WO2020247590A1 (https=)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10242503B2 (en) 2017-01-09 2019-03-26 Snap Inc. Surface aware lens
US11030813B2 (en) 2018-08-30 2021-06-08 Snap Inc. Video clip object tracking
JP7142315B2 (ja) * 2018-09-27 2022-09-27 パナソニックＩｐマネジメント株式会社 説明支援装置および説明支援方法
US11176737B2 (en) 2018-11-27 2021-11-16 Snap Inc. Textured mesh building
CN113330484B (zh) 2018-12-20 2025-08-05 斯纳普公司 虚拟表面修改
US11189098B2 (en) 2019-06-28 2021-11-30 Snap Inc. 3D object camera customization system
KR20210014909A (ko) * 2019-07-31 2021-02-10 삼성전자주식회사 대상의 언어 수준을 식별하는 전자 장치 및 방법
US11232646B2 (en) * 2019-09-06 2022-01-25 Snap Inc. Context-based virtual object rendering
US11227442B1 (en) 2019-12-19 2022-01-18 Snap Inc. 3D captions with semantic graphical elements
US11093691B1 (en) * 2020-02-14 2021-08-17 Capital One Services, Llc System and method for establishing an interactive communication session
US20210375023A1 (en) * 2020-06-01 2021-12-02 Nvidia Corporation Content animation using one or more neural networks
US11763366B1 (en) * 2020-06-04 2023-09-19 Walgreen Co. Automatic initialization of customer assistance based on computer vision analysis
WO2022046674A1 (en) * 2020-08-24 2022-03-03 Sterling Labs Llc Devices and methods for motion planning of computer characters
US11756251B2 (en) * 2020-09-03 2023-09-12 Sony Interactive Entertainment Inc. Facial animation control by automatic generation of facial action units using text and speech
WO2022056151A1 (en) * 2020-09-09 2022-03-17 Colin Brady A system to convert expression input into a complex full body animation, in real time or from recordings, analyzed over time
CN115426553B (zh) * 2021-05-12 2025-01-14 海信集团控股股份有限公司 一种智能音箱及其显示方法
US12296266B2 (en) 2021-07-12 2025-05-13 Emotelogic Llc Digital character with dynamic interactive behavior
CN114201042B (zh) * 2021-11-09 2023-09-15 北京电子工程总体研究所 分布式综合集成研讨厅装置、系统、构建方法及交互方法
KR102701578B1 (ko) * 2021-12-17 2024-09-02 한국전자기술연구원 메타버스 플랫폼에서 신체활동이 어려운 환자의 활동 및 고인의 추억을 기억하기 위한 방법 및 시스템
US12346994B2 (en) 2022-01-11 2025-07-01 Meetkai, Inc Method and system for virtual intelligence user interaction
US12400634B2 (en) * 2022-04-21 2025-08-26 Google Llc Dynamically adapting given assistant output based on a given persona assigned to an automated assistant
CN114782594A (zh) * 2022-04-29 2022-07-22 北京慧夜科技有限公司 一种动画生成方法和系统
CN114995636B (zh) * 2022-05-09 2025-10-17 阿里巴巴（中国）有限公司 多模态交互方法以及装置
KR20230164954A (ko) * 2022-05-26 2023-12-05 한국전자기술연구원 대화형 가상 아바타의 구현 방법
JP2024028023A (ja) * 2022-08-19 2024-03-01 ソニーセミコンダクタソリューションズ株式会社 表情加工装置、表情加工方法および表情加工プログラム
KR102860506B1 (ko) * 2022-12-06 2025-09-16 그루브웍스 주식회사 Ai 기반 인터랙티브 아바타톡 제공 장치 및 방법
WO2024145667A1 (en) * 2022-12-30 2024-07-04 Theai, Inc. Archetype-based generation of artificial intelligence characters
US12002470B1 (en) * 2022-12-31 2024-06-04 Theai, Inc. Multi-source based knowledge data for artificial intelligence characters
WO2024170658A1 (en) * 2023-02-17 2024-08-22 Sony Semiconductor Solutions Corporation Device, method, and computer program to control an avatar
US20240303891A1 (en) * 2023-03-10 2024-09-12 Artie, Inc. Multi-modal model for dynamically responsive virtual characters
US12589309B2 (en) 2023-08-10 2026-03-31 Sony Interactive Entertainment Inc. Tailoring in-game dialogue to player attributes
KR102644550B1 (ko) * 2023-09-27 2024-03-07 셀렉트스타 주식회사 자연어처리모델을 이용한 캐릭터 영상통화 제공방법, 이를 수행하는 컴퓨팅시스템, 및 이를 구현하기 위한 컴퓨터-판독가능 기록매체
US20250124662A1 (en) * 2023-10-17 2025-04-17 Kyndryl, Inc. Preventing harassment on metaverse environments
WO2025089532A1 (en) 2023-10-23 2025-05-01 Samsung Electronics Co., Ltd. Electronic device and method for managing iot devices in a metaverse environment
JP2025077645A (ja) * 2023-11-07 2025-05-19 株式会社リコー 情報処理装置、情報処理方法、プログラム、情報処理システム
US20250182366A1 (en) * 2023-11-30 2025-06-05 Nvidia Corporation Interactive bot animations for interactive systems and applications
JP7632925B1 (ja) 2024-02-22 2025-02-19 デジタルヒューマン株式会社 情報処理システム、情報処理方法及びプログラム
CN118135068B (zh) * 2024-05-07 2024-07-23 深圳威尔视觉科技有限公司 基于虚拟数字人的云互动方法、装置及计算机设备
US12271986B1 (en) * 2024-12-17 2025-04-08 Peakspan Capital Management, Llc Systems and methods for generating an autonomous bot that replicates speech characteristics, visual expressions, and actions of a professional
US12403402B1 (en) * 2025-03-14 2025-09-02 Bitpart AI, Inc. Multi-agent planning system for controlling non-player agents in a game
CN121349460A (zh) * 2025-12-18 2026-01-16 杭州秋果计划科技有限公司 一种基于Web前端的交互方法、系统和电子设备

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6964023B2 (en) * 2001-02-05 2005-11-08 International Business Machines Corporation System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input
US20070015121A1 (en) * 2005-06-02 2007-01-18 University Of Southern California Interactive Foreign Language Teaching
US20070111795A1 (en) * 2005-11-15 2007-05-17 Joon-Hyuk Choi Virtual entity on a network
US8224652B2 (en) 2008-09-26 2012-07-17 Microsoft Corporation Speech and text driven HMM-based body animation synthesis
US9361730B2 (en) * 2012-07-26 2016-06-07 Qualcomm Incorporated Interactions of tangible and augmented reality objects
US9796095B1 (en) * 2012-08-15 2017-10-24 Hanson Robokind And Intelligent Bots, Llc System and method for controlling intelligent animated characters
US20140212854A1 (en) * 2013-01-31 2014-07-31 Sri International Multi-modal modeling of temporal interaction sequences
US9378576B2 (en) * 2013-06-07 2016-06-28 Faceshift Ag Online modeling for real-time facial animation
CN107431635B (zh) * 2015-03-27 2021-10-08 英特尔公司 化身面部表情和/或语音驱动的动画化
WO2017137947A1 (en) * 2016-02-10 2017-08-17 Vats Nitin Producing realistic talking face with expression using images text and voice
US9940932B2 (en) * 2016-03-02 2018-04-10 Wipro Limited System and method for speech-to-text conversion
US10810780B2 (en) * 2017-07-28 2020-10-20 Baobab Studios Inc. Systems and methods for real-time complex character animations and interactivity
CN107765852A (zh) * 2017-10-11 2018-03-06 北京光年无限科技有限公司 基于虚拟人的多模态交互处理方法及系统
CN107797663A (zh) * 2017-10-26 2018-03-13 北京光年无限科技有限公司 基于虚拟人的多模态交互处理方法及系统
EP3752957A4 (en) * 2018-02-15 2021-11-17 DMAI, Inc. SYSTEM AND PROCEDURE FOR SPEECH UNDERSTANDING VIA INTEGRATED AUDIO AND VIDEO-BASED VOICE RECOGNITION
US11062494B2 (en) * 2018-03-06 2021-07-13 Didimo, Inc. Electronic messaging utilizing animatable 3D models
CN108646918A (zh) * 2018-05-10 2018-10-12 北京光年无限科技有限公司 基于虚拟人的视觉交互方法及系统
JP2022500795A (ja) * 2018-07-04 2022-01-04 ウェブ アシスタンツ ゲーエムベーハー アバターアニメーション
US11315325B2 (en) * 2018-10-09 2022-04-26 Magic Leap, Inc. Systems and methods for artificial intelligence-based virtual and augmented reality

Similar Documents

Publication Publication Date Title
JPWO2020247590A5 (https=)
US9754585B2 (en) Crowdsourced, grounded language for intent modeling in conversational interfaces
WO2022170848A1 (zh) 人机交互方法、装置、系统、电子设备以及计算机介质
CN108804698A (zh) 基于人物ip的人机交互方法、系统、介质及设备
KR20190118108A (ko) 전자 장치 및 그의 제어방법
CN116704085B (zh) 虚拟形象生成方法、装置、电子设备和存储介质
CN114694224A (zh) 客服问答方法、装置、设备、存储介质和计算机程序产品
US10692498B2 (en) Question urgency in QA system with visual representation in three dimensional space
CN116010230B (zh) 测试方法、装置、设备、存储介质及产品
CN114073854A (zh) 基于多媒体文件的游戏方法和系统
CN114443889A (zh) 音频获取的方法、装置、电子设备及存储介质
US11762451B2 (en) Methods and apparatus to add common sense reasoning to artificial intelligence in the context of human machine interfaces
WO2022242706A1 (zh) 基于多模态的反应式响应生成
JP2020529680A (ja) 通話中の感情を認識し、認識された感情を活用する方法およびシステム
CN121359143A (zh) 使用机器学习进行媒体内容编辑的技术架构
EP4629232A1 (en) Interaction method and apparatus, device, and storage medium
US20130339849A1 (en) Digital content preparation and presentation
CN113762056A (zh) 演唱视频识别方法、装置、设备及存储介质
CN113038053A (zh) 一种数据合成方法、装置、电子设备以及存储介质
CN115052194B (zh) 学习报告生成方法、装置、电子设备及存储介质
JP7794197B2 (ja) 情報処理システム及び情報処理方法
CN112951013B (zh) 一种学习交互方法、装置、电子设备以及存储介质
CN113901838A (zh) 对话检测方法和装置、电子设备、存储介质
US20240320519A1 (en) Systems and methods for providing a digital human in a virtual environment
CN121002494A (zh) 对应于视频的评论的生成