JP2022534708A5 - - Google Patents
Info
- Publication number
- JP2022534708A5 JP2022534708A5 JP2021569969A JP2021569969A JP2022534708A5 JP 2022534708 A5 JP2022534708 A5 JP 2022534708A5 JP 2021569969 A JP2021569969 A JP 2021569969A JP 2021569969 A JP2021569969 A JP 2021569969A JP 2022534708 A5 JP2022534708 A5 JP 2022534708A5
- Authority
- JP
- Japan
Links
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201962858234P | 2019-06-06 | 2019-06-06 | |
| US62/858,234 | 2019-06-06 | ||
| PCT/US2020/036068 WO2020247590A1 (en) | 2019-06-06 | 2020-06-04 | Multi-modal model for dynamically responsive virtual characters |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| JP2022534708A JP2022534708A (ja) | 2022-08-03 |
| JP2022534708A5 true JP2022534708A5 (https=) | 2023-06-13 |
| JPWO2020247590A5 JPWO2020247590A5 (https=) | 2023-06-13 |
Family
ID=73652134
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2021569969A Pending JP2022534708A (ja) | 2019-06-06 | 2020-06-04 | 動的に反応する仮想キャラクターのためのマルチモーダルモデル |
Country Status (8)
| Country | Link |
|---|---|
| US (2) | US11501480B2 (https=) |
| EP (1) | EP3980865A4 (https=) |
| JP (1) | JP2022534708A (https=) |
| KR (1) | KR20220039702A (https=) |
| CN (1) | CN114303116A (https=) |
| AU (1) | AU2020287622A1 (https=) |
| CA (1) | CA3137927A1 (https=) |
| WO (1) | WO2020247590A1 (https=) |
Families Citing this family (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10242503B2 (en) | 2017-01-09 | 2019-03-26 | Snap Inc. | Surface aware lens |
| US11030813B2 (en) | 2018-08-30 | 2021-06-08 | Snap Inc. | Video clip object tracking |
| JP7142315B2 (ja) * | 2018-09-27 | 2022-09-27 | パナソニックＩｐマネジメント株式会社 | 説明支援装置および説明支援方法 |
| US11176737B2 (en) | 2018-11-27 | 2021-11-16 | Snap Inc. | Textured mesh building |
| CN113330484B (zh) | 2018-12-20 | 2025-08-05 | 斯纳普公司 | 虚拟表面修改 |
| US11189098B2 (en) | 2019-06-28 | 2021-11-30 | Snap Inc. | 3D object camera customization system |
| KR20210014909A (ko) * | 2019-07-31 | 2021-02-10 | 삼성전자주식회사 | 대상의 언어 수준을 식별하는 전자 장치 및 방법 |
| US11232646B2 (en) * | 2019-09-06 | 2022-01-25 | Snap Inc. | Context-based virtual object rendering |
| US11227442B1 (en) | 2019-12-19 | 2022-01-18 | Snap Inc. | 3D captions with semantic graphical elements |
| US11093691B1 (en) * | 2020-02-14 | 2021-08-17 | Capital One Services, Llc | System and method for establishing an interactive communication session |
| US20210375023A1 (en) * | 2020-06-01 | 2021-12-02 | Nvidia Corporation | Content animation using one or more neural networks |
| US11763366B1 (en) * | 2020-06-04 | 2023-09-19 | Walgreen Co. | Automatic initialization of customer assistance based on computer vision analysis |
| WO2022046674A1 (en) * | 2020-08-24 | 2022-03-03 | Sterling Labs Llc | Devices and methods for motion planning of computer characters |
| US11756251B2 (en) * | 2020-09-03 | 2023-09-12 | Sony Interactive Entertainment Inc. | Facial animation control by automatic generation of facial action units using text and speech |
| WO2022056151A1 (en) * | 2020-09-09 | 2022-03-17 | Colin Brady | A system to convert expression input into a complex full body animation, in real time or from recordings, analyzed over time |
| CN115426553B (zh) * | 2021-05-12 | 2025-01-14 | 海信集团控股股份有限公司 | 一种智能音箱及其显示方法 |
| US12296266B2 (en) | 2021-07-12 | 2025-05-13 | Emotelogic Llc | Digital character with dynamic interactive behavior |
| CN114201042B (zh) * | 2021-11-09 | 2023-09-15 | 北京电子工程总体研究所 | 分布式综合集成研讨厅装置、系统、构建方法及交互方法 |
| KR102701578B1 (ko) * | 2021-12-17 | 2024-09-02 | 한국전자기술연구원 | 메타버스 플랫폼에서 신체활동이 어려운 환자의 활동 및 고인의 추억을 기억하기 위한 방법 및 시스템 |
| US12346994B2 (en) | 2022-01-11 | 2025-07-01 | Meetkai, Inc | Method and system for virtual intelligence user interaction |
| US12400634B2 (en) * | 2022-04-21 | 2025-08-26 | Google Llc | Dynamically adapting given assistant output based on a given persona assigned to an automated assistant |
| CN114782594A (zh) * | 2022-04-29 | 2022-07-22 | 北京慧夜科技有限公司 | 一种动画生成方法和系统 |
| CN114995636B (zh) * | 2022-05-09 | 2025-10-17 | 阿里巴巴（中国）有限公司 | 多模态交互方法以及装置 |
| KR20230164954A (ko) * | 2022-05-26 | 2023-12-05 | 한국전자기술연구원 | 대화형 가상 아바타의 구현 방법 |
| JP2024028023A (ja) * | 2022-08-19 | 2024-03-01 | ソニーセミコンダクタソリューションズ株式会社 | 表情加工装置、表情加工方法および表情加工プログラム |
| KR102860506B1 (ko) * | 2022-12-06 | 2025-09-16 | 그루브웍스 주식회사 | Ai 기반 인터랙티브 아바타톡 제공 장치 및 방법 |
| WO2024145667A1 (en) * | 2022-12-30 | 2024-07-04 | Theai, Inc. | Archetype-based generation of artificial intelligence characters |
| US12002470B1 (en) * | 2022-12-31 | 2024-06-04 | Theai, Inc. | Multi-source based knowledge data for artificial intelligence characters |
| WO2024170658A1 (en) * | 2023-02-17 | 2024-08-22 | Sony Semiconductor Solutions Corporation | Device, method, and computer program to control an avatar |
| US20240303891A1 (en) * | 2023-03-10 | 2024-09-12 | Artie, Inc. | Multi-modal model for dynamically responsive virtual characters |
| US12589309B2 (en) | 2023-08-10 | 2026-03-31 | Sony Interactive Entertainment Inc. | Tailoring in-game dialogue to player attributes |
| KR102644550B1 (ko) * | 2023-09-27 | 2024-03-07 | 셀렉트스타 주식회사 | 자연어처리모델을 이용한 캐릭터 영상통화 제공방법, 이를 수행하는 컴퓨팅시스템, 및 이를 구현하기 위한 컴퓨터-판독가능 기록매체 |
| US20250124662A1 (en) * | 2023-10-17 | 2025-04-17 | Kyndryl, Inc. | Preventing harassment on metaverse environments |
| WO2025089532A1 (en) | 2023-10-23 | 2025-05-01 | Samsung Electronics Co., Ltd. | Electronic device and method for managing iot devices in a metaverse environment |
| JP2025077645A (ja) * | 2023-11-07 | 2025-05-19 | 株式会社リコー | 情報処理装置、情報処理方法、プログラム、情報処理システム |
| US20250182366A1 (en) * | 2023-11-30 | 2025-06-05 | Nvidia Corporation | Interactive bot animations for interactive systems and applications |
| JP7632925B1 (ja) | 2024-02-22 | 2025-02-19 | デジタルヒューマン株式会社 | 情報処理システム、情報処理方法及びプログラム |
| CN118135068B (zh) * | 2024-05-07 | 2024-07-23 | 深圳威尔视觉科技有限公司 | 基于虚拟数字人的云互动方法、装置及计算机设备 |
| US12271986B1 (en) * | 2024-12-17 | 2025-04-08 | Peakspan Capital Management, Llc | Systems and methods for generating an autonomous bot that replicates speech characteristics, visual expressions, and actions of a professional |
| US12403402B1 (en) * | 2025-03-14 | 2025-09-02 | Bitpart AI, Inc. | Multi-agent planning system for controlling non-player agents in a game |
| CN121349460A (zh) * | 2025-12-18 | 2026-01-16 | 杭州秋果计划科技有限公司 | 一种基于Web前端的交互方法、系统和电子设备 |
Family Cites Families (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6570555B1 (en) * | 1998-12-30 | 2003-05-27 | Fuji Xerox Co., Ltd. | Method and apparatus for embodied conversational characters with multimodal input/output in an interface device |
| US6964023B2 (en) * | 2001-02-05 | 2005-11-08 | International Business Machines Corporation | System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input |
| US20070015121A1 (en) * | 2005-06-02 | 2007-01-18 | University Of Southern California | Interactive Foreign Language Teaching |
| US20070111795A1 (en) * | 2005-11-15 | 2007-05-17 | Joon-Hyuk Choi | Virtual entity on a network |
| US8224652B2 (en) | 2008-09-26 | 2012-07-17 | Microsoft Corporation | Speech and text driven HMM-based body animation synthesis |
| US9361730B2 (en) * | 2012-07-26 | 2016-06-07 | Qualcomm Incorporated | Interactions of tangible and augmented reality objects |
| US9796095B1 (en) * | 2012-08-15 | 2017-10-24 | Hanson Robokind And Intelligent Bots, Llc | System and method for controlling intelligent animated characters |
| US20140212854A1 (en) * | 2013-01-31 | 2014-07-31 | Sri International | Multi-modal modeling of temporal interaction sequences |
| US9378576B2 (en) * | 2013-06-07 | 2016-06-28 | Faceshift Ag | Online modeling for real-time facial animation |
| CN107431635B (zh) * | 2015-03-27 | 2021-10-08 | 英特尔公司 | 化身面部表情和/或语音驱动的动画化 |
| WO2017137947A1 (en) * | 2016-02-10 | 2017-08-17 | Vats Nitin | Producing realistic talking face with expression using images text and voice |
| US9940932B2 (en) * | 2016-03-02 | 2018-04-10 | Wipro Limited | System and method for speech-to-text conversion |
| US10810780B2 (en) * | 2017-07-28 | 2020-10-20 | Baobab Studios Inc. | Systems and methods for real-time complex character animations and interactivity |
| CN107765852A (zh) * | 2017-10-11 | 2018-03-06 | 北京光年无限科技有限公司 | 基于虚拟人的多模态交互处理方法及系统 |
| CN107797663A (zh) * | 2017-10-26 | 2018-03-13 | 北京光年无限科技有限公司 | 基于虚拟人的多模态交互处理方法及系统 |
| EP3752957A4 (en) * | 2018-02-15 | 2021-11-17 | DMAI, Inc. | SYSTEM AND PROCEDURE FOR SPEECH UNDERSTANDING VIA INTEGRATED AUDIO AND VIDEO-BASED VOICE RECOGNITION |
| US11062494B2 (en) * | 2018-03-06 | 2021-07-13 | Didimo, Inc. | Electronic messaging utilizing animatable 3D models |
| CN108646918A (zh) * | 2018-05-10 | 2018-10-12 | 北京光年无限科技有限公司 | 基于虚拟人的视觉交互方法及系统 |
| JP2022500795A (ja) * | 2018-07-04 | 2022-01-04 | ウェブ アシスタンツ ゲーエムベーハー | アバターアニメーション |
| US11315325B2 (en) * | 2018-10-09 | 2022-04-26 | Magic Leap, Inc. | Systems and methods for artificial intelligence-based virtual and augmented reality |
-
2020
- 2020-06-04 CN CN202080041919.9A patent/CN114303116A/zh active Pending
- 2020-06-04 AU AU2020287622A patent/AU2020287622A1/en not_active Abandoned
- 2020-06-04 US US17/596,262 patent/US11501480B2/en active Active
- 2020-06-04 WO PCT/US2020/036068 patent/WO2020247590A1/en not_active Ceased
- 2020-06-04 CA CA3137927A patent/CA3137927A1/en active Pending
- 2020-06-04 JP JP2021569969A patent/JP2022534708A/ja active Pending
- 2020-06-04 KR KR1020227000276A patent/KR20220039702A/ko not_active Withdrawn
- 2020-06-04 EP EP20817714.7A patent/EP3980865A4/en not_active Withdrawn
-
2022
- 2022-11-10 US US18/054,486 patent/US20230145369A1/en not_active Abandoned