JPWO2020203999A1 - - Google Patents

Info

Publication number
JPWO2020203999A1
JPWO2020203999A1 JP2021512134A JP2021512134A JPWO2020203999A1 JP WO2020203999 A1 JPWO2020203999 A1 JP WO2020203999A1 JP 2021512134 A JP2021512134 A JP 2021512134A JP 2021512134 A JP2021512134 A JP 2021512134A JP WO2020203999 A1 JPWO2020203999 A1 JP WO2020203999A1
Authority
JP
Japan
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2021512134A
Other languages
Japanese (ja)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed filed Critical
Publication of JPWO2020203999A1 publication Critical patent/JPWO2020203999A1/ja
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2148—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the process organisation or structure, e.g. boosting cascade
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/57—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for processing of video signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H04L65/1089—In-session procedures by adding media; by removing media
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • H04N7/157—Conference systems defining a virtual conference space and using avatars or agents
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Evolutionary Computation (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Ophthalmology & Optometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)
JP2021512134A 2019-04-01 2020-03-30 Pending JPWO2020203999A1 (https=)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2019070095 2019-04-01
JP2019110923 2019-06-14
JP2019179883 2019-09-30
PCT/JP2020/014673 WO2020203999A1 (ja) 2019-04-01 2020-03-30 コミュニケーション支援システム、コミュニケーション支援方法、および画像制御プログラム

Publications (1)

Publication Number Publication Date
JPWO2020203999A1 true JPWO2020203999A1 (https=) 2020-10-08

Family

ID=72668494

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2021512135A Pending JPWO2020204000A1 (https=) 2019-04-01 2020-03-30
JP2021512134A Pending JPWO2020203999A1 (https=) 2019-04-01 2020-03-30

Family Applications Before (1)

Application Number Title Priority Date Filing Date
JP2021512135A Pending JPWO2020204000A1 (https=) 2019-04-01 2020-03-30

Country Status (5)

Country Link
US (2) US20220124140A1 (https=)
EP (1) EP3951604A4 (https=)
JP (2) JPWO2020204000A1 (https=)
CN (2) CN113508423A (https=)
WO (2) WO2020203999A1 (https=)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI439960B (zh) 2010-04-07 2014-06-01 蘋果公司 虛擬使用者編輯環境
CN110109592B (zh) 2016-09-23 2022-09-23 苹果公司 头像创建和编辑
US11722764B2 (en) 2018-05-07 2023-08-08 Apple Inc. Creative camera
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
DK202070625A1 (en) 2020-05-11 2022-01-04 Apple Inc User interfaces related to time
JP7367632B2 (ja) * 2020-07-31 2023-10-24 トヨタ自動車株式会社 レッスンシステム、レッスン方法、及びプログラム
CN114787759B (zh) 2020-10-14 2024-08-06 住友电气工业株式会社 交流支持方法、交流支持系统、终端装置以及存储介质
JP7673417B2 (ja) * 2021-02-04 2025-05-09 大日本印刷株式会社 選考支援システム、サーバ、リモート面接方法、及びプログラム
US11568646B2 (en) 2021-02-26 2023-01-31 Kickback Space Inc. Real-time video dimensional transformations of video for presentation in mixed reality-based virtual spaces
CN113012490A (zh) * 2021-03-09 2021-06-22 沙艾霖 一种基于虚拟场景的语言学习系统及装置
JP7767723B2 (ja) * 2021-03-18 2025-11-12 株式会社リコー 情報処理装置、非言語情報変換システム、情報処理方法およびプログラム
US11776190B2 (en) * 2021-06-04 2023-10-03 Apple Inc. Techniques for managing an avatar on a lock screen
US11694419B2 (en) 2021-09-06 2023-07-04 Kickback Space Inc. Image analysis and gaze redirection using characteristics of the eye
JP7775620B2 (ja) * 2021-10-07 2025-11-26 トヨタ自動車株式会社 仮想空間制御システム、その制御方法、及び、制御プログラム
US20240096033A1 (en) * 2021-10-11 2024-03-21 Meta Platforms Technologies, Llc Technology for creating, replicating and/or controlling avatars in extended reality
WO2023062795A1 (ja) * 2021-10-14 2023-04-20 株式会社I’mbesideyou ビデオミーティング評価端末
JP7062126B1 (ja) * 2021-11-01 2022-05-02 株式会社バーチャルキャスト 端末、情報処理方法、プログラム、および記録媒体
WO2023090419A1 (ja) * 2021-11-19 2023-05-25 凸版印刷株式会社 コンテンツ生成装置、コンテンツ生成方法、及びプログラム
US11727131B2 (en) * 2021-12-29 2023-08-15 Salesforce, Inc. Referencing a document in a virtual space
JP2023131824A (ja) * 2022-03-10 2023-09-22 Ａｖｉｔａ株式会社 情報処理装置、制御プログラムおよび制御方法
JP2023131825A (ja) * 2022-03-10 2023-09-22 Ａｖｉｔａ株式会社 情報処理装置、制御プログラムおよび制御方法
JP7357862B2 (ja) * 2022-03-17 2023-10-10 グリー株式会社 端末装置の制御プログラム、端末装置、端末装置の制御方法、サーバ装置の制御プログラム、サーバ装置、及びサーバ装置の制御方法
US12567180B2 (en) * 2022-05-11 2026-03-03 Samsung Electronics Co., Ltd. Electronic apparatus and controlling method for automatically generating virtual space corresponding to items of avatar
US12561465B2 (en) * 2022-07-11 2026-02-24 Dell Products L.P. Virtual representation of individual in computing environment
WO2024029135A1 (ja) * 2022-08-04 2024-02-08 住友電気工業株式会社 表示プログラム、表示方法及び表示システム
CN117980872B (zh) 2022-08-04 2025-02-25 住友电气工业株式会社 显示程序、显示方法以及显示系统
US12287913B2 (en) 2022-09-06 2025-04-29 Apple Inc. Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
JP2024053975A (ja) * 2022-10-04 2024-04-16 株式会社日立製作所 会議支援装置及び方法
JP2024059439A (ja) * 2022-10-18 2024-05-01 トヨタ自動車株式会社 端末装置
WO2024085084A1 (ja) * 2022-10-21 2024-04-25 株式会社Ｎｔｔドコモ アバター制御装置
US12149864B1 (en) * 2022-11-08 2024-11-19 Meta Platforms, Inc. Systems and methods for incorporating avatars into real-time communication sessions
US12322053B2 (en) * 2023-01-10 2025-06-03 Bank Of America Corporation Metaverse enabled digital cognitive twin
JP2025068411A (ja) * 2023-10-16 2025-04-28 オムロン株式会社 学習装置、操作情報変換装置及び学習方法
US12368691B2 (en) 2023-10-24 2025-07-22 Bank Of America Corporation System and method for generating alternative information formats using advanced computational models for data analysis and automated processing

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1021215A (ja) * 1996-06-28 1998-01-23 Ritsumeikan サイバースペースの作成方法及びその作成装置
WO2003058518A2 (en) * 2002-01-07 2003-07-17 Stephen James Crampton Method and apparatus for an avatar user interface system
US9652809B1 (en) * 2004-12-21 2017-05-16 Aol Inc. Using user profile information to determine an avatar and/or avatar characteristics
US8243116B2 (en) * 2007-09-24 2012-08-14 Fuji Xerox Co., Ltd. Method and system for modifying non-verbal behavior for social appropriateness in video conferencing and other computer mediated communications
US20120130717A1 (en) * 2010-11-19 2012-05-24 Microsoft Corporation Real-time Animation for an Expressive Avatar
JP5209101B2 (ja) * 2011-09-27 2013-06-12 株式会社 ディー・エヌ・エー メッセージ送受信システム、メッセージ送受信方法、及びプログラム
WO2013152453A1 (en) * 2012-04-09 2013-10-17 Intel Corporation Communication using interactive avatars
US9936165B2 (en) * 2012-09-06 2018-04-03 Intel Corporation System and method for avatar creation and synchronization
US10708545B2 (en) * 2018-01-17 2020-07-07 Duelight Llc System, method, and computer program for transmitting face models based on face data points
US9690784B1 (en) * 2013-03-15 2017-06-27 University Of Central Florida Research Foundation, Inc. Culturally adaptive avatar simulator
US9706040B2 (en) * 2013-10-31 2017-07-11 Udayakumar Kadirvel System and method for facilitating communication via interaction with an avatar
KR101756504B1 (ko) * 2014-03-12 2017-07-11 엔에이치엔엔터테인먼트 주식회사 리그전을 위한 게임 방법 및 게임 시스템
JP2015191537A (ja) 2014-03-28 2015-11-02 Kddi株式会社 視線一致画像生成方法、装置およびプログラム
US9672416B2 (en) * 2014-04-29 2017-06-06 Microsoft Technology Licensing, Llc Facial expression tracking
US20160134840A1 (en) * 2014-07-28 2016-05-12 Alexa Margaret McCulloch Avatar-Mediated Telepresence Systems with Enhanced Filtering
JP2016085579A (ja) 2014-10-24 2016-05-19 大学共同利用機関法人情報・システム研究機構 対話装置のための画像処理装置及び方法、並びに対話装置
WO2016090605A1 (en) * 2014-12-11 2016-06-16 Intel Corporation Avatar selection mechanism
CN107533356A (zh) * 2015-03-09 2018-01-02 文塔纳3D有限责任公司 头像控制系统
WO2016161553A1 (en) * 2015-04-07 2016-10-13 Intel Corporation Avatar generation and animations
JP2017130046A (ja) 2016-01-20 2017-07-27 日本電信電話株式会社 視線一致顔画像合成方法、テレビ会議システム、及びプログラム
US10063604B2 (en) * 2016-02-17 2018-08-28 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Systems and methods for facilitating video communication using virtual avatars
US20180089880A1 (en) * 2016-09-23 2018-03-29 Apple Inc. Transmission of avatar data
JP6338037B1 (ja) 2016-09-30 2018-06-06 大日本印刷株式会社 細胞取扱容器
WO2018186031A1 (ja) * 2017-04-03 2018-10-11 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US10685466B2 (en) * 2017-05-23 2020-06-16 Dell Products L.P. System and method of utilizing video systems with available bandwidth
JP6973747B2 (ja) 2017-10-11 2021-12-01 株式会社ブリヂストン 止水材
US10244208B1 (en) * 2017-12-12 2019-03-26 Facebook, Inc. Systems and methods for visually representing users in communication applications
JP7175620B2 (ja) 2018-03-30 2022-11-21 キヤノン株式会社 型を用いて基板上の組成物を成形する成形装置、成形方法、および物品の製造方法
JP6487585B1 (ja) * 2018-04-12 2019-03-20 株式会社バーチャルキャスト コンテンツ配信サーバ、仮想キャラクタ提供サーバ、コンテンツ配信システム、コンテンツ配信方法及びプログラム

Also Published As

Publication number Publication date
JPWO2020204000A1 (https=) 2020-10-08
WO2020203999A1 (ja) 2020-10-08
WO2020204000A1 (ja) 2020-10-08
US20220124140A1 (en) 2022-04-21
CN113508369A (zh) 2021-10-15
CN113508423A (zh) 2021-10-15
EP3951604A1 (en) 2022-02-09
US20220150285A1 (en) 2022-05-12
EP3951604A4 (en) 2022-06-01

Similar Documents

Publication Publication Date Title
JPWO2020203999A1 (https=)
BR112021017339A2 (https=)
BR112021018450A2 (https=)
BR112021017892A2 (https=)
BR112021017782A2 (https=)
BR112021017939A2 (https=)
BR112021017738A2 (https=)
BR112021016996A2 (https=)
BR112021017728A2 (https=)
BR112021013944A2 (https=)
BR112021018452A2 (https=)
BR112021017703A2 (https=)
BR112021018102A2 (https=)
BR112021017732A2 (https=)
BR112021017234A2 (https=)
BR112021017355A2 (https=)
BR112021018168A2 (https=)
BR112021018093A2 (https=)
BR112021017173A2 (https=)
BR112021017083A2 (https=)
BR112021018250A2 (https=)
BR112021018584A2 (https=)
BR112021017310A2 (https=)
BR112021013128A2 (https=)
BR112021018484A2 (https=)