EP3980865A4 - Multi-modal model for dynamically responsive virtual characters - Google Patents

Multi-modal model for dynamically responsive virtual characters Download PDF

Info

Publication number
EP3980865A4
EP3980865A4 EP20817714.7A EP20817714A EP3980865A4 EP 3980865 A4 EP3980865 A4 EP 3980865A4 EP 20817714 A EP20817714 A EP 20817714A EP 3980865 A4 EP3980865 A4 EP 3980865A4
Authority
EP
European Patent Office
Prior art keywords
virtual characters
dynamically responsive
modal model
responsive virtual
modal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20817714.7A
Other languages
German (de)
French (fr)
Other versions
EP3980865A1 (en
Inventor
Armando MCINTYRE-KIRWIN
Ryan HORRIGAN
Josh EISENBERG
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Artie Inc
Original Assignee
Artie Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Artie Inc filed Critical Artie Inc
Publication of EP3980865A1 publication Critical patent/EP3980865A1/en
Publication of EP3980865A4 publication Critical patent/EP3980865A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/004—Artificial life, i.e. computing arrangements simulating life
    • G06N3/006—Artificial life, i.e. computing arrangements simulating life based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/205—3D [Three Dimensional] animation driven by audio data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/10—Constructive solid geometry [CSG] using solid primitives, e.g. cylinders, cubes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00—Speech synthesis; Text to speech systems
    • G10L13/02—Methods for producing synthetic speech; Speech synthesisers
    • G10L13/027—Concept to speech synthesisers; Generation of natural phrases from machine-based concepts
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1822—Parsing for meaning understanding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/55—Details of game data or player data management
    • A63F2300/5546—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history
    • A63F2300/5553—Details of game data or player data management using player registration data, e.g. identification, account, preferences, game history user representation in the game field, e.g. avatar
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/038—Indexing scheme relating to G06F3/038
    • G06F2203/0381—Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2213/00—Indexing scheme for animation
    • G06T2213/08—Animation software package
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/02—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Computer Graphics (AREA)
  • Biophysics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
EP20817714.7A 2019-06-06 2020-06-04 Multi-modal model for dynamically responsive virtual characters Pending EP3980865A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962858234P 2019-06-06 2019-06-06
PCT/US2020/036068 WO2020247590A1 (en) 2019-06-06 2020-06-04 Multi-modal model for dynamically responsive virtual characters

Publications (2)

Publication Number Publication Date
EP3980865A1 EP3980865A1 (en) 2022-04-13
EP3980865A4 true EP3980865A4 (en) 2023-05-17

Family

ID=73652134

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20817714.7A Pending EP3980865A4 (en) 2019-06-06 2020-06-04 Multi-modal model for dynamically responsive virtual characters

Country Status (8)

Country Link
US (2) US11501480B2 (en)
EP (1) EP3980865A4 (en)
JP (1) JP2022534708A (en)
KR (1) KR20220039702A (en)
CN (1) CN114303116A (en)
AU (1) AU2020287622A1 (en)
CA (1) CA3137927A1 (en)
WO (1) WO2020247590A1 (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7142315B2 (en) * 2018-09-27 2022-09-27 パナソニックＩｐマネジメント株式会社 Explanation support device and explanation support method
KR20210014909A (en) * 2019-07-31 2021-02-10 삼성전자주식회사 Electronic device for identifying language level of a target and method thereof
US11232646B2 (en) * 2019-09-06 2022-01-25 Snap Inc. Context-based virtual object rendering
US11093691B1 (en) * 2020-02-14 2021-08-17 Capital One Services, Llc System and method for establishing an interactive communication session
US20210375023A1 (en) * 2020-06-01 2021-12-02 Nvidia Corporation Content animation using one or more neural networks
WO2022046674A1 (en) * 2020-08-24 2022-03-03 Sterling Labs Llc Devices and methods for motion planning of computer characters
US11756251B2 (en) * 2020-09-03 2023-09-12 Sony Interactive Entertainment Inc. Facial animation control by automatic generation of facial action units using text and speech
CN115426553A (en) * 2021-05-12 2022-12-02 海信集团控股股份有限公司 Intelligent sound box and display method thereof
US20230009454A1 (en) * 2021-07-12 2023-01-12 Keith Paciello Digital character with dynamic interactive behavior
CN114201042B (en) * 2021-11-09 2023-09-15 北京电子工程总体研究所 Distributed comprehensive integrated seminar device, system, construction method and interaction method
US20230230293A1 (en) * 2022-01-11 2023-07-20 MeetKai, Inc. Method and system for virtual intelligence user interaction
KR20230164954A (en) * 2022-05-26 2023-12-05 한국전자기술연구원 Method for implementing interactive virtual avatar
JP2024028023A (en) * 2022-08-19 2024-03-01 ソニーセミコンダクタソリューションズ株式会社 Expression processing apparatus, expression processing method and expression processing program
US20240220520A1 (en) * 2022-12-30 2024-07-04 Theai, Inc. Archetype-based generation of artificial intelligence characters
US12002470B1 (en) * 2022-12-31 2024-06-04 Theai, Inc. Multi-source based knowledge data for artificial intelligence characters
WO2024170658A1 (en) * 2023-02-17 2024-08-22 Sony Semiconductor Solutions Corporation Device, method, and computer program to control an avatar
KR102644550B1 (en) * 2023-09-27 2024-03-07 셀렉트스타 주식회사 The Method Of Providing A Character Video Call Using A Natural Language Processing Model, The Computing System That Performs It, And The Computer-readable Recording Medium To Implement It
CN118135068B (en) * 2024-05-07 2024-07-23 深圳威尔视觉科技有限公司 Cloud interaction method and device based on virtual digital person and computer equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US20140212854A1 (en) * 2013-01-31 2014-07-31 Sri International Multi-modal modeling of temporal interaction sequences
US9796095B1 (en) * 2012-08-15 2017-10-24 Hanson Robokind And Intelligent Bots, Llc System and method for controlling intelligent animated characters

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6964023B2 (en) * 2001-02-05 2005-11-08 International Business Machines Corporation System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input
US20070015121A1 (en) * 2005-06-02 2007-01-18 University Of Southern California Interactive Foreign Language Teaching
US20070111795A1 (en) * 2005-11-15 2007-05-17 Joon-Hyuk Choi Virtual entity on a network
US8224652B2 (en) 2008-09-26 2012-07-17 Microsoft Corporation Speech and text driven HMM-based body animation synthesis
US9378576B2 (en) 2013-06-07 2016-06-28 Faceshift Ag Online modeling for real-time facial animation
US20170039750A1 (en) * 2015-03-27 2017-02-09 Intel Corporation Avatar facial expression and/or speech driven animations
US11783524B2 (en) 2016-02-10 2023-10-10 Nitin Vats Producing realistic talking face with expression using images text and voice
US10818061B2 (en) * 2017-07-28 2020-10-27 Baobab Studios Inc. Systems and methods for real-time complex character animations and interactivity
CN107765852A (en) * 2017-10-11 2018-03-06 北京光年无限科技有限公司 Multi-modal interaction processing method and system based on visual human
CN107797663A (en) * 2017-10-26 2018-03-13 北京光年无限科技有限公司 Multi-modal interaction processing method and system based on visual human
US11017779B2 (en) * 2018-02-15 2021-05-25 DMAI, Inc. System and method for speech understanding via integrated audio and visual based speech recognition
WO2019173108A1 (en) * 2018-03-06 2019-09-12 Didimo, Inc. Electronic messaging utilizing animatable 3d models
CN108646918A (en) * 2018-05-10 2018-10-12 北京光年无限科技有限公司 Visual interactive method and system based on visual human
EP3718086A1 (en) * 2018-07-04 2020-10-07 Web Assistants GmbH Avatar animation
EP3864575A4 (en) * 2018-10-09 2021-12-01 Magic Leap, Inc. Systems and methods for virtual and augmented reality

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US9796095B1 (en) * 2012-08-15 2017-10-24 Hanson Robokind And Intelligent Bots, Llc System and method for controlling intelligent animated characters
US20140212854A1 (en) * 2013-01-31 2014-07-31 Sri International Multi-modal modeling of temporal interaction sequences

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
HUI ZHANG ET AL: "Real-time adaptive behaviors in multimodal human-avatar interactions", INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES AND THE WORKSHOP ON MACHINE LEARNING FOR MULTIMODAL INTERACTION ON, ICMI-MLMI '10, ACM PRESS, NEW YORK, NEW YORK, USA, 8 November 2010 (2010-11-08), pages 1 - 8, XP058296254, ISBN: 978-1-4503-0414-6, DOI: 10.1145/1891903.1891909 *
KAIHUI MU ET AL: "Animating a Chinese interactive virtual character", MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2011 IEEE INTERNATIONAL WORKSHOP ON, IEEE, 18 September 2011 (2011-09-18), pages 1 - 5, XP032067788, ISBN: 978-1-4577-1621-8, DOI: 10.1109/MLSP.2011.6064586 *
MARCO GILLIES ET AL: "Piavca: a framework for heterogeneous interactions with virtual characters", VIRTUAL REALITY, SPRINGER-VERLAG, LO, vol. 14, no. 4, 30 July 2010 (2010-07-30), pages 221 - 228, XP019863845, ISSN: 1434-9957, DOI: 10.1007/S10055-010-0167-5 *
See also references of WO2020247590A1 *

Also Published As

Publication number Publication date
EP3980865A1 (en) 2022-04-13
CN114303116A (en) 2022-04-08
JP2022534708A (en) 2022-08-03
KR20220039702A (en) 2022-03-29
CA3137927A1 (en) 2020-12-10
US20220148248A1 (en) 2022-05-12
WO2020247590A1 (en) 2020-12-10
US20230145369A1 (en) 2023-05-11
US11501480B2 (en) 2022-11-15
AU2020287622A1 (en) 2021-11-18

Similar Documents

Publication Publication Date Title
EP3980865A4 (en) Multi-modal model for dynamically responsive virtual characters
EP3593326A4 (en) Virtual vision system
EP4081887A4 (en) Graphical user interface system
EP3659076A4 (en) Virtual restaurant system
EP3701460A4 (en) Virtual subaccounts
TWI800343B (en) Virtual environment workout controls
EP3918579A4 (en) Augmented reality mobile edge computing
EP3740846A4 (en) Providing virtual content based on user context
EP4031050A4 (en) Surgical virtual reality user interface
EP3621055A4 (en) Universal virtual simulator
EP3356877A4 (en) Eye gaze responsive virtual reality headset
EP4064005A4 (en) Virtual reality system
EP3618352A4 (en) Virtual machine management
EP4072691A4 (en) Exercise system
EP3849434A4 (en) Computer vision techniques
EP3888047A4 (en) Interactive virtual interface
EP3621709A4 (en) Virtual reality headset stands
EP3773410A4 (en) Eye moisturizer
EP3987385A4 (en) Virtual location selection for virtual content
EP3807747A4 (en) Virtual reality hand gesture generation
EP3983496A4 (en) Drag reducing agents
EP3987473A4 (en) User specific advertising in a virtual environment
EP3938518A4 (en) Expression vector
EP4048570A4 (en) Virtual safety manager
EP3942789A4 (en) Virtual intercom system

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20211111

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G06F0003000000

Ipc: G06N0020000000

A4 Supplementary search report drawn up and despatched

Effective date: 20230418

RIC1 Information provided on ipc code assigned before grant

Ipc: G06V 40/16 20220101ALN20230412BHEP

Ipc: G10L 15/26 20060101ALN20230412BHEP

Ipc: H04L 51/02 20220101ALN20230412BHEP

Ipc: G06N 3/006 20230101ALI20230412BHEP

Ipc: G06T 13/40 20110101ALI20230412BHEP

Ipc: G06F 3/01 20060101ALI20230412BHEP

Ipc: A63F 13/00 20140101ALI20230412BHEP

Ipc: G10L 15/02 20060101ALI20230412BHEP

Ipc: G10L 15/00 20130101ALI20230412BHEP

Ipc: G06T 13/00 20110101ALI20230412BHEP

Ipc: G06F 3/00 20060101ALI20230412BHEP

Ipc: G06N 20/00 20190101AFI20230412BHEP