DK3602409T3 - Udvælgelse af handlinger ved hjælp af multimodale inputs - Google Patents
Udvælgelse af handlinger ved hjælp af multimodale inputs Download PDFInfo
- Publication number
- DK3602409T3 DK3602409T3 DK18729406.1T DK18729406T DK3602409T3 DK 3602409 T3 DK3602409 T3 DK 3602409T3 DK 18729406 T DK18729406 T DK 18729406T DK 3602409 T3 DK3602409 T3 DK 3602409T3
- Authority
- DK
- Denmark
- Prior art keywords
- selecting actions
- multimodal inputs
- multimodal
- inputs
- actions
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G06N3/0455—Auto-encoder networks; Encoder-decoder networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/092—Reinforcement learning
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Evolutionary Computation (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Machine Translation (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201762515458P | 2017-06-05 | 2017-06-05 | |
| PCT/EP2018/064703 WO2018224471A1 (en) | 2017-06-05 | 2018-06-05 | Selecting actions using multi-modal inputs |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| DK3602409T3 true DK3602409T3 (da) | 2024-01-29 |
Family
ID=62530233
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| DK18729406.1T DK3602409T3 (da) | 2017-06-05 | 2018-06-05 | Udvælgelse af handlinger ved hjælp af multimodale inputs |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US11354509B2 (da) |
| EP (2) | EP4273757A3 (da) |
| CN (2) | CN110692066B (da) |
| DK (1) | DK3602409T3 (da) |
| WO (1) | WO2018224471A1 (da) |
Families Citing this family (58)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
| US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
| US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
| KR20150104615A (ko) | 2013-02-07 | 2015-09-15 | 애플 인크. | 디지털 어시스턴트를 위한 음성 트리거 |
| US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
| US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
| US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
| US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
| US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
| US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
| US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
| DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
| CN117521725A (zh) * | 2016-11-04 | 2024-02-06 | 渊慧科技有限公司 | 加强学习系统 |
| US11615285B2 (en) | 2017-01-06 | 2023-03-28 | Ecole Polytechnique Federale De Lausanne (Epfl) | Generating and identifying functional subnetworks within structural networks |
| DK180048B1 (da) | 2017-05-11 | 2020-02-04 | Apple Inc. | Opretholdelse af databeskyttelse af personoplysninger |
| DK201770429A1 (da) | 2017-05-12 | 2018-12-14 | Apple Inc. | Low-latency intelligent automated assistant |
| DK179496B1 (da) | 2017-05-12 | 2019-01-15 | Apple Inc. | Bruger-specifikke akustiske modeller |
| DK201770411A1 (da) | 2017-05-15 | 2018-12-20 | Apple Inc. | Multi-modal interfaces |
| EP4273757A3 (en) | 2017-06-05 | 2024-02-14 | DeepMind Technologies Limited | Selecting actions using multi-modal inputs |
| US10963273B2 (en) | 2018-04-20 | 2021-03-30 | Facebook, Inc. | Generating personalized content summaries for users |
| US11676220B2 (en) * | 2018-04-20 | 2023-06-13 | Meta Platforms, Inc. | Processing multimodal user input for assistant systems |
| US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
| US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
| DK180639B1 (da) | 2018-06-01 | 2021-11-04 | Apple Inc | Deaktivering af bevågenheds-opmærksom virtuel assistent |
| US11663478B2 (en) | 2018-06-11 | 2023-05-30 | Inait Sa | Characterizing activity in a recurrent artificial neural network |
| US11972343B2 (en) * | 2018-06-11 | 2024-04-30 | Inait Sa | Encoding and decoding information |
| US11893471B2 (en) | 2018-06-11 | 2024-02-06 | Inait Sa | Encoding and decoding information and artificial neural networks |
| US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
| US11250838B2 (en) * | 2018-11-16 | 2022-02-15 | Deepmind Technologies Limited | Cross-modal sequence distillation |
| KR20210116640A (ko) * | 2019-02-25 | 2021-09-27 | 구글 엘엘씨 | 피라미드 계층의 아키텍처를 생성하기 위한 시스템 및 방법 |
| EP3871088A1 (en) * | 2019-02-26 | 2021-09-01 | Google LLC | Reinforcement learning techniques for selecting a software policy network and autonomously controlling a corresponding software client based on selected policy network |
| US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
| US11569978B2 (en) | 2019-03-18 | 2023-01-31 | Inait Sa | Encrypting and decrypting information |
| US11652603B2 (en) | 2019-03-18 | 2023-05-16 | Inait Sa | Homomorphic encryption |
| EP3921785A4 (en) | 2019-03-20 | 2022-04-20 | Sony Group Corporation | REINFORCEMENT LEARNING THROUGH A CRITICAL DUAL ACTOR ALGORITHM |
| US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
| DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
| US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
| JP7339776B2 (ja) * | 2019-05-28 | 2023-09-06 | 川崎重工業株式会社 | 制御システム、機械装置システム及び制御方法 |
| US11227599B2 (en) | 2019-06-01 | 2022-01-18 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
| US20210019642A1 (en) * | 2019-07-17 | 2021-01-21 | Wingman AI Agents Limited | System for voice communication with ai agents in an environment |
| US11900244B1 (en) * | 2019-09-30 | 2024-02-13 | Amazon Technologies, Inc. | Attention-based deep reinforcement learning for autonomous agents |
| US20220392206A1 (en) * | 2019-11-15 | 2022-12-08 | Deepmind Technologies Limited | Reinforcement learning for active sequence processing |
| US11580401B2 (en) | 2019-12-11 | 2023-02-14 | Inait Sa | Distance metrics and clustering in recurrent neural networks |
| US11816553B2 (en) | 2019-12-11 | 2023-11-14 | Inait Sa | Output from a recurrent neural network |
| US11651210B2 (en) | 2019-12-11 | 2023-05-16 | Inait Sa | Interpreting and improving the processing results of recurrent neural networks |
| US11797827B2 (en) | 2019-12-11 | 2023-10-24 | Inait Sa | Input into a neural network |
| US11397786B2 (en) * | 2019-12-12 | 2022-07-26 | Yahoo Assets Llc | Method and system of personalized blending for content recommendation |
| US11445068B1 (en) * | 2020-02-21 | 2022-09-13 | Express Scripts Strategic Development, Inc. | Virtual caller system |
| SG11202102364YA (en) * | 2020-04-02 | 2021-04-29 | Alipay Hangzhou Inf Tech Co Ltd | Determining action selection policies of an execution device |
| US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
| US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
| US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
| JP2023536126A (ja) * | 2020-07-28 | 2023-08-23 | ディープマインド テクノロジーズ リミテッド | 観測埋込みを制御する補助タスクを使用する、アクション選択ニューラルネットワークのトレーニング |
| US11181988B1 (en) * | 2020-08-31 | 2021-11-23 | Apple Inc. | Incorporating user feedback into text prediction models via joint reward planning |
| US11550991B2 (en) * | 2021-03-29 | 2023-01-10 | Capital One Services, Llc | Methods and systems for generating alternative content using adversarial networks implemented in an application programming interface layer |
| CN113052248A (zh) * | 2021-03-31 | 2021-06-29 | 北京字节跳动网络技术有限公司 | 超参数确定方法、装置、深度强化学习框架、介质及设备 |
| CN114781652B (zh) * | 2022-06-21 | 2022-10-14 | 济南大学 | 一种基于多模态强化学习的人机协同框架 |
Family Cites Families (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5680557A (en) * | 1994-02-16 | 1997-10-21 | The United States Of America As Represented By The Secretary Of The Army | Natural computing system |
| US5963966A (en) * | 1995-11-08 | 1999-10-05 | Cybernet Systems Corporation | Automated capture of technical documents for electronic review and distribution |
| US9071885B2 (en) * | 2010-08-18 | 2015-06-30 | Demand Media, Inc. | Systems, methods, and machine-readable storage media for presenting animations overlying multimedia files |
| US8296142B2 (en) * | 2011-01-21 | 2012-10-23 | Google Inc. | Speech recognition using dock context |
| EP2748765B1 (en) * | 2011-08-25 | 2022-12-14 | Cornell University | Retinal encoder for machine vision |
| US20130145241A1 (en) * | 2011-12-04 | 2013-06-06 | Ahmed Salama | Automated augmentation of text, web and physical environments using multimedia content |
| US10628733B2 (en) * | 2015-04-06 | 2020-04-21 | Deepmind Technologies Limited | Selecting reinforcement learning actions using goals and observations |
| US9965705B2 (en) * | 2015-11-03 | 2018-05-08 | Baidu Usa Llc | Systems and methods for attention-based configurable convolutional neural networks (ABC-CNN) for visual question answering |
| US20180284735A1 (en) * | 2016-05-09 | 2018-10-04 | StrongForce IoT Portfolio 2016, LLC | Methods and systems for industrial internet of things data collection in a network sensitive upstream oil and gas environment |
| US20170337682A1 (en) * | 2016-05-18 | 2017-11-23 | Siemens Healthcare Gmbh | Method and System for Image Registration Using an Intelligent Artificial Agent |
| KR20180001889A (ko) * | 2016-06-28 | 2018-01-05 | 삼성전자주식회사 | 언어 처리 방법 및 장치 |
| US11810038B2 (en) * | 2016-07-06 | 2023-11-07 | International Business Machines Corporation | Risk optimization through reinforcement learning |
| US10546066B2 (en) * | 2016-08-31 | 2020-01-28 | Microsoft Technology Licensing, Llc | End-to-end learning of dialogue agents for information access |
| JP6797610B2 (ja) * | 2016-08-31 | 2020-12-09 | キヤノン株式会社 | 装置、方法、及びプログラム |
| US10963782B2 (en) * | 2016-11-04 | 2021-03-30 | Salesforce.Com, Inc. | Dynamic coattention network for question answering |
| US20180129742A1 (en) * | 2016-11-10 | 2018-05-10 | Qualcomm Incorporated | Natural language object tracking |
| US9754221B1 (en) * | 2017-03-09 | 2017-09-05 | Alphaics Corporation | Processor for implementing reinforcement learning operations |
| US10372824B2 (en) * | 2017-05-15 | 2019-08-06 | International Business Machines Corporation | Disambiguating concepts in natural language |
| DK201770431A1 (da) * | 2017-05-15 | 2018-12-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
| EP4273757A3 (en) * | 2017-06-05 | 2024-02-14 | DeepMind Technologies Limited | Selecting actions using multi-modal inputs |
| US10645073B1 (en) * | 2017-06-12 | 2020-05-05 | Ca, Inc. | Systems and methods for authenticating applications installed on computing devices |
| EP3895157A4 (en) * | 2018-12-13 | 2022-07-27 | Microsoft Technology Licensing, LLC | NEURONAL TEXT-TO-Speech SYNTHESIS WITH MULTI-LEVEL TEXTUAL INFORMATION |
| US11694042B2 (en) * | 2020-06-16 | 2023-07-04 | Baidu Usa Llc | Cross-lingual unsupervised classification with multi-view transfer learning |
-
2018
- 2018-06-05 EP EP23198528.4A patent/EP4273757A3/en active Pending
- 2018-06-05 CN CN201880026852.4A patent/CN110692066B/zh active Active
- 2018-06-05 DK DK18729406.1T patent/DK3602409T3/da active
- 2018-06-05 EP EP18729406.1A patent/EP3602409B1/en active Active
- 2018-06-05 CN CN202310780609.4A patent/CN116957055A/zh active Pending
- 2018-06-05 US US16/497,602 patent/US11354509B2/en active Active
- 2018-06-05 WO PCT/EP2018/064703 patent/WO2018224471A1/en unknown
-
2022
- 2022-05-16 US US17/744,921 patent/US12008324B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP4273757A3 (en) | 2024-02-14 |
| CN110692066B (zh) | 2023-06-02 |
| WO2018224471A1 (en) | 2018-12-13 |
| US20220318516A1 (en) | 2022-10-06 |
| EP3602409B1 (en) | 2023-11-01 |
| CN116957055A (zh) | 2023-10-27 |
| US11354509B2 (en) | 2022-06-07 |
| CN110692066A (zh) | 2020-01-14 |
| US20210110115A1 (en) | 2021-04-15 |
| EP4273757A2 (en) | 2023-11-08 |
| EP3602409A1 (en) | 2020-02-05 |
| US12008324B2 (en) | 2024-06-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DK3602409T3 (da) | Udvælgelse af handlinger ved hjælp af multimodale inputs | |
| DK3079106T3 (da) | UDVÆLGELSE AF FORSTÆRKNINGSLÆRINGSHANDLINGER VED HJÆLP AF MÅL og OBSERVATIONER | |
| DK3535429T3 (da) | Fremgangsmåde til genvinding af lithium | |
| MA46879A (fr) | Composite souple | |
| CL2017000487S1 (es) | Cámara | |
| DK3717132T3 (da) | Separator | |
| FR3046436B1 (fr) | Convertisseur electrostatique. | |
| DK3300385T3 (da) | Mikrofonarrangement | |
| DK3304451T3 (da) | Beslutningstagning | |
| DK3246420T3 (da) | Fremgangsmåde til udvaskning af kobber | |
| DK3164367T3 (da) | Udglatning af en coating | |
| DK3267033T3 (da) | Vindmølle | |
| DE112017006386A5 (de) | Schraubarbeitszylinder | |
| FI11890U1 (fi) | Kosketustyyppinen syöttölaite | |
| DE112017000734A5 (de) | Glycolsensor | |
| FR3041321B3 (fr) | Trottinette pliable | |
| FR3036367B1 (fr) | Trottinette pliable | |
| DK3318749T3 (da) | Vindmølle | |
| ES1225564Y (es) | Parasol | |
| DE112017006474A5 (de) | Gargerätevorrichtung | |
| DE112017005767A5 (de) | Nasslaufende lamellenkupplung | |
| FR3053129B1 (fr) | Microscope | |
| ES1171408Y (es) | Foco sumergible | |
| DE112017000296A5 (de) | Radgeschwindigkeitssensorvorrichtung | |
| DK3117706T3 (da) | Integreret skadedyrsbekæmpelse ved anvendelse af ubemandede enheder |