DK3602409T3 - Udvælgelse af handlinger ved hjælp af multimodale inputs - Google Patents
Udvælgelse af handlinger ved hjælp af multimodale inputs Download PDFInfo
- Publication number
- DK3602409T3 DK3602409T3 DK18729406.1T DK18729406T DK3602409T3 DK 3602409 T3 DK3602409 T3 DK 3602409T3 DK 18729406 T DK18729406 T DK 18729406T DK 3602409 T3 DK3602409 T3 DK 3602409T3
- Authority
- DK
- Denmark
- Prior art keywords
- selecting actions
- multimodal inputs
- multimodal
- inputs
- actions
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G06N3/0455—Auto-encoder networks; Encoder-decoder networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/092—Reinforcement learning
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mathematical Optimization (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Machine Translation (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762515458P | 2017-06-05 | 2017-06-05 | |
PCT/EP2018/064703 WO2018224471A1 (en) | 2017-06-05 | 2018-06-05 | Selecting actions using multi-modal inputs |
Publications (1)
Publication Number | Publication Date |
---|---|
DK3602409T3 true DK3602409T3 (da) | 2024-01-29 |
Family
ID=62530233
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
DK18729406.1T DK3602409T3 (da) | 2017-06-05 | 2018-06-05 | Udvælgelse af handlinger ved hjælp af multimodale inputs |
Country Status (5)
Country | Link |
---|---|
US (3) | US11354509B2 (da) |
EP (2) | EP3602409B1 (da) |
CN (2) | CN110692066B (da) |
DK (1) | DK3602409T3 (da) |
WO (1) | WO2018224471A1 (da) |
Families Citing this family (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
DE112014000709B4 (de) | 2013-02-07 | 2021-12-30 | Apple Inc. | Verfahren und vorrichtung zum betrieb eines sprachtriggers für einen digitalen assistenten |
US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
WO2018083667A1 (en) * | 2016-11-04 | 2018-05-11 | Deepmind Technologies Limited | Reinforcement learning systems |
US11615285B2 (en) | 2017-01-06 | 2023-03-28 | Ecole Polytechnique Federale De Lausanne (Epfl) | Generating and identifying functional subnetworks within structural networks |
DK180048B1 (da) | 2017-05-11 | 2020-02-04 | Apple Inc. | Opretholdelse af databeskyttelse af personoplysninger |
DK201770428A1 (da) | 2017-05-12 | 2019-02-18 | Apple Inc. | Low-latency intelligent automated assistant |
DK179496B1 (da) | 2017-05-12 | 2019-01-15 | Apple Inc. | Bruger-specifikke akustiske modeller |
DK201770411A1 (da) | 2017-05-15 | 2018-12-20 | Apple Inc. | Multi-modal interfaces |
US20180336275A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Intelligent automated assistant for media exploration |
DK3602409T3 (da) * | 2017-06-05 | 2024-01-29 | Deepmind Tech Ltd | Udvælgelse af handlinger ved hjælp af multimodale inputs |
US11676220B2 (en) * | 2018-04-20 | 2023-06-13 | Meta Platforms, Inc. | Processing multimodal user input for assistant systems |
US11010179B2 (en) | 2018-04-20 | 2021-05-18 | Facebook, Inc. | Aggregating semantic information for improved understanding of users |
US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
DK180639B1 (da) | 2018-06-01 | 2021-11-04 | Apple Inc | Deaktivering af bevågenheds-opmærksom virtuel assistent |
DK201870355A1 (da) | 2018-06-01 | 2019-12-16 | Apple Inc. | Virtual assistant operation in multi-device environments |
US11663478B2 (en) | 2018-06-11 | 2023-05-30 | Inait Sa | Characterizing activity in a recurrent artificial neural network |
US11972343B2 (en) * | 2018-06-11 | 2024-04-30 | Inait Sa | Encoding and decoding information |
US11893471B2 (en) | 2018-06-11 | 2024-02-06 | Inait Sa | Encoding and decoding information and artificial neural networks |
US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
US11250838B2 (en) * | 2018-11-16 | 2022-02-15 | Deepmind Technologies Limited | Cross-modal sequence distillation |
JP7317979B2 (ja) * | 2019-02-25 | 2023-07-31 | グーグル エルエルシー | ピラミッドレイヤのアーキテクチャを生成するためのシステムおよび方法 |
CN113227973A (zh) * | 2019-02-26 | 2021-08-06 | 谷歌有限责任公司 | 用于选择软件策略网络并且基于所选择的策略网络自主控制对应软件客户端的强化学习技术 |
US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
US11652603B2 (en) | 2019-03-18 | 2023-05-16 | Inait Sa | Homomorphic encryption |
US11569978B2 (en) | 2019-03-18 | 2023-01-31 | Inait Sa | Encrypting and decrypting information |
WO2020190460A1 (en) * | 2019-03-20 | 2020-09-24 | Sony Corporation | Reinforcement learning through a double actor critic algorithm |
US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
JP7339776B2 (ja) * | 2019-05-28 | 2023-09-06 | 川崎重工業株式会社 | 制御システム、機械装置システム及び制御方法 |
US11227599B2 (en) | 2019-06-01 | 2022-01-18 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
US20210019642A1 (en) * | 2019-07-17 | 2021-01-21 | Wingman AI Agents Limited | System for voice communication with ai agents in an environment |
US11900244B1 (en) * | 2019-09-30 | 2024-02-13 | Amazon Technologies, Inc. | Attention-based deep reinforcement learning for autonomous agents |
US20220392206A1 (en) * | 2019-11-15 | 2022-12-08 | Deepmind Technologies Limited | Reinforcement learning for active sequence processing |
US11580401B2 (en) | 2019-12-11 | 2023-02-14 | Inait Sa | Distance metrics and clustering in recurrent neural networks |
US11797827B2 (en) | 2019-12-11 | 2023-10-24 | Inait Sa | Input into a neural network |
US11651210B2 (en) | 2019-12-11 | 2023-05-16 | Inait Sa | Interpreting and improving the processing results of recurrent neural networks |
US11816553B2 (en) | 2019-12-11 | 2023-11-14 | Inait Sa | Output from a recurrent neural network |
US11397786B2 (en) * | 2019-12-12 | 2022-07-26 | Yahoo Assets Llc | Method and system of personalized blending for content recommendation |
US11445068B1 (en) * | 2020-02-21 | 2022-09-13 | Express Scripts Strategic Development, Inc. | Virtual caller system |
WO2020143848A2 (en) * | 2020-04-02 | 2020-07-16 | Alipay (Hangzhou) Information Technology Co., Ltd. | Determining action selection policies of an execution device |
US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
JP7523665B2 (ja) | 2020-07-28 | 2024-07-26 | ディープマインド テクノロジーズ リミテッド | 観測埋込みを制御する補助タスクを使用する、アクション選択ニューラルネットワークのトレーニング |
US11181988B1 (en) * | 2020-08-31 | 2021-11-23 | Apple Inc. | Incorporating user feedback into text prediction models via joint reward planning |
US11550991B2 (en) * | 2021-03-29 | 2023-01-10 | Capital One Services, Llc | Methods and systems for generating alternative content using adversarial networks implemented in an application programming interface layer |
CN113052248B (zh) * | 2021-03-31 | 2024-08-23 | 北京字节跳动网络技术有限公司 | 超参数确定方法、装置、深度强化学习框架、介质及设备 |
CN114239760B (zh) * | 2022-02-25 | 2022-05-20 | 苏州浪潮智能科技有限公司 | 多模态模型训练以及图像识别方法、装置、电子设备 |
CN114781652B (zh) * | 2022-06-21 | 2022-10-14 | 济南大学 | 一种基于多模态强化学习的人机协同框架 |
WO2024163919A1 (en) * | 2023-02-02 | 2024-08-08 | Google Llc | Controlling robots using multi-modal language models |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5680557A (en) * | 1994-02-16 | 1997-10-21 | The United States Of America As Represented By The Secretary Of The Army | Natural computing system |
US5963966A (en) * | 1995-11-08 | 1999-10-05 | Cybernet Systems Corporation | Automated capture of technical documents for electronic review and distribution |
US9071885B2 (en) * | 2010-08-18 | 2015-06-30 | Demand Media, Inc. | Systems, methods, and machine-readable storage media for presenting animations overlying multimedia files |
US8296142B2 (en) * | 2011-01-21 | 2012-10-23 | Google Inc. | Speech recognition using dock context |
US9547804B2 (en) * | 2011-08-25 | 2017-01-17 | Cornell University | Retinal encoder for machine vision |
US20130145241A1 (en) * | 2011-12-04 | 2013-06-06 | Ahmed Salama | Automated augmentation of text, web and physical environments using multimedia content |
CN106056213B (zh) * | 2015-04-06 | 2022-03-29 | 渊慧科技有限公司 | 使用目标和观察来选择强化学习动作 |
US9965705B2 (en) * | 2015-11-03 | 2018-05-08 | Baidu Usa Llc | Systems and methods for attention-based configurable convolutional neural networks (ABC-CNN) for visual question answering |
US20180284746A1 (en) * | 2016-05-09 | 2018-10-04 | StrongForce IoT Portfolio 2016, LLC | Methods and systems for data collection optimization in an industrial internet of things environment |
US20170337682A1 (en) * | 2016-05-18 | 2017-11-23 | Siemens Healthcare Gmbh | Method and System for Image Registration Using an Intelligent Artificial Agent |
KR20180001889A (ko) * | 2016-06-28 | 2018-01-05 | 삼성전자주식회사 | 언어 처리 방법 및 장치 |
US11810038B2 (en) * | 2016-07-06 | 2023-11-07 | International Business Machines Corporation | Risk optimization through reinforcement learning |
US10546066B2 (en) * | 2016-08-31 | 2020-01-28 | Microsoft Technology Licensing, Llc | End-to-end learning of dialogue agents for information access |
JP6797610B2 (ja) * | 2016-08-31 | 2020-12-09 | キヤノン株式会社 | 装置、方法、及びプログラム |
US10963782B2 (en) * | 2016-11-04 | 2021-03-30 | Salesforce.Com, Inc. | Dynamic coattention network for question answering |
US20180129742A1 (en) * | 2016-11-10 | 2018-05-10 | Qualcomm Incorporated | Natural language object tracking |
US9754221B1 (en) * | 2017-03-09 | 2017-09-05 | Alphaics Corporation | Processor for implementing reinforcement learning operations |
US10372824B2 (en) * | 2017-05-15 | 2019-08-06 | International Business Machines Corporation | Disambiguating concepts in natural language |
DK201770431A1 (da) * | 2017-05-15 | 2018-12-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
DK3602409T3 (da) * | 2017-06-05 | 2024-01-29 | Deepmind Tech Ltd | Udvælgelse af handlinger ved hjælp af multimodale inputs |
US10645073B1 (en) * | 2017-06-12 | 2020-05-05 | Ca, Inc. | Systems and methods for authenticating applications installed on computing devices |
WO2020118643A1 (en) * | 2018-12-13 | 2020-06-18 | Microsoft Technology Licensing, Llc | Neural text-to-speech synthesis with multi-level text information |
US11694042B2 (en) * | 2020-06-16 | 2023-07-04 | Baidu Usa Llc | Cross-lingual unsupervised classification with multi-view transfer learning |
-
2018
- 2018-06-05 DK DK18729406.1T patent/DK3602409T3/da active
- 2018-06-05 EP EP18729406.1A patent/EP3602409B1/en active Active
- 2018-06-05 EP EP23198528.4A patent/EP4273757A3/en active Pending
- 2018-06-05 US US16/497,602 patent/US11354509B2/en active Active
- 2018-06-05 CN CN201880026852.4A patent/CN110692066B/zh active Active
- 2018-06-05 CN CN202310780609.4A patent/CN116957055A/zh active Pending
- 2018-06-05 WO PCT/EP2018/064703 patent/WO2018224471A1/en unknown
-
2022
- 2022-05-16 US US17/744,921 patent/US12008324B2/en active Active
-
2024
- 2024-04-29 US US18/649,774 patent/US20240320438A1/en active Pending
Also Published As
Publication number | Publication date |
---|---|
US20240320438A1 (en) | 2024-09-26 |
EP4273757A3 (en) | 2024-02-14 |
US20210110115A1 (en) | 2021-04-15 |
US12008324B2 (en) | 2024-06-11 |
CN110692066B (zh) | 2023-06-02 |
CN116957055A (zh) | 2023-10-27 |
EP4273757A2 (en) | 2023-11-08 |
US11354509B2 (en) | 2022-06-07 |
CN110692066A (zh) | 2020-01-14 |
WO2018224471A1 (en) | 2018-12-13 |
EP3602409A1 (en) | 2020-02-05 |
US20220318516A1 (en) | 2022-10-06 |
EP3602409B1 (en) | 2023-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DK3602409T3 (da) | Udvælgelse af handlinger ved hjælp af multimodale inputs | |
DK3079106T3 (da) | UDVÆLGELSE AF FORSTÆRKNINGSLÆRINGSHANDLINGER VED HJÆLP AF MÅL og OBSERVATIONER | |
DK3535429T3 (da) | Fremgangsmåde til genvinding af lithium | |
MA46879A (fr) | Composite souple | |
DK3717132T3 (da) | Separator | |
CL2017000487S1 (es) | Cámara | |
FR3046436B1 (fr) | Convertisseur electrostatique. | |
DK3300385T3 (da) | Mikrofonarrangement | |
DK3164367T3 (da) | Udglatning af en coating | |
DK3304451T3 (da) | Beslutningstagning | |
DK3246420T3 (da) | Fremgangsmåde til udvaskning af kobber | |
DK3267033T3 (da) | Vindmølle | |
DE112017006386A5 (de) | Schraubarbeitszylinder | |
FI11890U1 (fi) | Kosketustyyppinen syöttölaite | |
DE112017000734A5 (de) | Glycolsensor | |
DK3318749T3 (da) | Vindmølle | |
FR3041321B3 (fr) | Trottinette pliable | |
FR3036367B1 (fr) | Trottinette pliable | |
DE112017005767A5 (de) | Nasslaufende lamellenkupplung | |
ES1225564Y (es) | Parasol | |
DE112017006474A5 (de) | Gargerätevorrichtung | |
FR3053129B1 (fr) | Microscope | |
ES1171408Y (es) | Foco sumergible | |
DE112017000296A5 (de) | Radgeschwindigkeitssensorvorrichtung | |
DK3117706T3 (da) | Integreret skadedyrsbekæmpelse ved anvendelse af ubemandede enheder |