PL3459017T3 - Progresywne sieci neuronowe - Google Patents

Progresywne sieci neuronowe

Info

Publication number
PL3459017T3
PL3459017T3 PL16826910.8T PL16826910T PL3459017T3 PL 3459017 T3 PL3459017 T3 PL 3459017T3 PL 16826910 T PL16826910 T PL 16826910T PL 3459017 T3 PL3459017 T3 PL 3459017T3
Authority
PL
Poland
Prior art keywords
neural networks
progressive neural
progressive
networks
neural
Prior art date
Application number
PL16826910.8T
Other languages
English (en)
Inventor
Neil Charles RABINOWITZ
Guillaume Desjardins
Andrei-Alexandru RUSU
Koray Kavukcuoglu
Raia Thais HADSELL
Razvan PASCANU
James Kirkpatrick
Hubert Josef SOYER
Original Assignee
Deepmind Technologies Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Deepmind Technologies Limited filed Critical Deepmind Technologies Limited
Publication of PL3459017T3 publication Critical patent/PL3459017T3/pl

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/094—Adversarial learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/096—Transfer learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/0985—Hyperparameter optimisation; Meta-learning; Learning-to-learn

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Image Analysis (AREA)
  • Feedback Control In General (AREA)
  • Manipulator (AREA)
PL16826910.8T 2016-05-20 2016-12-30 Progresywne sieci neuronowe PL3459017T3 (pl)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662339719P 2016-05-20 2016-05-20
PCT/US2016/069589 WO2017200597A1 (en) 2016-05-20 2016-12-30 Progressive neural networks

Publications (1)

Publication Number Publication Date
PL3459017T3 true PL3459017T3 (pl) 2024-05-13

Family

ID=57822141

Family Applications (1)

Application Number Title Priority Date Filing Date
PL16826910.8T PL3459017T3 (pl) 2016-05-20 2016-12-30 Progresywne sieci neuronowe

Country Status (5)

Country Link
US (3) US10949734B2 (pl)
EP (2) EP4312157B1 (pl)
CN (2) CN117829216A (pl)
PL (1) PL3459017T3 (pl)
WO (1) WO2017200597A1 (pl)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IE87469B1 (en) * 2016-10-06 2024-01-03 Google Llc Image processing neural networks with separable convolutional layers
CN116992917B (zh) * 2016-10-10 2026-03-10 渊慧科技有限公司 用于选择动作的系统和方法
US10963783B2 (en) * 2017-02-19 2021-03-30 Intel Corporation Technologies for optimized machine learning training
PL3607466T3 (pl) * 2017-04-07 2025-10-20 Intel Corporation Zaawansowany agent sztucznej inteligencji do modelowania interakcji fizycznych
US10679129B2 (en) 2017-09-28 2020-06-09 D5Ai Llc Stochastic categorical autoencoder network
US11100399B2 (en) * 2017-11-21 2021-08-24 International Business Machines Corporation Feature extraction using multi-task learning
CN107968962B (zh) * 2017-12-12 2019-08-09 华中科技大学 一种基于深度学习的两帧不相邻图像的视频生成方法
CN108388795A (zh) * 2018-02-11 2018-08-10 浙江工业大学 一种基于lstm检测器的对抗攻击防御方法
EP3537345A1 (en) * 2018-03-06 2019-09-11 Hybris AG Computer-implemented method, system and computer program product for providing a conversational application interface
KR102565278B1 (ko) 2018-03-26 2023-08-09 삼성전자주식회사 영상 분할 방법, 영상 분할 장치, 및 영상 분할을 위한 학습 방법
US12020164B2 (en) 2018-04-18 2024-06-25 Deepmind Technologies Limited Neural networks for scalable continual learning in domains with sequentially learned tasks
US10657377B2 (en) 2018-06-12 2020-05-19 At&T Intellectual Property I, L.P. Model-driven learning for video analytics
WO2020044567A1 (ja) * 2018-08-31 2020-03-05 オリンパス株式会社 データ処理システムおよびデータ処理方法
US11676008B2 (en) * 2018-09-27 2023-06-13 Google Llc Parameter-efficient multi-task and transfer learning
US11645509B2 (en) * 2018-09-27 2023-05-09 Salesforce.Com, Inc. Continual neural network learning via explicit structure learning
US11715043B2 (en) 2019-03-01 2023-08-01 Apple Inc. Semantics preservation for machine learning models deployed as dependent on other machine learning models
US11559221B2 (en) * 2019-03-22 2023-01-24 Siemens Healthcare Gmbh Multi-task progressive networks for patient modeling for medical scans
CN111797865A (zh) * 2019-04-09 2020-10-20 Oppo广东移动通信有限公司 数据处理方法、装置、存储介质和电子设备
CN110334743B (zh) * 2019-06-10 2021-05-04 浙江大学 一种基于卷积长短时记忆网络的渐进迁移学习方法
US11475297B2 (en) 2019-08-28 2022-10-18 International Business Machines Corporation Cross-domain homophily quantification for transfer learning
US11741370B2 (en) * 2019-08-28 2023-08-29 International Business Machines Corporation Transfer learning based on cross-domain homophily influences
US12398719B2 (en) 2019-09-12 2025-08-26 Schneider Electric Systems Usa, Inc. Predicting well site failure modes and times using machine learning analytics and dynacard classifications
WO2021061781A1 (en) * 2019-09-25 2021-04-01 Google Llc Multi-task adapter neural networks
DE102019220171A1 (de) * 2019-12-19 2021-06-24 Conti Temic Microelectronic Gmbh Umwandlung von Eingangs-Bilddaten einer Mehrzahl von Fahrzeugkameras eines Rundumsichtsystems in optimierte Ausgangs-Bilddaten
CN111340089A (zh) * 2020-02-21 2020-06-26 苏州工业园区服务外包职业学院 图像特征学习方法、模型、装置和计算机存储介质
US11783187B2 (en) 2020-03-04 2023-10-10 Here Global B.V. Method, apparatus, and system for progressive training of evolving machine learning architectures
US11087883B1 (en) * 2020-04-02 2021-08-10 Blue Eye Soft, Inc. Systems and methods for transfer-to-transfer learning-based training of a machine learning model for detecting medical conditions
US11995566B2 (en) 2020-06-02 2024-05-28 Nec Corporation Machine learning knowledge management based on lifelong boosting in presence of less data
CN111723203A (zh) * 2020-06-15 2020-09-29 苏州意能通信息技术有限公司 一种基于终生学习的文本分类方法
WO2022028926A1 (en) 2020-08-07 2022-02-10 Telefonaktiebolaget Lm Ericsson (Publ) Offline simulation-to-reality transfer for reinforcement learning
US12174915B1 (en) 2020-10-01 2024-12-24 Wells Fargo Bank, N.A. Progressive machine learning using a qualifier
US12236939B2 (en) * 2021-03-12 2025-02-25 Samsung Electronics Co., Ltd. Method of generating a trigger word detection model, and an apparatus for the same
US20230153573A1 (en) * 2021-11-17 2023-05-18 University Of Florida Research Foundation, Incorporated Modularized and correlation-based configuration process framework for machine learning models
US12094087B2 (en) * 2022-03-04 2024-09-17 Wisconsin Alumni Research Foundation Systems, methods, and media for generating digital images using low bit depth image sensor data
US20250182449A1 (en) * 2022-03-23 2025-06-05 University Of Southern California Automated vessel wall segmentation system and method
US12517983B2 (en) * 2022-08-22 2026-01-06 Nec Corporation SNR detection with few-shot trained models
EP4639417A1 (en) * 2023-01-26 2025-10-29 GDM Holding LLC Mitigating loss of plasticity when training neural networks
WO2026030757A1 (en) * 2024-08-02 2026-02-05 Incora Health, Inc. Wearable-based health system for detecting stress and recovery

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5113483A (en) * 1990-06-15 1992-05-12 Microelectronics And Computer Technology Corporation Neural network with semi-localized non-linear mapping of the input space
EP0466022A3 (en) * 1990-07-12 1993-08-25 Allen-Bradley Company, Inc. Teaching method for recurrent neural networks
FR2691004B1 (fr) * 1992-05-05 1994-06-17 Thomson Csf Dispositif connexionniste de suivi de l'evolution d'une information entre au moins deux valeurs donnees, et applications.
US5572628A (en) * 1994-09-16 1996-11-05 Lucent Technologies Inc. Training system for neural networks
US5748847A (en) * 1995-12-21 1998-05-05 Maryland Technology Corporation Nonadaptively trained adaptive neural systems
US6038338A (en) * 1997-02-03 2000-03-14 The United States Of America As Represented By The Secretary Of The Navy Hybrid neural network for pattern recognition
KR100529311B1 (ko) 2003-01-21 2005-11-17 삼성전자주식회사 신경 회로망을 이용하여 가변 길이 부호화 비트 스트림의길이를 선택하는 장치 및 방법
US7958071B2 (en) * 2007-04-19 2011-06-07 Hewlett-Packard Development Company, L.P. Computational nodes and computational-node networks that include dynamical-nanodevice connections
US20140032570A1 (en) * 2012-07-30 2014-01-30 International Business Machines Corporation Discriminative Learning Via Hierarchical Transformations
US9177550B2 (en) * 2013-03-06 2015-11-03 Microsoft Technology Licensing, Llc Conservatively adapting a deep neural network in a recognition system
GB2513105A (en) * 2013-03-15 2014-10-22 Deepmind Technologies Ltd Signal processing systems
US9202462B2 (en) * 2013-09-30 2015-12-01 Google Inc. Key phrase detection
CA2941352C (en) * 2014-03-06 2022-09-20 Progress, Inc. Neural network and method of neural network training
CN104573731B (zh) * 2015-02-06 2018-03-23 厦门大学 基于卷积神经网络的快速目标检测方法
CN205139973U (zh) * 2015-10-26 2016-04-06 中国人民解放军军械工程学院 基于fpga器件构建的bp神经网络
CN116992917B (zh) * 2016-10-10 2026-03-10 渊慧科技有限公司 用于选择动作的系统和方法

Also Published As

Publication number Publication date
EP3459017B1 (en) 2023-11-01
EP3459017A1 (en) 2019-03-27
CN117829216A (zh) 2024-04-05
EP4312157B1 (en) 2026-02-04
US11775804B2 (en) 2023-10-03
EP4312157A3 (en) 2024-03-20
US12462145B2 (en) 2025-11-04
US20170337464A1 (en) 2017-11-23
US20210201116A1 (en) 2021-07-01
EP4312157A2 (en) 2024-01-31
US20240119262A1 (en) 2024-04-11
CN109328362A (zh) 2019-02-12
US10949734B2 (en) 2021-03-16
CN109328362B (zh) 2024-01-05
WO2017200597A1 (en) 2017-11-23

Similar Documents

Publication Publication Date Title
PL3459017T3 (pl) Progresywne sieci neuronowe
GB2568087B (en) Activation functions for deep neural networks
GB2582519B (en) Convolutional neural network hardware
GB2556459B (en) Neural networks for speaker verification
GB201718756D0 (en) Neural interface
GB2550864B (en) Well
AU201616677S (en) Cylindres
GB201608691D0 (en) Electrode
GB201512278D0 (en) Hybrid neural network
IL262621A (en) synapse producing substance
GB201518594D0 (en) Solid formation
AU201710580S (en) Bookrack
GB201714768D0 (en) Providing context facts
GB201611699D0 (en) Behaviour modification
GB2601073B (en) Activation functions for Deep Neural Networks
GB201611252D0 (en) Electrode
AU201713059S (en) SUNSHADE - square
GB201619778D0 (en) Polytunnel arrangement
GB201617479D0 (en) Neural network compilation
GB201617477D0 (en) Neural network optimisation
AU201713060S (en) SUNSHADE - triangle
AU2016376V (en) NinbellaPurple Alyogyne huegelii
GB201621210D0 (en) Polytunnel arrangement
AU2016359V (en) JCU6 Desmanthus bicornutus
AU2016362V (en) JCU9 Desmanthus pernambucanus