CN103930909B - 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置 - Google Patents

无监督的神经重放、学习完善、关联以及记忆转移的方法和装置 Download PDF

Info

Publication number
CN103930909B
CN103930909B CN201280055300.9A CN201280055300A CN103930909B CN 103930909 B CN103930909 B CN 103930909B CN 201280055300 A CN201280055300 A CN 201280055300A CN 103930909 B CN103930909 B CN 103930909B
Authority
CN
China
Prior art keywords
pattern
neuron
layer
neurons
playback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201280055300.9A
Other languages
English (en)
Chinese (zh)
Other versions
CN103930909A (zh
Inventor
J·F·亨泽格
V·H·陈
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to CN201610181481.XA priority Critical patent/CN105868828B/zh
Publication of CN103930909A publication Critical patent/CN103930909A/zh
Application granted granted Critical
Publication of CN103930909B publication Critical patent/CN103930909B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/092—Reinforcement learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Electrotherapy Devices (AREA)
  • Detergent Compositions (AREA)
  • Air Conditioning Control Device (AREA)
  • Testing Of Coins (AREA)
  • Feedback Control In General (AREA)
CN201280055300.9A 2011-11-09 2012-11-09 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置 Active CN103930909B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610181481.XA CN105868828B (zh) 2011-11-09 2012-11-09 神经系统工程设计方法和装置

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/292,184 2011-11-09
US13/292,184 US9443190B2 (en) 2011-11-09 2011-11-09 Methods and apparatus for neural pattern sequence completion and neural pattern hierarchical replay by invoking replay of a referenced neural pattern
PCT/US2012/064512 WO2013071155A1 (en) 2011-11-09 2012-11-09 Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: neural associative learning, pattern completion, separation, generalization and hierarchical replay

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN201610181481.XA Division CN105868828B (zh) 2011-11-09 2012-11-09 神经系统工程设计方法和装置

Publications (2)

Publication Number Publication Date
CN103930909A CN103930909A (zh) 2014-07-16
CN103930909B true CN103930909B (zh) 2017-07-04

Family

ID=47428966

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201280055300.9A Active CN103930909B (zh) 2011-11-09 2012-11-09 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置
CN201610181481.XA Active CN105868828B (zh) 2011-11-09 2012-11-09 神经系统工程设计方法和装置

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201610181481.XA Active CN105868828B (zh) 2011-11-09 2012-11-09 神经系统工程设计方法和装置

Country Status (8)

Country Link
US (1) US9443190B2 (https=)
EP (1) EP2776986A1 (https=)
JP (1) JP5989791B2 (https=)
KR (1) KR101815438B1 (https=)
CN (2) CN103930909B (https=)
BR (1) BR112014010445A2 (https=)
IN (1) IN2014CN03295A (https=)
WO (1) WO2013071155A1 (https=)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9405975B2 (en) 2010-03-26 2016-08-02 Brain Corporation Apparatus and methods for pulse-code invariant object recognition
US9906838B2 (en) 2010-07-12 2018-02-27 Time Warner Cable Enterprises Llc Apparatus and methods for content delivery and message exchange across multiple content delivery networks
US9015091B2 (en) * 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
KR101912165B1 (ko) * 2011-12-09 2018-10-29 삼성전자주식회사 스파이킹 뉴런 기반 작업 기억 장치
US9070083B2 (en) * 2011-12-13 2015-06-30 Iucf-Hyu Industry-University Cooperation Foundation Hanyang University Method for learning task skill and robot using thereof
US9224090B2 (en) 2012-05-07 2015-12-29 Brain Corporation Sensory input processing apparatus in a spiking neural network
US9412041B1 (en) 2012-06-29 2016-08-09 Brain Corporation Retinal apparatus and methods
US9186793B1 (en) 2012-08-31 2015-11-17 Brain Corporation Apparatus and methods for controlling attention of a robot
US9311594B1 (en) 2012-09-20 2016-04-12 Brain Corporation Spiking neuron network apparatus and methods for encoding of sensory data
US9183493B2 (en) 2012-10-25 2015-11-10 Brain Corporation Adaptive plasticity apparatus and methods for spiking neuron network
US9111226B2 (en) 2012-10-25 2015-08-18 Brain Corporation Modulated plasticity apparatus and methods for spiking neuron network
US9218563B2 (en) * 2012-10-25 2015-12-22 Brain Corporation Spiking neuron sensory processing apparatus and methods for saliency detection
US9275326B2 (en) 2012-11-30 2016-03-01 Brain Corporation Rate stabilization through plasticity in spiking neuron network
US9239985B2 (en) 2013-06-19 2016-01-19 Brain Corporation Apparatus and methods for processing inputs in an artificial neuron network
US9436909B2 (en) 2013-06-19 2016-09-06 Brain Corporation Increased dynamic range artificial neuron network apparatus and methods
US9552546B1 (en) 2013-07-30 2017-01-24 Brain Corporation Apparatus and methods for efficacy balancing in a spiking neuron network
US20150134582A1 (en) * 2013-11-08 2015-05-14 Qualcomm Incorporated Implementing synaptic learning using replay in spiking neural networks
US9987743B2 (en) 2014-03-13 2018-06-05 Brain Corporation Trainable modular robotic apparatus and methods
US9533413B2 (en) 2014-03-13 2017-01-03 Brain Corporation Trainable modular robotic apparatus and methods
US10275705B2 (en) 2014-08-08 2019-04-30 Vicarious Fpc, Inc. Systems and methods for generating data explanations for neural networks and related systems
US9881349B1 (en) 2014-10-24 2018-01-30 Gopro, Inc. Apparatus and methods for computerized object identification
US10083395B2 (en) * 2015-05-21 2018-09-25 Google Llc Batch processing in a neural network processor
US9840003B2 (en) 2015-06-24 2017-12-12 Brain Corporation Apparatus and methods for safe navigation of robotic devices
JP2017102904A (ja) * 2015-10-23 2017-06-08 株式会社半導体エネルギー研究所 半導体装置および電子機器
EP3602287A4 (en) * 2017-03-28 2021-01-06 HRL Laboratories, LLC NEURAL MODEL BASED CONTROL UNIT
US11645835B2 (en) * 2017-08-30 2023-05-09 Board Of Regents, The University Of Texas System Hypercomplex deep learning methods, architectures, and apparatus for multimodal small, medium, and large-scale data representation, analysis, and applications
US11742901B2 (en) * 2020-07-27 2023-08-29 Electronics And Telecommunications Research Institute Deep learning based beamforming method and apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1150847A (zh) * 1994-05-02 1997-05-28 摩托罗拉公司 使用神经网络的计算机和使用该神经网络的方法
US6041322A (en) * 1997-04-18 2000-03-21 Industrial Technology Research Institute Method and apparatus for processing data in a neural network

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7089218B1 (en) 2004-01-06 2006-08-08 Neuric Technologies, Llc Method for inclusion of psychological temperament in an electronic emulation of the human brain
JP3647584B2 (ja) 1996-12-26 2005-05-11 富士通株式会社 学習型自己定位装置
WO2004097733A2 (en) 2003-04-30 2004-11-11 Darwinian Neural Network Industries Ltd Neural networks
JP2005190429A (ja) 2003-12-26 2005-07-14 Hiroshima Univ 参照データ認識・学習方法及びパターン認識システム
EP2360629A3 (en) 2005-05-07 2012-04-11 Stephen L. Thaler Device for the autonomous bootstrapping of useful information
JP4201012B2 (ja) 2006-04-06 2008-12-24 ソニー株式会社 データ処理装置、データ処理方法、およびプログラム
EP2259214B1 (en) 2009-06-04 2013-02-27 Honda Research Institute Europe GmbH Implementing a neural associative memory based on non-linear learning of discrete synapses
US20120117012A1 (en) 2010-04-08 2012-05-10 Neurosciences Research Foundation, Inc. Spike-timing computer modeling of working memory
WO2012138761A1 (en) 2011-04-04 2012-10-11 Sheepdog Sciences, Inc. Apparatus, system, and method for modulating consolidation of memory during sleep
US9147155B2 (en) 2011-08-16 2015-09-29 Qualcomm Incorporated Method and apparatus for neural temporal coding, learning and recognition
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
US9015091B2 (en) 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US8909575B2 (en) 2012-02-29 2014-12-09 Qualcomm Incorporated Method and apparatus for modeling neural resource based synaptic placticity
WO2014081671A1 (en) 2012-11-20 2014-05-30 Qualcomm Incorporated Dynamical event neuron and synapse models for learning spiking neural networks

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1150847A (zh) * 1994-05-02 1997-05-28 摩托罗拉公司 使用神经网络的计算机和使用该神经网络的方法
US6041322A (en) * 1997-04-18 2000-03-21 Industrial Technology Research Institute Method and apparatus for processing data in a neural network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Convergence and divergence in a neural architecture for recognition and memory;Kaspar Meyer;《Trends in Neurosciences》;20090731;第32卷(第7期);摘要，第376页第1栏第27行-第380页第1栏第39行，附图1-2 *
Hippocampal ripples and memory consolidation;Gabrielle Girardeau;《Current Opinion in Neurobiology》;20110615;第21卷(第21期);摘要，第1页第2栏第16行-第5页第2栏第41行，附图1-2 *

Also Published As

Publication number Publication date
JP2014535117A (ja) 2014-12-25
JP5989791B2 (ja) 2016-09-07
EP2776986A1 (en) 2014-09-17
US20130117212A1 (en) 2013-05-09
CN105868828B (zh) 2019-06-11
BR112014010445A2 (pt) 2017-04-18
CN103930909A (zh) 2014-07-16
IN2014CN03295A (https=) 2015-07-03
US9443190B2 (en) 2016-09-13
WO2013071155A1 (en) 2013-05-16
CN105868828A (zh) 2016-08-17
KR101815438B1 (ko) 2018-01-05
KR20140092879A (ko) 2014-07-24

Similar Documents

Publication Publication Date Title
CN103930909B (zh) 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置
CN103930910B (zh) 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置：结构可塑性和结构约束建模
CN103930907B (zh) 一种神经组件记忆转移的方法和装置
CN103930908A (zh) 无监督的神经重放、学习完善、关联以及记忆转移的方法和装置：神经组件重放
KR101594724B1 (ko) 스파이킹 신경망들에서의 구조적 지연 가소성에 대한 방법 및 장치
KR20170031695A (ko) 신경망들에서의 콘볼루션 동작의 분해
US9361545B2 (en) Methods and apparatus for estimating angular movement with a single two dimensional device
US20150088796A1 (en) Methods and apparatus for implementation of group tags for neural models
CN114861838A (zh) 一种基于神经元复杂动力学的脉冲神经类脑智能分类方法
JP2017507397A (ja) 自動エラー訂正のための同時レイテンシおよびレートコーディング
Rolls et al. Hippocampal storage and recall of neocortical “What”–“Where” representations
US9275329B2 (en) Behavioral homeostasis in artificial nervous systems using dynamical spiking neuron models

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant