JP5989791B2 - 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル連想学習、パターン補間、分離、一般化および階層的リプレイ - Google Patents

無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル連想学習、パターン補間、分離、一般化および階層的リプレイ Download PDF

Info

Publication number
JP5989791B2
JP5989791B2 JP2014541342A JP2014541342A JP5989791B2 JP 5989791 B2 JP5989791 B2 JP 5989791B2 JP 2014541342 A JP2014541342 A JP 2014541342A JP 2014541342 A JP2014541342 A JP 2014541342A JP 5989791 B2 JP5989791 B2 JP 5989791B2
Authority
JP
Japan
Prior art keywords
pattern
neurons
layer
learning
replay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2014541342A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014535117A (ja
Inventor
ハンジンジャー、ジェイソン・フランク
チャン、ビクター・ホッキウ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of JP2014535117A publication Critical patent/JP2014535117A/ja
Application granted granted Critical
Publication of JP5989791B2 publication Critical patent/JP5989791B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/092—Reinforcement learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Electrotherapy Devices (AREA)
  • Detergent Compositions (AREA)
  • Air Conditioning Control Device (AREA)
  • Testing Of Coins (AREA)
  • Feedback Control In General (AREA)
JP2014541342A 2011-11-09 2012-11-09 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル連想学習、パターン補間、分離、一般化および階層的リプレイ Expired - Fee Related JP5989791B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/292,184 2011-11-09
US13/292,184 US9443190B2 (en) 2011-11-09 2011-11-09 Methods and apparatus for neural pattern sequence completion and neural pattern hierarchical replay by invoking replay of a referenced neural pattern
PCT/US2012/064512 WO2013071155A1 (en) 2011-11-09 2012-11-09 Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: neural associative learning, pattern completion, separation, generalization and hierarchical replay

Publications (2)

Publication Number Publication Date
JP2014535117A JP2014535117A (ja) 2014-12-25
JP5989791B2 true JP5989791B2 (ja) 2016-09-07

Family

ID=47428966

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014541342A Expired - Fee Related JP5989791B2 (ja) 2011-11-09 2012-11-09 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル連想学習、パターン補間、分離、一般化および階層的リプレイ

Country Status (8)

Country Link
US (1) US9443190B2 (https=)
EP (1) EP2776986A1 (https=)
JP (1) JP5989791B2 (https=)
KR (1) KR101815438B1 (https=)
CN (2) CN103930909B (https=)
BR (1) BR112014010445A2 (https=)
IN (1) IN2014CN03295A (https=)
WO (1) WO2013071155A1 (https=)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9405975B2 (en) 2010-03-26 2016-08-02 Brain Corporation Apparatus and methods for pulse-code invariant object recognition
US9906838B2 (en) 2010-07-12 2018-02-27 Time Warner Cable Enterprises Llc Apparatus and methods for content delivery and message exchange across multiple content delivery networks
US9015091B2 (en) * 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
KR101912165B1 (ko) * 2011-12-09 2018-10-29 삼성전자주식회사 스파이킹 뉴런 기반 작업 기억 장치
US9070083B2 (en) * 2011-12-13 2015-06-30 Iucf-Hyu Industry-University Cooperation Foundation Hanyang University Method for learning task skill and robot using thereof
US9224090B2 (en) 2012-05-07 2015-12-29 Brain Corporation Sensory input processing apparatus in a spiking neural network
US9412041B1 (en) 2012-06-29 2016-08-09 Brain Corporation Retinal apparatus and methods
US9186793B1 (en) 2012-08-31 2015-11-17 Brain Corporation Apparatus and methods for controlling attention of a robot
US9311594B1 (en) 2012-09-20 2016-04-12 Brain Corporation Spiking neuron network apparatus and methods for encoding of sensory data
US9183493B2 (en) 2012-10-25 2015-11-10 Brain Corporation Adaptive plasticity apparatus and methods for spiking neuron network
US9111226B2 (en) 2012-10-25 2015-08-18 Brain Corporation Modulated plasticity apparatus and methods for spiking neuron network
US9218563B2 (en) * 2012-10-25 2015-12-22 Brain Corporation Spiking neuron sensory processing apparatus and methods for saliency detection
US9275326B2 (en) 2012-11-30 2016-03-01 Brain Corporation Rate stabilization through plasticity in spiking neuron network
US9239985B2 (en) 2013-06-19 2016-01-19 Brain Corporation Apparatus and methods for processing inputs in an artificial neuron network
US9436909B2 (en) 2013-06-19 2016-09-06 Brain Corporation Increased dynamic range artificial neuron network apparatus and methods
US9552546B1 (en) 2013-07-30 2017-01-24 Brain Corporation Apparatus and methods for efficacy balancing in a spiking neuron network
US20150134582A1 (en) * 2013-11-08 2015-05-14 Qualcomm Incorporated Implementing synaptic learning using replay in spiking neural networks
US9987743B2 (en) 2014-03-13 2018-06-05 Brain Corporation Trainable modular robotic apparatus and methods
US9533413B2 (en) 2014-03-13 2017-01-03 Brain Corporation Trainable modular robotic apparatus and methods
US10275705B2 (en) 2014-08-08 2019-04-30 Vicarious Fpc, Inc. Systems and methods for generating data explanations for neural networks and related systems
US9881349B1 (en) 2014-10-24 2018-01-30 Gopro, Inc. Apparatus and methods for computerized object identification
US10083395B2 (en) * 2015-05-21 2018-09-25 Google Llc Batch processing in a neural network processor
US9840003B2 (en) 2015-06-24 2017-12-12 Brain Corporation Apparatus and methods for safe navigation of robotic devices
JP2017102904A (ja) * 2015-10-23 2017-06-08 株式会社半導体エネルギー研究所 半導体装置および電子機器
EP3602287A4 (en) * 2017-03-28 2021-01-06 HRL Laboratories, LLC NEURAL MODEL BASED CONTROL UNIT
US11645835B2 (en) * 2017-08-30 2023-05-09 Board Of Regents, The University Of Texas System Hypercomplex deep learning methods, architectures, and apparatus for multimodal small, medium, and large-scale data representation, analysis, and applications
US11742901B2 (en) * 2020-07-27 2023-08-29 Electronics And Telecommunications Research Institute Deep learning based beamforming method and apparatus

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5583964A (en) 1994-05-02 1996-12-10 Motorola, Inc. Computer utilizing neural network and method of using same
US7089218B1 (en) 2004-01-06 2006-08-08 Neuric Technologies, Llc Method for inclusion of psychological temperament in an electronic emulation of the human brain
JP3647584B2 (ja) 1996-12-26 2005-05-11 富士通株式会社 学習型自己定位装置
US6041322A (en) 1997-04-18 2000-03-21 Industrial Technology Research Institute Method and apparatus for processing data in a neural network
WO2004097733A2 (en) 2003-04-30 2004-11-11 Darwinian Neural Network Industries Ltd Neural networks
JP2005190429A (ja) 2003-12-26 2005-07-14 Hiroshima Univ 参照データ認識・学習方法及びパターン認識システム
EP2360629A3 (en) 2005-05-07 2012-04-11 Stephen L. Thaler Device for the autonomous bootstrapping of useful information
JP4201012B2 (ja) 2006-04-06 2008-12-24 ソニー株式会社 データ処理装置、データ処理方法、およびプログラム
EP2259214B1 (en) 2009-06-04 2013-02-27 Honda Research Institute Europe GmbH Implementing a neural associative memory based on non-linear learning of discrete synapses
US20120117012A1 (en) 2010-04-08 2012-05-10 Neurosciences Research Foundation, Inc. Spike-timing computer modeling of working memory
WO2012138761A1 (en) 2011-04-04 2012-10-11 Sheepdog Sciences, Inc. Apparatus, system, and method for modulating consolidation of memory during sleep
US9147155B2 (en) 2011-08-16 2015-09-29 Qualcomm Incorporated Method and apparatus for neural temporal coding, learning and recognition
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
US9015091B2 (en) 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US8909575B2 (en) 2012-02-29 2014-12-09 Qualcomm Incorporated Method and apparatus for modeling neural resource based synaptic placticity
WO2014081671A1 (en) 2012-11-20 2014-05-30 Qualcomm Incorporated Dynamical event neuron and synapse models for learning spiking neural networks

Also Published As

Publication number Publication date
JP2014535117A (ja) 2014-12-25
CN103930909B (zh) 2017-07-04
EP2776986A1 (en) 2014-09-17
US20130117212A1 (en) 2013-05-09
CN105868828B (zh) 2019-06-11
BR112014010445A2 (pt) 2017-04-18
CN103930909A (zh) 2014-07-16
IN2014CN03295A (https=) 2015-07-03
US9443190B2 (en) 2016-09-13
WO2013071155A1 (en) 2013-05-16
CN105868828A (zh) 2016-08-17
KR101815438B1 (ko) 2018-01-05
KR20140092879A (ko) 2014-07-24

Similar Documents

Publication Publication Date Title
JP5989791B2 (ja) 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル連想学習、パターン補間、分離、一般化および階層的リプレイ
JP5934378B2 (ja) 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：構造可塑性および構造制約モデリング
JP5989793B2 (ja) 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル構成要素リプレイ
JP5989792B2 (ja) 無監督ニューラルリプレイ、学習改善、関連付け、およびメモリ転送のための方法および装置：ニューラル構成要素メモリ転送
JP6219418B2 (ja) ニューラルテンポラルコーディング、学習および認識のための方法および装置
JP5944518B2 (ja) スパイキングニューラルネットワークにおける自然マルチスパイク列のニューラル学習のための方法および装置
TW201626293A (zh) 由知識圖譜偏置的資料分類
CN110110677A (zh) 摄影图像中的眨眼和转移注视避免
US9269045B2 (en) Auditory source separation in a spiking neural network

Legal Events

Date Code Title Description
A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20151110

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160209

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160712

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160810

R150 Certificate of patent or registration of utility model

Ref document number: 5989791

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees