KR101815438B1 - 비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 신경 연관 학습, 패턴 완성, 분리, 일반화 및 계층적 리플레이를 위한 방법들 및 장치 - Google Patents

비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 신경 연관 학습, 패턴 완성, 분리, 일반화 및 계층적 리플레이를 위한 방법들 및 장치 Download PDF

Info

Publication number
KR101815438B1
KR101815438B1 KR1020147015330A KR20147015330A KR101815438B1 KR 101815438 B1 KR101815438 B1 KR 101815438B1 KR 1020147015330 A KR1020147015330 A KR 1020147015330A KR 20147015330 A KR20147015330 A KR 20147015330A KR 101815438 B1 KR101815438 B1 KR 101815438B1
Authority
KR
South Korea
Prior art keywords
pattern
neurons
layer
replay
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020147015330A
Other languages
English (en)
Korean (ko)
Other versions
KR20140092879A (ko
Inventor
제이슨 프랭크 헌징거
빅터 호키우 챈
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20140092879A publication Critical patent/KR20140092879A/ko
Application granted granted Critical
Publication of KR101815438B1 publication Critical patent/KR101815438B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/092—Reinforcement learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Image Analysis (AREA)
  • Electrotherapy Devices (AREA)
  • Detergent Compositions (AREA)
  • Air Conditioning Control Device (AREA)
  • Testing Of Coins (AREA)
  • Feedback Control In General (AREA)
KR1020147015330A 2011-11-09 2012-11-09 비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 신경 연관 학습, 패턴 완성, 분리, 일반화 및 계층적 리플레이를 위한 방법들 및 장치 Active KR101815438B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/292,184 2011-11-09
US13/292,184 US9443190B2 (en) 2011-11-09 2011-11-09 Methods and apparatus for neural pattern sequence completion and neural pattern hierarchical replay by invoking replay of a referenced neural pattern
PCT/US2012/064512 WO2013071155A1 (en) 2011-11-09 2012-11-09 Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: neural associative learning, pattern completion, separation, generalization and hierarchical replay

Publications (2)

Publication Number Publication Date
KR20140092879A KR20140092879A (ko) 2014-07-24
KR101815438B1 true KR101815438B1 (ko) 2018-01-05

Family

ID=47428966

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020147015330A Active KR101815438B1 (ko) 2011-11-09 2012-11-09 비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 신경 연관 학습, 패턴 완성, 분리, 일반화 및 계층적 리플레이를 위한 방법들 및 장치

Country Status (8)

Country Link
US (1) US9443190B2 (https=)
EP (1) EP2776986A1 (https=)
JP (1) JP5989791B2 (https=)
KR (1) KR101815438B1 (https=)
CN (2) CN103930909B (https=)
BR (1) BR112014010445A2 (https=)
IN (1) IN2014CN03295A (https=)
WO (1) WO2013071155A1 (https=)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9405975B2 (en) 2010-03-26 2016-08-02 Brain Corporation Apparatus and methods for pulse-code invariant object recognition
US9906838B2 (en) 2010-07-12 2018-02-27 Time Warner Cable Enterprises Llc Apparatus and methods for content delivery and message exchange across multiple content delivery networks
US9015091B2 (en) * 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
KR101912165B1 (ko) * 2011-12-09 2018-10-29 삼성전자주식회사 스파이킹 뉴런 기반 작업 기억 장치
US9070083B2 (en) * 2011-12-13 2015-06-30 Iucf-Hyu Industry-University Cooperation Foundation Hanyang University Method for learning task skill and robot using thereof
US9224090B2 (en) 2012-05-07 2015-12-29 Brain Corporation Sensory input processing apparatus in a spiking neural network
US9412041B1 (en) 2012-06-29 2016-08-09 Brain Corporation Retinal apparatus and methods
US9186793B1 (en) 2012-08-31 2015-11-17 Brain Corporation Apparatus and methods for controlling attention of a robot
US9311594B1 (en) 2012-09-20 2016-04-12 Brain Corporation Spiking neuron network apparatus and methods for encoding of sensory data
US9183493B2 (en) 2012-10-25 2015-11-10 Brain Corporation Adaptive plasticity apparatus and methods for spiking neuron network
US9111226B2 (en) 2012-10-25 2015-08-18 Brain Corporation Modulated plasticity apparatus and methods for spiking neuron network
US9218563B2 (en) * 2012-10-25 2015-12-22 Brain Corporation Spiking neuron sensory processing apparatus and methods for saliency detection
US9275326B2 (en) 2012-11-30 2016-03-01 Brain Corporation Rate stabilization through plasticity in spiking neuron network
US9239985B2 (en) 2013-06-19 2016-01-19 Brain Corporation Apparatus and methods for processing inputs in an artificial neuron network
US9436909B2 (en) 2013-06-19 2016-09-06 Brain Corporation Increased dynamic range artificial neuron network apparatus and methods
US9552546B1 (en) 2013-07-30 2017-01-24 Brain Corporation Apparatus and methods for efficacy balancing in a spiking neuron network
US20150134582A1 (en) * 2013-11-08 2015-05-14 Qualcomm Incorporated Implementing synaptic learning using replay in spiking neural networks
US9987743B2 (en) 2014-03-13 2018-06-05 Brain Corporation Trainable modular robotic apparatus and methods
US9533413B2 (en) 2014-03-13 2017-01-03 Brain Corporation Trainable modular robotic apparatus and methods
US10275705B2 (en) 2014-08-08 2019-04-30 Vicarious Fpc, Inc. Systems and methods for generating data explanations for neural networks and related systems
US9881349B1 (en) 2014-10-24 2018-01-30 Gopro, Inc. Apparatus and methods for computerized object identification
US10083395B2 (en) * 2015-05-21 2018-09-25 Google Llc Batch processing in a neural network processor
US9840003B2 (en) 2015-06-24 2017-12-12 Brain Corporation Apparatus and methods for safe navigation of robotic devices
JP2017102904A (ja) * 2015-10-23 2017-06-08 株式会社半導体エネルギー研究所 半導体装置および電子機器
EP3602287A4 (en) * 2017-03-28 2021-01-06 HRL Laboratories, LLC NEURAL MODEL BASED CONTROL UNIT
US11645835B2 (en) * 2017-08-30 2023-05-09 Board Of Regents, The University Of Texas System Hypercomplex deep learning methods, architectures, and apparatus for multimodal small, medium, and large-scale data representation, analysis, and applications
US11742901B2 (en) * 2020-07-27 2023-08-29 Electronics And Telecommunications Research Institute Deep learning based beamforming method and apparatus

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5583964A (en) 1994-05-02 1996-12-10 Motorola, Inc. Computer utilizing neural network and method of using same
US7089218B1 (en) 2004-01-06 2006-08-08 Neuric Technologies, Llc Method for inclusion of psychological temperament in an electronic emulation of the human brain
JP3647584B2 (ja) 1996-12-26 2005-05-11 富士通株式会社 学習型自己定位装置
US6041322A (en) 1997-04-18 2000-03-21 Industrial Technology Research Institute Method and apparatus for processing data in a neural network
WO2004097733A2 (en) 2003-04-30 2004-11-11 Darwinian Neural Network Industries Ltd Neural networks
JP2005190429A (ja) 2003-12-26 2005-07-14 Hiroshima Univ 参照データ認識・学習方法及びパターン認識システム
EP2360629A3 (en) 2005-05-07 2012-04-11 Stephen L. Thaler Device for the autonomous bootstrapping of useful information
JP4201012B2 (ja) 2006-04-06 2008-12-24 ソニー株式会社 データ処理装置、データ処理方法、およびプログラム
EP2259214B1 (en) 2009-06-04 2013-02-27 Honda Research Institute Europe GmbH Implementing a neural associative memory based on non-linear learning of discrete synapses
US20120117012A1 (en) 2010-04-08 2012-05-10 Neurosciences Research Foundation, Inc. Spike-timing computer modeling of working memory
WO2012138761A1 (en) 2011-04-04 2012-10-11 Sheepdog Sciences, Inc. Apparatus, system, and method for modulating consolidation of memory during sleep
US9147155B2 (en) 2011-08-16 2015-09-29 Qualcomm Incorporated Method and apparatus for neural temporal coding, learning and recognition
US9424513B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for neural component memory transfer of a referenced pattern by including neurons to output a pattern substantially the same as the referenced pattern
US9015091B2 (en) 2011-11-09 2015-04-21 Qualcomm Incorporated Methods and apparatus for unsupervised neural replay, learning refinement, association and memory transfer: structural plasticity and structural constraint modeling
US9424511B2 (en) 2011-11-09 2016-08-23 Qualcomm Incorporated Methods and apparatus for unsupervised neural component replay by referencing a pattern in neuron outputs
US8909575B2 (en) 2012-02-29 2014-12-09 Qualcomm Incorporated Method and apparatus for modeling neural resource based synaptic placticity
WO2014081671A1 (en) 2012-11-20 2014-05-30 Qualcomm Incorporated Dynamical event neuron and synapse models for learning spiking neural networks

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Girardeau et al. Hippocampal ripples and memory consolidation. Current Opinion in Neurobiology, 2011, Vol.21, pp.452-459
Kaspar Meyer et al. Convergence and divergence in a neural architecture for recognition and memory. Trends in Neurosciences, 2009.06.10. Vol.32, No.7, pp.376-382.*

Also Published As

Publication number Publication date
JP2014535117A (ja) 2014-12-25
JP5989791B2 (ja) 2016-09-07
CN103930909B (zh) 2017-07-04
EP2776986A1 (en) 2014-09-17
US20130117212A1 (en) 2013-05-09
CN105868828B (zh) 2019-06-11
BR112014010445A2 (pt) 2017-04-18
CN103930909A (zh) 2014-07-16
IN2014CN03295A (https=) 2015-07-03
US9443190B2 (en) 2016-09-13
WO2013071155A1 (en) 2013-05-16
CN105868828A (zh) 2016-08-17
KR20140092879A (ko) 2014-07-24

Similar Documents

Publication Publication Date Title
KR101815438B1 (ko) 비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 신경 연관 학습, 패턴 완성, 분리, 일반화 및 계층적 리플레이를 위한 방법들 및 장치
KR101582061B1 (ko) 비감독 신경 리플레이, 학습 리파인먼트, 연관 및 기억 전달: 구조적 가소성 및 구조적 제약 모델링을 위한 방법들 및 장치
KR101616660B1 (ko) 신경 성분 리플레이를 위한 방법, 장치 및 컴퓨터 판독가능 저장 매체
KR101755082B1 (ko) 신경 성분 기억 전달을 위한 방법, 장치 및 컴퓨터 판독가능 저장 매체
KR101793011B1 (ko) 스파이킹 네트워크들의 효율적인 하드웨어 구현
KR20160138002A (ko) 스파이킹 dbn (deep belief network) 에서의 트레이닝, 인식, 및 생성
US9652711B2 (en) Analog signal reconstruction and recognition via sub-threshold modulation
KR20160125967A (ko) 일반적인 뉴런 모델들의 효율적인 구현을 위한 방법 및 장치
KR20160047581A (ko) 인공 신경 시스템에서 브레이크포인트 결정 유닛을 구현하기 위한 방법들 및 장치
Capone et al. Beyond spiking networks

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20140605

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20150618

Patent event code: PE09021S01D

AMND Amendment
E601 Decision to refuse application
PE0601 Decision on rejection of patent

Patent event date: 20160128

Comment text: Decision to Refuse Application

Patent event code: PE06012S01D

Patent event date: 20150618

Comment text: Notification of reason for refusal

Patent event code: PE06011S01I

X091 Application refused [patent]
AMND Amendment
PX0901 Re-examination

Patent event code: PX09011S01I

Patent event date: 20160128

Comment text: Decision to Refuse Application

Patent event code: PX09012R01I

Patent event date: 20150918

Comment text: Amendment to Specification, etc.

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20160607

Patent event code: PE09021S01D

AMND Amendment
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20170131

Patent event code: PE09021S01D

AMND Amendment
PX0701 Decision of registration after re-examination

Patent event date: 20170928

Comment text: Decision to Grant Registration

Patent event code: PX07013S01D

Patent event date: 20170428

Comment text: Amendment to Specification, etc.

Patent event code: PX07012R01I

Patent event date: 20160907

Comment text: Amendment to Specification, etc.

Patent event code: PX07012R01I

Patent event date: 20160428

Comment text: Amendment to Specification, etc.

Patent event code: PX07012R01I

Patent event date: 20160128

Comment text: Decision to Refuse Application

Patent event code: PX07011S01I

Patent event date: 20150918

Comment text: Amendment to Specification, etc.

Patent event code: PX07012R01I

X701 Decision to grant (after re-examination)
GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20171229

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20171229

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
FPAY Annual fee payment

Payment date: 20201005

Year of fee payment: 4

PR1001 Payment of annual fee

Payment date: 20201005

Start annual number: 4

End annual number: 4

FPAY Annual fee payment

Payment date: 20210929

Year of fee payment: 5

PR1001 Payment of annual fee

Payment date: 20210929

Start annual number: 5

End annual number: 5

FPAY Annual fee payment

Payment date: 20220921

Year of fee payment: 6

PR1001 Payment of annual fee

Payment date: 20220921

Start annual number: 6

End annual number: 6

PR1001 Payment of annual fee

Payment date: 20230921

Start annual number: 7

End annual number: 7

PR1001 Payment of annual fee