EP2939187A4 - Neural model for reinforcement learning - Google Patents

Neural model for reinforcement learning Download PDF

Info

Publication number
EP2939187A4
EP2939187A4 EP13860582.9A EP13860582A EP2939187A4 EP 2939187 A4 EP2939187 A4 EP 2939187A4 EP 13860582 A EP13860582 A EP 13860582A EP 2939187 A4 EP2939187 A4 EP 2939187A4
Authority
EP
European Patent Office
Prior art keywords
reinforcement learning
neural model
neural
model
learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP13860582.9A
Other languages
German (de)
French (fr)
Other versions
EP2939187A1 (en
Inventor
Corey M. Thibeault
Narayan Srinivasa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HRL Laboratories LLC
Original Assignee
HRL Laboratories LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HRL Laboratories LLC filed Critical HRL Laboratories LLC
Priority claimed from PCT/US2013/041451 external-priority patent/WO2014088634A1/en
Publication of EP2939187A1 publication Critical patent/EP2939187A1/en
Publication of EP2939187A4 publication Critical patent/EP2939187A4/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Neurology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
EP13860582.9A 2012-12-03 2013-05-16 Neural model for reinforcement learning Ceased EP2939187A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261732590P 2012-12-03 2012-12-03
PCT/US2013/041451 WO2014088634A1 (en) 2012-12-03 2013-05-16 Neural model for reinforcement learning

Publications (2)

Publication Number Publication Date
EP2939187A1 EP2939187A1 (en) 2015-11-04
EP2939187A4 true EP2939187A4 (en) 2017-08-16

Family

ID=51896593

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13860582.9A Ceased EP2939187A4 (en) 2012-12-03 2013-05-16 Neural model for reinforcement learning

Country Status (2)

Country Link
EP (1) EP2939187A4 (en)
CN (1) CN104823205B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180174030A1 (en) * 2016-12-15 2018-06-21 Fu-Chang Hsu Self-learning for neural network arrays
CN110428049B (en) * 2019-08-21 2021-10-26 南京邮电大学 Voltage type neural network based on polymorphic memristor and operation method thereof

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090182697A1 (en) * 2005-08-15 2009-07-16 Massaquoi Steve G Computer-Implemented Model of the Central Nervous System

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
PL338507A1 (en) * 1997-06-11 2000-11-06 Univ Southern California Dynamic synapsis for processing signals in the network of nerve cells
US7467115B2 (en) * 2004-07-15 2008-12-16 Neurosciences Research Foundation, Inc. Mobile brain-based device having a simulated nervous system based on the hippocampus
JP5154666B2 (en) * 2008-03-14 2013-02-27 ヒューレット−パッカード デベロップメント カンパニー エル．ピー． Neuromorphic circuit

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090182697A1 (en) * 2005-08-15 2009-07-16 Massaquoi Steve G Computer-Implemented Model of the Central Nervous System

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
D. R. W. BARR ET AL: "Implementation of multi-layer leaky integrator networks on a cellular processor array", PROCEEDINGS OF THE 2007 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN'07), 12 August 2007 (2007-08-12), pages 1560 - 1565, XP031154826, DOI: 10.1109/IJCNN.2007.4371190 *
E. DAUCÉ: "Hebbian reinforcement learning in a modular dynamic network", PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON SIMULATION OF ADAPTIVE BEHAVIOR, 13 July 2004 (2004-07-13), pages 305 - 314, XP007913889, ISBN: 978-0-262-69341-7 *
J. IGARASHI ET AL: "Real-time simulation of a spiking neural network model of the basal ganglia circuitry using general purpose computing on graphics processing units", NEURAL NETWORKS, vol. 24, no. 9, 30 June 2011 (2011-06-30), pages 950 - 960, XP028298414, DOI: 10.1016/J.NEUNET.2011.06.008 *
See also references of WO2014088634A1 *
T. C. STEWART ET AL: "Learning to select actions with spiking neurons in the basal ganglia", FRONTIERS IN NEUROSCIENCE, vol. 6, 2, 31 January 2012 (2012-01-31), XP055389198, DOI: 10.3389/fnins.2012.00002 *

Also Published As

Publication number Publication date
CN104823205A (en) 2015-08-05
CN104823205B (en) 2019-05-28
EP2939187A1 (en) 2015-11-04

Similar Documents

Publication Publication Date Title
EP2629123B8 (en) Simulation model optimization
GB201519807D0 (en) Range extender control
EP2936334A4 (en) Instance weighted learning machine learning model
IL227210B (en) Neural stimulator system
EP2766868A4 (en) Course skeleton for adaptive learning
EP2915712A4 (en) Vehicle travel controller
GB2507336B (en) Learning aid
EP2931631A4 (en) Modular tanks
EP2815940A4 (en) Vehicle control apparatus
EP2907124A4 (en) Learning aid
EP2939187A4 (en) Neural model for reinforcement learning
GB2494100B (en) Language learning system
GB2493723B (en) Learning aid
AU2012904419A0 (en) Learning Aid
AU2012902648A0 (en) A sub-frame system
GB201300105D0 (en) The learning natterbox
AU2012903326A0 (en) Teaching Aid
AU2012905056A0 (en) A method
AU2012903154A0 (en) A tank
AU2012905183A0 (en) A trailer
AU2012902838A0 (en) A i
GB201119901D0 (en) An improved learning aid
AU2012901203A0 (en) Learning Toolkit
GB201109107D0 (en) Computer-assisted learning
HUP1200504A2 (en) Driving simulator

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150617

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20170719

RIC1 Information provided on ipc code assigned before grant

Ipc: G06N 3/063 20060101ALI20170713BHEP

Ipc: G06N 3/04 20060101AFI20170713BHEP

17Q First examination report despatched

Effective date: 20181109

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20191123