GB2581310B - Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries - Google Patents

Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries Download PDF

Info

Publication number
GB2581310B
GB2581310B GB2008959.5A GB202008959A GB2581310B GB 2581310 B GB2581310 B GB 2581310B GB 202008959 A GB202008959 A GB 202008959A GB 2581310 B GB2581310 B GB 2581310B
Authority
GB
United Kingdom
Prior art keywords
asymmetries
fixed device
polarity inversion
weight transfer
synaptic weight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
GB2008959.5A
Other languages
English (en)
Other versions
GB2581310A (en
GB202008959D0 (en
Inventor
Burr Geoffrey
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of GB202008959D0 publication Critical patent/GB202008959D0/en
Publication of GB2581310A publication Critical patent/GB2581310A/en
Application granted granted Critical
Publication of GB2581310B publication Critical patent/GB2581310B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Neurology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Semiconductor Memories (AREA)
GB2008959.5A 2017-11-20 2018-11-19 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries Active GB2581310B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/818,521 US11074499B2 (en) 2017-11-20 2017-11-20 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
PCT/IB2018/059102 WO2019097494A1 (en) 2017-11-20 2018-11-19 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Publications (3)

Publication Number Publication Date
GB202008959D0 GB202008959D0 (en) 2020-07-29
GB2581310A GB2581310A (en) 2020-08-12
GB2581310B true GB2581310B (en) 2020-12-09

Family

ID=66533047

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2008959.5A Active GB2581310B (en) 2017-11-20 2018-11-19 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Country Status (6)

Country Link
US (2) US11074499B2 (cg-RX-API-DMAC7.html)
JP (1) JP7139426B2 (cg-RX-API-DMAC7.html)
CN (1) CN111373414B (cg-RX-API-DMAC7.html)
DE (1) DE112018004992B4 (cg-RX-API-DMAC7.html)
GB (1) GB2581310B (cg-RX-API-DMAC7.html)
WO (1) WO2019097494A1 (cg-RX-API-DMAC7.html)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
EP3701351A4 (en) 2018-01-30 2021-01-27 D5Ai Llc SELF-ORGANIZING PARTIALLY ORGANIZED NETWORKS
US11694065B2 (en) 2019-08-28 2023-07-04 Micron Technology, Inc. Spiking neural unit
US11183238B2 (en) 2019-08-28 2021-11-23 International Business Machines Corporation Suppressing outlier drift coefficients while programming phase change memory synapses
US12052260B2 (en) 2019-09-30 2024-07-30 International Business Machines Corporation Scalable and dynamic transfer learning mechanism
KR102782076B1 (ko) 2019-12-13 2025-03-18 삼성전자주식회사 스위칭 소자와 저항 소자를 포함하는 3차원 뉴로모픽 장치
US11475946B2 (en) 2020-01-16 2022-10-18 International Business Machines Corporation Synapse weight update compensation
KR102873065B1 (ko) * 2020-04-23 2025-10-16 삼성전자주식회사 뉴로모픽 컴퓨팅 장치 및 그것의 동작 방법
US12156486B2 (en) 2020-12-02 2024-11-26 International Business Machines Corporation Horizontal RRAM device and architecture for variability reduction
US11908458B2 (en) * 2020-12-29 2024-02-20 International Business Machines Corporation Customization of recurrent neural network transducers for speech recognition
US12626111B2 (en) * 2021-06-17 2026-05-12 International Business Machines Corporation Calibrating peripheral variability
KR102574156B1 (ko) 2021-07-06 2023-09-01 고려대학교 산학협력단 역전파와 음수 가중치 설정이 가능한 뉴로모픽 회로
KR102514652B1 (ko) * 2021-11-19 2023-03-29 서울대학교산학협력단 뉴로모픽 소자를 위한 가중치 전사 장치 및 이를 이용한 가중치 전사 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102959565A (zh) * 2010-07-07 2013-03-06 高通股份有限公司 用于生物启发型网络的通信和突触训练方法及硬件
CN103430186A (zh) * 2012-01-20 2013-12-04 松下电器产业株式会社 神经网络电路的学习方法
US9715656B1 (en) * 2016-09-12 2017-07-25 International Business Machines Corporation Killing asymmetric resistive processing units for neural network training

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5101361A (en) * 1989-09-29 1992-03-31 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Analog hardware for delta-backpropagation neural networks
EP0768610B1 (en) 1995-10-13 2000-08-09 STMicroelectronics S.r.l. Low-voltage, very-low-power neural network
CN101364594B (zh) * 2007-08-09 2010-06-02 中国科学院半导体研究所 硅基单电子神经元量子电路
US7814038B1 (en) 2007-12-06 2010-10-12 Dominic John Repici Feedback-tolerant method and device producing weight-adjustment factors for pre-synaptic neurons in artificial neural networks
WO2010133925A1 (en) 2009-05-20 2010-11-25 Universite Paris Sud (Paris 11) Teaching method for a neuronal nano- block
US9665822B2 (en) 2010-06-30 2017-05-30 International Business Machines Corporation Canonical spiking neuron network for spatiotemporal associative memory
US8694452B2 (en) 2010-07-07 2014-04-08 Qualcomm Incorporated Methods and systems for CMOS implementation of neuron synapse
US8676734B2 (en) 2010-07-07 2014-03-18 Qualcomm, Incorporated Methods and systems for replaceable synaptic weight storage in neuro-processors
US8655813B2 (en) 2010-12-30 2014-02-18 International Business Machines Corporation Synaptic weight normalized spiking neuronal networks
US8832010B2 (en) 2012-01-04 2014-09-09 International Business Machines Corporation Electronic synapses from stochastic binary memory devices
US20160364643A1 (en) 2012-03-08 2016-12-15 Hrl Laboratories Llc Scalable integrated circuit with synaptic electronics and cmos integrated memristors
US20150120631A1 (en) 2012-05-10 2015-04-30 Consejo Superior de Investagaciones Cientificas (CSIC) Method and System for Converting Pulsed-Processing Neural Network with Instantaneous Integration Synapses into Dynamic Integration Synapses
GB201209174D0 (en) 2012-05-25 2012-07-04 Univ Bath Neural network
US8811060B2 (en) 2012-05-31 2014-08-19 International Business Machines Corporation Non-volatile memory crosspoint repair
US9424514B2 (en) 2012-07-25 2016-08-23 Board Of Trustees Of Michigan State University Synapse maintenance in the developmental networks
US9218564B2 (en) 2012-07-30 2015-12-22 International Business Machines Corporation Providing transposable access to a synapse array using a recursive array layout
US20150019468A1 (en) 2013-07-09 2015-01-15 Knowmtech, Llc Thermodynamic computing
US9753959B2 (en) 2013-10-16 2017-09-05 University Of Tennessee Research Foundation Method and apparatus for constructing a neuroscience-inspired artificial neural network with visualization of neural pathways
CN203661036U (zh) * 2013-12-20 2014-06-18 浙江大学城市学院 一种基于浮栅技术的二值动态BiCMOS与门电路
US9619749B2 (en) 2014-03-06 2017-04-11 Progress, Inc. Neural network and method of neural network training
US9990580B2 (en) 2015-03-13 2018-06-05 International Business Machines Corporation Neuromorphic synapses
US10460237B2 (en) * 2015-11-30 2019-10-29 International Business Machines Corporation Neuron-centric local learning rate for artificial neural networks to increase performance, learning rate margin, and reduce power consumption
US10891543B2 (en) 2015-12-28 2021-01-12 Samsung Electronics Co., Ltd. LUT based synapse weight update scheme in STDP neuromorphic systems
US10614355B2 (en) 2015-12-30 2020-04-07 SK Hynix Inc. Method for updating weights of synapses of a neuromorphic device
US11270194B2 (en) 2017-07-26 2022-03-08 International Business Machines Corporation System and method for constructing synaptic weights for artificial neural networks from signed analog conductance-pairs of varying significance
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102959565A (zh) * 2010-07-07 2013-03-06 高通股份有限公司 用于生物启发型网络的通信和突触训练方法及硬件
CN103430186A (zh) * 2012-01-20 2013-12-04 松下电器产业株式会社 神经网络电路的学习方法
US9715656B1 (en) * 2016-09-12 2017-07-25 International Business Machines Corporation Killing asymmetric resistive processing units for neural network training

Also Published As

Publication number Publication date
DE112018004992T5 (de) 2020-06-10
CN111373414B (zh) 2023-08-25
JP7139426B2 (ja) 2022-09-20
GB2581310A (en) 2020-08-12
CN111373414A (zh) 2020-07-03
US20210287090A1 (en) 2021-09-16
US11074499B2 (en) 2021-07-27
GB202008959D0 (en) 2020-07-29
JP2021503649A (ja) 2021-02-12
DE112018004992B4 (de) 2023-11-02
WO2019097494A1 (en) 2019-05-23
US11915132B2 (en) 2024-02-27
US20190156194A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
GB202008959D0 (en) Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
DK3406543T3 (da) Artikeltransferindretning
EP3304760A4 (en) TRANSPORT DEVICE WITH NFC CHARGER
SG11202001587UA (en) Methods and apparatus for value transfer
DK3455978T3 (da) Multi-underbærebølge-fremgangsmåde og indretning med flere numerologier
SI3347127T2 (sl) Prenosna naprava
IL283065A (en) Weight distribution exoskeleton
PL3256341T3 (pl) Urządzenie kontaktowe i zespół szybkiego ładowania
DK3577043T3 (da) Transportør med justerbare transportruller
HRP20181484T1 (hr) Uređaj za prijenos tereta
EP3668030A4 (en) TRANSMISSION DEVICE
EP3317620C0 (en) TRANSFER AND WEIGHING DEVICE
PL3687855T3 (pl) Urządzenie do przekazywania ładunków
EP3416896A4 (en) TRANSFER DEVICE AND LOAD TRANSFER DEVICE
DE112016001341A5 (de) Drehmomentübertragungseinrichtung
DE112016001345A5 (de) Drehmomentübertragungseinrichtung
EP3188695A4 (en) Exoskeleton device and method of impeding relative movement in the exoskeleton device
EP3111219A4 (en) Testing device, testing kit, transfer member, testing device fabrication method, and testing method
HUE058919T2 (hu) Súlymérõ eszköz és mérési eljárás
DE112016004226A5 (de) Drehmomentübertragungseinrichtung
DE112016001132A5 (de) Drehmomentübertragungseinrichtung
DE112018002763A5 (de) Drehmomentübertragungseinrichtung
EP3524667A4 (en) CELL TRANSFER DEVICE
DE112016004238A5 (de) Drehmomentübertragungseinrichtung
SG11201610796RA (en) Transfer membrane retaining jig and separation-transfer device

Legal Events

Date Code Title Description
746 Register noted 'licences of right' (sect. 46/1977)

Effective date: 20210125