DE112018004992B4 - Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien - Google Patents

Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien Download PDF

Info

Publication number
DE112018004992B4
DE112018004992B4 DE112018004992.2T DE112018004992T DE112018004992B4 DE 112018004992 B4 DE112018004992 B4 DE 112018004992B4 DE 112018004992 T DE112018004992 T DE 112018004992T DE 112018004992 B4 DE112018004992 B4 DE 112018004992B4
Authority
DE
Germany
Prior art keywords
conductivity
conductance
pair
neurons
synaptic weight
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
DE112018004992.2T
Other languages
German (de)
English (en)
Other versions
DE112018004992T5 (de
Inventor
Geoffrey Burr
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of DE112018004992T5 publication Critical patent/DE112018004992T5/de
Application granted granted Critical
Publication of DE112018004992B4 publication Critical patent/DE112018004992B4/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Neurology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Semiconductor Memories (AREA)
DE112018004992.2T 2017-11-20 2018-11-19 Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien Active DE112018004992B4 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/818,521 US11074499B2 (en) 2017-11-20 2017-11-20 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
US15/818,521 2017-11-20
PCT/IB2018/059102 WO2019097494A1 (en) 2017-11-20 2018-11-19 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Publications (2)

Publication Number Publication Date
DE112018004992T5 DE112018004992T5 (de) 2020-06-10
DE112018004992B4 true DE112018004992B4 (de) 2023-11-02

Family

ID=66533047

Family Applications (1)

Application Number Title Priority Date Filing Date
DE112018004992.2T Active DE112018004992B4 (de) 2017-11-20 2018-11-19 Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien

Country Status (6)

Country Link
US (2) US11074499B2 (cg-RX-API-DMAC7.html)
JP (1) JP7139426B2 (cg-RX-API-DMAC7.html)
CN (1) CN111373414B (cg-RX-API-DMAC7.html)
DE (1) DE112018004992B4 (cg-RX-API-DMAC7.html)
GB (1) GB2581310B (cg-RX-API-DMAC7.html)
WO (1) WO2019097494A1 (cg-RX-API-DMAC7.html)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
EP3701351A4 (en) 2018-01-30 2021-01-27 D5Ai Llc SELF-ORGANIZING PARTIALLY ORGANIZED NETWORKS
US11694065B2 (en) 2019-08-28 2023-07-04 Micron Technology, Inc. Spiking neural unit
US11183238B2 (en) 2019-08-28 2021-11-23 International Business Machines Corporation Suppressing outlier drift coefficients while programming phase change memory synapses
US12052260B2 (en) 2019-09-30 2024-07-30 International Business Machines Corporation Scalable and dynamic transfer learning mechanism
KR102782076B1 (ko) 2019-12-13 2025-03-18 삼성전자주식회사 스위칭 소자와 저항 소자를 포함하는 3차원 뉴로모픽 장치
US11475946B2 (en) 2020-01-16 2022-10-18 International Business Machines Corporation Synapse weight update compensation
KR102873065B1 (ko) * 2020-04-23 2025-10-16 삼성전자주식회사 뉴로모픽 컴퓨팅 장치 및 그것의 동작 방법
US12156486B2 (en) 2020-12-02 2024-11-26 International Business Machines Corporation Horizontal RRAM device and architecture for variability reduction
US11908458B2 (en) * 2020-12-29 2024-02-20 International Business Machines Corporation Customization of recurrent neural network transducers for speech recognition
US12626111B2 (en) * 2021-06-17 2026-05-12 International Business Machines Corporation Calibrating peripheral variability
KR102574156B1 (ko) 2021-07-06 2023-09-01 고려대학교 산학협력단 역전파와 음수 가중치 설정이 가능한 뉴로모픽 회로
KR102514652B1 (ko) * 2021-11-19 2023-03-29 서울대학교산학협력단 뉴로모픽 소자를 위한 가중치 전사 장치 및 이를 이용한 가중치 전사 방법

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5101361A (en) * 1989-09-29 1992-03-31 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Analog hardware for delta-backpropagation neural networks
EP0768610B1 (en) 1995-10-13 2000-08-09 STMicroelectronics S.r.l. Low-voltage, very-low-power neural network
CN101364594B (zh) * 2007-08-09 2010-06-02 中国科学院半导体研究所 硅基单电子神经元量子电路
US7814038B1 (en) 2007-12-06 2010-10-12 Dominic John Repici Feedback-tolerant method and device producing weight-adjustment factors for pre-synaptic neurons in artificial neural networks
WO2010133925A1 (en) 2009-05-20 2010-11-25 Universite Paris Sud (Paris 11) Teaching method for a neuronal nano- block
US9665822B2 (en) 2010-06-30 2017-05-30 International Business Machines Corporation Canonical spiking neuron network for spatiotemporal associative memory
US8694452B2 (en) 2010-07-07 2014-04-08 Qualcomm Incorporated Methods and systems for CMOS implementation of neuron synapse
US8676734B2 (en) 2010-07-07 2014-03-18 Qualcomm, Incorporated Methods and systems for replaceable synaptic weight storage in neuro-processors
US9092736B2 (en) 2010-07-07 2015-07-28 Qualcomm Incorporated Communication and synapse training method and hardware for biologically inspired networks
US8655813B2 (en) 2010-12-30 2014-02-18 International Business Machines Corporation Synaptic weight normalized spiking neuronal networks
US8832010B2 (en) 2012-01-04 2014-09-09 International Business Machines Corporation Electronic synapses from stochastic binary memory devices
CN103430186A (zh) * 2012-01-20 2013-12-04 松下电器产业株式会社 神经网络电路的学习方法
US20160364643A1 (en) 2012-03-08 2016-12-15 Hrl Laboratories Llc Scalable integrated circuit with synaptic electronics and cmos integrated memristors
US20150120631A1 (en) 2012-05-10 2015-04-30 Consejo Superior de Investagaciones Cientificas (CSIC) Method and System for Converting Pulsed-Processing Neural Network with Instantaneous Integration Synapses into Dynamic Integration Synapses
GB201209174D0 (en) 2012-05-25 2012-07-04 Univ Bath Neural network
US8811060B2 (en) 2012-05-31 2014-08-19 International Business Machines Corporation Non-volatile memory crosspoint repair
US9424514B2 (en) 2012-07-25 2016-08-23 Board Of Trustees Of Michigan State University Synapse maintenance in the developmental networks
US9218564B2 (en) 2012-07-30 2015-12-22 International Business Machines Corporation Providing transposable access to a synapse array using a recursive array layout
US20150019468A1 (en) 2013-07-09 2015-01-15 Knowmtech, Llc Thermodynamic computing
US9753959B2 (en) 2013-10-16 2017-09-05 University Of Tennessee Research Foundation Method and apparatus for constructing a neuroscience-inspired artificial neural network with visualization of neural pathways
CN203661036U (zh) * 2013-12-20 2014-06-18 浙江大学城市学院 一种基于浮栅技术的二值动态BiCMOS与门电路
US9619749B2 (en) 2014-03-06 2017-04-11 Progress, Inc. Neural network and method of neural network training
US9990580B2 (en) 2015-03-13 2018-06-05 International Business Machines Corporation Neuromorphic synapses
US10460237B2 (en) * 2015-11-30 2019-10-29 International Business Machines Corporation Neuron-centric local learning rate for artificial neural networks to increase performance, learning rate margin, and reduce power consumption
US10891543B2 (en) 2015-12-28 2021-01-12 Samsung Electronics Co., Ltd. LUT based synapse weight update scheme in STDP neuromorphic systems
US10614355B2 (en) 2015-12-30 2020-04-07 SK Hynix Inc. Method for updating weights of synapses of a neuromorphic device
US9715656B1 (en) 2016-09-12 2017-07-25 International Business Machines Corporation Killing asymmetric resistive processing units for neural network training
US11270194B2 (en) 2017-07-26 2022-03-08 International Business Machines Corporation System and method for constructing synaptic weights for artificial neural networks from signed analog conductance-pairs of varying significance
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
AGARWAL, Sapan, et al.: Achieving ideal accuracies in analog neuromorphic computing using periodic carry. In: 2017 Symposium on VLSI Technology, 03.08.2017, S. T174-T175. https://doi.org/10.23919/VLSIT.2017.7998164 [abgerufen am 07.06.2023]
BURR, Geoffrey W., et al.: Experimental demonstration and tolerancing of a large-scale neural network (165 000 synapses) using phase-change memory as the synaptic weight element. In: IEEE Transactions on Electron Devices, 62, 2015, 11, S. 3498-3507. https://doi.org/10.1109/TED.2015.2439635 [abgerufen am 06.06.2023]

Also Published As

Publication number Publication date
DE112018004992T5 (de) 2020-06-10
CN111373414B (zh) 2023-08-25
JP7139426B2 (ja) 2022-09-20
GB2581310A (en) 2020-08-12
GB2581310B (en) 2020-12-09
CN111373414A (zh) 2020-07-03
US20210287090A1 (en) 2021-09-16
US11074499B2 (en) 2021-07-27
GB202008959D0 (en) 2020-07-29
JP2021503649A (ja) 2021-02-12
WO2019097494A1 (en) 2019-05-23
US11915132B2 (en) 2024-02-27
US20190156194A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
DE112018004992T5 (de) Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien
DE112018002950B4 (de) System und Verfahren zum Aufbauen von synaptischen Gewichten für künstliche neuronale Netze aus mit Vorzeichen versehenen analogen Leitwertpaaren unterschiedlicher Wertigkeit
DE112019000437B4 (de) Architektur einer resistiven verarbeitungseinheit mit voneinander getrennter gewichtungsaktualisierungs- und inferenzschaltung
DE112016003245B4 (de) Resistive Verarbeitungseinheit
DE112018004223B4 (de) Trainieren künstlicher neuronaler Netze
DE112018005726B4 (de) Resistive verarbeitungseinheit auf zählerbasis für programmierbare und rekonfigurierbare künstliche neuronale netzwerke
DE112018000272T5 (de) Resistive Verarbeitungseinheit mit hysteretischen Aktualisierungen zum Trainieren neuronaler Netze
DE112019005119T5 (de) Abgleichtechniken zum angleichen des symmetriepunktes als null-gewichtungspunkt in analogen kreuzungspunktanordnungen
DE102019116305A1 (de) Pipelining zur verbesserung der inferenzgenauigkeit neuronaler netze
DE112011101370T5 (de) Neuronales Netz mit kanonischen gepulsten Neuronen für einen raumzeitlichen Assoziativspeicher
DE112020002186B4 (de) Dnn-training mit asymmetrischen rpu-einheiten
DE112021006459T5 (de) Dynamische konfiguration einer auslese-schaltungsanordnung für verschiedene operationen in einem analogen resistiven kreuzschienen-array
WO2013170843A1 (de) Verfahren zum trainieren eines künstlichen neuronalen netzes
WO2005024717A1 (de) System und verfahren zur automatisierten erfahrungstarifierung und/oder schadensreservierung
DE4016197A1 (de) Neuralnetzwerk mit einer matrix zum berechnen der uebereinstimmung zwischen zwei binaermustern
DE112021002939T5 (de) Effiziente kachel-zuordnung für zeilenweise zuordnung in neuronalen faltungsnetzen zur analogen inferenz in künstliche-intelligenz-netzen
DE112020002547T5 (de) Rausch- und signalverwaltung für rpu-array
DE112021005218T5 (de) Neuromorphe Einheit mit mehreren Anschlüssen
DE102020106867A1 (de) Vektor-matrix-multiplikation mit 3d-nand
DE102020120212A1 (de) Netzwerk zur automatischen Programmierspannungsauswahl
DE112020003371T5 (de) Unterdrücken von ausreisserdriftkoeffizienten während des programmierens von phasenwechsel-speichersynapsen
DE112021004941B4 (de) Gewichtungswiederholung in rpu-kreuzschienen-arrays
DE112021006672T5 (de) Dnn-training durch filtern mit versteckter matrix
DE112021008566T5 (de) Computerimplementiertes verfahren, vorrichtung und computerprogrammprodukt
DE112021001968T5 (de) Driftregularisierung zum entgegenwirken einer variation in driftkoeffizienten für analoge beschleuniger

Legal Events

Date Code Title Description
R012 Request for examination validly filed
R016 Response to examination communication
R018 Grant decision by examination section/examining division
R084 Declaration of willingness to licence
R020 Patent grant now final