DE112018004992B4 - Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien - Google Patents
Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien Download PDFInfo
- Publication number
- DE112018004992B4 DE112018004992B4 DE112018004992.2T DE112018004992T DE112018004992B4 DE 112018004992 B4 DE112018004992 B4 DE 112018004992B4 DE 112018004992 T DE112018004992 T DE 112018004992T DE 112018004992 B4 DE112018004992 B4 DE 112018004992B4
- Authority
- DE
- Germany
- Prior art keywords
- conductivity
- conductance
- pair
- neurons
- synaptic weight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
- G06N3/065—Analogue means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0499—Feedforward networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Neurology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Image Analysis (AREA)
- Semiconductor Memories (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/818,521 US11074499B2 (en) | 2017-11-20 | 2017-11-20 | Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries |
| US15/818,521 | 2017-11-20 | ||
| PCT/IB2018/059102 WO2019097494A1 (en) | 2017-11-20 | 2018-11-19 | Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| DE112018004992T5 DE112018004992T5 (de) | 2020-06-10 |
| DE112018004992B4 true DE112018004992B4 (de) | 2023-11-02 |
Family
ID=66533047
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| DE112018004992.2T Active DE112018004992B4 (de) | 2017-11-20 | 2018-11-19 | Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US11074499B2 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7139426B2 (cg-RX-API-DMAC7.html) |
| CN (1) | CN111373414B (cg-RX-API-DMAC7.html) |
| DE (1) | DE112018004992B4 (cg-RX-API-DMAC7.html) |
| GB (1) | GB2581310B (cg-RX-API-DMAC7.html) |
| WO (1) | WO2019097494A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11074499B2 (en) | 2017-11-20 | 2021-07-27 | International Business Machines Corporation | Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries |
| EP3701351A4 (en) | 2018-01-30 | 2021-01-27 | D5Ai Llc | SELF-ORGANIZING PARTIALLY ORGANIZED NETWORKS |
| US11694065B2 (en) | 2019-08-28 | 2023-07-04 | Micron Technology, Inc. | Spiking neural unit |
| US11183238B2 (en) | 2019-08-28 | 2021-11-23 | International Business Machines Corporation | Suppressing outlier drift coefficients while programming phase change memory synapses |
| US12052260B2 (en) | 2019-09-30 | 2024-07-30 | International Business Machines Corporation | Scalable and dynamic transfer learning mechanism |
| KR102782076B1 (ko) | 2019-12-13 | 2025-03-18 | 삼성전자주식회사 | 스위칭 소자와 저항 소자를 포함하는 3차원 뉴로모픽 장치 |
| US11475946B2 (en) | 2020-01-16 | 2022-10-18 | International Business Machines Corporation | Synapse weight update compensation |
| KR102873065B1 (ko) * | 2020-04-23 | 2025-10-16 | 삼성전자주식회사 | 뉴로모픽 컴퓨팅 장치 및 그것의 동작 방법 |
| US12156486B2 (en) | 2020-12-02 | 2024-11-26 | International Business Machines Corporation | Horizontal RRAM device and architecture for variability reduction |
| US11908458B2 (en) * | 2020-12-29 | 2024-02-20 | International Business Machines Corporation | Customization of recurrent neural network transducers for speech recognition |
| US12626111B2 (en) * | 2021-06-17 | 2026-05-12 | International Business Machines Corporation | Calibrating peripheral variability |
| KR102574156B1 (ko) | 2021-07-06 | 2023-09-01 | 고려대학교 산학협력단 | 역전파와 음수 가중치 설정이 가능한 뉴로모픽 회로 |
| KR102514652B1 (ko) * | 2021-11-19 | 2023-03-29 | 서울대학교산학협력단 | 뉴로모픽 소자를 위한 가중치 전사 장치 및 이를 이용한 가중치 전사 방법 |
Family Cites Families (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5101361A (en) * | 1989-09-29 | 1992-03-31 | The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration | Analog hardware for delta-backpropagation neural networks |
| EP0768610B1 (en) | 1995-10-13 | 2000-08-09 | STMicroelectronics S.r.l. | Low-voltage, very-low-power neural network |
| CN101364594B (zh) * | 2007-08-09 | 2010-06-02 | 中国科学院半导体研究所 | 硅基单电子神经元量子电路 |
| US7814038B1 (en) | 2007-12-06 | 2010-10-12 | Dominic John Repici | Feedback-tolerant method and device producing weight-adjustment factors for pre-synaptic neurons in artificial neural networks |
| WO2010133925A1 (en) | 2009-05-20 | 2010-11-25 | Universite Paris Sud (Paris 11) | Teaching method for a neuronal nano- block |
| US9665822B2 (en) | 2010-06-30 | 2017-05-30 | International Business Machines Corporation | Canonical spiking neuron network for spatiotemporal associative memory |
| US8694452B2 (en) | 2010-07-07 | 2014-04-08 | Qualcomm Incorporated | Methods and systems for CMOS implementation of neuron synapse |
| US8676734B2 (en) | 2010-07-07 | 2014-03-18 | Qualcomm, Incorporated | Methods and systems for replaceable synaptic weight storage in neuro-processors |
| US9092736B2 (en) | 2010-07-07 | 2015-07-28 | Qualcomm Incorporated | Communication and synapse training method and hardware for biologically inspired networks |
| US8655813B2 (en) | 2010-12-30 | 2014-02-18 | International Business Machines Corporation | Synaptic weight normalized spiking neuronal networks |
| US8832010B2 (en) | 2012-01-04 | 2014-09-09 | International Business Machines Corporation | Electronic synapses from stochastic binary memory devices |
| CN103430186A (zh) * | 2012-01-20 | 2013-12-04 | 松下电器产业株式会社 | 神经网络电路的学习方法 |
| US20160364643A1 (en) | 2012-03-08 | 2016-12-15 | Hrl Laboratories Llc | Scalable integrated circuit with synaptic electronics and cmos integrated memristors |
| US20150120631A1 (en) | 2012-05-10 | 2015-04-30 | Consejo Superior de Investagaciones Cientificas (CSIC) | Method and System for Converting Pulsed-Processing Neural Network with Instantaneous Integration Synapses into Dynamic Integration Synapses |
| GB201209174D0 (en) | 2012-05-25 | 2012-07-04 | Univ Bath | Neural network |
| US8811060B2 (en) | 2012-05-31 | 2014-08-19 | International Business Machines Corporation | Non-volatile memory crosspoint repair |
| US9424514B2 (en) | 2012-07-25 | 2016-08-23 | Board Of Trustees Of Michigan State University | Synapse maintenance in the developmental networks |
| US9218564B2 (en) | 2012-07-30 | 2015-12-22 | International Business Machines Corporation | Providing transposable access to a synapse array using a recursive array layout |
| US20150019468A1 (en) | 2013-07-09 | 2015-01-15 | Knowmtech, Llc | Thermodynamic computing |
| US9753959B2 (en) | 2013-10-16 | 2017-09-05 | University Of Tennessee Research Foundation | Method and apparatus for constructing a neuroscience-inspired artificial neural network with visualization of neural pathways |
| CN203661036U (zh) * | 2013-12-20 | 2014-06-18 | 浙江大学城市学院 | 一种基于浮栅技术的二值动态BiCMOS与门电路 |
| US9619749B2 (en) | 2014-03-06 | 2017-04-11 | Progress, Inc. | Neural network and method of neural network training |
| US9990580B2 (en) | 2015-03-13 | 2018-06-05 | International Business Machines Corporation | Neuromorphic synapses |
| US10460237B2 (en) * | 2015-11-30 | 2019-10-29 | International Business Machines Corporation | Neuron-centric local learning rate for artificial neural networks to increase performance, learning rate margin, and reduce power consumption |
| US10891543B2 (en) | 2015-12-28 | 2021-01-12 | Samsung Electronics Co., Ltd. | LUT based synapse weight update scheme in STDP neuromorphic systems |
| US10614355B2 (en) | 2015-12-30 | 2020-04-07 | SK Hynix Inc. | Method for updating weights of synapses of a neuromorphic device |
| US9715656B1 (en) | 2016-09-12 | 2017-07-25 | International Business Machines Corporation | Killing asymmetric resistive processing units for neural network training |
| US11270194B2 (en) | 2017-07-26 | 2022-03-08 | International Business Machines Corporation | System and method for constructing synaptic weights for artificial neural networks from signed analog conductance-pairs of varying significance |
| US11074499B2 (en) | 2017-11-20 | 2021-07-27 | International Business Machines Corporation | Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries |
-
2017
- 2017-11-20 US US15/818,521 patent/US11074499B2/en active Active
-
2018
- 2018-11-19 JP JP2020526371A patent/JP7139426B2/ja active Active
- 2018-11-19 GB GB2008959.5A patent/GB2581310B/en active Active
- 2018-11-19 CN CN201880074824.XA patent/CN111373414B/zh active Active
- 2018-11-19 WO PCT/IB2018/059102 patent/WO2019097494A1/en not_active Ceased
- 2018-11-19 DE DE112018004992.2T patent/DE112018004992B4/de active Active
-
2021
- 2021-05-25 US US17/329,245 patent/US11915132B2/en active Active
Non-Patent Citations (2)
| Title |
|---|
| AGARWAL, Sapan, et al.: Achieving ideal accuracies in analog neuromorphic computing using periodic carry. In: 2017 Symposium on VLSI Technology, 03.08.2017, S. T174-T175. https://doi.org/10.23919/VLSIT.2017.7998164 [abgerufen am 07.06.2023] |
| BURR, Geoffrey W., et al.: Experimental demonstration and tolerancing of a large-scale neural network (165 000 synapses) using phase-change memory as the synaptic weight element. In: IEEE Transactions on Electron Devices, 62, 2015, 11, S. 3498-3507. https://doi.org/10.1109/TED.2015.2439635 [abgerufen am 06.06.2023] |
Also Published As
| Publication number | Publication date |
|---|---|
| DE112018004992T5 (de) | 2020-06-10 |
| CN111373414B (zh) | 2023-08-25 |
| JP7139426B2 (ja) | 2022-09-20 |
| GB2581310A (en) | 2020-08-12 |
| GB2581310B (en) | 2020-12-09 |
| CN111373414A (zh) | 2020-07-03 |
| US20210287090A1 (en) | 2021-09-16 |
| US11074499B2 (en) | 2021-07-27 |
| GB202008959D0 (en) | 2020-07-29 |
| JP2021503649A (ja) | 2021-02-12 |
| WO2019097494A1 (en) | 2019-05-23 |
| US11915132B2 (en) | 2024-02-27 |
| US20190156194A1 (en) | 2019-05-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE112018004992T5 (de) | Übertragung synaptischer gewichte zwischen leitfähigkeitspaaren mitpolaritätsumkehr zum verringern fester einheitenasymmetrien | |
| DE112018002950B4 (de) | System und Verfahren zum Aufbauen von synaptischen Gewichten für künstliche neuronale Netze aus mit Vorzeichen versehenen analogen Leitwertpaaren unterschiedlicher Wertigkeit | |
| DE112019000437B4 (de) | Architektur einer resistiven verarbeitungseinheit mit voneinander getrennter gewichtungsaktualisierungs- und inferenzschaltung | |
| DE112016003245B4 (de) | Resistive Verarbeitungseinheit | |
| DE112018004223B4 (de) | Trainieren künstlicher neuronaler Netze | |
| DE112018005726B4 (de) | Resistive verarbeitungseinheit auf zählerbasis für programmierbare und rekonfigurierbare künstliche neuronale netzwerke | |
| DE112018000272T5 (de) | Resistive Verarbeitungseinheit mit hysteretischen Aktualisierungen zum Trainieren neuronaler Netze | |
| DE112019005119T5 (de) | Abgleichtechniken zum angleichen des symmetriepunktes als null-gewichtungspunkt in analogen kreuzungspunktanordnungen | |
| DE102019116305A1 (de) | Pipelining zur verbesserung der inferenzgenauigkeit neuronaler netze | |
| DE112011101370T5 (de) | Neuronales Netz mit kanonischen gepulsten Neuronen für einen raumzeitlichen Assoziativspeicher | |
| DE112020002186B4 (de) | Dnn-training mit asymmetrischen rpu-einheiten | |
| DE112021006459T5 (de) | Dynamische konfiguration einer auslese-schaltungsanordnung für verschiedene operationen in einem analogen resistiven kreuzschienen-array | |
| WO2013170843A1 (de) | Verfahren zum trainieren eines künstlichen neuronalen netzes | |
| WO2005024717A1 (de) | System und verfahren zur automatisierten erfahrungstarifierung und/oder schadensreservierung | |
| DE4016197A1 (de) | Neuralnetzwerk mit einer matrix zum berechnen der uebereinstimmung zwischen zwei binaermustern | |
| DE112021002939T5 (de) | Effiziente kachel-zuordnung für zeilenweise zuordnung in neuronalen faltungsnetzen zur analogen inferenz in künstliche-intelligenz-netzen | |
| DE112020002547T5 (de) | Rausch- und signalverwaltung für rpu-array | |
| DE112021005218T5 (de) | Neuromorphe Einheit mit mehreren Anschlüssen | |
| DE102020106867A1 (de) | Vektor-matrix-multiplikation mit 3d-nand | |
| DE102020120212A1 (de) | Netzwerk zur automatischen Programmierspannungsauswahl | |
| DE112020003371T5 (de) | Unterdrücken von ausreisserdriftkoeffizienten während des programmierens von phasenwechsel-speichersynapsen | |
| DE112021004941B4 (de) | Gewichtungswiederholung in rpu-kreuzschienen-arrays | |
| DE112021006672T5 (de) | Dnn-training durch filtern mit versteckter matrix | |
| DE112021008566T5 (de) | Computerimplementiertes verfahren, vorrichtung und computerprogrammprodukt | |
| DE112021001968T5 (de) | Driftregularisierung zum entgegenwirken einer variation in driftkoeffizienten für analoge beschleuniger |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| R012 | Request for examination validly filed | ||
| R016 | Response to examination communication | ||
| R018 | Grant decision by examination section/examining division | ||
| R084 | Declaration of willingness to licence | ||
| R020 | Patent grant now final |