CN111373414B - 用于减少固定设备不对称性的具有极性反转的电导对之间的突触权重传递 - Google Patents

用于减少固定设备不对称性的具有极性反转的电导对之间的突触权重传递 Download PDF

Info

Publication number
CN111373414B
CN111373414B CN201880074824.XA CN201880074824A CN111373414B CN 111373414 B CN111373414 B CN 111373414B CN 201880074824 A CN201880074824 A CN 201880074824A CN 111373414 B CN111373414 B CN 111373414B
Authority
CN
China
Prior art keywords
conductance
ann
pair
neurons
pairs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880074824.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN111373414A (zh
Inventor
G·伯尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CN111373414A publication Critical patent/CN111373414A/zh
Application granted granted Critical
Publication of CN111373414B publication Critical patent/CN111373414B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Neurology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Semiconductor Memories (AREA)
CN201880074824.XA 2017-11-20 2018-11-19 用于减少固定设备不对称性的具有极性反转的电导对之间的突触权重传递 Active CN111373414B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/818,521 US11074499B2 (en) 2017-11-20 2017-11-20 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
US15/818,521 2017-11-20
PCT/IB2018/059102 WO2019097494A1 (en) 2017-11-20 2018-11-19 Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Publications (2)

Publication Number Publication Date
CN111373414A CN111373414A (zh) 2020-07-03
CN111373414B true CN111373414B (zh) 2023-08-25

Family

ID=66533047

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880074824.XA Active CN111373414B (zh) 2017-11-20 2018-11-19 用于减少固定设备不对称性的具有极性反转的电导对之间的突触权重传递

Country Status (6)

Country Link
US (2) US11074499B2 (cg-RX-API-DMAC7.html)
JP (1) JP7139426B2 (cg-RX-API-DMAC7.html)
CN (1) CN111373414B (cg-RX-API-DMAC7.html)
DE (1) DE112018004992B4 (cg-RX-API-DMAC7.html)
GB (1) GB2581310B (cg-RX-API-DMAC7.html)
WO (1) WO2019097494A1 (cg-RX-API-DMAC7.html)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
EP3701351A4 (en) 2018-01-30 2021-01-27 D5Ai Llc SELF-ORGANIZING PARTIALLY ORGANIZED NETWORKS
US11694065B2 (en) 2019-08-28 2023-07-04 Micron Technology, Inc. Spiking neural unit
US11183238B2 (en) 2019-08-28 2021-11-23 International Business Machines Corporation Suppressing outlier drift coefficients while programming phase change memory synapses
US12052260B2 (en) 2019-09-30 2024-07-30 International Business Machines Corporation Scalable and dynamic transfer learning mechanism
KR102782076B1 (ko) 2019-12-13 2025-03-18 삼성전자주식회사 스위칭 소자와 저항 소자를 포함하는 3차원 뉴로모픽 장치
US11475946B2 (en) 2020-01-16 2022-10-18 International Business Machines Corporation Synapse weight update compensation
KR102873065B1 (ko) * 2020-04-23 2025-10-16 삼성전자주식회사 뉴로모픽 컴퓨팅 장치 및 그것의 동작 방법
US12156486B2 (en) 2020-12-02 2024-11-26 International Business Machines Corporation Horizontal RRAM device and architecture for variability reduction
US11908458B2 (en) * 2020-12-29 2024-02-20 International Business Machines Corporation Customization of recurrent neural network transducers for speech recognition
US12626111B2 (en) * 2021-06-17 2026-05-12 International Business Machines Corporation Calibrating peripheral variability
KR102574156B1 (ko) 2021-07-06 2023-09-01 고려대학교 산학협력단 역전파와 음수 가중치 설정이 가능한 뉴로모픽 회로
KR102514652B1 (ko) * 2021-11-19 2023-03-29 서울대학교산학협력단 뉴로모픽 소자를 위한 가중치 전사 장치 및 이를 이용한 가중치 전사 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5101361A (en) * 1989-09-29 1992-03-31 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Analog hardware for delta-backpropagation neural networks
CN101364594A (zh) * 2007-08-09 2009-02-11 中国科学院半导体研究所 硅基单电子神经元量子电路
CN203661036U (zh) * 2013-12-20 2014-06-18 浙江大学城市学院 一种基于浮栅技术的二值动态BiCMOS与门电路

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0768610B1 (en) 1995-10-13 2000-08-09 STMicroelectronics S.r.l. Low-voltage, very-low-power neural network
US7814038B1 (en) 2007-12-06 2010-10-12 Dominic John Repici Feedback-tolerant method and device producing weight-adjustment factors for pre-synaptic neurons in artificial neural networks
WO2010133925A1 (en) 2009-05-20 2010-11-25 Universite Paris Sud (Paris 11) Teaching method for a neuronal nano- block
US9665822B2 (en) 2010-06-30 2017-05-30 International Business Machines Corporation Canonical spiking neuron network for spatiotemporal associative memory
US8694452B2 (en) 2010-07-07 2014-04-08 Qualcomm Incorporated Methods and systems for CMOS implementation of neuron synapse
US8676734B2 (en) 2010-07-07 2014-03-18 Qualcomm, Incorporated Methods and systems for replaceable synaptic weight storage in neuro-processors
US9092736B2 (en) 2010-07-07 2015-07-28 Qualcomm Incorporated Communication and synapse training method and hardware for biologically inspired networks
US8655813B2 (en) 2010-12-30 2014-02-18 International Business Machines Corporation Synaptic weight normalized spiking neuronal networks
US8832010B2 (en) 2012-01-04 2014-09-09 International Business Machines Corporation Electronic synapses from stochastic binary memory devices
CN103430186A (zh) * 2012-01-20 2013-12-04 松下电器产业株式会社 神经网络电路的学习方法
US20160364643A1 (en) 2012-03-08 2016-12-15 Hrl Laboratories Llc Scalable integrated circuit with synaptic electronics and cmos integrated memristors
US20150120631A1 (en) 2012-05-10 2015-04-30 Consejo Superior de Investagaciones Cientificas (CSIC) Method and System for Converting Pulsed-Processing Neural Network with Instantaneous Integration Synapses into Dynamic Integration Synapses
GB201209174D0 (en) 2012-05-25 2012-07-04 Univ Bath Neural network
US8811060B2 (en) 2012-05-31 2014-08-19 International Business Machines Corporation Non-volatile memory crosspoint repair
US9424514B2 (en) 2012-07-25 2016-08-23 Board Of Trustees Of Michigan State University Synapse maintenance in the developmental networks
US9218564B2 (en) 2012-07-30 2015-12-22 International Business Machines Corporation Providing transposable access to a synapse array using a recursive array layout
US20150019468A1 (en) 2013-07-09 2015-01-15 Knowmtech, Llc Thermodynamic computing
US9753959B2 (en) 2013-10-16 2017-09-05 University Of Tennessee Research Foundation Method and apparatus for constructing a neuroscience-inspired artificial neural network with visualization of neural pathways
US9619749B2 (en) 2014-03-06 2017-04-11 Progress, Inc. Neural network and method of neural network training
US9990580B2 (en) 2015-03-13 2018-06-05 International Business Machines Corporation Neuromorphic synapses
US10460237B2 (en) * 2015-11-30 2019-10-29 International Business Machines Corporation Neuron-centric local learning rate for artificial neural networks to increase performance, learning rate margin, and reduce power consumption
US10891543B2 (en) 2015-12-28 2021-01-12 Samsung Electronics Co., Ltd. LUT based synapse weight update scheme in STDP neuromorphic systems
US10614355B2 (en) 2015-12-30 2020-04-07 SK Hynix Inc. Method for updating weights of synapses of a neuromorphic device
US9715656B1 (en) 2016-09-12 2017-07-25 International Business Machines Corporation Killing asymmetric resistive processing units for neural network training
US11270194B2 (en) 2017-07-26 2022-03-08 International Business Machines Corporation System and method for constructing synaptic weights for artificial neural networks from signed analog conductance-pairs of varying significance
US11074499B2 (en) 2017-11-20 2021-07-27 International Business Machines Corporation Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5101361A (en) * 1989-09-29 1992-03-31 The United States Of America As Represented By The Administrator Of The National Aeronautics And Space Administration Analog hardware for delta-backpropagation neural networks
CN101364594A (zh) * 2007-08-09 2009-02-11 中国科学院半导体研究所 硅基单电子神经元量子电路
CN203661036U (zh) * 2013-12-20 2014-06-18 浙江大学城市学院 一种基于浮栅技术的二值动态BiCMOS与门电路

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于平面晶体管型器件的突触可塑性模拟;陈艳;张晨曦;王来源;李腾飞;朱颖;仪明东;黄维;;科学通报(第Z2期);全文 *

Also Published As

Publication number Publication date
DE112018004992T5 (de) 2020-06-10
JP7139426B2 (ja) 2022-09-20
GB2581310A (en) 2020-08-12
GB2581310B (en) 2020-12-09
CN111373414A (zh) 2020-07-03
US20210287090A1 (en) 2021-09-16
US11074499B2 (en) 2021-07-27
GB202008959D0 (en) 2020-07-29
JP2021503649A (ja) 2021-02-12
DE112018004992B4 (de) 2023-11-02
WO2019097494A1 (en) 2019-05-23
US11915132B2 (en) 2024-02-27
US20190156194A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
US11915132B2 (en) Synaptic weight transfer between conductance pairs with polarity inversion for reducing fixed device asymmetries
CN110945535B (zh) 一种在人工神经网络ann中实现的方法
Nandakumar et al. Mixed-precision architecture based on computational memory for training deep neural networks
US9779355B1 (en) Back propagation gates and storage capacitor for neural networks
CN112005252B (zh) 具有单独权重更新和干扰电路的电阻式处理单元架构
JP7228320B2 (ja) ニューロモーフィック・チップ、ニューロモーフィック・システム、ニューロモーフィック・チップ内のシナプス重みを更新するための方法およびコンピュータ・プログラム
JP7288047B2 (ja) アナログ・クロスポイント・アレイにおいて対称点をゼロ重み点として一致させるためのアライメント方法、そのベクトル行列
US10664745B2 (en) Resistive processing units and neural network training methods
US11087204B2 (en) Resistive processing unit with multiple weight readers
US10453527B1 (en) In-cell differential read-out circuitry for reading signed weight values in resistive processing unit architecture
CN113728338B (zh) 利用非对称rpu器件的dnn训练
CN111433792A (zh) 可编程可重置人工神经网络的基于计数器的电阻处理单元
US12229680B2 (en) Neural network accelerators resilient to conductance drift
US20210064974A1 (en) Formation failure resilient neuromorphic device
US12230321B2 (en) Device with neural network
JP2022534380A (ja) Rpuアレイのためのノイズおよび信号管理
CN110651330A (zh) 二分忆阻网络中的深度学习
Gnawali et al. Reliability enhancements in memristive neural network architectures
Kim et al. VCAM: Variation compensation through activation matching for analog binarized neural networks
US12417803B2 (en) Neural network based method and device
KR20230029759A (ko) 아날로그 크로스바 어레이들을 업데이트하기 위한 희소 수정가능 비트 길이 결정 펄스 생성
CN116128035B (zh) 训练方法及装置、电子设备和计算机存储介质
JP7724873B2 (ja) ディープ・ニューラル・ネットワーク・トレーニング
JP2023533846A (ja) クロスバーアレイを更新するためのパルス生成
Mehonic Algorithmic Optimisation for Memristive Deep Learning Accelerators

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant