CN113841164B - Rpu阵列的噪声和信号管理 - Google Patents

Rpu阵列的噪声和信号管理 Download PDF

Info

Publication number
CN113841164B
CN113841164B CN202080037034.1A CN202080037034A CN113841164B CN 113841164 B CN113841164 B CN 113841164B CN 202080037034 A CN202080037034 A CN 202080037034A CN 113841164 B CN113841164 B CN 113841164B
Authority
CN
China
Prior art keywords
standard deviation
normalizer
post
mean
vectors
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080037034.1A
Other languages
English (en)
Chinese (zh)
Other versions
CN113841164A (zh
Inventor
M.J.拉施
T.戈克曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CN113841164A publication Critical patent/CN113841164A/zh
Application granted granted Critical
Publication of CN113841164B publication Critical patent/CN113841164B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Complex Calculations (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
CN202080037034.1A 2019-05-31 2020-04-09 Rpu阵列的噪声和信号管理 Active CN113841164B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/427,559 2019-05-31
US16/427,559 US11361218B2 (en) 2019-05-31 2019-05-31 Noise and signal management for RPU array
PCT/IB2020/053407 WO2020240288A1 (en) 2019-05-31 2020-04-09 Noise and signal management for rpu array

Publications (2)

Publication Number Publication Date
CN113841164A CN113841164A (zh) 2021-12-24
CN113841164B true CN113841164B (zh) 2023-05-16

Family

ID=73550855

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080037034.1A Active CN113841164B (zh) 2019-05-31 2020-04-09 Rpu阵列的噪声和信号管理

Country Status (6)

Country Link
US (1) US11361218B2 (https=)
JP (1) JP7357080B2 (https=)
CN (1) CN113841164B (https=)
DE (1) DE112020002547T5 (https=)
GB (1) GB2597232B (https=)
WO (1) WO2020240288A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11482133B2 (en) * 2019-09-04 2022-10-25 Optum Services (Ireland) Limited Automatically modifying display presentations to programmatically accommodate for visual impairments
DE102019213898A1 (de) * 2019-09-11 2021-03-11 Robert Bosch Gmbh Robustes und besser trainierbares künstliches neuronales Netzwerk
US12488250B2 (en) 2020-11-02 2025-12-02 International Business Machines Corporation Weight repetition on RPU crossbar arrays
US12169534B2 (en) * 2020-12-07 2024-12-17 International Business Machines Corporation Worst case noise and bound management for RPU crossbar arrays
US12112264B2 (en) 2020-12-15 2024-10-08 International Business Machines Corporation Dynamic configuration of readout circuitry for different operations in analog resistive crossbar array
US12585940B2 (en) * 2021-09-25 2026-03-24 International Business Machines Corporation Learning static bound management parameters for analog resistive processing unit system
US20240086677A1 (en) * 2022-09-12 2024-03-14 International Business Machines Corporation Learned column-weights for rapid-estimation of properties of an entire excitation vector
CN118487605B (zh) * 2024-05-08 2025-10-14 北京犀灵视觉科技有限公司 感存算融合处理场景的模拟域信号归一化方法及装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5500905A (en) * 1991-06-12 1996-03-19 Microelectronics And Computer Technology Corporation Pattern recognition neural network with saccade-like operation
US10192161B1 (en) * 2017-12-13 2019-01-29 International Business Machines Corporation Lithium-drift based resistive processing unit for accelerating machine learning training
CN109416758A (zh) * 2016-06-09 2019-03-01 前进公司 神经网络及神经网络训练的方法

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2081036C (en) 1991-12-19 1999-08-03 Ahmed Hashem Abdelmonem Method and apparatus for predicting transmission system errors and failures
US6078843A (en) 1997-01-24 2000-06-20 Honeywell Inc. Neural network including input normalization for use in a closed loop control system
US6054710A (en) 1997-12-18 2000-04-25 Cypress Semiconductor Corp. Method and apparatus for obtaining two- or three-dimensional information from scanning electron microscopy
EP3483795B1 (en) * 2015-01-28 2021-03-10 Google LLC Batch normalization layers
US10373054B2 (en) 2015-04-19 2019-08-06 International Business Machines Corporation Annealed dropout training of neural networks
JP6523815B2 (ja) * 2015-06-22 2019-06-05 株式会社日立製作所 プラント診断装置及びプラント診断方法
US10248907B2 (en) * 2015-10-20 2019-04-02 International Business Machines Corporation Resistive processing unit
US9646243B1 (en) 2016-09-12 2017-05-09 International Business Machines Corporation Convolutional neural networks using resistive processing unit array
US10755170B2 (en) * 2017-03-01 2020-08-25 International Business Machines Corporation Resistive processing unit with hysteretic updates for neural network training
US10325007B2 (en) 2017-04-05 2019-06-18 International Business Machines Corporation Noise and bound management for RPU array
US10990874B2 (en) 2017-05-22 2021-04-27 Sap Se Predicting wildfires on the basis of biophysical indicators and spatiotemporal properties using a convolutional neural network
US11947668B2 (en) * 2018-10-12 2024-04-02 Sophos Limited Methods and apparatus for preserving information between layers within a neural network
EP3921796B1 (en) * 2019-02-06 2026-04-08 The University of British Columbia Neural network image analysis

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5500905A (en) * 1991-06-12 1996-03-19 Microelectronics And Computer Technology Corporation Pattern recognition neural network with saccade-like operation
CN109416758A (zh) * 2016-06-09 2019-03-01 前进公司 神经网络及神经网络训练的方法
US10192161B1 (en) * 2017-12-13 2019-01-29 International Business Machines Corporation Lithium-drift based resistive processing unit for accelerating machine learning training

Also Published As

Publication number Publication date
US20200380348A1 (en) 2020-12-03
GB2597232B (en) 2023-02-15
JP2022534380A (ja) 2022-07-29
JP7357080B2 (ja) 2023-10-05
GB2597232A (en) 2022-01-19
US11361218B2 (en) 2022-06-14
DE112020002547T5 (de) 2022-03-03
WO2020240288A1 (en) 2020-12-03
GB202116922D0 (en) 2022-01-05
CN113841164A (zh) 2021-12-24

Similar Documents

Publication Publication Date Title
CN113841164B (zh) Rpu阵列的噪声和信号管理
US11386319B2 (en) Training of artificial neural networks
KR102672586B1 (ko) 인공신경망의 훈련 방법 및 장치
US11556770B2 (en) Auto weight scaling for RPUs
JP7422782B2 (ja) 非対称ｒｐｕデバイスによるｄｎｎの訓練
US12585940B2 (en) Learning static bound management parameters for analog resistive processing unit system
JP7649616B2 (ja) 隠れ行列訓練ｄｎｎのフィルタリング
US12229680B2 (en) Neural network accelerators resilient to conductance drift
JP7692477B2 (ja) Ｒｐｕクロスバー・アレイ上の重み反復
KR102714239B1 (ko) 아날로그 크로스바 어레이들을 업데이트하기 위한 희소 수정가능 비트 길이 결정 펄스 생성
JP7724873B2 (ja) ディープ・ニューラル・ネットワーク・トレーニング
WO2024083180A1 (en) Dnn training algorithm with dynamically computed zero-reference.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant