JP7357080B2 - Ｒｐｕアレイのためのノイズおよび信号管理 - Google Patents

Ｒｐｕアレイのためのノイズおよび信号管理 Download PDF

Info

Publication number
JP7357080B2
JP7357080B2 JP2021569493A JP2021569493A JP7357080B2 JP 7357080 B2 JP7357080 B2 JP 7357080B2 JP 2021569493 A JP2021569493 A JP 2021569493A JP 2021569493 A JP2021569493 A JP 2021569493A JP 7357080 B2 JP7357080 B2 JP 7357080B2
Authority
JP
Japan
Prior art keywords
normalizer
standard deviation
values
post
mean
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2021569493A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022534380A (ja
JP2022534380A5 (https=
Inventor
ヨハネス ラッシュ、マルテ
ゴクメン、タイフン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of JP2022534380A publication Critical patent/JP2022534380A/ja
Publication of JP2022534380A5 publication Critical patent/JP2022534380A5/ja
Application granted granted Critical
Publication of JP7357080B2 publication Critical patent/JP7357080B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G06N3/065—Analogue means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Complex Calculations (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
JP2021569493A 2019-05-31 2020-04-09 Ｒｐｕアレイのためのノイズおよび信号管理 Active JP7357080B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/427,559 2019-05-31
US16/427,559 US11361218B2 (en) 2019-05-31 2019-05-31 Noise and signal management for RPU array
PCT/IB2020/053407 WO2020240288A1 (en) 2019-05-31 2020-04-09 Noise and signal management for rpu array

Publications (3)

Publication Number Publication Date
JP2022534380A JP2022534380A (ja) 2022-07-29
JP2022534380A5 JP2022534380A5 (https=) 2022-09-15
JP7357080B2 true JP7357080B2 (ja) 2023-10-05

Family

ID=73550855

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021569493A Active JP7357080B2 (ja) 2019-05-31 2020-04-09 Ｒｐｕアレイのためのノイズおよび信号管理

Country Status (6)

Country Link
US (1) US11361218B2 (https=)
JP (1) JP7357080B2 (https=)
CN (1) CN113841164B (https=)
DE (1) DE112020002547T5 (https=)
GB (1) GB2597232B (https=)
WO (1) WO2020240288A1 (https=)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11482133B2 (en) * 2019-09-04 2022-10-25 Optum Services (Ireland) Limited Automatically modifying display presentations to programmatically accommodate for visual impairments
DE102019213898A1 (de) * 2019-09-11 2021-03-11 Robert Bosch Gmbh Robustes und besser trainierbares künstliches neuronales Netzwerk
US12488250B2 (en) 2020-11-02 2025-12-02 International Business Machines Corporation Weight repetition on RPU crossbar arrays
US12169534B2 (en) * 2020-12-07 2024-12-17 International Business Machines Corporation Worst case noise and bound management for RPU crossbar arrays
US12112264B2 (en) 2020-12-15 2024-10-08 International Business Machines Corporation Dynamic configuration of readout circuitry for different operations in analog resistive crossbar array
US12585940B2 (en) * 2021-09-25 2026-03-24 International Business Machines Corporation Learning static bound management parameters for analog resistive processing unit system
US20240086677A1 (en) * 2022-09-12 2024-03-14 International Business Machines Corporation Learned column-weights for rapid-estimation of properties of an entire excitation vector
CN118487605B (zh) * 2024-05-08 2025-10-14 北京犀灵视觉科技有限公司 感存算融合处理场景的模拟域信号归一化方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017010232A (ja) 2015-06-22 2017-01-12 株式会社日立製作所 プラント診断装置及びプラント診断方法
US20180293208A1 (en) 2017-04-05 2018-10-11 International Business Machines Corporation Noise and bound management for rpu array
JP2019502970A (ja) 2015-10-20 2019-01-31 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 抵抗型処理ユニット
JP2020514886A (ja) 2017-03-01 2020-05-21 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 抵抗型処理ユニットアレイ、抵抗型処理ユニットアレイを形成する方法およびヒステリシス動作のための方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5500905A (en) 1991-06-12 1996-03-19 Microelectronics And Computer Technology Corporation Pattern recognition neural network with saccade-like operation
CA2081036C (en) 1991-12-19 1999-08-03 Ahmed Hashem Abdelmonem Method and apparatus for predicting transmission system errors and failures
US6078843A (en) 1997-01-24 2000-06-20 Honeywell Inc. Neural network including input normalization for use in a closed loop control system
US6054710A (en) 1997-12-18 2000-04-25 Cypress Semiconductor Corp. Method and apparatus for obtaining two- or three-dimensional information from scanning electron microscopy
EP3483795B1 (en) * 2015-01-28 2021-03-10 Google LLC Batch normalization layers
US10373054B2 (en) 2015-04-19 2019-08-06 International Business Machines Corporation Annealed dropout training of neural networks
WO2017214507A1 (en) * 2016-06-09 2017-12-14 Progress, Inc. Neural network and method of neural network training
US9646243B1 (en) 2016-09-12 2017-05-09 International Business Machines Corporation Convolutional neural networks using resistive processing unit array
US10990874B2 (en) 2017-05-22 2021-04-27 Sap Se Predicting wildfires on the basis of biophysical indicators and spatiotemporal properties using a convolutional neural network
US10192161B1 (en) 2017-12-13 2019-01-29 International Business Machines Corporation Lithium-drift based resistive processing unit for accelerating machine learning training
US11947668B2 (en) * 2018-10-12 2024-04-02 Sophos Limited Methods and apparatus for preserving information between layers within a neural network
EP3921796B1 (en) * 2019-02-06 2026-04-08 The University of British Columbia Neural network image analysis

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017010232A (ja) 2015-06-22 2017-01-12 株式会社日立製作所 プラント診断装置及びプラント診断方法
JP2019502970A (ja) 2015-10-20 2019-01-31 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 抵抗型処理ユニット
JP2020514886A (ja) 2017-03-01 2020-05-21 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 抵抗型処理ユニットアレイ、抵抗型処理ユニットアレイを形成する方法およびヒステリシス動作のための方法
US20180293208A1 (en) 2017-04-05 2018-10-11 International Business Machines Corporation Noise and bound management for rpu array

Also Published As

Publication number Publication date
US20200380348A1 (en) 2020-12-03
GB2597232B (en) 2023-02-15
JP2022534380A (ja) 2022-07-29
CN113841164B (zh) 2023-05-16
GB2597232A (en) 2022-01-19
US11361218B2 (en) 2022-06-14
DE112020002547T5 (de) 2022-03-03
WO2020240288A1 (en) 2020-12-03
GB202116922D0 (en) 2022-01-05
CN113841164A (zh) 2021-12-24

Similar Documents

Publication Publication Date Title
JP7357080B2 (ja) Ｒｐｕアレイのためのノイズおよび信号管理
US11556770B2 (en) Auto weight scaling for RPUs
CN107924227B (zh) 电阻处理单元
JP7422782B2 (ja) 非対称ｒｐｕデバイスによるｄｎｎの訓練
US9646243B1 (en) Convolutional neural networks using resistive processing unit array
US20220058492A1 (en) Delta-sigma modulation neurons for high-precision training of memristive synapses in deep neural networks
US12229680B2 (en) Neural network accelerators resilient to conductance drift
JP7649616B2 (ja) 隠れ行列訓練ｄｎｎのフィルタリング
US20230195832A1 (en) Calibration of matrix-vector operations on resistive processing unit hardware
JP7692477B2 (ja) Ｒｐｕクロスバー・アレイ上の重み反復
KR102714239B1 (ko) 아날로그 크로스바 어레이들을 업데이트하기 위한 희소 수정가능 비트 길이 결정 펄스 생성
JP7724873B2 (ja) ディープ・ニューラル・ネットワーク・トレーニング

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20220512

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220905

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220922

TRDD Decision of grant or rejection written
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20230831

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230905

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230925

R150 Certificate of patent or registration of utility model

Ref document number: 7357080

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150