EP3756186A4 - Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz - Google Patents

Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz Download PDF

Info

Publication number
EP3756186A4
EP3756186A4 EP19888248.2A EP19888248A EP3756186A4 EP 3756186 A4 EP3756186 A4 EP 3756186A4 EP 19888248 A EP19888248 A EP 19888248A EP 3756186 A4 EP3756186 A4 EP 3756186A4
Authority
EP
European Patent Office
Prior art keywords
neural network
volatile memory
deep learning
memory die
learning neural
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19888248.2A
Other languages
English (en)
French (fr)
Other versions
EP3756186A2 (de
Inventor
Rami Rom
Ofir Pele
Alexander Bazarsky
Tomer Tzvi ELIASH
Ran ZAMIR
Karin Inbar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Western Digital Technologies Inc
Original Assignee
Western Digital Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/212,586 external-priority patent/US20200184335A1/en
Priority claimed from US16/212,596 external-priority patent/US11133059B2/en
Application filed by Western Digital Technologies Inc filed Critical Western Digital Technologies Inc
Priority to EP20178429.5A priority Critical patent/EP3789925A1/de
Publication of EP3756186A2 publication Critical patent/EP3756186A2/de
Publication of EP3756186A4 publication Critical patent/EP3756186A4/de
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Semiconductor Memories (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Complex Calculations (AREA)
  • Error Detection And Correction (AREA)
  • Retry When Errors Occur (AREA)
EP19888248.2A 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz Pending EP3756186A4 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP20178429.5A EP3789925A1 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/212,586 US20200184335A1 (en) 2018-12-06 2018-12-06 Non-volatile memory die with deep learning neural network
US16/212,596 US11133059B2 (en) 2018-12-06 2018-12-06 Non-volatile memory die with deep learning neural network
PCT/US2019/050105 WO2020117348A2 (en) 2018-12-06 2019-09-06 Non-volatile memory die with deep learning neural network

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP20178429.5A Division-Into EP3789925A1 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz
EP20178429.5A Division EP3789925A1 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz

Publications (2)

Publication Number Publication Date
EP3756186A2 EP3756186A2 (de) 2020-12-30
EP3756186A4 true EP3756186A4 (de) 2021-06-02

Family

ID=70975628

Family Applications (2)

Application Number Title Priority Date Filing Date
EP19888248.2A Pending EP3756186A4 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz
EP20178429.5A Pending EP3789925A1 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP20178429.5A Pending EP3789925A1 (de) 2018-12-06 2019-09-06 Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz

Country Status (3)

Country Link
EP (2) EP3756186A4 (de)
CN (2) CN117669663A (de)
WO (1) WO2020117348A2 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112182965B (zh) * 2020-09-25 2024-02-02 苏州融睿纳米复材科技有限公司 一种基于深度学习来设计红外相变材料的方法
WO2022132287A1 (en) * 2020-12-15 2022-06-23 Microchip Technology Inc. Method and apparatus for performing a neural network operation
CN112598122B (zh) * 2020-12-23 2023-09-05 北方工业大学 一种基于可变电阻式随机存储器的卷积神经网络加速器
CN112669893B (zh) * 2020-12-30 2022-08-16 杭州海康存储科技有限公司 确定待使用读电压的方法、系统、装置及设备
US11514992B2 (en) 2021-02-25 2022-11-29 Microchip Technology Inc. Method and apparatus for reading a flash memory device
US11934696B2 (en) 2021-05-18 2024-03-19 Microchip Technology Inc. Machine learning assisted quality of service (QoS) for solid state drives
US11699493B2 (en) 2021-05-24 2023-07-11 Microchip Technology Inc. Method and apparatus for performing a read of a flash memory using predicted retention-and-read-disturb-compensated threshold voltage shift offset values
US11514994B1 (en) 2021-05-28 2022-11-29 Microchip Technology Inc. Method and apparatus for outlier management
CN117480732A (zh) 2021-09-28 2024-01-30 微芯片技术股份有限公司 具有陷阱块管理的ldpc解码
CN114915496B (zh) * 2022-07-11 2023-01-10 广州番禺职业技术学院 基于时间权重和深度神经网络的网络入侵检测方法和装置

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180052766A1 (en) * 2016-08-16 2018-02-22 Western Digital Technologies, Inc. Non-volatile storage system with compute engine to accelerate big data applications

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9753695B2 (en) * 2012-09-04 2017-09-05 Analog Devices Global Datapath circuit for digital signal processors
FR3025344B1 (fr) * 2014-08-28 2017-11-24 Commissariat Energie Atomique Reseau de neurones convolutionnels
US9678832B2 (en) * 2014-09-18 2017-06-13 Sandisk Technologies Llc Storage module and method for on-chip copy gather
US9778863B2 (en) * 2014-09-30 2017-10-03 Sandisk Technologies Llc System and method for folding partial blocks into multi-level cell memory blocks
CN105488565A (zh) * 2015-11-17 2016-04-13 中国科学院计算技术研究所 加速深度神经网络算法的加速芯片的运算装置及方法
US10460237B2 (en) * 2015-11-30 2019-10-29 International Business Machines Corporation Neuron-centric local learning rate for artificial neural networks to increase performance, learning rate margin, and reduce power consumption
WO2017162129A1 (zh) * 2016-03-21 2017-09-28 成都海存艾匹科技有限公司 含有三维存储阵列的集成神经处理器
US11501131B2 (en) * 2016-09-09 2022-11-15 SK Hynix Inc. Neural network hardware accelerator architectures and operating method thereof
US9646243B1 (en) * 2016-09-12 2017-05-09 International Business Machines Corporation Convolutional neural networks using resistive processing unit array
US10846595B2 (en) * 2016-12-20 2020-11-24 Intel Corporation Rapid competitive learning techniques for neural networks
US10909449B2 (en) * 2017-04-14 2021-02-02 Samsung Electronics Co., Ltd. Monolithic multi-bit weight cell for neuromorphic computing
US10699778B2 (en) * 2017-04-28 2020-06-30 Arizona Board Of Regents On Behalf Of Arizona State University Static random access memory (SRAM) cell and related SRAM array for deep neural network and machine learning applications
KR102473579B1 (ko) * 2017-05-11 2022-12-01 포항공과대학교 산학협력단 가중치 소자 및 이의 작동 방법
US10127494B1 (en) * 2017-08-02 2018-11-13 Google Llc Neural network crossbar stack
CN108053848A (zh) * 2018-01-02 2018-05-18 清华大学 电路结构及神经网络芯片

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180052766A1 (en) * 2016-08-16 2018-02-22 Western Digital Technologies, Inc. Non-volatile storage system with compute engine to accelerate big data applications

Also Published As

Publication number Publication date
WO2020117348A3 (en) 2020-12-10
WO2020117348A2 (en) 2020-06-11
EP3789925A1 (de) 2021-03-10
CN112154460B (zh) 2024-05-28
EP3756186A2 (de) 2020-12-30
CN117669663A (zh) 2024-03-08
CN112154460A (zh) 2020-12-29

Similar Documents

Publication Publication Date Title
EP3756186A4 (de) Nichtflüchtige speichermatrix mit tiefenlernendem neuronalen netz
EP3718055A4 (de) Schaltungen neuronaler netze mit nichtflüchtigen synapsenarrays
EP3710998A4 (de) Maschinenlernmodelle auf der grundlage nicht-lokaler neuronaler netze
EP3673483A4 (de) Datenübertragung mit gestapelten speichermatrizen
EP3797386A4 (de) Tieflernsystem
EP3635782A4 (de) Speicherarrays
EP3635783A4 (de) Speicherarrays
EP3710990A4 (de) Metalernen für multitask-lernen für neuronale netze
EP3735656A4 (de) Programmierbares neuron für einen analogen nichtflüchtigen speicher in einem künstlichen neuronalen tiefenlernnetzwerk
EP3821466A4 (de) Vertikale speichervorrichtungen
EP3718110A4 (de) Operationen auf speicherzellen
EP3593263A4 (de) Intelligente pläne
EP3607435A4 (de) Verfahren und systeme zur verstärkung von tiefen neuronalen netzen für tiefenlernen
EP3769266A4 (de) Verarbeitungselement für neuronales netz
EP3472838A4 (de) Vermeidung von speicherzellenprägung
EP3459019A4 (de) Tiefenlernender neuronaler netzwerkklassifizierer mit nichtflüchtiger speicheranordnung
EP3766178A4 (de) Decodierer für analogen neuronalen speicher in einem künstlichen neuronalen tiefenlernnetz
EP3994693A4 (de) Neuronaler netzwerkspeicher
EP3427265A4 (de) Parallele zugriffstechniken innerhalb von speicherabschnitten durch streckenunabhängigkeit
EP3645727A4 (de) Dna-basiertes neuronales netzwerk
GB201800750D0 (en) Object tracking by unsupervised learning
EP3963462A4 (de) Effiziente architekturen für tiefenlernalgorithmen
GB201800770D0 (en) Object tracking by unsupervised learning
EP3507808A4 (de) Speicherarrays
EP3807878A4 (de) Auf tiefem neuronalem netz basierte sprachverbesserung

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20200604

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17D Deferred search report published (corrected)

Effective date: 20201210

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: G11C0011560000

Ipc: G06N0003040000

A4 Supplementary search report drawn up and despatched

Effective date: 20210503

RIC1 Information provided on ipc code assigned before grant

Ipc: G06N 3/04 20060101AFI20210426BHEP

Ipc: G06N 3/063 20060101ALI20210426BHEP

Ipc: G06N 3/08 20060101ALI20210426BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230117