JP7385657B2 - 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 - Google Patents
深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 Download PDFInfo
- Publication number
- JP7385657B2 JP7385657B2 JP2021520973A JP2021520973A JP7385657B2 JP 7385657 B2 JP7385657 B2 JP 7385657B2 JP 2021520973 A JP2021520973 A JP 2021520973A JP 2021520973 A JP2021520973 A JP 2021520973A JP 7385657 B2 JP7385657 B2 JP 7385657B2
- Authority
- JP
- Japan
- Prior art keywords
- cell
- volatile memory
- memory cell
- selected non
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000015654 memory Effects 0.000 title claims description 199
- 238000013528 artificial neural network Methods 0.000 title claims description 31
- 238000013135 deep learning Methods 0.000 title description 2
- 230000001537 neural effect Effects 0.000 title description 2
- 238000000034 method Methods 0.000 claims description 82
- 239000013598 vector Substances 0.000 claims description 67
- 230000008569 process Effects 0.000 claims description 19
- 239000011159 matrix material Substances 0.000 claims description 16
- 238000012795 verification Methods 0.000 claims description 9
- 210000004027 cell Anatomy 0.000 description 374
- 230000006870 function Effects 0.000 description 44
- 210000002569 neuron Anatomy 0.000 description 35
- 238000003491 array Methods 0.000 description 30
- 210000000225 synapse Anatomy 0.000 description 27
- 230000004913 activation Effects 0.000 description 22
- 239000003990 capacitor Substances 0.000 description 12
- 239000000463 material Substances 0.000 description 10
- 210000004205 output neuron Anatomy 0.000 description 7
- 239000000758 substrate Substances 0.000 description 7
- 102100036301 C-C chemokine receptor type 7 Human genes 0.000 description 6
- 102100031658 C-X-C chemokine receptor type 5 Human genes 0.000 description 6
- 101000716065 Homo sapiens C-C chemokine receptor type 7 Proteins 0.000 description 6
- 101000922405 Homo sapiens C-X-C chemokine receptor type 5 Proteins 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000011156 evaluation Methods 0.000 description 4
- 230000010354 integration Effects 0.000 description 4
- 238000011176 pooling Methods 0.000 description 4
- 230000000306 recurrent effect Effects 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 4
- 230000006403 short-term memory Effects 0.000 description 4
- 101100406317 Arabidopsis thaliana BCE2 gene Proteins 0.000 description 3
- 101100493897 Arabidopsis thaliana BGLU30 gene Proteins 0.000 description 3
- 101100422614 Arabidopsis thaliana STR15 gene Proteins 0.000 description 3
- 101100063437 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) DIN7 gene Proteins 0.000 description 3
- 101100141327 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) RNR3 gene Proteins 0.000 description 3
- 238000013459 approach Methods 0.000 description 3
- 101150112501 din1 gene Proteins 0.000 description 3
- 230000007787 long-term memory Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012905 input function Methods 0.000 description 2
- 230000000946 synaptic effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 101150051404 CGR1 gene Proteins 0.000 description 1
- 101150107986 CGR2 gene Proteins 0.000 description 1
- 101100243090 Candida glabrata (strain ATCC 2001 / CBS 138 / JCM 3761 / NBRC 0622 / NRRL Y-65) PDH1 gene Proteins 0.000 description 1
- 102100023226 Early growth response protein 1 Human genes 0.000 description 1
- 230000005689 Fowler Nordheim tunneling Effects 0.000 description 1
- 101001049697 Homo sapiens Early growth response protein 1 Proteins 0.000 description 1
- 101150085452 IPT1 gene Proteins 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000013529 biological neural network Methods 0.000 description 1
- 230000033228 biological regulation Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 210000003169 central nervous system Anatomy 0.000 description 1
- 101150054999 cgrA gene Proteins 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003750 conditioning effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000009413 insulation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000005641 tunneling Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10B—ELECTRONIC MEMORY DEVICES
- H10B41/00—Electrically erasable-and-programmable ROM [EEPROM] devices comprising floating gates
- H10B41/40—Electrically erasable-and-programmable ROM [EEPROM] devices comprising floating gates characterised by the peripheral circuit region
- H10B41/42—Simultaneous manufacture of periphery and memory cells
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C11/00—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor
- G11C11/56—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using storage elements with more than two stable states represented by steps, e.g. of voltage, current, phase, frequency
- G11C11/5621—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using storage elements with more than two stable states represented by steps, e.g. of voltage, current, phase, frequency using charge storage in a floating gate
- G11C11/5628—Programming or writing circuits; Data input circuits
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C11/00—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor
- G11C11/54—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using elements simulating biological cells, e.g. neuron
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
- G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
- G06N3/065—Analogue means
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C11/00—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor
- G11C11/56—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using storage elements with more than two stable states represented by steps, e.g. of voltage, current, phase, frequency
- G11C11/5621—Digital stores characterised by the use of particular electric or magnetic storage elements; Storage elements therefor using storage elements with more than two stable states represented by steps, e.g. of voltage, current, phase, frequency using charge storage in a floating gate
- G11C11/5642—Sensing or reading circuits; Data output circuits
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C27/00—Electric analogue stores, e.g. for storing instantaneous values
- G11C27/005—Electric analogue stores, e.g. for storing instantaneous values with non-volatile charge storage, e.g. on floating gate or MNOS
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C7/00—Arrangements for writing information into, or reading information out from, a digital store
- G11C7/16—Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L29/00—Semiconductor devices specially adapted for rectifying, amplifying, oscillating or switching and having potential barriers; Capacitors or resistors having potential barriers, e.g. a PN-junction depletion layer or carrier concentration layer; Details of semiconductor bodies or of electrodes thereof ; Multistep manufacturing processes therefor
- H01L29/66—Types of semiconductor device ; Multistep manufacturing processes therefor
- H01L29/68—Types of semiconductor device ; Multistep manufacturing processes therefor controllable by only the electric current supplied, or only the electric potential applied, to an electrode which does not carry the current to be rectified, amplified or switched
- H01L29/76—Unipolar devices, e.g. field effect transistors
- H01L29/772—Field effect transistors
- H01L29/78—Field effect transistors with field effect produced by an insulated gate
- H01L29/788—Field effect transistors with field effect produced by an insulated gate with floating gate
- H01L29/7881—Programmable transistors with only two possible levels of programmation
- H01L29/7883—Programmable transistors with only two possible levels of programmation charging by tunnelling of carriers, e.g. Fowler-Nordheim tunnelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C16/00—Erasable programmable read-only memories
- G11C16/02—Erasable programmable read-only memories electrically programmable
- G11C16/04—Erasable programmable read-only memories electrically programmable using variable threshold transistors, e.g. FAMOS
- G11C16/0408—Erasable programmable read-only memories electrically programmable using variable threshold transistors, e.g. FAMOS comprising cells containing floating gate transistors
- G11C16/0425—Erasable programmable read-only memories electrically programmable using variable threshold transistors, e.g. FAMOS comprising cells containing floating gate transistors comprising cells containing a merged floating gate and select transistor
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11C—STATIC STORES
- G11C2211/00—Indexing scheme relating to digital stores characterized by the use of particular electric or magnetic storage elements; Storage elements therefor
- G11C2211/56—Indexing scheme relating to G11C11/56 and sub-groups for features not covered by these groups
- G11C2211/562—Multilevel memory programming aspects
- G11C2211/5621—Multilevel programming verification
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L29/00—Semiconductor devices specially adapted for rectifying, amplifying, oscillating or switching and having potential barriers; Capacitors or resistors having potential barriers, e.g. a PN-junction depletion layer or carrier concentration layer; Details of semiconductor bodies or of electrodes thereof ; Multistep manufacturing processes therefor
- H01L29/40—Electrodes ; Multistep manufacturing processes therefor
- H01L29/41—Electrodes ; Multistep manufacturing processes therefor characterised by their shape, relative sizes or dispositions
- H01L29/423—Electrodes ; Multistep manufacturing processes therefor characterised by their shape, relative sizes or dispositions not carrying the current to be rectified, amplified or switched
- H01L29/42312—Gate electrodes for field effect devices
- H01L29/42316—Gate electrodes for field effect devices for field-effect transistors
- H01L29/4232—Gate electrodes for field effect devices for field-effect transistors with insulated gate
- H01L29/4234—Gate electrodes for transistors with charge trapping gate insulator
- H01L29/42344—Gate electrodes for transistors with charge trapping gate insulator with at least one additional gate, e.g. program gate, erase gate or select gate
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Computer Hardware Design (AREA)
- Neurology (AREA)
- Power Engineering (AREA)
- Ceramic Engineering (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Manufacturing & Machinery (AREA)
- Non-Volatile Memory (AREA)
- Read Only Memory (AREA)
- Semiconductor Memories (AREA)
Description
本出願は、2018年10月16日に出願された「Precision Tuning For the Programming Of Analog Neural Memory In A Deep Learning Artificial Neural Network」と題する米国特許仮出願第62/746,470号、及び2018年12月21日に出願された「Precision Tuning For the Programming Of Analog Neural Memory In A Deep Learning Artificial Neural Network」と題する米国特許出願第16/231,231号の優先権を主張する。
人工ニューラルネットワーク内のベクトル行列乗算(VMM)アレイ内の不揮発性メモリセルの浮遊ゲートに正確な量の電荷を精密かつ迅速に堆積させるための精密調整アルゴリズム及び装置の多数の実施形態が開示される。
不揮発性メモリセル
不揮発性メモリセルアレイを使用するニューラルネットワーク
ベクトル行列乗算(VMM)アレイ
Ids=Io*e(Vg-Vth)/kVt=w*Io*e(Vg)/kVt
式中、w=e(-Vth)/kVtである。
Vg=k*Vt*log[Ids/wp*Io]
式中、wpは、基準又は周辺メモリセルのwである。
Iout=wa*Io*e(Vg)/kVt、すなわち
Iout=(wa/wp)*Iin=W*Iin
W=e(Vthp-Vtha)/kVt
式中、メモリアレイの各メモリセルのwa=wである。
Ids=β*(Vgs-Vth)*Vds;β=u*Cox*W/L
W=α(Vgs-Vth)
表5:図10のVMMアレイ1000の動作
表6:図11のVMMアレイ1100の動作
表7:図12のVMMアレイ1200の動作
表8:図13のVMMアレイ1300の動作
長・短期記憶
ゲート付き回帰型ユニット
VMM内のセルの精密プログラミングのための実施形態
表9:N=8の場合のN個の所望の電流値の例
Vi=Vi-1+Vincrement、
Vincrementは、傾斜Vgに比例する
Vg=k*Vt*log[Ids/wa*Io]
ここで、waはメモリセルのwであり、Idsは電流標的プラスオフセット値である。
表11:デジタルビット入力と生成パルス数
表12:デジタルビット入力加算
Claims (10)
- 選択された不揮発性メモリセルを、N個の可能な値のうちの1つを記憶するようにプログラミングする方法であって、Nは2よりも大きい整数であり、前記選択された不揮発性メモリセルは浮遊ゲートを含み、前記方法は、
前記選択された不揮発性メモリセルを「0」状態にプログラミングするステップと、
読み出し動作中に3~5μAの電流を引き込むレベルに、前記選択された不揮発性メモリセルに対して消去を行うように、前記選択された不揮発性メモリセルでソフト消去動作を実行するステップと、
粗プログラミングプロセスを実行するステップであって、前記粗プログラミングプロセスが、
ルックアップテーブル内のM個の異なる電流値から粗標的電流値を第1のスレッショルド電流値として選択するステップであって、M<Nである、ステップと、
前記浮遊ゲートに電荷を追加するステップと、
検証動作中に前記選択された不揮発性メモリセルを通る電流が前記第1のスレッショルド電流値以下になるまで、前記追加するステップを繰り返すステップと、を含む、ステップと、
検証動作中に前記選択された不揮発性メモリセルを通る電流が第2のスレッショルド電流値以下になるまで、精密プログラミングプロセスを実行するステップであって、前記粗プログラミングプロセスのプログラミングステップにおける増分よりも小さい増分の電荷が前記浮遊ゲートに追加される、ステップと、を含む、方法。 - 検証動作中に前記選択された不揮発性メモリセルを通る電流が第3のスレッショルド電流値以下になるまで、第2の精密プログラミングプロセスを実行するステップ、を更に含む、請求項1に記載の方法。
- 前記精密プログラミングプロセスは、前記選択された不揮発性メモリセルの制御ゲートに、大きさが増加していく電圧パルスを印加するステップを含む、請求項1に記載の方法。
- 前記精密プログラミングプロセスは、前記選択された不揮発性メモリセルの制御ゲートに、持続時間が増加していく電圧パルスを印加するステップを含む、請求項1に記載の方法。
- 前記第2の精密プログラミングプロセスは、前記選択された不揮発性メモリセルの制御ゲートに、大きさが増加していく電圧パルスを印加するステップを含む、請求項2に記載の方法。
- 前記第2の精密プログラミングプロセスは、前記選択された不揮発性メモリセルの制御ゲートに持続時間が増加していく電圧パルスを印加するステップを含む、請求項2に記載の方法。
- 前記選択された不揮発性メモリセルは、スプリットゲート型フラッシュメモリセルである、請求項1に記載の方法。
- 前記選択された不揮発性メモリセルは、アナログメモリディープニューラルネットワーク内のベクトル行列乗算アレイ内にある、請求項1に記載の方法。
- 前記選択された不揮発性メモリセルで読み出し動作を実行するステップと、
前記読み出し動作中に前記選択された不揮発性メモリセルによって引き込まれた前記電流を、積分型アナログデジタル変換器を使用してデジタルビットを生成するために積分するステップと、を更に含む、請求項1に記載の方法。 - 前記選択された不揮発性メモリセルで読み出し動作を実行するステップと、
前記読み出し動作中に前記選択された不揮発性メモリセルによって引き込まれた前記電流を、シグマデルタ型アナログデジタル変換器を使用してデジタルビットに変換するステップと、を更に含む、請求項1に記載の方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2023191760A JP2024023266A (ja) | 2018-10-16 | 2023-11-09 | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862746470P | 2018-10-16 | 2018-10-16 | |
US62/746,470 | 2018-10-16 | ||
US16/231,231 | 2018-12-21 | ||
US16/231,231 US10741568B2 (en) | 2018-10-16 | 2018-12-21 | Precision tuning for the programming of analog neural memory in a deep learning artificial neural network |
PCT/US2019/043524 WO2020081140A1 (en) | 2018-10-16 | 2019-07-25 | Precision tuning for the programming of analog neural memory in a deep learning artificial neural network |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023191760A Division JP2024023266A (ja) | 2018-10-16 | 2023-11-09 | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2022505073A JP2022505073A (ja) | 2022-01-14 |
JPWO2020081140A5 JPWO2020081140A5 (ja) | 2022-08-01 |
JP7385657B2 true JP7385657B2 (ja) | 2023-11-22 |
Family
ID=70160163
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2021520973A Active JP7385657B2 (ja) | 2018-10-16 | 2019-07-25 | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 |
JP2023191760A Pending JP2024023266A (ja) | 2018-10-16 | 2023-11-09 | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2023191760A Pending JP2024023266A (ja) | 2018-10-16 | 2023-11-09 | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 |
Country Status (7)
Country | Link |
---|---|
US (4) | US10741568B2 (ja) |
EP (2) | EP4202930A1 (ja) |
JP (2) | JP7385657B2 (ja) |
KR (2) | KR20220025131A (ja) |
CN (2) | CN114580616A (ja) |
TW (2) | TWI799006B (ja) |
WO (1) | WO2020081140A1 (ja) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10741568B2 (en) * | 2018-10-16 | 2020-08-11 | Silicon Storage Technology, Inc. | Precision tuning for the programming of analog neural memory in a deep learning artificial neural network |
CN112151095A (zh) * | 2019-06-26 | 2020-12-29 | 北京知存科技有限公司 | 存算一体芯片、存储单元阵列结构 |
US11755899B2 (en) * | 2019-11-11 | 2023-09-12 | Silicon Storage Technology, Inc. | Precise programming method and apparatus for analog neural memory in an artificial neural network |
US11568021B2 (en) | 2020-02-21 | 2023-01-31 | Alibaba Group Holding Limited | Vector-vector multiplication techniques for processing systems |
US11568252B2 (en) | 2020-06-29 | 2023-01-31 | Alibaba Group Holding Limited | Variable input size techniques for neural networks |
US11875852B2 (en) | 2020-07-06 | 2024-01-16 | Silicon Storage Technology, Inc. | Adaptive bias decoder to provide a voltage to a control gate line in an analog neural memory array in artificial neural network |
CN112149813B (zh) * | 2020-09-18 | 2022-05-13 | 明峰医疗系统股份有限公司 | 基于神经网络的探测器积分电容动态调节方法 |
KR20230080483A (ko) * | 2020-12-23 | 2023-06-07 | 실리콘 스토리지 테크놀로지 인크 | 딥 러닝 인공 신경망에서의 아날로그 신경 메모리를 위한 입력 및 디지털 출력 메케니즘 |
US20220215239A1 (en) * | 2021-01-01 | 2022-07-07 | Silicon Storage Technology, Inc. | Digital output mechanisms for analog neural memory in a deep learning artificial neural network |
TWI770922B (zh) * | 2021-03-31 | 2022-07-11 | 財團法人工業技術研究院 | 低精度神經網路的資料特徵擴增系統及方法 |
US20220374161A1 (en) * | 2021-05-19 | 2022-11-24 | Silicon Storage Technology, Inc. | Output circuit for analog neural memory in a deep learning artificial neural network |
FR3127599B1 (fr) * | 2021-09-29 | 2024-06-14 | Stmicroelectronics Grenoble 2 Sas | Circuit intégré comprenant une mémoire non volatile |
WO2023146567A1 (en) * | 2022-01-28 | 2023-08-03 | Silicon Storage Technology, Inc. | Artificial neural network comprising an analog array and a digital array |
CN116523013B (zh) * | 2023-07-04 | 2023-10-20 | 清华大学 | 人工神经元及人工神经网络 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006509326A (ja) | 2002-12-05 | 2006-03-16 | サンディスク コーポレイション | 多状態メモリのための高性能検証 |
US20060291285A1 (en) | 2003-02-06 | 2006-12-28 | Nima Mokhlesi | System and method for programming cells in non-volatile integrated memory devices |
JP2007520845A (ja) | 2004-01-27 | 2007-07-26 | サンディスク コーポレイション | 非揮発性メモリの雑/ファインプログラミングのための効率的ベリフィケーション |
JP2009537055A (ja) | 2006-05-12 | 2009-10-22 | アノビット テクノロジーズ リミテッド | 適応能力を有するメモリ素子 |
WO2017200883A1 (en) | 2016-05-17 | 2017-11-23 | Silicon Storage Technology, Inc. | Deep learning neural network classifier using non-volatile memory array |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5029130A (en) | 1990-01-22 | 1991-07-02 | Silicon Storage Technology, Inc. | Single transistor non-valatile electrically alterable semiconductor memory device |
JP3260357B2 (ja) | 1990-01-24 | 2002-02-25 | 株式会社日立製作所 | 情報処理装置 |
TW270192B (en) | 1995-05-11 | 1996-02-11 | Ind Tech Res Inst | Artificial neural network architecture |
JP3930074B2 (ja) * | 1996-09-30 | 2007-06-13 | 株式会社ルネサステクノロジ | 半導体集積回路及びデータ処理システム |
US6141241A (en) * | 1998-06-23 | 2000-10-31 | Energy Conversion Devices, Inc. | Universal memory element with systems employing same and apparatus and method for reading, writing and programming same |
US6747310B2 (en) | 2002-10-07 | 2004-06-08 | Actrans System Inc. | Flash memory cells with separated self-aligned select and erase gates, and process of fabrication |
KR100738788B1 (ko) | 2004-12-07 | 2007-07-12 | 주식회사 엘지화학 | 폴리벤즈이미다졸-벤즈아마이드 공중합체와 그의제조방법, 및 이로부터 제조된 전해질 막과 그의 제조방법 |
JP2007034537A (ja) * | 2005-07-25 | 2007-02-08 | Sony Corp | 複合型記憶装置、データ書込方法及びプログラム |
US7961511B2 (en) * | 2006-09-26 | 2011-06-14 | Sandisk Corporation | Hybrid programming methods and systems for non-volatile memory storage elements |
US7450426B2 (en) * | 2006-10-10 | 2008-11-11 | Sandisk Corporation | Systems utilizing variable program voltage increment values in non-volatile memory program operations |
KR100780773B1 (ko) | 2006-11-03 | 2007-11-30 | 주식회사 하이닉스반도체 | 플래시 메모리소자의 프로그램 시작 바이어스 설정방법 및이를 이용한 프로그램 방법 |
WO2009152037A2 (en) * | 2008-06-12 | 2009-12-17 | Sandisk Corporation | Nonvolatile memory and method for correlated multiple pass programming |
US8208310B2 (en) * | 2010-05-04 | 2012-06-26 | Sandisk Technologies Inc. | Mitigating channel coupling effects during sensing of non-volatile storage elements |
US8681563B1 (en) | 2011-04-04 | 2014-03-25 | Sk Hynix Memory Solutions Inc. | Flash multiple-pass write with accurate first-pass write |
US9195586B2 (en) * | 2012-02-23 | 2015-11-24 | Hgst Technologies Santa Ana, Inc. | Determining bias information for offsetting operating variations in memory cells based on wordline address |
JP6563313B2 (ja) | 2014-11-21 | 2019-08-21 | 株式会社半導体エネルギー研究所 | 半導体装置、及び電子機器 |
US20170110194A1 (en) * | 2015-10-19 | 2017-04-20 | Silicon Storage Technology, Inc. | Power Driven Optimization For Flash Memory |
CN116705110A (zh) * | 2016-09-21 | 2023-09-05 | 合肥睿科微电子有限公司 | 存储装置的电子电路及方法 |
US10748630B2 (en) | 2017-11-29 | 2020-08-18 | Silicon Storage Technology, Inc. | High precision and highly efficient tuning mechanisms and algorithms for analog neuromorphic memory in artificial neural networks |
US10910061B2 (en) * | 2018-03-14 | 2021-02-02 | Silicon Storage Technology, Inc. | Method and apparatus for programming analog neural memory in a deep learning artificial neural network |
US10741568B2 (en) * | 2018-10-16 | 2020-08-11 | Silicon Storage Technology, Inc. | Precision tuning for the programming of analog neural memory in a deep learning artificial neural network |
US20210118894A1 (en) * | 2018-10-16 | 2021-04-22 | Silicon Storage Technology, Inc. | Input and digital output mechanisms for analog neural memory in a deep learning artificial neural network |
KR102637733B1 (ko) | 2018-10-31 | 2024-02-19 | 삼성전자주식회사 | 뉴럴 네트워크 프로세서 및 그것의 컨볼루션 연산 방법 |
US20200159495A1 (en) | 2018-11-15 | 2020-05-21 | Samsung Electronics Co., Ltd. | Processing apparatus and method of processing add operation therein |
KR20200061164A (ko) | 2018-11-23 | 2020-06-02 | 삼성전자주식회사 | 뉴럴 네트워크 연산 수행을 위한 뉴럴 네트워크 장치, 뉴럴 네트워크 장치의 동작 방법 및 뉴럴 네트워크 장치를 포함하는 애플리케이션 프로세서 |
CN110728358B (zh) | 2019-09-30 | 2022-06-10 | 上海商汤智能科技有限公司 | 基于神经网络的数据处理方法和装置 |
-
2018
- 2018-12-21 US US16/231,231 patent/US10741568B2/en active Active
-
2019
- 2019-07-25 WO PCT/US2019/043524 patent/WO2020081140A1/en unknown
- 2019-07-25 EP EP23156869.2A patent/EP4202930A1/en active Pending
- 2019-07-25 JP JP2021520973A patent/JP7385657B2/ja active Active
- 2019-07-25 CN CN202210224682.9A patent/CN114580616A/zh active Pending
- 2019-07-25 KR KR1020227004070A patent/KR20220025131A/ko not_active Application Discontinuation
- 2019-07-25 EP EP19750208.1A patent/EP3867911B1/en active Active
- 2019-07-25 CN CN201980068251.4A patent/CN112868063B/zh active Active
- 2019-07-25 KR KR1020217011467A patent/KR102361803B1/ko active IP Right Grant
- 2019-10-04 TW TW110147108A patent/TWI799006B/zh active
- 2019-10-04 TW TW108136072A patent/TWI751441B/zh active
-
2020
- 2020-07-02 US US16/919,697 patent/US11482530B2/en active Active
- 2020-12-14 US US17/121,555 patent/US11729970B2/en active Active
-
2022
- 2022-09-21 US US17/949,962 patent/US20230031487A1/en active Pending
-
2023
- 2023-11-09 JP JP2023191760A patent/JP2024023266A/ja active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006509326A (ja) | 2002-12-05 | 2006-03-16 | サンディスク コーポレイション | 多状態メモリのための高性能検証 |
US20060291285A1 (en) | 2003-02-06 | 2006-12-28 | Nima Mokhlesi | System and method for programming cells in non-volatile integrated memory devices |
JP2007520845A (ja) | 2004-01-27 | 2007-07-26 | サンディスク コーポレイション | 非揮発性メモリの雑/ファインプログラミングのための効率的ベリフィケーション |
JP2009537055A (ja) | 2006-05-12 | 2009-10-22 | アノビット テクノロジーズ リミテッド | 適応能力を有するメモリ素子 |
WO2017200883A1 (en) | 2016-05-17 | 2017-11-23 | Silicon Storage Technology, Inc. | Deep learning neural network classifier using non-volatile memory array |
Also Published As
Publication number | Publication date |
---|---|
TW202025172A (zh) | 2020-07-01 |
US11482530B2 (en) | 2022-10-25 |
US10741568B2 (en) | 2020-08-11 |
JP2024023266A (ja) | 2024-02-21 |
WO2020081140A1 (en) | 2020-04-23 |
CN112868063B (zh) | 2022-03-22 |
US20210098477A1 (en) | 2021-04-01 |
KR20210049179A (ko) | 2021-05-04 |
US20200119028A1 (en) | 2020-04-16 |
US20200335511A1 (en) | 2020-10-22 |
CN112868063A (zh) | 2021-05-28 |
JP2022505073A (ja) | 2022-01-14 |
US20230031487A1 (en) | 2023-02-02 |
KR102361803B1 (ko) | 2022-02-15 |
TWI751441B (zh) | 2022-01-01 |
EP3867911B1 (en) | 2023-03-29 |
TW202213360A (zh) | 2022-04-01 |
TWI799006B (zh) | 2023-04-11 |
US11729970B2 (en) | 2023-08-15 |
KR20220025131A (ko) | 2022-03-03 |
CN114580616A (zh) | 2022-06-03 |
EP3867911A1 (en) | 2021-08-25 |
EP4202930A1 (en) | 2023-06-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7385657B2 (ja) | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 | |
JP7346579B2 (ja) | 深層学習人工ニューラルネットワーク内のアナログニューラルメモリにおいてニューロン電流をニューロン電流ベースの時間パルスに変換するためのシステム | |
JP7308290B2 (ja) | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのための構成可能な入力ブロック及び出力ブロック、並びに物理的レイアウト | |
JP7404542B2 (ja) | 人工ニューラルネットワークにおけるアナログニューラルメモリのための精密なデータ調整方法及び装置 | |
JP7340694B2 (ja) | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリのプログラミングのための精密な調整 | |
JP7340101B2 (ja) | 人工ニューラルネットワークにおけるアナログニューラルメモリのための精密なプログラミング方法及び装置 | |
US20240098991A1 (en) | Input and output blocks for an array of memory cells | |
JP2024502798A (ja) | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリ用のデジタル出力機構 | |
JP2024504003A (ja) | 深層学習人工ニューラルネットワークにおけるアナログニューラルメモリ用の入力及びデジタル出力機構 | |
EP4341933A1 (en) | Output circuit for analog neural memory in a deep learning artificial neural network | |
WO2022245384A1 (en) | Output circuit for analog neural memory in a deep learning artificial neural network |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220722 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20220722 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230627 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230926 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20231017 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20231110 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7385657 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |