DK3373210T3 - Neuralt netværksmatricetransponering i hardware - Google Patents
Neuralt netværksmatricetransponering i hardware Download PDFInfo
- Publication number
- DK3373210T3 DK3373210T3 DK18160942.1T DK18160942T DK3373210T3 DK 3373210 T3 DK3373210 T3 DK 3373210T3 DK 18160942 T DK18160942 T DK 18160942T DK 3373210 T3 DK3373210 T3 DK 3373210T3
- Authority
- DK
- Denmark
- Prior art keywords
- hardware
- neural network
- matrix transposition
- network matrix
- transposition
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/76—Arrangements for rearranging, permuting or selecting data according to predetermined rules, independently of the content of the data
- G06F7/78—Arrangements for rearranging, permuting or selecting data according to predetermined rules, independently of the content of the data for changing the order of data flow, e.g. matrix transposition or LIFO buffers; Overflow or underflow handling therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
- G06F2207/48—Indexing scheme relating to groups G06F7/48 - G06F7/575
- G06F2207/4802—Special implementations
- G06F2207/4818—Threshold devices
- G06F2207/4824—Neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Artificial Intelligence (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Neurology (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Complex Calculations (AREA)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/455,024 US10909447B2 (en) | 2017-03-09 | 2017-03-09 | Transposing neural network matrices in hardware |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| DK3373210T3 true DK3373210T3 (da) | 2020-08-17 |
Family
ID=61768515
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| DK20174935.5T DK3761235T3 (da) | 2017-03-09 | 2018-03-09 | Transponering af matricer for neurale netværk i hardware |
| DK18160942.1T DK3373210T3 (da) | 2017-03-09 | 2018-03-09 | Neuralt netværksmatricetransponering i hardware |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| DK20174935.5T DK3761235T3 (da) | 2017-03-09 | 2018-03-09 | Transponering af matricer for neurale netværk i hardware |
Country Status (9)
| Country | Link |
|---|---|
| US (3) | US10909447B2 (da) |
| EP (2) | EP3373210B1 (da) |
| CN (2) | CN115271049A (da) |
| DE (2) | DE102018105457A1 (da) |
| DK (2) | DK3761235T3 (da) |
| FI (1) | FI3761235T3 (da) |
| GB (1) | GB2562572A (da) |
| TW (2) | TWI765168B (da) |
| WO (1) | WO2018165514A1 (da) |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10402628B2 (en) * | 2016-10-10 | 2019-09-03 | Gyrfalcon Technology Inc. | Image classification systems based on CNN based IC and light-weight classifier |
| US10795836B2 (en) | 2017-04-17 | 2020-10-06 | Microsoft Technology Licensing, Llc | Data processing performance enhancement for neural networks using a virtualized data iterator |
| JP6907700B2 (ja) * | 2017-05-23 | 2021-07-21 | 富士通株式会社 | 情報処理装置、マルチスレッド行列演算方法、およびマルチスレッド行列演算プログラム |
| US20180350351A1 (en) * | 2017-05-31 | 2018-12-06 | Intel Corporation | Feature extraction using neural network accelerator |
| US11507429B2 (en) * | 2017-09-14 | 2022-11-22 | Electronics And Telecommunications Research Institute | Neural network accelerator including bidirectional processing element array |
| US10459876B2 (en) * | 2018-01-31 | 2019-10-29 | Amazon Technologies, Inc. | Performing concurrent operations in a processing element |
| US11769042B2 (en) | 2018-02-08 | 2023-09-26 | Western Digital Technologies, Inc. | Reconfigurable systolic neural network engine |
| US11741346B2 (en) | 2018-02-08 | 2023-08-29 | Western Digital Technologies, Inc. | Systolic neural network engine with crossover connection optimization |
| US10990650B1 (en) * | 2018-03-22 | 2021-04-27 | Amazon Technologies, Inc. | Reducing computations for data including padding |
| US10621489B2 (en) | 2018-03-30 | 2020-04-14 | International Business Machines Corporation | Massively parallel neural inference computing elements |
| US11315020B2 (en) * | 2018-09-24 | 2022-04-26 | International Business Machines Corporation | Optimized partitioning of multi-layer networks in core-based neurosynaptic architectures |
| CN111199275B (zh) * | 2018-11-20 | 2023-04-28 | 上海登临科技有限公司 | 用于神经网络的片上系统 |
| CN109919321A (zh) * | 2019-02-01 | 2019-06-21 | 京微齐力(北京)科技有限公司 | 单元具有本地累加功能的人工智能模块及系统芯片 |
| US11556764B2 (en) * | 2019-03-01 | 2023-01-17 | Microsoft Technology Licensing, Llc | Deriving a concordant software neural network layer from a quantized firmware neural network layer |
| US11783176B2 (en) | 2019-03-25 | 2023-10-10 | Western Digital Technologies, Inc. | Enhanced storage device memory architecture for machine learning |
| US10929058B2 (en) | 2019-03-25 | 2021-02-23 | Western Digital Technologies, Inc. | Enhanced memory device architecture for machine learning |
| US10990397B2 (en) | 2019-03-30 | 2021-04-27 | Intel Corporation | Apparatuses, methods, and systems for transpose instructions of a matrix operations accelerator |
| CN111914831B (zh) * | 2019-05-10 | 2023-06-02 | 杭州海康威视数字技术股份有限公司 | 目标检测方法、装置及存储介质 |
| US11620358B2 (en) * | 2019-05-14 | 2023-04-04 | Intel Corporation | Technologies for performing macro operations in memory |
| CN112149049A (zh) * | 2019-06-26 | 2020-12-29 | 北京百度网讯科技有限公司 | 用于变换矩阵的装置和方法、数据处理系统 |
| US10884707B1 (en) * | 2019-06-27 | 2021-01-05 | Amazon Technologies, Inc. | Transpose operations using processing element array |
| CN110210615B (zh) * | 2019-07-08 | 2024-05-28 | 中昊芯英(杭州)科技有限公司 | 一种用于执行神经网络计算的脉动阵列系统 |
| CN114258538B (zh) * | 2019-08-16 | 2024-04-12 | 谷歌有限责任公司 | 片上操作的显式调度 |
| CN116057914B (zh) * | 2019-08-22 | 2024-06-28 | 谷歌有限责任公司 | 初始化片上操作的方法和系统 |
| US11170141B2 (en) * | 2019-09-12 | 2021-11-09 | Robert Bosch Gmbh | Graph transformer neural network force field for prediction of atomic forces and energies in molecular dynamic simulations |
| US20220092382A1 (en) * | 2020-09-23 | 2022-03-24 | The Governing Council Of The University Of Toronto | Quantization for neural network computation |
| US12079301B2 (en) | 2021-01-08 | 2024-09-03 | Microsoft Technology Licensing, Llc | Performing tensor operations using a programmable control engine |
| US11748251B2 (en) | 2021-01-08 | 2023-09-05 | Microsoft Technology Licensing, Llc | Storing tensors in memory based on depth |
| TWI766777B (zh) * | 2021-07-27 | 2022-06-01 | 鴻海精密工業股份有限公司 | 神經網路劃分的方法、電子設備及存儲介質 |
| CN113626769B (zh) * | 2021-10-12 | 2022-01-21 | 中国人民解放军国防科技大学 | 面向向量处理器的低位宽数据矩阵向量化转置方法及系统 |
| US12118354B2 (en) | 2022-08-30 | 2024-10-15 | Advanced Micro Devices, Inc. | Virtually padding data structures |
| TWI808000B (zh) * | 2022-09-20 | 2023-07-01 | 創鑫智慧股份有限公司 | 矩陣裝置及其操作方法 |
Family Cites Families (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5073752A (en) * | 1990-04-19 | 1991-12-17 | Picker International, Inc. | Discrete fourier transform imaging |
| US5644517A (en) * | 1992-10-22 | 1997-07-01 | International Business Machines Corporation | Method for performing matrix transposition on a mesh multiprocessor architecture having multiple processor with concurrent execution of the multiple processors |
| US20020146160A1 (en) * | 2001-01-19 | 2002-10-10 | Parker Mary F. | Method and apparatus for generating two-dimensional images of cervical tissue from three-dimensional hyperspectral cubes |
| US6877020B1 (en) * | 2001-12-31 | 2005-04-05 | Apple Computer, Inc. | Method and apparatus for matrix transposition |
| US7564933B2 (en) * | 2004-11-30 | 2009-07-21 | The Regents Of The University Of California | Method and system for near optimal iterative detection of the 2-dimensional ISI channel |
| US20060190517A1 (en) * | 2005-02-02 | 2006-08-24 | Guerrero Miguel A | Techniques for transposition of a matrix arranged in a memory as multiple items per word |
| US7395251B2 (en) * | 2005-07-01 | 2008-07-01 | International Business Machines Corporation | Neural networks for prediction and control |
| US8031954B2 (en) * | 2007-04-26 | 2011-10-04 | Canon Kabushiki Kaisha | Image encoding apparatus and control method thereof using prediction encoding and pixel classification |
| US8812285B2 (en) * | 2010-08-31 | 2014-08-19 | The Regents Of The University Of California | Designing digital processors using a flexibility metric |
| CN102437858B (zh) * | 2011-08-31 | 2013-11-06 | 北京理工大学 | 一种卷积码编码器结构的改进方法 |
| EP3035249B1 (en) | 2014-12-19 | 2019-11-27 | Intel Corporation | Method and apparatus for distributed and cooperative computation in artificial neural networks |
| US9747546B2 (en) | 2015-05-21 | 2017-08-29 | Google Inc. | Neural network processor |
| US10083395B2 (en) | 2015-05-21 | 2018-09-25 | Google Llc | Batch processing in a neural network processor |
| US10049322B2 (en) | 2015-05-21 | 2018-08-14 | Google Llc | Prefetching weights for use in a neural network processor |
| US10438117B1 (en) | 2015-05-21 | 2019-10-08 | Google Llc | Computing convolutions using a neural network processor |
| US10192162B2 (en) | 2015-05-21 | 2019-01-29 | Google Llc | Vector computation unit in a neural network processor |
| US9805303B2 (en) | 2015-05-21 | 2017-10-31 | Google Inc. | Rotating data for neural network computations |
| CN105068546B (zh) | 2015-07-31 | 2017-06-16 | 哈尔滨工业大学 | 一种卫星编队相对轨道自适应神经网络构形包含控制方法 |
| US10325006B2 (en) * | 2015-09-29 | 2019-06-18 | International Business Machines Corporation | Scalable architecture for analog matrix operations with resistive devices |
| CN105913117A (zh) * | 2016-04-04 | 2016-08-31 | 北京工业大学 | 一种计算机智能识别的相关神经网络方法 |
| CN106021188B (zh) * | 2016-05-11 | 2019-04-12 | 广州广电运通金融电子股份有限公司 | 浮点矩阵求逆的并行硬件架构和并行计算方法 |
| CN106022468B (zh) * | 2016-05-17 | 2018-06-01 | 成都启英泰伦科技有限公司 | 人工神经网络处理器集成电路及该集成电路的设计方法 |
-
2017
- 2017-03-09 US US15/455,024 patent/US10909447B2/en active Active
-
2018
- 2018-03-09 EP EP18160942.1A patent/EP3373210B1/en active Active
- 2018-03-09 GB GB1803806.7A patent/GB2562572A/en not_active Withdrawn
- 2018-03-09 WO PCT/US2018/021681 patent/WO2018165514A1/en active Application Filing
- 2018-03-09 CN CN202210795051.2A patent/CN115271049A/zh active Pending
- 2018-03-09 CN CN201810196453.4A patent/CN108573304B/zh active Active
- 2018-03-09 DK DK20174935.5T patent/DK3761235T3/da active
- 2018-03-09 FI FIEP20174935.5T patent/FI3761235T3/fi active
- 2018-03-09 DK DK18160942.1T patent/DK3373210T3/da active
- 2018-03-09 DE DE102018105457.2A patent/DE102018105457A1/de active Pending
- 2018-03-09 TW TW108127280A patent/TWI765168B/zh active
- 2018-03-09 DE DE202018101330.0U patent/DE202018101330U1/de active Active
- 2018-03-09 EP EP20174935.5A patent/EP3761235B1/en active Active
- 2018-03-09 TW TW107108167A patent/TWI671688B/zh active
-
2021
- 2021-01-29 US US17/162,745 patent/US11704547B2/en active Active
-
2023
- 2023-06-05 US US18/329,418 patent/US20240152740A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018165514A1 (en) | 2018-09-13 |
| EP3373210B1 (en) | 2020-06-17 |
| GB2562572A (en) | 2018-11-21 |
| CN108573304A (zh) | 2018-09-25 |
| US20210224641A1 (en) | 2021-07-22 |
| DE102018105457A1 (de) | 2018-09-13 |
| US20180260690A1 (en) | 2018-09-13 |
| FI3761235T3 (fi) | 2024-07-23 |
| CN115271049A (zh) | 2022-11-01 |
| US10909447B2 (en) | 2021-02-02 |
| EP3761235A1 (en) | 2021-01-06 |
| TW201837792A (zh) | 2018-10-16 |
| US20240152740A1 (en) | 2024-05-09 |
| TWI765168B (zh) | 2022-05-21 |
| GB201803806D0 (en) | 2018-04-25 |
| US11704547B2 (en) | 2023-07-18 |
| TW201945983A (zh) | 2019-12-01 |
| DK3761235T3 (da) | 2024-07-29 |
| CN108573304B (zh) | 2022-07-26 |
| EP3761235B1 (en) | 2024-05-01 |
| TWI671688B (zh) | 2019-09-11 |
| EP3373210A1 (en) | 2018-09-12 |
| DE202018101330U1 (de) | 2018-06-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DK3373210T3 (da) | Neuralt netværksmatricetransponering i hardware | |
| DK3728870T3 (da) | Pladesæt | |
| DK3564830T3 (da) | Transponering i en matrix-vektor-processor. | |
| DK3555814T3 (da) | Udførelse af average pooling i hardware | |
| DK3580561T3 (da) | Hla-baserede metoder, sammensætninger og anvendelse heraf | |
| CL2020000951A1 (es) | Célula. | |
| DK3516147T3 (da) | Skudsikker rulleport | |
| DK3116084T3 (da) | Elektricitetsdistributionsnetværk. | |
| DK3658413T3 (da) | Godssikringsenhed | |
| DK3602714T3 (da) | Redundant jævnspændingsnet | |
| ES1188184Y (es) | Vajilla cuenta-cuentos | |
| DK3159314T3 (da) | Efterklaringsenhed, fremgangsmåde og anvendelse | |
| ITUA20162998A1 (it) | Cerniera di 180°. | |
| IT201700121095U1 (it) | Rinforza spalle | |
| DK3454288T3 (da) | Nøgleudvekslingssystem | |
| DE112018005138A5 (de) | Türfeststeller | |
| ES1188983Y (es) | Maleta cilindrica enrollable | |
| IT201700061856U1 (it) | Valigia da viaggio | |
| UA36439S (uk) | Двері | |
| IT201700037572U1 (it) | Targhetta espositiva | |
| UA36140S (uk) | Двері | |
| IT201700112270A1 (it) | Pbox-PORTA AURICOLARE | |
| FI11891U1 (fi) | Umpinainen säiliöjärjestelmä | |
| UA35516S (uk) | Двері | |
| UA35518S (uk) | Двері |