CN109308520A - 实现softmax函数计算的FPGA电路及方法 - Google Patents
实现softmax函数计算的FPGA电路及方法 Download PDFInfo
- Publication number
- CN109308520A CN109308520A CN201811122277.6A CN201811122277A CN109308520A CN 109308520 A CN109308520 A CN 109308520A CN 201811122277 A CN201811122277 A CN 201811122277A CN 109308520 A CN109308520 A CN 109308520A
- Authority
- CN
- China
- Prior art keywords
- value
- module
- elements
- fpga circuitry
- vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Neurology (AREA)
- Logic Circuits (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811122277.6A CN109308520B (zh) | 2018-09-26 | 2018-09-26 | 实现softmax函数计算的FPGA电路及方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811122277.6A CN109308520B (zh) | 2018-09-26 | 2018-09-26 | 实现softmax函数计算的FPGA电路及方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109308520A true CN109308520A (zh) | 2019-02-05 |
CN109308520B CN109308520B (zh) | 2022-05-13 |
Family
ID=65224862
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201811122277.6A Active CN109308520B (zh) | 2018-09-26 | 2018-09-26 | 实现softmax函数计算的FPGA电路及方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109308520B (zh) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110135086A (zh) * | 2019-05-20 | 2019-08-16 | 合肥工业大学 | 计算精度可变的softmax函数硬件电路及其实现方法 |
CN112036561A (zh) * | 2020-09-30 | 2020-12-04 | 北京百度网讯科技有限公司 | 数据处理方法、装置、电子设备及存储介质 |
CN114612996A (zh) * | 2022-03-31 | 2022-06-10 | 安谋科技(中国)有限公司 | 神经网络模型的运行方法、介质、程序产品以及电子设备 |
CN114626489A (zh) * | 2022-05-17 | 2022-06-14 | 深圳比特微电子科技有限公司 | 一种softmax函数定点化实现方法和装置 |
CN114648101A (zh) * | 2022-05-13 | 2022-06-21 | 杭州研极微电子有限公司 | 基于transformer结构的softmax函数量化实现方法和装置 |
WO2022168604A1 (ja) * | 2021-02-05 | 2022-08-11 | コニカミノルタ株式会社 | ソフトマックス関数の近似計算装置、近似計算方法および近似計算プログラム |
CN115511047A (zh) * | 2022-06-09 | 2022-12-23 | 上海燧原科技有限公司 | Softmax模型的量化方法、装置、设备及介质 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101493760A (zh) * | 2008-12-24 | 2009-07-29 | 京信通信系统(中国)有限公司 | 一种高速除法器及其实现高速除法运算的方法 |
CN201311633Y (zh) * | 2008-11-07 | 2009-09-16 | 中国北车股份有限公司大连电力牵引研发中心 | 基于fpga的浮点数值除法器实现的功能模块 |
CN104765713A (zh) * | 2014-12-20 | 2015-07-08 | 中国科学院西安光学精密机械研究所 | 基于分段查表三角函数实现fpga数字信号处理的方法 |
CN107133012A (zh) * | 2017-04-27 | 2017-09-05 | 湖南省瞬渺通信技术有限公司 | 一种高速自定义浮点复数除法器 |
CN108021537A (zh) * | 2018-01-05 | 2018-05-11 | 南京大学 | 一种基于硬件平台的softmax实现方式 |
CN108037906A (zh) * | 2017-12-14 | 2018-05-15 | 中国人民解放军国防科技大学 | 基于tcordic算法的浮点基本函数实现方法及装置 |
US20180232152A1 (en) * | 2017-02-10 | 2018-08-16 | Xerox Corporation | Gated end-to-end memory network |
US20180246853A1 (en) * | 2017-02-28 | 2018-08-30 | Microsoft Technology Licensing, Llc | Hardware node with matrix-vector multiply tiles for neural network processing |
-
2018
- 2018-09-26 CN CN201811122277.6A patent/CN109308520B/zh active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN201311633Y (zh) * | 2008-11-07 | 2009-09-16 | 中国北车股份有限公司大连电力牵引研发中心 | 基于fpga的浮点数值除法器实现的功能模块 |
CN101493760A (zh) * | 2008-12-24 | 2009-07-29 | 京信通信系统(中国)有限公司 | 一种高速除法器及其实现高速除法运算的方法 |
CN104765713A (zh) * | 2014-12-20 | 2015-07-08 | 中国科学院西安光学精密机械研究所 | 基于分段查表三角函数实现fpga数字信号处理的方法 |
US20180232152A1 (en) * | 2017-02-10 | 2018-08-16 | Xerox Corporation | Gated end-to-end memory network |
US20180246853A1 (en) * | 2017-02-28 | 2018-08-30 | Microsoft Technology Licensing, Llc | Hardware node with matrix-vector multiply tiles for neural network processing |
CN107133012A (zh) * | 2017-04-27 | 2017-09-05 | 湖南省瞬渺通信技术有限公司 | 一种高速自定义浮点复数除法器 |
CN108037906A (zh) * | 2017-12-14 | 2018-05-15 | 中国人民解放军国防科技大学 | 基于tcordic算法的浮点基本函数实现方法及装置 |
CN108021537A (zh) * | 2018-01-05 | 2018-05-11 | 南京大学 | 一种基于硬件平台的softmax实现方式 |
Non-Patent Citations (1)
Title |
---|
BO YUAN等: ""Efficient Hardware Architecture of Softmax Layer in Deep Neural Network"", 《2016 IEEE SOCC》 * |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110135086A (zh) * | 2019-05-20 | 2019-08-16 | 合肥工业大学 | 计算精度可变的softmax函数硬件电路及其实现方法 |
CN110135086B (zh) * | 2019-05-20 | 2022-09-13 | 合肥工业大学 | 计算精度可变的softmax函数硬件电路及其实现方法 |
CN112036561A (zh) * | 2020-09-30 | 2020-12-04 | 北京百度网讯科技有限公司 | 数据处理方法、装置、电子设备及存储介质 |
CN112036561B (zh) * | 2020-09-30 | 2024-01-19 | 北京百度网讯科技有限公司 | 数据处理方法、装置、电子设备及存储介质 |
WO2022168604A1 (ja) * | 2021-02-05 | 2022-08-11 | コニカミノルタ株式会社 | ソフトマックス関数の近似計算装置、近似計算方法および近似計算プログラム |
CN114612996A (zh) * | 2022-03-31 | 2022-06-10 | 安谋科技(中国)有限公司 | 神经网络模型的运行方法、介质、程序产品以及电子设备 |
CN114648101A (zh) * | 2022-05-13 | 2022-06-21 | 杭州研极微电子有限公司 | 基于transformer结构的softmax函数量化实现方法和装置 |
CN114626489A (zh) * | 2022-05-17 | 2022-06-14 | 深圳比特微电子科技有限公司 | 一种softmax函数定点化实现方法和装置 |
CN115511047A (zh) * | 2022-06-09 | 2022-12-23 | 上海燧原科技有限公司 | Softmax模型的量化方法、装置、设备及介质 |
CN115511047B (zh) * | 2022-06-09 | 2024-03-08 | 上海燧原科技股份有限公司 | Softmax模型的量化方法、装置、设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
CN109308520B (zh) | 2022-05-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109308520A (zh) | 实现softmax函数计算的FPGA电路及方法 | |
Huang et al. | Robust stability analysis of switched Hopfield neural networks with time-varying delay under uncertainty | |
Wang et al. | WinoNN: Optimizing FPGA-based convolutional neural network accelerators using sparse Winograd algorithm | |
Li et al. | Identification method of neuro‐fuzzy‐based Hammerstein model with coloured noise | |
CN111382860B (zh) | 一种lstm网络的压缩加速方法及fpga加速器 | |
Zhang et al. | Base-2 softmax function: Suitability for training and efficient hardware implementation | |
Noh et al. | FlexBlock: A flexible DNN training accelerator with multi-mode block floating point support | |
CN113935489A (zh) | 基于量子神经网络的变分量子模型tfq-vqa及其两级优化方法 | |
Nazemi et al. | A high performance neural network model for solving chance constrained optimization problems | |
Singh et al. | Fpga implementation of a trained neural network | |
Song et al. | Bsc: Block-based stochastic computing to enable accurate and efficient tinyml | |
Lin et al. | Low-area architecture design of multi-mode activation functions with controllable maximum absolute error for neural network applications | |
CN110837624A (zh) | 一种针对sigmoid函数的近似计算装置 | |
Liu et al. | An efficient BCNN deployment method using quality-aware approximate computing | |
CN110458277A (zh) | 适用于深度学习硬件加速器的可配置精度的卷积硬件结构 | |
Srivastava et al. | Estimation of loadability margin using parallel self-organizing hierarchical neural network | |
Yuancan | A novel method to handle inequality constraints for convex programming neural network | |
Velasco et al. | A hybrid model of autoregressive integrated moving average and artificial neural network for load forecasting | |
Kavipriya et al. | Booth multiplier design using modified square root carry-select-adder | |
Kong | Dynamical behaviors of the generalized hematopoiesis model with discontinuous harvesting terms | |
Ersoy et al. | Realization of artificial neural networks on FPGA | |
Radhakrishnan et al. | An efficient design for area-efficient truncated adaptive booth multiplier for signal processing applications | |
Zhang et al. | A deep learning inference scheme based on pipelined matrix multiplication acceleration design and non-uniform quantization | |
CN112949830B (zh) | 智能推断网络系统以及加法单元和池化单元电路系统 | |
Yi | A Hardware Implementation of SOM Neural Network Algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40004190 Country of ref document: HK |
|
TA01 | Transfer of patent application right |
Effective date of registration: 20200925 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20200925 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |