HK1259158A1 - 在定點運算計算系統中實現神經網絡 - Google Patents
在定點運算計算系統中實現神經網絡Info
- Publication number
- HK1259158A1 HK1259158A1 HK19101205.8A HK19101205A HK1259158A1 HK 1259158 A1 HK1259158 A1 HK 1259158A1 HK 19101205 A HK19101205 A HK 19101205A HK 1259158 A1 HK1259158 A1 HK 1259158A1
- Authority
- HK
- Hong Kong
- Prior art keywords
- neural networks
- fixed point
- computing systems
- point arithmetic
- arithmetic computing
- Prior art date
Links
- 238000013528 artificial neural network Methods 0.000 title 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F5/00—Methods or arrangements for data conversion without changing the order or content of the data handled
- G06F5/01—Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising
- G06F5/012—Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising in floating-point computations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
- G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
- G06F7/483—Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
- G06F2207/3804—Details
- G06F2207/3808—Details concerning the type of numbers or the way they are handled
- G06F2207/3812—Devices capable of handling different types of numbers
- G06F2207/3824—Accepting both fixed-point and floating-point numbers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
- G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
- G06F2207/48—Indexing scheme relating to groups G06F7/48 - G06F7/575
- G06F2207/4802—Special implementations
- G06F2207/4818—Threshold devices
- G06F2207/4824—Neural networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Molecular Biology (AREA)
- Artificial Intelligence (AREA)
- General Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- Mathematical Optimization (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- Neurology (AREA)
- Nonlinear Science (AREA)
- Image Analysis (AREA)
- Feedback Control In General (AREA)
- Advance Control (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/432,842 US10650303B2 (en) | 2017-02-14 | 2017-02-14 | Implementing neural networks in fixed point arithmetic computing systems |
US15/476,769 US9836692B1 (en) | 2017-02-14 | 2017-03-31 | Implementing neural networks in fixed point arithmetic computing systems |
Publications (1)
Publication Number | Publication Date |
---|---|
HK1259158A1 true HK1259158A1 (zh) | 2019-11-29 |
Family
ID=60452224
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
HK19101205.8A HK1259158A1 (zh) | 2017-02-14 | 2019-01-23 | 在定點運算計算系統中實現神經網絡 |
Country Status (9)
Country | Link |
---|---|
US (3) | US10650303B2 (zh) |
EP (1) | EP3361422B1 (zh) |
CN (2) | CN108427991A (zh) |
DE (1) | DE102018103303A1 (zh) |
DK (1) | DK3361422T3 (zh) |
GB (1) | GB2561669A (zh) |
HK (1) | HK1259158A1 (zh) |
TW (4) | TWI787803B (zh) |
WO (1) | WO2018152205A1 (zh) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10417525B2 (en) | 2014-09-22 | 2019-09-17 | Samsung Electronics Co., Ltd. | Object recognition with reduced neural network weight precision |
US10467796B2 (en) | 2017-04-17 | 2019-11-05 | Intel Corporation | Graphics system with additional context |
CN109961133B (zh) * | 2017-12-14 | 2020-04-24 | 中科寒武纪科技股份有限公司 | 集成电路芯片装置及相关产品 |
WO2019129070A1 (zh) * | 2017-12-27 | 2019-07-04 | 北京中科寒武纪科技有限公司 | 一种集成电路芯片装置 |
EP3651077B1 (en) * | 2018-02-13 | 2021-10-27 | Shanghai Cambricon Information Technology Co., Ltd | Computation device and method |
KR20190125141A (ko) | 2018-04-27 | 2019-11-06 | 삼성전자주식회사 | 뉴럴 네트워크의 파라미터들을 양자화하는 방법 및 장치 |
KR20200026455A (ko) | 2018-09-03 | 2020-03-11 | 삼성전자주식회사 | 인공 신경망 시스템 및 인공 신경망의 고정 소수점 제어 방법 |
CN109284761B (zh) * | 2018-09-04 | 2020-11-27 | 苏州科达科技股份有限公司 | 一种图像特征提取方法、装置、设备及可读存储介质 |
KR20200029661A (ko) | 2018-09-07 | 2020-03-19 | 삼성전자주식회사 | 뉴럴 프로세싱 시스템 |
US11663464B2 (en) | 2018-09-20 | 2023-05-30 | Kneron (Taiwan) Co., Ltd. | Deep neural network with low-precision dynamic fixed-point in reconfigurable hardware design |
KR20200061164A (ko) | 2018-11-23 | 2020-06-02 | 삼성전자주식회사 | 뉴럴 네트워크 연산 수행을 위한 뉴럴 네트워크 장치, 뉴럴 네트워크 장치의 동작 방법 및 뉴럴 네트워크 장치를 포함하는 애플리케이션 프로세서 |
CN109670582B (zh) * | 2018-12-28 | 2021-05-07 | 四川那智科技有限公司 | 一种全定点化神经网络的设计方法 |
DE112020000202T5 (de) * | 2019-01-18 | 2021-08-26 | Hitachi Astemo, Ltd. | Komprimierungsvorrichtung für neuronale Netze |
CN110008952B (zh) * | 2019-03-26 | 2021-06-15 | 深兰科技(上海)有限公司 | 一种目标识别方法及设备 |
WO2021077283A1 (zh) * | 2019-10-22 | 2021-04-29 | 深圳鲲云信息科技有限公司 | 神经网络计算压缩方法、系统及存储介质 |
US11601134B2 (en) | 2020-01-10 | 2023-03-07 | Robert Bosch Gmbh | Optimized quantization for reduced resolution neural networks |
US20220156567A1 (en) * | 2020-11-13 | 2022-05-19 | Mediatek Inc. | Neural network processing unit for hybrid and mixed precision computing |
CN112702600B (zh) * | 2020-12-29 | 2022-04-12 | 南京大学 | 一种图像编解码神经网络分层定点化方法 |
CN113342346B (zh) * | 2021-05-18 | 2022-03-25 | 北京百度网讯科技有限公司 | 深度学习框架的算子注册方法、装置、设备和存储介质 |
TWI778822B (zh) * | 2021-09-30 | 2022-09-21 | 鴻海精密工業股份有限公司 | 基於神經網路模型的影像處理方法、電子設備及儲存介質 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW305998B (en) | 1996-06-14 | 1997-05-21 | Ind Tech Res Inst | Weighted sum type of artificial neural network with reconfigurable structure and bit-serial I/O mode |
US8443169B2 (en) * | 2005-03-28 | 2013-05-14 | Gerald George Pechanek | Interconnection network connecting operation-configurable nodes according to one or more levels of adjacency in multiple dimensions of communication in a multi-processor and a neural processor |
US7917333B2 (en) | 2008-08-20 | 2011-03-29 | Caterpillar Inc. | Virtual sensor network (VSN) based control system and method |
US9015204B2 (en) | 2009-07-15 | 2015-04-21 | Hewlett-Packard Development Company, L.P. | Onboarding resources to an identity management system |
TWI525558B (zh) | 2011-01-17 | 2016-03-11 | Univ Nat Taipei Technology | Resilient high - speed hardware reverse transfer and feedback type neural network system |
CN102981854A (zh) | 2012-11-16 | 2013-03-20 | 天津市天祥世联网络科技有限公司 | 基于浮点数运算内联函数库的神经网络优化方法 |
CN106575379B (zh) * | 2014-09-09 | 2019-07-23 | 英特尔公司 | 用于神经网络的改进的定点整型实现方式 |
US20170061279A1 (en) * | 2015-01-14 | 2017-03-02 | Intel Corporation | Updating an artificial neural network using flexible fixed point representation |
US10373050B2 (en) | 2015-05-08 | 2019-08-06 | Qualcomm Incorporated | Fixed point neural network based on floating point neural network quantization |
US11244225B2 (en) | 2015-07-10 | 2022-02-08 | Samsung Electronics Co., Ltd. | Neural network processor configurable using macro instructions |
WO2017073000A1 (ja) * | 2015-10-29 | 2017-05-04 | 株式会社Preferred Networks | 情報処理装置及び情報処理方法 |
CN105760933A (zh) | 2016-02-18 | 2016-07-13 | 清华大学 | 卷积神经网络的逐层变精度定点化方法及装置 |
-
2017
- 2017-02-14 US US15/432,842 patent/US10650303B2/en active Active
- 2017-03-31 US US15/476,769 patent/US9836692B1/en active Active
-
2018
- 2018-02-14 DE DE102018103303.6A patent/DE102018103303A1/de not_active Withdrawn
- 2018-02-14 TW TW110115931A patent/TWI787803B/zh active
- 2018-02-14 DK DK18156667.0T patent/DK3361422T3/da active
- 2018-02-14 TW TW107105678A patent/TWI728230B/zh active
- 2018-02-14 WO PCT/US2018/018184 patent/WO2018152205A1/en active Application Filing
- 2018-02-14 CN CN201810152235.0A patent/CN108427991A/zh active Pending
- 2018-02-14 GB GB1802414.1A patent/GB2561669A/en not_active Withdrawn
- 2018-02-14 TW TW111135158A patent/TWI823571B/zh active
- 2018-02-14 EP EP18156667.0A patent/EP3361422B1/en active Active
- 2018-02-14 TW TW107202461U patent/TWM573476U/zh unknown
- 2018-02-14 CN CN202211709740.3A patent/CN116415637A/zh active Pending
-
2019
- 2019-01-23 HK HK19101205.8A patent/HK1259158A1/zh unknown
-
2020
- 2020-03-26 US US16/830,922 patent/US11868864B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US9836692B1 (en) | 2017-12-05 |
GB201802414D0 (en) | 2018-03-28 |
TWI728230B (zh) | 2021-05-21 |
US11868864B2 (en) | 2024-01-09 |
US20200226445A1 (en) | 2020-07-16 |
TW202131233A (zh) | 2021-08-16 |
CN108427991A (zh) | 2018-08-21 |
EP3361422B1 (en) | 2021-12-08 |
US10650303B2 (en) | 2020-05-12 |
TW202301201A (zh) | 2023-01-01 |
TW201835818A (zh) | 2018-10-01 |
TWI823571B (zh) | 2023-11-21 |
TWI787803B (zh) | 2022-12-21 |
EP3361422A1 (en) | 2018-08-15 |
WO2018152205A1 (en) | 2018-08-23 |
TWM573476U (zh) | 2019-01-21 |
CN116415637A (zh) | 2023-07-11 |
DE102018103303A1 (de) | 2018-08-16 |
US20180232626A1 (en) | 2018-08-16 |
GB2561669A (en) | 2018-10-24 |
DK3361422T3 (da) | 2022-01-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
HK1259158A1 (zh) | 在定點運算計算系統中實現神經網絡 | |
SG11202004153UA (en) | Distributed computing system and method | |
GB201906513D0 (en) | Power management in disaggregated computing systems | |
HK1252999A1 (zh) | 通用並行計算架構 | |
GB201621068D0 (en) | Edge computing system | |
GB201801088D0 (en) | Neuromorphic processing devices | |
PT3523723T (pt) | Sistema e método computacional de alto desempenho | |
EP3138231B8 (en) | Secure computing systems and methods | |
EP3329424A4 (en) | OBJECT DETECTION WITH NEURONAL NETWORK | |
EP3295294A4 (en) | Stream computing system and method | |
EP3192016A4 (en) | Computing system for training neural networks | |
EP3218800C0 (en) | SECURE MULTI-PARTY CALCULATION ON SPREADSHEETS | |
GB201721776D0 (en) | Edge computing system | |
PL3265571T3 (pl) | System wielowektorowy i jego zastosowania | |
EP3475820A4 (en) | ADAPTIVE RESOURCE MANAGEMENT IN DISTRIBUTED COMPUTER SYSTEMS | |
SG11201704498QA (en) | Computing systems and methods | |
ZA201800006B (en) | Intelligent defense system based on cloud computing platform | |
EP3346644A4 (en) | GATEWAY DEVICE AND COMPUTER DEVICE | |
GB201800176D0 (en) | Executing computational graphs on graphics processing units | |
EP3304944A4 (en) | Self-locating computing devices, systems, and methods | |
GB201621081D0 (en) | Edge computing system | |
GB201801887D0 (en) | Crawler device and traveling object | |
GB2569270B (en) | Parallel computing | |
ZA201705375B (en) | Continuous bagging processes and systems | |
EP3590060A4 (en) | COMPUTER SYSTEMS AND PROCEDURES |