HK1259158A1 - 在定點運算計算系統中實現神經網絡 - Google Patents

在定點運算計算系統中實現神經網絡

Info

Publication number
HK1259158A1
HK1259158A1 HK19101205.8A HK19101205A HK1259158A1 HK 1259158 A1 HK1259158 A1 HK 1259158A1 HK 19101205 A HK19101205 A HK 19101205A HK 1259158 A1 HK1259158 A1 HK 1259158A1
Authority
HK
Hong Kong
Prior art keywords
neural networks
fixed point
computing systems
point arithmetic
arithmetic computing
Prior art date
Application number
HK19101205.8A
Other languages
English (en)
Inventor
威廉‧約翰‧格蘭德
Original Assignee
谷歌有限責任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 谷歌有限責任公司 filed Critical 谷歌有限責任公司
Publication of HK1259158A1 publication Critical patent/HK1259158A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F5/00—Methods or arrangements for data conversion without changing the order or content of the data handled
    • G06F5/01—Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising
    • G06F5/012—Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising in floating-point computations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/483—Computations with numbers represented by a non-linear combination of denominational numbers, e.g. rational numbers, logarithmic number system or floating-point numbers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
    • G06F2207/3804—Details
    • G06F2207/3808—Details concerning the type of numbers or the way they are handled
    • G06F2207/3812—Devices capable of handling different types of numbers
    • G06F2207/3824—Accepting both fixed-point and floating-point numbers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2207/00—Indexing scheme relating to methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F2207/38—Indexing scheme relating to groups G06F7/38 - G06F7/575
    • G06F2207/48—Indexing scheme relating to groups G06F7/48 - G06F7/575
    • G06F2207/4802—Special implementations
    • G06F2207/4818—Threshold devices
    • G06F2207/4824—Neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Optimization (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Pure & Applied Mathematics (AREA)
  • Neurology (AREA)
  • Nonlinear Science (AREA)
  • Image Analysis (AREA)
  • Feedback Control In General (AREA)
  • Advance Control (AREA)
HK19101205.8A 2017-02-14 2019-01-23 在定點運算計算系統中實現神經網絡 HK1259158A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/432,842 US10650303B2 (en) 2017-02-14 2017-02-14 Implementing neural networks in fixed point arithmetic computing systems
US15/476,769 US9836692B1 (en) 2017-02-14 2017-03-31 Implementing neural networks in fixed point arithmetic computing systems

Publications (1)

Publication Number Publication Date
HK1259158A1 true HK1259158A1 (zh) 2019-11-29

Family

ID=60452224

Family Applications (1)

Application Number Title Priority Date Filing Date
HK19101205.8A HK1259158A1 (zh) 2017-02-14 2019-01-23 在定點運算計算系統中實現神經網絡

Country Status (9)

Country Link
US (3) US10650303B2 (zh)
EP (1) EP3361422B1 (zh)
CN (2) CN108427991A (zh)
DE (1) DE102018103303A1 (zh)
DK (1) DK3361422T3 (zh)
GB (1) GB2561669A (zh)
HK (1) HK1259158A1 (zh)
TW (4) TWI787803B (zh)
WO (1) WO2018152205A1 (zh)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10417525B2 (en) 2014-09-22 2019-09-17 Samsung Electronics Co., Ltd. Object recognition with reduced neural network weight precision
US10467796B2 (en) 2017-04-17 2019-11-05 Intel Corporation Graphics system with additional context
CN109961133B (zh) * 2017-12-14 2020-04-24 中科寒武纪科技股份有限公司 集成电路芯片装置及相关产品
WO2019129070A1 (zh) * 2017-12-27 2019-07-04 北京中科寒武纪科技有限公司 一种集成电路芯片装置
EP3651077B1 (en) * 2018-02-13 2021-10-27 Shanghai Cambricon Information Technology Co., Ltd Computation device and method
KR20190125141A (ko) 2018-04-27 2019-11-06 삼성전자주식회사 뉴럴 네트워크의 파라미터들을 양자화하는 방법 및 장치
KR20200026455A (ko) 2018-09-03 2020-03-11 삼성전자주식회사 인공 신경망 시스템 및 인공 신경망의 고정 소수점 제어 방법
CN109284761B (zh) * 2018-09-04 2020-11-27 苏州科达科技股份有限公司 一种图像特征提取方法、装置、设备及可读存储介质
KR20200029661A (ko) 2018-09-07 2020-03-19 삼성전자주식회사 뉴럴 프로세싱 시스템
US11663464B2 (en) 2018-09-20 2023-05-30 Kneron (Taiwan) Co., Ltd. Deep neural network with low-precision dynamic fixed-point in reconfigurable hardware design
KR20200061164A (ko) 2018-11-23 2020-06-02 삼성전자주식회사 뉴럴 네트워크 연산 수행을 위한 뉴럴 네트워크 장치, 뉴럴 네트워크 장치의 동작 방법 및 뉴럴 네트워크 장치를 포함하는 애플리케이션 프로세서
CN109670582B (zh) * 2018-12-28 2021-05-07 四川那智科技有限公司 一种全定点化神经网络的设计方法
DE112020000202T5 (de) * 2019-01-18 2021-08-26 Hitachi Astemo, Ltd. Komprimierungsvorrichtung für neuronale Netze
CN110008952B (zh) * 2019-03-26 2021-06-15 深兰科技（上海）有限公司 一种目标识别方法及设备
WO2021077283A1 (zh) * 2019-10-22 2021-04-29 深圳鲲云信息科技有限公司 神经网络计算压缩方法、系统及存储介质
US11601134B2 (en) 2020-01-10 2023-03-07 Robert Bosch Gmbh Optimized quantization for reduced resolution neural networks
US20220156567A1 (en) * 2020-11-13 2022-05-19 Mediatek Inc. Neural network processing unit for hybrid and mixed precision computing
CN112702600B (zh) * 2020-12-29 2022-04-12 南京大学 一种图像编解码神经网络分层定点化方法
CN113342346B (zh) * 2021-05-18 2022-03-25 北京百度网讯科技有限公司 深度学习框架的算子注册方法、装置、设备和存储介质
TWI778822B (zh) * 2021-09-30 2022-09-21 鴻海精密工業股份有限公司 基於神經網路模型的影像處理方法、電子設備及儲存介質

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW305998B (en) 1996-06-14 1997-05-21 Ind Tech Res Inst Weighted sum type of artificial neural network with reconfigurable structure and bit-serial I/O mode
US8443169B2 (en) * 2005-03-28 2013-05-14 Gerald George Pechanek Interconnection network connecting operation-configurable nodes according to one or more levels of adjacency in multiple dimensions of communication in a multi-processor and a neural processor
US7917333B2 (en) 2008-08-20 2011-03-29 Caterpillar Inc. Virtual sensor network (VSN) based control system and method
US9015204B2 (en) 2009-07-15 2015-04-21 Hewlett-Packard Development Company, L.P. Onboarding resources to an identity management system
TWI525558B (zh) 2011-01-17 2016-03-11 Univ Nat Taipei Technology Resilient high - speed hardware reverse transfer and feedback type neural network system
CN102981854A (zh) 2012-11-16 2013-03-20 天津市天祥世联网络科技有限公司 基于浮点数运算内联函数库的神经网络优化方法
CN106575379B (zh) * 2014-09-09 2019-07-23 英特尔公司 用于神经网络的改进的定点整型实现方式
US20170061279A1 (en) * 2015-01-14 2017-03-02 Intel Corporation Updating an artificial neural network using flexible fixed point representation
US10373050B2 (en) 2015-05-08 2019-08-06 Qualcomm Incorporated Fixed point neural network based on floating point neural network quantization
US11244225B2 (en) 2015-07-10 2022-02-08 Samsung Electronics Co., Ltd. Neural network processor configurable using macro instructions
WO2017073000A1 (ja) * 2015-10-29 2017-05-04 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ 情報処理装置及び情報処理方法
CN105760933A (zh) 2016-02-18 2016-07-13 清华大学 卷积神经网络的逐层变精度定点化方法及装置

Also Published As

Publication number Publication date
US9836692B1 (en) 2017-12-05
GB201802414D0 (en) 2018-03-28
TWI728230B (zh) 2021-05-21
US11868864B2 (en) 2024-01-09
US20200226445A1 (en) 2020-07-16
TW202131233A (zh) 2021-08-16
CN108427991A (zh) 2018-08-21
EP3361422B1 (en) 2021-12-08
US10650303B2 (en) 2020-05-12
TW202301201A (zh) 2023-01-01
TW201835818A (zh) 2018-10-01
TWI823571B (zh) 2023-11-21
TWI787803B (zh) 2022-12-21
EP3361422A1 (en) 2018-08-15
WO2018152205A1 (en) 2018-08-23
TWM573476U (zh) 2019-01-21
CN116415637A (zh) 2023-07-11
DE102018103303A1 (de) 2018-08-16
US20180232626A1 (en) 2018-08-16
GB2561669A (en) 2018-10-24
DK3361422T3 (da) 2022-01-31

Similar Documents

Publication Publication Date Title
HK1259158A1 (zh) 在定點運算計算系統中實現神經網絡
SG11202004153UA (en) Distributed computing system and method
GB201906513D0 (en) Power management in disaggregated computing systems
HK1252999A1 (zh) 通用並行計算架構
GB201621068D0 (en) Edge computing system
GB201801088D0 (en) Neuromorphic processing devices
PT3523723T (pt) Sistema e método computacional de alto desempenho
EP3138231B8 (en) Secure computing systems and methods
EP3329424A4 (en) OBJECT DETECTION WITH NEURONAL NETWORK
EP3295294A4 (en) Stream computing system and method
EP3192016A4 (en) Computing system for training neural networks
EP3218800C0 (en) SECURE MULTI-PARTY CALCULATION ON SPREADSHEETS
GB201721776D0 (en) Edge computing system
PL3265571T3 (pl) System wielowektorowy i jego zastosowania
EP3475820A4 (en) ADAPTIVE RESOURCE MANAGEMENT IN DISTRIBUTED COMPUTER SYSTEMS
SG11201704498QA (en) Computing systems and methods
ZA201800006B (en) Intelligent defense system based on cloud computing platform
EP3346644A4 (en) GATEWAY DEVICE AND COMPUTER DEVICE
GB201800176D0 (en) Executing computational graphs on graphics processing units
EP3304944A4 (en) Self-locating computing devices, systems, and methods
GB201621081D0 (en) Edge computing system
GB201801887D0 (en) Crawler device and traveling object
GB2569270B (en) Parallel computing
ZA201705375B (en) Continuous bagging processes and systems
EP3590060A4 (en) COMPUTER SYSTEMS AND PROCEDURES