IL301126A - Efficient compound engine - Google Patents

Efficient compound engine

Info

Publication number
IL301126A
IL301126A IL301126A IL30112623A IL301126A IL 301126 A IL301126 A IL 301126A IL 301126 A IL301126 A IL 301126A IL 30112623 A IL30112623 A IL 30112623A IL 301126 A IL301126 A IL 301126A
Authority
IL
Israel
Prior art keywords
convolver
row
data
input
units
Prior art date
Application number
IL301126A
Other languages
English (en)
Hebrew (he)
Original Assignee
Recogni Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Recogni Inc filed Critical Recogni Inc
Publication of IL301126A publication Critical patent/IL301126A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/15—Correlation function computation including computation of convolution operations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F5/00—Methods or arrangements for data conversion without changing the order or content of the data handled
    • G06F5/01—Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G06N5/046—Forward inferencing; Production systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Neurology (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Complex Calculations (AREA)
  • Lubrication Of Internal Combustion Engines (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
IL301126A 2018-03-13 2019-02-13 Efficient compound engine IL301126A (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862642578P 2018-03-13 2018-03-13
US201862694290P 2018-07-05 2018-07-05
PCT/US2019/017787 WO2019177735A1 (en) 2018-03-13 2019-02-13 Efficient convolutional engine

Publications (1)

Publication Number Publication Date
IL301126A true IL301126A (en) 2023-05-01

Family

ID=65635810

Family Applications (3)

Application Number Title Priority Date Filing Date
IL301126A IL301126A (en) 2018-03-13 2019-02-13 Efficient compound engine
IL295915A IL295915A (en) 2018-03-13 2019-02-13 Efficient convolutional engine
IL277197A IL277197B2 (en) 2018-03-13 2020-09-07 Efficient compound engine

Family Applications After (2)

Application Number Title Priority Date Filing Date
IL295915A IL295915A (en) 2018-03-13 2019-02-13 Efficient convolutional engine
IL277197A IL277197B2 (en) 2018-03-13 2020-09-07 Efficient compound engine

Country Status (7)

Country Link
US (6) US11468302B2 (de)
EP (4) EP4220488B1 (de)
JP (2) JP7171883B2 (de)
KR (1) KR102516039B1 (de)
CN (1) CN112236783B (de)
IL (3) IL301126A (de)
WO (1) WO2019177735A1 (de)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11514136B2 (en) * 2019-05-17 2022-11-29 Aspiring Sky Co. Limited Circuit for neural network convolutional calculation of variable feature and kernel sizes
US12254405B2 (en) * 2021-03-12 2025-03-18 Qualcomm Incorporated Processing data in pixel-to-pixel neural networks
US11782310B2 (en) * 2021-12-07 2023-10-10 3M Innovative Properties Company Backlighting for display systems
US12456035B2 (en) * 2021-12-08 2025-10-28 Black Sesame Technologies Inc. Neural networks graph partitioning system and method for the same
CN114371829B (zh) * 2022-01-05 2024-07-26 华中科技大学 多项式乘法器中的数据处理方法、多项式乘法器及处理器
JP7784945B2 (ja) * 2022-04-21 2025-12-12 株式会社日立製作所 情報処理装置、情報処理方法、情報処理プログラム、ソフトウェア作成装置、ソフトウェア作成方法、及びソフトウェア作成プログラム
US11762946B1 (en) * 2022-09-23 2023-09-19 Recogni Inc. Systems for using shifter circuit and 3×3 convolver units to emulate functionality of larger sized convolver units
US20240330660A1 (en) * 2023-03-31 2024-10-03 Stmicroelectronics International N.V. Neural network including local storage unit
CN120874928B (zh) * 2025-09-26 2025-12-16 中国人民解放军军事科学院国防科技创新研究院 应用于量化神经网络卷积层的可变精度计算单元的设计方法及使用方法
US12688254B1 (en) 2026-02-27 2026-07-21 Tensordyne, Inc. Method and apparatus for logarithmic mathematics in AI matrix multiplications

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4347580A (en) * 1980-07-21 1982-08-31 The United States Of America As Represented By The Secretary Of The Navy Array convolver/correlator
US5014235A (en) * 1987-12-15 1991-05-07 Steven G. Morton Convolution memory
US5138695A (en) 1989-10-10 1992-08-11 Hnc, Inc. Systolic array image processing system
US5949920A (en) * 1996-08-13 1999-09-07 Hewlett-Packard Co. Reconfigurable convolver circuit
US10572824B2 (en) * 2003-05-23 2020-02-25 Ip Reservoir, Llc System and method for low latency multi-functional pipeline with correlation logic and selectively activated/deactivated pipelined data processing engines
WO2009120232A1 (en) * 2008-03-27 2009-10-01 Ge Healthcare Bioscience Bioprocess Corp. A method for preventing an unauthorized use of disposable bioprocess components
US8533250B1 (en) * 2009-06-17 2013-09-10 Altera Corporation Multiplier with built-in accumulator
US8442927B2 (en) 2009-07-30 2013-05-14 Nec Laboratories America, Inc. Dynamically configurable, multi-ported co-processor for convolutional neural networks
US9477999B2 (en) 2013-09-20 2016-10-25 The Board Of Trustees Of The Leland Stanford Junior University Low power programmable image processor
US10417525B2 (en) * 2014-09-22 2019-09-17 Samsung Electronics Co., Ltd. Object recognition with reduced neural network weight precision
US10223635B2 (en) * 2015-01-22 2019-03-05 Qualcomm Incorporated Model compression and fine-tuning
US9965824B2 (en) 2015-04-23 2018-05-08 Google Llc Architecture for high performance, power efficient, programmable image processing
US10373050B2 (en) * 2015-05-08 2019-08-06 Qualcomm Incorporated Fixed point neural network based on floating point neural network quantization
US10049322B2 (en) * 2015-05-21 2018-08-14 Google Llc Prefetching weights for use in a neural network processor
US20160379109A1 (en) 2015-06-29 2016-12-29 Microsoft Technology Licensing, Llc Convolutional neural networks on hardware accelerators
KR102325602B1 (ko) 2015-07-06 2021-11-12 삼성전자주식회사 데이터를 병렬적으로 처리하는 장치 및 방법
CN106203617B (zh) * 2016-06-27 2018-08-21 哈尔滨工业大学深圳研究生院 一种基于卷积神经网络的加速处理单元及阵列结构
US10546211B2 (en) * 2016-07-01 2020-01-28 Google Llc Convolutional neural network on programmable two dimensional image processor
US20180007302A1 (en) * 2016-07-01 2018-01-04 Google Inc. Block Operations For An Image Processor Having A Two-Dimensional Execution Lane Array and A Two-Dimensional Shift Register
US20180046903A1 (en) * 2016-08-12 2018-02-15 DeePhi Technology Co., Ltd. Deep processing unit (dpu) for implementing an artificial neural network (ann)
JP2018067154A (ja) * 2016-10-19 2018-04-26 ソニーセミコンダクタソリューションズ株式会社 演算処理回路および認識システム
US9779786B1 (en) * 2016-10-26 2017-10-03 Xilinx, Inc. Tensor operations and acceleration
JP6961011B2 (ja) 2016-12-09 2021-11-05 ベイジン ホライズン インフォメーション テクノロジー カンパニー リミテッド データ管理のためのシステム及び方法
WO2018138603A1 (en) * 2017-01-26 2018-08-02 Semiconductor Energy Laboratory Co., Ltd. Semiconductor device and electronic device including the semiconductor device
CN106951395B (zh) 2017-02-13 2018-08-17 上海客鹭信息技术有限公司 面向压缩卷积神经网络的并行卷积运算方法及装置
CN106951961B (zh) 2017-02-24 2019-11-26 清华大学 一种粗粒度可重构的卷积神经网络加速器及系统
US10489878B2 (en) 2017-05-15 2019-11-26 Google Llc Configurable and programmable image processor unit
CN118821876A (zh) * 2017-05-19 2024-10-22 莫维迪乌斯有限公司 用于提高卷积效率的方法、系统和装置
US10929746B2 (en) 2017-11-27 2021-02-23 Samsung Electronics Co., Ltd. Low-power hardware acceleration method and system for convolution neural network computation
KR102931058B1 (ko) * 2017-12-05 2026-02-24 삼성전자주식회사 뉴럴 네트워크에서 컨볼루션 연산을 처리하는 방법 및 장치
US10747844B2 (en) * 2017-12-12 2020-08-18 Tesla, Inc. Systems and methods for converting a matrix input to a vectorized input for a matrix processor
US11256977B2 (en) * 2017-12-29 2022-02-22 Facebook, Inc. Lowering hardware for neural networks

Also Published As

Publication number Publication date
EP3766020C0 (de) 2023-11-08
WO2019177735A1 (en) 2019-09-19
CN112236783A (zh) 2021-01-15
US11645504B2 (en) 2023-05-09
JP7171883B2 (ja) 2022-11-15
US11580372B2 (en) 2023-02-14
US11593630B2 (en) 2023-02-28
US11694068B2 (en) 2023-07-04
US20220351027A1 (en) 2022-11-03
US20190286975A1 (en) 2019-09-19
EP4583001A2 (de) 2025-07-09
EP4220488B1 (de) 2025-07-09
US20220351031A1 (en) 2022-11-03
JP2023014091A (ja) 2023-01-26
IL295915A (en) 2022-10-01
KR102516039B1 (ko) 2023-03-30
US20220351029A1 (en) 2022-11-03
JP2021517702A (ja) 2021-07-26
IL277197B2 (en) 2023-02-01
EP4220488C0 (de) 2025-07-09
US11694069B2 (en) 2023-07-04
EP3766020B1 (de) 2023-11-08
EP4583001A3 (de) 2025-08-20
US11468302B2 (en) 2022-10-11
KR20200140282A (ko) 2020-12-15
IL277197B (en) 2022-10-01
US20220351028A1 (en) 2022-11-03
IL277197A (en) 2020-10-29
EP4583000A3 (de) 2025-08-20
US20220351030A1 (en) 2022-11-03
EP4220488A1 (de) 2023-08-02
EP3766020A1 (de) 2021-01-20
CN112236783B (zh) 2023-04-11
EP4583000A2 (de) 2025-07-09

Similar Documents

Publication Publication Date Title
EP3766020B1 (de) Effiziente faltungsmaschine
EP3644223A1 (de) Bildklassifikationssystem basierend auf ensemble-lernen
US20190095776A1 (en) Efficient data distribution for parallel processing
US20230376733A1 (en) Convolutional neural network accelerator hardware
CN110059815A (zh) 人工智能推理计算设备
US11164032B2 (en) Method of performing data processing operation
CN108073549A (zh) 卷积运算装置及方法
EP4290395A1 (de) Hardwarearchitektur mit geringem stromverbrauch zur handhabung von akkumulationsüberschüssen in einem konvolutionsbetrieb
KR102833795B1 (ko) 컨볼루션 뉴럴 네트워크를 처리하는 방법 및 장치
Lee et al. Designing an optimized processing elements structure for depthwise separable convolution
US12061967B2 (en) Processing data for a layer of a neural network
US20230075264A1 (en) Methods and devices for efficient general deconvolution implementation on hardware accelerator
EP4303771B1 (de) Iterationsmaschine zur berechnung grosser kerne bei faltungsbeschleunigern
US7397951B2 (en) Image processing device and image processing method
US20250231742A1 (en) Transposing information using shadow latches and active latches for efficient die area in processing system
US20040172437A1 (en) Image processing device and image processing method
WO2020225916A1 (ja) 情報処理装置