CN115500090A - 具有接口系统的事件驱动集成电路 - Google Patents
具有接口系统的事件驱动集成电路 Download PDFInfo
- Publication number
- CN115500090A CN115500090A CN202180004244.5A CN202180004244A CN115500090A CN 115500090 A CN115500090 A CN 115500090A CN 202180004244 A CN202180004244 A CN 202180004244A CN 115500090 A CN115500090 A CN 115500090A
- Authority
- CN
- China
- Prior art keywords
- event
- module
- driven
- address
- interface system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 claims abstract description 51
- 238000000034 method Methods 0.000 claims abstract description 49
- 230000008569 process Effects 0.000 claims abstract description 34
- 230000004927 fusion Effects 0.000 claims abstract description 31
- 238000005070 sampling Methods 0.000 claims abstract description 27
- 230000010076 replication Effects 0.000 claims description 28
- 238000001914 filtration Methods 0.000 claims description 26
- 238000013507 mapping Methods 0.000 claims description 16
- 238000013528 artificial neural network Methods 0.000 claims description 9
- 230000008859 change Effects 0.000 claims description 7
- 230000008878 coupling Effects 0.000 claims description 7
- 238000010168 coupling process Methods 0.000 claims description 7
- 238000005859 coupling reaction Methods 0.000 claims description 7
- 229910052710 silicon Inorganic materials 0.000 claims description 7
- 239000010703 silicon Substances 0.000 claims description 7
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 claims description 6
- 239000011521 glass Substances 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 230000008521 reorganization Effects 0.000 claims description 6
- 238000000926 separation method Methods 0.000 claims description 5
- 238000001514 detection method Methods 0.000 claims description 4
- 238000011176 pooling Methods 0.000 claims description 4
- 238000011144 upstream manufacturing Methods 0.000 claims description 4
- 238000013527 convolutional neural network Methods 0.000 claims description 2
- 238000004806 packaging method and process Methods 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 abstract description 14
- 238000013461 design Methods 0.000 abstract description 12
- 230000000694 effects Effects 0.000 abstract description 9
- 230000006870 function Effects 0.000 abstract description 8
- 238000005516 engineering process Methods 0.000 abstract description 6
- 230000008901 benefit Effects 0.000 abstract description 5
- 239000013078 crystal Substances 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 239000000047 product Substances 0.000 description 7
- 238000012986 modification Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012421 spiking Methods 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 4
- 238000001228 spectrum Methods 0.000 description 4
- 230000002411 adverse Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 238000006467 substitution reaction Methods 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 230000008520 organization Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010348 incorporation Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000008450 motivation Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000002207 retinal effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 210000000225 synapse Anatomy 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000036962 time dependent Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000004804 winding Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/049—Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/47—Image sensors with pixel address output; Event-driven image sensors; Selection of pixels to be read out based on image data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/76—Architectures of general purpose stored program computers
- G06F15/78—Architectures of general purpose stored program computers comprising a single central processing unit
- G06F15/7807—System on chip, i.e. computer system on a single chip; System in package, i.e. computer system on one or more chips in a single package
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/79—Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Molecular Biology (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Neurology (AREA)
- Advance Control (AREA)
- Multi Processors (AREA)
- Testing Or Calibration Of Command Recording Devices (AREA)
Abstract
本发明涉及一种事件驱动集成电路，其包括传感器、接口系统和处理器，方案异步产生和处理带有地址的事件，且接口系统包括构成可编程菊花链形式的复制模块、融合模块、二次采样模块、兴趣区域模块、事件路由模块等。通过转接板将传感器、接口系统和处理器耦接在单芯片上，且可以使用不同的工艺制造不同的裸晶，方案可以消弭现有技术中信号损失和噪声干扰，可实现信号的高速处理和更低的芯片占用面积、制造成本等技术效果，解决了现有技术中芯片面积大、信号处理能力弱的技术问题。此外接口系统的巧妙设计，丰富了接口系统的功能和可配置性，为后续处理提供各种功耗、功能、速度上的优势。
Description
PCT国内申请，说明书已公开。
Claims (38)
- PCT国内申请，权利要求书已公开。
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2021/088143 WO2022221994A1 (zh) | 2021-04-19 | 2021-04-19 | 具有接口系统的事件驱动集成电路 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115500090A true CN115500090A (zh) | 2022-12-20 |
Family
ID=83723647
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202180004244.5A Pending CN115500090A (zh) | 2021-04-19 | 2021-04-19 | 具有接口系统的事件驱动集成电路 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20240107187A1 (zh) |
| EP (1) | EP4207761A4 (zh) |
| JP (1) | JP2024507400A (zh) |
| KR (1) | KR20230134548A (zh) |
| CN (1) | CN115500090A (zh) |
| WO (1) | WO2022221994A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111031266A (zh) * | 2019-12-31 | 2020-04-17 | 中国人民解放军国防科技大学 | 基于哈希函数的动态视觉传感器背景活动噪声过滤方法、系统及介质 |
| CN111190647A (zh) * | 2019-12-25 | 2020-05-22 | 浙江省北大信息技术高等研究院 | 一种事件驱动型常开唤醒芯片 |
| US20200169681A1 (en) * | 2018-11-26 | 2020-05-28 | Bae Systems Information And Electronic Systems Integration Inc. | Ctia based pixel for simultaneous synchronous frame-based & asynchronous event-driven readouts |
| US20200372254A1 (en) * | 2017-12-26 | 2020-11-26 | Prophesee | Method for outputting a signal from an event-based sensor, and event-based sensor using such method |
| CN112153309A (zh) * | 2019-06-26 | 2020-12-29 | 三星电子株式会社 | 视觉传感器、图像处理设备以及视觉传感器的操作方法 |
| CN112534816A (zh) * | 2018-08-14 | 2021-03-19 | 华为技术有限公司 | 用于视频图像编码的编码参数的基于事件自适应 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5244587B2 (ja) | 2005-06-03 | 2013-07-24 | ウニヴェルズィテート チューリッヒ | 時間依存性の画像データを検出するフォトアレイ |
| CN108574793B (zh) * | 2017-03-08 | 2022-05-10 | 三星电子株式会社 | 被配置为重新生成时间戳的图像处理设备及包括其在内的电子设备 |
| CN107302695A (zh) * | 2017-05-31 | 2017-10-27 | 天津大学 | 一种基于仿生视觉机理的电子复眼系统 |
| JP7175730B2 (ja) * | 2018-12-05 | 2022-11-21 | 株式会社ソニー・インタラクティブエンタテインメント | 信号処理装置、電子機器、センサ装置、信号処理方法およびプログラム |
| CN117094374A (zh) | 2019-04-09 | 2023-11-21 | 成都时识科技有限公司 | 电子电路及内存映射器 |
| US11588987B2 (en) * | 2019-10-02 | 2023-02-21 | Sensors Unlimited, Inc. | Neuromorphic vision with frame-rate imaging for target detection and tracking |
| CN112597980B (zh) * | 2021-03-04 | 2021-06-04 | 之江实验室 | 一种面向动态视觉传感器的类脑手势序列识别方法 |
-
2021
- 2021-04-19 JP JP2023552014A patent/JP2024507400A/ja active Pending
- 2021-04-19 EP EP21937245.5A patent/EP4207761A4/en active Pending
- 2021-04-19 US US18/010,486 patent/US20240107187A1/en active Pending
- 2021-04-19 KR KR1020237028111A patent/KR20230134548A/ko active Search and Examination
- 2021-04-19 CN CN202180004244.5A patent/CN115500090A/zh active Pending
- 2021-04-19 WO PCT/CN2021/088143 patent/WO2022221994A1/zh active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200372254A1 (en) * | 2017-12-26 | 2020-11-26 | Prophesee | Method for outputting a signal from an event-based sensor, and event-based sensor using such method |
| CN112534816A (zh) * | 2018-08-14 | 2021-03-19 | 华为技术有限公司 | 用于视频图像编码的编码参数的基于事件自适应 |
| US20200169681A1 (en) * | 2018-11-26 | 2020-05-28 | Bae Systems Information And Electronic Systems Integration Inc. | Ctia based pixel for simultaneous synchronous frame-based & asynchronous event-driven readouts |
| CN112153309A (zh) * | 2019-06-26 | 2020-12-29 | 三星电子株式会社 | 视觉传感器、图像处理设备以及视觉传感器的操作方法 |
| CN111190647A (zh) * | 2019-12-25 | 2020-05-22 | 浙江省北大信息技术高等研究院 | 一种事件驱动型常开唤醒芯片 |
| CN111031266A (zh) * | 2019-12-31 | 2020-04-17 | 中国人民解放军国防科技大学 | 基于哈希函数的动态视觉传感器背景活动噪声过滤方法、系统及介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20240107187A1 (en) | 2024-03-28 |
| KR20230134548A (ko) | 2023-09-21 |
| WO2022221994A1 (zh) | 2022-10-27 |
| EP4207761A4 (en) | 2024-06-19 |
| JP2024507400A (ja) | 2024-02-19 |
| EP4207761A1 (en) | 2023-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11677662B2 (en) | FPGA-efficient directional two-dimensional router | |
| CN106951926B (zh) | 一种混合架构的深度学习方法及装置 | |
| WO2017173755A1 (zh) | 片上数据划分读写方法、系统及其装置 | |
| CN107852379A (zh) | 用于现场可编程门阵列的定向二维路由器和互连网络、以及所述路由器和网络的其他电路和应用 | |
| EP3557488A1 (en) | Neuromorphic circuit having 3d stacked structure and semiconductor device having the same | |
| CN111433758B (zh) | 可编程运算与控制芯片、设计方法及其装置 | |
| Kowalczyk et al. | Real-time implementation of contextual image processing operations for 4K video stream in Zynq ultrascale+ MPSoC | |
| KR101950786B1 (ko) | 분산처리용 인공신경망 연산 가속화 방법 | |
| KR102137802B1 (ko) | 분산처리용 인공신경망 연산 가속화 장치, 이를 이용한 인공신경망 가속화 시스템, 및 그 인공신경망의 가속화 방법 | |
| WO2022179074A1 (zh) | 数据处理装置、方法、计算机设备及存储介质 | |
| US20220004854A1 (en) | Artificial neural network computation acceleration apparatus for distributed processing, artificial neural network acceleration system using same, and artificial neural network acceleration method therefor | |
| WO2021150952A1 (en) | Data flow architecture for processing with memory computation modules | |
| TWI537980B (zh) | 用於寫入經遮罩資料至緩衝器之裝置及方法 | |
| Thomas | Rotation-invariant point convolution with multiple equivariant alignments | |
| WO2022179075A1 (zh) | 一种数据处理方法、装置、计算机设备及存储介质 | |
| CN115500090A (zh) | 具有接口系统的事件驱动集成电路 | |
| US11664818B2 (en) | Neural network processor for compressing featuremap data and computing system including the same | |
| WO2018197693A1 (fr) | Procédé et dispositif automatisés aptes à assurer l'invariance perceptive d'un évènement spatio-temporel dynamiquement en vue d'en extraire des représentations sémantiques unifiées | |
| Quan et al. | D_dNet-65 R-CNN: Object detection model fusing deep dilated convolutions and light-weight networks | |
| CN113704156B (zh) | 感知数据处理装置、板卡、系统及方法 | |
| CN114239466A (zh) | 基于忆阻器bam实现多模态信息融合联想的电路及其应用 | |
| Schaffner et al. | A real-time 720p feature extraction core based on semantic kernels binarized | |
| JP2020160755A (ja) | 半導体装置 | |
| Blume et al. | Integration of high-performance ASICs into reconfigurable systems providing additional multimedia functionality | |
| EP0333537A1 (fr) | Dispositif de traitement numérique de signaux |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |