CN116210228A - 信号处理装置、成像装置和信号处理方法 - Google Patents

信号处理装置、成像装置和信号处理方法 Download PDF

Info

Publication number
CN116210228A
CN116210228A CN202180065035.1A CN202180065035A CN116210228A CN 116210228 A CN116210228 A CN 116210228A CN 202180065035 A CN202180065035 A CN 202180065035A CN 116210228 A CN116210228 A CN 116210228A
Authority
CN
China
Prior art keywords
input data
multiply
data
processing unit
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180065035.1A
Other languages
English (en)
Chinese (zh)
Inventor
半泽克彦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Semiconductor Solutions Corp
Original Assignee
Sony Semiconductor Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Semiconductor Solutions Corp filed Critical Sony Semiconductor Solutions Corp
Publication of CN116210228A publication Critical patent/CN116210228A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/544—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices for evaluating functions by calculation
    • G06F7/5443—Sum of products
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/78—Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/067—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means
    • G06N3/0675—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means using electro-optical, acousto-optical or opto-electronic means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Software Systems (AREA)
  • Mathematical Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Mathematical Optimization (AREA)
  • Computational Mathematics (AREA)
  • Neurology (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Image Processing (AREA)
CN202180065035.1A 2020-09-30 2021-09-16 信号处理装置、成像装置和信号处理方法 Pending CN116210228A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020166280 2020-09-30
JP2020-166280 2020-09-30
PCT/JP2021/034103 WO2022070947A1 (ja) 2020-09-30 2021-09-16 信号処理装置、撮像装置、信号処理方法

Publications (1)

Publication Number Publication Date
CN116210228A true CN116210228A (zh) 2023-06-02

Family

ID=80950317

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180065035.1A Pending CN116210228A (zh) 2020-09-30 2021-09-16 信号处理装置、成像装置和信号处理方法

Country Status (5)

Country Link
US (1) US20230333816A1 (https=)
JP (1) JPWO2022070947A1 (https=)
CN (1) CN116210228A (https=)
DE (1) DE112021005190T5 (https=)
WO (1) WO2022070947A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20220150319A (ko) * 2020-03-06 2022-11-10 가부시키가이샤 한도오따이 에네루기 켄큐쇼 촬상 장치 및 전자 기기
US20220253692A1 (en) * 2021-02-05 2022-08-11 Samsung Electronics Co., Ltd. Method and apparatus of operating a neural network
US11979674B2 (en) * 2022-09-08 2024-05-07 Micron Technology, Inc. Image enhancement using integrated circuit devices having analog inference capability
US12266184B2 (en) * 2022-09-08 2025-04-01 Micron Technology, Inc. Surveillance cameras implemented using integrated circuit devices having analog inference capability
US12538048B2 (en) * 2022-09-08 2026-01-27 Micron Technology, Inc. Image sensor with analog inference capability
US12437810B2 (en) * 2022-11-29 2025-10-07 Micron Technology, Inc. Memory device performing multiplication using logical states of memory cells
WO2024162015A1 (ja) * 2023-02-03 2024-08-08 ソニーセミコンダクタソリューションズ株式会社 撮像装置、データ処理方法、及び、記録媒体
US20240304255A1 (en) * 2023-03-09 2024-09-12 Micron Technology, Inc. Memory device for multiplication using memory cells with different thresholds based on bit significance
JP7696532B2 (ja) * 2023-05-17 2025-06-20 三菱電機モビリティ株式会社 異常判定装置、および、異常判定方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070244842A1 (en) * 2004-06-03 2007-10-18 Mie Ishii Information Processing Method and Apparatus, and Image Pickup Device
CN102053817A (zh) * 2009-10-30 2011-05-11 Arm有限公司 用于执行乘法累加运算的设备和方法
CN107622305A (zh) * 2017-08-24 2018-01-23 中国科学院计算技术研究所 用于神经网络的处理器和处理方法
US20180285715A1 (en) * 2017-03-28 2018-10-04 Samsung Electronics Co., Ltd. Convolutional neural network (cnn) processing method and apparatus
US20190362787A1 (en) * 2018-05-22 2019-11-28 The Regents Of The University Of Michigan Memory Processing Unit
US20200159529A1 (en) * 2018-11-19 2020-05-21 Advanced Micro Devices, Inc. Family of lossy sparse load simd instructions
CN111669527A (zh) * 2020-07-01 2020-09-15 浙江大学 一种cmos图像传感器内的卷积运算架构

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10360163B2 (en) 2016-10-27 2019-07-23 Google Llc Exploiting input data sparsity in neural network compute units

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070244842A1 (en) * 2004-06-03 2007-10-18 Mie Ishii Information Processing Method and Apparatus, and Image Pickup Device
CN102053817A (zh) * 2009-10-30 2011-05-11 Arm有限公司 用于执行乘法累加运算的设备和方法
US20180285715A1 (en) * 2017-03-28 2018-10-04 Samsung Electronics Co., Ltd. Convolutional neural network (cnn) processing method and apparatus
CN107622305A (zh) * 2017-08-24 2018-01-23 中国科学院计算技术研究所 用于神经网络的处理器和处理方法
US20190362787A1 (en) * 2018-05-22 2019-11-28 The Regents Of The University Of Michigan Memory Processing Unit
US20200159529A1 (en) * 2018-11-19 2020-05-21 Advanced Micro Devices, Inc. Family of lossy sparse load simd instructions
CN111669527A (zh) * 2020-07-01 2020-09-15 浙江大学 一种cmos图像传感器内的卷积运算架构

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YASUHIRO NAKAHARA , JUNTARO CHIKA , TAIKI AMAGASAKI, KEN ZHAO, MASAHIRO IIDA: "RECONF;IEICE Technical Report", DNN ACCELERATOR FOR AI EDGE COMPUTING, vol. 119, 7 November 2019 (2019-11-07) *

Also Published As

Publication number Publication date
JPWO2022070947A1 (https=) 2022-04-07
DE112021005190T5 (de) 2023-09-14
WO2022070947A1 (ja) 2022-04-07
US20230333816A1 (en) 2023-10-19

Similar Documents

Publication Publication Date Title
CN116210228A (zh) 信号处理装置、成像装置和信号处理方法
US11816045B2 (en) Exploiting input data sparsity in neural network compute units
US20250299034A1 (en) Activation Functions for Deep Neural Networks
US7098437B2 (en) Semiconductor integrated circuit device having a plurality of photo detectors and processing elements
US20190385024A1 (en) Image processing using a neural network system
US20180032150A1 (en) Method for processing event signal and event-based sensor performing the same
WO2019029785A1 (en) MATERIAL CIRCUIT
CN110430368A (zh) 用于处理图像的设备和方法
EP3633559B1 (en) Information processing apparatus, information processing method, non-transitory computer-readable storage medium
US20200118249A1 (en) Device configured to perform neural network operation and method of operating same
JP2011054192A (ja) 画像分割システム及び方法
JP6567381B2 (ja) 演算装置、方法及びプログラム
Piyasena et al. Reducing dynamic power in streaming CNN hardware accelerators by exploiting computational redundancies
CN103841340A (zh) 图像传感器及其运作方法
KR102557572B1 (ko) 인공 신경망 장치 및 그 동작 방법
EP3971781A1 (en) Method and apparatus with neural network operation
CN113160026A (zh) 图像处理方法、装置、介质以及电子设备
JP2007535066A (ja) 画像処理装置及び方法
US9818045B2 (en) Apparatus and method for detecting a feature in an image
US20100128989A1 (en) Correlation processing apparatus and medium readable by correlation processing apparatus
JP4436626B2 (ja) 画像処理装置
CN120561434B (zh) 卷积运算系统和方法
KR20190066463A (ko) 멀티 센서 카메라의 전력 관리 방법 및 장치
CN121456572A (zh) 计算机储存装置及其分类方法
CN119851099A (zh) 图像识别系统及方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination