JP2025502456A - 効率的なイメージセンサ - Google Patents

効率的なイメージセンサ Download PDF

Info

Publication number
JP2025502456A
JP2025502456A JP2024543313A JP2024543313A JP2025502456A JP 2025502456 A JP2025502456 A JP 2025502456A JP 2024543313 A JP2024543313 A JP 2024543313A JP 2024543313 A JP2024543313 A JP 2024543313A JP 2025502456 A JP2025502456 A JP 2025502456A
Authority
JP
Japan
Prior art keywords
neuron
image sensor
neural network
detector
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2024543313A
Other languages
English (en)
Japanese (ja)
Other versions
JP2025502456A5 (https=
Inventor
ファン デル テンペル ウォード
ムラド クリスチャン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
VoxelSensors BV SRL
Original Assignee
VoxelSensors BV SRL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VoxelSensors BV SRL filed Critical VoxelSensors BV SRL
Publication of JP2025502456A publication Critical patent/JP2025502456A/ja
Publication of JP2025502456A5 publication Critical patent/JP2025502456A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • H04N25/772Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters
    • H04N25/773Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters comprising photon counting circuits, e.g. single photon detection [SPD] or single photon avalanche diodes [SPAD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/049Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/067Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means
    • G06N3/0675Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using optical means using electro-optical, acousto-optical or opto-electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/67Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
    • H04N25/671Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
    • H04N25/673Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction by using reference sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/79Arrangements of circuitry being divided between different or multiple substrates, chips or circuit boards, e.g. stacked image sensors
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Neurology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
JP2024543313A 2022-01-27 2023-01-19 効率的なイメージセンサ Pending JP2025502456A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP22153557.8A EP4221188A1 (en) 2022-01-27 2022-01-27 Efficient image sensor
EP22153557.8 2022-01-27
PCT/EP2023/051204 WO2023143997A1 (en) 2022-01-27 2023-01-19 Efficient image sensor

Publications (2)

Publication Number Publication Date
JP2025502456A true JP2025502456A (ja) 2025-01-24
JP2025502456A5 JP2025502456A5 (https=) 2026-01-20

Family

ID=80121782

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2024543313A Pending JP2025502456A (ja) 2022-01-27 2023-01-19 効率的なイメージセンサ

Country Status (6)

Country Link
US (1) US20250159379A1 (https=)
EP (2) EP4221188A1 (https=)
JP (1) JP2025502456A (https=)
KR (1) KR20240144227A (https=)
CN (1) CN118541988A (https=)
WO (1) WO2023143997A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102024110274A1 (de) * 2024-04-12 2025-10-16 OQmented GmbH Verfahren und Vorrichtung zur Bereinigung einer Messung einer Tiefeninformation

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030076992A1 (en) * 2001-06-26 2003-04-24 Banish Michele R. Neural network based element, image pre-processor, and method of pre-processing using a neural network
US7262402B2 (en) * 2005-02-14 2007-08-28 Ecole Polytechnique Federal De Lausanne Integrated imager circuit comprising a monolithic array of single photon avalanche diodes
US7512573B2 (en) * 2006-10-16 2009-03-31 Alcatel-Lucent Usa Inc. Optical processor for an artificial neural network
US9070039B2 (en) * 2013-02-01 2015-06-30 Brian Corporation Temporal winner takes all spiking neuron network sensory processing apparatus and methods
US11289175B1 (en) * 2012-11-30 2022-03-29 Hrl Laboratories, Llc Method of modeling functions of orientation and adaptation on visual cortex
US20180278868A1 (en) * 2017-03-21 2018-09-27 The Charles Stark Draper Laboratory, Inc. Neuromorphic Digital Focal Plane Array
US11037968B2 (en) * 2019-04-05 2021-06-15 Waymo Llc Image sensor architecture
US11493387B2 (en) * 2020-03-12 2022-11-08 Spectricity Correction and calibration of spectral sensor output
JP2023525950A (ja) * 2020-05-07 2023-06-20 メタ プラットフォームズ テクノロジーズ, リミテッド ライアビリティ カンパニー スマートセンサ

Also Published As

Publication number Publication date
EP4338426A1 (en) 2024-03-20
EP4221188A1 (en) 2023-08-02
CN118541988A (zh) 2024-08-23
US20250159379A1 (en) 2025-05-15
KR20240144227A (ko) 2024-10-02
WO2023143997A1 (en) 2023-08-03

Similar Documents

Publication Publication Date Title
Posch et al. Retinomorphic event-based vision sensors: bioinspired cameras with spiking output
Afshar et al. Event-based processing of single photon avalanche diode sensors
EP3967028B1 (en) Event-based vision sensor using on/off event and grayscale detection ramps
US20160093273A1 (en) Dynamic vision sensor with shared pixels and time division multiplexing for higher spatial resolution and better linear separable data
US20230007207A1 (en) Methods of sensor mode switching in event based sensor and imaging camera for low power application
US10677593B2 (en) Machine vision system for forming a digital representation of a low information content scene
WO2021084833A1 (ja) 物体認識システム及び物体認識システムの信号処理方法、並びに、電子機器
JP7830342B2 (ja) 固体撮像装置及び電子機器
US11962924B2 (en) Smart sensor with region of interest capabilities
US11539895B1 (en) Systems, methods, and media for motion adaptive imaging using single-photon image sensor data
JP2023543709A (ja) 時間遅延積分(tdi)に基づく画像センサ及びそのイメージング方法
EP3403398B1 (en) Machine vision system for forming a one dimensional digital representation of a low information content scene
JP2025502456A (ja) 効率的なイメージセンサ
Lin et al. Spiking neural networks for active time-resolved SPAD imaging
CN117999457A (zh) 三维成像系统
US20260101124A1 (en) Smart Sensor with Region of Interest Capabilities
CN109101884B (zh) 一种脉冲阵列预测方法
Huang et al. A motion sensor with on-chip pixel rendering module for optical flow gradient extraction
WO2017010316A1 (ja) 撮像装置、および情報処理システム
US20220400213A1 (en) Object recognition system and method of signal processing performed by object recognition system, and electronic apparatus
CN114972553B (zh) 一种适用于spad阵列的带时间信息的像素地址编码电路
Modak et al. Energy efficiency through in-sensor computing: ADC-less real-time sensing for image edge detection
CN116520350B (zh) 一种感算一体的激光雷达探测芯片
CN220732925U (zh) 图像传感器像素单元、信号处理电路和电子设备
CN117692812A (zh) 一种图像处理方法、电子设备、存储介质和产品

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260109

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20260109