TW202428036A - 感測器裝置 - Google Patents

感測器裝置 Download PDF

Info

Publication number
TW202428036A
TW202428036A TW112138299A TW112138299A TW202428036A TW 202428036 A TW202428036 A TW 202428036A TW 112138299 A TW112138299 A TW 112138299A TW 112138299 A TW112138299 A TW 112138299A TW 202428036 A TW202428036 A TW 202428036A
Authority
TW
Taiwan
Prior art keywords
detection
unit
array sensor
image
frame
Prior art date
Application number
TW112138299A
Other languages
English (en)
Chinese (zh)
Inventor
高塚進
矢島史
鉄川弘樹
Original Assignee
日商索尼股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日商索尼股份有限公司 filed Critical 日商索尼股份有限公司
Publication of TW202428036A publication Critical patent/TW202428036A/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/443Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/771Feature selection, e.g. selecting representative features from a multi-dimensional feature space
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/19Recognition using electronic means
    • G06V30/191Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
    • G06V30/19113Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/617Upgrading or updating of programs or applications for camera control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/65Control of camera operation in relation to power supply
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/665Control of cameras or camera modules involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/745Circuitry for generating timing or clock signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Vascular Medicine (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Measurement Of Length, Angles, Or The Like Using Electric Or Magnetic Means (AREA)
  • Image Input (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
TW112138299A 2018-10-19 2019-09-26 感測器裝置 TW202428036A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2018-197496 2018-10-19
JP2018197496 2018-10-19
JP2019111092A JP6683280B1 (ja) 2018-10-19 2019-06-14 センサ装置、信号処理方法
JP2019-111092 2019-06-14

Publications (1)

Publication Number Publication Date
TW202428036A true TW202428036A (zh) 2024-07-01

Family

ID=70166569

Family Applications (2)

Application Number Title Priority Date Filing Date
TW112138299A TW202428036A (zh) 2018-10-19 2019-09-26 感測器裝置
TW108134793A TWI821417B (zh) 2018-10-19 2019-09-26 感測器裝置及信號處理方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
TW108134793A TWI821417B (zh) 2018-10-19 2019-09-26 感測器裝置及信號處理方法

Country Status (7)

Country Link
US (2) US11495008B2 (https=)
EP (1) EP3869784B1 (https=)
JP (2) JP6683280B1 (https=)
KR (1) KR102790248B1 (https=)
CN (1) CN113039777B (https=)
TW (2) TW202428036A (https=)
WO (1) WO2020080140A1 (https=)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6683280B1 (ja) 2018-10-19 2020-04-15 ソニー株式会社 センサ装置、信号処理方法
CN109344801A (zh) * 2018-10-26 2019-02-15 京东方科技集团股份有限公司 一种物体检测方法及装置
JP7279533B2 (ja) * 2019-06-14 2023-05-23 ソニーグループ株式会社 センサ装置、信号処理方法
US12526547B2 (en) 2019-09-05 2026-01-13 Waymo Llc Smart sensor with region of interest capabilities
WO2021159215A1 (en) * 2020-02-12 2021-08-19 Marine Canada Acquisition Inc. Marine driver assist system and method
TWI786409B (zh) * 2020-06-01 2022-12-11 聚晶半導體股份有限公司 影像偵測裝置以及影像偵測方法
WO2022019049A1 (ja) * 2020-07-20 2022-01-27 ソニーグループ株式会社 情報処理装置、情報処理システム、情報処理方法、及び情報処理プログラム
US12241740B2 (en) * 2020-11-02 2025-03-04 Artilux, Inc. Optical sensing apparatus with deactivated photodetector regions and method thereof
US12080033B1 (en) * 2020-11-20 2024-09-03 Apple Inc. Hybrid compression for sparse binary images
US11756283B2 (en) 2020-12-16 2023-09-12 Waymo Llc Smart sensor implementations of region of interest operating modes
WO2022145293A1 (ja) * 2020-12-28 2022-07-07 富士フイルム株式会社 撮像支援装置、撮像装置、撮像支援方法、及びプログラム
JP7764866B2 (ja) * 2021-02-01 2025-11-06 ソニーグループ株式会社 データ処理装置および方法、並びに、データ処理システム
DE112021007480T5 (de) * 2021-04-09 2024-02-01 Mitsubishi Electric Corporation Informationssammelvorrichtung, Server und Informationssammelverfahren
KR102343047B1 (ko) * 2021-06-17 2021-12-24 주식회사 인피닉 2d 이미지 전처리 방법
WO2023047775A1 (ja) * 2021-09-27 2023-03-30 富士フイルム株式会社 画像生成方法、プロセッサ、及びプログラム
TWI813072B (zh) * 2021-11-17 2023-08-21 瑞昱半導體股份有限公司 用於物件追蹤的電子裝置及方法
KR102592088B1 (ko) * 2021-11-19 2023-10-20 주식회사 핀텔 스트리밍모듈을 이용한 고해상도 영상분석방법, 장치 및 이에 대한 컴퓨터 프로그램
CN116152851A (zh) * 2021-11-23 2023-05-23 瑞昱半导体股份有限公司 用于对象追踪的电子装置及方法
JP2023167444A (ja) * 2022-05-12 2023-11-24 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、情報処理方法及び情報生成方法
US20250304292A1 (en) * 2022-05-13 2025-10-02 Sony Group Corporation Mobile body control device, mobile body control method, and program
US12288371B2 (en) * 2022-08-10 2025-04-29 Avid Technology, Inc. Finding the semantic region of interest in images
WO2024047748A1 (ja) * 2022-08-30 2024-03-07 日本電気株式会社 映像処理システム、映像処理方法、及び映像処理装置
WO2024047747A1 (ja) * 2022-08-30 2024-03-07 日本電気株式会社 映像処理システム、映像処理方法、及び映像処理装置
CN115783925A (zh) * 2022-12-16 2023-03-14 日立楼宇技术(广州)有限公司 一种传感器帧率调节方法、装置、控制设备和存储介质

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793033A (en) * 1996-03-29 1998-08-11 Metanetics Corporation Portable data collection device with viewing assembly
JP2000105835A (ja) 1998-07-28 2000-04-11 Hitachi Denshi Ltd 物体認識方法及び物体追跡監視装置
WO2000049812A1 (fr) * 1999-02-19 2000-08-24 Sony Corporation Dispositif de traitement d'images, procede de traitement d'images, dispositif d'apprentissage, procede d'apprentissage et support enregistre
JP4581199B2 (ja) * 2000-08-22 2010-11-17 ソニー株式会社 画像信号処理装置、画像信号処理方法、学習装置、学習方法及び記録媒体
JP4146751B2 (ja) 2003-04-01 2008-09-10 本田技研工業株式会社 顔識別装置、顔識別方法及び顔識別プログラム
US7595819B2 (en) * 2003-07-31 2009-09-29 Sony Corporation Signal processing device and signal processing method, program, and recording medium
US7720580B2 (en) * 2004-12-23 2010-05-18 Donnelly Corporation Object detection system for vehicle
US7526102B2 (en) * 2005-09-13 2009-04-28 Verificon Corporation System and method for object tracking and activity analysis
JP4626493B2 (ja) * 2005-11-14 2011-02-09 ソニー株式会社 画像処理装置、画像処理方法、画像処理方法のプログラム及び画像処理方法のプログラムを記録した記録媒体
JP4876836B2 (ja) * 2006-10-12 2012-02-15 日本電気株式会社 撮像装置及び方法並びにプログラム
US20080129541A1 (en) * 2006-12-01 2008-06-05 Magna Electronics Black ice detection and warning system
JP2008228232A (ja) * 2007-03-15 2008-09-25 Canon Inc 撮像装置、撮像方法、プログラム、及び記憶媒体
JP2009010472A (ja) * 2007-06-26 2009-01-15 Casio Comput Co Ltd 撮像装置及びそのプログラム
JP2009077143A (ja) * 2007-09-20 2009-04-09 Fujifilm Corp 自動撮影装置
JP2009206920A (ja) * 2008-02-28 2009-09-10 Nikon Corp カメラ
JP5166102B2 (ja) * 2008-04-22 2013-03-21 株式会社東芝 画像処理装置及びその方法
JP2010062943A (ja) * 2008-09-04 2010-03-18 Nikon Corp 電子カメラ
JP2010087599A (ja) 2008-09-29 2010-04-15 Fujifilm Corp 撮像装置、方法およびプログラム
EP2246806B1 (en) * 2009-04-29 2014-04-02 Autoliv Development AB Vision method and system for automatically detecting objects in front of a motor vehicle
JP5527592B2 (ja) 2009-09-03 2014-06-18 ソニー株式会社 画像処理装置および方法、並びにプログラム
JP4860739B2 (ja) * 2009-09-03 2012-01-25 パナソニック株式会社 画像処理装置及び画像処理方法
JP5675229B2 (ja) * 2010-09-02 2015-02-25 キヤノン株式会社 画像処理装置及び画像処理方法
JP2013012930A (ja) * 2011-06-29 2013-01-17 Canon Inc 全方位撮像装置、及びその制御方法
BR112014027066A2 (pt) * 2012-05-02 2017-06-27 Nikon Corp dispositivo de formação de imagem
US20140313381A1 (en) 2013-04-19 2014-10-23 Canon Kabushiki Kaisha Image pickup apparatus
JP6075393B2 (ja) * 2013-05-31 2017-02-08 株式会社ニコン 電子機器及び制御プログラム
JP2015032966A (ja) 2013-08-01 2015-02-16 キヤノン株式会社 画像処理装置、撮像装置、制御方法、及びプログラム
US9349076B1 (en) * 2013-12-20 2016-05-24 Amazon Technologies, Inc. Template-based target object detection in an image
AU2014240213B2 (en) 2014-09-30 2016-12-08 Canon Kabushiki Kaisha System and Method for object re-identification
JP6410923B2 (ja) 2015-03-26 2018-10-24 富士フイルム株式会社 追尾制御装置、追尾制御方法、追尾制御プログラム、及び、自動追尾撮影システム
WO2017042710A1 (en) * 2015-09-09 2017-03-16 Lightmetrics Technologies Pvt. Ltd. System and method for detecting objects in an automotive environment
US10514526B2 (en) * 2015-09-16 2019-12-24 Canon Kabushiki Kaisha Image sensor and image capturing apparatus
US10235585B2 (en) * 2016-04-11 2019-03-19 The Nielsen Company (US) Methods and apparatus to determine the dimensions of a region of interest of a target object from an image using target object landmarks
US20170323149A1 (en) * 2016-05-05 2017-11-09 International Business Machines Corporation Rotation invariant object detection
US9760806B1 (en) * 2016-05-11 2017-09-12 TCL Research America Inc. Method and system for vision-centric deep-learning-based road situation analysis
KR20180105294A (ko) * 2017-03-14 2018-09-28 한국전자통신연구원 이미지 압축 장치
US10540554B2 (en) * 2018-03-29 2020-01-21 Toyota Jidosha Kabushiki Kaisha Real-time detection of traffic situation
JP6683280B1 (ja) * 2018-10-19 2020-04-15 ソニー株式会社 センサ装置、信号処理方法

Also Published As

Publication number Publication date
TWI821417B (zh) 2023-11-11
CN113039777A (zh) 2021-06-25
TW202021333A (zh) 2020-06-01
JP7424140B2 (ja) 2024-01-30
US20210256286A1 (en) 2021-08-19
CN113039777B (zh) 2023-07-14
EP3869784A1 (en) 2021-08-25
JP2020068521A (ja) 2020-04-30
KR102790248B1 (ko) 2025-04-01
US20230124921A1 (en) 2023-04-20
US11495008B2 (en) 2022-11-08
EP3869784A4 (en) 2021-12-22
JP6683280B1 (ja) 2020-04-15
EP3869784B1 (en) 2025-04-16
WO2020080140A1 (ja) 2020-04-23
US11785183B2 (en) 2023-10-10
JP2020108172A (ja) 2020-07-09
KR20210075988A (ko) 2021-06-23

Similar Documents

Publication Publication Date Title
TWI821417B (zh) 感測器裝置及信號處理方法
KR102790254B1 (ko) 센서 장치 및 파라미터 설정 방법
TWI845547B (zh) 感測器裝置、信號處理方法
JP7279533B2 (ja) センサ装置、信号処理方法
EP3869782A1 (en) Sensor device and parameter setting method
EP3869783B1 (en) Sensor device and signal processing method