CN113039777B - 传感器装置和信号处理方法 - Google Patents

传感器装置和信号处理方法 Download PDF

Info

Publication number
CN113039777B
CN113039777B CN201980067306.XA CN201980067306A CN113039777B CN 113039777 B CN113039777 B CN 113039777B CN 201980067306 A CN201980067306 A CN 201980067306A CN 113039777 B CN113039777 B CN 113039777B
Authority
CN
China
Prior art keywords
detection
unit
area
information
array sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980067306.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN113039777A (zh
Inventor
高塚进
矢岛史
铁川弘树
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of CN113039777A publication Critical patent/CN113039777A/zh
Application granted granted Critical
Publication of CN113039777B publication Critical patent/CN113039777B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/40Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
    • H04N25/44Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
    • H04N25/443Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading pixels from selected two-dimensional [2D] regions of the array, e.g. for windowing or digital zooming
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/147Details of sensors, e.g. sensor lenses
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/771Feature selection, e.g. selecting representative features from a multi-dimensional feature space
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/19Recognition using electronic means
    • G06V30/191Design or setup of recognition systems or techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
    • G06V30/19113Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/61Control of cameras or camera modules based on recognised objects
    • H04N23/611Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/617Upgrading or updating of programs or applications for camera control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/65Control of camera operation in relation to power supply
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/665Control of cameras or camera modules involving internal camera communication with the image sensor, e.g. synchronising or multiplexing SSIS control signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/745Circuitry for generating timing or clock signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Vascular Medicine (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Geophysics And Detection Of Objects (AREA)
  • Measurement Of Length, Angles, Or The Like Using Electric Or Magnetic Means (AREA)
  • Image Input (AREA)
  • Radar Systems Or Details Thereof (AREA)
  • Measurement Of Velocity Or Position Using Acoustic Or Ultrasonic Waves (AREA)
CN201980067306.XA 2018-10-19 2019-10-04 传感器装置和信号处理方法 Active CN113039777B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2018-197496 2018-10-19
JP2018197496 2018-10-19
JP2019111092A JP6683280B1 (ja) 2018-10-19 2019-06-14 センサ装置、信号処理方法
JP2019-111092 2019-06-14
PCT/JP2019/039284 WO2020080140A1 (ja) 2018-10-19 2019-10-04 センサ装置、信号処理方法

Publications (2)

Publication Number Publication Date
CN113039777A CN113039777A (zh) 2021-06-25
CN113039777B true CN113039777B (zh) 2023-07-14

Family

ID=70166569

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980067306.XA Active CN113039777B (zh) 2018-10-19 2019-10-04 传感器装置和信号处理方法

Country Status (7)

Country Link
US (2) US11495008B2 (https=)
EP (1) EP3869784B1 (https=)
JP (2) JP6683280B1 (https=)
KR (1) KR102790248B1 (https=)
CN (1) CN113039777B (https=)
TW (2) TW202428036A (https=)
WO (1) WO2020080140A1 (https=)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6683280B1 (ja) 2018-10-19 2020-04-15 ソニー株式会社 センサ装置、信号処理方法
CN109344801A (zh) * 2018-10-26 2019-02-15 京东方科技集团股份有限公司 一种物体检测方法及装置
JP7279533B2 (ja) * 2019-06-14 2023-05-23 ソニーグループ株式会社 センサ装置、信号処理方法
US12526547B2 (en) 2019-09-05 2026-01-13 Waymo Llc Smart sensor with region of interest capabilities
WO2021159215A1 (en) * 2020-02-12 2021-08-19 Marine Canada Acquisition Inc. Marine driver assist system and method
TWI786409B (zh) * 2020-06-01 2022-12-11 聚晶半導體股份有限公司 影像偵測裝置以及影像偵測方法
WO2022019049A1 (ja) * 2020-07-20 2022-01-27 ソニーグループ株式会社 情報処理装置、情報処理システム、情報処理方法、及び情報処理プログラム
US12241740B2 (en) * 2020-11-02 2025-03-04 Artilux, Inc. Optical sensing apparatus with deactivated photodetector regions and method thereof
US12080033B1 (en) * 2020-11-20 2024-09-03 Apple Inc. Hybrid compression for sparse binary images
US11756283B2 (en) 2020-12-16 2023-09-12 Waymo Llc Smart sensor implementations of region of interest operating modes
WO2022145293A1 (ja) * 2020-12-28 2022-07-07 富士フイルム株式会社 撮像支援装置、撮像装置、撮像支援方法、及びプログラム
JP7764866B2 (ja) * 2021-02-01 2025-11-06 ソニーグループ株式会社 データ処理装置および方法、並びに、データ処理システム
DE112021007480T5 (de) * 2021-04-09 2024-02-01 Mitsubishi Electric Corporation Informationssammelvorrichtung, Server und Informationssammelverfahren
KR102343047B1 (ko) * 2021-06-17 2021-12-24 주식회사 인피닉 2d 이미지 전처리 방법
WO2023047775A1 (ja) * 2021-09-27 2023-03-30 富士フイルム株式会社 画像生成方法、プロセッサ、及びプログラム
TWI813072B (zh) * 2021-11-17 2023-08-21 瑞昱半導體股份有限公司 用於物件追蹤的電子裝置及方法
KR102592088B1 (ko) * 2021-11-19 2023-10-20 주식회사 핀텔 스트리밍모듈을 이용한 고해상도 영상분석방법, 장치 및 이에 대한 컴퓨터 프로그램
CN116152851A (zh) * 2021-11-23 2023-05-23 瑞昱半导体股份有限公司 用于对象追踪的电子装置及方法
JP2023167444A (ja) * 2022-05-12 2023-11-24 ソニーセミコンダクタソリューションズ株式会社 情報処理装置、情報処理方法及び情報生成方法
US20250304292A1 (en) * 2022-05-13 2025-10-02 Sony Group Corporation Mobile body control device, mobile body control method, and program
US12288371B2 (en) * 2022-08-10 2025-04-29 Avid Technology, Inc. Finding the semantic region of interest in images
WO2024047748A1 (ja) * 2022-08-30 2024-03-07 日本電気株式会社 映像処理システム、映像処理方法、及び映像処理装置
WO2024047747A1 (ja) * 2022-08-30 2024-03-07 日本電気株式会社 映像処理システム、映像処理方法、及び映像処理装置
CN115783925A (zh) * 2022-12-16 2023-03-14 日立楼宇技术(广州)有限公司 一种传感器帧率调节方法、装置、控制设备和存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009206920A (ja) * 2008-02-28 2009-09-10 Nikon Corp カメラ
EP3007434A1 (en) * 2013-05-31 2016-04-13 Nikon Corporation Electronic device and control program
CN108028898A (zh) * 2015-09-16 2018-05-11 佳能株式会社 图像传感器和摄像设备

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793033A (en) * 1996-03-29 1998-08-11 Metanetics Corporation Portable data collection device with viewing assembly
JP2000105835A (ja) 1998-07-28 2000-04-11 Hitachi Denshi Ltd 物体認識方法及び物体追跡監視装置
WO2000049812A1 (fr) * 1999-02-19 2000-08-24 Sony Corporation Dispositif de traitement d'images, procede de traitement d'images, dispositif d'apprentissage, procede d'apprentissage et support enregistre
JP4581199B2 (ja) * 2000-08-22 2010-11-17 ソニー株式会社 画像信号処理装置、画像信号処理方法、学習装置、学習方法及び記録媒体
JP4146751B2 (ja) 2003-04-01 2008-09-10 本田技研工業株式会社 顔識別装置、顔識別方法及び顔識別プログラム
US7595819B2 (en) * 2003-07-31 2009-09-29 Sony Corporation Signal processing device and signal processing method, program, and recording medium
US7720580B2 (en) * 2004-12-23 2010-05-18 Donnelly Corporation Object detection system for vehicle
US7526102B2 (en) * 2005-09-13 2009-04-28 Verificon Corporation System and method for object tracking and activity analysis
JP4626493B2 (ja) * 2005-11-14 2011-02-09 ソニー株式会社 画像処理装置、画像処理方法、画像処理方法のプログラム及び画像処理方法のプログラムを記録した記録媒体
JP4876836B2 (ja) * 2006-10-12 2012-02-15 日本電気株式会社 撮像装置及び方法並びにプログラム
US20080129541A1 (en) * 2006-12-01 2008-06-05 Magna Electronics Black ice detection and warning system
JP2008228232A (ja) * 2007-03-15 2008-09-25 Canon Inc 撮像装置、撮像方法、プログラム、及び記憶媒体
JP2009010472A (ja) * 2007-06-26 2009-01-15 Casio Comput Co Ltd 撮像装置及びそのプログラム
JP2009077143A (ja) * 2007-09-20 2009-04-09 Fujifilm Corp 自動撮影装置
JP5166102B2 (ja) * 2008-04-22 2013-03-21 株式会社東芝 画像処理装置及びその方法
JP2010062943A (ja) * 2008-09-04 2010-03-18 Nikon Corp 電子カメラ
JP2010087599A (ja) 2008-09-29 2010-04-15 Fujifilm Corp 撮像装置、方法およびプログラム
EP2246806B1 (en) * 2009-04-29 2014-04-02 Autoliv Development AB Vision method and system for automatically detecting objects in front of a motor vehicle
JP5527592B2 (ja) 2009-09-03 2014-06-18 ソニー株式会社 画像処理装置および方法、並びにプログラム
JP4860739B2 (ja) * 2009-09-03 2012-01-25 パナソニック株式会社 画像処理装置及び画像処理方法
JP5675229B2 (ja) * 2010-09-02 2015-02-25 キヤノン株式会社 画像処理装置及び画像処理方法
JP2013012930A (ja) * 2011-06-29 2013-01-17 Canon Inc 全方位撮像装置、及びその制御方法
BR112014027066A2 (pt) * 2012-05-02 2017-06-27 Nikon Corp dispositivo de formação de imagem
US20140313381A1 (en) 2013-04-19 2014-10-23 Canon Kabushiki Kaisha Image pickup apparatus
JP2015032966A (ja) 2013-08-01 2015-02-16 キヤノン株式会社 画像処理装置、撮像装置、制御方法、及びプログラム
US9349076B1 (en) * 2013-12-20 2016-05-24 Amazon Technologies, Inc. Template-based target object detection in an image
AU2014240213B2 (en) 2014-09-30 2016-12-08 Canon Kabushiki Kaisha System and Method for object re-identification
JP6410923B2 (ja) 2015-03-26 2018-10-24 富士フイルム株式会社 追尾制御装置、追尾制御方法、追尾制御プログラム、及び、自動追尾撮影システム
WO2017042710A1 (en) * 2015-09-09 2017-03-16 Lightmetrics Technologies Pvt. Ltd. System and method for detecting objects in an automotive environment
US10235585B2 (en) * 2016-04-11 2019-03-19 The Nielsen Company (US) Methods and apparatus to determine the dimensions of a region of interest of a target object from an image using target object landmarks
US20170323149A1 (en) * 2016-05-05 2017-11-09 International Business Machines Corporation Rotation invariant object detection
US9760806B1 (en) * 2016-05-11 2017-09-12 TCL Research America Inc. Method and system for vision-centric deep-learning-based road situation analysis
KR20180105294A (ko) * 2017-03-14 2018-09-28 한국전자통신연구원 이미지 압축 장치
US10540554B2 (en) * 2018-03-29 2020-01-21 Toyota Jidosha Kabushiki Kaisha Real-time detection of traffic situation
JP6683280B1 (ja) * 2018-10-19 2020-04-15 ソニー株式会社 センサ装置、信号処理方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009206920A (ja) * 2008-02-28 2009-09-10 Nikon Corp カメラ
EP3007434A1 (en) * 2013-05-31 2016-04-13 Nikon Corporation Electronic device and control program
CN108028898A (zh) * 2015-09-16 2018-05-11 佳能株式会社 图像传感器和摄像设备

Also Published As

Publication number Publication date
TWI821417B (zh) 2023-11-11
CN113039777A (zh) 2021-06-25
TW202021333A (zh) 2020-06-01
JP7424140B2 (ja) 2024-01-30
US20210256286A1 (en) 2021-08-19
EP3869784A1 (en) 2021-08-25
JP2020068521A (ja) 2020-04-30
KR102790248B1 (ko) 2025-04-01
TW202428036A (zh) 2024-07-01
US20230124921A1 (en) 2023-04-20
US11495008B2 (en) 2022-11-08
EP3869784A4 (en) 2021-12-22
JP6683280B1 (ja) 2020-04-15
EP3869784B1 (en) 2025-04-16
WO2020080140A1 (ja) 2020-04-23
US11785183B2 (en) 2023-10-10
JP2020108172A (ja) 2020-07-09
KR20210075988A (ko) 2021-06-23

Similar Documents

Publication Publication Date Title
CN113039777B (zh) 传感器装置和信号处理方法
CN112970243B (zh) 传感器装置和参数设置方法
CN112823506B (zh) 传感器装置和信号处理方法
JP7279533B2 (ja) センサ装置、信号処理方法
EP3869782A1 (en) Sensor device and parameter setting method
EP3869783B1 (en) Sensor device and signal processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant