CN115039403B - 图像处理方法和传感器装置 - Google Patents

图像处理方法和传感器装置 Download PDF

Info

Publication number
CN115039403B
CN115039403B CN202080095191.8A CN202080095191A CN115039403B CN 115039403 B CN115039403 B CN 115039403B CN 202080095191 A CN202080095191 A CN 202080095191A CN 115039403 B CN115039403 B CN 115039403B
Authority
CN
China
Prior art keywords
color
color information
information acquisition
pixels
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202080095191.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN115039403A (zh
Inventor
高塚进
铁川弘树
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Group Corp
Original Assignee
Sony Group Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Group Corp filed Critical Sony Group Corp
Publication of CN115039403A publication Critical patent/CN115039403A/zh
Application granted granted Critical
Publication of CN115039403B publication Critical patent/CN115039403B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H04N25/136—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Geometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)
CN202080095191.8A 2020-02-19 2020-12-25 图像处理方法和传感器装置 Active CN115039403B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020025952 2020-02-19
JP2020-025952 2020-02-19
PCT/JP2020/048890 WO2021166450A1 (ja) 2020-02-19 2020-12-25 画像処理方法、センサ装置

Publications (2)

Publication Number Publication Date
CN115039403A CN115039403A (zh) 2022-09-09
CN115039403B true CN115039403B (zh) 2024-04-12

Family

ID=77390645

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080095191.8A Active CN115039403B (zh) 2020-02-19 2020-12-25 图像处理方法和传感器装置

Country Status (7)

Country Link
US (1) US12273633B2 (https=)
EP (1) EP4109895A4 (https=)
JP (1) JPWO2021166450A1 (https=)
KR (1) KR102776069B1 (https=)
CN (1) CN115039403B (https=)
TW (1) TWI859405B (https=)
WO (1) WO2021166450A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12464259B2 (en) * 2021-01-21 2025-11-04 Google Llc Sparse color image sensor system
CN116977197A (zh) * 2023-04-11 2023-10-31 北京仁光科技有限公司 用于对rgb数据进行处理的方法、设备和介质
TWI863637B (zh) * 2023-10-19 2024-11-21 國立臺灣師範大學 基於圖像重點色彩之人工智慧色彩建議系統及方法

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5892590A (en) * 1993-05-31 1999-04-06 Matsushita Electric Industrial Co., Ltd. Corrected data generator for image taking device
CN101233763A (zh) * 2005-07-28 2008-07-30 伊斯曼柯达公司 处理彩色和全色像素
CN101783354A (zh) * 2009-01-08 2010-07-21 索尼公司 图像拾取元件和图像拾取设备
CN102870405A (zh) * 2011-03-09 2013-01-09 富士胶片株式会社 彩色成像元件
CN103533262A (zh) * 2012-07-02 2014-01-22 索尼公司 信号处理装置及方法、程序、固体图像传感器和电子设备
CN103650487A (zh) * 2011-07-13 2014-03-19 富士胶片株式会社 图像拾取设备、图像拾取元件，和用于校正灵敏度差异的方法
JP2014161022A (ja) * 2014-03-12 2014-09-04 Sony Corp 固体撮像装置、固体撮像装置の信号処理方法および撮像装置
JP2015050494A (ja) * 2013-08-30 2015-03-16 日立オートモティブシステムズ株式会社 撮像装置
CN204697179U (zh) * 2014-06-30 2015-10-07 半导体元件工业有限责任公司 具有像素阵列的图像传感器
CN106210572A (zh) * 2014-12-01 2016-12-07 爱思开海力士有限公司 滤色器阵列、图像传感器以及红外数据获取方法
CN107895028A (zh) * 2017-11-17 2018-04-10 天津大学 采用深度学习的草图检索方法
CN108695351A (zh) * 2017-04-07 2018-10-23 三星电子株式会社 包括宽带滤色器的图像传感器
CN109819136A (zh) * 2014-12-25 2019-05-28 佳能株式会社 线传感器、图像读取设备和图像形成装置
CN208970511U (zh) * 2017-10-19 2019-06-11 半导体元件工业有限责任公司 像素阵列及用于图像传感器的滤色器层

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6721446B1 (en) * 1999-04-26 2004-04-13 Adobe Systems Incorporated Identifying intrinsic pixel colors in a region of uncertain pixels
US7978240B2 (en) * 2005-10-03 2011-07-12 Konica Minolta Photo Imaging, Inc. Enhancing image quality imaging unit and image sensor
US20070159542A1 (en) * 2006-01-12 2007-07-12 Gang Luo Color filter array with neutral elements and color image formation
JP5033711B2 (ja) 2007-06-13 2012-09-26 富士フイルム株式会社 撮像装置及び撮像装置の駆動方法
KR20090120159A (ko) * 2008-05-19 2009-11-24 삼성전자주식회사 영상합성장치 및 영상합성방법
CN102090067B (zh) * 2008-08-04 2013-03-20 松下电器产业株式会社 摄像装置、图像处理方法、图像处理程序及半导体集成电路
JP2011199798A (ja) 2010-03-24 2011-10-06 Sony Corp 物理情報取得装置、固体撮像装置、物理情報取得方法
DE102010003668B4 (de) 2010-04-07 2020-03-26 Robert Bosch Gmbh Farbmaske für einen Bildsensor einer Fahrzeugkamera
WO2012166840A2 (en) 2011-06-01 2012-12-06 The Board Of Trustees Of The Leland Stanford Junior University Learning of image processing pipeline for digital imaging devices
US9179110B2 (en) * 2012-11-02 2015-11-03 Semiconductor Components Industries, Llc Imaging systems with modified clear image pixels
DE102013223699A1 (de) 2013-11-20 2015-05-21 Takata AG Filteranordnung und Verfahren zum Herstellen einer Filteranordnung
JP2015106791A (ja) 2013-11-29 2015-06-08 株式会社ニコン 撮像装置
CN104468578B (zh) * 2014-12-10 2017-12-26 怀效宁 一种无线通讯的优先通讯系统和通讯方法
JP6628497B2 (ja) * 2015-05-19 2020-01-08 キヤノン株式会社 撮像装置、撮像システム、および画像処理方法
CN108140130B (zh) 2015-11-05 2019-10-18 谷歌有限责任公司 图像处理方法及非暂时性计算机可读介质
US9986213B2 (en) * 2016-06-29 2018-05-29 Omnivision Technologies, Inc. Image sensor with big and small pixels and method of manufacture
US10346710B2 (en) 2016-09-29 2019-07-09 Datacolor Inc. Multi-agent training of a color identification neural network
US20180188427A1 (en) * 2016-12-29 2018-07-05 Uber Technologies, Inc. Color Filter Array for Image Capture Device
KR102507474B1 (ko) 2018-01-09 2023-03-10 삼성전자주식회사 이미지 센서
US11605153B1 (en) * 2022-01-03 2023-03-14 Microsoft Technology Licensing, Llc Generate super-resolution images from sparse color information

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5892590A (en) * 1993-05-31 1999-04-06 Matsushita Electric Industrial Co., Ltd. Corrected data generator for image taking device
CN101233763A (zh) * 2005-07-28 2008-07-30 伊斯曼柯达公司 处理彩色和全色像素
CN101783354A (zh) * 2009-01-08 2010-07-21 索尼公司 图像拾取元件和图像拾取设备
CN102870405A (zh) * 2011-03-09 2013-01-09 富士胶片株式会社 彩色成像元件
CN103650487A (zh) * 2011-07-13 2014-03-19 富士胶片株式会社 图像拾取设备、图像拾取元件，和用于校正灵敏度差异的方法
CN103533262A (zh) * 2012-07-02 2014-01-22 索尼公司 信号处理装置及方法、程序、固体图像传感器和电子设备
JP2015050494A (ja) * 2013-08-30 2015-03-16 日立オートモティブシステムズ株式会社 撮像装置
JP2014161022A (ja) * 2014-03-12 2014-09-04 Sony Corp 固体撮像装置、固体撮像装置の信号処理方法および撮像装置
CN204697179U (zh) * 2014-06-30 2015-10-07 半导体元件工业有限责任公司 具有像素阵列的图像传感器
CN106210572A (zh) * 2014-12-01 2016-12-07 爱思开海力士有限公司 滤色器阵列、图像传感器以及红外数据获取方法
CN109819136A (zh) * 2014-12-25 2019-05-28 佳能株式会社 线传感器、图像读取设备和图像形成装置
CN108695351A (zh) * 2017-04-07 2018-10-23 三星电子株式会社 包括宽带滤色器的图像传感器
CN208970511U (zh) * 2017-10-19 2019-06-11 半导体元件工业有限责任公司 像素阵列及用于图像传感器的滤色器层
CN107895028A (zh) * 2017-11-17 2018-04-10 天津大学 采用深度学习的草图检索方法

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
A novel color filter array with 75% transparent elements;Gang Luo;《Proc. SPIE 6502, Digital Photography III》;1-9 *
Deep color reconstruction for a sparse color Sensor;S. M. A. SHARIF等;《Optics Express》;1-21 *
Rethinking Color Cameras;Ayan Chakrabarti等;《2014 IEEE INTERNATIONAL CONFERENCE ON COMPUTIONAL PHOTOGRAPHY(ICCP)》;1-8 *
基于图像纹理特征LBP的计算机生成图像与真实图像的取证技术研究;李艳红;《中国优秀硕士学位论文全文数据库（电子期刊）信息科技辑》;全文 *

Also Published As

Publication number Publication date
WO2021166450A1 (ja) 2021-08-26
TW202135522A (zh) 2021-09-16
EP4109895A1 (en) 2022-12-28
JPWO2021166450A1 (https=) 2021-08-26
KR102776069B1 (ko) 2025-03-07
US20230037953A1 (en) 2023-02-09
KR20220143013A (ko) 2022-10-24
CN115039403A (zh) 2022-09-09
US12273633B2 (en) 2025-04-08
EP4109895A4 (en) 2023-07-26
TWI859405B (zh) 2024-10-21

Similar Documents

Publication Publication Date Title
CN115039403B (zh) 图像处理方法和传感器装置
US10182216B2 (en) Extended color processing on pelican array cameras
US9025871B2 (en) Image processing apparatus and method of providing high sensitive color images
EP1209903B1 (en) Method and system of noise removal for a sparsely sampled extended dynamic range image
KR102286136B1 (ko) 컬러 필터 어레이, 이를 포함하는 이미지 센서 및 이를 이용한 적외선 정보 획득 방법
US8237121B2 (en) Alternating row infrared filter for an image sensor
US20180013962A1 (en) Image sensor method and apparatus equipped with multiple contiguous infrared filter elements
CN110880163B (zh) 一种基于深度学习的弱光彩色成像方法
KR20180094029A (ko) 단일 매트릭스 센서에 의해 가시 및 근적외 이미지들을 획득하는 시스템 및 방법
JP6953297B2 (ja) 撮像装置及び撮像システム
CN116309116B (zh) 一种基于raw图像的低弱光图像增强方法与装置
US20230112586A1 (en) Dynamic pixel-wise multi-gain readout for high dynamic range imaging
US10091481B2 (en) Sensor module, method for ascertaining a brightness and/or the color of an electromagnetic radiation and method for manufacturing a sensor module
US20130128083A1 (en) High dynamic range image sensing device and image sensing method and manufacturing method thereof
EP4436164B1 (en) Image acquisition apparatus and method of operating the same
US20220408033A1 (en) Computationally Enhanced Low-Performance Infrared Focal Plane Arrays
EP2517179A1 (en) Determining color information using a binary sensor
US20250267375A1 (en) Imaging device and operating method thereof
CN110235441A (zh) 用于低照度的多摄像头系统
CN118263268A (zh) 图像传感器及其形成方法、图像处理方法
Singh et al. Double Binnable RGB, RGBW and LMS Color Filter Arrays
CN117746316A (zh) 一种日夜状态检测方法及系统
CN121262485A (zh) 图像传感器以及图像处理方法和装置
JP2020022085A (ja) 画像信号処理装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant