CN106161890B - 成像装置、成像系统以及信号处理方法 - Google Patents

成像装置、成像系统以及信号处理方法 Download PDF

Info

Publication number
CN106161890B
CN106161890B CN201610308087.8A CN201610308087A CN106161890B CN 106161890 B CN106161890 B CN 106161890B CN 201610308087 A CN201610308087 A CN 201610308087A CN 106161890 B CN106161890 B CN 106161890B
Authority
CN
China
Prior art keywords
pixel
correlation
pixels
signal
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610308087.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN106161890A (zh
Inventor
大西智也
海部纪之
川野藤雄
高堂寿士
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kato Corp
Original Assignee
Kato Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kato Corp filed Critical Kato Corp
Publication of CN106161890A publication Critical patent/CN106161890A/zh
Application granted granted Critical
Publication of CN106161890B publication Critical patent/CN106161890B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/03—Circuitry for demodulating colour component signals modulated spatially by colour striped filters by frequency separation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/48—Increasing resolution by shifting the sensor relative to the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/78—Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2209/00—Details of colour television systems
    • H04N2209/04—Picture signal generators
    • H04N2209/041—Picture signal generators using solid-state devices
    • H04N2209/042—Picture signal generators using solid-state devices having a single pick-up sensor
    • H04N2209/045—Picture signal generators using solid-state devices having a single pick-up sensor using mosaic colour filter
    • H04N2209/046—Colour interpolation to calculate the missing colour values

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
CN201610308087.8A 2015-05-11 2016-05-11 成像装置、成像系统以及信号处理方法 Active CN106161890B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-096831 2015-05-11
JP2015096831A JP6598507B2 (ja) 2015-05-11 2015-05-11 撮像装置、撮像システム、信号処理方法

Publications (2)

Publication Number Publication Date
CN106161890A CN106161890A (zh) 2016-11-23
CN106161890B true CN106161890B (zh) 2019-11-08

Family

ID=55963191

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610308087.8A Active CN106161890B (zh) 2015-05-11 2016-05-11 成像装置、成像系统以及信号处理方法

Country Status (4)

Country Link
US (2) US9883152B2 (enExample)
EP (1) EP3093819B1 (enExample)
JP (1) JP6598507B2 (enExample)
CN (1) CN106161890B (enExample)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5999750B2 (ja) * 2011-08-25 2016-09-28 ソニー株式会社 撮像素子、撮像装置及び生体撮像装置
JP6584131B2 (ja) * 2015-05-08 2019-10-02 キヤノン株式会社 撮像装置、撮像システム、および信号処理方法
JP6598507B2 (ja) * 2015-05-11 2019-10-30 キヤノン株式会社 撮像装置、撮像システム、信号処理方法
EP3429197B1 (en) * 2016-03-09 2020-05-06 Sony Corporation Image processing apparatus, imaging apparatus, image processing method, and program
JP6980492B2 (ja) * 2017-11-13 2021-12-15 キヤノン株式会社 撮像装置及び撮像システム
JP2020043435A (ja) * 2018-09-07 2020-03-19 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、画像処理方法および画像処理プログラム
JP2020088464A (ja) * 2018-11-19 2020-06-04 キヤノン株式会社 撮像装置、画像処理装置、および画像処理方法
CN113454511B (zh) 2018-12-21 2023-11-14 斯科皮奥实验室有限公司 显微图像的压缩获取
JP2020108061A (ja) * 2018-12-28 2020-07-09 キヤノン株式会社 撮像装置及び撮像システム
CN109905681B (zh) * 2019-02-01 2021-07-16 华为技术有限公司 图像传感器、从其获取图像数据的方法及摄像设备
KR102709671B1 (ko) * 2019-08-08 2024-09-26 에스케이하이닉스 주식회사 이미지 센서, 이미지 신호 프로세서 및 이들을 포함하는 이미지 처리 시스템
EP4036617A4 (en) * 2019-09-26 2022-11-16 Sony Semiconductor Solutions Corporation IMAGING DEVICE
CN111355937B (zh) * 2020-03-11 2021-11-16 北京迈格威科技有限公司 图像处理方法、装置和电子设备
CN113452968B (zh) * 2020-03-25 2022-04-26 杭州海康威视数字技术股份有限公司 图像处理方法
WO2022011506A1 (zh) * 2020-07-13 2022-01-20 深圳市汇顶科技股份有限公司 图像处理的方法和图像处理装置
KR102832603B1 (ko) 2020-10-21 2025-07-14 삼성전자주식회사 왜곡을 발생시키는 렌즈를 갖는 카메라 시스템에서 이미지 해상도를 개선하는 장치 및 그 동작 방법
JP2023010159A (ja) * 2021-07-09 2023-01-20 株式会社ソシオネクスト 画像処理装置および画像処理方法
CN115866423A (zh) * 2021-09-22 2023-03-28 华为技术有限公司 一种图像传感器、摄像头模组、电子设备及图像处理方法
EP4645894A1 (en) * 2023-01-31 2025-11-05 Samsung Electronics Co., Ltd. Image sensor, electronic device comprising image sensor, and operation method thereof
KR20250011360A (ko) * 2023-07-14 2025-01-21 에스케이하이닉스 주식회사 이미지 신호 프로세서

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5382976A (en) * 1993-06-30 1995-01-17 Eastman Kodak Company Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients
CN101006731A (zh) * 2005-06-21 2007-07-25 索尼株式会社 图像处理装置及图像处理方法、摄像装置以及计算机程序
CN101360248A (zh) * 2007-07-30 2009-02-04 卡西欧计算机株式会社 像素插值电路、像素插值方法以及记录介质
CN103238335A (zh) * 2010-03-04 2013-08-07 索尼公司 图像处理装置、图像处理方法和程序
WO2014050249A1 (ja) * 2012-09-28 2014-04-03 株式会社メガチップス 画素補間装置、撮像装置、プログラムおよび集積回路

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8139130B2 (en) * 2005-07-28 2012-03-20 Omnivision Technologies, Inc. Image sensor with improved light sensitivity
US7978240B2 (en) * 2005-10-03 2011-07-12 Konica Minolta Photo Imaging, Inc. Enhancing image quality imaging unit and image sensor
JP2007208885A (ja) * 2006-02-06 2007-08-16 Konica Minolta Photo Imaging Inc 撮像ユニットおよび撮像装置
TWI422020B (zh) * 2008-12-08 2014-01-01 Sony Corp 固態成像裝置
JP4760915B2 (ja) * 2009-01-08 2011-08-31 ソニー株式会社 固体撮像素子
JP5326943B2 (ja) * 2009-08-31 2013-10-30 ソニー株式会社 画像処理装置、および画像処理方法、並びにプログラム
JP5935237B2 (ja) * 2011-03-24 2016-06-15 ソニー株式会社 固体撮像装置および電子機器
JP5702893B2 (ja) * 2012-07-06 2015-04-15 富士フイルム株式会社 カラー撮像素子および撮像装置
JP5702892B2 (ja) * 2012-07-06 2015-04-15 富士フイルム株式会社 カラー撮像素子および撮像装置
DE112013004198T5 (de) * 2012-08-27 2015-05-07 Fujifilm Corporation Bildverarbeitungsvorrichtung, Verfahren, Programm, Aufzeichnungsmedium und Bildaufnahmevorrichtung
JP6308760B2 (ja) * 2012-12-20 2018-04-11 キヤノン株式会社 光電変換装置および光電変換装置を有する撮像装置
CN105264886B (zh) * 2013-05-23 2017-05-03 富士胶片株式会社 像素插值装置及其动作控制方法
JP6239358B2 (ja) * 2013-12-02 2017-11-29 株式会社メガチップス 画素補間装置、撮像装置、プログラムおよび集積回路
JP6276580B2 (ja) * 2013-12-20 2018-02-07 株式会社メガチップス 画素補間処理装置、撮像装置、プログラムおよび集積回路
KR102219199B1 (ko) * 2014-04-29 2021-02-23 삼성전자주식회사 이미지 센서의 픽셀 어레이 및 이미지 센서
JP6598507B2 (ja) * 2015-05-11 2019-10-30 キヤノン株式会社 撮像装置、撮像システム、信号処理方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5382976A (en) * 1993-06-30 1995-01-17 Eastman Kodak Company Apparatus and method for adaptively interpolating a full color image utilizing luminance gradients
CN101006731A (zh) * 2005-06-21 2007-07-25 索尼株式会社 图像处理装置及图像处理方法、摄像装置以及计算机程序
CN101360248A (zh) * 2007-07-30 2009-02-04 卡西欧计算机株式会社 像素插值电路、像素插值方法以及记录介质
CN103238335A (zh) * 2010-03-04 2013-08-07 索尼公司 图像处理装置、图像处理方法和程序
WO2014050249A1 (ja) * 2012-09-28 2014-04-03 株式会社メガチップス 画素補間装置、撮像装置、プログラムおよび集積回路

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Color filter array recovery using a threshold-based variable number of gradients;Edward Chang;《Proc. SPIE 3650, Sensors, Cameras, and Applications for Digital Photography》;19990322;全文 *
New color filter arrays of high light sensitivity and high demosaicking performanc;Wang J;《 IEEE International Conference on Image Processing》;20111231;全文 *
New digital camera sensor architecture for low light imaging;Kumar M;《 IEEE International Conference on Image Processing》;20091231;全文 *

Also Published As

Publication number Publication date
CN106161890A (zh) 2016-11-23
JP2016213715A (ja) 2016-12-15
EP3093819A3 (en) 2016-12-07
US20180109769A1 (en) 2018-04-19
US10021358B2 (en) 2018-07-10
EP3093819A2 (en) 2016-11-16
US20160337623A1 (en) 2016-11-17
EP3093819B1 (en) 2019-05-08
US9883152B2 (en) 2018-01-30
JP6598507B2 (ja) 2019-10-30

Similar Documents

Publication Publication Date Title
CN106161890B (zh) 成像装置、成像系统以及信号处理方法
EP4161061B1 (en) Image acquisition method, camera assembly, and mobile terminal
JP6628497B2 (ja) 撮像装置、撮像システム、および画像処理方法
US10136107B2 (en) Imaging systems with visible light sensitive pixels and infrared light sensitive pixels
JP6584131B2 (ja) 撮像装置、撮像システム、および信号処理方法
US10368041B2 (en) Imaging device, imaging system, and image processing method
CN204633945U (zh) 图像传感器、成像系统和处理器系统
KR101442313B1 (ko) 카메라 센서 교정
CN110177226B (zh) 图像感测装置
US7876363B2 (en) Methods, systems and apparatuses for high-quality green imbalance compensation in images
CN110944126B (zh) 成像系统和对图像传感器进行黑阶校正的方法
US20080068477A1 (en) Solid-state imaging device
US10229475B2 (en) Apparatus, system, and signal processing method for image pickup using resolution data and color data
KR20160065464A (ko) 컬러 필터 어레이, 이를 포함하는 이미지 센서 및 이를 이용한 적외선 정보 획득 방법
US7259788B1 (en) Image sensor and method for implementing optical summing using selectively transmissive filters
US8582006B2 (en) Pixel arrangement for extended dynamic range imaging
JP2016213740A (ja) 撮像装置及び撮像システム
JP5607265B2 (ja) 撮像装置、撮像装置の制御方法、及び制御プログラム
US9628730B2 (en) Dark current gradient estimation using optically black pixels
JP6069857B2 (ja) 撮像装置
US20130038772A1 (en) Image processing apparatus and image processing method
TWI536765B (zh) 具有透明濾波器像素之成像系統
TWI617198B (zh) 具有透明濾波器像素之成像系統
KR20240126516A (ko) 이미지의 노이즈를 감소시키는 방법
TWI601427B (zh) 具有透明濾波器像素之成像系統

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant