KR102776069B1 - 화상 처리 방법, 센서 장치 - Google Patents

화상 처리 방법, 센서 장치 Download PDF

Info

Publication number
KR102776069B1
KR102776069B1 KR1020227026583A KR20227026583A KR102776069B1 KR 102776069 B1 KR102776069 B1 KR 102776069B1 KR 1020227026583 A KR1020227026583 A KR 1020227026583A KR 20227026583 A KR20227026583 A KR 20227026583A KR 102776069 B1 KR102776069 B1 KR 102776069B1
Authority
KR
South Korea
Prior art keywords
color
information acquisition
pixels
color information
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227026583A
Other languages
English (en)
Korean (ko)
Other versions
KR20220143013A (ko
Inventor
스스무 다카츠카
히로키 데츠카와
Original Assignee
소니그룹주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 소니그룹주식회사 filed Critical 소니그룹주식회사
Publication of KR20220143013A publication Critical patent/KR20220143013A/ko
Application granted granted Critical
Publication of KR102776069B1 publication Critical patent/KR102776069B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/43—Conversion of monochrome picture signals to colour picture signals for colour picture display
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/60—Extraction of image or video features relating to illumination properties, e.g. using a reflectance or lighting model
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/133—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing panchromatic light, e.g. filters passing white light
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H04N25/136—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Geometry (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)
KR1020227026583A 2020-02-19 2020-12-25 화상 처리 방법, 센서 장치 Active KR102776069B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020025952 2020-02-19
JPJP-P-2020-025952 2020-02-19
PCT/JP2020/048890 WO2021166450A1 (ja) 2020-02-19 2020-12-25 画像処理方法、センサ装置

Publications (2)

Publication Number Publication Date
KR20220143013A KR20220143013A (ko) 2022-10-24
KR102776069B1 true KR102776069B1 (ko) 2025-03-07

Family

ID=77390645

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020227026583A Active KR102776069B1 (ko) 2020-02-19 2020-12-25 화상 처리 방법, 센서 장치

Country Status (7)

Country Link
US (1) US12273633B2 (https=)
EP (1) EP4109895A4 (https=)
JP (1) JPWO2021166450A1 (https=)
KR (1) KR102776069B1 (https=)
CN (1) CN115039403B (https=)
TW (1) TWI859405B (https=)
WO (1) WO2021166450A1 (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12464259B2 (en) * 2021-01-21 2025-11-04 Google Llc Sparse color image sensor system
CN116977197A (zh) * 2023-04-11 2023-10-31 北京仁光科技有限公司 用于对rgb数据进行处理的方法、设备和介质
TWI863637B (zh) * 2023-10-19 2024-11-21 國立臺灣師範大學 基於圖像重點色彩之人工智慧色彩建議系統及方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015050494A (ja) * 2013-08-30 2015-03-16 日立オートモティブシステムズ株式会社 撮像装置

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06339026A (ja) * 1993-05-31 1994-12-06 Matsushita Electric Ind Co Ltd 補正データ生成装置
US6721446B1 (en) * 1999-04-26 2004-04-13 Adobe Systems Incorporated Identifying intrinsic pixel colors in a region of uncertain pixels
US8274715B2 (en) * 2005-07-28 2012-09-25 Omnivision Technologies, Inc. Processing color and panchromatic pixels
US7978240B2 (en) * 2005-10-03 2011-07-12 Konica Minolta Photo Imaging, Inc. Enhancing image quality imaging unit and image sensor
US20070159542A1 (en) * 2006-01-12 2007-07-12 Gang Luo Color filter array with neutral elements and color image formation
JP5033711B2 (ja) 2007-06-13 2012-09-26 富士フイルム株式会社 撮像装置及び撮像装置の駆動方法
KR20090120159A (ko) * 2008-05-19 2009-11-24 삼성전자주식회사 영상합성장치 및 영상합성방법
CN102090067B (zh) * 2008-08-04 2013-03-20 松下电器产业株式会社 摄像装置、图像处理方法、图像处理程序及半导体集成电路
JP5476716B2 (ja) 2009-01-08 2014-04-23 ソニー株式会社 撮像素子および撮像装置
JP2011199798A (ja) 2010-03-24 2011-10-06 Sony Corp 物理情報取得装置、固体撮像装置、物理情報取得方法
DE102010003668B4 (de) 2010-04-07 2020-03-26 Robert Bosch Gmbh Farbmaske für einen Bildsensor einer Fahrzeugkamera
EP2685711B1 (en) 2011-03-09 2017-08-30 Fujifilm Corporation Color image pickup device
WO2012166840A2 (en) 2011-06-01 2012-12-06 The Board Of Trustees Of The Leland Stanford Junior University Learning of image processing pipeline for digital imaging devices
WO2013008597A1 (ja) 2011-07-13 2013-01-17 富士フイルム株式会社 撮像装置、撮像素子及び感度差補正方法
JP5900194B2 (ja) 2012-07-02 2016-04-06 ソニー株式会社 信号処理装置、信号処理方法、プログラム、固体撮像素子、および電子機器
US9179110B2 (en) * 2012-11-02 2015-11-03 Semiconductor Components Industries, Llc Imaging systems with modified clear image pixels
DE102013223699A1 (de) 2013-11-20 2015-05-21 Takata AG Filteranordnung und Verfahren zum Herstellen einer Filteranordnung
JP2015106791A (ja) 2013-11-29 2015-06-08 株式会社ニコン 撮像装置
JP5884847B2 (ja) 2014-03-12 2016-03-15 ソニー株式会社 固体撮像装置、固体撮像装置の信号処理方法および撮像装置
CN104468578B (zh) * 2014-12-10 2017-12-26 怀效宁 一种无线通讯的优先通讯系统和通讯方法
US9432568B2 (en) 2014-06-30 2016-08-30 Semiconductor Components Industries, Llc Pixel arrangements for image sensors with phase detection pixels
KR102286136B1 (ko) 2014-12-01 2021-08-06 에스케이하이닉스 주식회사 컬러 필터 어레이, 이를 포함하는 이미지 센서 및 이를 이용한 적외선 정보 획득 방법
WO2016103430A1 (ja) 2014-12-25 2016-06-30 キヤノン株式会社 ラインセンサ、画像読取装置、画像形成装置
JP6628497B2 (ja) * 2015-05-19 2020-01-08 キヤノン株式会社 撮像装置、撮像システム、および画像処理方法
CN108140130B (zh) 2015-11-05 2019-10-18 谷歌有限责任公司 图像处理方法及非暂时性计算机可读介质
US9986213B2 (en) * 2016-06-29 2018-05-29 Omnivision Technologies, Inc. Image sensor with big and small pixels and method of manufacture
US10346710B2 (en) 2016-09-29 2019-07-09 Datacolor Inc. Multi-agent training of a color identification neural network
US20180188427A1 (en) * 2016-12-29 2018-07-05 Uber Technologies, Inc. Color Filter Array for Image Capture Device
KR102395992B1 (ko) 2017-04-07 2022-05-10 삼성전자주식회사 광대역 컬러 필터를 포함하는 이미지 센서
US10510787B2 (en) 2017-10-19 2019-12-17 Semiconductor Components Industries, Llc Structures and methods of creating clear pixels
CN107895028B (zh) * 2017-11-17 2019-11-29 天津大学 采用深度学习的草图检索方法
KR102507474B1 (ko) 2018-01-09 2023-03-10 삼성전자주식회사 이미지 센서
US11605153B1 (en) * 2022-01-03 2023-03-14 Microsoft Technology Licensing, Llc Generate super-resolution images from sparse color information

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015050494A (ja) * 2013-08-30 2015-03-16 日立オートモティブシステムズ株式会社 撮像装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
S. M. A. Sharif et al., "Deep color reconstruction for a sparse color sensor", Optics Express Vol. 27, Issue 17, (2019.09.19.)*

Also Published As

Publication number Publication date
CN115039403B (zh) 2024-04-12
WO2021166450A1 (ja) 2021-08-26
TW202135522A (zh) 2021-09-16
EP4109895A1 (en) 2022-12-28
JPWO2021166450A1 (https=) 2021-08-26
US20230037953A1 (en) 2023-02-09
KR20220143013A (ko) 2022-10-24
CN115039403A (zh) 2022-09-09
US12273633B2 (en) 2025-04-08
EP4109895A4 (en) 2023-07-26
TWI859405B (zh) 2024-10-21

Similar Documents

Publication Publication Date Title
KR102776069B1 (ko) 화상 처리 방법, 센서 장치
US9582863B2 (en) Image processing apparatus, image processing method, and program
EP1209903B1 (en) Method and system of noise removal for a sparsely sampled extended dynamic range image
KR102286136B1 (ko) 컬러 필터 어레이, 이를 포함하는 이미지 센서 및 이를 이용한 적외선 정보 획득 방법
US9681059B2 (en) Image-capturing device
US20190222812A1 (en) Image sensing device
CN1894952A (zh) 产生红外图像和正常图像的方法和成像设备
JP2007504770A (ja) 拡大したダイナミックレンジを有する画像センサ
CN110880163B (zh) 一种基于深度学习的弱光彩色成像方法
CN102647565A (zh) 像素阵列的排列方法、图像传感器及图像传感方法
US20140340553A1 (en) High dynamic range image sensor with full resolution recovery
JP6953297B2 (ja) 撮像装置及び撮像システム
US20070159542A1 (en) Color filter array with neutral elements and color image formation
US12225315B2 (en) Dynamic pixel-wise multi-gain readout for high dynamic range imaging
JP2002064754A (ja) 撮像装置の有効ダイナミックレンジを拡張する方法及び装置
CN102959959A (zh) 固态成像装置驱动方法、固态成像装置及成像设备
WO2025092241A1 (zh) 一种基于混合阵列的视觉传感器芯片
JP2017005644A (ja) 画像処理装置、画像処理方法及び撮像装置
US20160219231A1 (en) Dark current gradient estimation using optically black pixels
US12470786B2 (en) Image acquisition apparatus and electronic apparatus including same, and method of controlling image acquisition apparatus
WO2025092240A1 (zh) 一种基于像素融合技术的视觉传感器芯片
CN115393210B (zh) 图像重建方法、装置、模组、设备、介质及程序产品
Rebiere et al. Color pixel reconstruction for a monolithic RGB-Z CMOS imager
KR20200049546A (ko) 영상 처리 장치, 촬상 장치, 영상 처리 방법 및 영상 처리 프로그램
KR20250176082A (ko) 이미지 신호 처리 방법 및 그 방법을 수행하는 이미지 처리 장치

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20220801

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20240930

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20241211

PG1601 Publication of registration