JP4999494B2 - 撮像装置 - Google Patents
撮像装置 Download PDFInfo
- Publication number
- JP4999494B2 JP4999494B2 JP2007050100A JP2007050100A JP4999494B2 JP 4999494 B2 JP4999494 B2 JP 4999494B2 JP 2007050100 A JP2007050100 A JP 2007050100A JP 2007050100 A JP2007050100 A JP 2007050100A JP 4999494 B2 JP4999494 B2 JP 4999494B2
- Authority
- JP
- Japan
- Prior art keywords
- pixel
- signal
- infrared
- saturated
- output signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims description 23
- 229920006395 saturated elastomer Polymers 0.000 claims description 26
- 238000004364 calculation method Methods 0.000 claims description 22
- 238000012545 processing Methods 0.000 claims description 16
- 238000000034 method Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 9
- 238000006243 chemical reaction Methods 0.000 description 7
- 230000014509 gene expression Effects 0.000 description 5
- 230000007704 transition Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 239000000470 constituent Substances 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 238000012935 Averaging Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002238 attenuated effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14643—Photodiode arrays; MOS imagers
- H01L27/14649—Infrared imagers
-
- H—ELECTRICITY
- H01—ELECTRIC ELEMENTS
- H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
- H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
- H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
- H01L27/144—Devices controlled by radiation
- H01L27/146—Imager structures
- H01L27/14601—Structural or functional details thereof
- H01L27/1462—Coatings
- H01L27/14621—Colour filter arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N2209/00—Details of colour television systems
- H04N2209/04—Picture signal generators
- H04N2209/041—Picture signal generators using solid-state devices
- H04N2209/042—Picture signal generators using solid-state devices having a single pick-up sensor
- H04N2209/047—Picture signal generators using solid-state devices having a single pick-up sensor using multispectral pick-up elements
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Power Engineering (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Color Television Image Signal Generators (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Description
図1は、本発明の実施の形態に係る撮像装置100の構成を示した図である。この構成は、ハードウエア的には、任意のコンピュータのCPU、メモリ、その他のLSIで実現でき、ソフトウエア的にはメモリにロードされたプログラムなどによって実現されるが、ここではそれらの連携によって実現される機能ブロックを描いている。したがって、これらの機能ブロックがハードウエアのみ、ソフトウエアのみ、またはそれらの組合せによっていろいろな形で実現できることは、当業者には理解されるところである。
信号推測部15は、下記式1により、緑用画素20、赤用画素22および青用画素24から本来得られたであろうと推測される推測信号を生成する。
(対象画素の推測信号)=(対象画素に対応する赤外線用画素の赤外線信号)×{(比率算出用画素の可視光成分+赤外線成分信号)/(比率算出用画素に対応する赤外線用画素の赤外線信号)}・・・(式1)
図4は、実施の形態に係る撮像装置100内における画像信号の遷移例2を示す。この遷移例は、推測した値と実際の値とのズレを補正する処理が施される例である。
(判定値)=(対象画素と隣接画素との差分)−A×Σ(対象画素の隣接画素とその隣接画素との差分)・・・(式2)
係数Aは、判定の厳しさを決定する係数であり、係数Aを小さく設定すればノイズが大きい画素と判定されやすくなり、係数Aを大きく設定すればノイズが大きい画素と判定されにくくなる。信号推測部15は、上記式2の判定値が正であればノイズが大きいと判定し、負であればノイズが小さいと判定する。これらの処理により、ノイズが大きいと判定された画素に対しては、隣接画素から生成した代替信号を利用することにより、画像全体のノイズを減少させることができる。
Claims (3)
- 可視光と赤外線の両方を受光する複数の第1画素と、
前記複数の第1画素にそれぞれ対応づけられた、赤外線を受光する複数の第2画素と、
前記複数の第1画素のうち、受光によって飽和している第1画素とは別の第1画素の出力信号と、その別の第1画素に対応する第2画素の出力信号との関係を利用して、前記飽和している第1画素に入射した可視光成分を求める処理部と、
を備え、
前記処理部は、
前記別の第1画素の出力信号とその別の第1画素に対応する第2画素の出力信号との比率を算出する比率算出部と、
前記比率算出部により算出された比率を、前記飽和している第1画素に対応する第2画素の出力信号に乗算する信号推測部と、
前記信号推測部により乗算された信号から、前記飽和している第1画素に対応する第2画素の出力信号を減算する減算部と、
前記第1画素の出力信号が飽和しているか否かを判定する飽和判定部と、
を含み、
前記信号推測部は、前記飽和判定部により飽和していると判定された第1画素の出力信号を推測した結果、推測した信号が前記第1画素の飽和値より小さい場合、その飽和値以上の値を有した信号を出力することを特徴とする撮像装置。 - 前記比率算出部は、前記飽和している第1画素と被写体および光源の少なくとも一方が共通すると推測される別の第1画素の出力信号と、その別の第1画素に対応する第2画素の出力信号との比率を算出することを特徴とする請求項1に記載の撮像装置。
- 前記第1画素と前記第2画素は、同一の撮像素子に形成されていることを特徴とする請求項1または2に記載の撮像装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007050100A JP4999494B2 (ja) | 2007-02-28 | 2007-02-28 | 撮像装置 |
US12/071,977 US7705308B2 (en) | 2007-02-28 | 2008-02-28 | Image pickup apparatus including image pickup devices having sensitivity in infrared region |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007050100A JP4999494B2 (ja) | 2007-02-28 | 2007-02-28 | 撮像装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2008219140A JP2008219140A (ja) | 2008-09-18 |
JP4999494B2 true JP4999494B2 (ja) | 2012-08-15 |
Family
ID=39714818
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2007050100A Active JP4999494B2 (ja) | 2007-02-28 | 2007-02-28 | 撮像装置 |
Country Status (2)
Country | Link |
---|---|
US (1) | US7705308B2 (ja) |
JP (1) | JP4999494B2 (ja) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4984634B2 (ja) | 2005-07-21 | 2012-07-25 | ソニー株式会社 | 物理情報取得方法および物理情報取得装置 |
KR101829777B1 (ko) * | 2011-03-09 | 2018-02-20 | 삼성디스플레이 주식회사 | 광 감지 센서 |
US9013620B2 (en) | 2011-04-20 | 2015-04-21 | Trw Automotive U.S. Llc | Multiple band imager and method |
JP6231284B2 (ja) * | 2013-02-21 | 2017-11-15 | クラリオン株式会社 | 撮像装置 |
CN105432076B (zh) * | 2013-07-25 | 2017-10-10 | 日立麦克赛尔株式会社 | 摄像装置 |
US10582175B2 (en) * | 2014-06-24 | 2020-03-03 | Maxell, Ltd. | Imaging sensor and imaging device |
KR20160114474A (ko) * | 2015-03-24 | 2016-10-05 | (주)실리콘화일 | 4-컬러 이미지 센서, 4-컬러 이미지 센서의 제조방법 및 이에 따른 4-컬러 이미지 센서 |
JP6384595B2 (ja) * | 2015-03-31 | 2018-09-05 | 株式会社ニコン | 撮像装置、データ生成装置および画像処理装置 |
US9425227B1 (en) * | 2015-05-20 | 2016-08-23 | Visera Technologies Company Limited | Imaging sensor using infrared-pass filter for green deduction |
FR3058230B1 (fr) * | 2016-10-27 | 2019-03-15 | Detection Technology Sas | Dispositif de spectrometrie |
TWI645720B (zh) | 2017-03-17 | 2018-12-21 | 瑞昱半導體股份有限公司 | 影像處理裝置及方法 |
JP6767331B2 (ja) * | 2017-09-25 | 2020-10-14 | 株式会社 日立産業制御ソリューションズ | 撮像装置 |
JP7169863B2 (ja) * | 2018-12-03 | 2022-11-11 | キヤノン株式会社 | 撮像装置及びその制御方法、及び演算方法 |
JP7379024B2 (ja) * | 2019-09-02 | 2023-11-14 | キヤノン株式会社 | 撮像装置及び信号処理装置 |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7164117B2 (en) * | 1992-05-05 | 2007-01-16 | Automotive Technologies International, Inc. | Vehicular restraint system control system and method using multiple optical imagers |
JP2737568B2 (ja) | 1992-09-22 | 1998-04-08 | 松下電器産業株式会社 | カラー撮像装置 |
DE10335190A1 (de) * | 2003-07-30 | 2005-03-03 | Daimlerchrysler Ag | Sensoranordnung mit einer Mehrzahl von Typen optischer Sensoren |
JP4286123B2 (ja) * | 2003-12-22 | 2009-06-24 | 三洋電機株式会社 | カラー撮像素子およびカラー信号処理回路 |
WO2006026354A2 (en) * | 2004-08-25 | 2006-03-09 | Newport Imaging Corporation | Apparatus for multiple camera devices and method of operating same |
JP2006180270A (ja) * | 2004-12-22 | 2006-07-06 | Sony Corp | 画像処理装置、撮像装置、画像処理方法、プログラム、及び記録媒体 |
JP2006237737A (ja) * | 2005-02-22 | 2006-09-07 | Sanyo Electric Co Ltd | カラーフィルタアレイ及び固体撮像素子 |
JP2006237738A (ja) * | 2005-02-22 | 2006-09-07 | Sanyo Electric Co Ltd | 色信号処理方法 |
JP4803178B2 (ja) * | 2005-06-14 | 2011-10-26 | 株式会社ニコン | 画像処理装置、コンピュータプログラム製品および画像処理方法 |
US7326903B2 (en) * | 2006-06-29 | 2008-02-05 | Noble Peak Vision Corp. | Mixed analog and digital pixel for high dynamic range readout |
-
2007
- 2007-02-28 JP JP2007050100A patent/JP4999494B2/ja active Active
-
2008
- 2008-02-28 US US12/071,977 patent/US7705308B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20080203305A1 (en) | 2008-08-28 |
US7705308B2 (en) | 2010-04-27 |
JP2008219140A (ja) | 2008-09-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4999494B2 (ja) | 撮像装置 | |
US7821552B2 (en) | Imaging apparatus provided with imaging device having sensitivity in visible and infrared regions | |
JP4420917B2 (ja) | 撮像装置 | |
JP4346634B2 (ja) | 目標物検出装置 | |
JP5206796B2 (ja) | 画像入力装置 | |
US8411176B2 (en) | Image input device | |
JP2007202107A (ja) | 撮像装置 | |
JP4960309B2 (ja) | 固体撮像装置 | |
US9936172B2 (en) | Signal processing device, signal processing method, and signal processing program for performing color reproduction of an image | |
WO2016098641A1 (ja) | 撮像装置、撮像方法、およびプログラム | |
JP2011239252A (ja) | 撮像装置 | |
JP2007088873A (ja) | 信号処理方法、信号処理回路およびこれを用いたカメラシステム | |
JP4312222B2 (ja) | 撮像装置 | |
JP5228717B2 (ja) | 画像入力装置 | |
JP5098908B2 (ja) | 画像入力装置 | |
CN111770321B (zh) | 图像处理设备、摄像设备、图像处理方法和存储介质 | |
JP5091550B2 (ja) | ホワイトバランス調整装置およびホワイトバランス調整方法 | |
JP5464008B2 (ja) | 画像入力装置 | |
JP4135197B2 (ja) | 画像処理装置および画像処理方法、並びにカメラ | |
JP4993275B2 (ja) | 画像処理装置 | |
JP4833669B2 (ja) | 撮像装置およびその信号処理方法 | |
JP2010252077A (ja) | 撮像装置 | |
JP2010199845A (ja) | 画像撮影装置、画像撮影方法、画像処理装置、および画像処理方法 | |
JP2023013549A (ja) | 撮像装置、撮像方法、及びプログラム | |
JP2007329976A (ja) | 画像処理装置および画像処理方法、並びにカメラ |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20091204 |
|
A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20110615 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20111212 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20120117 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20120410 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20120508 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20120515 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 4999494 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20150525 Year of fee payment: 3 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20150525 Year of fee payment: 3 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20150525 Year of fee payment: 3 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |