TWI699117B - 標定成安裝在全光相機之感測器,被濾色器陣列部份罩覆的微影像區至少一個再聚焦影像色彩組成份之決定方法,光場資料獲取裝置,電腦程式製品,以及非暫態電腦可讀式載波媒體 - Google Patents
標定成安裝在全光相機之感測器,被濾色器陣列部份罩覆的微影像區至少一個再聚焦影像色彩組成份之決定方法,光場資料獲取裝置,電腦程式製品,以及非暫態電腦可讀式載波媒體 Download PDFInfo
- Publication number
- TWI699117B TWI699117B TW105119022A TW105119022A TWI699117B TW I699117 B TWI699117 B TW I699117B TW 105119022 A TW105119022 A TW 105119022A TW 105119022 A TW105119022 A TW 105119022A TW I699117 B TWI699117 B TW I699117B
- Authority
- TW
- Taiwan
- Prior art keywords
- color
- micro
- image area
- sensor
- micro image
- Prior art date
Links
- 230000007423 decrease Effects 0.000 claims abstract description 8
- 238000000034 method Methods 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 4
- 229920006395 saturated elastomer Polymers 0.000 claims 3
- 230000004075 alteration Effects 0.000 description 16
- 238000012545 processing Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 8
- 239000003086 colorant Substances 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 206010034972 Photosensitivity reaction Diseases 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 5
- 230000036211 photosensitivity Effects 0.000 description 5
- 230000035945 sensitivity Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 210000001747 pupil Anatomy 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 241001428800 Cell fusing agent virus Species 0.000 description 2
- 206010034960 Photophobia Diseases 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 208000036971 interstitial lung disease 2 Diseases 0.000 description 2
- 208000013469 light sensitivity Diseases 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 210000003660 reticulum Anatomy 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 125000006850 spacer group Chemical group 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
- G02B7/10—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
- G02B7/102—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
- G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/20—Filters
- G02B5/22—Absorbing filters
- G02B5/223—Absorbing filters containing organic substances, e.g. dyes, inks or pigments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/257—Colour aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N25/611—Correction of chromatic aberration
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
- H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
- H10F39/80—Constructional details of image sensors
- H10F39/805—Coatings
- H10F39/8053—Colour filters
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Engineering & Computer Science (AREA)
- Color Television Image Signal Generators (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP15306053.8A EP3113478A1 (en) | 2015-06-30 | 2015-06-30 | Plenoptic foveated camera |
| EP15306053.8 | 2015-06-30 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201713108A TW201713108A (zh) | 2017-04-01 |
| TWI699117B true TWI699117B (zh) | 2020-07-11 |
Family
ID=53724155
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW105119022A TWI699117B (zh) | 2015-06-30 | 2016-06-17 | 標定成安裝在全光相機之感測器,被濾色器陣列部份罩覆的微影像區至少一個再聚焦影像色彩組成份之決定方法,光場資料獲取裝置,電腦程式製品,以及非暫態電腦可讀式載波媒體 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US9900582B2 (enExample) |
| EP (2) | EP3113478A1 (enExample) |
| JP (1) | JP6887223B2 (enExample) |
| KR (1) | KR102735046B1 (enExample) |
| CN (1) | CN106331445B (enExample) |
| TW (1) | TWI699117B (enExample) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102502452B1 (ko) * | 2016-02-15 | 2023-02-22 | 삼성전자주식회사 | 이미지 센서 및 복원 이미지 생성 방법 |
| US20170332000A1 (en) * | 2016-05-10 | 2017-11-16 | Lytro, Inc. | High dynamic range light-field imaging |
| WO2019005260A1 (en) | 2017-06-29 | 2019-01-03 | Apple Inc. | FLIGHT TIME DEPTH MAPPING WITH PARALLAX COMPENSATION |
| EP3486866A1 (en) | 2017-11-15 | 2019-05-22 | Thomson Licensing | A method for processing a light field video based on the use of a super-rays representation |
| CN111670576B (zh) * | 2017-12-05 | 2022-10-25 | 艾瑞3D有限公司 | 用于深度获取的光场图像处理方法 |
| CN111465870B (zh) | 2017-12-18 | 2023-08-29 | 苹果公司 | 使用可寻址发射器阵列的飞行时间感测 |
| EP3540499A1 (en) | 2018-03-13 | 2019-09-18 | Thomson Licensing | Image sensor comprising a color splitter with two different refractive indexes |
| EP3540479A1 (en) | 2018-03-13 | 2019-09-18 | Thomson Licensing | Diffraction grating comprising double-materials structures |
| EP3588150A1 (en) | 2018-06-29 | 2020-01-01 | Thomson Licensing | An optical device comprising multi-layer waveguides |
| EP3591700A1 (en) | 2018-07-02 | 2020-01-08 | Thomson Licensing | Image sensor comprising a color splitter with two different refractive indexes, and different height |
| EP3671310A1 (en) | 2018-12-18 | 2020-06-24 | Thomson Licensing | Optical manipulation apparatus for trapping or moving micro or nanoparticles |
| EP3671322A1 (en) | 2018-12-18 | 2020-06-24 | Thomson Licensing | Device for forming an outgoing electromagnetic wave from an incident electromagnetic wave |
| EP3671293A1 (en) | 2018-12-21 | 2020-06-24 | Thomson Licensing | An optical device comprising at least one diffraction grating having a grating pitch above the wavelength |
| CN113330328B (zh) | 2019-02-11 | 2024-06-14 | 苹果公司 | 深度感测方法及装置 |
| US12306307B2 (en) | 2019-06-10 | 2025-05-20 | Apple Inc. | Selection of pulse repetition intervals for sensing time of flight |
| US11500094B2 (en) | 2019-06-10 | 2022-11-15 | Apple Inc. | Selection of pulse repetition intervals for sensing time of flight |
| US11555900B1 (en) | 2019-07-17 | 2023-01-17 | Apple Inc. | LiDAR system with enhanced area coverage |
| CN110595365B (zh) * | 2019-09-19 | 2021-06-25 | 上海兰宝传感科技股份有限公司 | 一种减少激光三角位移传感器检测色差的自适应算法 |
| US11733359B2 (en) | 2019-12-03 | 2023-08-22 | Apple Inc. | Configurable array of single-photon detectors |
| US12442926B2 (en) | 2021-02-04 | 2025-10-14 | Apple Inc. | Time-of-flight depth sensing with improved linearity |
| US12196860B2 (en) | 2021-03-02 | 2025-01-14 | Apple Inc. | Depth sensor calibration using internal reflections |
| US11681028B2 (en) | 2021-07-18 | 2023-06-20 | Apple Inc. | Close-range measurement of time of flight using parallax shift |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130222652A1 (en) * | 2012-02-28 | 2013-08-29 | Lytro, Inc. | Compensating for sensor saturation and microlens modulation during light-field image processing |
| CN104303493A (zh) * | 2012-05-09 | 2015-01-21 | 莱特洛公司 | 用于改进的光场捕获和操作的光学系统的优化 |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5506619A (en) | 1995-03-17 | 1996-04-09 | Eastman Kodak Company | Adaptive color plan interpolation in single sensor color electronic camera |
| US6882364B1 (en) | 1997-12-02 | 2005-04-19 | Fuji Photo Film Co., Ltd | Solid-state imaging apparatus and signal processing method for transforming image signals output from a honeycomb arrangement to high quality video signals |
| US7012643B2 (en) * | 2002-05-08 | 2006-03-14 | Ball Aerospace & Technologies Corp. | One chip, low light level color camera |
| SE0402576D0 (sv) * | 2004-10-25 | 2004-10-25 | Forskarpatent I Uppsala Ab | Multispectral and hyperspectral imaging |
| US7978240B2 (en) * | 2005-10-03 | 2011-07-12 | Konica Minolta Photo Imaging, Inc. | Enhancing image quality imaging unit and image sensor |
| JP2007311447A (ja) * | 2006-05-17 | 2007-11-29 | Sanyo Electric Co Ltd | 光電変換装置 |
| KR100871564B1 (ko) * | 2006-06-19 | 2008-12-02 | 삼성전기주식회사 | 카메라 모듈 |
| US20100265385A1 (en) * | 2009-04-18 | 2010-10-21 | Knight Timothy J | Light Field Camera Image, File and Configuration Data, and Methods of Using, Storing and Communicating Same |
| JP5239417B2 (ja) | 2008-03-14 | 2013-07-17 | 凸版印刷株式会社 | マイクロレンズアレイの製造方法及び濃度分布マスク及びその設計方法 |
| US8358365B2 (en) * | 2009-05-01 | 2013-01-22 | Samsung Electronics Co., Ltd. | Photo detecting device and image pickup device and method thereon |
| US8179457B2 (en) * | 2009-06-23 | 2012-05-15 | Nokia Corporation | Gradient color filters for sub-diffraction limit sensors |
| US8228417B1 (en) | 2009-07-15 | 2012-07-24 | Adobe Systems Incorporated | Focused plenoptic camera employing different apertures or filtering at different microlenses |
| US8284293B2 (en) * | 2010-07-07 | 2012-10-09 | Aptina Imaging Corporation | Image sensors with graded refractive index microlenses |
| JP5713816B2 (ja) * | 2011-03-16 | 2015-05-07 | 株式会社東芝 | 固体撮像装置及びカメラモジュール |
| US20130076966A1 (en) * | 2011-09-22 | 2013-03-28 | John Norvold Border | Digital imaging system with refocusable imaging mode |
| US8831377B2 (en) * | 2012-02-28 | 2014-09-09 | Lytro, Inc. | Compensating for variation in microlens position during light-field image processing |
| JP5591851B2 (ja) * | 2012-03-15 | 2014-09-17 | 株式会社東芝 | 固体撮像装置および携帯情報端末 |
| JP5537618B2 (ja) | 2012-08-01 | 2014-07-02 | キヤノン株式会社 | 撮像装置 |
| JP2015060067A (ja) * | 2013-09-18 | 2015-03-30 | 株式会社東芝 | 撮像レンズ及び固体撮像装置 |
-
2015
- 2015-06-30 EP EP15306053.8A patent/EP3113478A1/en not_active Withdrawn
-
2016
- 2016-06-17 TW TW105119022A patent/TWI699117B/zh active
- 2016-06-24 JP JP2016125154A patent/JP6887223B2/ja active Active
- 2016-06-27 EP EP16176397.4A patent/EP3113479B1/en active Active
- 2016-06-27 KR KR1020160080105A patent/KR102735046B1/ko active Active
- 2016-06-29 CN CN201610498800.XA patent/CN106331445B/zh active Active
- 2016-06-30 US US15/198,643 patent/US9900582B2/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130222652A1 (en) * | 2012-02-28 | 2013-08-29 | Lytro, Inc. | Compensating for sensor saturation and microlens modulation during light-field image processing |
| CN104303493A (zh) * | 2012-05-09 | 2015-01-21 | 莱特洛公司 | 用于改进的光场捕获和操作的光学系统的优化 |
Also Published As
| Publication number | Publication date |
|---|---|
| KR102735046B1 (ko) | 2024-11-28 |
| JP2017017690A (ja) | 2017-01-19 |
| EP3113479A1 (en) | 2017-01-04 |
| KR20170003423A (ko) | 2017-01-09 |
| US9900582B2 (en) | 2018-02-20 |
| CN106331445A (zh) | 2017-01-11 |
| EP3113479B1 (en) | 2020-10-21 |
| TW201713108A (zh) | 2017-04-01 |
| EP3113478A1 (en) | 2017-01-04 |
| CN106331445B (zh) | 2021-01-12 |
| US20170006278A1 (en) | 2017-01-05 |
| JP6887223B2 (ja) | 2021-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI699117B (zh) | 標定成安裝在全光相機之感測器,被濾色器陣列部份罩覆的微影像區至少一個再聚焦影像色彩組成份之決定方法,光場資料獲取裝置,電腦程式製品,以及非暫態電腦可讀式載波媒體 | |
| TWI504276B (zh) | 用於捕捉彩色影像之影像感測器 | |
| US10334229B2 (en) | Method for obtaining a refocused image from a 4D raw light field data using a shift correction parameter | |
| KR101340688B1 (ko) | 루미넌스 및 크로미넌스 센서들을 이용한 이미지 캡처 | |
| JP6509914B2 (ja) | 深度推定のための画像センサ | |
| US8363093B2 (en) | Stereoscopic imaging using split complementary color filters | |
| CN108141571A (zh) | 无掩模相位检测自动聚焦 | |
| KR20170106931A (ko) | 광 필드 데이터 처리 방법 및 디바이스 | |
| JP5406151B2 (ja) | 3次元撮像装置 | |
| JP2014011526A (ja) | 画像処理装置、撮像装置および画像処理方法 | |
| US20190110028A1 (en) | Method for correcting aberration affecting light-field data | |
| KR20160140453A (ko) | 4d 원시 광 필드 데이터로부터 리포커싱된 이미지를 획득하기 위한 방법 | |
| CN113395497A (zh) | 图像处理方法、图像处理装置以及摄像装置 | |
| JP2017108377A (ja) | 画像処理装置および画像処理方法、撮像装置、プログラム、記憶媒体 | |
| US10366478B2 (en) | Method and device for obtaining a HDR image by graph signal processing | |
| US9807368B2 (en) | Plenoptic camera comprising a shuffled color filter array | |
| US20110018993A1 (en) | Ranging apparatus using split complementary color filters | |
| JP2016134661A (ja) | 画像処理方法、画像処理装置、撮像装置、プログラム、および、記憶媒体 | |
| JP2021089708A (ja) | 情報処理方法、情報処理システム、及び、情報処理装置 | |
| Wu et al. | Real-time division-of-focal-plane polarization imaging system with progressive networks | |
| CN119583967A (zh) | 一种基于多曝光和多焦距融合的图像生成方法及系统 | |
| CN116506745A (zh) | 成像装置和方法 | |
| HK1238834A1 (en) | Image sensor, image processing method, imaging device and mobile terminal |