JP6887223B2 - プレンオプティック・フォービエイテッド・カメラ - Google Patents

プレンオプティック・フォービエイテッド・カメラ Download PDF

Info

Publication number
JP6887223B2
JP6887223B2 JP2016125154A JP2016125154A JP6887223B2 JP 6887223 B2 JP6887223 B2 JP 6887223B2 JP 2016125154 A JP2016125154 A JP 2016125154A JP 2016125154 A JP2016125154 A JP 2016125154A JP 6887223 B2 JP6887223 B2 JP 6887223B2
Authority
JP
Japan
Prior art keywords
color
microimage
area
filter array
color filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016125154A
Other languages
English (en)
Japanese (ja)
Other versions
JP2017017690A (ja
JP2017017690A5 (enExample
Inventor
ヴァンダム，ブノワ
ボレル，ティエリ
シェヴァリエ，ルイス
Original Assignee
インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ filed Critical インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Publication of JP2017017690A publication Critical patent/JP2017017690A/ja
Publication of JP2017017690A5 publication Critical patent/JP2017017690A5/ja
Application granted granted Critical
Publication of JP6887223B2 publication Critical patent/JP6887223B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/10—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
    • G02B7/102—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G02B3/0037—Arrays characterized by the distribution or form of lenses
    • G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/22—Absorbing filters
    • G02B5/223—Absorbing filters containing organic substances, e.g. dyes, inks or pigments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611—Correction of chromatic aberration
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
JP2016125154A 2015-06-30 2016-06-24 プレンオプティック・フォービエイテッド・カメラ Active JP6887223B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15306053.8A EP3113478A1 (en) 2015-06-30 2015-06-30 Plenoptic foveated camera
EP15306053.8 2015-06-30

Publications (3)

Publication Number Publication Date
JP2017017690A JP2017017690A (ja) 2017-01-19
JP2017017690A5 JP2017017690A5 (enExample) 2019-07-25
JP6887223B2 true JP6887223B2 (ja) 2021-06-16

Family

ID=53724155

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016125154A Active JP6887223B2 (ja) 2015-06-30 2016-06-24 プレンオプティック・フォービエイテッド・カメラ

Country Status (6)

Country Link
US (1) US9900582B2 (enExample)
EP (2) EP3113478A1 (enExample)
JP (1) JP6887223B2 (enExample)
KR (1) KR102735046B1 (enExample)
CN (1) CN106331445B (enExample)
TW (1) TWI699117B (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102502452B1 (ko) * 2016-02-15 2023-02-22 삼성전자주식회사 이미지 센서 및 복원 이미지 생성 방법
US20170332000A1 (en) * 2016-05-10 2017-11-16 Lytro, Inc. High dynamic range light-field imaging
WO2019005260A1 (en) 2017-06-29 2019-01-03 Apple Inc. FLIGHT TIME DEPTH MAPPING WITH PARALLAX COMPENSATION
EP3486866A1 (en) 2017-11-15 2019-05-22 Thomson Licensing A method for processing a light field video based on the use of a super-rays representation
CN111670576B (zh) * 2017-12-05 2022-10-25 艾瑞3D有限公司 用于深度获取的光场图像处理方法
CN111465870B (zh) 2017-12-18 2023-08-29 苹果公司 使用可寻址发射器阵列的飞行时间感测
EP3540499A1 (en) 2018-03-13 2019-09-18 Thomson Licensing Image sensor comprising a color splitter with two different refractive indexes
EP3540479A1 (en) 2018-03-13 2019-09-18 Thomson Licensing Diffraction grating comprising double-materials structures
EP3588150A1 (en) 2018-06-29 2020-01-01 Thomson Licensing An optical device comprising multi-layer waveguides
EP3591700A1 (en) 2018-07-02 2020-01-08 Thomson Licensing Image sensor comprising a color splitter with two different refractive indexes, and different height
EP3671310A1 (en) 2018-12-18 2020-06-24 Thomson Licensing Optical manipulation apparatus for trapping or moving micro or nanoparticles
EP3671322A1 (en) 2018-12-18 2020-06-24 Thomson Licensing Device for forming an outgoing electromagnetic wave from an incident electromagnetic wave
EP3671293A1 (en) 2018-12-21 2020-06-24 Thomson Licensing An optical device comprising at least one diffraction grating having a grating pitch above the wavelength
CN113330328B (zh) 2019-02-11 2024-06-14 苹果公司 深度感测方法及装置
US12306307B2 (en) 2019-06-10 2025-05-20 Apple Inc. Selection of pulse repetition intervals for sensing time of flight
US11500094B2 (en) 2019-06-10 2022-11-15 Apple Inc. Selection of pulse repetition intervals for sensing time of flight
US11555900B1 (en) 2019-07-17 2023-01-17 Apple Inc. LiDAR system with enhanced area coverage
CN110595365B (zh) * 2019-09-19 2021-06-25 上海兰宝传感科技股份有限公司 一种减少激光三角位移传感器检测色差的自适应算法
US11733359B2 (en) 2019-12-03 2023-08-22 Apple Inc. Configurable array of single-photon detectors
US12442926B2 (en) 2021-02-04 2025-10-14 Apple Inc. Time-of-flight depth sensing with improved linearity
US12196860B2 (en) 2021-03-02 2025-01-14 Apple Inc. Depth sensor calibration using internal reflections
US11681028B2 (en) 2021-07-18 2023-06-20 Apple Inc. Close-range measurement of time of flight using parallax shift

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5506619A (en) 1995-03-17 1996-04-09 Eastman Kodak Company Adaptive color plan interpolation in single sensor color electronic camera
US6882364B1 (en) 1997-12-02 2005-04-19 Fuji Photo Film Co., Ltd Solid-state imaging apparatus and signal processing method for transforming image signals output from a honeycomb arrangement to high quality video signals
US7012643B2 (en) * 2002-05-08 2006-03-14 Ball Aerospace & Technologies Corp. One chip, low light level color camera
SE0402576D0 (sv) * 2004-10-25 2004-10-25 Forskarpatent I Uppsala Ab Multispectral and hyperspectral imaging
US7978240B2 (en) * 2005-10-03 2011-07-12 Konica Minolta Photo Imaging, Inc. Enhancing image quality imaging unit and image sensor
JP2007311447A (ja) * 2006-05-17 2007-11-29 Sanyo Electric Co Ltd 光電変換装置
KR100871564B1 (ko) * 2006-06-19 2008-12-02 삼성전기주식회사 카메라 모듈
US20100265385A1 (en) * 2009-04-18 2010-10-21 Knight Timothy J Light Field Camera Image, File and Configuration Data, and Methods of Using, Storing and Communicating Same
JP5239417B2 (ja) 2008-03-14 2013-07-17 凸版印刷株式会社 マイクロレンズアレイの製造方法及び濃度分布マスク及びその設計方法
US8358365B2 (en) * 2009-05-01 2013-01-22 Samsung Electronics Co., Ltd. Photo detecting device and image pickup device and method thereon
US8179457B2 (en) * 2009-06-23 2012-05-15 Nokia Corporation Gradient color filters for sub-diffraction limit sensors
US8228417B1 (en) 2009-07-15 2012-07-24 Adobe Systems Incorporated Focused plenoptic camera employing different apertures or filtering at different microlenses
US8284293B2 (en) * 2010-07-07 2012-10-09 Aptina Imaging Corporation Image sensors with graded refractive index microlenses
JP5713816B2 (ja) * 2011-03-16 2015-05-07 株式会社東芝 固体撮像装置及びカメラモジュール
US20130076966A1 (en) * 2011-09-22 2013-03-28 John Norvold Border Digital imaging system with refocusable imaging mode
US8948545B2 (en) * 2012-02-28 2015-02-03 Lytro, Inc. Compensating for sensor saturation and microlens modulation during light-field image processing
US8831377B2 (en) * 2012-02-28 2014-09-09 Lytro, Inc. Compensating for variation in microlens position during light-field image processing
JP5591851B2 (ja) * 2012-03-15 2014-09-17 株式会社東芝 固体撮像装置および携帯情報端末
HK1201391A1 (en) * 2012-05-09 2015-08-28 莱特洛公司 Optimization of optical systems for improved light field capture and manipulation
JP5537618B2 (ja) 2012-08-01 2014-07-02 キヤノン株式会社 撮像装置
JP2015060067A (ja) * 2013-09-18 2015-03-30 株式会社東芝 撮像レンズ及び固体撮像装置

Also Published As

Publication number Publication date
KR102735046B1 (ko) 2024-11-28
JP2017017690A (ja) 2017-01-19
EP3113479A1 (en) 2017-01-04
KR20170003423A (ko) 2017-01-09
US9900582B2 (en) 2018-02-20
CN106331445A (zh) 2017-01-11
EP3113479B1 (en) 2020-10-21
TW201713108A (zh) 2017-04-01
EP3113478A1 (en) 2017-01-04
CN106331445B (zh) 2021-01-12
US20170006278A1 (en) 2017-01-05
TWI699117B (zh) 2020-07-11

Similar Documents

Publication Publication Date Title
JP6887223B2 (ja) プレンオプティック・フォービエイテッド・カメラ
US10560684B2 (en) System and methods for calibration of an array camera
US9338380B2 (en) Image processing methods for image sensors with phase detection pixels
CN107194965B (zh) 用于处理光场数据的方法和设备
US10334229B2 (en) Method for obtaining a refocused image from a 4D raw light field data using a shift correction parameter
CN108141571B (zh) 无掩模相位检测自动聚焦
US9432568B2 (en) Pixel arrangements for image sensors with phase detection pixels
US9383548B2 (en) Image sensor for depth estimation
US10708486B2 (en) Generation of a depth-artificial image by determining an interpolated supplementary depth through interpolation based on the original depths and a detected edge
US20190110028A1 (en) Method for correcting aberration affecting light-field data
JP2014011526A (ja) 画像処理装置、撮像装置および画像処理方法
JP6370348B2 (ja) 画像処理装置および画像処理方法、撮像装置、プログラム、記憶媒体
CN107431754A (zh) 图像处理方法、图像处理装置和摄像设备
KR20160140453A (ko) 4d 원시 광 필드 데이터로부터 리포커싱된 이미지를 획득하기 위한 방법
US10366478B2 (en) Method and device for obtaining a HDR image by graph signal processing
US9807368B2 (en) Plenoptic camera comprising a shuffled color filter array
US20250217944A1 (en) Quad-Photodiode (QPD) Image Deblurring Using Convolutional Neural Network
US20240127407A1 (en) Image sensor apparatus for capturing depth information

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20181220

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20181227

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190618

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20190618

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191111

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20191209

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20200117

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20200414

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200708

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20201222

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210319

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210428

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210518

R150 Certificate of patent or registration of utility model

Ref document number: 6887223

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250