KR102735046B1 - 플렌옵틱 포비티드 카메라 - Google Patents

플렌옵틱 포비티드 카메라 Download PDF

Info

Publication number
KR102735046B1
KR102735046B1 KR1020160080105A KR20160080105A KR102735046B1 KR 102735046 B1 KR102735046 B1 KR 102735046B1 KR 1020160080105 A KR1020160080105 A KR 1020160080105A KR 20160080105 A KR20160080105 A KR 20160080105A KR 102735046 B1 KR102735046 B1 KR 102735046B1
Authority
KR
South Korea
Prior art keywords
microimage
sensor
color
filter array
color filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020160080105A
Other languages
English (en)
Korean (ko)
Other versions
KR20170003423A (ko
Inventor
브누와 방담므
띠에리 보렐
루이 슈발리에
Original Assignee
인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 filed Critical 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Publication of KR20170003423A publication Critical patent/KR20170003423A/ko
Application granted granted Critical
Publication of KR102735046B1 publication Critical patent/KR102735046B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
    • G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
    • G02B7/10—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
    • G02B7/102—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G02B3/0037—Arrays characterized by the distribution or form of lenses
    • G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/22—Absorbing filters
    • G02B5/223—Absorbing filters containing organic substances, e.g. dyes, inks or pigments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611—Correction of chromatic aberration
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
KR1020160080105A 2015-06-30 2016-06-27 플렌옵틱 포비티드 카메라 Active KR102735046B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP15306053.8A EP3113478A1 (en) 2015-06-30 2015-06-30 Plenoptic foveated camera
EP15306053.8 2015-06-30

Publications (2)

Publication Number Publication Date
KR20170003423A KR20170003423A (ko) 2017-01-09
KR102735046B1 true KR102735046B1 (ko) 2024-11-28

Family

ID=53724155

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160080105A Active KR102735046B1 (ko) 2015-06-30 2016-06-27 플렌옵틱 포비티드 카메라

Country Status (6)

Country Link
US (1) US9900582B2 (enExample)
EP (2) EP3113478A1 (enExample)
JP (1) JP6887223B2 (enExample)
KR (1) KR102735046B1 (enExample)
CN (1) CN106331445B (enExample)
TW (1) TWI699117B (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102502452B1 (ko) * 2016-02-15 2023-02-22 삼성전자주식회사 이미지 센서 및 복원 이미지 생성 방법
US20170332000A1 (en) * 2016-05-10 2017-11-16 Lytro, Inc. High dynamic range light-field imaging
WO2019005260A1 (en) 2017-06-29 2019-01-03 Apple Inc. FLIGHT TIME DEPTH MAPPING WITH PARALLAX COMPENSATION
EP3486866A1 (en) 2017-11-15 2019-05-22 Thomson Licensing A method for processing a light field video based on the use of a super-rays representation
CN111670576B (zh) * 2017-12-05 2022-10-25 艾瑞3D有限公司 用于深度获取的光场图像处理方法
CN111465870B (zh) 2017-12-18 2023-08-29 苹果公司 使用可寻址发射器阵列的飞行时间感测
EP3540499A1 (en) 2018-03-13 2019-09-18 Thomson Licensing Image sensor comprising a color splitter with two different refractive indexes
EP3540479A1 (en) 2018-03-13 2019-09-18 Thomson Licensing Diffraction grating comprising double-materials structures
EP3588150A1 (en) 2018-06-29 2020-01-01 Thomson Licensing An optical device comprising multi-layer waveguides
EP3591700A1 (en) 2018-07-02 2020-01-08 Thomson Licensing Image sensor comprising a color splitter with two different refractive indexes, and different height
EP3671310A1 (en) 2018-12-18 2020-06-24 Thomson Licensing Optical manipulation apparatus for trapping or moving micro or nanoparticles
EP3671322A1 (en) 2018-12-18 2020-06-24 Thomson Licensing Device for forming an outgoing electromagnetic wave from an incident electromagnetic wave
EP3671293A1 (en) 2018-12-21 2020-06-24 Thomson Licensing An optical device comprising at least one diffraction grating having a grating pitch above the wavelength
CN113330328B (zh) 2019-02-11 2024-06-14 苹果公司 深度感测方法及装置
US12306307B2 (en) 2019-06-10 2025-05-20 Apple Inc. Selection of pulse repetition intervals for sensing time of flight
US11500094B2 (en) 2019-06-10 2022-11-15 Apple Inc. Selection of pulse repetition intervals for sensing time of flight
US11555900B1 (en) 2019-07-17 2023-01-17 Apple Inc. LiDAR system with enhanced area coverage
CN110595365B (zh) * 2019-09-19 2021-06-25 上海兰宝传感科技股份有限公司 一种减少激光三角位移传感器检测色差的自适应算法
US11733359B2 (en) 2019-12-03 2023-08-22 Apple Inc. Configurable array of single-photon detectors
US12442926B2 (en) 2021-02-04 2025-10-14 Apple Inc. Time-of-flight depth sensing with improved linearity
US12196860B2 (en) 2021-03-02 2025-01-14 Apple Inc. Depth sensor calibration using internal reflections
US11681028B2 (en) 2021-07-18 2023-06-20 Apple Inc. Close-range measurement of time of flight using parallax shift

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130222652A1 (en) 2012-02-28 2013-08-29 Lytro, Inc. Compensating for sensor saturation and microlens modulation during light-field image processing
JP2013192182A (ja) * 2012-03-15 2013-09-26 Toshiba Corp 固体撮像装置および携帯情報端末
WO2013169671A1 (en) 2012-05-09 2013-11-14 Lytro, Inc. Optimization of optical systems for improved light field capture and manipulation

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5506619A (en) 1995-03-17 1996-04-09 Eastman Kodak Company Adaptive color plan interpolation in single sensor color electronic camera
US6882364B1 (en) 1997-12-02 2005-04-19 Fuji Photo Film Co., Ltd Solid-state imaging apparatus and signal processing method for transforming image signals output from a honeycomb arrangement to high quality video signals
US7012643B2 (en) * 2002-05-08 2006-03-14 Ball Aerospace & Technologies Corp. One chip, low light level color camera
SE0402576D0 (sv) * 2004-10-25 2004-10-25 Forskarpatent I Uppsala Ab Multispectral and hyperspectral imaging
US7978240B2 (en) * 2005-10-03 2011-07-12 Konica Minolta Photo Imaging, Inc. Enhancing image quality imaging unit and image sensor
JP2007311447A (ja) * 2006-05-17 2007-11-29 Sanyo Electric Co Ltd 光電変換装置
KR100871564B1 (ko) * 2006-06-19 2008-12-02 삼성전기주식회사 카메라 모듈
US20100265385A1 (en) * 2009-04-18 2010-10-21 Knight Timothy J Light Field Camera Image, File and Configuration Data, and Methods of Using, Storing and Communicating Same
JP5239417B2 (ja) 2008-03-14 2013-07-17 凸版印刷株式会社 マイクロレンズアレイの製造方法及び濃度分布マスク及びその設計方法
US8358365B2 (en) * 2009-05-01 2013-01-22 Samsung Electronics Co., Ltd. Photo detecting device and image pickup device and method thereon
US8179457B2 (en) * 2009-06-23 2012-05-15 Nokia Corporation Gradient color filters for sub-diffraction limit sensors
US8228417B1 (en) 2009-07-15 2012-07-24 Adobe Systems Incorporated Focused plenoptic camera employing different apertures or filtering at different microlenses
US8284293B2 (en) * 2010-07-07 2012-10-09 Aptina Imaging Corporation Image sensors with graded refractive index microlenses
JP5713816B2 (ja) * 2011-03-16 2015-05-07 株式会社東芝 固体撮像装置及びカメラモジュール
US20130076966A1 (en) * 2011-09-22 2013-03-28 John Norvold Border Digital imaging system with refocusable imaging mode
US8831377B2 (en) * 2012-02-28 2014-09-09 Lytro, Inc. Compensating for variation in microlens position during light-field image processing
JP5537618B2 (ja) 2012-08-01 2014-07-02 キヤノン株式会社 撮像装置
JP2015060067A (ja) * 2013-09-18 2015-03-30 株式会社東芝 撮像レンズ及び固体撮像装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130222652A1 (en) 2012-02-28 2013-08-29 Lytro, Inc. Compensating for sensor saturation and microlens modulation during light-field image processing
JP2013192182A (ja) * 2012-03-15 2013-09-26 Toshiba Corp 固体撮像装置および携帯情報端末
WO2013169671A1 (en) 2012-05-09 2013-11-14 Lytro, Inc. Optimization of optical systems for improved light field capture and manipulation

Also Published As

Publication number Publication date
JP2017017690A (ja) 2017-01-19
EP3113479A1 (en) 2017-01-04
KR20170003423A (ko) 2017-01-09
US9900582B2 (en) 2018-02-20
CN106331445A (zh) 2017-01-11
EP3113479B1 (en) 2020-10-21
TW201713108A (zh) 2017-04-01
EP3113478A1 (en) 2017-01-04
CN106331445B (zh) 2021-01-12
US20170006278A1 (en) 2017-01-05
JP6887223B2 (ja) 2021-06-16
TWI699117B (zh) 2020-07-11

Similar Documents

Publication Publication Date Title
KR102735046B1 (ko) 플렌옵틱 포비티드 카메라
EP3396942B1 (en) Image sensor, imaging method and electronic device
CN107194965B (zh) 用于处理光场数据的方法和设备
US10334229B2 (en) Method for obtaining a refocused image from a 4D raw light field data using a shift correction parameter
CN108141571B (zh) 无掩模相位检测自动聚焦
US10708486B2 (en) Generation of a depth-artificial image by determining an interpolated supplementary depth through interpolation based on the original depths and a detected edge
EP3098779B1 (en) Method for obtaining a refocused image from 4d raw light field data
US20190110028A1 (en) Method for correcting aberration affecting light-field data
US10567636B2 (en) Resolution enhancement using sensor with plural photodiodes per microlens
US10366478B2 (en) Method and device for obtaining a HDR image by graph signal processing
US9807368B2 (en) Plenoptic camera comprising a shuffled color filter array
CN107710741A (zh) 一种获取深度信息的方法及摄像装置
EP3200151A1 (en) Method and device for obtaining a depth map
EP3099054A1 (en) Method and apparatus for determining a focal stack of images from light field data associated with a scene, and corresponding computer program product
CN116506745A (zh) 成像装置和方法
JP2019191681A (ja) 画像処理装置、その制御方法およびプログラム
JP2015148905A (ja) 被写体検出装置、撮像装置及びプログラム

Legal Events

Date Code Title Description
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

PA0109 Patent application

St.27 status event code: A-0-1-A10-A12-nap-PA0109

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

R17-X000 Change to representative recorded

St.27 status event code: A-3-3-R10-R17-oth-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

G170 Re-publication after modification of scope of protection [patent]
PG1701 Publication of correction

St.27 status event code: A-3-3-P10-P19-oth-PG1701

Patent document republication publication date: 20200729

Republication note text: Request for Correction Notice (Document Request)

Gazette number: 1020170003423

Gazette reference publication date: 20170109

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

D13-X000 Search requested

St.27 status event code: A-1-2-D10-D13-srh-X000

D14-X000 Search report completed

St.27 status event code: A-1-2-D10-D14-srh-X000

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U11-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601