EP3871020A4 - Color and multi-spectral image sensor based on 3d engineered material - Google Patents

Color and multi-spectral image sensor based on 3d engineered material Download PDF

Info

Publication number
EP3871020A4
EP3871020A4 EP19909195.0A EP19909195A EP3871020A4 EP 3871020 A4 EP3871020 A4 EP 3871020A4 EP 19909195 A EP19909195 A EP 19909195A EP 3871020 A4 EP3871020 A4 EP 3871020A4
Authority
EP
European Patent Office
Prior art keywords
color
image sensor
sensor based
spectral image
engineered material
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19909195.0A
Other languages
German (de)
French (fr)
Other versions
EP3871020A2 (en
Inventor
Philip Camayd-Munoz
Conner Ballew
Gregory Roberts
Andrei Faraon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
California Institute of Technology CalTech
Original Assignee
California Institute of Technology CalTech
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by California Institute of Technology CalTech filed Critical California Institute of Technology CalTech
Publication of EP3871020A2 publication Critical patent/EP3871020A2/en
Publication of EP3871020A4 publication Critical patent/EP3871020A4/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01Q—ANTENNAS, i.e. RADIO AERIALS
    • H01Q15/00—Devices for reflection, refraction, diffraction or polarisation of waves radiated from an antenna, e.g. quasi-optical devices
    • H01Q15/02—Refracting or diffracting devices, e.g. lens, prism
    • H01Q15/10—Refracting or diffracting devices, e.g. lens, prism comprising three-dimensional array of impedance discontinuities, e.g. holes in conductive surfaces or conductive discs forming artificial dielectric
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/10—Beam splitting or combining systems
    • G02B27/1006—Beam splitting or combining systems for splitting or combining different wavelengths
    • G02B27/1013—Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/02—Diffusing elements; Afocal elements
    • G02B5/0205—Diffusing elements; Afocal elements characterised by the diffusing properties
    • G02B5/021—Diffusing elements; Afocal elements characterised by the diffusing properties the diffusion taking place at the element's surface, e.g. by means of surface roughening or microprismatic structures
    • G02B5/0226—Diffusing elements; Afocal elements characterised by the diffusing properties the diffusion taking place at the element's surface, e.g. by means of surface roughening or microprismatic structures having particles on the surface
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002—Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/02—Diffusing elements; Afocal elements
    • G02B5/0205—Diffusing elements; Afocal elements characterised by the diffusing properties
    • G02B5/0236—Diffusing elements; Afocal elements characterised by the diffusing properties the diffusion taking place within the volume of the element
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/02—Diffusing elements; Afocal elements
    • G02B5/0268—Diffusing elements; Afocal elements characterized by the fabrication or manufacturing method
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/02—Diffusing elements; Afocal elements
    • G02B5/0273—Diffusing elements; Afocal elements characterized by the use
    • G02B5/0278—Diffusing elements; Afocal elements characterized by the use used in transmission
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144—Devices controlled by radiation
    • H01L27/146—Imager structures
    • H01L27/14601—Structural or functional details thereof
    • H01L27/14625—Optical elements or arrangements associated with the device
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144—Devices controlled by radiation
    • H01L27/146—Imager structures
    • H01L27/14643—Photodiode arrays; MOS imagers
    • H01L27/14645—Colour imagers
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01L—SEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14—Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144—Devices controlled by radiation
    • H01L27/146—Imager structures
    • H01L27/14683—Processes or apparatus peculiar to the manufacture or treatment of these devices or parts thereof
    • H01L27/14685—Process for coatings or optical elements
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01P—WAVEGUIDES; RESONATORS, LINES, OR OTHER DEVICES OF THE WAVEGUIDE TYPE
    • H01P1/00—Auxiliary devices
    • H01P1/20—Frequency-selective devices, e.g. filters
    • H01P1/207—Hollow waveguide filters
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01Q—ANTENNAS, i.e. RADIO AERIALS
    • H01Q15/00—Devices for reflection, refraction, diffraction or polarisation of waves radiated from an antenna, e.g. quasi-optical devices
    • H01Q15/0006—Devices acting selectively as reflecting surface, as diffracting or as refracting device, e.g. frequency filtering or angular spatial filtering devices
    • H01Q15/0086—Devices acting selectively as reflecting surface, as diffracting or as refracting device, e.g. frequency filtering or angular spatial filtering devices said selective devices having materials with a synthesized negative refractive index, e.g. metamaterials or left-handed materials
EP19909195.0A 2018-10-22 2019-10-17 Color and multi-spectral image sensor based on 3d engineered material Pending EP3871020A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862748677P 2018-10-22 2018-10-22
US201862776685P 2018-12-07 2018-12-07
PCT/US2019/056809 WO2020146029A2 (en) 2018-10-22 2019-10-17 Color and multi-spectral image sensor based on 3d engineered material

Publications (2)

Publication Number Publication Date
EP3871020A2 EP3871020A2 (en) 2021-09-01
EP3871020A4 true EP3871020A4 (en) 2022-06-29

Family

ID=70280500

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19909195.0A Pending EP3871020A4 (en) 2018-10-22 2019-10-17 Color and multi-spectral image sensor based on 3d engineered material

Country Status (6)

Country Link
US (2) US11397331B2 (en)
EP (1) EP3871020A4 (en)
JP (1) JP2022503657A (en)
KR (1) KR20210064240A (en)
CN (1) CN113167938A (en)
WO (1) WO2020146029A2 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020146029A2 (en) 2018-10-22 2020-07-16 California Institute Of Technology Color and multi-spectral image sensor based on 3d engineered material
US11239276B2 (en) 2019-10-18 2022-02-01 California Institute Of Technology CMOS color image sensors with metamaterial color splitting
JP2023509034A (en) * 2019-12-31 2023-03-06 華為技術有限公司 Image sensor, spectral splitting and filtering device, and image sensor manufacturing method
WO2022039971A1 (en) * 2020-08-20 2022-02-24 Applied Materials, Inc. Oled light field architectures
EP4238187A1 (en) * 2020-11-02 2023-09-06 The Board Of Trustees Of The Leland Stanford Junior University Color-routers for image sensing
US20220417474A1 (en) * 2021-06-28 2022-12-29 Qualcomm Incorporated Macroscopic refracting lens image sensor
WO2024019876A1 (en) * 2022-07-22 2024-01-25 California Institute Of Technology Orbital angular momentum splitting with volumetric meta-optics

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130099343A1 (en) * 2010-07-02 2013-04-25 Panasonic Corporation Solid-state imaging device
US20160054172A1 (en) * 2014-08-22 2016-02-25 Samsung Electronics Co., Ltd. Image sensor for producing vivid colors and method of manufacturing the same
US20180045953A1 (en) * 2016-04-29 2018-02-15 The Board Of Trustees Of The Leland Stanford Junior University Device components formed of geometric structures

Family Cites Families (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3971065A (en) 1975-03-05 1976-07-20 Eastman Kodak Company Color imaging array
US5438414A (en) 1993-01-22 1995-08-01 The Johns Hopkins University Integrated dual imaging detector
US6763261B2 (en) * 1995-09-20 2004-07-13 Board Of Regents, The University Of Texas System Method and apparatus for detecting vulnerable atherosclerotic plaque
US6859275B2 (en) * 1999-04-09 2005-02-22 Plain Sight Systems, Inc. System and method for encoded spatio-spectral information processing
US7575939B2 (en) 2000-10-30 2009-08-18 Sru Biosystems, Inc. Optical detection of label-free biomolecular interactions using microreplicated plastic sensor elements
US6870624B2 (en) 2000-10-30 2005-03-22 Coho Holdings Llc Optical wavelength resonant device for chemical sensing
US9295391B1 (en) * 2000-11-10 2016-03-29 The General Hospital Corporation Spectrally encoded miniature endoscopic imaging probe
EP1377853B1 (en) 2001-04-10 2008-09-17 President And Fellows of Harvard College Microlens for projection lithography and method of preparation thereof
US20030103995A1 (en) * 2001-06-04 2003-06-05 Hamblin Michael R. Detection and therapy of vulnerable plaque with photodynamic compounds
JP4040484B2 (en) 2003-01-31 2008-01-30 キヤノン株式会社 Polarization separation optical system, projection display optical system, projection image display apparatus, and image display system
US20050234220A1 (en) * 2003-09-02 2005-10-20 Tadanori Koga Low density, low dielectric, metalizable polymer films
KR100684872B1 (en) 2004-08-03 2007-02-20 삼성전자주식회사 Optical System For Spatially Controlling Light Polarization And Method Of Making The Same
DE102004040535A1 (en) 2004-08-20 2006-02-23 Carl Zeiss Ag Polarization selective blazed diffractive optical element
US7170050B2 (en) 2004-09-17 2007-01-30 Pacific Biosciences Of California, Inc. Apparatus and methods for optical analysis of molecules
JP3928055B2 (en) 2005-03-02 2007-06-13 国立大学法人山口大学 Negative permeability or negative permittivity metamaterial and surface wave waveguide
EP2275026A1 (en) * 2005-09-29 2011-01-19 The General Hospital Corporation Arrangements and methods for providing multimodality microscopic imaging of one or more biological structures
JP2007265581A (en) 2006-03-30 2007-10-11 Fujinon Sano Kk Diffraction element
US7911386B1 (en) 2006-05-23 2011-03-22 The Regents Of The University Of California Multi-band radiating elements with composite right/left-handed meta-material transmission line
US20090250110A1 (en) 2006-07-14 2009-10-08 The Regents Of The University Of California Forward scattering nanoparticle enhancement method and photo detector device
JP4949876B2 (en) 2007-01-30 2012-06-13 株式会社リコー Polarization control element
CN101641301A (en) * 2007-02-12 2010-02-03 Beneq有限公司 The adulterating method of glass
DE102007021774B4 (en) 2007-04-30 2013-01-17 Seereal Technologies S.A. Light modulator for representing complex-valued information
US7978403B2 (en) * 2007-05-10 2011-07-12 Stc.Unm Imaging interferometric microscopy
US8421000B2 (en) 2007-11-23 2013-04-16 Koninklijke Philips Electronics N.V. Beam shaping without introducing divergence within a light beam
JP2009223074A (en) 2008-03-18 2009-10-01 Ricoh Co Ltd Polarization converting element
WO2010009136A2 (en) * 2008-07-14 2010-01-21 The General Hospital Corporation Apparatus and methods for color endoscopy
JP5671455B2 (en) 2009-01-21 2015-02-18 レイブンブリック，エルエルシー Optical metapolarizer device
US20100302481A1 (en) 2009-06-01 2010-12-02 Baum Alexandra Absorbing wire grid polarizer
US8300294B2 (en) 2009-09-18 2012-10-30 Toyota Motor Engineering & Manufacturing North America, Inc. Planar gradient index optical metamaterials
US9113023B2 (en) 2009-11-20 2015-08-18 Faro Technologies, Inc. Three-dimensional scanner with spectroscopic energy detector
US20120092770A1 (en) * 2010-01-29 2012-04-19 Jingjing Li Non-periodic gratings for shaping reflected and transmitted light irradiance profiles
WO2011139785A2 (en) * 2010-04-27 2011-11-10 The Regents Of The University Of Michigan Display device having plasmonic color filters and photovoltaic capabilities
RU2013106521A (en) 2010-07-15 2014-08-20 Асахи Гласс Компани, Лимитед METHOD AND METAMATERIAL METHOD
KR101432115B1 (en) 2010-07-15 2014-08-21 한국전자통신연구원 meta material and manufacturing method at the same
JP5480049B2 (en) 2010-07-22 2014-04-23 三菱レイヨン株式会社 Molded body and method for producing the same
JP5425025B2 (en) 2010-09-08 2014-02-26 三菱電機株式会社 Polarization control element
JP5549495B2 (en) 2010-09-13 2014-07-16 大日本印刷株式会社 Optical element, method for producing the same, and method for using the same
JP2012078541A (en) 2010-09-30 2012-04-19 Fujifilm Corp Optical film, polarizing plate, image display device and method for producing optical film
US20120194912A1 (en) 2011-01-31 2012-08-02 Andrei Faraon Optical systems implimented with thermally controlled sub-wavelength gratings
EP2530499A1 (en) 2011-06-01 2012-12-05 Université Jean-Monnet Planar grating polarization transformer
TWI454755B (en) 2011-11-23 2014-10-01 Univ Nat Cheng Kung Metallic structure and opto-electronic apparatus
CN103364955A (en) 2012-03-28 2013-10-23 首都师范大学 Planar optical element and design method thereof
CN103048723B (en) 2012-12-14 2015-05-20 南京大学 L-shaped wave plate and manufacturing method thereof
CN102981205B (en) 2012-12-26 2015-02-04 苏州大学 Sub-wavelength rectangular ring array quarter wave plate and fabrication method thereof
US9262671B2 (en) * 2013-03-15 2016-02-16 Nito Inc. Systems, methods, and software for detecting an object in an image
CN103399369B (en) 2013-07-16 2016-01-27 哈尔滨工程大学 Based on the transmission light device of artificial electromagnetic material
US20150198812A1 (en) 2014-01-15 2015-07-16 Georgia Tech Research Corporation Photo-Mask and Accessory Optical Components for Fabrication of Three-Dimensional Structures
US9507064B2 (en) 2014-07-27 2016-11-29 The Board Of Trustees Of The Leland Stanford Junior University Dielectric metasurface optical elements
EP3195048B1 (en) 2014-09-15 2021-11-03 California Institute of Technology Simultaneous polarization and wavefront control using a planar device
US9395309B2 (en) * 2014-10-15 2016-07-19 Exnodes Inc. Multiple angle computational wafer inspection
EP3238143A1 (en) * 2014-12-22 2017-11-01 Massachusetts Institute of Technology Analog to digital computations in biological systems
US11089286B2 (en) 2015-07-29 2021-08-10 Samsung Electronics Co., Ltd. Image sensor
US11450970B2 (en) 2017-12-04 2022-09-20 California Institute Of Technology Metasurface-assisted 3D beam shaping for desired phase, amplitude, and polarization
WO2020146029A2 (en) 2018-10-22 2020-07-16 California Institute Of Technology Color and multi-spectral image sensor based on 3d engineered material
US20220004016A1 (en) 2019-10-18 2022-01-06 California Institute Of Technology Broadband polarization splitting based on volumetric meta-optics
US11239276B2 (en) 2019-10-18 2022-02-01 California Institute Of Technology CMOS color image sensors with metamaterial color splitting
JP2022553495A (en) 2019-10-18 2022-12-23 カリフォルニア インスティチュート オブ テクノロジー CMOS color image sensor with metamaterial color separation

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130099343A1 (en) * 2010-07-02 2013-04-25 Panasonic Corporation Solid-state imaging device
US20160054172A1 (en) * 2014-08-22 2016-02-25 Samsung Electronics Co., Ltd. Image sensor for producing vivid colors and method of manufacturing the same
US20180045953A1 (en) * 2016-04-29 2018-02-15 The Board Of Trustees Of The Leland Stanford Junior University Device components formed of geometric structures

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
AFIFI SADDEK ET AL: "Electromagnetic Scattering From 3D Layered Structures With Randomly Rough Interfaces: Analysis With the Small Perturbation Method and the Small Slope Approximation", IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, IEEE, USA, vol. 62, no. 10, 1 October 2014 (2014-10-01), pages 5200 - 5208, XP011560581, ISSN: 0018-926X, [retrieved on 20141002], DOI: 10.1109/TAP.2014.2341704 *
See also references of WO2020146029A2 *
SEIJI NISHIWAKI ET AL: "Efficient colour splitters for high-pixel-density image sensors", NATURE PHOTONICS, vol. 7, no. 3, 3 February 2013 (2013-02-03), London, pages 248 - 254, XP055358688, ISSN: 1749-4885, DOI: 10.1038/nphoton.2012.345 *

Also Published As

Publication number Publication date
JP2022503657A (en) 2022-01-12
EP3871020A2 (en) 2021-09-01
WO2020146029A2 (en) 2020-07-16
KR20210064240A (en) 2021-06-02
US20200124866A1 (en) 2020-04-23
CN113167938A (en) 2021-07-23
WO2020146029A3 (en) 2020-08-27
US11397331B2 (en) 2022-07-26
US20230122182A1 (en) 2023-04-20

Similar Documents

Publication Publication Date Title
EP3871020A4 (en) Color and multi-spectral image sensor based on 3d engineered material
EP3743876A4 (en) Crop type classification in images
EP3683838A4 (en) Color image-capture element and image capture device
EP3743877A4 (en) Crop boundary detection in images
GB2577353B (en) A pixel unit, image sensor and camera
EP3550273A4 (en) Image capturing element and image capturing device
EP3535967A4 (en) Sensor for capturing image and method for controlling the same
EP3682202A4 (en) Hybrid visible and near infrared imaging with an rgb color filter array sensor
EP3864436A4 (en) Digital pixel
EP3913907A4 (en) Pixel acquisition circuit and image sensor
EP3724850A4 (en) Color quality assessment based on multispectral imaging
EP3756224A4 (en) Image sensor and semiconductor structure
IL251189A0 (en) Gradual transitioning between two-dimensional and theree-dimensional augmented reality images
EP3682629A4 (en) Image processing and presentation
EP3278364A4 (en) Image sensor and image sensor pixel having jfet source follower
EP3446083A4 (en) Digital pathology color calibration and validation
EP3714356A4 (en) Contextual and aware button-free screen articulation
EP3591959A4 (en) Image sensor and control system
EP3751840A4 (en) Solid-state image sensor and imaging device
EP4045881A4 (en) Luminescence imaging for sensing and/or authentication
EP3447461A4 (en) Infrared imaging element and infrared camera
EP3506355A4 (en) Distance sensor and distance image sensor
EP3840363A4 (en) Image capturing element
EP3432573A4 (en) Pixel sensing unit and image capturing device
EP4050655A4 (en) Pixel structure and image sensor

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210520

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20220530

RIC1 Information provided on ipc code assigned before grant

Ipc: G02B 5/02 20060101AFI20220523BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230605