CN118348657A - 生成复合影像的成像系统及方法 - Google Patents

生成复合影像的成像系统及方法 Download PDF

Info

Publication number
CN118348657A
CN118348657A CN202410257855.6A CN202410257855A CN118348657A CN 118348657 A CN118348657 A CN 118348657A CN 202410257855 A CN202410257855 A CN 202410257855A CN 118348657 A CN118348657 A CN 118348657A
Authority
CN
China
Prior art keywords
metalens
filter
composite image
imaging system
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410257855.6A
Other languages
English (en)
Chinese (zh)
Inventor
傅晋欣
徐永安
卢多维克·葛德特
拿玛·阿加曼
罗伯特·杨·维塞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Applied Materials Inc
Original Assignee
Applied Materials Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Applied Materials Inc filed Critical Applied Materials Inc
Publication of CN118348657A publication Critical patent/CN118348657A/zh
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002—Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0015—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/201—Filters in the form of arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611—Correction of chromatic aberration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/806—Optical elements or arrangements associated with the image sensors
    • H10F39/8063—Microlenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Blocking Light For Cameras (AREA)
  • Lenses (AREA)
  • Solid State Image Pick-Up Elements (AREA)
CN202410257855.6A 2019-06-06 2020-04-27 生成复合影像的成像系统及方法 Pending CN118348657A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201962858258P 2019-06-06 2019-06-06
US62/858,258 2019-06-06
CN202080041362.9A CN113924517B (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法
PCT/US2020/030036 WO2020247109A1 (en) 2019-06-06 2020-04-27 Imaging system and method of creating composite images

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN202080041362.9A Division CN113924517B (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Publications (1)

Publication Number Publication Date
CN118348657A true CN118348657A (zh) 2024-07-16

Family

ID=73651674

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202410257855.6A Pending CN118348657A (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法
CN202080041362.9A Active CN113924517B (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202080041362.9A Active CN113924517B (zh) 2019-06-06 2020-04-27 生成复合影像的成像系统及方法

Country Status (7)

Country Link
US (2) US11610925B2 (cg-RX-API-DMAC10.html)
EP (1) EP3980830B1 (cg-RX-API-DMAC10.html)
JP (2) JP7650244B2 (cg-RX-API-DMAC10.html)
KR (1) KR102915906B1 (cg-RX-API-DMAC10.html)
CN (2) CN118348657A (cg-RX-API-DMAC10.html)
TW (2) TWI857068B (cg-RX-API-DMAC10.html)
WO (1) WO2020247109A1 (cg-RX-API-DMAC10.html)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11610925B2 (en) * 2019-06-06 2023-03-21 Applied Materials, Inc. Imaging system and method of creating composite images
WO2021062231A2 (en) * 2019-09-26 2021-04-01 Firstlight Pharmaceuticals Llc Cannabinoid prodrug compounds
WO2023012110A1 (en) * 2021-08-02 2023-02-09 Nil Technology Aps Multi-channel high-resolution imaging devices incorporating metalenses
EP4381728A1 (en) * 2021-08-02 2024-06-12 Nil Technology ApS Multi-channel high-resolution imaging devices incorporating metalenses for color images
CN113905164A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及通过光场成像系统采集光场信息的方法
CN113905165A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及利用光场成像系统采集光场信息的方法
KR20240151196A (ko) * 2022-02-14 2024-10-17 튜놉틱스, 인크. 색상 분할 메타 광학 계산 카메라를 사용한 고품질 이미징을 위한 시스템 및 방법
CN119768715A (zh) * 2022-07-12 2025-04-04 新加坡科技研究局 光学系统及形成光学系统的方法、形成多色图像的方法
WO2024225663A1 (ko) 2023-04-24 2024-10-31 삼성전자 주식회사 이미지를 복원하기 위한 전자 장치 및 그 동작 방법

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPQ289099A0 (en) 1999-09-16 1999-10-07 Silverbrook Research Pty Ltd Method and apparatus for manipulating a bayer image
US7019890B2 (en) 2001-10-05 2006-03-28 E-Vision, Llc Hybrid electro-active lens
WO2005041562A1 (ja) * 2003-10-22 2005-05-06 Matsushita Electric Industrial Co., Ltd. 撮像装置とその製造方法、携帯機器、及び撮像素子とその製造方法
US7123298B2 (en) * 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements
EP1812968B1 (en) * 2004-08-25 2019-01-16 Callahan Cellular L.L.C. Apparatus for multiple camera devices and method of operating same
US7206136B2 (en) * 2005-02-18 2007-04-17 Eastman Kodak Company Digital camera using multiple lenses and image sensors to provide an extended zoom range
US8599301B2 (en) * 2006-04-17 2013-12-03 Omnivision Technologies, Inc. Arrayed imaging systems having improved alignment and associated methods
JP4985183B2 (ja) 2007-07-26 2012-07-25 東京エレクトロン株式会社 基板処理装置及び基板処理方法並びに記憶媒体
JP2009252978A (ja) * 2008-04-04 2009-10-29 Panasonic Corp 固体撮像素子およびその製造方法
US8866920B2 (en) * 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
EP4336447B1 (en) * 2008-05-20 2025-05-07 Adeia Imaging LLC Capturing and processing of images using monolithic camera array with heterogeneous imagers
WO2011100070A1 (en) 2010-02-12 2011-08-18 The Regents Of The University Of California Metamaterial-based optical lenses
JP5820143B2 (ja) 2010-06-22 2015-11-24 株式会社ニューフレアテクノロジー 半導体製造装置、半導体製造方法及び半導体製造装置のクリーニング方法
US8478123B2 (en) * 2011-01-25 2013-07-02 Aptina Imaging Corporation Imaging devices having arrays of image sensors and lenses with multiple aperture sizes
US9231013B2 (en) 2011-11-08 2016-01-05 Semiconductor Components Industries, Llc Resonance enhanced absorptive color filters having resonance cavities
US9298060B2 (en) 2011-12-20 2016-03-29 Washington University Imaging using metamaterials
US8988566B2 (en) * 2012-08-09 2015-03-24 Omnivision Technologies, Inc. Lens array for partitioned image sensor having color filters
FR3002242B1 (fr) 2013-02-21 2015-04-03 Altatech Semiconductor Dispositif de depot chimique en phase vapeur
CN110061018B (zh) 2013-05-21 2023-11-28 弗托斯传感与算法公司 全光透镜在光传感器衬底上的单片集成
JP6376920B2 (ja) * 2014-03-07 2018-08-22 キヤノン株式会社 複眼撮像装置
CN103986867B (zh) * 2014-04-24 2017-04-05 宇龙计算机通信科技(深圳)有限公司 一种图像拍摄终端和图像拍摄方法
KR102157675B1 (ko) * 2014-07-25 2020-09-18 삼성전자주식회사 촬영 장치 및 그 촬영 방법
KR102394277B1 (ko) 2014-08-22 2022-05-06 에스케이하이닉스 주식회사 이미지 센서 및 이를 구비하는 전자장치
US9583522B2 (en) 2014-09-04 2017-02-28 SK Hynix Inc. Image sensor and electronic device including the same
TWI531852B (zh) * 2014-09-16 2016-05-01 聚晶半導體股份有限公司 影像擷取裝置及數位變焦方法
KR102251483B1 (ko) * 2014-10-23 2021-05-14 삼성전자주식회사 영상을 처리하는 전자 장치 및 방법
WO2016140720A2 (en) 2014-12-10 2016-09-09 President And Fellows Of Harvard College Achromatic metasurface optical components by dispersive phase compensation
CN104506771B (zh) * 2014-12-18 2018-04-27 北京智谷睿拓技术服务有限公司 图像处理方法及装置
JP6486149B2 (ja) * 2015-03-03 2019-03-20 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
WO2016168173A1 (en) 2015-04-14 2016-10-20 California Institute Of Technology Multi-wavelength optical dielectric metasurfaces
US9946051B2 (en) * 2015-04-22 2018-04-17 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN110769149B (zh) * 2015-04-23 2021-05-11 苹果公司 用于处理来自多相机的内容的方法、电子设备和存储介质
US10403668B2 (en) * 2015-07-29 2019-09-03 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
US10790325B2 (en) * 2015-07-29 2020-09-29 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN106803872A (zh) * 2017-03-02 2017-06-06 苏州苏大维格光电科技股份有限公司 相机镜头及手机
JP6863787B2 (ja) * 2017-03-17 2021-04-21 ソニー・オリンパスメディカルソリューションズ株式会社 内視鏡システム
US10678047B2 (en) 2017-03-29 2020-06-09 Microsoft Technology Licensing, Llc Achromatized metasurface lens
US10284759B2 (en) * 2017-09-28 2019-05-07 Motorola Mobility Llc Display with interspaced microlenses and corresponding devices and methods
US11257856B2 (en) * 2017-10-13 2022-02-22 Trustees Of Boston University Lens-free compound eye cameras based on angle-sensitive meta-surfaces
KR20190051670A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 전자 장치 및 그의 이미지 처리 방법
CN109348114A (zh) * 2018-11-26 2019-02-15 Oppo广东移动通信有限公司 成像装置和电子设备
US11610925B2 (en) * 2019-06-06 2023-03-21 Applied Materials, Inc. Imaging system and method of creating composite images

Also Published As

Publication number Publication date
TWI916962B (zh) 2026-03-01
KR102915906B1 (ko) 2026-01-20
US12021102B2 (en) 2024-06-25
JP2022535238A (ja) 2022-08-05
JP2025108420A (ja) 2025-07-23
EP3980830A1 (en) 2022-04-13
US20230230991A1 (en) 2023-07-20
TWI857068B (zh) 2024-10-01
WO2020247109A1 (en) 2020-12-10
JP7650244B2 (ja) 2025-03-24
CN113924517A (zh) 2022-01-11
KR20220017480A (ko) 2022-02-11
TW202113422A (zh) 2021-04-01
CN113924517B (zh) 2024-03-22
US11610925B2 (en) 2023-03-21
EP3980830B1 (en) 2026-06-03
TW202503354A (zh) 2025-01-16
US20200388642A1 (en) 2020-12-10
EP3980830A4 (en) 2023-06-07

Similar Documents

Publication Publication Date Title
TWI857068B (zh) 創造複合影像的成像系統及方法
US11756975B2 (en) Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array
CN103703413B (zh) 使用颜色相关波前编码扩展透镜系统中景深的系统和方法
KR102765854B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
CN204697179U (zh) 具有像素阵列的图像传感器
KR102693695B1 (ko) 이미지 센서 및 그 준비 방법 및 전자 장치
US10403664B2 (en) Photoelectric conversion apparatus and imaging system
JP6480919B2 (ja) プレノプティックセンサとその製造方法およびプレノプティックセンサを有する配置
JP5947217B2 (ja) 色分離フィルタアレイ、固体撮像素子、撮像装置、および表示装置
US8860855B2 (en) Solid-state image sensor with dispersing element that disperses light according to color component, image capture device and signal processing method
US20230037261A1 (en) Sensing with liquid crystal polarization holograms and metasurface
US9583522B2 (en) Image sensor and electronic device including the same
TW202503361A (zh) 影像感測器及包括影像感測器之電子設備
JP5018125B2 (ja) 固体撮像装置および撮像装置
US20250093562A1 (en) Spectral filter and electronic device including the same
CN112788218A (zh) 电子设备及其摄像模组
US20260046530A1 (en) Image sensor and electronic apparatus including the same
JP4545734B2 (ja) モバイルカメラ光学系の光学レンズシステム
JP5234165B2 (ja) 固体撮像装置および撮像装置
KR20250106518A (ko) 이미지 센서 및 이를 포함하는 전자 장치

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination