TWI857068B - 創造複合影像的成像系統及方法 - Google Patents

創造複合影像的成像系統及方法 Download PDF

Info

Publication number
TWI857068B
TWI857068B TW109118273A TW109118273A TWI857068B TW I857068 B TWI857068 B TW I857068B TW 109118273 A TW109118273 A TW 109118273A TW 109118273 A TW109118273 A TW 109118273A TW I857068 B TWI857068 B TW I857068B
Authority
TW
Taiwan
Prior art keywords
lens
super
composite image
filter
imaging system
Prior art date
Application number
TW109118273A
Other languages
English (en)
Chinese (zh)
Other versions
TW202113422A (zh
Inventor
晉欣 傅
永安 徐
魯多維 葛迪
納瑪 艾卡曼
羅伯特詹 維瑟爾
Original Assignee
美商應用材料股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 美商應用材料股份有限公司 filed Critical 美商應用材料股份有限公司
Publication of TW202113422A publication Critical patent/TW202113422A/zh
Application granted granted Critical
Publication of TWI857068B publication Critical patent/TWI857068B/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
    • G02B1/002—Optical elements characterised by the material of which they are made; Optical coatings for optical elements made of materials engineered to provide properties not available in nature, e.g. metamaterials
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0015—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras characterised by the lens design
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00—Optical objectives specially designed for the purposes specified below
    • G02B13/001—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • G02B13/0055—Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras employing a special optical element
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
    • G02B27/005—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration for correction of secondary colour or higher-order chromatic aberrations
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/20—Filters
    • G02B5/201—Filters in the form of arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
    • H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611—Correction of chromatic aberration
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/805—Coatings
    • H10F39/8053—Colour filters
    • H—ELECTRICITY
    • H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
    • H10F—INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION
    • H10F39/00—Integrated devices, or assemblies of multiple devices, comprising at least one element covered by group H10F30/00, e.g. radiation detectors comprising photodiode arrays
    • H10F39/80—Constructional details of image sensors
    • H10F39/806—Optical elements or arrangements associated with the image sensors
    • H10F39/8063—Microlenses
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Lenses (AREA)
  • Cameras In General (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Blocking Light For Cameras (AREA)
  • Solid State Image Pick-Up Elements (AREA)
TW109118273A 2019-06-06 2020-06-01 創造複合影像的成像系統及方法 TWI857068B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962858258P 2019-06-06 2019-06-06
US62/858,258 2019-06-06

Publications (2)

Publication Number Publication Date
TW202113422A TW202113422A (zh) 2021-04-01
TWI857068B true TWI857068B (zh) 2024-10-01

Family

ID=73651674

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109118273A TWI857068B (zh) 2019-06-06 2020-06-01 創造複合影像的成像系統及方法

Country Status (7)

Country Link
US (2) US11610925B2 (https=)
EP (1) EP3980830A4 (https=)
JP (2) JP7650244B2 (https=)
KR (1) KR102915906B1 (https=)
CN (2) CN118348657A (https=)
TW (1) TWI857068B (https=)
WO (1) WO2020247109A1 (https=)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3980830A4 (en) * 2019-06-06 2023-06-07 Applied Materials, Inc. IMAGING SYSTEM AND METHOD OF GENERATING COMPOSITE IMAGES
JP7475731B2 (ja) * 2019-09-26 2024-04-30 ファーストライト ファーマシューティカルズ，エルエルシー カンナビノイドプロドラッグ化合物
WO2023012110A1 (en) * 2021-08-02 2023-02-09 Nil Technology Aps Multi-channel high-resolution imaging devices incorporating metalenses
WO2023012078A1 (en) * 2021-08-02 2023-02-09 Nil Technology Aps Multi-channel high-resolution imaging devices incorporating metalenses for color images
CN113905165A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及利用光场成像系统采集光场信息的方法
CN113905164A (zh) * 2021-10-09 2022-01-07 奕目(上海)科技有限公司 光场成像系统以及通过光场成像系统采集光场信息的方法
KR20240151196A (ko) * 2022-02-14 2024-10-17 튜놉틱스, 인크. 색상 분할 메타 광학 계산 카메라를 사용한 고품질 이미징을 위한 시스템 및 방법
CN119768715A (zh) * 2022-07-12 2025-04-04 新加坡科技研究局 光学系统及形成光学系统的方法、形成多色图像的方法
WO2024225663A1 (ko) 2023-04-24 2024-10-31 삼성전자 주식회사 이미지를 복원하기 위한 전자 장치 및 그 동작 방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090250594A1 (en) * 2008-04-04 2009-10-08 Panasonic Corporation Solid-state image sensor and manufacturing method thereof
TW201608711A (zh) * 2014-08-22 2016-03-01 愛思開海力士有限公司 影像感測器及具有該影像感測器的電子裝置
US20170034500A1 (en) * 2015-07-29 2017-02-02 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
US9583522B2 (en) * 2014-09-04 2017-02-28 SK Hynix Inc. Image sensor and electronic device including the same
CN109348114A (zh) * 2018-11-26 2019-02-15 Oppo广东移动通信有限公司 成像装置和电子设备

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPQ289099A0 (en) 1999-09-16 1999-10-07 Silverbrook Research Pty Ltd Method and apparatus for manipulating a bayer image
US7019890B2 (en) 2001-10-05 2006-03-28 E-Vision, Llc Hybrid electro-active lens
US7924327B2 (en) 2003-10-22 2011-04-12 Panasonic Corporation Imaging apparatus and method for producing the same, portable equipment, and imaging sensor and method for producing the same
US7123298B2 (en) 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements
EP1812968B1 (en) * 2004-08-25 2019-01-16 Callahan Cellular L.L.C. Apparatus for multiple camera devices and method of operating same
US7206136B2 (en) 2005-02-18 2007-04-17 Eastman Kodak Company Digital camera using multiple lenses and image sensors to provide an extended zoom range
EP2016620A2 (en) * 2006-04-17 2009-01-21 Omnivision Cdm Optics, Inc. Arrayed imaging systems and associated methods
JP4985183B2 (ja) 2007-07-26 2012-07-25 東京エレクトロン株式会社 基板処理装置及び基板処理方法並びに記憶媒体
EP4336447B1 (en) 2008-05-20 2025-05-07 Adeia Imaging LLC Capturing and processing of images using monolithic camera array with heterogeneous imagers
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
WO2011100070A1 (en) 2010-02-12 2011-08-18 The Regents Of The University Of California Metamaterial-based optical lenses
JP5820143B2 (ja) 2010-06-22 2015-11-24 株式会社ニューフレアテクノロジー 半導体製造装置、半導体製造方法及び半導体製造装置のクリーニング方法
US8478123B2 (en) * 2011-01-25 2013-07-02 Aptina Imaging Corporation Imaging devices having arrays of image sensors and lenses with multiple aperture sizes
US9231013B2 (en) * 2011-11-08 2016-01-05 Semiconductor Components Industries, Llc Resonance enhanced absorptive color filters having resonance cavities
US9298060B2 (en) 2011-12-20 2016-03-29 Washington University Imaging using metamaterials
US8988566B2 (en) * 2012-08-09 2015-03-24 Omnivision Technologies, Inc. Lens array for partitioned image sensor having color filters
FR3002242B1 (fr) 2013-02-21 2015-04-03 Altatech Semiconductor Dispositif de depot chimique en phase vapeur
JP6480919B2 (ja) * 2013-05-21 2019-03-13 クラレト，ホルヘ ヴィセンテ ブラスコ プレノプティックセンサとその製造方法およびプレノプティックセンサを有する配置
JP6376920B2 (ja) 2014-03-07 2018-08-22 キヤノン株式会社 複眼撮像装置
CN103986867B (zh) * 2014-04-24 2017-04-05 宇龙计算机通信科技(深圳)有限公司 一种图像拍摄终端和图像拍摄方法
KR102157675B1 (ko) * 2014-07-25 2020-09-18 삼성전자주식회사 촬영 장치 및 그 촬영 방법
TWI531852B (zh) * 2014-09-16 2016-05-01 聚晶半導體股份有限公司 影像擷取裝置及數位變焦方法
KR102251483B1 (ko) * 2014-10-23 2021-05-14 삼성전자주식회사 영상을 처리하는 전자 장치 및 방법
US10816815B2 (en) 2014-12-10 2020-10-27 President And Fellows Of Harvard College Achromatic metasurface optical components by dispersive phase compensation
CN104506771B (zh) 2014-12-18 2018-04-27 北京智谷睿拓技术服务有限公司 图像处理方法及装置
JP6486149B2 (ja) * 2015-03-03 2019-03-20 キヤノン株式会社 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
WO2016168173A1 (en) 2015-04-14 2016-10-20 California Institute Of Technology Multi-wavelength optical dielectric metasurfaces
US9946051B2 (en) * 2015-04-22 2018-04-17 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN108353126B (zh) * 2015-04-23 2019-08-23 苹果公司 处理相机的内容的方法、电子设备和计算机可读存储介质
US10790325B2 (en) 2015-07-29 2020-09-29 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN106803872A (zh) * 2017-03-02 2017-06-06 苏州苏大维格光电科技股份有限公司 相机镜头及手机
JP6863787B2 (ja) 2017-03-17 2021-04-21 ソニー・オリンパスメディカルソリューションズ株式会社 内視鏡システム
US10678047B2 (en) 2017-03-29 2020-06-09 Microsoft Technology Licensing, Llc Achromatized metasurface lens
US10284759B2 (en) * 2017-09-28 2019-05-07 Motorola Mobility Llc Display with interspaced microlenses and corresponding devices and methods
US11257856B2 (en) * 2017-10-13 2022-02-22 Trustees Of Boston University Lens-free compound eye cameras based on angle-sensitive meta-surfaces
KR20190051670A (ko) * 2017-11-07 2019-05-15 삼성전자주식회사 전자 장치 및 그의 이미지 처리 방법
EP3980830A4 (en) * 2019-06-06 2023-06-07 Applied Materials, Inc. IMAGING SYSTEM AND METHOD OF GENERATING COMPOSITE IMAGES

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090250594A1 (en) * 2008-04-04 2009-10-08 Panasonic Corporation Solid-state image sensor and manufacturing method thereof
TW201608711A (zh) * 2014-08-22 2016-03-01 愛思開海力士有限公司 影像感測器及具有該影像感測器的電子裝置
US9583522B2 (en) * 2014-09-04 2017-02-28 SK Hynix Inc. Image sensor and electronic device including the same
US20170034500A1 (en) * 2015-07-29 2017-02-02 Samsung Electronics Co., Ltd. Imaging apparatus and image sensor including the same
CN109348114A (zh) * 2018-11-26 2019-02-15 Oppo广东移动通信有限公司 成像装置和电子设备

Also Published As

Publication number Publication date
US20230230991A1 (en) 2023-07-20
CN113924517B (zh) 2024-03-22
KR102915906B1 (ko) 2026-01-20
EP3980830A4 (en) 2023-06-07
US20200388642A1 (en) 2020-12-10
EP3980830A1 (en) 2022-04-13
US12021102B2 (en) 2024-06-25
TW202113422A (zh) 2021-04-01
US11610925B2 (en) 2023-03-21
CN118348657A (zh) 2024-07-16
WO2020247109A1 (en) 2020-12-10
TW202503354A (zh) 2025-01-16
CN113924517A (zh) 2022-01-11
JP2022535238A (ja) 2022-08-05
KR20220017480A (ko) 2022-02-11
JP2025108420A (ja) 2025-07-23
JP7650244B2 (ja) 2025-03-24

Similar Documents

Publication Publication Date Title
TWI857068B (zh) 創造複合影像的成像系統及方法
KR102830280B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
US11756975B2 (en) Image sensor and image sensing method to generate high sensitivity image through thin lens element and micro lens array
TWI549273B (zh) 用於具彩色濾光片之分割影像感測器之鏡片陣列
CN108141571B (zh) 无掩模相位检测自动聚焦
CN204697179U (zh) 具有像素阵列的图像传感器
CN103703413B (zh) 使用颜色相关波前编码扩展透镜系统中景深的系统和方法
KR102765854B1 (ko) 색분리 렌즈 어레이를 적용한 영상 획득 장치 및 방법
KR102693695B1 (ko) 이미지 센서 및 그 준비 방법 및 전자 장치
US20250159316A1 (en) Imaging with liquid crystal polarization holograms and metasurface
US9583522B2 (en) Image sensor and electronic device including the same
TW202043834A (zh) 使用晶圓級整合製程的光場相機及方法
TW201638620A (zh) 鏡頭模組陣列、影像感測裝置與數位縮放影像融合方法
US20250093562A1 (en) Spectral filter and electronic device including the same
TWI916962B (zh) 創造複合影像的成像系統及方法
JP2009182550A (ja) カメラモジュール
CN112788218A (zh) 电子设备及其摄像模组
US20260046530A1 (en) Image sensor and electronic apparatus including the same
KR102202196B1 (ko) 카메라 모듈
US20250221075A1 (en) Image sensor and electronic apparatus including the same
JP4545734B2 (ja) モバイルカメラ光学系の光学レンズシステム
TW201543891A (zh) 光學變焦成像系統及相關方法