CN111670576B - 用于深度获取的光场图像处理方法 - Google Patents

用于深度获取的光场图像处理方法 Download PDF

Info

Publication number
CN111670576B
CN111670576B CN201880087607.4A CN201880087607A CN111670576B CN 111670576 B CN111670576 B CN 111670576B CN 201880087607 A CN201880087607 A CN 201880087607A CN 111670576 B CN111670576 B CN 111670576B
Authority
CN
China
Prior art keywords
color
primary
color channel
transfer function
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880087607.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN111670576A (zh
Inventor
乔纳森·伊库拉·萨里
赵智镐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Airray 3d Co ltd
Original Assignee
Airray 3d Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Airray 3d Co ltd filed Critical Airray 3d Co ltd
Publication of CN111670576A publication Critical patent/CN111670576A/zh
Application granted granted Critical
Publication of CN111670576B publication Critical patent/CN111670576B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Optical Elements Other Than Lenses (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
CN201880087607.4A 2017-12-05 2018-12-05 用于深度获取的光场图像处理方法 Active CN111670576B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762594718P 2017-12-05 2017-12-05
US62/594,718 2017-12-05
PCT/CA2018/051554 WO2019109182A1 (en) 2017-12-05 2018-12-05 Light field image processing method for depth acquisition

Publications (2)

Publication Number Publication Date
CN111670576A CN111670576A (zh) 2020-09-15
CN111670576B true CN111670576B (zh) 2022-10-25

Family

ID=66750041

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880087607.4A Active CN111670576B (zh) 2017-12-05 2018-12-05 用于深度获取的光场图像处理方法

Country Status (8)

Country Link
US (1) US11438571B2 (enExample)
EP (1) EP3721621B1 (enExample)
JP (1) JP7245835B2 (enExample)
KR (1) KR102543392B1 (enExample)
CN (1) CN111670576B (enExample)
CA (1) CA3084679C (enExample)
TW (1) TW201925860A (enExample)
WO (1) WO2019109182A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102391632B1 (ko) * 2016-06-07 2022-04-27 애어리3디 인크. 광 필드 이미징 장치 및 깊이 획득 및 3차원 이미징 방법
IL251636B (en) 2017-04-06 2018-02-28 Yoav Berlatzky Coherence camera system and method thereof
JP7245835B2 (ja) * 2017-12-05 2023-03-24 エアリー３ディー インコーポレイティド 奥行取得のためのライトフィールド画像処理方法
EP3522106A1 (en) * 2018-01-31 2019-08-07 InterDigital CE Patent Holdings A filter array enabling easy demosaicing
KR102513680B1 (ko) * 2018-06-08 2023-03-24 엘지이노텍 주식회사 카메라 모듈 및 그의 깊이 정보 추출 방법
US11686935B2 (en) * 2019-01-29 2023-06-27 Meta Platforms Technologies, Llc Interferometric structured illumination for depth determination
TW202101035A (zh) 2019-06-05 2021-01-01 加拿大商艾瑞３Ｄ股份有限公司 用於3d感測之光場成像裝置及方法
CN110398477B (zh) * 2019-07-03 2022-06-24 香港光云科技有限公司 材质分类及识别方法
CN110928035A (zh) * 2019-12-20 2020-03-27 京东方科技集团股份有限公司 一种显示装置
US11704929B2 (en) 2020-07-06 2023-07-18 Visera Technologies Company Limited Optical structure and method of fabricating the same
CN114365019B (zh) * 2020-07-22 2024-09-20 深圳市汇顶科技股份有限公司 深度信息图像采集装置和电子设备
US11741748B2 (en) 2020-10-14 2023-08-29 Shenzhen GOODIX Technology Co., Ltd. Passive image depth sensing for object verification based on chromatic differentiation
US12429702B2 (en) * 2020-11-10 2025-09-30 Airy3D Inc. Imaging systems and methods for dual depth and polarization sensing
WO2022104467A1 (en) * 2020-11-20 2022-05-27 Airy3D Inc. Diffraction-grating-based systems and methods for stereoscopic and multiscopic imaging
US20220179147A1 (en) * 2020-12-04 2022-06-09 Facebook Technologies, Llc Patterned backlight for display panel
US11740471B2 (en) 2020-12-04 2023-08-29 Meta Platforms Technologies, Llc Display device with transparent illuminator
EP4278147A4 (en) 2021-01-15 2024-12-11 Airy3d Inc. DETERMINATION OF LENS POSITION IN DEPTH IMAGING
WO2022155747A1 (en) * 2021-01-22 2022-07-28 Airy3D Inc. Power management techniques in depth imaging
KR102325647B1 (ko) 2021-08-04 2021-11-12 파이어슈라이크게임즈 주식회사 라이트맵 기반 모바일 게임의 3d 객체 데이터 처리 방법, 장치 및 시스템
US11832001B2 (en) 2021-12-20 2023-11-28 Visera Technologies Company Limited Image processing method and image processing system
US11683604B1 (en) * 2022-02-23 2023-06-20 Omnivision Technologies, Inc. Circuit and method for image artifact reduction in high-density, highpixel-count, image sensor with phase detection autofocus
CN115166993B (zh) * 2022-05-31 2023-11-10 北京邮电大学 自适应三维光场显示方法及系统
CN115272584B (zh) * 2022-08-03 2025-07-25 清华大学深圳国际研究生院 一种光场显微系统的多色同步重建方法
TWI837061B (zh) * 2023-09-06 2024-03-21 國立中山大學 利用彩色條紋投影技術進行三維形貌量測的系統及方法
KR102870535B1 (ko) 2024-03-06 2025-10-13 경희대학교 산학협력단 다초점 이미지 분석을 통한 라이트 필드 획득 방법 및 라이트 필드 획득을 위한 광학계 시스템
CN120010086B (zh) * 2025-04-17 2025-07-25 深圳市永泰光电有限公司 光学镜头自动聚焦系统及方法

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0120397B1 (ko) 1992-04-28 1997-10-22 나카무라 히사오 화상표시장치
US5675407A (en) * 1995-03-02 1997-10-07 Zheng Jason Geng Color ranging method for high speed low-cost three dimensional surface profile measurement
KR100416548B1 (ko) * 2001-10-10 2004-02-05 삼성전자주식회사 3차원 영상 표시장치
US20060072005A1 (en) * 2004-10-06 2006-04-06 Thomas-Wayne Patty J Method and apparatus for 3-D electron holographic visual and audio scene propagation in a video or cinematic arena, digitally processed, auto language tracking
US20090128911A1 (en) 2005-09-14 2009-05-21 Moti Itzkovitch Diffraction Grating With a Spatially Varying Duty-Cycle
US7456881B2 (en) * 2006-01-12 2008-11-25 Aptina Imaging Corporation Method and apparatus for producing Bayer color mosaic interpolation for imagers
JP5934459B2 (ja) 2006-04-17 2016-06-15 オムニビジョン テクノロジーズ， インコーポレイテッド アレイ化撮像システムおよび関連方法
FR2917845B1 (fr) 2007-06-19 2011-08-19 Christophe Brossier Procede de visualisation d'une sequence d'images produisant une sensation de relief
WO2010044943A2 (en) * 2008-07-25 2010-04-22 Cornell University Light field image sensor, method and applications
US8809758B2 (en) 2008-07-25 2014-08-19 Cornell University Light field image sensor with an angle-sensitive pixel (ASP) device
US8289440B2 (en) 2008-12-08 2012-10-16 Lytro, Inc. Light field data acquisition devices, and methods of using and manufacturing same
JP5500879B2 (ja) 2009-06-19 2014-05-21 キヤノン株式会社 画像処理装置および画像処理方法
US20110013056A1 (en) * 2009-07-17 2011-01-20 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Color filters and demosaicing techniques for digital imaging
EP2601785A4 (en) 2010-08-03 2017-12-13 Cornell University Angle sensitive pixel (asp)-based image processing system, method, and applications
WO2012058360A2 (en) * 2010-10-27 2012-05-03 Cornell University Light field image sensor, method and applications
US8610813B2 (en) * 2011-05-31 2013-12-17 Omnivision Technologies, Inc. System and method for extending depth of field in a lens system by use of color-dependent wavefront coding
WO2013099792A1 (ja) 2011-12-28 2013-07-04 富士フイルム株式会社 画像処理装置及び方法並びに撮像装置
US8861850B2 (en) 2012-01-31 2014-10-14 Apple Inc. Digital image color correction
JP5958837B2 (ja) 2012-05-28 2016-08-02 パナソニックＩｐマネジメント株式会社 奥行き推定撮像装置
JP2015037102A (ja) 2013-08-12 2015-02-23 株式会社東芝 固体撮像装置
US9515113B2 (en) 2013-08-27 2016-12-06 Rambus Inc. Optical sensing of nearby scenes with tessellated phase anti-symmetric gratings
EP3084513A1 (en) * 2013-12-20 2016-10-26 Koninklijke Philips N.V. Autostereoscopic display device
JP5944578B2 (ja) 2014-02-21 2016-07-05 ＡｖａｎＳｔｒａｔｅ株式会社 ガラス板の製造方法、及び、ガラス板の製造装置
US9426383B1 (en) * 2014-06-20 2016-08-23 Amazon Technologies, Inc. Digital camera for capturing spectral and spatial information
JP6595161B2 (ja) 2014-07-31 2019-10-23 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、画像処理方法、及び、撮像装置
EP3113478A1 (en) 2015-06-30 2017-01-04 Thomson Licensing Plenoptic foveated camera
EP3113475B1 (en) * 2015-06-30 2018-12-19 Thomson Licensing An apparatus and a method for modifying colours of a focal stack of a scene according to a colour palette
KR102391632B1 (ko) * 2016-06-07 2022-04-27 애어리3디 인크. 광 필드 이미징 장치 및 깊이 획득 및 3차원 이미징 방법
JP7245835B2 (ja) * 2017-12-05 2023-03-24 エアリー３ディー インコーポレイティド 奥行取得のためのライトフィールド画像処理方法

Also Published As

Publication number Publication date
JP7245835B2 (ja) 2023-03-24
TW201925860A (zh) 2019-07-01
EP3721621B1 (en) 2025-07-23
CN111670576A (zh) 2020-09-15
US20200359004A1 (en) 2020-11-12
WO2019109182A1 (en) 2019-06-13
CA3084679C (en) 2023-03-07
KR20200112825A (ko) 2020-10-05
JP2021506168A (ja) 2021-02-18
CA3084679A1 (en) 2019-06-13
EP3721621A4 (en) 2021-08-25
US11438571B2 (en) 2022-09-06
KR102543392B1 (ko) 2023-06-13
EP3721621A1 (en) 2020-10-14

Similar Documents

Publication Publication Date Title
CN111670576B (zh) 用于深度获取的光场图像处理方法
US12474509B2 (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
JP6064290B2 (ja) 撮像装置、分光システム、および分光方法
CN103155544B (zh) 基于角度敏感像素（asp）的图像处理系统、处理方法和应用
TW202101035A (zh) 用於3d感測之光場成像裝置及方法
JP2018511253A (ja) 分散して空間的符号化画像を作成する画像を伴う撮像素子
CN104121990A (zh) 基于随机光栅的压缩感知宽波段高光谱成像系统
US20220030183A1 (en) Infrared and non-infrared channel blender for depth mapping using structured light
CN115307577A (zh) 一种目标三维信息测量方法和系统
US11676293B2 (en) Methods for depth sensing using candidate images selected based on an epipolar line
KR20230113110A (ko) 렌즈리스 카메라를 이용한 스냅샷 기반 초분광 이미지 획득 장치 및 방법
Gundogan et al. Computational spectral imaging with diffractive lenses and spectral filter arrays
Rueda et al. Compressive spectral imaging based on colored coded apertures
US20240412563A1 (en) Methods and systems using depth imaging for training and deploying neural networks for biometric anti-spoofing
CA3026789C (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
Shi Task-specific Computational Cameras
WO2025245172A1 (en) Split-aperture 2-in-1 computational imaging devices
WO2023106143A1 (ja) 分光画像を生成するシステムに用いられる装置およびフィルタアレイ、分光画像を生成するシステム、ならびにフィルタアレイの製造方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant