CA3084679C - Light field image processing method for depth acquisition - Google Patents

Light field image processing method for depth acquisition Download PDF

Info

Publication number
CA3084679C
CA3084679C CA3084679A CA3084679A CA3084679C CA 3084679 C CA3084679 C CA 3084679C CA 3084679 A CA3084679 A CA 3084679A CA 3084679 A CA3084679 A CA 3084679A CA 3084679 C CA3084679 C CA 3084679C
Authority
CA
Canada
Prior art keywords
color
pixel
main
scene
channel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA3084679A
Other languages
English (en)
French (fr)
Other versions
CA3084679A1 (en
Inventor
Jonathan Ikola Saari
Ji-Ho Cho
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Airy3d Inc
Original Assignee
Airy3d Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Airy3d Inc filed Critical Airy3d Inc
Publication of CA3084679A1 publication Critical patent/CA3084679A1/en
Application granted granted Critical
Publication of CA3084679C publication Critical patent/CA3084679C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
  • Optical Elements Other Than Lenses (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
CA3084679A 2017-12-05 2018-12-05 Light field image processing method for depth acquisition Active CA3084679C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762594718P 2017-12-05 2017-12-05
US62/594,718 2017-12-05
PCT/CA2018/051554 WO2019109182A1 (en) 2017-12-05 2018-12-05 Light field image processing method for depth acquisition

Publications (2)

Publication Number Publication Date
CA3084679A1 CA3084679A1 (en) 2019-06-13
CA3084679C true CA3084679C (en) 2023-03-07

Family

ID=66750041

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3084679A Active CA3084679C (en) 2017-12-05 2018-12-05 Light field image processing method for depth acquisition

Country Status (8)

Country Link
US (1) US11438571B2 (enExample)
EP (1) EP3721621B1 (enExample)
JP (1) JP7245835B2 (enExample)
KR (1) KR102543392B1 (enExample)
CN (1) CN111670576B (enExample)
CA (1) CA3084679C (enExample)
TW (1) TW201925860A (enExample)
WO (1) WO2019109182A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3466052B1 (en) * 2016-06-07 2025-02-19 Airy3d Inc. Light field imaging device and method for depth acquisition and three-dimensional imaging
IL251636B (en) 2017-04-06 2018-02-28 Yoav Berlatzky Coherence camera system and method thereof
KR102543392B1 (ko) * 2017-12-05 2023-06-13 애어리3디 인크. 깊이 획득을 위한 명시야 이미지 처리 방법
EP3522106A1 (en) * 2018-01-31 2019-08-07 InterDigital CE Patent Holdings A filter array enabling easy demosaicing
KR102513680B1 (ko) * 2018-06-08 2023-03-24 엘지이노텍 주식회사 카메라 모듈 및 그의 깊이 정보 추출 방법
US11686935B2 (en) * 2019-01-29 2023-06-27 Meta Platforms Technologies, Llc Interferometric structured illumination for depth determination
US12259563B2 (en) 2019-06-05 2025-03-25 Airy3D Inc. Light field imaging device and method for 3D sensing
CN110398477B (zh) * 2019-07-03 2022-06-24 香港光云科技有限公司 材质分类及识别方法
CN110928035A (zh) * 2019-12-20 2020-03-27 京东方科技集团股份有限公司 一种显示装置
US11704929B2 (en) * 2020-07-06 2023-07-18 Visera Technologies Company Limited Optical structure and method of fabricating the same
CN114365019B (zh) * 2020-07-22 2024-09-20 深圳市汇顶科技股份有限公司 深度信息图像采集装置和电子设备
US11741748B2 (en) * 2020-10-14 2023-08-29 Shenzhen GOODIX Technology Co., Ltd. Passive image depth sensing for object verification based on chromatic differentiation
US12429702B2 (en) * 2020-11-10 2025-09-30 Airy3D Inc. Imaging systems and methods for dual depth and polarization sensing
WO2022104467A1 (en) * 2020-11-20 2022-05-27 Airy3D Inc. Diffraction-grating-based systems and methods for stereoscopic and multiscopic imaging
US20220179147A1 (en) * 2020-12-04 2022-06-09 Facebook Technologies, Llc Patterned backlight for display panel
US11740471B2 (en) 2020-12-04 2023-08-29 Meta Platforms Technologies, Llc Display device with transparent illuminator
WO2022150903A1 (en) 2021-01-15 2022-07-21 Airy3D Inc. Lens position determination in depth imaging
US12432444B2 (en) * 2021-01-22 2025-09-30 Airy3D Inc. Power management techniques in depth imaging
KR102325647B1 (ko) 2021-08-04 2021-11-12 파이어슈라이크게임즈 주식회사 라이트맵 기반 모바일 게임의 3d 객체 데이터 처리 방법, 장치 및 시스템
US11832001B2 (en) * 2021-12-20 2023-11-28 Visera Technologies Company Limited Image processing method and image processing system
US11683604B1 (en) * 2022-02-23 2023-06-20 Omnivision Technologies, Inc. Circuit and method for image artifact reduction in high-density, highpixel-count, image sensor with phase detection autofocus
CN115166993B (zh) * 2022-05-31 2023-11-10 北京邮电大学 自适应三维光场显示方法及系统
CN115272584B (zh) * 2022-08-03 2025-07-25 清华大学深圳国际研究生院 一种光场显微系统的多色同步重建方法
TWI837061B (zh) * 2023-09-06 2024-03-21 國立中山大學 利用彩色條紋投影技術進行三維形貌量測的系統及方法
KR102870535B1 (ko) 2024-03-06 2025-10-13 경희대학교 산학협력단 다초점 이미지 분석을 통한 라이트 필드 획득 방법 및 라이트 필드 획득을 위한 광학계 시스템
CN120010086B (zh) * 2025-04-17 2025-07-25 深圳市永泰光电有限公司 光学镜头自动聚焦系统及方法

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0120397B1 (ko) 1992-04-28 1997-10-22 나카무라 히사오 화상표시장치
US5675407A (en) * 1995-03-02 1997-10-07 Zheng Jason Geng Color ranging method for high speed low-cost three dimensional surface profile measurement
KR100416548B1 (ko) * 2001-10-10 2004-02-05 삼성전자주식회사 3차원 영상 표시장치
US20060072005A1 (en) 2004-10-06 2006-04-06 Thomas-Wayne Patty J Method and apparatus for 3-D electron holographic visual and audio scene propagation in a video or cinematic arena, digitally processed, auto language tracking
US20090097122A1 (en) 2005-09-14 2009-04-16 Mirage Innovations Ltd Diffractive Optical Device and System
US7456881B2 (en) * 2006-01-12 2008-11-25 Aptina Imaging Corporation Method and apparatus for producing Bayer color mosaic interpolation for imagers
TWI397995B (zh) 2006-04-17 2013-06-01 豪威科技股份有限公司 陣列成像系統及其相關方法
FR2917845B1 (fr) 2007-06-19 2011-08-19 Christophe Brossier Procede de visualisation d'une sequence d'images produisant une sensation de relief
US8809758B2 (en) 2008-07-25 2014-08-19 Cornell University Light field image sensor with an angle-sensitive pixel (ASP) device
US8530811B2 (en) 2008-07-25 2013-09-10 Cornell University Light field image sensor, method and applications
US8289440B2 (en) * 2008-12-08 2012-10-16 Lytro, Inc. Light field data acquisition devices, and methods of using and manufacturing same
JP5500879B2 (ja) 2009-06-19 2014-05-21 キヤノン株式会社 画像処理装置および画像処理方法
US20110013056A1 (en) 2009-07-17 2011-01-20 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Color filters and demosaicing techniques for digital imaging
WO2012018887A2 (en) 2010-08-03 2012-02-09 Cornell University Angle sensitive pixel (asp)-based image processing system, method, and applications
KR101904033B1 (ko) * 2010-10-27 2018-10-04 코넬 유니버시티 광 필드 이미지 센서, 방법들 및 응용들
US8610813B2 (en) * 2011-05-31 2013-12-17 Omnivision Technologies, Inc. System and method for extending depth of field in a lens system by use of color-dependent wavefront coding
EP2800380B1 (en) 2011-12-28 2018-02-28 Fujifilm Corporation Imaging device and imaging processing method
US8861850B2 (en) 2012-01-31 2014-10-14 Apple Inc. Digital image color correction
WO2013179538A1 (ja) 2012-05-28 2013-12-05 パナソニック株式会社 奥行き推定撮像装置
JP2015037102A (ja) 2013-08-12 2015-02-23 株式会社東芝 固体撮像装置
US9515113B2 (en) 2013-08-27 2016-12-06 Rambus Inc. Optical sensing of nearby scenes with tessellated phase anti-symmetric gratings
KR102308388B1 (ko) 2013-12-20 2021-10-05 코닌클리케 필립스 엔.브이. 무안경식 디스플레이 디바이스
CN105121365B (zh) 2014-02-21 2017-09-19 安瀚视特控股株式会社 玻璃板的制造方法及玻璃板的制造装置
US9426383B1 (en) * 2014-06-20 2016-08-23 Amazon Technologies, Inc. Digital camera for capturing spectral and spatial information
JP6595161B2 (ja) 2014-07-31 2019-10-23 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、画像処理方法、及び、撮像装置
EP3113475B1 (en) * 2015-06-30 2018-12-19 Thomson Licensing An apparatus and a method for modifying colours of a focal stack of a scene according to a colour palette
EP3113478A1 (en) 2015-06-30 2017-01-04 Thomson Licensing Plenoptic foveated camera
EP3466052B1 (en) * 2016-06-07 2025-02-19 Airy3d Inc. Light field imaging device and method for depth acquisition and three-dimensional imaging
KR102543392B1 (ko) * 2017-12-05 2023-06-13 애어리3디 인크. 깊이 획득을 위한 명시야 이미지 처리 방법

Also Published As

Publication number Publication date
EP3721621A4 (en) 2021-08-25
EP3721621B1 (en) 2025-07-23
WO2019109182A1 (en) 2019-06-13
KR102543392B1 (ko) 2023-06-13
JP2021506168A (ja) 2021-02-18
CN111670576B (zh) 2022-10-25
CA3084679A1 (en) 2019-06-13
US11438571B2 (en) 2022-09-06
KR20200112825A (ko) 2020-10-05
JP7245835B2 (ja) 2023-03-24
TW201925860A (zh) 2019-07-01
EP3721621A1 (en) 2020-10-14
US20200359004A1 (en) 2020-11-12
CN111670576A (zh) 2020-09-15

Similar Documents

Publication Publication Date Title
CA3084679C (en) Light field image processing method for depth acquisition
US12474509B2 (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
US12259563B2 (en) Light field imaging device and method for 3D sensing
CN103155544B (zh) 基于角度敏感像素（asp）的图像处理系统、处理方法和应用
CA2979836C (en) Depth field imaging apparatus, methods, and applications
US20240147032A1 (en) Imaging device and optical element
WO2022104467A1 (en) Diffraction-grating-based systems and methods for stereoscopic and multiscopic imaging
KR20230113110A (ko) 렌즈리스 카메라를 이용한 스냅샷 기반 초분광 이미지 획득 장치 및 방법
US20240412563A1 (en) Methods and systems using depth imaging for training and deploying neural networks for biometric anti-spoofing
Rueda et al. Compressive spectral imaging based on colored coded apertures
CA3026789C (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
Wang et al. Angle-sensitive pixels: a new paradigm for low-power, low-cost 2D and 3D sensing
US20240012262A1 (en) Imaging systems and methods for dual depth and polarization sensing
Shi Task-specific Computational Cameras
WO2025245172A1 (en) Split-aperture 2-in-1 computational imaging devices
EP4623587A1 (en) Edge angle and baseline angle correction in depth imaging

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220816

EEER Examination request

Effective date: 20220816

EEER Examination request

Effective date: 20220816

EEER Examination request

Effective date: 20220816

EEER Examination request

Effective date: 20220816