JP7245835B2 - 奥行取得のためのライトフィールド画像処理方法 - Google Patents

奥行取得のためのライトフィールド画像処理方法 Download PDF

Info

Publication number
JP7245835B2
JP7245835B2 JP2020530983A JP2020530983A JP7245835B2 JP 7245835 B2 JP7245835 B2 JP 7245835B2 JP 2020530983 A JP2020530983 A JP 2020530983A JP 2020530983 A JP2020530983 A JP 2020530983A JP 7245835 B2 JP7245835 B2 JP 7245835B2
Authority
JP
Japan
Prior art keywords
color
primary
pixel
grating
wavefront
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020530983A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021506168A (ja
JP2021506168A5 (enExample
Inventor
ジョナサン イコラ サーリ、
ジ－ホ チョ，
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Airy3d Inc
Original Assignee
Airy3d Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Airy3d Inc filed Critical Airy3d Inc
Publication of JP2021506168A publication Critical patent/JP2021506168A/ja
Publication of JP2021506168A5 publication Critical patent/JP2021506168A5/ja
Application granted granted Critical
Publication of JP7245835B2 publication Critical patent/JP7245835B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/257—Colour aspects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Optical Elements Other Than Lenses (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Color Television Image Signal Generators (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
JP2020530983A 2017-12-05 2018-12-05 奥行取得のためのライトフィールド画像処理方法 Active JP7245835B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762594718P 2017-12-05 2017-12-05
US62/594,718 2017-12-05
PCT/CA2018/051554 WO2019109182A1 (en) 2017-12-05 2018-12-05 Light field image processing method for depth acquisition

Publications (3)

Publication Number Publication Date
JP2021506168A JP2021506168A (ja) 2021-02-18
JP2021506168A5 JP2021506168A5 (enExample) 2022-01-11
JP7245835B2 true JP7245835B2 (ja) 2023-03-24

Family

ID=66750041

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020530983A Active JP7245835B2 (ja) 2017-12-05 2018-12-05 奥行取得のためのライトフィールド画像処理方法

Country Status (8)

Country Link
US (1) US11438571B2 (enExample)
EP (1) EP3721621B1 (enExample)
JP (1) JP7245835B2 (enExample)
KR (1) KR102543392B1 (enExample)
CN (1) CN111670576B (enExample)
CA (1) CA3084679C (enExample)
TW (1) TW201925860A (enExample)
WO (1) WO2019109182A1 (enExample)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017210781A1 (en) * 2016-06-07 2017-12-14 Airy3D Inc. Light field imaging device and method for depth acquisition and three-dimensional imaging
IL251636B (en) 2017-04-06 2018-02-28 Yoav Berlatzky Coherence camera system and method thereof
TW201925860A (zh) * 2017-12-05 2019-07-01 加拿大商艾瑞３Ｄ股份有限公司 用於深度獲取之光場影像處理方法
EP3522106A1 (en) * 2018-01-31 2019-08-07 InterDigital CE Patent Holdings A filter array enabling easy demosaicing
KR102513680B1 (ko) * 2018-06-08 2023-03-24 엘지이노텍 주식회사 카메라 모듈 및 그의 깊이 정보 추출 방법
US11686935B2 (en) * 2019-01-29 2023-06-27 Meta Platforms Technologies, Llc Interferometric structured illumination for depth determination
EP3981143A4 (en) 2019-06-05 2023-07-26 Airy3d Inc. Light field imaging device and method for 3d sensing
CN110398477B (zh) * 2019-07-03 2022-06-24 香港光云科技有限公司 材质分类及识别方法
CN110928035A (zh) * 2019-12-20 2020-03-27 京东方科技集团股份有限公司 一种显示装置
US11704929B2 (en) * 2020-07-06 2023-07-18 Visera Technologies Company Limited Optical structure and method of fabricating the same
WO2022016412A1 (zh) * 2020-07-22 2022-01-27 深圳市汇顶科技股份有限公司 深度信息图像采集装置和电子设备
US11741748B2 (en) * 2020-10-14 2023-08-29 Shenzhen GOODIX Technology Co., Ltd. Passive image depth sensing for object verification based on chromatic differentiation
US12429702B2 (en) * 2020-11-10 2025-09-30 Airy3D Inc. Imaging systems and methods for dual depth and polarization sensing
WO2022104467A1 (en) * 2020-11-20 2022-05-27 Airy3D Inc. Diffraction-grating-based systems and methods for stereoscopic and multiscopic imaging
US11740471B2 (en) 2020-12-04 2023-08-29 Meta Platforms Technologies, Llc Display device with transparent illuminator
US20220179147A1 (en) * 2020-12-04 2022-06-09 Facebook Technologies, Llc Patterned backlight for display panel
EP4278147A4 (en) 2021-01-15 2024-12-11 Airy3d Inc. DETERMINATION OF LENS POSITION IN DEPTH IMAGING
WO2022155747A1 (en) * 2021-01-22 2022-07-28 Airy3D Inc. Power management techniques in depth imaging
KR102325647B1 (ko) 2021-08-04 2021-11-12 파이어슈라이크게임즈 주식회사 라이트맵 기반 모바일 게임의 3d 객체 데이터 처리 방법, 장치 및 시스템
US11832001B2 (en) * 2021-12-20 2023-11-28 Visera Technologies Company Limited Image processing method and image processing system
US11683604B1 (en) * 2022-02-23 2023-06-20 Omnivision Technologies, Inc. Circuit and method for image artifact reduction in high-density, highpixel-count, image sensor with phase detection autofocus
CN115166993B (zh) * 2022-05-31 2023-11-10 北京邮电大学 自适应三维光场显示方法及系统
CN115272584B (zh) * 2022-08-03 2025-07-25 清华大学深圳国际研究生院 一种光场显微系统的多色同步重建方法
TWI837061B (zh) * 2023-09-06 2024-03-21 國立中山大學 利用彩色條紋投影技術進行三維形貌量測的系統及方法
KR102870535B1 (ko) 2024-03-06 2025-10-13 경희대학교 산학협력단 다초점 이미지 분석을 통한 라이트 필드 획득 방법 및 라이트 필드 획득을 위한 광학계 시스템
CN120010086B (zh) * 2025-04-17 2025-07-25 深圳市永泰光电有限公司 光学镜头自动聚焦系统及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011002387A (ja) 2009-06-19 2011-01-06 Canon Inc 画像処理装置および画像処理方法
US20110174998A1 (en) 2008-07-25 2011-07-21 Cornell University Light field image sensor, method and applications
WO2013179538A1 (ja) 2012-05-28 2013-12-05 パナソニック株式会社 奥行き推定撮像装置
JP2017017690A (ja) 2015-06-30 2017-01-19 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ プレンオプティック・フォービエイテッド・カメラ

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR0120397B1 (ko) 1992-04-28 1997-10-22 나카무라 히사오 화상표시장치
US5675407A (en) * 1995-03-02 1997-10-07 Zheng Jason Geng Color ranging method for high speed low-cost three dimensional surface profile measurement
KR100416548B1 (ko) * 2001-10-10 2004-02-05 삼성전자주식회사 3차원 영상 표시장치
US20060072005A1 (en) * 2004-10-06 2006-04-06 Thomas-Wayne Patty J Method and apparatus for 3-D electron holographic visual and audio scene propagation in a video or cinematic arena, digitally processed, auto language tracking
EP1932050A2 (en) * 2005-09-14 2008-06-18 Mirage Innovations Ltd. Diffractive optical device and system
US7456881B2 (en) * 2006-01-12 2008-11-25 Aptina Imaging Corporation Method and apparatus for producing Bayer color mosaic interpolation for imagers
EP2016620A2 (en) 2006-04-17 2009-01-21 Omnivision Cdm Optics, Inc. Arrayed imaging systems and associated methods
FR2917845B1 (fr) * 2007-06-19 2011-08-19 Christophe Brossier Procede de visualisation d'une sequence d'images produisant une sensation de relief
US8809758B2 (en) 2008-07-25 2014-08-19 Cornell University Light field image sensor with an angle-sensitive pixel (ASP) device
US8289440B2 (en) * 2008-12-08 2012-10-16 Lytro, Inc. Light field data acquisition devices, and methods of using and manufacturing same
US20110013056A1 (en) 2009-07-17 2011-01-20 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Color filters and demosaicing techniques for digital imaging
KR101790601B1 (ko) 2010-08-03 2017-10-26 코넬 유니버시티 각 감지 픽셀(asp)에 기초한 이미지 처리 시스템, 방법, 및 응용들
KR101904033B1 (ko) * 2010-10-27 2018-10-04 코넬 유니버시티 광 필드 이미지 센서, 방법들 및 응용들
US8610813B2 (en) * 2011-05-31 2013-12-17 Omnivision Technologies, Inc. System and method for extending depth of field in a lens system by use of color-dependent wavefront coding
CN104025583B (zh) * 2011-12-28 2016-10-19 富士胶片株式会社 图像处理装置、方法及摄像装置
US8861850B2 (en) * 2012-01-31 2014-10-14 Apple Inc. Digital image color correction
JP2015037102A (ja) 2013-08-12 2015-02-23 株式会社東芝 固体撮像装置
US9515113B2 (en) 2013-08-27 2016-12-06 Rambus Inc. Optical sensing of nearby scenes with tessellated phase anti-symmetric gratings
CN105849623B (zh) 2013-12-20 2019-09-10 皇家飞利浦有限公司 自动立体显示设备
KR101755136B1 (ko) 2014-02-21 2017-07-06 아반스트레이트 가부시키가이샤 유리판의 제조 방법 및 유리판의 제조 장치
US9426383B1 (en) * 2014-06-20 2016-08-23 Amazon Technologies, Inc. Digital camera for capturing spectral and spatial information
JP6595161B2 (ja) * 2014-07-31 2019-10-23 ソニーセミコンダクタソリューションズ株式会社 画像処理装置、画像処理方法、及び、撮像装置
EP3113475B1 (en) * 2015-06-30 2018-12-19 Thomson Licensing An apparatus and a method for modifying colours of a focal stack of a scene according to a colour palette
WO2017210781A1 (en) * 2016-06-07 2017-12-14 Airy3D Inc. Light field imaging device and method for depth acquisition and three-dimensional imaging
TW201925860A (zh) * 2017-12-05 2019-07-01 加拿大商艾瑞３Ｄ股份有限公司 用於深度獲取之光場影像處理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110174998A1 (en) 2008-07-25 2011-07-21 Cornell University Light field image sensor, method and applications
JP2011002387A (ja) 2009-06-19 2011-01-06 Canon Inc 画像処理装置および画像処理方法
WO2013179538A1 (ja) 2012-05-28 2013-12-05 パナソニック株式会社 奥行き推定撮像装置
JP2017017690A (ja) 2015-06-30 2017-01-19 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ プレンオプティック・フォービエイテッド・カメラ

Also Published As

Publication number Publication date
EP3721621A4 (en) 2021-08-25
KR20200112825A (ko) 2020-10-05
EP3721621A1 (en) 2020-10-14
TW201925860A (zh) 2019-07-01
JP2021506168A (ja) 2021-02-18
EP3721621B1 (en) 2025-07-23
KR102543392B1 (ko) 2023-06-13
CA3084679C (en) 2023-03-07
WO2019109182A1 (en) 2019-06-13
CN111670576B (zh) 2022-10-25
US20200359004A1 (en) 2020-11-12
CA3084679A1 (en) 2019-06-13
US11438571B2 (en) 2022-09-06
CN111670576A (zh) 2020-09-15

Similar Documents

Publication Publication Date Title
JP7245835B2 (ja) 奥行取得のためのライトフィールド画像処理方法
US12474509B2 (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
US12259563B2 (en) Light field imaging device and method for 3D sensing
Liang Punching holes in light: recent progress in single-shot coded-aperture optical imaging
CN103155544B (zh) 基于角度敏感像素（asp）的图像处理系统、处理方法和应用
CN104121990A (zh) 基于随机光栅的压缩感知宽波段高光谱成像系统
WO2022104467A1 (en) Diffraction-grating-based systems and methods for stereoscopic and multiscopic imaging
KR20230113110A (ko) 렌즈리스 카메라를 이용한 스냅샷 기반 초분광 이미지 획득 장치 및 방법
US20240412563A1 (en) Methods and systems using depth imaging for training and deploying neural networks for biometric anti-spoofing
Rueda et al. Compressive spectral imaging based on colored coded apertures
US12429702B2 (en) Imaging systems and methods for dual depth and polarization sensing
Wang et al. Angle-sensitive pixels: a new paradigm for low-power, low-cost 2D and 3D sensing
CA3026789C (en) Light field imaging device and method for depth acquisition and three-dimensional imaging
EP4623587A1 (en) Edge angle and baseline angle correction in depth imaging
Chen Efficient Machine Vision Using Computational Cameras

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211201

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211201

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20221117

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221130

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230221

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230308

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230313

R150 Certificate of patent or registration of utility model

Ref document number: 7245835

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150