KR102354260B1 - 광 필드 데이터 처리 방법 및 디바이스 - Google Patents

광 필드 데이터 처리 방법 및 디바이스 Download PDF

Info

Publication number
KR102354260B1
KR102354260B1 KR1020170031143A KR20170031143A KR102354260B1 KR 102354260 B1 KR102354260 B1 KR 102354260B1 KR 1020170031143 A KR1020170031143 A KR 1020170031143A KR 20170031143 A KR20170031143 A KR 20170031143A KR 102354260 B1 KR102354260 B1 KR 102354260B1
Authority
KR
South Korea
Prior art keywords
ray
group
light field
rays
field data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020170031143A
Other languages
English (en)
Korean (ko)
Other versions
KR20170106931A (ko
Inventor
뉴스 사베떼르
마띠유 오그
크리스틴 귀유모
Original Assignee
인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 filed Critical 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Publication of KR20170106931A publication Critical patent/KR20170106931A/ko
Application granted granted Critical
Publication of KR102354260B1 publication Critical patent/KR102354260B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B3/00—Simple or compound lenses
    • G02B3/0006—Arrays
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/11—Region-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/162—Segmentation; Edge detection involving graph-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10052—Images from lightfield camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
KR1020170031143A 2016-03-14 2017-03-13 광 필드 데이터 처리 방법 및 디바이스 Active KR102354260B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16305273.1 2016-03-14
EP16305273.1A EP3220351A1 (en) 2016-03-14 2016-03-14 Method and device for processing lightfield data

Publications (2)

Publication Number Publication Date
KR20170106931A KR20170106931A (ko) 2017-09-22
KR102354260B1 true KR102354260B1 (ko) 2022-01-21

Family

ID=55642383

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170031143A Active KR102354260B1 (ko) 2016-03-14 2017-03-13 광 필드 데이터 처리 방법 및 디바이스

Country Status (5)

Country Link
US (1) US10055856B2 (https=)
EP (2) EP3220351A1 (https=)
JP (1) JP6847718B6 (https=)
KR (1) KR102354260B1 (https=)
CN (1) CN107194965B (https=)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10298834B2 (en) 2006-12-01 2019-05-21 Google Llc Video refocusing
US9858649B2 (en) 2015-09-30 2018-01-02 Lytro, Inc. Depth-based image blurring
US10334151B2 (en) 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images
US10440407B2 (en) 2017-05-09 2019-10-08 Google Llc Adaptive control for immersive experience delivery
US10419737B2 (en) 2015-04-15 2019-09-17 Google Llc Data structures and delivery methods for expediting virtual reality playback
US10540818B2 (en) 2015-04-15 2020-01-21 Google Llc Stereo image generation and interactive playback
US10341632B2 (en) 2015-04-15 2019-07-02 Google Llc. Spatial random access enabled video system with a three-dimensional viewing volume
US10412373B2 (en) 2015-04-15 2019-09-10 Google Llc Image capture for virtual reality displays
US10565734B2 (en) 2015-04-15 2020-02-18 Google Llc Video capture, processing, calibration, computational fiber artifact removal, and light-field pipeline
US10469873B2 (en) 2015-04-15 2019-11-05 Google Llc Encoding and decoding virtual reality video
US11328446B2 (en) 2015-04-15 2022-05-10 Google Llc Combining light-field data with active depth data for depth map generation
US10275898B1 (en) 2015-04-15 2019-04-30 Google Llc Wedge-based light-field video capture
US10444931B2 (en) 2017-05-09 2019-10-15 Google Llc Vantage generation and interactive playback
US10546424B2 (en) 2015-04-15 2020-01-28 Google Llc Layered content delivery for virtual and augmented reality experiences
US10567464B2 (en) 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US9979909B2 (en) 2015-07-24 2018-05-22 Lytro, Inc. Automatic lens flare detection and correction for light-field images
US10275892B2 (en) 2016-06-09 2019-04-30 Google Llc Multi-view scene segmentation and propagation
US10679361B2 (en) 2016-12-05 2020-06-09 Google Llc Multi-view rotoscope contour propagation
US9900510B1 (en) * 2016-12-08 2018-02-20 Lytro, Inc. Motion blur for light-field images
US10594945B2 (en) 2017-04-03 2020-03-17 Google Llc Generating dolly zoom effect using light field image data
US10474227B2 (en) 2017-05-09 2019-11-12 Google Llc Generation of virtual reality with 6 degrees of freedom from limited viewer data
US10354399B2 (en) 2017-05-25 2019-07-16 Google Llc Multi-view back-projection to a light-field
US10545215B2 (en) 2017-09-13 2020-01-28 Google Llc 4D camera tracking and optical stabilization
US10776995B2 (en) * 2017-10-17 2020-09-15 Nvidia Corporation Light fields as better backgrounds in rendering
EP3493155A1 (en) * 2017-12-01 2019-06-05 Thomson Licensing Surface color segmentation
CN112105976B (zh) 2018-01-14 2022-12-09 光场实验室公司 能量场三维打印系统
US10965862B2 (en) 2018-01-18 2021-03-30 Google Llc Multi-camera navigation interface
US10678056B2 (en) * 2018-02-26 2020-06-09 Google Llc Augmented reality light field head-mounted displays
EP3579561A1 (en) * 2018-06-05 2019-12-11 InterDigital VC Holdings, Inc. Prediction for light-field coding and decoding
EP3824621B1 (en) 2018-07-19 2025-06-11 Activ Surgical, Inc. Systems and methods for multi-modal sensing of depth in vision systems for automated surgical robots
CN109360235B (zh) * 2018-09-29 2022-07-19 中国航空工业集团公司上海航空测控技术研究所 一种基于光场数据的混合深度估计方法
EP3902458A4 (en) 2018-12-28 2022-09-21 Activ Surgical, Inc. USER INTERFACE ELEMENTS TO ALIGN A REMOTE CAMERA DURING OPERATIONS
JP2022516473A (ja) 2018-12-28 2022-02-28 アクティブ サージカル， インコーポレイテッド 低侵襲性外科手術における到達性、作業空間、および巧妙さを最適化するためのシステムおよび方法
US12292564B2 (en) 2019-04-08 2025-05-06 Activ Surgical, Inc. Systems and methods for medical imaging
WO2020210168A1 (en) 2019-04-08 2020-10-15 Activ Surgical, Inc. Systems and methods for medical imaging
WO2020214821A1 (en) 2019-04-19 2020-10-22 Activ Surgical, Inc. Systems and methods for trocar kinematics
EP4017340A4 (en) 2019-08-21 2023-12-13 Activ Surgical, Inc. Systems and methods for medical imaging
CN112884877B (zh) * 2021-02-19 2025-05-16 中国科学院微电子研究所 光场显示方法、装置、电子设备及存储介质
KR102807621B1 (ko) * 2023-04-21 2025-05-22 (주) 파란텍 2d 및 3d 영상획득 카메라
CN116630134A (zh) * 2023-05-23 2023-08-22 北京拙河科技有限公司 一种光场相机图像数据多线程处理方法及装置

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7129943B2 (en) * 2002-11-15 2006-10-31 Microsoft Corporation System and method for feature-based light field morphing and texture transfer
US20130070222A1 (en) * 2011-09-19 2013-03-21 D2S, Inc. Method and System for Optimization of an Image on a Substrate to be Manufactured Using Optical Lithography
ATE551841T1 (de) * 2009-04-22 2012-04-15 Raytrix Gmbh Digitales bildgebungsverfahren zum synthetisieren eines bildes unter verwendung der mit einer plenoptischen kamera aufgezeichneten daten
KR101675961B1 (ko) * 2010-12-29 2016-11-14 삼성전자주식회사 적응적 부화소 렌더링 장치 및 방법
GB2501936B (en) 2012-05-11 2016-11-30 Canon Kk Micro lens array and imaging apparatus
US9179126B2 (en) * 2012-06-01 2015-11-03 Ostendo Technologies, Inc. Spatio-temporal light field cameras
EP2901671A4 (en) * 2012-09-28 2016-08-24 Pelican Imaging Corp GENERATING IMAGES FROM LIGHT FIELDS USING VIRTUAL VIEWPOINTS
CN103108452B (zh) * 2013-01-10 2015-01-21 北京航空航天大学 一种动态光场数据驱动的场景光照重现方法
US9786062B2 (en) * 2013-05-06 2017-10-10 Disney Enterprises, Inc. Scene reconstruction from high spatio-angular resolution light fields
US9460515B2 (en) 2013-10-25 2016-10-04 Ricoh Co., Ltd. Processing of light fields by transforming to scale and depth space
KR20160106045A (ko) * 2013-11-22 2016-09-09 비디노티 에스아 광필드 처리방법
US9305375B2 (en) 2014-03-25 2016-04-05 Lytro, Inc. High-quality post-rendering depth blur
JP2015198336A (ja) * 2014-04-01 2015-11-09 キヤノン株式会社 画像処理装置およびその制御方法、並びにプログラム
CN104156916B (zh) * 2014-07-31 2017-03-29 北京航空航天大学 一种用于场景光照恢复的光场投影方法
CN104598744B (zh) * 2015-01-27 2017-11-21 北京工业大学 一种基于光场的深度估计方法
CN104867129A (zh) 2015-04-16 2015-08-26 东南大学 一种光场图像分割方法

Also Published As

Publication number Publication date
EP3220352B1 (en) 2020-12-02
KR20170106931A (ko) 2017-09-22
EP3220351A1 (en) 2017-09-20
JP6847718B2 (ja) 2021-03-24
JP2017182796A (ja) 2017-10-05
CN107194965A (zh) 2017-09-22
EP3220352A1 (en) 2017-09-20
JP6847718B6 (ja) 2021-05-26
CN107194965B (zh) 2021-11-09
US20170263012A1 (en) 2017-09-14
US10055856B2 (en) 2018-08-21

Similar Documents

Publication Publication Date Title
KR102354260B1 (ko) 광 필드 데이터 처리 방법 및 디바이스
CN108141527B (zh) 相位检测自动聚焦算法
JP6887223B2 (ja) プレンオプティック・フォービエイテッド・カメラ
US9048153B2 (en) Three-dimensional image sensor
US20120056988A1 (en) 3-d camera
EP3094076A1 (en) Method for obtaining a refocused image from a 4D raw light field data using a shift correction parameter
US10949700B2 (en) Depth based image searching
KR102801383B1 (ko) 영상 복원 장치 및 방법
US9818199B2 (en) Method and apparatus for estimating depth of focused plenoptic data
US20210314543A1 (en) Imaging system and method
EP3224805B1 (en) Method and apparatus for estimating depth of unfocused plenoptic data
CN115035235A (zh) 三维重建方法及装置
EP2879092B1 (en) Method and device for estimating disparity associated with views of a scene acquired with a plenoptic camera
CN104184936B (zh) 基于光场相机的影像对焦处理方法及其系统
KR102644944B1 (ko) 이미지 센서 및 이미지 센싱 방법
CN115514877A (zh) 用于从多视角图像降噪的装置和方法
CN117197256B (zh) 一种标定方法、装置及电子设备
EP3200151A1 (en) Method and device for obtaining a depth map
Wang et al. Asymmetric stereo color transfer
US20240127407A1 (en) Image sensor apparatus for capturing depth information
HK40043924A (en) Method and apparatus for generating depth images, method for generating reference images, and electronic device
HK40043924B (en) Method and apparatus for generating depth images, method for generating reference images, and electronic device

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20170313

PG1501 Laying open of application
N231 Notification of change of applicant
PN2301 Change of applicant

Patent event date: 20191023

Comment text: Notification of Change of Applicant

Patent event code: PN23011R01D

A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200227

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20170313

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20210423

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20211018

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20220118

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20220119

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20250107

Start annual number: 4

End annual number: 4