KR102551274B1 - 장면의 계층적 깊이 데이터를 생성하기 위한 방법 - Google Patents

장면의 계층적 깊이 데이터를 생성하기 위한 방법 Download PDF

Info

Publication number
KR102551274B1
KR102551274B1 KR1020227010349A KR20227010349A KR102551274B1 KR 102551274 B1 KR102551274 B1 KR 102551274B1 KR 1020227010349 A KR1020227010349 A KR 1020227010349A KR 20227010349 A KR20227010349 A KR 20227010349A KR 102551274 B1 KR102551274 B1 KR 102551274B1
Authority
KR
South Korea
Prior art keywords
information
image
blocking
depth
field content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020227010349A
Other languages
English (en)
Korean (ko)
Other versions
KR20220045242A (ko
Inventor
디디에 도옌
기욤 부아송
실뱅 띠에보
Original Assignee
인터디지털 브이씨 홀딩스 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 브이씨 홀딩스 인코포레이티드 filed Critical 인터디지털 브이씨 홀딩스 인코포레이티드
Priority to KR1020237021910A priority Critical patent/KR102733983B1/ko
Publication of KR20220045242A publication Critical patent/KR20220045242A/ko
Application granted granted Critical
Publication of KR102551274B1 publication Critical patent/KR102551274B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/15—Processing image signals for colour aspects of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Image Processing (AREA)
KR1020227010349A 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법 Active KR102551274B1 (ko)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020237021910A KR102733983B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP16305933.0 2016-07-21
EP16305933.0A EP3273686A1 (en) 2016-07-21 2016-07-21 A method for generating layered depth data of a scene
KR1020197004739A KR102381462B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법
PCT/EP2017/068525 WO2018015555A1 (en) 2016-07-21 2017-07-21 A method for generating layered depth data of a scene

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020197004739A Division KR102381462B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020237021910A Division KR102733983B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법

Publications (2)

Publication Number Publication Date
KR20220045242A KR20220045242A (ko) 2022-04-12
KR102551274B1 true KR102551274B1 (ko) 2023-07-05

Family

ID=56683857

Family Applications (3)

Application Number Title Priority Date Filing Date
KR1020227010349A Active KR102551274B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법
KR1020237021910A Active KR102733983B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법
KR1020197004739A Active KR102381462B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법

Family Applications After (2)

Application Number Title Priority Date Filing Date
KR1020237021910A Active KR102733983B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법
KR1020197004739A Active KR102381462B1 (ko) 2016-07-21 2017-07-21 장면의 계층적 깊이 데이터를 생성하기 위한 방법

Country Status (7)

Country Link
US (2) US11127146B2 (enExample)
EP (2) EP3273686A1 (enExample)
JP (2) JP7184748B2 (enExample)
KR (3) KR102551274B1 (enExample)
CN (2) CN117596411A (enExample)
BR (1) BR112019001046A2 (enExample)
WO (1) WO2018015555A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene
EP3416381A1 (en) 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
EP3416371A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method for displaying, on a 2d display device, a content derived from light field data
EP3598389A1 (en) * 2018-07-19 2020-01-22 Thomson Licensing Method for detecting occlusions in an image, corresponding device and computer program product
US11252392B2 (en) * 2019-02-22 2022-02-15 Avalon Holographies Inc. Layered scene decomposition CODEC with layered depth imaging
US11562529B2 (en) * 2021-06-23 2023-01-24 Meta Platforms Technologies, Llc Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
CN115202174B (zh) * 2022-07-14 2023-11-10 浙江理工大学 基于光场图像的全息体视图获取方法、系统和应用
US20240155072A1 (en) * 2022-11-07 2024-05-09 At&T Intellectual Property I, L.P. Three-dimensional visual communication sessions
KR20250130098A (ko) * 2024-02-23 2025-09-01 삼성전자주식회사 이미지 처리 장치 및, 이미지의 인코딩 및 디코딩 방법

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ZA962306B (en) * 1995-03-22 1996-09-27 Idt Deutschland Gmbh Method and apparatus for depth modelling and providing depth information of moving objects
US7561620B2 (en) * 2004-08-03 2009-07-14 Microsoft Corporation System and process for compressing and decompressing multiple, layered, video streams employing spatial and temporal encoding
EP3104603B2 (en) * 2006-03-31 2022-06-08 Koninklijke Philips N.V. Efficient image receiver for multiple views
US7940268B2 (en) * 2007-06-29 2011-05-10 Microsoft Corporation Real-time rendering of light-scattering media
JP5575650B2 (ja) * 2007-10-11 2014-08-20 コーニンクレッカ フィリップス エヌ ヴェ 奥行きマップを処理する方法及び装置
CN102132573B (zh) * 2008-08-26 2013-10-23 皇家飞利浦电子股份有限公司 用于编码3d视频信号的方法和系统，用于编码3d视频信号的编码器，用于解码3d视频信号的方法和系统，用于解码3d视频信号的解码器
EP2180449A1 (en) * 2008-10-21 2010-04-28 Koninklijke Philips Electronics N.V. Method and device for providing a layered depth model of a scene
EP2342900A1 (en) * 2008-10-28 2011-07-13 Koninklijke Philips Electronics N.V. Generation of occlusion data for image properties
MX2011008609A (es) * 2009-02-17 2011-09-09 Koninklije Philips Electronics N V Combinar datos de imagen tridimensional y graficos.
RU2551789C2 (ru) * 2009-10-02 2015-05-27 Конинклейке Филипс Электроникс Н.В. Выбор точек обзора для формирования дополнительных видов в 3d видео
US9197799B2 (en) * 2009-10-19 2015-11-24 Pixar Super light field lens with focus control and non spherical lenslet arrays
WO2011081646A1 (en) * 2009-12-15 2011-07-07 Thomson Licensing Stereo-image quality and disparity/depth indications
KR20120049636A (ko) 2010-11-09 2012-05-17 삼성전자주식회사 영상 처리 장치 및 방법
KR20120129313A (ko) * 2011-05-19 2012-11-28 한국전자통신연구원 차이 정보를 사용한 3차원 영상 정보 전송 시스템 및 방법
KR102002165B1 (ko) * 2011-09-28 2019-07-25 포토내이션 리미티드 라이트 필드 이미지 파일의 인코딩 및 디코딩을 위한 시스템 및 방법
US9237330B2 (en) * 2012-02-21 2016-01-12 Intellectual Ventures Fund 83 Llc Forming a stereoscopic video
ITTO20120413A1 (it) * 2012-05-08 2013-11-09 Sisvel Technology Srl Metodo per la generazione e ricostruzione di un flusso video tridimensionale, basato sull'utilizzo della mappa delle occlusioni, e corrispondente dispositivo di generazione e ricostruzione.
US20150237323A1 (en) * 2012-07-23 2015-08-20 Thomlson Licensing 3d video representation using information embedding
US9092890B2 (en) * 2012-12-20 2015-07-28 Ricoh Company, Ltd. Occlusion-aware reconstruction of three-dimensional scenes from light field images
JP6150277B2 (ja) 2013-01-07 2017-06-21 国立研究開発法人情報通信研究機構 立体映像符号化装置、立体映像復号化装置、立体映像符号化方法、立体映像復号化方法、立体映像符号化プログラム及び立体映像復号化プログラム
US10062210B2 (en) * 2013-04-24 2018-08-28 Qualcomm Incorporated Apparatus and method for radiance transfer sampling for augmented reality
US9460515B2 (en) * 2013-10-25 2016-10-04 Ricoh Co., Ltd. Processing of light fields by transforming to scale and depth space
KR102156402B1 (ko) * 2013-11-05 2020-09-16 삼성전자주식회사 영상 처리 방법 및 장치
JP2016537901A (ja) 2013-11-22 2016-12-01 ヴィディノティ エスアーＶｉｄｉｎｏｔｉ Ｓａ ライトフィールド処理方法
KR101561525B1 (ko) * 2013-12-30 2015-10-20 재단법인대구경북과학기술원 스테레오 깊이 영상 생성 장치 및 방법
JP6669063B2 (ja) * 2014-05-21 2020-03-18 ソニー株式会社 画像処理装置および方法
US10567464B2 (en) * 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US10136116B2 (en) * 2016-03-07 2018-11-20 Ricoh Company, Ltd. Object segmentation from light field data
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene

Also Published As

Publication number Publication date
JP2019527425A (ja) 2019-09-26
JP7664891B2 (ja) 2025-04-18
BR112019001046A2 (pt) 2019-04-30
US20220005216A1 (en) 2022-01-06
CN109644280B (zh) 2023-10-31
US11803980B2 (en) 2023-10-31
EP3488608A1 (en) 2019-05-29
KR102381462B1 (ko) 2022-04-01
KR20220045242A (ko) 2022-04-12
JP2022174085A (ja) 2022-11-22
CN109644280A (zh) 2019-04-16
US20190385323A1 (en) 2019-12-19
KR20190032440A (ko) 2019-03-27
EP3273686A1 (en) 2018-01-24
WO2018015555A1 (en) 2018-01-25
JP7184748B2 (ja) 2022-12-06
KR102733983B1 (ko) 2024-11-26
US11127146B2 (en) 2021-09-21
KR20230106714A (ko) 2023-07-13
CN117596411A (zh) 2024-02-23

Similar Documents

Publication Publication Date Title
KR102551274B1 (ko) 장면의 계층적 깊이 데이터를 생성하기 위한 방법
CA2668941C (en) System and method for model fitting and registration of objects for 2d-to-3d conversion
KR101907945B1 (ko) 다중 시점 장면에서의 그래픽 표시
KR102156402B1 (ko) 영상 처리 방법 및 장치
JP4879326B2 (ja) ３次元画像を合成するシステム及び方法
JP7285834B2 (ja) 三次元再構成方法および三次元再構成装置
TWI547901B (zh) 模擬立體圖像顯示方法及顯示設備
Feng et al. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications
JP2010522469A (ja) ２ｄ−ｔｏ−３ｄ変換のための２ｄ画像の領域分類のシステム及び方法
US20200137376A1 (en) Method for generating a light-field 3d display unit image and a generating device
Kim et al. Generation of ROI enhanced depth maps using stereoscopic cameras and a depth camera
KR20200107217A (ko) 영상 처리 방법 및 장치
Min et al. 2D/3D freeview video generation for 3DTV system
KR101208767B1 (ko) 곡면 투사를 이용한 입체 영상 생성 방법, 장치 및 시스템, 이를 위한 기록 매체
JP6717576B2 (ja) 映像レンダリング装置及び方法
Knorr et al. An image-based rendering (ibr) approach for realistic stereo view synthesis of tv broadcast based on structure from motion
KR20110060180A (ko) 관심 객체 선택을 통한 3차원 모델 생성 방법 및 장치
JP6595878B2 (ja) 要素画像群生成装置及びそのプログラム
Schmeing et al. Depth image based rendering
Kovács et al. Analysis and optimization of pixel usage of light-field conversion from multi-camera setups to 3D light-field displays
Adhikarla et al. View synthesis for lightfield displays using region based non-linear image warping
Gurbuz et al. 3D imaging for glasses-free multiview 3D displays
EP3267682A1 (en) Multiview video encoding
Nazzar Automated detection of defects in 3D movies
Jeong Autostereoscopic 3D Display Rendering from Stereo Sequences

Legal Events

Date Code Title Description
A107 Divisional application of patent
PA0104 Divisional application for international application

St.27 status event code: A-0-1-A10-A16-div-PA0104

St.27 status event code: A-0-1-A10-A18-div-PA0104

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

PA0104 Divisional application for international application

St.27 status event code: A-0-1-A10-A16-div-PA0104

St.27 status event code: A-0-1-A10-A18-div-PA0104

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

Fee payment year number: 1

St.27 status event code: A-2-2-U10-U12-oth-PR1002

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601