JP7184748B2 - 場面の積層深度データを生成するための方法 - Google Patents

場面の積層深度データを生成するための方法 Download PDF

Info

Publication number
JP7184748B2
JP7184748B2 JP2019501966A JP2019501966A JP7184748B2 JP 7184748 B2 JP7184748 B2 JP 7184748B2 JP 2019501966 A JP2019501966 A JP 2019501966A JP 2019501966 A JP2019501966 A JP 2019501966A JP 7184748 B2 JP7184748 B2 JP 7184748B2
Authority
JP
Japan
Prior art keywords
image
content
occlusion information
scene
lightfield
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019501966A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019527425A (ja
JP2019527425A5 (enExample
Inventor
ドワイヤン，ディディエ
ボワソン，ギヨーム
シーバウド，シルヴァイン
Original Assignee
インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス， インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Publication of JP2019527425A publication Critical patent/JP2019527425A/ja
Publication of JP2019527425A5 publication Critical patent/JP2019527425A5/ja
Priority to JP2022131864A priority Critical patent/JP7664891B2/ja
Application granted granted Critical
Publication of JP7184748B2 publication Critical patent/JP7184748B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/15—Processing image signals for colour aspects of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Processing Or Creating Images (AREA)
JP2019501966A 2016-07-21 2017-07-21 場面の積層深度データを生成するための方法 Active JP7184748B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022131864A JP7664891B2 (ja) 2016-07-21 2022-08-22 場面の積層深度データを生成するための方法

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP16305933.0A EP3273686A1 (en) 2016-07-21 2016-07-21 A method for generating layered depth data of a scene
EP16305933.0 2016-07-21
PCT/EP2017/068525 WO2018015555A1 (en) 2016-07-21 2017-07-21 A method for generating layered depth data of a scene

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022131864A Division JP7664891B2 (ja) 2016-07-21 2022-08-22 場面の積層深度データを生成するための方法

Publications (3)

Publication Number Publication Date
JP2019527425A JP2019527425A (ja) 2019-09-26
JP2019527425A5 JP2019527425A5 (enExample) 2020-08-27
JP7184748B2 true JP7184748B2 (ja) 2022-12-06

Family

ID=56683857

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2019501966A Active JP7184748B2 (ja) 2016-07-21 2017-07-21 場面の積層深度データを生成するための方法
JP2022131864A Active JP7664891B2 (ja) 2016-07-21 2022-08-22 場面の積層深度データを生成するための方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022131864A Active JP7664891B2 (ja) 2016-07-21 2022-08-22 場面の積層深度データを生成するための方法

Country Status (7)

Country Link
US (2) US11127146B2 (enExample)
EP (2) EP3273686A1 (enExample)
JP (2) JP7184748B2 (enExample)
KR (3) KR102381462B1 (enExample)
CN (2) CN117596411A (enExample)
BR (1) BR112019001046A2 (enExample)
WO (1) WO2018015555A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene
EP3416381A1 (en) 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
EP3416371A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method for displaying, on a 2d display device, a content derived from light field data
EP3598389A1 (en) * 2018-07-19 2020-01-22 Thomson Licensing Method for detecting occlusions in an image, corresponding device and computer program product
US11363249B2 (en) * 2019-02-22 2022-06-14 Avalon Holographics Inc. Layered scene decomposition CODEC with transparency
US11562529B2 (en) * 2021-06-23 2023-01-24 Meta Platforms Technologies, Llc Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
CN115202174B (zh) * 2022-07-14 2023-11-10 浙江理工大学 基于光场图像的全息体视图获取方法、系统和应用
US20240155072A1 (en) * 2022-11-07 2024-05-09 At&T Intellectual Property I, L.P. Three-dimensional visual communication sessions
KR20250130098A (ko) * 2024-02-23 2025-09-01 삼성전자주식회사 이미지 처리 장치 및, 이미지의 인코딩 및 디코딩 방법

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015178217A1 (ja) 2014-05-21 2015-11-26 ソニー株式会社 画像処理装置および方法

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR19980702922A (ko) * 1995-03-22 1998-09-05 마누엘쿠베로 깊이 모델링 및 이동 물체의 깊이 정보 제공방법 및 장치
US7561620B2 (en) * 2004-08-03 2009-07-14 Microsoft Corporation System and process for compressing and decompressing multiple, layered, video streams employing spatial and temporal encoding
ES2599858T3 (es) * 2006-03-31 2017-02-03 Koninklijke Philips N.V. Codificación eficaz de múltiples vistas
US7940268B2 (en) * 2007-06-29 2011-05-10 Microsoft Corporation Real-time rendering of light-scattering media
US8447096B2 (en) * 2007-10-11 2013-05-21 Koninklijke Philips Electronics N.V. Method and device for processing a depth-map
KR20110058844A (ko) * 2008-08-26 2011-06-01 코닌클리케 필립스 일렉트로닉스 엔.브이. ３ｄ 비디오 신호를 인코딩하기 위한 방법 및 시스템, ３―ｄ 비디오 신호, 인코딩된 ３ｄ 비디오 신호를 인코딩하기 위한 인코더, ３ｄ 비디오 신호를 디코딩하기 위한 방법 및 시스템, ３ｄ 비디오 신호를 디코딩하기 위한 디코더
EP2180449A1 (en) 2008-10-21 2010-04-28 Koninklijke Philips Electronics N.V. Method and device for providing a layered depth model of a scene
US20110205226A1 (en) * 2008-10-28 2011-08-25 Koninklijke Philips Electronics N.V. Generation of occlusion data for image properties
CN102318352B (zh) * 2009-02-17 2014-12-10 皇家飞利浦电子股份有限公司 组合3d图像和图形数据
JP5859441B2 (ja) * 2009-10-02 2016-02-10 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． ３ｄビデオにおける追加のビューを生成するための視点の選択
US9197799B2 (en) * 2009-10-19 2015-11-24 Pixar Super light field lens with focus control and non spherical lenslet arrays
US9030530B2 (en) * 2009-12-15 2015-05-12 Thomson Licensing Stereo-image quality and disparity/depth indications
KR20120049636A (ko) 2010-11-09 2012-05-17 삼성전자주식회사 영상 처리 장치 및 방법
KR20120129313A (ko) * 2011-05-19 2012-11-28 한국전자통신연구원 차이 정보를 사용한 3차원 영상 정보 전송 시스템 및 방법
CN104081414B (zh) * 2011-09-28 2017-08-01 Fotonation开曼有限公司 用于编码和解码光场图像文件的系统及方法
US9237330B2 (en) * 2012-02-21 2016-01-12 Intellectual Ventures Fund 83 Llc Forming a stereoscopic video
ITTO20120413A1 (it) * 2012-05-08 2013-11-09 Sisvel Technology Srl Metodo per la generazione e ricostruzione di un flusso video tridimensionale, basato sull'utilizzo della mappa delle occlusioni, e corrispondente dispositivo di generazione e ricostruzione.
WO2014015460A1 (en) * 2012-07-23 2014-01-30 Thomson Licensing 3d video representation using information embedding
US9092890B2 (en) * 2012-12-20 2015-07-28 Ricoh Company, Ltd. Occlusion-aware reconstruction of three-dimensional scenes from light field images
JP6150277B2 (ja) * 2013-01-07 2017-06-21 国立研究開発法人情報通信研究機構 立体映像符号化装置、立体映像復号化装置、立体映像符号化方法、立体映像復号化方法、立体映像符号化プログラム及び立体映像復号化プログラム
US10062210B2 (en) * 2013-04-24 2018-08-28 Qualcomm Incorporated Apparatus and method for radiance transfer sampling for augmented reality
US9460515B2 (en) * 2013-10-25 2016-10-04 Ricoh Co., Ltd. Processing of light fields by transforming to scale and depth space
KR102156402B1 (ko) * 2013-11-05 2020-09-16 삼성전자주식회사 영상 처리 방법 및 장치
JP2016537901A (ja) 2013-11-22 2016-12-01 ヴィディノティ エスアーＶｉｄｉｎｏｔｉ Ｓａ ライトフィールド処理方法
KR101561525B1 (ko) 2013-12-30 2015-10-20 재단법인대구경북과학기술원 스테레오 깊이 영상 생성 장치 및 방법
US10567464B2 (en) * 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US10136116B2 (en) * 2016-03-07 2018-11-20 Ricoh Company, Ltd. Object segmentation from light field data
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015178217A1 (ja) 2014-05-21 2015-11-26 ソニー株式会社 画像処理装置および方法

Also Published As

Publication number Publication date
EP3273686A1 (en) 2018-01-24
WO2018015555A1 (en) 2018-01-25
BR112019001046A2 (pt) 2019-04-30
CN109644280B (zh) 2023-10-31
KR20230106714A (ko) 2023-07-13
CN117596411A (zh) 2024-02-23
KR20220045242A (ko) 2022-04-12
EP3488608A1 (en) 2019-05-29
KR20190032440A (ko) 2019-03-27
KR102551274B1 (ko) 2023-07-05
US20190385323A1 (en) 2019-12-19
US11127146B2 (en) 2021-09-21
CN109644280A (zh) 2019-04-16
JP2019527425A (ja) 2019-09-26
JP7664891B2 (ja) 2025-04-18
US20220005216A1 (en) 2022-01-06
JP2022174085A (ja) 2022-11-22
US11803980B2 (en) 2023-10-31
KR102733983B1 (ko) 2024-11-26
KR102381462B1 (ko) 2022-04-01

Similar Documents

Publication Publication Date Title
JP7664891B2 (ja) 場面の積層深度データを生成するための方法
US10540773B2 (en) System and method for infinite smoothing of image sequences
US9237330B2 (en) Forming a stereoscopic video
CN104205826B (zh) 用于重建高密度三维图像的设备和方法
Feng et al. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications
TWI547901B (zh) 模擬立體圖像顯示方法及顯示設備
US8611642B2 (en) Forming a steroscopic image using range map
WO2013074561A1 (en) Modifying the viewpoint of a digital image
JP7285834B2 (ja) 三次元再構成方法および三次元再構成装置
Jang et al. Efficient disparity map estimation using occlusion handling for various 3D multimedia applications
KR20130107840A (ko) 실감 파노라마 영상 생성을 위한 3ｄ 데이터 포맷 생성／소비 장치 및 방법
JPWO2012056686A1 (ja) ３次元画像補間装置、３次元撮像装置および３次元画像補間方法
Cheng et al. Spatio-temporally consistent novel view synthesis algorithm from video-plus-depth sequences for autostereoscopic displays
Knorr et al. An image-based rendering (ibr) approach for realistic stereo view synthesis of tv broadcast based on structure from motion
Cooke Image-based rendering for teleconference systems
Lee et al. Automatic 2d-to-3d conversion using multi-scale deep neural network
Liao et al. Stereo matching and viewpoint synthesis FPGA implementation
Lin et al. Spatio-temporally consistent multi-view video synthesis for autostereoscopic displays
KR20190072742A (ko) 캘리브레이션된 멀티 카메라 입력 기반 실시간 초다시점 중간시점 영상 합성 방법 및 시스템
JP2024062935A (ja) 立体視表示コンテンツを生成する方法および装置
Kang et al. Efficient disparity map generation for moving multi-camera system using TOF depth sensor
Kim et al. A study on real-time implementation of the view interpolation system
Choi et al. Multi-View Stereoscopic Image Synthesis Algorithm for 3DTV
Lee et al. Generation of Multiple Depth Images from a Single Depth Map Using Multi-baseline Information

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200720

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200720

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210827

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210901

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20211118

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20220420

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220822

C60 Trial request (containing other claim documents, opposition documents)

Free format text: JAPANESE INTERMEDIATE CODE: C60

Effective date: 20220822

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20220908

C21 Notice of transfer of a case for reconsideration by examiners before appeal proceedings

Free format text: JAPANESE INTERMEDIATE CODE: C21

Effective date: 20220909

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20221101

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20221124

R150 Certificate of patent or registration of utility model

Ref document number: 7184748

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250