CN117596411A - 生成场景的分层深度数据的方法、装置和计算机可读介质 - Google Patents

生成场景的分层深度数据的方法、装置和计算机可读介质 Download PDF

Info

Publication number
CN117596411A
CN117596411A CN202311314322.9A CN202311314322A CN117596411A CN 117596411 A CN117596411 A CN 117596411A CN 202311314322 A CN202311314322 A CN 202311314322A CN 117596411 A CN117596411 A CN 117596411A
Authority
CN
China
Prior art keywords
light field
occlusion information
generating
reference view
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311314322.9A
Other languages
English (en)
Chinese (zh)
Inventor
D·多延
G·博伊森
S·蒂鲍德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital VC Holdings Inc
Original Assignee
InterDigital VC Holdings Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by InterDigital VC Holdings Inc filed Critical InterDigital VC Holdings Inc
Publication of CN117596411A publication Critical patent/CN117596411A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/557—Depth or shape recovery from multiple images from light fields, e.g. from plenoptic cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/128—Adjusting depth or disparity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/15—Processing image signals for colour aspects of image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/207—Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/232—Image signal generators using stereoscopic image cameras using a single 2D image sensor using fly-eye lenses, e.g. arrangements of circular lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G06T15/205—Image-based rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/003—Aspects relating to the "2D+depth" image format

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Image Processing (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
CN202311314322.9A 2016-07-21 2017-07-21 生成场景的分层深度数据的方法、装置和计算机可读介质 Pending CN117596411A (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
EP16305933.0 2016-07-21
EP16305933.0A EP3273686A1 (en) 2016-07-21 2016-07-21 A method for generating layered depth data of a scene
CN201780051484.4A CN109644280B (zh) 2016-07-21 2017-07-21 生成场景的分层深度数据的方法
PCT/EP2017/068525 WO2018015555A1 (en) 2016-07-21 2017-07-21 A method for generating layered depth data of a scene

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201780051484.4A Division CN109644280B (zh) 2016-07-21 2017-07-21 生成场景的分层深度数据的方法

Publications (1)

Publication Number Publication Date
CN117596411A true CN117596411A (zh) 2024-02-23

Family

ID=56683857

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202311314322.9A Pending CN117596411A (zh) 2016-07-21 2017-07-21 生成场景的分层深度数据的方法、装置和计算机可读介质
CN201780051484.4A Active CN109644280B (zh) 2016-07-21 2017-07-21 生成场景的分层深度数据的方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201780051484.4A Active CN109644280B (zh) 2016-07-21 2017-07-21 生成场景的分层深度数据的方法

Country Status (7)

Country Link
US (2) US11127146B2 (enExample)
EP (2) EP3273686A1 (enExample)
JP (2) JP7184748B2 (enExample)
KR (3) KR102381462B1 (enExample)
CN (2) CN117596411A (enExample)
BR (1) BR112019001046A2 (enExample)
WO (1) WO2018015555A1 (enExample)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene
EP3416371A1 (en) * 2017-06-12 2018-12-19 Thomson Licensing Method for displaying, on a 2d display device, a content derived from light field data
EP3416381A1 (en) 2017-06-12 2018-12-19 Thomson Licensing Method and apparatus for providing information to a user observing a multi view content
EP3598389A1 (en) * 2018-07-19 2020-01-22 Thomson Licensing Method for detecting occlusions in an image, corresponding device and computer program product
US11252392B2 (en) * 2019-02-22 2022-02-15 Avalon Holographies Inc. Layered scene decomposition CODEC with layered depth imaging
US11562529B2 (en) * 2021-06-23 2023-01-24 Meta Platforms Technologies, Llc Generating and modifying an artificial reality environment using occlusion surfaces at predetermined distances
CN115202174B (zh) * 2022-07-14 2023-11-10 浙江理工大学 基于光场图像的全息体视图获取方法、系统和应用
US20240155072A1 (en) * 2022-11-07 2024-05-09 At&T Intellectual Property I, L.P. Three-dimensional visual communication sessions
KR20250130098A (ko) * 2024-02-23 2025-09-01 삼성전자주식회사 이미지 처리 장치 및, 이미지의 인코딩 및 디코딩 방법

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU6726596A (en) * 1995-03-22 1996-10-08 Idt International Digital Technologies Deutschland Gmbh Method and apparatus for depth modelling and providing depth information of moving objects
US7561620B2 (en) * 2004-08-03 2009-07-14 Microsoft Corporation System and process for compressing and decompressing multiple, layered, video streams employing spatial and temporal encoding
TR201810139T4 (tr) * 2006-03-31 2018-08-27 Koninklijke Philips Nv Çoklu görünümler için etkili görüntü alıcısı.
US7940268B2 (en) * 2007-06-29 2011-05-10 Microsoft Corporation Real-time rendering of light-scattering media
KR101484487B1 (ko) * 2007-10-11 2015-01-28 코닌클리케 필립스 엔.브이. 깊이-맵을 프로세싱하는 방법 및 디바이스
KR20110058844A (ko) * 2008-08-26 2011-06-01 코닌클리케 필립스 일렉트로닉스 엔.브이. ３ｄ 비디오 신호를 인코딩하기 위한 방법 및 시스템, ３―ｄ 비디오 신호, 인코딩된 ３ｄ 비디오 신호를 인코딩하기 위한 인코더, ３ｄ 비디오 신호를 디코딩하기 위한 방법 및 시스템, ３ｄ 비디오 신호를 디코딩하기 위한 디코더
EP2180449A1 (en) 2008-10-21 2010-04-28 Koninklijke Philips Electronics N.V. Method and device for providing a layered depth model of a scene
WO2010049850A1 (en) * 2008-10-28 2010-05-06 Koninklijke Philips Electronics N.V. Generation of occlusion data for image properties
RU2538335C2 (ru) * 2009-02-17 2015-01-10 Конинклейке Филипс Электроникс Н.В. Объединение данных 3d изображения и графических данных
CN102549507B (zh) * 2009-10-02 2014-08-20 皇家飞利浦电子股份有限公司 选择视点用于在3d视频中生成附加视图
US9197799B2 (en) * 2009-10-19 2015-11-24 Pixar Super light field lens with focus control and non spherical lenslet arrays
US9030530B2 (en) * 2009-12-15 2015-05-12 Thomson Licensing Stereo-image quality and disparity/depth indications
KR20120049636A (ko) 2010-11-09 2012-05-17 삼성전자주식회사 영상 처리 장치 및 방법
KR20120129313A (ko) * 2011-05-19 2012-11-28 한국전자통신연구원 차이 정보를 사용한 3차원 영상 정보 전송 시스템 및 방법
CN104081414B (zh) * 2011-09-28 2017-08-01 Fotonation开曼有限公司 用于编码和解码光场图像文件的系统及方法
US9237330B2 (en) * 2012-02-21 2016-01-12 Intellectual Ventures Fund 83 Llc Forming a stereoscopic video
ITTO20120413A1 (it) * 2012-05-08 2013-11-09 Sisvel Technology Srl Metodo per la generazione e ricostruzione di un flusso video tridimensionale, basato sull'utilizzo della mappa delle occlusioni, e corrispondente dispositivo di generazione e ricostruzione.
WO2014015460A1 (en) * 2012-07-23 2014-01-30 Thomson Licensing 3d video representation using information embedding
US9092890B2 (en) * 2012-12-20 2015-07-28 Ricoh Company, Ltd. Occlusion-aware reconstruction of three-dimensional scenes from light field images
JP6150277B2 (ja) 2013-01-07 2017-06-21 国立研究開発法人情報通信研究機構 立体映像符号化装置、立体映像復号化装置、立体映像符号化方法、立体映像復号化方法、立体映像符号化プログラム及び立体映像復号化プログラム
US10062210B2 (en) * 2013-04-24 2018-08-28 Qualcomm Incorporated Apparatus and method for radiance transfer sampling for augmented reality
US9460515B2 (en) * 2013-10-25 2016-10-04 Ricoh Co., Ltd. Processing of light fields by transforming to scale and depth space
KR102156402B1 (ko) * 2013-11-05 2020-09-16 삼성전자주식회사 영상 처리 방법 및 장치
WO2015074718A1 (en) 2013-11-22 2015-05-28 Vidinoti Sa A light field processing method
KR101561525B1 (ko) * 2013-12-30 2015-10-20 재단법인대구경북과학기술원 스테레오 깊이 영상 생성 장치 및 방법
CN106464853B (zh) 2014-05-21 2019-07-16 索尼公司 图像处理设备和方法
US10567464B2 (en) * 2015-04-15 2020-02-18 Google Llc Video compression with adaptive view-dependent lighting removal
US10136116B2 (en) * 2016-03-07 2018-11-20 Ricoh Company, Ltd. Object segmentation from light field data
EP3273686A1 (en) * 2016-07-21 2018-01-24 Thomson Licensing A method for generating layered depth data of a scene

Also Published As

Publication number Publication date
BR112019001046A2 (pt) 2019-04-30
WO2018015555A1 (en) 2018-01-25
JP2022174085A (ja) 2022-11-22
KR20190032440A (ko) 2019-03-27
CN109644280A (zh) 2019-04-16
US11803980B2 (en) 2023-10-31
KR20220045242A (ko) 2022-04-12
EP3488608A1 (en) 2019-05-29
EP3273686A1 (en) 2018-01-24
KR20230106714A (ko) 2023-07-13
KR102381462B1 (ko) 2022-04-01
JP7184748B2 (ja) 2022-12-06
US11127146B2 (en) 2021-09-21
JP2019527425A (ja) 2019-09-26
KR102551274B1 (ko) 2023-07-05
US20220005216A1 (en) 2022-01-06
JP7664891B2 (ja) 2025-04-18
US20190385323A1 (en) 2019-12-19
KR102733983B1 (ko) 2024-11-26
CN109644280B (zh) 2023-10-31

Similar Documents

Publication Publication Date Title
JP7664891B2 (ja) 場面の積層深度データを生成するための方法
US9237330B2 (en) Forming a stereoscopic video
EP2992508B1 (en) Diminished and mediated reality effects from reconstruction
JP2021185542A (ja) ３次元再構成において構造特徴を検出し、組み合わせるための方法およびシステム
CN106464853B (zh) 图像处理设备和方法
US20130095920A1 (en) Generating free viewpoint video using stereo imaging
JP7285834B2 (ja) 三次元再構成方法および三次元再構成装置
TWI547901B (zh) 模擬立體圖像顯示方法及顯示設備
Feng et al. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications
CN108537871A (zh) 信息处理设备和信息处理方法
Jang et al. Efficient disparity map estimation using occlusion handling for various 3D multimedia applications
CN108028904B (zh) 移动设备上光场增强现实/虚拟现实的方法和系统
WO2023169283A1 (zh) 双目立体全景图像的生成方法、装置、设备、存储介质和产品
KR20190027079A (ko) 전자 장치, 그 제어 방법 및 컴퓨터 판독가능 기록 매체
Knorr et al. An image-based rendering (ibr) approach for realistic stereo view synthesis of tv broadcast based on structure from motion
CN107787507B (zh) 获得表示图像的锐度级别的配准误差图的装置和方法
WO2020059575A1 (ja) ３次元画像生成装置、３次元画像生成方法、及びプログラム
CN112308896A (zh) 图像处理方法、芯片电路、装置、电子设备及存储介质
Han et al. Depth estimation and video synthesis for 2D to 3D video conversion
CN117635684A (zh) 立体格式图像检测方法与使用该方法的电子装置
Sharma et al. A simple objective method for automatic error detection in stereoscopic 3D video
HK1182248B (en) Generating free viewpoint video using stereo imaging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination