CN109997358B - 用于自由视点视频流式传输的以解码器为中心的uv编解码器 - Google Patents

用于自由视点视频流式传输的以解码器为中心的uv编解码器 Download PDF

Info

Publication number
CN109997358B
CN109997358B CN201780073335.8A CN201780073335A CN109997358B CN 109997358 B CN109997358 B CN 109997358B CN 201780073335 A CN201780073335 A CN 201780073335A CN 109997358 B CN109997358 B CN 109997358B
Authority
CN
China
Prior art keywords
free
video content
view video
decoded
decoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201780073335.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN109997358A (zh
Inventor
D·格拉兹斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN109997358A publication Critical patent/CN109997358A/zh
Application granted granted Critical
Publication of CN109997358B publication Critical patent/CN109997358B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more two-dimensional [2D] image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Closed-Circuit Television Systems (AREA)
CN201780073335.8A 2016-11-28 2017-11-20 用于自由视点视频流式传输的以解码器为中心的uv编解码器 Active CN109997358B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662426900P 2016-11-28 2016-11-28
US62/426,900 2016-11-28
US15/816,094 2017-11-17
US15/816,094 US10389994B2 (en) 2016-11-28 2017-11-17 Decoder-centric UV codec for free-viewpoint video streaming
PCT/US2017/062461 WO2018098054A1 (en) 2016-11-28 2017-11-20 Decoder-centric uv codec for free-viewpoint video streaming

Publications (2)

Publication Number Publication Date
CN109997358A CN109997358A (zh) 2019-07-09
CN109997358B true CN109997358B (zh) 2022-02-22

Family

ID=62191154

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780073335.8A Active CN109997358B (zh) 2016-11-28 2017-11-20 用于自由视点视频流式传输的以解码器为中心的uv编解码器

Country Status (6)

Country Link
US (1) US10389994B2 (https=)
EP (1) EP3526966B1 (https=)
JP (1) JP6939883B2 (https=)
KR (1) KR102194758B1 (https=)
CN (1) CN109997358B (https=)
WO (1) WO2018098054A1 (https=)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10242484B1 (en) * 2017-10-17 2019-03-26 8i Limited UV mapping and compression
EP3509308A1 (en) * 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream
JP7271099B2 (ja) * 2018-07-19 2023-05-11 キヤノン株式会社 ファイルの生成装置およびファイルに基づく映像の生成装置
KR102287133B1 (ko) * 2018-11-30 2021-08-09 한국전자기술연구원 자유 시점 영상 제공 방법 및 장치
US11457197B2 (en) * 2019-02-22 2022-09-27 Avalon Holographics Inc. Layered scene decomposition CODEC with view independent rasterization
CN113728625A (zh) 2019-05-14 2021-11-30 英特尔公司 用于三自由度加/沉浸式视频的元数据（3DoF+/MIV）和视频-点云编码（V-PCC）的沉浸式视频编码技术
CN110223382B (zh) * 2019-06-13 2021-02-12 电子科技大学 基于深度学习的单帧图像自由视点三维模型重建方法
US11120623B2 (en) * 2019-06-25 2021-09-14 HypeVR Optimized volumetric video playback
KR102731169B1 (ko) * 2019-08-29 2024-11-15 한국전자통신연구원 이머시브 영상 처리 방법 및 이머시브 영상 합성 방법
EP3793199A1 (en) 2019-09-10 2021-03-17 InterDigital VC Holdings, Inc. A method and apparatus for delivering a volumetric video content
US10964089B1 (en) 2019-10-07 2021-03-30 Sony Corporation Method and apparatus for coding view-dependent texture attributes of points in a 3D point cloud
JP7549660B2 (ja) * 2019-11-29 2024-09-11 中興通訊股▲ふん▼有限公司 マルチビュービデオ処理方法および装置
US11704839B2 (en) 2019-12-17 2023-07-18 Electronics And Telecommunications Research Institute Multiview video encoding and decoding method
WO2021136878A1 (en) * 2020-01-02 2021-07-08 Nokia Technologies Oy A method, an apparatus and a computer program product for volumetric video encoding and decoding
US11601636B2 (en) * 2020-05-22 2023-03-07 Google Llc Methods, systems, and media for generating an immersive light field video with a layered mesh representation
US12423874B2 (en) * 2021-10-04 2025-09-23 Tencent America LLC Method and apparatus of adaptive sampling for mesh compression by encoders
US12125250B2 (en) * 2021-11-22 2024-10-22 Tencent America LLC Decoding of patch temporal alignment for mesh compression
US12412312B2 (en) * 2021-12-03 2025-09-09 Tencent America LLC Method and apparatus for chart based mesh compression
US20230290063A1 (en) 2022-03-11 2023-09-14 Apple Inc. Adaptive tessellation for efficient dynamic mesh encoding, decoding, processing, and rendering
JP2024008741A (ja) * 2022-07-09 2024-01-19 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
JP7727597B2 (ja) * 2022-07-09 2025-08-21 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
JP2024008746A (ja) * 2022-07-09 2024-01-19 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
US12401805B2 (en) * 2022-08-23 2025-08-26 Tencent America LLC UV coordinate ranges and texture map size
US20260045023A1 (en) * 2022-09-06 2026-02-12 Sony Group Corporation Information processing system, operation method of information processing system, and program
US20240104783A1 (en) * 2022-09-22 2024-03-28 Tencent America LLC Multiple attribute maps merging

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1145512A (zh) * 1995-06-20 1997-03-19 索尼公司 再现语音信号的方法和装置以及传输该信号的方法
EP2187641A3 (en) * 1997-10-27 2010-12-15 Mitsubishi Denki Kabushiki Kaisha Image coding apparatus, image coding method, image decoding apparatus and image decoding method

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US805874A (en) * 1902-09-11 1905-11-28 Frank B Cook Automatic fire-extinguisher system.
JP2000132683A (ja) * 1998-10-23 2000-05-12 Toshiba Corp 多視点画像符号化方法
JP2006041811A (ja) * 2004-07-26 2006-02-09 Kddi Corp 自由視点画像ストリーミング方式
US8878836B2 (en) 2008-02-29 2014-11-04 Samsung Electronics Co., Ltd. Method and apparatus for encoding datastream including additional information on multiview image and method and apparatus for decoding datastream by using the same
US20100259595A1 (en) * 2009-04-10 2010-10-14 Nokia Corporation Methods and Apparatuses for Efficient Streaming of Free View Point Video
EP2309648A1 (en) * 2009-09-14 2011-04-13 Thomson Licensing Method for encoding floating-point data, method for decoding floating-point data, and corresponding encoder and decoder
CN102291579B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的多目立体视频分形压缩与解压缩方法
JP5870618B2 (ja) * 2011-10-21 2016-03-01 大日本印刷株式会社 自由視点映像表示装置
US9237329B1 (en) * 2012-10-18 2016-01-12 Google Inc. Systems and methods for capturing data of an object
US9483845B2 (en) * 2013-04-26 2016-11-01 Nvidia Corporation Extending prediction modes and performance of video codecs
US20160295241A1 (en) * 2013-12-03 2016-10-06 Nippon Telegraph And Telephone Corporation Video encoding apparatus and method, video decoding apparatus and method, and programs therefor
US9807373B1 (en) * 2013-12-27 2017-10-31 Google Inc. Systems and devices for acquiring imagery and three-dimensional (3D) models of objects
US10339701B2 (en) * 2014-05-13 2019-07-02 Pcp Vr Inc. Method, system and apparatus for generation and playback of virtual reality multimedia
GB2526838B (en) * 2014-06-04 2016-06-01 Imagination Tech Ltd Relightable texture for use in rendering an image
FR3028990B1 (fr) * 2014-11-21 2018-01-19 Institut National Des Sciences Appliquees De Lyon Procedes de compression et de decompression de donnees representatives d’un objet tridimensionnel numerique et support d'enregistrement d'informations contenant ces donnees
JP6501348B2 (ja) * 2014-12-26 2019-04-17 Kddi株式会社 自由視点画像生成装置、方法およびプログラム
US10362290B2 (en) * 2015-02-17 2019-07-23 Nextvr Inc. Methods and apparatus for processing content based on viewing information and/or communicating content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1145512A (zh) * 1995-06-20 1997-03-19 索尼公司 再现语音信号的方法和装置以及传输该信号的方法
EP2187641A3 (en) * 1997-10-27 2010-12-15 Mitsubishi Denki Kabushiki Kaisha Image coding apparatus, image coding method, image decoding apparatus and image decoding method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Optimal Representation of Multi-View Video;Volino等;《Surrey research insight》;20140905;正文第4-5部分 *

Also Published As

Publication number Publication date
JP6939883B2 (ja) 2021-09-22
KR20190068622A (ko) 2019-06-18
US10389994B2 (en) 2019-08-20
EP3526966B1 (en) 2025-02-26
WO2018098054A1 (en) 2018-05-31
JP2020513703A (ja) 2020-05-14
US20180152688A1 (en) 2018-05-31
KR102194758B1 (ko) 2020-12-23
EP3526966A1 (en) 2019-08-21
CN109997358A (zh) 2019-07-09

Similar Documents

Publication Publication Date Title
CN109997358B (zh) 用于自由视点视频流式传输的以解码器为中心的uv编解码器
US11599968B2 (en) Apparatus, a method and a computer program for volumetric video
US10600233B2 (en) Parameterizing 3D scenes for volumetric viewing
US10567464B2 (en) Video compression with adaptive view-dependent lighting removal
US10419737B2 (en) Data structures and delivery methods for expediting virtual reality playback
US11202086B2 (en) Apparatus, a method and a computer program for volumetric video
US10341632B2 (en) Spatial random access enabled video system with a three-dimensional viewing volume
US10546424B2 (en) Layered content delivery for virtual and augmented reality experiences
CN116235497A (zh) 一种用于用信号通知基于多平面图像的体积视频的深度的方法和装置
WO2016040161A1 (en) Simultaneous localization and mapping for video coding
JP2022533754A (ja) ボリュメトリック映像の符号化および復号化のための方法、装置、およびコンピュータプログラム製品
JP6845490B2 (ja) 自由動作ｆｖｖアプリケーションのためのマルチレイヤｕｖマップに基づくテクスチャレンダリング
US12177410B2 (en) Method for transmitting 360 video, method for receiving 360 video, 360 video transmitting device, and 360 video receiving device
US11196977B2 (en) Unified coding of 3D objects and scenes
EP4573752A1 (en) Efficient mapping coordinate creation and transmission
JP7744334B2 (ja) ボリュメトリックビデオを符号化、送信、及び復号する方法及び装置
EP3698332A1 (en) An apparatus, a method and a computer program for volumetric video
WO2019122504A1 (en) Method for encoding and decoding volumetric video data
CN112806015A (zh) 全向视频的编码和解码
Verlani Proxy Based Compression of Depth Movies

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant