KR102194758B1 - 자유 시점 비디오 스트리밍을 위한 디코더 중심의 uv 코덱 - Google Patents

자유 시점 비디오 스트리밍을 위한 디코더 중심의 uv 코덱 Download PDF

Info

Publication number
KR102194758B1
KR102194758B1 KR1020197015195A KR20197015195A KR102194758B1 KR 102194758 B1 KR102194758 B1 KR 102194758B1 KR 1020197015195 A KR1020197015195 A KR 1020197015195A KR 20197015195 A KR20197015195 A KR 20197015195A KR 102194758 B1 KR102194758 B1 KR 102194758B1
Authority
KR
South Korea
Prior art keywords
video content
view video
free view
decoder
decoded
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020197015195A
Other languages
English (en)
Korean (ko)
Other versions
KR20190068622A (ko
Inventor
다닐로 그라지오시
Original Assignee
소니 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 소니 주식회사 filed Critical 소니 주식회사
Publication of KR20190068622A publication Critical patent/KR20190068622A/ko
Application granted granted Critical
Publication of KR102194758B1 publication Critical patent/KR102194758B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
    • H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G06T15/04—Texture mapping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • H04N13/178—Metadata, e.g. disparity information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H04N13/243—Image signal generators using stereoscopic image cameras using three or more two-dimensional [2D] image sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)
  • Closed-Circuit Television Systems (AREA)
KR1020197015195A 2016-11-28 2017-11-20 자유 시점 비디오 스트리밍을 위한 디코더 중심의 uv 코덱 Active KR102194758B1 (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201662426900P 2016-11-28 2016-11-28
US62/426,900 2016-11-28
US15/816,094 2017-11-17
US15/816,094 US10389994B2 (en) 2016-11-28 2017-11-17 Decoder-centric UV codec for free-viewpoint video streaming
PCT/US2017/062461 WO2018098054A1 (en) 2016-11-28 2017-11-20 Decoder-centric uv codec for free-viewpoint video streaming

Publications (2)

Publication Number Publication Date
KR20190068622A KR20190068622A (ko) 2019-06-18
KR102194758B1 true KR102194758B1 (ko) 2020-12-23

Family

ID=62191154

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020197015195A Active KR102194758B1 (ko) 2016-11-28 2017-11-20 자유 시점 비디오 스트리밍을 위한 디코더 중심의 uv 코덱

Country Status (6)

Country Link
US (1) US10389994B2 (https=)
EP (1) EP3526966B1 (https=)
JP (1) JP6939883B2 (https=)
KR (1) KR102194758B1 (https=)
CN (1) CN109997358B (https=)
WO (1) WO2018098054A1 (https=)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10242484B1 (en) * 2017-10-17 2019-03-26 8i Limited UV mapping and compression
EP3509308A1 (en) * 2018-01-05 2019-07-10 Koninklijke Philips N.V. Apparatus and method for generating an image data bitstream
JP7271099B2 (ja) * 2018-07-19 2023-05-11 キヤノン株式会社 ファイルの生成装置およびファイルに基づく映像の生成装置
KR102287133B1 (ko) * 2018-11-30 2021-08-09 한국전자기술연구원 자유 시점 영상 제공 방법 및 장치
US11457197B2 (en) * 2019-02-22 2022-09-27 Avalon Holographics Inc. Layered scene decomposition CODEC with view independent rasterization
CN113728625A (zh) 2019-05-14 2021-11-30 英特尔公司 用于三自由度加/沉浸式视频的元数据（3DoF+/MIV）和视频-点云编码（V-PCC）的沉浸式视频编码技术
CN110223382B (zh) * 2019-06-13 2021-02-12 电子科技大学 基于深度学习的单帧图像自由视点三维模型重建方法
US11120623B2 (en) * 2019-06-25 2021-09-14 HypeVR Optimized volumetric video playback
KR102731169B1 (ko) * 2019-08-29 2024-11-15 한국전자통신연구원 이머시브 영상 처리 방법 및 이머시브 영상 합성 방법
EP3793199A1 (en) 2019-09-10 2021-03-17 InterDigital VC Holdings, Inc. A method and apparatus for delivering a volumetric video content
US10964089B1 (en) 2019-10-07 2021-03-30 Sony Corporation Method and apparatus for coding view-dependent texture attributes of points in a 3D point cloud
JP7549660B2 (ja) * 2019-11-29 2024-09-11 中興通訊股▲ふん▼有限公司 マルチビュービデオ処理方法および装置
US11704839B2 (en) 2019-12-17 2023-07-18 Electronics And Telecommunications Research Institute Multiview video encoding and decoding method
WO2021136878A1 (en) * 2020-01-02 2021-07-08 Nokia Technologies Oy A method, an apparatus and a computer program product for volumetric video encoding and decoding
US11601636B2 (en) * 2020-05-22 2023-03-07 Google Llc Methods, systems, and media for generating an immersive light field video with a layered mesh representation
US12423874B2 (en) * 2021-10-04 2025-09-23 Tencent America LLC Method and apparatus of adaptive sampling for mesh compression by encoders
US12125250B2 (en) * 2021-11-22 2024-10-22 Tencent America LLC Decoding of patch temporal alignment for mesh compression
US12412312B2 (en) * 2021-12-03 2025-09-09 Tencent America LLC Method and apparatus for chart based mesh compression
US20230290063A1 (en) 2022-03-11 2023-09-14 Apple Inc. Adaptive tessellation for efficient dynamic mesh encoding, decoding, processing, and rendering
JP2024008741A (ja) * 2022-07-09 2024-01-19 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
JP7727597B2 (ja) * 2022-07-09 2025-08-21 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
JP2024008746A (ja) * 2022-07-09 2024-01-19 Kddi株式会社 メッシュ復号装置、メッシュ符号化装置、メッシュ復号方法及びプログラム
US12401805B2 (en) * 2022-08-23 2025-08-26 Tencent America LLC UV coordinate ranges and texture map size
US20260045023A1 (en) * 2022-09-06 2026-02-12 Sony Group Corporation Information processing system, operation method of information processing system, and program
US20240104783A1 (en) * 2022-09-22 2024-03-28 Tencent America LLC Multiple attribute maps merging

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013090257A (ja) * 2011-10-21 2013-05-13 Dainippon Printing Co Ltd 自由視点映像表示装置
JP2016126425A (ja) * 2014-12-26 2016-07-11 Kddi株式会社 自由視点画像生成装置、方法およびプログラム

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US805874A (en) * 1902-09-11 1905-11-28 Frank B Cook Automatic fire-extinguisher system.
JP3747492B2 (ja) * 1995-06-20 2006-02-22 ソニー株式会社 音声信号の再生方法及び再生装置
JP3860323B2 (ja) 1997-10-27 2006-12-20 三菱電機株式会社 画像復号化装置、画像復号化方法
JP2000132683A (ja) * 1998-10-23 2000-05-12 Toshiba Corp 多視点画像符号化方法
JP2006041811A (ja) * 2004-07-26 2006-02-09 Kddi Corp 自由視点画像ストリーミング方式
US8878836B2 (en) 2008-02-29 2014-11-04 Samsung Electronics Co., Ltd. Method and apparatus for encoding datastream including additional information on multiview image and method and apparatus for decoding datastream by using the same
US20100259595A1 (en) * 2009-04-10 2010-10-14 Nokia Corporation Methods and Apparatuses for Efficient Streaming of Free View Point Video
EP2309648A1 (en) * 2009-09-14 2011-04-13 Thomson Licensing Method for encoding floating-point data, method for decoding floating-point data, and corresponding encoder and decoder
CN102291579B (zh) * 2011-07-06 2014-03-05 北京航空航天大学 一种快速的多目立体视频分形压缩与解压缩方法
US9237329B1 (en) * 2012-10-18 2016-01-12 Google Inc. Systems and methods for capturing data of an object
US9483845B2 (en) * 2013-04-26 2016-11-01 Nvidia Corporation Extending prediction modes and performance of video codecs
US20160295241A1 (en) * 2013-12-03 2016-10-06 Nippon Telegraph And Telephone Corporation Video encoding apparatus and method, video decoding apparatus and method, and programs therefor
US9807373B1 (en) * 2013-12-27 2017-10-31 Google Inc. Systems and devices for acquiring imagery and three-dimensional (3D) models of objects
US10339701B2 (en) * 2014-05-13 2019-07-02 Pcp Vr Inc. Method, system and apparatus for generation and playback of virtual reality multimedia
GB2526838B (en) * 2014-06-04 2016-06-01 Imagination Tech Ltd Relightable texture for use in rendering an image
FR3028990B1 (fr) * 2014-11-21 2018-01-19 Institut National Des Sciences Appliquees De Lyon Procedes de compression et de decompression de donnees representatives d’un objet tridimensionnel numerique et support d'enregistrement d'informations contenant ces donnees
US10362290B2 (en) * 2015-02-17 2019-07-23 Nextvr Inc. Methods and apparatus for processing content based on viewing information and/or communicating content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013090257A (ja) * 2011-10-21 2013-05-13 Dainippon Printing Co Ltd 自由視点映像表示装置
JP2016126425A (ja) * 2014-12-26 2016-07-11 Kddi株式会社 自由視点画像生成装置、方法およびプログラム

Also Published As

Publication number Publication date
JP6939883B2 (ja) 2021-09-22
KR20190068622A (ko) 2019-06-18
US10389994B2 (en) 2019-08-20
EP3526966B1 (en) 2025-02-26
WO2018098054A1 (en) 2018-05-31
JP2020513703A (ja) 2020-05-14
US20180152688A1 (en) 2018-05-31
EP3526966A1 (en) 2019-08-21
CN109997358A (zh) 2019-07-09
CN109997358B (zh) 2022-02-22

Similar Documents

Publication Publication Date Title
KR102194758B1 (ko) 자유 시점 비디오 스트리밍을 위한 디코더 중심의 uv 코덱
EP3695597B1 (en) Apparatus and method for encoding/decoding a volumetric video
US10499033B2 (en) Apparatus, a method and a computer program for coding and rendering volumetric video
US11202086B2 (en) Apparatus, a method and a computer program for volumetric video
US11025882B2 (en) Live action volumetric video compression/decompression and playback
US20190139296A1 (en) Parameterizing 3d scenes for volumetric viewing
US20160073117A1 (en) Simultaneous localization and mapping for video coding
JP7217226B2 (ja) グローバルな回転における動き補償画像を符号化する方法、デバイス及びストリーム
CN107426559A (zh) 用于沉浸式视频格式的方法、装置和流
CN112189345A (zh) 体积式视频格式的方法，装置和流
JP6845490B2 (ja) 自由動作ｆｖｖアプリケーションのためのマルチレイヤｕｖマップに基づくテクスチャレンダリング
WO2019229293A1 (en) An apparatus, a method and a computer program for volumetric video
US12177410B2 (en) Method for transmitting 360 video, method for receiving 360 video, 360 video transmitting device, and 360 video receiving device
JP7692408B2 (ja) 容積ビデオを符号化、送信、及び復号化するための方法及び装置
JP7744334B2 (ja) ボリュメトリックビデオを符号化、送信、及び復号する方法及び装置
WO2019077199A1 (en) APPARATUS, METHOD, AND COMPUTER PROGRAM FOR VOLUMETRIC VIDEO
EP3729805B1 (en) Method and apparatus for encoding and decoding volumetric video data
TW202106000A (zh) 傳送容積視訊內容之方法及裝置
Verlani Proxy Based Compression of Depth Movies

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

Patent event date: 20190527

Patent event code: PA01051R01D

Comment text: International Patent Application

PA0201 Request for examination
PG1501 Laying open of application
E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20200603

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20201203

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20201217

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20201217

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
PR1001 Payment of annual fee

Payment date: 20231128

Start annual number: 4

End annual number: 4