JP7166782B2 - 二次元ポイントクラウドを符号化および復号する方法および装置 - Google Patents

二次元ポイントクラウドを符号化および復号する方法および装置 Download PDF

Info

Publication number
JP7166782B2
JP7166782B2 JP2018080325A JP2018080325A JP7166782B2 JP 7166782 B2 JP7166782 B2 JP 7166782B2 JP 2018080325 A JP2018080325 A JP 2018080325A JP 2018080325 A JP2018080325 A JP 2018080325A JP 7166782 B2 JP7166782 B2 JP 7166782B2
Authority
JP
Japan
Prior art keywords
point cloud
frame
mapping operator
matrix
frames
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018080325A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018198421A5 (https=
JP2018198421A (ja
Inventor
フルーロー，ジュリアン
シュポー，バートランド
ドレ，ルノー
Original Assignee
インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターデジタル ヴイシー ホールディングス， インコーポレイテッド filed Critical インターデジタル ヴイシー ホールディングス， インコーポレイテッド
Publication of JP2018198421A publication Critical patent/JP2018198421A/ja
Publication of JP2018198421A5 publication Critical patent/JP2018198421A5/ja
Application granted granted Critical
Publication of JP7166782B2 publication Critical patent/JP7166782B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/06—Topological mapping of higher dimensional structures onto lower dimensional surfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
JP2018080325A 2017-05-04 2018-04-19 二次元ポイントクラウドを符号化および復号する方法および装置 Active JP7166782B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP17305504.7A EP3399757A1 (en) 2017-05-04 2017-05-04 Method and apparatus to encode and decode two-dimension point clouds
EP17305504.7 2017-05-04

Publications (3)

Publication Number Publication Date
JP2018198421A JP2018198421A (ja) 2018-12-13
JP2018198421A5 JP2018198421A5 (https=) 2021-05-27
JP7166782B2 true JP7166782B2 (ja) 2022-11-08

Family

ID=58709420

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018080325A Active JP7166782B2 (ja) 2017-05-04 2018-04-19 二次元ポイントクラウドを符号化および復号する方法および装置

Country Status (9)

Country Link
US (1) US11122101B2 (https=)
EP (2) EP3399757A1 (https=)
JP (1) JP7166782B2 (https=)
KR (1) KR102627189B1 (https=)
CN (1) CN108810571B (https=)
BR (1) BR102018009143A2 (https=)
CA (1) CA3003608A1 (https=)
MX (1) MX383636B (https=)
RU (1) RU2762005C2 (https=)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109460535B (zh) * 2018-11-14 2023-02-03 深圳职业技术学院 一种基于云的有限域矩阵求逆装置及求逆方法
KR102256913B1 (ko) * 2018-12-03 2021-05-27 고려대학교 산학협력단 삼차원 동적 포인트 클라우드 압축방법
CN111327902B (zh) * 2018-12-13 2022-11-22 华为技术有限公司 点云的编解码方法及装置
CN111327897B (zh) * 2018-12-13 2022-01-14 华为技术有限公司 点云编码方法和编码器
US11095900B2 (en) * 2018-12-19 2021-08-17 Sony Group Corporation Point cloud coding structure
US11039115B2 (en) * 2018-12-21 2021-06-15 Samsung Electronics Co., Ltd. Low complexity color smoothing of reconstructed point clouds
WO2020146341A1 (en) * 2019-01-07 2020-07-16 Futurewei Technologies, Inc. Point cloud bitstream structure and auxiliary information differential coding
KR102640235B1 (ko) 2019-01-11 2024-02-23 삼성전자주식회사 3차원 데이터 부호화 방법 및 장치 및 3차원 데이터 복호화 방법 및 장치
US11190803B2 (en) * 2019-01-18 2021-11-30 Sony Group Corporation Point cloud coding using homography transform
KR102828184B1 (ko) 2019-02-07 2025-07-02 인터디지털 브이씨 홀딩스 인코포레이티드 포인트 클라우드의 처리
WO2020185578A1 (en) 2019-03-08 2020-09-17 Vid Scale, Inc. Methods and apparatus for adaptive streaming of point clouds
EP3713238A1 (en) * 2019-03-20 2020-09-23 InterDigital VC Holdings, Inc. Processing a point cloud
CN111739111B (zh) * 2019-03-20 2023-05-30 上海交通大学 一种点云投影编码的块内偏移优化方法及系统
KR102895281B1 (ko) * 2019-03-20 2025-12-04 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
WO2020190097A1 (ko) * 2019-03-20 2020-09-24 엘지전자 주식회사 포인트 클라우드 데이터 수신 장치, 포인트 클라우드 데이터 수신 방법, 포인트 클라우드 데이터 처리 장치 및 포인트 클라우드 데이터 처리 방법
WO2020189895A1 (ko) * 2019-03-21 2020-09-24 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
KR102699245B1 (ko) * 2019-03-21 2024-08-27 엘지전자 주식회사 포인트 클라우드 데이터 부호화 장치, 포인트 클라우드 데이터 부호화 방법, 포인트 클라우드 데이터 복호화 장치 및 포인트 클라우드 데이터 복호화 방법
WO2020235979A1 (ko) 2019-05-23 2020-11-26 삼성전자 주식회사 포인트 클라우드 기반 데이터를 렌더링하는 방법 및 장치
WO2020256244A1 (ko) * 2019-06-21 2020-12-24 엘지전자 주식회사 포인트 클라우드 데이터 송신 장치, 포인트 클라우드 데이터 송신 방법, 포인트 클라우드 데이터 수신 장치 및 포인트 클라우드 데이터 수신 방법
US20220377327A1 (en) * 2019-07-03 2022-11-24 Lg Electronics Inc. Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
WO2021066626A1 (en) * 2019-10-03 2021-04-08 Lg Electronics Inc. Point cloud data transmission device, point cloud data transmission method, point cloud data reception device, and point cloud data reception method
CN110730364B (zh) * 2019-10-14 2021-08-31 广州微算互联信息技术有限公司 一种云手机数据传输方法、装置及存储介质
US11348285B2 (en) * 2019-12-10 2022-05-31 Sony Group Corporation Mesh compression via point cloud representation
CN114762356B (zh) * 2019-12-13 2024-06-11 索尼集团公司 图像处理装置和方法
CN115023739A (zh) * 2019-12-20 2022-09-06 交互数字Vc控股法国公司 用于对具有视图驱动的镜面反射的体积视频进行编码和解码的方法和装置
WO2021140276A1 (en) * 2020-01-10 2021-07-15 Nokia Technologies Oy Storage of multiple atlases from one v-pcc elementary stream in isobmff
US11743501B2 (en) * 2020-04-07 2023-08-29 Qualcomm Incorporated High-level syntax design for geometry-based point cloud compression
CN118138737A (zh) * 2020-04-11 2024-06-04 Lg电子株式会社 对点云数据进行编解码的方法和存储介质
CN115428467B (zh) * 2020-04-14 2024-03-08 Lg电子株式会社 点云数据发送设备和方法、点云数据接收设备和方法
JP7611400B2 (ja) 2020-12-31 2025-01-09 オッポ広東移動通信有限公司 点群符号化および復号化方法、エンコーダ、デコーダ、ならびにコンピュータ記憶媒体
CN115474041B (zh) * 2021-06-11 2023-05-26 腾讯科技（深圳）有限公司 点云属性的预测方法、装置及相关设备
JP2024527513A (ja) * 2021-06-22 2024-07-25 インターデイジタル パテント ホールディングス インコーポレイテッド ３ｄ点群の展開による学習ベースの点群圧縮
CN117693936A (zh) * 2021-07-04 2024-03-12 抖音视界有限公司 用于点云编解码的方法、装置和介质
EP4141794A1 (en) * 2021-08-31 2023-03-01 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus of encoding/decoding point cloud geometry data sensed by at least one sensor

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180268570A1 (en) 2017-03-16 2018-09-20 Samsung Electronics Co., Ltd. Point cloud and mesh compression using image/video codecs

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6701028B1 (en) * 2000-01-11 2004-03-02 Applied Materials, Inc. Method and apparatus for fast signal convolution using spline kernel
US7236613B2 (en) * 2003-08-29 2007-06-26 The Boeing Company Methods and apparatus for infrared resolution of closely-spaced objects
WO2005025404A2 (en) * 2003-09-08 2005-03-24 Vanderbilt University Apparatus and methods of cortical surface registration and deformation tracking for patient-to-image alignment in relation to image-guided surgery
US8042056B2 (en) * 2004-03-16 2011-10-18 Leica Geosystems Ag Browsers for large geometric data visualization
WO2009154644A1 (en) 2008-06-17 2009-12-23 Ntt Docomo, Inc. Image/video quality enhancement and super-resolution using sparse transformations
US8179393B2 (en) * 2009-02-13 2012-05-15 Harris Corporation Fusion of a 2D electro-optical image and 3D point cloud data for scene interpretation and registration performance assessment
US9445072B2 (en) 2009-11-11 2016-09-13 Disney Enterprises, Inc. Synthesizing views based on image domain warping
US8525848B2 (en) * 2009-11-16 2013-09-03 Autodesk, Inc. Point cloud decimation engine
US20110222757A1 (en) * 2010-03-10 2011-09-15 Gbo 3D Technology Pte. Ltd. Systems and methods for 2D image and spatial data capture for 3D stereo imaging
CN103261912B (zh) * 2010-07-29 2016-01-20 威凯托陵科有限公司 用于测量对象的距离和/或强度特性的设备和方法
GB201103822D0 (en) * 2011-03-07 2011-04-20 Isis Innovation System for providing locality information and associated devices
TWI538473B (zh) * 2011-03-15 2016-06-11 杜比實驗室特許公司 影像資料轉換的方法與設備
JP5745435B2 (ja) * 2012-02-01 2015-07-08 東芝プラントシステム株式会社 三次元データ処理装置、三次元データ処理プログラムおよび三次元データ処理方法
US9565450B2 (en) 2012-03-07 2017-02-07 Lg Electronics Inc. Method and device for processing video signal
RU2013100160A (ru) 2013-01-09 2014-07-20 ЭлЭсАй Корпорейшн Обработка изображений со сверхразрешением с использованием обратимой разреженной матрицы
CN103761744B (zh) * 2014-02-21 2016-06-15 哈尔滨工业大学 通用型二维点云分组方法
EP2947630A1 (en) * 2014-05-23 2015-11-25 My Virtual Reality Software AS Method for compressing coordinate data
US9940727B2 (en) * 2014-06-19 2018-04-10 University Of Southern California Three-dimensional modeling from wide baseline range scans
US9864584B2 (en) * 2014-11-14 2018-01-09 Cavium, Inc. Code generator for programmable network devices
CN106339208B (zh) * 2015-07-15 2019-12-13 腾讯科技（深圳）有限公司 一种多媒体信息弹窗的处理方法及设备
US10193904B2 (en) * 2015-07-16 2019-01-29 Qatar University Data-driven semi-global alignment technique for masquerade detection in stand-alone and cloud computing systems
CN105427239B (zh) * 2015-12-05 2018-05-22 刘忠艳 一种二维点云匹配方法
US10043305B2 (en) * 2016-01-06 2018-08-07 Meta Company Apparatuses, methods and systems for pre-warping images for a display system with a distorting optical component
US20170214943A1 (en) * 2016-01-22 2017-07-27 Mitsubishi Electric Research Laboratories, Inc. Point Cloud Compression using Prediction and Shape-Adaptive Transforms
CN106228570B (zh) * 2016-07-08 2019-04-09 百度在线网络技术（北京）有限公司 一种真值数据确定方法和装置
US10417533B2 (en) * 2016-08-09 2019-09-17 Cognex Corporation Selection of balanced-probe sites for 3-D alignment algorithms
US20180053324A1 (en) * 2016-08-19 2018-02-22 Mitsubishi Electric Research Laboratories, Inc. Method for Predictive Coding of Point Cloud Geometries
US20190116372A1 (en) * 2017-10-16 2019-04-18 Mitsubishi Electric Research Laboratories, Inc. Systems and Methods for Compressing, Representing and Processing Point Clouds

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180268570A1 (en) 2017-03-16 2018-09-20 Samsung Electronics Co., Ltd. Point cloud and mesh compression using image/video codecs

Also Published As

Publication number Publication date
CN108810571B (zh) 2022-04-05
JP2018198421A (ja) 2018-12-13
KR20180122947A (ko) 2018-11-14
US20180324240A1 (en) 2018-11-08
RU2018115810A (ru) 2019-10-30
CA3003608A1 (en) 2018-11-04
BR102018009143A2 (pt) 2019-03-19
US11122101B2 (en) 2021-09-14
MX2018005496A (es) 2018-11-09
RU2018115810A3 (https=) 2021-06-23
CN108810571A (zh) 2018-11-13
EP3399757A1 (en) 2018-11-07
KR102627189B1 (ko) 2024-01-22
RU2762005C2 (ru) 2021-12-14
MX383636B (es) 2025-03-14
EP3399758A1 (en) 2018-11-07
EP3399758B1 (en) 2020-09-16

Similar Documents

Publication Publication Date Title
JP7166782B2 (ja) 二次元ポイントクラウドを符号化および復号する方法および装置
JP7359153B2 (ja) 画像処理装置および方法
RU2742344C2 (ru) Способ, устройство и поток форматирования иммерсивного видео для устройств унаследованного и иммерсивного рендеринга
US12555272B2 (en) Mesh compression using coding units with different encoding parameters
US20250301160A1 (en) Bit plane encoding of data arrays
KR20200140824A (ko) 3d 객체를 나타내는 포인트 클라우드를 인코딩/디코딩하기 위한 방법 및 장치
KR20240093534A (ko) 메시 압축을 위한 변위 코딩
JP2021531548A (ja) 点群のジオメトリを符号化／復号する方法及び装置
JP2020536325A (ja) ３ｄシーンの点を生成するための方法およびデバイス
CN115398904A (zh) 具有α层的3D场景传输
US20250045971A1 (en) Hybrid framework for point cloud compression
KR20240101612A (ko) 인스턴스 기반 메시 코딩을 위한 방법
KR20240108466A (ko) 동적 메시 압축에서의 모션 필드 코딩
CN111479114A (zh) 点云的编解码方法及装置
JP7803337B2 (ja) 没入型ビデオの符号化および復号
JPWO2014167609A1 (ja) 情報処理装置、制御方法、プログラム、及び記録媒体
CN120982095A (zh) 点云编解码方法、编码器、解码器、码流及存储介质
US20220038715A1 (en) Method and system for adaptive image transferring for enhancing image quality
RU2857997C2 (ru) Способ и устройство закодирования 3D-облака точек в битовый поток, способ и устройство декодирования 3D-облака точек из битового потока
EP4492328A1 (en) Compression and signaling of displacements in dynamic mesh compression
Bruns et al. Evaluation of GPU/CPU co-processing models for JPEG 2000 packetization
WO2026012833A1 (en) 3dgs (3d gaussian splatting) based inpainting for 3d data compression
WO2025096197A1 (en) Entropy bottleneck layer for learning-based mesh compression
WO2025244774A1 (en) Model sharing for point cloud compression
WO2025096198A1 (en) Learning-based mesh compression using latent mesh

Legal Events

Date Code Title Description
A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191106

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210413

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210413

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220513

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220517

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220815

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20221003

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20221026

R150 Certificate of patent or registration of utility model

Ref document number: 7166782

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250