JP7329064B2 - 点群属性コーディング用のチャネル間予測と変換のための技術および装置 - Google Patents
点群属性コーディング用のチャネル間予測と変換のための技術および装置 Download PDFInfo
- Publication number
- JP7329064B2 JP7329064B2 JP2021556273A JP2021556273A JP7329064B2 JP 7329064 B2 JP7329064 B2 JP 7329064B2 JP 2021556273 A JP2021556273 A JP 2021556273A JP 2021556273 A JP2021556273 A JP 2021556273A JP 7329064 B2 JP7329064 B2 JP 7329064B2
- Authority
- JP
- Japan
- Prior art keywords
- point cloud
- transform
- residual
- encoding
- attribute information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 58
- 230000006835 compression Effects 0.000 claims description 9
- 238000007906 compression Methods 0.000 claims description 9
- 230000009467 reduction Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 23
- 238000004891 communication Methods 0.000 description 15
- 238000013139 quantization Methods 0.000 description 8
- 230000005540 biological transmission Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000000354 decomposition reaction Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 101000638078 Homo sapiens Transmembrane channel-like protein 3 Proteins 0.000 description 2
- 102100032048 Transmembrane channel-like protein 3 Human genes 0.000 description 2
- 238000004873 anchoring Methods 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000007596 consolidation process Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/001—Model-based coding, e.g. wire frame
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/56—Particle system, point based geometry or rendering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Architecture (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Description
本出願は、2019年10月6日に出願された米国仮特許出願第62/911,327号および2020年9月24日に出願された米国特許出願第17/030,779号からの優先権を主張し、その全ての内容は参照により本出願に組み込まれるものとする。
Co=R-B
t=B+(Co>>1)
Cg=G-t
Y=t+(Cg>>1)
t=Y-(Cg>>1)
G=Cg+t;
B=t-(Co>>1)
R=B+Co
G-Channel:
G_delta_index <- Quantize(G- G_pred)
G_delta_recon <- InverseQuantize(G_delta_index)
G_recon <- G_pred + G_delta_recon
EntopyEncode(G_delta_index)
C-Channels ('C' can be either R or B):
C_delta_index <- Quantize(C- C_pred)
C_delta_recon <- InverseQuantize(C_delta_index)
C_delta_residual_index <- Quantize (C_delta_recon - G_delta_recon)
C_delta_recon <- InverseQuantize(C_delta_residual_index) + G_delta_recon
C_recon <- C_pred + C_delta_recon
EntopyEncode(C_delta_residual_index)
G-Channel:
G_delta_index < - EntropyDecode()
G_delta_recon <- InverseQuantize(G_delta_index)
G_recon <- G_pred + G_delta_recon
// C-Channels ('C' can be either R or B)
C_delta_residual_index < - EntropyDecode()
C_delta_recon < - InverseQuantize(C_delta_residual_index) + G_delta_recon
C_recon <- C_pred + C_delta_recon
endIndex = pointCountPerLevelOfDetail[ 0 ];
for (i=0, d = 0; i< PointNum; i++) {
if ( i == endlndex ) {
endIndex = pointCountPerLevelOfDetail[ ++d ];
Q step Y = ( d < numlayer ) ? SliceQstepY[ d ] :SliceQstepY[ num_layer - 1 ];
QstepC = ( d < num layer ) ? SliceQstepC[ d ] :SliceQstepC[ num_layer - 1 ];
}
for (a=0; a< attrCnt; a++)
{
if (a==0 || lifting_residual_prediction_enabled_flag==0)
unquantAttributeCoefficients [ i ][ a ] = quantAttributeCoefficients[ i ][ a ] x(a == 0 ?QstepY :QstepC);
eise
unquant AttributeCoeffi ci ents [ i ][ a ] = quantAttributeCoefficients[ i ][ a ] x(a == 0 ?QstepY :QstepC) + unquantAttributeCoefficients[i][0];
}
}
G-Channel
G_coeff_index <- Quantize(G)
G_coeff_recon <- InverseQuantize(G_coeff_index)
G_recon <- G_coeff_recon/quantWeight
EntopyEncode(G_coeff_index)
// C-Channels ('C' can be either R or B)
C_coeff_index <- Quantize(C)
C_coeff_recon <- InverseQuantize(C_coeff_index)
C_coeff_residual_index <- Quantize (C_coeff_recon - G_coeff_recon)
C_ceoff_recon <- InverseQuantize(C_coeff_residual_index) + G_coeff_recon
C_recon <- C_coeff_recon/quantWeight
EntopyEncode(C_coeff_residual_index)
デコーディングについて
/G-Channel
G_coeff_index < - EntropyDecode()
G_coeff_recon <- InverseQuantize(G_coeff_index)
Grecon <- G_coeff_recon/quantW eight
// C-Channels ('C' can be either R or B)
C_coeff_residual_index < - EntropyDecode()
C_coeff_recon < - InverseQuantize(C_coeff_residual_index) + G_coeff_recon
C_recon <- C_coeff_recon/quantWeight
Co = R - B
t = B + (Co >> 1)
Cg = G - t
Y = t + (Cg >> 1)
t = Y - (Cg >> 1)
G = Cg + t;
B = t - (Co >> 1)
R = B + Co
Claims (6)
- 少なくとも1つのプロセッサによって実行される、点群の属性情報をコード化するための方法であって、
3次元空間内の点のセットを含む前記点群を取得するステップと、
予測残差のロスレスインループ変換としてYCoCg-R変換を使用して前記点群の少なくとも1つの点の前記属性情報をコード化するステップであって、前記ステップは、前記少なくとも1つの点の前記予測残差のロスレスインループ変換を使用することを:
前記少なくとも1つの点の隣接点の数が、前記隣接点の1つ1つへの前記予測残差のロスレスインループ変換としての前記YCoCg-R変換の適用によって残差の大きさの減少及び残差の分散の減少のいずれかを経験したかどうかを決定すること、
前記隣接点のチャネル値の最大絶対差を決定すること、および
前記隣接点からチャネル間相関を決定すること、
のうちの少なくとも1つを含む条件付きチェックによって決定することに基づく、ステップと、を含む方法。 - 前記YCoCg-R変換を使用して前記属性情報をコード化することに基づいて前記点群を送信することをさらに含む、請求項1に記載の方法。
- 前記YCoCg-R変換は、グラフベースの点群圧縮(G-PCC)に使用される、請求項1または2に記載の方法。
- Co=R-Bであり、
t=B+(Co>>1)であり、
Cg=G-tであり、
Y=t+(Cg>>1)である、請求項1乃至3のいずれか1項に記載の方法。 - 点群の属性情報をコード化するための装置であって、
プログラムコードを記憶するように構成された少なくとも1つのメモリと、
前記プログラムコードを読み取り、前記プログラムコードの指示に従って動作するように構成された少なくとも1つのプロセッサと、を含み、
前記プログラムコードは、
前記少なくとも1つのプロセッサに、請求項1乃至4のいずれか1項に記載の方法を実行させる、装置。 - 点群の属性情報をコード化するための装置の1つ以上のプロセッサによって実行されると、前記1つ以上のプロセッサに、請求項1乃至4のいずれか1項に記載の方法を実行させる1つ以上の命令を含む、プログラム。
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962911327P | 2019-10-06 | 2019-10-06 | |
US62/911,327 | 2019-10-06 | ||
US17/030,779 US11682144B2 (en) | 2019-10-06 | 2020-09-24 | Techniques and apparatus for inter-channel prediction and transform for point-cloud attribute coding |
US17/030,779 | 2020-09-24 | ||
PCT/US2020/053977 WO2021071752A1 (en) | 2019-10-06 | 2020-10-02 | Techniques and apparatus for inter-channel prediction and transform for point-cloud attribute coding |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2022535483A JP2022535483A (ja) | 2022-08-09 |
JP7329064B2 true JP7329064B2 (ja) | 2023-08-17 |
Family
ID=75274371
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2021556273A Active JP7329064B2 (ja) | 2019-10-06 | 2020-10-02 | 点群属性コーディング用のチャネル間予測と変換のための技術および装置 |
Country Status (6)
Country | Link |
---|---|
US (1) | US11682144B2 (ja) |
EP (1) | EP4038577A4 (ja) |
JP (1) | JP7329064B2 (ja) |
KR (1) | KR102625789B1 (ja) |
CN (1) | CN113795868B (ja) |
WO (1) | WO2021071752A1 (ja) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11551334B2 (en) * | 2020-01-09 | 2023-01-10 | Tencent America LLC | Techniques and apparatus for coarse granularity scalable lifting for point-cloud attribute coding |
US11645812B2 (en) * | 2020-10-06 | 2023-05-09 | Qualcomm Incorporated | Inter-component residual prediction for color attributes in geometry point cloud compression coding |
US11651551B2 (en) * | 2020-10-06 | 2023-05-16 | Qualcomm Incorporated | Coding of component of color attributes in geometry-based point cloud compression (G-PCC) |
US12003768B2 (en) * | 2021-04-05 | 2024-06-04 | Qualcomm Incorporated | Residual coding for geometry point cloud compression |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150264374A1 (en) | 2014-03-14 | 2015-09-17 | Vid Scale, Inc. | Systems and methods for rgb video coding enhancement |
US20190087978A1 (en) | 2017-09-18 | 2019-03-21 | Apple Inc. | Point cloud compression using non-cubic projections and masks |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050259730A1 (en) | 2004-05-18 | 2005-11-24 | Sharp Laboratories Of America, Inc. | Video coding with residual color conversion using reversible YCoCg |
US10244223B2 (en) * | 2014-01-10 | 2019-03-26 | Ostendo Technologies, Inc. | Methods for full parallax compressed light field 3D imaging systems |
US20150373327A1 (en) * | 2014-06-20 | 2015-12-24 | Qualcomm Incorporated | Block adaptive color-space conversion coding |
US11514613B2 (en) | 2017-03-16 | 2022-11-29 | Samsung Electronics Co., Ltd. | Point cloud and mesh compression using image/video codecs |
US10607373B2 (en) * | 2017-11-22 | 2020-03-31 | Apple Inc. | Point cloud compression with closed-loop color conversion |
US10783668B2 (en) * | 2017-12-22 | 2020-09-22 | Samsung Electronics Co., Ltd. | Handling duplicate points in point cloud compression |
CN109257604B (zh) * | 2018-11-20 | 2020-11-27 | 山东大学 | 一种基于tmc3点云编码器的颜色属性编码方法 |
-
2020
- 2020-09-24 US US17/030,779 patent/US11682144B2/en active Active
- 2020-10-02 JP JP2021556273A patent/JP7329064B2/ja active Active
- 2020-10-02 EP EP20875425.9A patent/EP4038577A4/en active Pending
- 2020-10-02 KR KR1020217033332A patent/KR102625789B1/ko active IP Right Grant
- 2020-10-02 WO PCT/US2020/053977 patent/WO2021071752A1/en unknown
- 2020-10-02 CN CN202080033242.4A patent/CN113795868B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150264374A1 (en) | 2014-03-14 | 2015-09-17 | Vid Scale, Inc. | Systems and methods for rgb video coding enhancement |
US20190087978A1 (en) | 2017-09-18 | 2019-03-21 | Apple Inc. | Point cloud compression using non-cubic projections and masks |
Also Published As
Publication number | Publication date |
---|---|
CN113795868A (zh) | 2021-12-14 |
US11682144B2 (en) | 2023-06-20 |
EP4038577A1 (en) | 2022-08-10 |
WO2021071752A1 (en) | 2021-04-15 |
CN113795868B (zh) | 2024-03-01 |
JP2022535483A (ja) | 2022-08-09 |
KR102625789B1 (ko) | 2024-01-15 |
EP4038577A4 (en) | 2023-11-08 |
US20210104072A1 (en) | 2021-04-08 |
KR20210139381A (ko) | 2021-11-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7329064B2 (ja) | 点群属性コーディング用のチャネル間予測と変換のための技術および装置 | |
US11741637B2 (en) | Node-based geometry and attribute coding for a point cloud | |
JP7263521B2 (ja) | インターフレーム点群属性符号化のための方法並びにその、装置およびコンピュータプログラム | |
JP7234375B2 (ja) | 点群属性コーディングの加重中央値を予測するための手法及びデバイス並びにコンピュータプログラム | |
US11710259B2 (en) | Predictive tree coding for point cloud coding | |
JP7384520B2 (ja) | フレーム間点群属性コーディングのための方法、装置及びコンピュータ・プログラム | |
JP2022516847A (ja) | 適応ポイントクラウド属性コーディングのための方法、装置、及びコンピュータプログラム | |
JP7213368B2 (ja) | 点群属性コーディングのためのチャネル間予測および変換の技術並びに装置 | |
CN112218077B (zh) | 通道间点云属性编码方法、装置以及可读存储介质 | |
JP7263550B2 (ja) | 点群の情報をコーディングする方法及び装置、及びコンピュータプログラム | |
CN113544747A (zh) | 用于点云编解码的几何合并模式的方法和装置 | |
JP2023501638A (ja) | スタック可能ネスト化モデル構造を用いたマルチレート・ニューラルイメージ圧縮のための方法および装置 | |
JP2023518542A (ja) | 潜在特徴領域におけるイントラ予測によるニューラル画像圧縮 | |
JP2023520593A (ja) | 適応型イントラ予測によるニューラル画像圧縮 | |
CN112616058B (zh) | 视频编码或解码方法、装置、计算机设备和存储介质 | |
CN112188197B (zh) | 通道间点云属性解码方法、装置以及可读存储介质 | |
CN113256746B (en) | Method, device and storage medium for point cloud encoding and decoding | |
CN112188197A (zh) | 通道间点云属性解码方法、装置以及可读存储介质 | |
CN115485729A (zh) | 用于神经图像压缩中多次学习替换率的方法和装置 | |
CN112616058A (zh) | 视频编码或解码方法、装置、计算机设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20211013 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20230104 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20230330 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20230711 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20230804 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7329064 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |