JP2023542840A - ビデオコーディングのためのフィルタ処理プロセス - Google Patents
ビデオコーディングのためのフィルタ処理プロセス Download PDFInfo
- Publication number
- JP2023542840A JP2023542840A JP2023515165A JP2023515165A JP2023542840A JP 2023542840 A JP2023542840 A JP 2023542840A JP 2023515165 A JP2023515165 A JP 2023515165A JP 2023515165 A JP2023515165 A JP 2023515165A JP 2023542840 A JP2023542840 A JP 2023542840A
- Authority
- JP
- Japan
- Prior art keywords
- block
- filtered
- samples
- refined
- scaling factor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/117—Filters, e.g. for pre-processing or post-processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
- H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202063085094P | 2020-09-29 | 2020-09-29 | |
| US63/085,094 | 2020-09-29 | ||
| US17/448,547 US11743459B2 (en) | 2020-09-29 | 2021-09-23 | Filtering process for video coding |
| US17/448,547 | 2021-09-23 | ||
| PCT/US2021/051979 WO2022072239A1 (en) | 2020-09-29 | 2021-09-24 | Filtering process for video coding |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2023542840A true JP2023542840A (ja) | 2023-10-12 |
| JP2023542840A5 JP2023542840A5 (enExample) | 2024-09-18 |
Family
ID=80821963
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2023515165A Pending JP2023542840A (ja) | 2020-09-29 | 2021-09-24 | ビデオコーディングのためのフィルタ処理プロセス |
Country Status (9)
| Country | Link |
|---|---|
| US (3) | US11743459B2 (enExample) |
| EP (1) | EP4222953A1 (enExample) |
| JP (1) | JP2023542840A (enExample) |
| KR (1) | KR20230078653A (enExample) |
| CN (1) | CN116235494B (enExample) |
| BR (1) | BR112023004483A2 (enExample) |
| PH (1) | PH12023550132A1 (enExample) |
| TW (1) | TWI908892B (enExample) |
| WO (1) | WO2022072239A1 (enExample) |
Families Citing this family (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11743459B2 (en) * | 2020-09-29 | 2023-08-29 | Qualcomm Incorporated | Filtering process for video coding |
| US11792438B2 (en) | 2020-10-02 | 2023-10-17 | Lemon Inc. | Using neural network filtering in video coding |
| US12022098B2 (en) * | 2021-03-04 | 2024-06-25 | Lemon Inc. | Neural network-based in-loop filter with residual scaling for video coding |
| JP2025500284A (ja) * | 2022-01-10 | 2025-01-09 | 現代自動車株式会社 | インター予測におけるデコーダ側の動きベクトルリストの修正の方法及び装置 |
| EP4512076A4 (en) * | 2022-04-20 | 2026-03-25 | Beijing Bytedance Network Tech Co Ltd | METHOD, APPARATUS AND MEDIA FOR VIDEO PROCESSING |
| CN119213776A (zh) * | 2022-05-24 | 2024-12-27 | Oppo广东移动通信有限公司 | 一种环路滤波方法、视频编解码方法、装置和系统 |
| WO2023231008A1 (zh) * | 2022-06-02 | 2023-12-07 | Oppo广东移动通信有限公司 | 编解码方法、编码器、解码器以及存储介质 |
| WO2023240618A1 (zh) * | 2022-06-17 | 2023-12-21 | Oppo广东移动通信有限公司 | 一种滤波方法、解码器、编码器及计算机可读存储介质 |
| US12598314B2 (en) | 2022-07-05 | 2026-04-07 | Qualcomm Incorporated | Neural network based filtering process for multiple color components in video coding |
| WO2024025280A1 (en) * | 2022-07-27 | 2024-02-01 | Samsung Electronics Co., Ltd. | Method and system for content-based scaling for artificial intelligence based in-loop filters |
| CN120077656A (zh) * | 2022-10-13 | 2025-05-30 | Oppo广东移动通信有限公司 | 基于神经网络的环路滤波、视频编解码方法、装置和系统 |
| WO2024078599A1 (en) * | 2022-10-13 | 2024-04-18 | Douyin Vision Co., Ltd. | Method, apparatus, and medium for video processing |
| WO2024151655A1 (en) * | 2023-01-10 | 2024-07-18 | Bytedance Inc. | Indications of usage suitability of a bitstream or a post-processing filter and removal of sei messages |
| US20240283925A1 (en) * | 2023-02-17 | 2024-08-22 | Qualcomm Incorporated | Methods for complexity reduction of neural network based video coding tools |
| US12615384B2 (en) * | 2023-04-14 | 2026-04-28 | Tencent America LLC | Explicit signaling for block based adaptive weighting factors |
| WO2025002821A1 (en) * | 2023-06-29 | 2025-01-02 | Interdigital Ce Patent Holdings, Sas | Loop filter training improvement |
| US20250008138A1 (en) * | 2023-06-30 | 2025-01-02 | Tencent America LLC | Block level adaptive weighted prediction |
| WO2025011521A1 (en) * | 2023-07-07 | 2025-01-16 | Douyin Vision Co., Ltd. | Neural-network post-filter on value ranges and coding methods of syntax elements |
| US20250106384A1 (en) * | 2023-09-27 | 2025-03-27 | Lg Electronics Inc. | Method and apparatus for handling intermediary pictures output in a neural-network post-filter group in sei message for coded bitstream |
| WO2025071301A1 (en) * | 2023-09-27 | 2025-04-03 | Lg Electronics Inc. | Method and apparatus for signaling purpose for neural-network post-filter grouping characteristic sei message for coded bitstream |
| WO2025065421A1 (zh) * | 2023-09-27 | 2025-04-03 | Oppo广东移动通信有限公司 | 编解码方法、编码器、解码器以及存储介质 |
| WO2025149364A1 (en) * | 2024-01-09 | 2025-07-17 | Interdigital Ce Patent Holdings, Sas | Neural network based loop filter multiscale improvement |
| WO2025156084A1 (zh) * | 2024-01-22 | 2025-07-31 | Oppo广东移动通信有限公司 | 编解码方法、编解码器、码流以及存储介质 |
| TW202545184A (zh) | 2024-04-15 | 2025-11-16 | 美商高通公司 | 用於視訊寫碼的適應性迴路濾波器(alf)及/或交叉分量alf |
| EP4661393A1 (en) * | 2024-06-05 | 2025-12-10 | InterDigital CE Patent Holdings, SAS | Classification-based post-filter rescaling |
| US20250392710A1 (en) | 2024-06-20 | 2025-12-25 | Qualcomm Incorporated | Temporal scalability for adaptive loop filter scaling factors for video coding |
| WO2026015303A1 (en) | 2024-07-08 | 2026-01-15 | Qualcomm Incorporated | Adaptive loop filter joint optimization in video coding |
| WO2026080199A1 (en) | 2024-10-11 | 2026-04-16 | Qualcomm Incorporated | Adaptive loop filter joint optimization for video coding |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015073196A (ja) * | 2013-10-02 | 2015-04-16 | 日本放送協会 | フィルタ選択装置、フィルタ装置およびこれらのプログラム |
| WO2019182159A1 (ja) * | 2018-03-23 | 2019-09-26 | シャープ株式会社 | 画像フィルタ装置、画像復号装置、及び画像符号化装置 |
Family Cites Families (36)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5790205A (en) * | 1996-08-23 | 1998-08-04 | Texas Instruments Incorporated | Method of increase sharpness in digital displays |
| US6289041B1 (en) * | 1997-02-11 | 2001-09-11 | Snaptrack, Inc. | Fast Acquisition, high sensitivity GPS receiver |
| US6347154B1 (en) * | 1999-04-08 | 2002-02-12 | Ati International Srl | Configurable horizontal scaler for video decoding and method therefore |
| US8013888B2 (en) * | 2005-02-14 | 2011-09-06 | Broadcom Corporation | Method and system for implementing film grain insertion |
| US7446820B2 (en) * | 2005-03-30 | 2008-11-04 | Intel Corporation | Methods and apparatus for re-scaling image by variable re-scaling factor using B-spline interpolator |
| US7539612B2 (en) | 2005-07-15 | 2009-05-26 | Microsoft Corporation | Coding and decoding scale factor information |
| US8446964B2 (en) * | 2005-07-18 | 2013-05-21 | Broadcom Corporation | Method and system for noise reduction with a motion compensated temporal filter |
| US8386271B2 (en) * | 2008-03-25 | 2013-02-26 | Microsoft Corporation | Lossless and near lossless scalable audio codec |
| US9094658B2 (en) * | 2010-05-10 | 2015-07-28 | Mediatek Inc. | Method and apparatus of adaptive loop filtering |
| KR101567467B1 (ko) * | 2011-05-10 | 2015-11-09 | 미디어텍 인크. | 루프내 필터 버퍼의 감소를 위한 방법 및 장치 |
| US9854275B2 (en) | 2011-06-25 | 2017-12-26 | Qualcomm Incorporated | Quantization in video coding |
| EP2713612A4 (en) | 2011-06-28 | 2014-11-26 | Samsung Electronics Co Ltd | PROCESS AND DEVICE FOR IMAGE CODING AND DECODING USING ADAPTIVE QUANTIZATION PARAMETER DIFFERENTIALS |
| US9300975B2 (en) * | 2011-09-11 | 2016-03-29 | Texas Instruments Incorporated | Concurrent access shared buffer in a video encoder |
| US9432700B2 (en) | 2011-09-27 | 2016-08-30 | Broadcom Corporation | Adaptive loop filtering in accordance with video coding |
| US9596463B2 (en) * | 2012-02-22 | 2017-03-14 | Qualcomm Incorporated | Coding of loop filter parameters using a codebook in video coding |
| US20140192898A1 (en) * | 2013-01-04 | 2014-07-10 | Intel Corporation | Coding unit bit number limitation |
| US9596465B2 (en) | 2013-01-04 | 2017-03-14 | Intel Corporation | Refining filter for inter layer prediction of scalable video coding |
| US9473784B2 (en) * | 2013-05-20 | 2016-10-18 | Texas Instruments Incorporated | Sample adaptive offset (SAO) filtering in video coding |
| US10708588B2 (en) * | 2013-06-19 | 2020-07-07 | Apple Inc. | Sample adaptive offset control |
| CN107615762B (zh) * | 2015-05-29 | 2020-06-26 | 寰发股份有限公司 | 一种管理解码图像缓存器并解码视频比特流的方法及装置 |
| US10425648B2 (en) * | 2015-09-29 | 2019-09-24 | Qualcomm Incorporated | Video intra-prediction using position-dependent prediction combination for video coding |
| WO2017068856A1 (ja) * | 2015-10-21 | 2017-04-27 | シャープ株式会社 | 予測画像生成装置、画像復号装置および画像符号化装置 |
| WO2017086740A1 (ko) * | 2015-11-18 | 2017-05-26 | 한국전자통신연구원 | 인루프 필터를 이용한 비디오 복호화 방법 및 이를 위한 장치 |
| US9998235B2 (en) * | 2016-01-08 | 2018-06-12 | Google Llc | In-band optical interference mitigation for direct-detection optical communication systems |
| EP3516877B1 (en) | 2016-12-01 | 2020-03-11 | Google LLC | Restoration in video coding using domain transform recursive filters |
| US10694181B2 (en) * | 2017-01-27 | 2020-06-23 | Qualcomm Incorporated | Bilateral filters in video coding with reduced complexity |
| US10645383B2 (en) * | 2018-05-31 | 2020-05-05 | Intel Corporation | Constrained directional enhancement filter selection for video coding |
| MX2021000173A (es) * | 2018-07-02 | 2021-05-27 | Huawei Tech Co Ltd | Aparato y metodo para filtrar en codificacion de video. |
| US10674151B2 (en) * | 2018-07-30 | 2020-06-02 | Intel Corporation | Adaptive in-loop filtering for video coding |
| US11284075B2 (en) | 2018-09-12 | 2022-03-22 | Qualcomm Incorporated | Prediction of adaptive loop filter parameters with reduced memory consumption for video coding |
| US10939102B2 (en) * | 2018-11-01 | 2021-03-02 | Mediatek Inc. | Post processing apparatus with super-resolution filter and loop restoration filter in block-level pipeline and associated post processing method |
| KR102154407B1 (ko) * | 2018-11-15 | 2020-09-09 | 한국전자기술연구원 | 타일 기반 스트리밍을 위한 모션 제한 av1 영상 부호화 방법 및 장치 |
| US11044473B2 (en) | 2018-12-21 | 2021-06-22 | Qualcomm Incorporated | Adaptive loop filtering classification in video coding |
| US10999606B2 (en) * | 2019-01-08 | 2021-05-04 | Intel Corporation | Method and system of neural network loop filtering for video coding |
| WO2021026322A1 (en) * | 2019-08-06 | 2021-02-11 | Op Solutions | Block-based adaptive resolution management |
| US11743459B2 (en) * | 2020-09-29 | 2023-08-29 | Qualcomm Incorporated | Filtering process for video coding |
-
2021
- 2021-09-23 US US17/448,547 patent/US11743459B2/en active Active
- 2021-09-24 CN CN202180063665.5A patent/CN116235494B/zh active Active
- 2021-09-24 JP JP2023515165A patent/JP2023542840A/ja active Pending
- 2021-09-24 TW TW110135680A patent/TWI908892B/zh active
- 2021-09-24 KR KR1020237009615A patent/KR20230078653A/ko active Pending
- 2021-09-24 PH PH1/2023/550132A patent/PH12023550132A1/en unknown
- 2021-09-24 WO PCT/US2021/051979 patent/WO2022072239A1/en not_active Ceased
- 2021-09-24 EP EP21791568.5A patent/EP4222953A1/en active Pending
- 2021-09-24 BR BR112023004483A patent/BR112023004483A2/pt unknown
-
2023
- 2023-05-11 US US18/316,150 patent/US12341959B2/en active Active
-
2025
- 2025-05-21 US US19/215,120 patent/US20250286996A1/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2015073196A (ja) * | 2013-10-02 | 2015-04-16 | 日本放送協会 | フィルタ選択装置、フィルタ装置およびこれらのプログラム |
| WO2019182159A1 (ja) * | 2018-03-23 | 2019-09-26 | シャープ株式会社 | 画像フィルタ装置、画像復号装置、及び画像符号化装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202213996A (zh) | 2022-04-01 |
| CN116235494B (zh) | 2026-03-31 |
| EP4222953A1 (en) | 2023-08-09 |
| BR112023004483A2 (pt) | 2023-04-04 |
| CN116235494A (zh) | 2023-06-06 |
| WO2022072239A1 (en) | 2022-04-07 |
| US20220103816A1 (en) | 2022-03-31 |
| US20250286996A1 (en) | 2025-09-11 |
| TWI908892B (zh) | 2025-12-21 |
| US12341959B2 (en) | 2025-06-24 |
| US11743459B2 (en) | 2023-08-29 |
| KR20230078653A (ko) | 2023-06-02 |
| US20230283772A1 (en) | 2023-09-07 |
| PH12023550132A1 (en) | 2024-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12341959B2 (en) | Filtering process for video coding | |
| US12356014B2 (en) | Multiple neural network models for filtering during video coding | |
| US20200366937A1 (en) | Low-frequency non-separable transform signaling based on zero-out patterns for video coding | |
| US11778213B2 (en) | Activation function design in neural network-based filtering process for video coding | |
| TW202115977A (zh) | 用於視訊編碼的跨分量自我調整迴路濾波 | |
| JP7637675B2 (ja) | ビデオコーディングのための変換スキップにおける残差値のためのコーディング方式をシグナリングすること | |
| US20200288130A1 (en) | Simplification of sub-block transforms in video coding | |
| US11368715B2 (en) | Block-based delta pulse code modulation for video coding | |
| US20210211685A1 (en) | Multiple transform set signaling for video coding | |
| US11729381B2 (en) | Deblocking filter parameter signaling | |
| JP2024501331A (ja) | ビデオコーディング中にフィルタ処理するための複数のニューラルネットワークモデル | |
| US12309400B2 (en) | Fixed bit depth processing for cross-component linear model (CCLM) mode in video coding | |
| JP2023544046A (ja) | 高ビット深度ビデオコーディングのためのライスパラメータ値の適応的な導出 | |
| CN116250233A (zh) | 具有最坏情况复杂度处理的扩展低频不可分离变换(lfnst)设计 | |
| JP2023517429A (ja) | ビデオコーディングのためのモノクロームパレットモード | |
| US11924410B2 (en) | Video coding using overlapped block motion compensation, combined inter-intra prediction, and/or luma mapping and chroma scaling | |
| CN116746146A (zh) | 在视频编解码期间用于滤波的多个神经网络模型 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20240909 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20240909 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20250725 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20250826 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20251110 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20260210 |