KR20230078653A - 비디오 코딩을 위한 필터링 프로세스 - Google Patents

비디오 코딩을 위한 필터링 프로세스 Download PDF

Info

Publication number
KR20230078653A
KR20230078653A KR1020237009615A KR20237009615A KR20230078653A KR 20230078653 A KR20230078653 A KR 20230078653A KR 1020237009615 A KR1020237009615 A KR 1020237009615A KR 20237009615 A KR20237009615 A KR 20237009615A KR 20230078653 A KR20230078653 A KR 20230078653A
Authority
KR
South Korea
Prior art keywords
block
filtered
samples
scaling factor
refined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020237009615A
Other languages
English (en)
Korean (ko)
Inventor
마르타 카르체비츠
홍타오 왕
지안레 천
벤카타 메헤르 사트칫 아난드 코트라
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20230078653A publication Critical patent/KR20230078653A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
KR1020237009615A 2020-09-29 2021-09-24 비디오 코딩을 위한 필터링 프로세스 Pending KR20230078653A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202063085094P 2020-09-29 2020-09-29
US63/085,094 2020-09-29
US17/448,547 2021-09-23
US17/448,547 US11743459B2 (en) 2020-09-29 2021-09-23 Filtering process for video coding
PCT/US2021/051979 WO2022072239A1 (en) 2020-09-29 2021-09-24 Filtering process for video coding

Publications (1)

Publication Number Publication Date
KR20230078653A true KR20230078653A (ko) 2023-06-02

Family

ID=80821963

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020237009615A Pending KR20230078653A (ko) 2020-09-29 2021-09-24 비디오 코딩을 위한 필터링 프로세스

Country Status (9)

Country Link
US (3) US11743459B2 (https=)
EP (1) EP4222953A1 (https=)
JP (1) JP2023542840A (https=)
KR (1) KR20230078653A (https=)
CN (1) CN116235494B (https=)
BR (1) BR112023004483A2 (https=)
PH (1) PH12023550132A1 (https=)
TW (1) TWI908892B (https=)
WO (1) WO2022072239A1 (https=)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11743459B2 (en) * 2020-09-29 2023-08-29 Qualcomm Incorporated Filtering process for video coding
US11792438B2 (en) 2020-10-02 2023-10-17 Lemon Inc. Using neural network filtering in video coding
US12022098B2 (en) * 2021-03-04 2024-06-25 Lemon Inc. Neural network-based in-loop filter with residual scaling for video coding
WO2023132564A1 (ko) * 2022-01-10 2023-07-13 현대자동차주식회사 인터 예측에서 디코더측 움직임벡터 리스트 수정을 위한 방법 및 장치
CN119072921A (zh) * 2022-04-20 2024-12-03 抖音视界有限公司 用于视频处理的方法、装置和介质
CN119213776A (zh) * 2022-05-24 2024-12-27 Oppo广东移动通信有限公司 一种环路滤波方法、视频编解码方法、装置和系统
CN119318150A (zh) * 2022-06-02 2025-01-14 Oppo广东移动通信有限公司 编解码方法、编码器、解码器以及存储介质
EP4542989A4 (en) * 2022-06-17 2026-04-15 Guangdong Oppo Mobile Telecommunications Corp Ltd FILTERING METHOD, DECODER, ENCODER AND COMPUTER-READABLE STORAGE MEDIA
US12598314B2 (en) 2022-07-05 2026-04-07 Qualcomm Incorporated Neural network based filtering process for multiple color components in video coding
WO2024025280A1 (en) * 2022-07-27 2024-02-01 Samsung Electronics Co., Ltd. Method and system for content-based scaling for artificial intelligence based in-loop filters
WO2024078599A1 (en) * 2022-10-13 2024-04-18 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
WO2024077576A1 (zh) * 2022-10-13 2024-04-18 Oppo广东移动通信有限公司 基于神经网络的环路滤波、视频编解码方法、装置和系统
WO2024151655A1 (en) * 2023-01-10 2024-07-18 Bytedance Inc. Indications of usage suitability of a bitstream or a post-processing filter and removal of sei messages
US20240283925A1 (en) * 2023-02-17 2024-08-22 Qualcomm Incorporated Methods for complexity reduction of neural network based video coding tools
JP2026503001A (ja) * 2023-04-14 2026-01-27 テンセント・アメリカ・エルエルシー デコーダ及びエンコーダによるビデオデータ処理方法、ビデオデータ処理デバイス、及びプログラム
WO2025002821A1 (en) * 2023-06-29 2025-01-02 Interdigital Ce Patent Holdings, Sas Loop filter training improvement
US20250008138A1 (en) * 2023-06-30 2025-01-02 Tencent America LLC Block level adaptive weighted prediction
WO2025011521A1 (en) * 2023-07-07 2025-01-16 Douyin Vision Co., Ltd. Neural-network post-filter on value ranges and coding methods of syntax elements
US20250106384A1 (en) * 2023-09-27 2025-03-27 Lg Electronics Inc. Method and apparatus for handling intermediary pictures output in a neural-network post-filter group in sei message for coded bitstream
WO2025071301A1 (en) * 2023-09-27 2025-04-03 Lg Electronics Inc. Method and apparatus for signaling purpose for neural-network post-filter grouping characteristic sei message for coded bitstream
WO2025065421A1 (zh) * 2023-09-27 2025-04-03 Oppo广东移动通信有限公司 编解码方法、编码器、解码器以及存储介质
WO2025149364A1 (en) * 2024-01-09 2025-07-17 Interdigital Ce Patent Holdings, Sas Neural network based loop filter multiscale improvement
WO2025156084A1 (zh) * 2024-01-22 2025-07-31 Oppo广东移动通信有限公司 编解码方法、编解码器、码流以及存储介质
TW202545184A (zh) 2024-04-15 2025-11-16 美商高通公司 用於視訊寫碼的適應性迴路濾波器（ａｌｆ）及／或交叉分量ａｌｆ
EP4661393A1 (en) * 2024-06-05 2025-12-10 InterDigital CE Patent Holdings, SAS Classification-based post-filter rescaling
US20250392710A1 (en) 2024-06-20 2025-12-25 Qualcomm Incorporated Temporal scalability for adaptive loop filter scaling factors for video coding
WO2026015303A1 (en) 2024-07-08 2026-01-15 Qualcomm Incorporated Adaptive loop filter joint optimization in video coding
WO2026080199A1 (en) 2024-10-11 2026-04-16 Qualcomm Incorporated Adaptive loop filter joint optimization for video coding

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790205A (en) * 1996-08-23 1998-08-04 Texas Instruments Incorporated Method of increase sharpness in digital displays
US6289041B1 (en) * 1997-02-11 2001-09-11 Snaptrack, Inc. Fast Acquisition, high sensitivity GPS receiver
US6347154B1 (en) * 1999-04-08 2002-02-12 Ati International Srl Configurable horizontal scaler for video decoding and method therefore
US8013888B2 (en) * 2005-02-14 2011-09-06 Broadcom Corporation Method and system for implementing film grain insertion
US7446820B2 (en) * 2005-03-30 2008-11-04 Intel Corporation Methods and apparatus for re-scaling image by variable re-scaling factor using B-spline interpolator
US7539612B2 (en) 2005-07-15 2009-05-26 Microsoft Corporation Coding and decoding scale factor information
US8446964B2 (en) * 2005-07-18 2013-05-21 Broadcom Corporation Method and system for noise reduction with a motion compensated temporal filter
US8386271B2 (en) * 2008-03-25 2013-02-26 Microsoft Corporation Lossless and near lossless scalable audio codec
US9094658B2 (en) * 2010-05-10 2015-07-28 Mediatek Inc. Method and apparatus of adaptive loop filtering
US20130322523A1 (en) * 2011-05-10 2013-12-05 Mediatek Inc. Method and apparatus for reduction of in-loop filter buffer
US9854275B2 (en) 2011-06-25 2017-12-26 Qualcomm Incorporated Quantization in video coding
WO2013002587A2 (ko) 2011-06-28 2013-01-03 삼성전자 주식회사 적응적인 양자화 파라미터 차분값을 이용한 영상의 부호화 및 복호화 방법과 장치
US9300975B2 (en) * 2011-09-11 2016-03-29 Texas Instruments Incorporated Concurrent access shared buffer in a video encoder
US9432700B2 (en) 2011-09-27 2016-08-30 Broadcom Corporation Adaptive loop filtering in accordance with video coding
US9596463B2 (en) * 2012-02-22 2017-03-14 Qualcomm Incorporated Coding of loop filter parameters using a codebook in video coding
US9596465B2 (en) 2013-01-04 2017-03-14 Intel Corporation Refining filter for inter layer prediction of scalable video coding
US20140192898A1 (en) * 2013-01-04 2014-07-10 Intel Corporation Coding unit bit number limitation
US9473784B2 (en) * 2013-05-20 2016-10-18 Texas Instruments Incorporated Sample adaptive offset (SAO) filtering in video coding
US10708588B2 (en) * 2013-06-19 2020-07-07 Apple Inc. Sample adaptive offset control
JP6311141B2 (ja) * 2013-10-02 2018-04-18 日本放送協会 フィルタ選択装置、フィルタ装置およびこれらのプログラム
EP3292691A4 (en) * 2015-05-29 2019-01-23 HFI Innovation Inc. METHOD OF MANAGING A DECODED IMAGE DEVICE FOR INTRABLOCK COPYING MODE
US10425648B2 (en) * 2015-09-29 2019-09-24 Qualcomm Incorporated Video intra-prediction using position-dependent prediction combination for video coding
CN108141609A (zh) * 2015-10-21 2018-06-08 夏普株式会社 预测图像生成装置、图像解码装置以及图像编码装置
KR20170058869A (ko) * 2015-11-18 2017-05-29 한국전자통신연구원 인루프 필터를 이용한 비디오 복호화 방법 및 이를 위한 장치
US9998235B2 (en) * 2016-01-08 2018-06-12 Google Llc In-band optical interference mitigation for direct-detection optical communication systems
CN113873237B (zh) 2016-12-01 2023-12-29 谷歌有限责任公司 用于恢复由重构产生的劣化帧的劣化图块的方法和装置
US10694181B2 (en) * 2017-01-27 2020-06-23 Qualcomm Incorporated Bilateral filters in video coding with reduced complexity
WO2019182159A1 (ja) * 2018-03-23 2019-09-26 シャープ株式会社 画像フィルタ装置、画像復号装置、及び画像符号化装置
US10645383B2 (en) * 2018-05-31 2020-05-05 Intel Corporation Constrained directional enhancement filter selection for video coding
CN112369037B (zh) * 2018-07-02 2022-04-22 华为技术有限公司 视频编解码中的滤波装置和方法
US10674151B2 (en) * 2018-07-30 2020-06-02 Intel Corporation Adaptive in-loop filtering for video coding
US11284075B2 (en) 2018-09-12 2022-03-22 Qualcomm Incorporated Prediction of adaptive loop filter parameters with reduced memory consumption for video coding
US10939102B2 (en) * 2018-11-01 2021-03-02 Mediatek Inc. Post processing apparatus with super-resolution filter and loop restoration filter in block-level pipeline and associated post processing method
KR102154407B1 (ko) * 2018-11-15 2020-09-09 한국전자기술연구원 타일 기반 스트리밍을 위한 모션 제한 av1 영상 부호화 방법 및 장치
US11044473B2 (en) 2018-12-21 2021-06-22 Qualcomm Incorporated Adaptive loop filtering classification in video coding
US10999606B2 (en) * 2019-01-08 2021-05-04 Intel Corporation Method and system of neural network loop filtering for video coding
WO2021026322A1 (en) * 2019-08-06 2021-02-11 Op Solutions Block-based adaptive resolution management
US11743459B2 (en) * 2020-09-29 2023-08-29 Qualcomm Incorporated Filtering process for video coding

Also Published As

Publication number Publication date
CN116235494A (zh) 2023-06-06
US12341959B2 (en) 2025-06-24
EP4222953A1 (en) 2023-08-09
BR112023004483A2 (pt) 2023-04-04
PH12023550132A1 (en) 2024-06-24
CN116235494B (zh) 2026-03-31
JP2023542840A (ja) 2023-10-12
US20230283772A1 (en) 2023-09-07
WO2022072239A1 (en) 2022-04-07
US20250286996A1 (en) 2025-09-11
US20220103816A1 (en) 2022-03-31
TW202213996A (zh) 2022-04-01
US11743459B2 (en) 2023-08-29
TWI908892B (zh) 2025-12-21

Similar Documents

Publication Publication Date Title
JP7795528B2 (ja) ビデオコーディング中にフィルタ処理するための複数のニューラルネットワークモデル
US12341959B2 (en) Filtering process for video coding
JP7637675B2 (ja) ビデオコーディングのための変換スキップにおける残差値のためのコーディング方式をシグナリングすること
JP7574231B2 (ja) ビデオコーディングにおけるクロマデルタ量子化パラメータ
KR20230078658A (ko) 비디오 코딩을 위한 뉴럴 네트워크-기반 필터링 프로세스에서의 활성화 함수 설계
EP4082211A1 (en) Lfnst signaling for chroma based on chroma transform skip
EP3935840A2 (en) Simplification of sub-block transforms in video coding
EP4186235B1 (en) Deblocking filter parameter signaling
KR20220115974A (ko) 비디오 코딩을 위한 다중 변환 세트 시그널링
KR20230129015A (ko) 비디오 코딩 동안의 필터링을 위한 다수의 신경망 모델들
KR20220036945A (ko) 팔레트 및 예측 모드 시그널링
KR20230002323A (ko) 비디오 코딩을 위한 적응적 스케일링 리스트 제어
WO2021061731A1 (en) Mode dependent block partition for lossless and mixed lossless and lossy video coding
WO2021055773A1 (en) Reference picture constraint for decoder side motion refinement and bi-directional optical flow
KR20230080407A (ko) 최악의 경우의 복잡성 핸들링을 갖는 확장된 저-주파수 비-분리가능한 변환 (lfnst) 설계들
EP4066490A1 (en) Flexible signaling of qp offset for adaptive color transform in video coding

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20230320

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20240906

Comment text: Request for Examination of Application