PH12023550197A1 - Multiple neural network models for filtering during video coding - Google Patents

Multiple neural network models for filtering during video coding

Info

Publication number
PH12023550197A1
PH12023550197A1 PH1/2023/550197A PH12023550197A PH12023550197A1 PH 12023550197 A1 PH12023550197 A1 PH 12023550197A1 PH 12023550197 A PH12023550197 A PH 12023550197A PH 12023550197 A1 PH12023550197 A1 PH 12023550197A1
Authority
PH
Philippines
Prior art keywords
neural network
network models
video coding
during video
multiple neural
Prior art date
Application number
PH1/2023/550197A
Other languages
English (en)
Inventor
Jianle Chen
Marta Karczewicz
Dana Kianfar
Venkata Meher Satchit Anand Kotra
Hongtao Wang
Auke Joris Wiggers
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of PH12023550197A1 publication Critical patent/PH12023550197A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
PH1/2023/550197A 2020-09-29 2021-09-24 Multiple neural network models for filtering during video coding PH12023550197A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063085092P 2020-09-29 2020-09-29
US17/448,658 US11930215B2 (en) 2020-09-29 2021-09-23 Multiple neural network models for filtering during video coding
PCT/US2021/052008 WO2022072245A1 (en) 2020-09-29 2021-09-24 Multiple neural network models for filtering during video coding

Publications (1)

Publication Number Publication Date
PH12023550197A1 true PH12023550197A1 (en) 2024-06-24

Family

ID=80821639

Family Applications (1)

Application Number Title Priority Date Filing Date
PH1/2023/550197A PH12023550197A1 (en) 2020-09-29 2021-09-24 Multiple neural network models for filtering during video coding

Country Status (8)

Country Link
US (3) US11930215B2 (https=)
EP (1) EP4222960A1 (https=)
JP (1) JP7795528B2 (https=)
KR (1) KR20230079360A (https=)
CN (1) CN116349226A (https=)
BR (1) BR112023004814A2 (https=)
PH (1) PH12023550197A1 (https=)
WO (1) WO2022072245A1 (https=)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11930215B2 (en) 2020-09-29 2024-03-12 Qualcomm Incorporated Multiple neural network models for filtering during video coding
US11716469B2 (en) * 2020-12-10 2023-08-01 Lemon Inc. Model selection in neural network-based in-loop filter for video coding
US20220321919A1 (en) * 2021-03-23 2022-10-06 Sharp Kabushiki Kaisha Systems and methods for signaling neural network-based in-loop filter parameter information in video coding
US12113995B2 (en) * 2021-04-06 2024-10-08 Lemon Inc. Neural network-based post filter for video coding
US11979591B2 (en) * 2021-04-06 2024-05-07 Lemon Inc. Unified neural network in-loop filter
US12323608B2 (en) * 2021-04-07 2025-06-03 Lemon Inc On neural network-based filtering for imaging/video coding
US12095988B2 (en) 2021-06-30 2024-09-17 Lemon, Inc. External attention in neural network-based video coding
US12603998B2 (en) 2021-07-07 2026-04-14 Lemon Inc. Configurable neural network model depth in neural network-based video coding
US20230051066A1 (en) * 2021-07-27 2023-02-16 Lemon Inc. Partitioning Information In Neural Network-Based Video Coding
WO2023158127A1 (ko) * 2022-02-21 2023-08-24 현대자동차주식회사 트랜스포머 기반 인루프 필터를 이용하는 비디오 코딩을 위한 방법 및 장치
CN119422374A (zh) * 2022-06-16 2025-02-11 抖音视界有限公司 基于可变速率神经网络的压缩
WO2023245194A1 (en) * 2022-06-17 2023-12-21 Bytedance Inc. Partitioning information in neural network-based video coding
WO2023245544A1 (zh) * 2022-06-23 2023-12-28 Oppo广东移动通信有限公司 编解码方法、码流、编码器、解码器以及存储介质
US12598314B2 (en) * 2022-07-05 2026-04-07 Qualcomm Incorporated Neural network based filtering process for multiple color components in video coding
TW202404371A (zh) * 2022-07-05 2024-01-16 美商高通公司 視訊譯碼中用於多種顏色分量的基於神經網路的濾波程序
WO2024009967A1 (ja) * 2022-07-05 2024-01-11 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 復号装置、符号化装置、復号方法、および符号化方法
WO2024011386A1 (zh) * 2022-07-11 2024-01-18 浙江大学 一种编解码方法、装置、编码器、解码器及存储介质
WO2024078599A1 (en) * 2022-10-13 2024-04-18 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
WO2024080904A1 (en) * 2022-10-13 2024-04-18 Telefonaktiebolaget Lm Ericsson (Publ) Selective application of neural network based filtering to picture regions
WO2024178432A1 (en) * 2023-02-24 2024-08-29 Google Llc Switchable machine-learning models on common inference hardware for video coding
WO2024245299A1 (en) * 2023-05-29 2024-12-05 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
US12581126B2 (en) * 2023-06-12 2026-03-17 Qualcomm Incorporated Low complexity NN-based in loop filter architectures with separable convolution
JPWO2025009295A1 (https=) * 2023-07-03 2025-01-09
CN120345242A (zh) * 2023-07-05 2025-07-18 Lg电子株式会社 图像编码/解码方法、存储比特流的记录介质和发送比特流的方法
WO2025048289A1 (ko) * 2023-08-25 2025-03-06 현대자동차주식회사 디코더 역량에 따라 신경망 기반 비디오 코딩 툴들을 제어하기 위한 방법
WO2025071276A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025071272A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025071278A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025129910A1 (en) * 2023-12-21 2025-06-26 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Dynamic mesh base geometry coding position adjustment method
WO2025131105A1 (en) * 2023-12-22 2025-06-26 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
CN120238656A (zh) * 2023-12-28 2025-07-01 维沃移动通信有限公司 视频压缩处理方法、装置及电子设备
CN119854487A (zh) * 2025-01-06 2025-04-18 深圳传音控股股份有限公司 图像处理方法、处理设备及存储介质

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8325797B2 (en) * 2005-04-11 2012-12-04 Maxim Integrated Products, Inc. System and method of reduced-temporal-resolution update for video coding and quality control
WO2019009448A1 (ko) 2017-07-06 2019-01-10 삼성전자 주식회사 영상을 부호화 또는 복호화하는 방법 및 장치
US11631199B2 (en) 2017-08-10 2023-04-18 Sharp Kabushiki Kaisha Image filtering apparatus, image decoding apparatus, and image coding apparatus
EP3451293A1 (en) 2017-08-28 2019-03-06 Thomson Licensing Method and apparatus for filtering with multi-branch deep learning
CN109819253B (zh) * 2017-11-21 2022-04-22 腾讯科技（深圳）有限公司 视频编码方法、装置、计算机设备和存储介质
CN108184129B (zh) * 2017-12-11 2020-01-10 北京大学 一种视频编解码方法、装置及用于图像滤波的神经网络
WO2019244116A1 (en) * 2018-06-21 2019-12-26 Beijing Bytedance Network Technology Co., Ltd. Border partition in video coding
US11720997B2 (en) 2018-10-19 2023-08-08 Samsung Electronics Co.. Ltd. Artificial intelligence (AI) encoding device and operating method thereof and AI decoding device and operating method thereof
US11282172B2 (en) * 2018-12-11 2022-03-22 Google Llc Guided restoration of video data using neural networks
US10999606B2 (en) * 2019-01-08 2021-05-04 Intel Corporation Method and system of neural network loop filtering for video coding
EP3706046A1 (en) 2019-03-04 2020-09-09 InterDigital VC Holdings, Inc. Method and device for picture encoding and decoding
TWI747339B (zh) * 2019-06-27 2021-11-21 聯發科技股份有限公司 視訊編解碼之方法和裝置
US11363307B2 (en) * 2019-08-08 2022-06-14 Hfi Innovation Inc. Video coding with subpictures
US20220295116A1 (en) * 2019-09-20 2022-09-15 Intel Corporation Convolutional neural network loop filter based on classifier
US11930215B2 (en) 2020-09-29 2024-03-12 Qualcomm Incorporated Multiple neural network models for filtering during video coding

Also Published As

Publication number Publication date
JP2023542841A (ja) 2023-10-12
JP7795528B2 (ja) 2026-01-07
WO2022072245A1 (en) 2022-04-07
KR20230079360A (ko) 2023-06-07
US20250317604A1 (en) 2025-10-09
EP4222960A1 (en) 2023-08-09
US20220103864A1 (en) 2022-03-31
CN116349226A (zh) 2023-06-27
BR112023004814A2 (pt) 2023-04-18
US20240244265A1 (en) 2024-07-18
TW202218422A (zh) 2022-05-01
US11930215B2 (en) 2024-03-12
US12356014B2 (en) 2025-07-08

Similar Documents

Publication Publication Date Title
PH12023550197A1 (en) Multiple neural network models for filtering during video coding
PH12023550132A1 (en) Filtering process for video coding
MX2021002284A (es) Relacion entre elementos de restriccion de particion.
PH12022552472A1 (en) Parameter set syntax elements and variables in video coding
MY170982A (en) Coding least significant bits of picture order count values identifying long-term reference pictures
JP2018129837A5 (https=)
JP2018532319A5 (https=)
MY183211A (en) Palette index grouping for video coding
JP2017523672A5 (https=)
PT1649723E (pt) Sintetizador multicanal e processo de geração de um sinal de saída multicanal
MY154342A (en) Technique for simulating film grain on encoded video
MX2016004643A (es) Dispositivo y metodo para codificacion escalable de informacion de video.
ATE182041T1 (de) Kompakte quellencodierungstabellen für codierungs-/decodierungssystem
WO2021178570A3 (en) Video coding syntax
MX2020013276A (es) Dispositivo de codificacion, metodo de codificacion, dispositivo de descodificacion y metodo de descodificacion.
ZA202107664B (en) Probability initialization for video coding
SA521421337B1 (ar) تنبؤ زمني لمتغيرات مرشِّح حلقي تكيفي مع انخفاض استهلاك ذاكرة لترميز فيديو
CN110276811A (zh) 图像转换方法、装置、电子设备及可读存储介质
PH12021550184A1 (en) Deblocking filter for video coding and processing
KR101727449B1 (ko) 영상 양자화 파라미터 복호 방법
CN107018426A (zh) 用于图像和视频编码的二进制化器选择
CN105718429B (zh) 巡检报告生成的方法及装置
CN111010534A (zh) 实时异步视频分析方法及系统
DE602006005045D1 (de) Verlustlose codierung von informationen mit garantierter maximaler bitrate
ZA202206940B (en) Picture header presence