BR112023004814A2 - Múltiplos modelos de rede neural para filtragem durante a codificação de vídeo - Google Patents

Múltiplos modelos de rede neural para filtragem durante a codificação de vídeo

Info

Publication number
BR112023004814A2
BR112023004814A2 BR112023004814A BR112023004814A BR112023004814A2 BR 112023004814 A2 BR112023004814 A2 BR 112023004814A2 BR 112023004814 A BR112023004814 A BR 112023004814A BR 112023004814 A BR112023004814 A BR 112023004814A BR 112023004814 A2 BR112023004814 A2 BR 112023004814A2
Authority
BR
Brazil
Prior art keywords
neural network
network models
video encoding
filtering
during video
Prior art date
Application number
BR112023004814A
Other languages
English (en)
Portuguese (pt)
Inventor
Wang Hongtao
Meher Satchit Anand KOTRA Venkata
Chen Jianle
Karczewicz Marta
Kianfar Dana
Joris Wiggers Auke
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of BR112023004814A2 publication Critical patent/BR112023004814A2/pt

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • G06T9/002Image coding using neural networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/129Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/13Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/192Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/86Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving reduction of coding artifacts, e.g. of blockiness
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
BR112023004814A 2020-09-29 2021-09-24 Múltiplos modelos de rede neural para filtragem durante a codificação de vídeo BR112023004814A2 (pt)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063085092P 2020-09-29 2020-09-29
US17/448,658 US11930215B2 (en) 2020-09-29 2021-09-23 Multiple neural network models for filtering during video coding
PCT/US2021/052008 WO2022072245A1 (en) 2020-09-29 2021-09-24 Multiple neural network models for filtering during video coding

Publications (1)

Publication Number Publication Date
BR112023004814A2 true BR112023004814A2 (pt) 2023-04-18

Family

ID=80821639

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112023004814A BR112023004814A2 (pt) 2020-09-29 2021-09-24 Múltiplos modelos de rede neural para filtragem durante a codificação de vídeo

Country Status (8)

Country Link
US (3) US11930215B2 (https=)
EP (1) EP4222960A1 (https=)
JP (1) JP7795528B2 (https=)
KR (1) KR20230079360A (https=)
CN (1) CN116349226A (https=)
BR (1) BR112023004814A2 (https=)
PH (1) PH12023550197A1 (https=)
WO (1) WO2022072245A1 (https=)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11930215B2 (en) 2020-09-29 2024-03-12 Qualcomm Incorporated Multiple neural network models for filtering during video coding
US11716469B2 (en) * 2020-12-10 2023-08-01 Lemon Inc. Model selection in neural network-based in-loop filter for video coding
US20220321919A1 (en) * 2021-03-23 2022-10-06 Sharp Kabushiki Kaisha Systems and methods for signaling neural network-based in-loop filter parameter information in video coding
US12113995B2 (en) * 2021-04-06 2024-10-08 Lemon Inc. Neural network-based post filter for video coding
US11979591B2 (en) * 2021-04-06 2024-05-07 Lemon Inc. Unified neural network in-loop filter
US12323608B2 (en) * 2021-04-07 2025-06-03 Lemon Inc On neural network-based filtering for imaging/video coding
US12095988B2 (en) 2021-06-30 2024-09-17 Lemon, Inc. External attention in neural network-based video coding
US12603998B2 (en) 2021-07-07 2026-04-14 Lemon Inc. Configurable neural network model depth in neural network-based video coding
US20230051066A1 (en) * 2021-07-27 2023-02-16 Lemon Inc. Partitioning Information In Neural Network-Based Video Coding
WO2023158127A1 (ko) * 2022-02-21 2023-08-24 현대자동차주식회사 트랜스포머 기반 인루프 필터를 이용하는 비디오 코딩을 위한 방법 및 장치
CN119422374A (zh) * 2022-06-16 2025-02-11 抖音视界有限公司 基于可变速率神经网络的压缩
WO2023245194A1 (en) * 2022-06-17 2023-12-21 Bytedance Inc. Partitioning information in neural network-based video coding
WO2023245544A1 (zh) * 2022-06-23 2023-12-28 Oppo广东移动通信有限公司 编解码方法、码流、编码器、解码器以及存储介质
US12598314B2 (en) * 2022-07-05 2026-04-07 Qualcomm Incorporated Neural network based filtering process for multiple color components in video coding
TW202404371A (zh) * 2022-07-05 2024-01-16 美商高通公司 視訊譯碼中用於多種顏色分量的基於神經網路的濾波程序
WO2024009967A1 (ja) * 2022-07-05 2024-01-11 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 復号装置、符号化装置、復号方法、および符号化方法
WO2024011386A1 (zh) * 2022-07-11 2024-01-18 浙江大学 一种编解码方法、装置、编码器、解码器及存储介质
WO2024078599A1 (en) * 2022-10-13 2024-04-18 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
WO2024080904A1 (en) * 2022-10-13 2024-04-18 Telefonaktiebolaget Lm Ericsson (Publ) Selective application of neural network based filtering to picture regions
WO2024178432A1 (en) * 2023-02-24 2024-08-29 Google Llc Switchable machine-learning models on common inference hardware for video coding
WO2024245299A1 (en) * 2023-05-29 2024-12-05 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
US12581126B2 (en) * 2023-06-12 2026-03-17 Qualcomm Incorporated Low complexity NN-based in loop filter architectures with separable convolution
JPWO2025009295A1 (https=) * 2023-07-03 2025-01-09
CN120345242A (zh) * 2023-07-05 2025-07-18 Lg电子株式会社 图像编码/解码方法、存储比特流的记录介质和发送比特流的方法
WO2025048289A1 (ko) * 2023-08-25 2025-03-06 현대자동차주식회사 디코더 역량에 따라 신경망 기반 비디오 코딩 툴들을 제어하기 위한 방법
WO2025071276A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025071272A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025071278A1 (ko) * 2023-09-27 2025-04-03 엘지전자 주식회사 영상 부호화/복호화 방법, 비트스트림을 전송하는 방법 및 비트스트림을 저장한 기록 매체
WO2025129910A1 (en) * 2023-12-21 2025-06-26 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Dynamic mesh base geometry coding position adjustment method
WO2025131105A1 (en) * 2023-12-22 2025-06-26 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
CN120238656A (zh) * 2023-12-28 2025-07-01 维沃移动通信有限公司 视频压缩处理方法、装置及电子设备
CN119854487A (zh) * 2025-01-06 2025-04-18 深圳传音控股股份有限公司 图像处理方法、处理设备及存储介质

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8325797B2 (en) * 2005-04-11 2012-12-04 Maxim Integrated Products, Inc. System and method of reduced-temporal-resolution update for video coding and quality control
WO2019009448A1 (ko) 2017-07-06 2019-01-10 삼성전자 주식회사 영상을 부호화 또는 복호화하는 방법 및 장치
US11631199B2 (en) 2017-08-10 2023-04-18 Sharp Kabushiki Kaisha Image filtering apparatus, image decoding apparatus, and image coding apparatus
EP3451293A1 (en) 2017-08-28 2019-03-06 Thomson Licensing Method and apparatus for filtering with multi-branch deep learning
CN109819253B (zh) * 2017-11-21 2022-04-22 腾讯科技(深圳)有限公司 视频编码方法、装置、计算机设备和存储介质
CN108184129B (zh) * 2017-12-11 2020-01-10 北京大学 一种视频编解码方法、装置及用于图像滤波的神经网络
WO2019244116A1 (en) * 2018-06-21 2019-12-26 Beijing Bytedance Network Technology Co., Ltd. Border partition in video coding
US11720997B2 (en) 2018-10-19 2023-08-08 Samsung Electronics Co.. Ltd. Artificial intelligence (AI) encoding device and operating method thereof and AI decoding device and operating method thereof
US11282172B2 (en) * 2018-12-11 2022-03-22 Google Llc Guided restoration of video data using neural networks
US10999606B2 (en) * 2019-01-08 2021-05-04 Intel Corporation Method and system of neural network loop filtering for video coding
EP3706046A1 (en) 2019-03-04 2020-09-09 InterDigital VC Holdings, Inc. Method and device for picture encoding and decoding
TWI747339B (zh) * 2019-06-27 2021-11-21 聯發科技股份有限公司 視訊編解碼之方法和裝置
US11363307B2 (en) * 2019-08-08 2022-06-14 Hfi Innovation Inc. Video coding with subpictures
US20220295116A1 (en) * 2019-09-20 2022-09-15 Intel Corporation Convolutional neural network loop filter based on classifier
US11930215B2 (en) 2020-09-29 2024-03-12 Qualcomm Incorporated Multiple neural network models for filtering during video coding

Also Published As

Publication number Publication date
JP2023542841A (ja) 2023-10-12
JP7795528B2 (ja) 2026-01-07
WO2022072245A1 (en) 2022-04-07
PH12023550197A1 (en) 2024-06-24
KR20230079360A (ko) 2023-06-07
US20250317604A1 (en) 2025-10-09
EP4222960A1 (en) 2023-08-09
US20220103864A1 (en) 2022-03-31
CN116349226A (zh) 2023-06-27
US20240244265A1 (en) 2024-07-18
TW202218422A (zh) 2022-05-01
US11930215B2 (en) 2024-03-12
US12356014B2 (en) 2025-07-08

Similar Documents

Publication Publication Date Title
BR112023004814A2 (pt) Múltiplos modelos de rede neural para filtragem durante a codificação de vídeo
BR112023004483A2 (pt) Processo de filtragem para codificação de vídeo
BR112021018855A2 (pt) Seleção de multitransformadas estendida para codificação de vídeo
SA518392315B1 (ar) ترميز بيانات ڤيديو باستخدام إطار شجري متعدد الأنواع ذو مستويين
PH12022552472A1 (en) Parameter set syntax elements and variables in video coding
MY209767A (en) Relation between partition constraint elements
BR112016008044A8 (pt) codificador de vídeo ou imagem, decodificador de vídeo ou imagem e meio legível por computador
BR112014030605A2 (pt) sinalização de dados para imagens de referência de longo prazo para codificação de vídeo
BR112021021397A2 (pt) Filtragem de sinal de predição em predição intra ponderada linear afim
BR112017018441A2 (pt) codificador de áudio para codificação de um sinal multicanal e decodificador de áudio para decodificação de um sinal de áudio codificado
BR112017007070A2 (pt) derivação e deslocamento de qp para transformada de cor adaptativa em codificação de vídeo
BR112017025634A2 (pt) cópia intrablocos em nível de fatia e outros avanços na codificação de vídeo
BR112018073380A2 (pt) confusão de múltiplos filtros em filtragem de loop adaptativa em codificação de vídeo
JP2016518050A5 (https=)
BR112014013373A8 (pt) codificação de bits menos significativos dos valores de contagem de ordem de imagem identificando imagens de referência de longo termo
MY177213A (en) Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
BR112014032473A2 (pt) sinalização de imagens de referência de longo prazo para codificação de vídeo
BR112022011828A2 (pt) Codificador, decodificador de vídeo e seus métodos
BR112022019172A2 (pt) Sinalização de índice de transformada não separável de baixa frequência em codificação de vídeo
BR112018015266A2 (pt) método e dispositivo para codificação/decodificação intra-preditiva de uma unidade de codificação compreendendo dados de imagem, a dita codificação intra-preditiva dependendo de uma árvore de predição e de uma árvore de transformadas
MY206252A (en) Encoding and decoding audio signals
MX2024004260A (es) Un codificador de video, un decodificador de video y metodos correspondientes.
CO2021003109A2 (es) Predicción temporal de parámetros de filtro de bucle adaptativo con consumo de memoria reducido para codificación de video
WO2021178570A3 (en) Video coding syntax
MX2024012959A (es) Codificador, decodificador, metodo de codificacion y metodo de decodificacion