BR112023005436A2 - Filtração baseada em rede neural de componente conjunto durante codificação de vídeo - Google Patents

Filtração baseada em rede neural de componente conjunto durante codificação de vídeo

Info

Publication number
BR112023005436A2
BR112023005436A2 BR112023005436A BR112023005436A BR112023005436A2 BR 112023005436 A2 BR112023005436 A2 BR 112023005436A2 BR 112023005436 A BR112023005436 A BR 112023005436A BR 112023005436 A BR112023005436 A BR 112023005436A BR 112023005436 A2 BR112023005436 A2 BR 112023005436A2
Authority
BR
Brazil
Prior art keywords
color component
neural network
filtered
size
component
Prior art date
Application number
BR112023005436A
Other languages
English (en)
Portuguese (pt)
Inventor
Chen Jianle
Wang Hongtao
Meher Satchit Anand KOTRA Venkata
Karczewicz Marta
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of BR112023005436A2 publication Critical patent/BR112023005436A2/pt

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • H04N19/82—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation involving filtering within a prediction loop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Processing (AREA)
BR112023005436A 2020-10-05 2021-10-05 Filtração baseada em rede neural de componente conjunto durante codificação de vídeo BR112023005436A2 (pt)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US202063087784P 2020-10-05 2020-10-05
US17/493,543 US11825101B2 (en) 2020-10-05 2021-10-04 Joint-component neural network based filtering during video coding
PCT/US2021/053490 WO2022076355A1 (en) 2020-10-05 2021-10-05 Joint-component neural network based filtering during video coding

Publications (1)

Publication Number Publication Date
BR112023005436A2 true BR112023005436A2 (pt) 2023-05-09

Family

ID=80931851

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112023005436A BR112023005436A2 (pt) 2020-10-05 2021-10-05 Filtração baseada em rede neural de componente conjunto durante codificação de vídeo

Country Status (7)

Country Link
US (1) US11825101B2 (https=)
EP (1) EP4226632A1 (https=)
JP (1) JP2023544705A (https=)
KR (1) KR20230081701A (https=)
CN (1) CN116508321A (https=)
BR (1) BR112023005436A2 (https=)
WO (1) WO2022076355A1 (https=)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116866574A (zh) * 2019-06-25 2023-10-10 日本放送协会 帧内预测装置、图像解码装置及程序
EP4256788A4 (en) * 2020-12-04 2025-02-26 Beijing Dajia Internet Information Technology Co., Ltd. NETWORK BASED IMAGE FILTERING FOR VIDEO CODING
US12212776B2 (en) * 2021-09-24 2025-01-28 Apple Inc. Systems and methods for low resolution motion estimation searches
US12555201B2 (en) * 2021-12-14 2026-02-17 Netflix, Inc. Techniques for component-based image preprocessing
CN119404507A (zh) * 2022-04-12 2025-02-07 韩国电子通信研究院 用于使用帧内块复制的视频编码/解码的方法和设备
WO2023198057A1 (en) * 2022-04-12 2023-10-19 Beijing Bytedance Network Technology Co., Ltd. Method, apparatus, and medium for video processing
WO2023241690A1 (en) * 2022-06-16 2023-12-21 Douyin Vision (Beijing) Co., Ltd. Variable-rate neural network based compression
CN119547445A (zh) * 2022-07-04 2025-02-28 杜比实验室特许公司 使用神经网络进行环路滤波
KR20240019638A (ko) * 2022-08-04 2024-02-14 삼성전자주식회사 크로마 성분 예측을 수행하는 ai에 기반한 비디오 복호화 장치 및 방법, 및 비디오 부호화 장치 및 방법
US20240080462A1 (en) * 2022-09-06 2024-03-07 Apple Inc. Systems and Methods for Low-Resolution Motion Estimation Searches
WO2024146446A1 (en) * 2023-01-04 2024-07-11 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
CN120569959A (zh) * 2023-01-11 2025-08-29 抖音视界有限公司 用于视频处理的方法、装置和介质
US12593040B2 (en) * 2023-02-08 2026-03-31 Mediatek Inc. Method and apparatus for improving performance of neural network filter based video coding
CN120898426A (zh) * 2023-03-22 2025-11-04 抖音视界有限公司 用于可视数据处理的方法、装置和介质
WO2024222745A1 (en) * 2023-04-25 2024-10-31 Douyin Vision Co., Ltd. Method, apparatus, and medium for video processing
US12457368B2 (en) * 2023-06-12 2025-10-28 Qualcomm Incorporated NN-based in loop filter architectures with separable convolution and switching order of decomposition
US20240422361A1 (en) * 2023-06-14 2024-12-19 Qualcomm Incorporated Neural network based in loop filter architecture with unified supplementary data processing for video coding
CN121753335A (zh) * 2023-08-26 2026-03-27 抖音视界有限公司 用于可视数据处理的方法、装置和介质
US12581085B2 (en) * 2024-05-13 2026-03-17 Tencent America LLC CCSO with filter shapes

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180041778A1 (en) * 2016-08-02 2018-02-08 Qualcomm Incorporated Geometry transformation-based adaptive loop filtering
US10419757B2 (en) * 2016-08-31 2019-09-17 Qualcomm Incorporated Cross-component filter
WO2019009449A1 (ko) * 2017-07-06 2019-01-10 삼성전자 주식회사 영상을 부호화/복호화 하는 방법 및 그 장치
EP3451670A1 (en) * 2017-08-28 2019-03-06 Thomson Licensing Method and apparatus for filtering with mode-aware deep learning
US11363302B2 (en) * 2017-10-12 2022-06-14 Mediatek Inc. Method and apparatus of neural network for video coding
CN108184129B (zh) * 2017-12-11 2020-01-10 北京大学 一种视频编解码方法、装置及用于图像滤波的神经网络
US20190246122A1 (en) * 2018-02-08 2019-08-08 Qualcomm Incorporated Palette coding for video coding
JP7073186B2 (ja) * 2018-05-14 2022-05-23 シャープ株式会社 画像フィルタ装置
WO2020047536A1 (en) * 2018-08-31 2020-03-05 Board Of Regents, University Of Texas System Deep learning based dosed prediction for treatment planning and quality assurance in radiation therapy
US11284075B2 (en) * 2018-09-12 2022-03-22 Qualcomm Incorporated Prediction of adaptive loop filter parameters with reduced memory consumption for video coding
EP3706046A1 (en) 2019-03-04 2020-09-09 InterDigital VC Holdings, Inc. Method and device for picture encoding and decoding
EP3941057A4 (en) * 2019-03-24 2022-06-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. FILTERING METHOD AND APPARATUS, ENCODER AND COMPUTER STORAGE MEDIUM

Also Published As

Publication number Publication date
JP2023544705A (ja) 2023-10-25
KR20230081701A (ko) 2023-06-07
EP4226632A1 (en) 2023-08-16
US20220109860A1 (en) 2022-04-07
WO2022076355A1 (en) 2022-04-14
CN116508321A (zh) 2023-07-28
US11825101B2 (en) 2023-11-21

Similar Documents

Publication Publication Date Title
BR112023005436A2 (pt) Filtração baseada em rede neural de componente conjunto durante codificação de vídeo
BR112015006481A2 (pt) momentos de remoção de armazenamento de imagem codificada independente de unidade de acesso em codificação de vídeo
BR112022022058A2 (pt) Elementos de sintaxe de conjunto de parâmetros e variáveis em codificação de vídeo
BR0212375A (pt) estabilização de imagem usando combinação de cor
BR112022027120A2 (pt) Material de embalagem, rede de material de embalagem, material de rede de embalagem e rede de material de rede de embalagem
BR112016029691A8 (pt) projeto extensível de mensagens da informação suplementar do realce (sei) de aninhamento
BR112021024591A2 (pt) Convolução em profundidade em redes neurais profundas
Filimonov et al. Postoperative complications of total laryngectomy in diabetic patients
BR112021024187A2 (pt) Dispositivo de codificação de imagem, dispositivo de decodificação de imagem, método e programa
BR112022018612A2 (pt) Processamento de transformada não separável de baixa frequência na codificação de vídeo
BR112015020060A2 (pt) métodos de codificação e decodificação de um bloco de imagens, dispositivos correspondentes e fluxo de dados
BR112022019193A2 (pt) Particionamento de bloco para codificação de imagem e vídeo
BR112022020002A2 (pt) Sinalização de parâmetros de ajuste de faixa dinâmica e habilitação de suporte de profundidade de bit variável
PH12022551803A1 (en) Signaling constraints and sequence parameter set sharing in video coding
BR112017015593A2 (pt) método e aparelho de codificação e decodificação de uma imagem a cores
Tov The Representation of the Causative Aspects of the Hiph'il in the LXX A Study in Translation Technique
Skehan Some Textual Problems in Isaia
BR112022008304A2 (pt) Método com base em transformada para imagem de codificação, e dispositivo para o mesmo
Kapstein An Intoxication of Mouse Venom
de Groot Latin-American European citizens: Some consequences of the autonomy of the member States of the European Union in nationality matters
Jácome Any Role for Mock News? Normative Journalism through Barcelona’s and the Daily Show’s Critical Narratives
Iturriaga et al. Antioxidant and Angiotensin AT1 Receptor Antagonist Treatment Reduced the Hypertension Induced by Chronic Intermittent Hypoxia in rats, but had Different Effects on Endothelial Dysfunction
Boeno et al. Hyperbaric Oxygen Therapy Following Cervical Spinal Cord Injury Increases BDNF/TrkB Signaling in Diaphragm Muscle
BR112022011748A2 (pt) Método para fornecer mensagens de gerenciamento a pelo menos um dispositivo de cliente, servidor para controlar o acesso a um conteúdo de áudio/vídeo e fornecer a pelo menos um dispositivo de cliente mensagens de gerenciamento, e dispositivo do cliente para receber mensagens de gerenciamento fornecidas por um servidor configurado para controlar o acesso a um conteúdo de áudio/vídeo
Dias et al. Participação comunitária e desenvolvimento local em zonas portuárias: lições aprendidas e boas práticas