CN115699585A - 用于解码神经网络的权重参数的解码器、编码器、方法和使用概率估计参数的编码表示 - Google Patents

用于解码神经网络的权重参数的解码器、编码器、方法和使用概率估计参数的编码表示 Download PDF

Info

Publication number
CN115699585A
CN115699585A CN202180042614.4A CN202180042614A CN115699585A CN 115699585 A CN115699585 A CN 115699585A CN 202180042614 A CN202180042614 A CN 202180042614A CN 115699585 A CN115699585 A CN 115699585A
Authority
CN
China
Prior art keywords
parameters
neural network
parameter values
available
decoder
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180042614.4A
Other languages
English (en)
Chinese (zh)
Inventor
保罗·哈斯
卡斯滕·穆勒
海纳·基尔霍夫
海科·施瓦尔茨
德特勒夫·马尔佩
托马斯·威甘德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV
Original Assignee
Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV filed Critical Fraunhofer Gesellschaft zur Foerderung der Angewandten Forschung eV
Publication of CN115699585A publication Critical patent/CN115699585A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/211—Selection of the most significant subset of features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2193—Validation; Performance evaluation; Active pattern learning techniques based on specific statistical tests
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/40—Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
    • H03M7/4006—Conversion to or from arithmetic code
    • H03M7/4012—Binary arithmetic codes
    • H03M7/4018—Context adapative binary arithmetic codes [CABAC]
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/70—Type of the data to be coded, other than image and sound
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Probability & Statistics with Applications (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Biology (AREA)
  • Neurology (AREA)
  • Algebra (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN202180042614.4A 2020-04-14 2021-04-13 用于解码神经网络的权重参数的解码器、编码器、方法和使用概率估计参数的编码表示 Pending CN115699585A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP20169498 2020-04-14
EP20169498.1 2020-04-14
PCT/EP2021/059594 WO2021209470A1 (en) 2020-04-14 2021-04-13 Decoder for decoding weight parameters of a neural network, encoder, methods and encoded representation using probability estimation parameters

Publications (1)

Publication Number Publication Date
CN115699585A true CN115699585A (zh) 2023-02-03

Family

ID=70390747

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180042614.4A Pending CN115699585A (zh) 2020-04-14 2021-04-13 用于解码神经网络的权重参数的解码器、编码器、方法和使用概率估计参数的编码表示

Country Status (6)

Country Link
US (1) US20230141029A1 (https=)
EP (1) EP4136756A1 (https=)
JP (2) JP7695954B2 (https=)
KR (1) KR20230005868A (https=)
CN (1) CN115699585A (https=)
WO (1) WO2021209470A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025002447A1 (en) * 2023-06-30 2025-01-02 Douyin Vision Co., Ltd. Method, apparatus, and medium for visual data processing

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115699020A (zh) * 2020-06-05 2023-02-03 华为技术有限公司 用于神经网络的量化
US20230050279A1 (en) * 2021-08-12 2023-02-16 Taiwan Semiconductor Manufacturing Company, Ltd. Integrated circuit and method of operating same

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103959782A (zh) * 2011-11-07 2014-07-30 夏普株式会社 具有增强cabac解码的视频解码器
WO2016199330A1 (ja) * 2015-06-12 2016-12-15 パナソニックＩｐマネジメント株式会社 画像符号化方法、画像復号方法、画像符号化装置および画像復号装置
EP3562162A1 (en) * 2018-04-27 2019-10-30 InterDigital VC Holdings, Inc. Method and apparatus for video encoding and decoding based on neural network implementation of cabac
WO2020008075A1 (en) * 2018-07-06 2020-01-09 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Arithmetic encoders, arithmetic decoders, video encoder, video decoder, methods for encoding, methods for decoding and computer program
JP2020022145A (ja) * 2018-08-03 2020-02-06 日本放送協会 符号化装置、復号装置、学習装置及びプログラム

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6159240B2 (ja) * 2013-12-09 2017-07-05 日本電信電話株式会社 二値算術符号化装置、二値算術符号化方法及び二値算術符号化プログラム
US10225555B2 (en) * 2015-05-19 2019-03-05 Mediatek Inc. Method and apparatus for multi-table based context adaptive binary arithmetic coding

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103959782A (zh) * 2011-11-07 2014-07-30 夏普株式会社 具有增强cabac解码的视频解码器
WO2016199330A1 (ja) * 2015-06-12 2016-12-15 パナソニックＩｐマネジメント株式会社 画像符号化方法、画像復号方法、画像符号化装置および画像復号装置
EP3562162A1 (en) * 2018-04-27 2019-10-30 InterDigital VC Holdings, Inc. Method and apparatus for video encoding and decoding based on neural network implementation of cabac
WO2020008075A1 (en) * 2018-07-06 2020-01-09 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Arithmetic encoders, arithmetic decoders, video encoder, video decoder, methods for encoding, methods for decoding and computer program
JP2020022145A (ja) * 2018-08-03 2020-02-06 日本放送協会 符号化装置、復号装置、学習装置及びプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SIMON WIEDEMANN等: "DeepCABAC: A Universal Compression Algorithm for Deep Neural Networks", IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, vol. 14, no. 4, 27 January 2020 (2020-01-27), pages 700 - 707 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025002447A1 (en) * 2023-06-30 2025-01-02 Douyin Vision Co., Ltd. Method, apparatus, and medium for visual data processing

Also Published As

Publication number Publication date
JP2023522887A (ja) 2023-06-01
EP4136756A1 (en) 2023-02-22
JP2025081713A (ja) 2025-05-27
JP7695954B2 (ja) 2025-06-19
WO2021209470A1 (en) 2021-10-21
US20230141029A1 (en) 2023-05-11
JP7817477B2 (ja) 2026-02-18
KR20230005868A (ko) 2023-01-10

Similar Documents

Publication Publication Date Title
JP7817477B2 (ja) ニューラルネットワークの重みパラメーターを復号化するデコーダー、エンコーダー、方法、及び確率推定パラメーターを使用する符号化表現
JP6923677B2 (ja) ビデオ圧縮におけるエントロピーコーディングのための選択的ミキシング
TWI744827B (zh) 用以壓縮類神經網路參數之方法與裝置
US5959560A (en) Data compression via alphabet partitioning and group partitioning
US8736467B2 (en) Adaptive binarization for arithmetic coding
US20250343764A1 (en) Concepts for Coding Neural Networks Parameters
CN110291793B (zh) 上下文自适应二进制算术编解码中范围推导的方法和装置
CN101501999A (zh) 数据编码
CN115917556A (zh) 用于神经网络参数的表示的改进的概念
JP2025186542A (ja) 更新モデルを使用して、ニューラルネットワークパラメーターを復号化する装置、方法及びコンピュータープログラム、並びにニューラルネットワークパラメーターを符号化する装置、方法及びコンピュータープログラム
US20200226791A1 (en) Method and device for digital data compression
WO2016025282A1 (en) Method for coding pulse vectors using statistical properties
WO2016025281A1 (en) Method for coding pulse vectors using statistical properties
WO2016025283A1 (en) Method for coding pulse vectors using statistical properties
JP2026071331A (ja) ニューラルネットワークの重みパラメーターを復号化するデコーダー、エンコーダー、方法、及び確率推定パラメーターを使用する符号化表現
WO2016025285A1 (en) Method for coding pulse vectors using statistical properties
Cui et al. An optimized probability estimation model for binary arithmetic coding
TW202606302A (zh) 算術編碼器、算術解碼器、視訊編碼器、視訊解碼器、編碼方法、解碼方法和電腦程式
Tuan et al. Index Assignment Optimization for Digital Communication Systems Using M-ary Modulation Schemes
CN115529104A (zh) 基于最大互信息的极化码量化译码方法及装置
WO2006134521A1 (en) Adaptive encoding and decoding of a stream of signal values
US20100226568A1 (en) Effective color modeling method for predictive image compression
Chan Lossy Compression of Individual Signals based on One Pass Codebook Adaptation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination