CN116917902A - 用于神经网络架构的编码技术 - Google Patents

用于神经网络架构的编码技术 Download PDF

Info

Publication number
CN116917902A
CN116917902A CN202280017590.1A CN202280017590A CN116917902A CN 116917902 A CN116917902 A CN 116917902A CN 202280017590 A CN202280017590 A CN 202280017590A CN 116917902 A CN116917902 A CN 116917902A
Authority
CN
China
Prior art keywords
encoding
quantized
encoded
dataset
operations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202280017590.1A
Other languages
English (en)
Chinese (zh)
Inventor
P·K·维特哈拉德夫尤尼
T·俞
N·布尚
J·南宫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN116917902A publication Critical patent/CN116917902A/zh
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W28/00—Network traffic management; Network resource management
    • H04W28/02—Traffic management, e.g. flow control or congestion control
    • H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W72/00—Local resource management
    • H04W72/20—Control channels or signalling for resource management
    • H04W72/23—Control channels or signalling for resource management in the downlink direction of a wireless link, i.e. towards a terminal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/08—Testing, supervising or monitoring using real traffic

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Mobile Radio Communication Systems (AREA)
CN202280017590.1A 2021-03-05 2022-02-04 用于神经网络架构的编码技术 Pending CN116917902A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/194,077 US12361277B2 (en) 2021-03-05 2021-03-05 Encoding techniques for neural network architectures
US17/194,077 2021-03-05
PCT/US2022/015285 WO2022186947A1 (en) 2021-03-05 2022-02-04 Encoding techniques for neural network architectures

Publications (1)

Publication Number Publication Date
CN116917902A true CN116917902A (zh) 2023-10-20

Family

ID=80445982

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202280017590.1A Pending CN116917902A (zh) 2021-03-05 2022-02-04 用于神经网络架构的编码技术

Country Status (8)

Country Link
US (1) US12361277B2 (https=)
EP (1) EP4302232A1 (https=)
JP (1) JP2024509502A (https=)
KR (1) KR20230154014A (https=)
CN (1) CN116917902A (https=)
BR (1) BR112023017266A2 (https=)
TW (1) TW202239152A (https=)
WO (1) WO2022186947A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025130612A1 (zh) * 2023-12-21 2025-06-26 华为技术有限公司 数据压缩的方法和装置

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022040661A1 (en) * 2020-08-18 2022-02-24 Qualcomm Incorporated Reporting weight updates to a neural network for generating channel state information feedback
FI20206314A1 (en) * 2020-12-16 2022-06-17 Nokia Technologies Oy ESTIMATION OF DELAY SPREAD AND DOPPLER SPREAD
EP4304095A1 (en) * 2022-07-05 2024-01-10 The Boeing Company Compression and distribution of meteorological data using machine learning
WO2024065296A1 (zh) * 2022-09-28 2024-04-04 华为技术有限公司 数据传输方法及装置
CN116155453B (zh) * 2023-04-23 2023-07-07 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 一种面向动态信噪比的译码方法及相关设备
WO2025091206A1 (en) * 2023-10-31 2025-05-08 Qualcomm Incorporated Configuration of entropy coding for channel state feedback

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050068207A1 (en) * 2003-09-25 2005-03-31 Dongpei Su Split runlength encoding method and apparatus
EP3564864A1 (en) * 2016-12-30 2019-11-06 Shanghai Cambricon Information Technology Co., Ltd Devices for compression/decompression, system, chip, and electronic device
CN111684802A (zh) * 2017-12-06 2020-09-18 V-诺瓦国际有限公司 用于对字节流进行分级编码和解码的方法和设备
CN111868753A (zh) * 2018-07-20 2020-10-30 谷歌有限责任公司 使用条件熵模型的数据压缩

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020068498A1 (en) 2018-09-27 2020-04-02 Google Llc Data compression using integer neural networks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050068207A1 (en) * 2003-09-25 2005-03-31 Dongpei Su Split runlength encoding method and apparatus
EP3564864A1 (en) * 2016-12-30 2019-11-06 Shanghai Cambricon Information Technology Co., Ltd Devices for compression/decompression, system, chip, and electronic device
CN111684802A (zh) * 2017-12-06 2020-09-18 V-诺瓦国际有限公司 用于对字节流进行分级编码和解码的方法和设备
CN111868753A (zh) * 2018-07-20 2020-10-30 谷歌有限责任公司 使用条件熵模型的数据压缩

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025130612A1 (zh) * 2023-12-21 2025-06-26 华为技术有限公司 数据压缩的方法和装置

Also Published As

Publication number Publication date
TW202239152A (zh) 2022-10-01
US20220284282A1 (en) 2022-09-08
JP2024509502A (ja) 2024-03-04
BR112023017266A2 (pt) 2023-09-26
KR20230154014A (ko) 2023-11-07
WO2022186947A1 (en) 2022-09-09
EP4302232A1 (en) 2024-01-10
US12361277B2 (en) 2025-07-15

Similar Documents

Publication Publication Date Title
CN115136520B (zh) 使用编码器神经网络的经压缩的测量反馈
CN115989639B (zh) 用于信道状态压缩和反馈的可配置度量
US12361277B2 (en) Encoding techniques for neural network architectures
CN116057898B (zh) 用于信道状态信息方案的神经网络或层配置指示符
CN117223230A (zh) 用于信道状态信息和信道压缩切换的技术
CN113169814B (zh) 用于极化编码重传的等效穿孔集合
CN113424455B (zh) 针对信道状态信息的系数指示
CN115053474B (zh) 下行链路控制信息中的外部编码方案
WO2022261845A1 (en) Variable-to-fixed distribution matching for probabilistic constellation shaping in wireless communications
US20230316062A1 (en) Layer-by-layer training for federated learning
US12113621B2 (en) Signal reconstruction for dynamic analog-to-digital converters
CN116830467A (zh) 用于共享的开放无线电接入网的组合方案
US12255714B2 (en) Techniques for encoding and decoding a channel between wireless communication devices
CN121794978A (zh) 物理级图像压缩和发送
CN117242733A (zh) 调制参考信号以传送反馈信息
WO2023184312A1 (en) Distributed machine learning model configurations
CN115836498B (zh) 用于广播中的网络译码终止的反馈设计
US11595177B2 (en) Tone classification for physical channels with multiplexed data
CN116548019A (zh) 批量频率扫描
WO2023097551A1 (en) Machine learning models for precoding
US12355537B2 (en) Feedback codebooks with bundling
WO2026055835A1 (en) Outer coding design with reed-solomon codes for extended reality system
WO2022056807A1 (en) Rateless coding over a packet data convergence protocol layer
CN119769049A (zh) 用于基于设备存储装置的网络译码的技术

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination