CN115516771A - 内联解压缩 - Google Patents

内联解压缩 Download PDF

Info

Publication number
CN115516771A
CN115516771A CN202180031806.5A CN202180031806A CN115516771A CN 115516771 A CN115516771 A CN 115516771A CN 202180031806 A CN202180031806 A CN 202180031806A CN 115516771 A CN115516771 A CN 115516771A
Authority
CN
China
Prior art keywords
data block
compressed
words
metadata
column
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180031806.5A
Other languages
English (en)
Chinese (zh)
Inventor
C·B·维里利
N·瓦伊德海纳坦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of CN115516771A publication Critical patent/CN115516771A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6005—Decoder aspects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2291—User-Defined Types; Storage management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3066—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction by means of a mask or a bit-map
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/70—Type of the data to be coded, other than image and sound
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/70—Type of the data to be coded, other than image and sound
    • H03M7/707—Structured documents, e.g. XML

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
CN202180031806.5A 2020-05-08 2021-05-07 内联解压缩 Pending CN115516771A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/870,873 US11362672B2 (en) 2020-05-08 2020-05-08 Inline decompression
US16/870,873 2020-05-08
PCT/US2021/031310 WO2021226466A1 (en) 2020-05-08 2021-05-07 Inline decompression

Publications (1)

Publication Number Publication Date
CN115516771A true CN115516771A (zh) 2022-12-23

Family

ID=76197609

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180031806.5A Pending CN115516771A (zh) 2020-05-08 2021-05-07 内联解压缩

Country Status (8)

Country Link
US (3) US11362672B2 (https=)
EP (1) EP4147358A1 (https=)
JP (1) JP7733674B2 (https=)
KR (1) KR20230008717A (https=)
CN (1) CN115516771A (https=)
BR (1) BR112022021848A2 (https=)
TW (1) TWI905186B (https=)
WO (1) WO2021226466A1 (https=)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11362672B2 (en) 2020-05-08 2022-06-14 Qualcomm Incorporated Inline decompression
JP6835285B1 (ja) * 2020-09-15 2021-02-24 富士電機株式会社 データ圧縮方法、データ圧縮装置、データ圧縮プログラム、データ伸長方法、データ伸長装置およびデータ伸長プログラム
US12511544B1 (en) * 2020-09-29 2025-12-30 Amazon Technologies, Inc. Feature-map throughput during training process
US20220214810A1 (en) * 2021-03-26 2022-07-07 Ian F. Adams Near-data processing in sharded storage environments
US12438556B2 (en) 2022-09-30 2025-10-07 Qualcomm Incorporated Single instruction multiple data (SIMD) sparse decompression with variable density
US12395187B2 (en) * 2023-08-18 2025-08-19 Mediatek, Inc. Computer architecture with data decompression support for neural network computing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140188819A1 (en) * 2013-01-02 2014-07-03 Oracle International Corporation Compression and deduplication layered driver
WO2016195702A1 (en) * 2015-06-05 2016-12-08 Hewlett Packard Enterprise Development Lp Compressed data block mapping
CN106233632A (zh) * 2014-03-19 2016-12-14 甲骨文国际公司 Ozip压缩和解压缩
US20200105021A1 (en) * 2018-10-02 2020-04-02 Samsung Electronics Co., Ltd. Online image compression in hardware

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6938047B2 (en) * 2003-02-19 2005-08-30 Maui X-Stream, Inc. Methods, data structures, and systems for processing media data streams
GB2447494A (en) 2007-03-15 2008-09-17 Linear Algebra Technologies Lt A method and circuit for compressing data using a bitmap to identify the location of data values
US8847797B1 (en) * 2012-05-31 2014-09-30 Google Inc. Byte-aligned dictionary-based compression and decompression
US10115177B2 (en) * 2014-06-27 2018-10-30 Samsung Electronics Co., Ltd. Online texture compression and decompression in hardware
US9652152B2 (en) * 2014-10-29 2017-05-16 Qualcomm Incorporated Efficient decompression locality system for demand paging
US9600420B2 (en) * 2014-10-29 2017-03-21 Qualcomm Incorporated Reducing decompression time without impacting compression ratio
JP7010548B2 (ja) * 2015-05-21 2022-01-26 ゼロポイント テクノロジーズ アーベー ハイブリッドデータ圧縮および解凍のための方法、デバイス、およびシステム
WO2017131578A1 (en) 2016-01-29 2017-08-03 Zeropoint Technologies Ab Methods, devices and systems for compressing and decompressing data
JP6950675B2 (ja) * 2016-03-09 2021-10-13 日本電気株式会社 情報処理装置、情報処理方法、データ構造およびプログラム
US10565207B2 (en) 2016-04-12 2020-02-18 Hsilin Huang Method, system and program product for mask-based compression of a sparse matrix
US10404274B2 (en) * 2017-01-15 2019-09-03 International Business Machines Corporation Space compression for file size reduction
US10795836B2 (en) 2017-04-17 2020-10-06 Microsoft Technology Licensing, Llc Data processing performance enhancement for neural networks using a virtualized data iterator
US10678435B2 (en) * 2017-05-11 2020-06-09 EMC IP Holding Company LLC Deduplication and compression of data segments in a data storage system
US10958920B2 (en) * 2017-07-24 2021-03-23 Dolby Laboratories Licensing Corporation Single-channel inverse mapping for image/video processing
US12346835B2 (en) 2017-09-08 2025-07-01 Nvidia Corporation Data inspection for compression/decompression configuration and data type determination
US10719323B2 (en) 2018-09-27 2020-07-21 Intel Corporation Systems and methods for performing matrix compress and decompress instructions
US11100923B2 (en) * 2018-09-28 2021-08-24 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US10917110B1 (en) * 2019-09-02 2021-02-09 Ati Technologies Ulc Multiple symbol decoder
US11301427B2 (en) * 2019-10-15 2022-04-12 EMC IP Holding Company LLC Inline and post-process data deduplication for a file system
US11362672B2 (en) * 2020-05-08 2022-06-14 Qualcomm Incorporated Inline decompression
US11922664B2 (en) * 2021-10-04 2024-03-05 Tencent America LLC Method and apparatus of adaptive sampling for mesh compression by decoders

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140188819A1 (en) * 2013-01-02 2014-07-03 Oracle International Corporation Compression and deduplication layered driver
CN106233632A (zh) * 2014-03-19 2016-12-14 甲骨文国际公司 Ozip压缩和解压缩
WO2016195702A1 (en) * 2015-06-05 2016-12-08 Hewlett Packard Enterprise Development Lp Compressed data block mapping
US20200105021A1 (en) * 2018-10-02 2020-04-02 Samsung Electronics Co., Ltd. Online image compression in hardware

Also Published As

Publication number Publication date
BR112022021848A2 (pt) 2022-12-20
US20210351789A1 (en) 2021-11-11
US12155402B2 (en) 2024-11-26
WO2021226466A1 (en) 2021-11-11
US20230223954A1 (en) 2023-07-13
KR20230008717A (ko) 2023-01-16
EP4147358A1 (en) 2023-03-15
US20240413839A1 (en) 2024-12-12
TW202145722A (zh) 2021-12-01
JP7733674B2 (ja) 2025-09-03
TWI905186B (zh) 2025-11-21
JP2023524751A (ja) 2023-06-13
US11362672B2 (en) 2022-06-14

Similar Documents

Publication Publication Date Title
CN115516771A (zh) 内联解压缩
US8782018B2 (en) Storage device and data processing device utilizing determined dictionary compression
US9479194B2 (en) Data compression apparatus and data decompression apparatus
US8208532B2 (en) Method and apparatus for data compression and decompression
US11791838B2 (en) Near-storage acceleration of dictionary decoding
US12072806B2 (en) Compression and decompression module in a cache controller for reducing off-chip data traffic
CN107590533A (zh) 一种用于深度神经网络的压缩装置
US10489159B2 (en) Pipelined decompression of sliding window compressed data
US11424761B2 (en) Multiple symbol decoder
US8674858B2 (en) Method for compression and real-time decompression of executable code
WO2019228098A1 (zh) 一种数据压缩方法及装置
US12298939B2 (en) Hardware-implemented file reader
CN117667994A (zh) 数据处理系统、方法及并行处理模块
CN113366463A (zh) 用于消除计算机存储器中的副本和值冗余的系统、方法和设备
US11461173B1 (en) Method and system for facilitating efficient data compression based on error correction code and reorganization of data placement
TW202612282A (zh) 線內解壓縮
CN107341113A (zh) Cache的压缩方法和装置
US20240086312A1 (en) Memory searching device and method
CN112445772B (zh) 用于数据压缩和解压缩的装置和方法
HK40053237A (zh) 用於消除计算机存储器中的副本和值冗余的系统、方法和设备
Groot Data compression of computer files in hardware.

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination