CN112514264A - 数据压缩、解压方法及相关装置、电子设备、系统 - Google Patents

数据压缩、解压方法及相关装置、电子设备、系统 Download PDF

Info

Publication number
CN112514264A
CN112514264A CN201980051013.2A CN201980051013A CN112514264A CN 112514264 A CN112514264 A CN 112514264A CN 201980051013 A CN201980051013 A CN 201980051013A CN 112514264 A CN112514264 A CN 112514264A
Authority
CN
China
Prior art keywords
data block
compressed
data
decompression
length
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980051013.2A
Other languages
English (en)
Inventor
陆超
刘保庆
何雷骏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN112514264A publication Critical patent/CN112514264A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3059—Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/40—Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/55—Compression Theory, e.g. compression of random number, repeated compression
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6005—Decoder aspects
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6011—Encoder aspects
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6017—Methods or arrangements to increase the throughput
    • H03M7/6023—Parallelization

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

本申请实施例公开了一种数据压缩、解压方法及相关装置、电子设备、系统，该数据压缩方法基于压缩算法对原始数据中的原始数据块进行处理以得到与原始数据块对应的长度为L2的规范压缩数据块，进而将原始数据压缩成供解压装置并行解压的一个或多个长度为L2的规范压缩数据块，其中，解压装置包括多个解压引擎，每个解压引擎在一个处理周期内能够对一个规范压缩数据块进行解压。通过执行本发明实施例的数据压缩方法可以压缩成长度为固定值的规范压缩数据块，使得各个解压引擎在解压该多个规范压缩数据块时可以同步解压，提高数据的解压效率。

Description

PCT国内申请，说明书已公开。

Claims (36)

  1. PCT国内申请，权利要求书已公开。
CN201980051013.2A 2018-07-31 2019-07-31 数据压缩、解压方法及相关装置、电子设备、系统 Pending CN112514264A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2018108599283 2018-07-31
CN201810859928.3A CN110784225A (zh) 2018-07-31 2018-07-31 数据压缩、解压方法及相关装置、电子设备、系统
PCT/CN2019/098758 WO2020025006A1 (zh) 2018-07-31 2019-07-31 数据压缩、解压方法及相关装置、电子设备、系统

Publications (1)

Publication Number Publication Date
CN112514264A true CN112514264A (zh) 2021-03-16

Family

ID=69232373

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810859928.3A Pending CN110784225A (zh) 2018-07-31 2018-07-31 数据压缩、解压方法及相关装置、电子设备、系统
CN201980051013.2A Pending CN112514264A (zh) 2018-07-31 2019-07-31 数据压缩、解压方法及相关装置、电子设备、系统

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201810859928.3A Pending CN110784225A (zh) 2018-07-31 2018-07-31 数据压缩、解压方法及相关装置、电子设备、系统

Country Status (4)

Country Link
US (1) US11463102B2 (zh)
EP (1) EP3820048A4 (zh)
CN (2) CN110784225A (zh)
WO (1) WO2020025006A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113326001A (zh) * 2021-05-20 2021-08-31 锐掣(杭州)科技有限公司 数据处理方法、装置、设备、系统、介质及程序

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11144207B2 (en) * 2019-11-07 2021-10-12 International Business Machines Corporation Accelerating memory compression of a physically scattered buffer
CN111884658A (zh) * 2020-07-09 2020-11-03 上海兆芯集成电路有限公司 数据解压缩方法、数据压缩方法及卷积运算装置
CN112104658B (zh) * 2020-09-17 2022-08-12 山东方寸微电子科技有限公司 一种报文压缩方法及系统
CN115149958A (zh) * 2021-03-30 2022-10-04 华为技术有限公司 数据压缩方法及装置
CN113641643A (zh) * 2021-07-02 2021-11-12 阿里巴巴新加坡控股有限公司 文件写入方法及装置
CN113726341B (zh) * 2021-08-25 2023-09-01 杭州海康威视数字技术股份有限公司 一种数据处理方法、装置、电子设备及存储介质
CN113590051B (zh) * 2021-09-29 2022-03-18 阿里云计算有限公司 数据存储和读取方法、装置、电子设备及介质
CN116634029B (zh) * 2023-07-21 2023-09-29 众科云(北京)科技有限公司 基于区块链的用工平台数据快速传输方法
CN116634167B (zh) * 2023-07-24 2023-11-07 中国科学院空天信息创新研究院 卫星成像数据存储及提取方法
CN117097346B (zh) * 2023-10-19 2024-03-19 深圳大普微电子股份有限公司 一种解压器及数据解压方法、系统、设备、计算机介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5572209A (en) * 1994-08-16 1996-11-05 International Business Machines Corporation Method and apparatus for compressing and decompressing data
US20020091905A1 (en) * 1999-01-29 2002-07-11 Interactive Silicon, Incorporated, Parallel compression and decompression system and method having multiple parallel compression and decompression engines
US20100079314A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Method and apparatus for compressing and decompressing data
US20130088373A1 (en) * 2011-10-07 2013-04-11 Fujitsu Limited Data compression apparatus and data compression method
US20130290615A1 (en) * 2010-10-22 2013-10-31 Indra Networks, Inc. Compression and decompression of data at high speed in solid state storage
CN103458460A (zh) * 2012-05-31 2013-12-18 国际商业机器公司 对信号数据进行压缩和解压缩的方法和装置
CN104753540A (zh) * 2015-03-05 2015-07-01 华为技术有限公司 数据压缩方法、数据解压方法和装置
CN106849956A (zh) * 2016-12-30 2017-06-13 华为机器有限公司 压缩方法、解压缩方法、装置和数据处理系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5654703A (en) * 1996-06-17 1997-08-05 Hewlett-Packard Company Parallel data compression and decompression
CN1250010C (zh) * 1996-12-18 2006-04-05 汤姆森消费电子有限公司 将数据压缩成固定长度数据块的方法
US7095343B2 (en) * 2001-10-09 2006-08-22 Trustees Of Princeton University code compression algorithms and architectures for embedded systems
US6577254B2 (en) * 2001-11-14 2003-06-10 Hewlett-Packard Development Company, L.P. Data compression/decompression system
US7982636B2 (en) * 2009-08-20 2011-07-19 International Business Machines Corporation Data compression using a nested hierachy of fixed phrase length static and dynamic dictionaries
US8497788B1 (en) * 2012-04-25 2013-07-30 Pure Storage Inc. Efficient techniques for aligned fixed-length compression
WO2014089753A1 (zh) * 2012-12-11 2014-06-19 华为技术有限公司 一种文件压缩方法，文件解压缩方法、装置及服务器
US8847798B2 (en) * 2012-12-17 2014-09-30 Maxeler Technologies, Ltd. Systems and methods for data compression and parallel, pipelined decompression
US10019457B1 (en) * 2013-01-22 2018-07-10 Amazon Technologies, Inc. Multi-level compression for storing data in a data store
US9510008B2 (en) * 2013-11-25 2016-11-29 Entropic Communications, Llc Video decoder memory bandwidth compression
US20150227540A1 (en) * 2014-02-12 2015-08-13 Hitachi, Ltd. System and method for content-aware data compression
US9413386B1 (en) * 2015-02-19 2016-08-09 Qualcomm Incorporated System, apparatus, and method for decompressing data
US10277248B2 (en) * 2015-07-07 2019-04-30 Tidal Systems, Inc. Compression engine with consistent throughput
CN106503165A (zh) * 2016-10-31 2017-03-15 杭州华为数字技术有限公司 压缩、解压方法、装置以及设备

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5572209A (en) * 1994-08-16 1996-11-05 International Business Machines Corporation Method and apparatus for compressing and decompressing data
US20020091905A1 (en) * 1999-01-29 2002-07-11 Interactive Silicon, Incorporated, Parallel compression and decompression system and method having multiple parallel compression and decompression engines
US20100079314A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Method and apparatus for compressing and decompressing data
US20130290615A1 (en) * 2010-10-22 2013-10-31 Indra Networks, Inc. Compression and decompression of data at high speed in solid state storage
US20130088373A1 (en) * 2011-10-07 2013-04-11 Fujitsu Limited Data compression apparatus and data compression method
CN103458460A (zh) * 2012-05-31 2013-12-18 国际商业机器公司 对信号数据进行压缩和解压缩的方法和装置
CN104753540A (zh) * 2015-03-05 2015-07-01 华为技术有限公司 数据压缩方法、数据解压方法和装置
CN106849956A (zh) * 2016-12-30 2017-06-13 华为机器有限公司 压缩方法、解压缩方法、装置和数据处理系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
YUAN XIE ET AL: "Code Compression for VLlW Processors Using Variable-to-fixed Coding", 《IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS》, vol. 15, no. 8, pages 138 - 143 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113326001A (zh) * 2021-05-20 2021-08-31 锐掣(杭州)科技有限公司 数据处理方法、装置、设备、系统、介质及程序

Also Published As

Publication number Publication date
EP3820048A1 (en) 2021-05-12
CN110784225A (zh) 2020-02-11
US11463102B2 (en) 2022-10-04
WO2020025006A1 (zh) 2020-02-06
US20210152183A1 (en) 2021-05-20
EP3820048A4 (en) 2021-09-01

Similar Documents

Publication Publication Date Title
CN112514264A (zh) 数据压缩、解压方法及相关装置、电子设备、系统
CN107565971B (zh) 一种数据压缩方法及装置
EP4018672A1 (en) Low-latency encoding using a bypass sub-stream and an entropy encoded sub-stream
US10187081B1 (en) Dictionary preload for data compression
US20090006510A1 (en) System and method for deflate processing within a compression engine
US10044370B1 (en) Lossless binary compression in a memory constrained environment
US8407378B2 (en) High-speed inline data compression inline with an eight byte data path
US7800519B2 (en) Method and apparatus for compressing and decompressing data
US9836248B2 (en) In-memory data compression complementary to host data compression
US9479194B2 (en) Data compression apparatus and data decompression apparatus
US10009606B2 (en) Low power context adaptive binary arithmetic decoder engine
KR20120084180A (ko) 데이터 압축 장치, 이의 동작 방법, 및 이를 포함하는 데이터 처리 장치
US7728742B2 (en) Method and apparatus for compressing and decompressing data
US11955995B2 (en) Apparatus and method for two-stage lossless data compression, and two-stage lossless data decompression
CN106849956B (zh) 压缩方法、解压缩方法、装置和数据处理系统
CN113300715B (zh) 一种数据处理方法、装置、硬件压缩设备以及介质
CN113630125A (zh) 数据压缩、编码解压缩方法、装置、电子设备及存储介质
CN114337678A (zh) 数据压缩方法、装置、设备及存储介质
US10361715B1 (en) Decompression circuit
CN113497627A (zh) 一种数据压缩和解压缩方法、装置及系统
WO2019168881A2 (en) Method and apparatus for data compression and decompression using a standardized data storage and retrieval protocol
CN108932315A (zh) 一种数据解压的方法以及相关装置
US10491241B1 (en) Data compression scheme utilizing a repetitive value within the data stream
WO2021237513A1 (zh) 数据压缩存储的系统、方法、处理器及计算机存储介质
CN115333544B (zh) 一种数据解压缩电路及其方法、芯片及电子设备

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination