CN106170760A - 一种计算数据的预期压缩率的方法及装置 - Google Patents

一种计算数据的预期压缩率的方法及装置 Download PDF

Info

Publication number
CN106170760A
CN106170760A CN201480036812.XA CN201480036812A CN106170760A CN 106170760 A CN106170760 A CN 106170760A CN 201480036812 A CN201480036812 A CN 201480036812A CN 106170760 A CN106170760 A CN 106170760A
Authority
CN
China
Prior art keywords
frequency
symbol
length
expected
encoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201480036812.XA
Other languages
English (en)
Other versions
CN106170760B (zh
Inventor
魏建生
朱俊华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN106170760A publication Critical patent/CN106170760A/zh
Application granted granted Critical
Publication of CN106170760B publication Critical patent/CN106170760B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/40—Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6064—Selection of Compressor
    • H03M7/6082—Selection strategies
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6058—Saving memory space in the encoder or decoder
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3068—Precoding preceding compression, e.g. Burrows-Wheeler transformation
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/40—Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
    • H03M7/4031—Fixed length to variable length coding
    • H03M7/4037—Prefix coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

一种计算数据的预期压缩率的方法及装置，涉及数据处理技术领域，在该方案中，是用表征符号序列中的符号的分布规律的相关指标来计算数据的预期压缩率的，表征符号序列中的符号的分布规律的相关指标与数据的预期压缩率相关性较高，因此，解决了现在计算数据的预期压缩率的过程中存在的准确度较低的缺陷。

Description

PCT国内申请，说明书已公开。

Claims (1)

  1. PCT国内申请，权利要求书已公开。
CN201480036812.XA 2014-07-11 2014-07-11 一种计算数据的预期压缩率的方法及装置 Active CN106170760B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/082077 WO2016004629A1 (zh) 2014-07-11 2014-07-11 一种计算数据的预期压缩率的方法及装置

Publications (2)

Publication Number Publication Date
CN106170760A true CN106170760A (zh) 2016-11-30
CN106170760B CN106170760B (zh) 2019-11-05

Family

ID=55063531

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201480036812.XA Active CN106170760B (zh) 2014-07-11 2014-07-11 一种计算数据的预期压缩率的方法及装置

Country Status (3)

Country Link
US (1) US9722631B2 (zh)
CN (1) CN106170760B (zh)
WO (1) WO2016004629A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3407198A1 (en) * 2017-05-22 2018-11-28 Siemens Aktiengesellschaft System, device and method for frozen period detection in sensor datasets

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040164883A1 (en) * 2003-02-24 2004-08-26 Kimito Horie Data compressing apparatus and data decoding apparatus
CN101299611A (zh) * 2008-06-30 2008-11-05 中国电子科技集团公司第二十八研究所 一种基于集合游程的数据压缩方法
CN103346800A (zh) * 2013-07-08 2013-10-09 沈阳东软医疗系统有限公司 一种数据压缩方法及装置
CN103746702A (zh) * 2013-12-17 2014-04-23 记忆科技(深圳)有限公司 数据的无损压缩方法与装置

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1157653C (zh) * 1994-04-22 2004-07-14 索尼公司 数据传输和接收装置及方法和数据记录和再现装置及方法
JP2000259187A (ja) * 1999-03-05 2000-09-22 Hitachi Information Technology Co Ltd 音声データ圧縮方法
FR2878668B1 (fr) * 2004-11-26 2007-07-13 Siemens Vdo Automotive Sas Procede de compression de donnees numeriques
US8295615B2 (en) 2007-05-10 2012-10-23 International Business Machines Corporation Selective compression of synchronized content based on a calculated compression ratio
US8321386B1 (en) 2008-04-14 2012-11-27 Netapp, Inc. System and method for estimating a compressibility of data in a storage device
US8195636B2 (en) 2009-04-29 2012-06-05 Netapp, Inc. Predicting space reclamation in deduplicated datasets
US8615499B2 (en) 2012-01-27 2013-12-24 International Business Machines Corporation Estimating data reduction in storage systems
US9246511B2 (en) 2012-03-20 2016-01-26 Sandisk Technologies Inc. Method and apparatus to process data based upon estimated compressibility of the data
US8650163B1 (en) 2012-08-20 2014-02-11 International Business Machines Corporation Estimation of data reduction rate in a data storage system
CN102890268B (zh) * 2012-10-11 2014-05-14 南京莱斯信息技术股份有限公司 一种雷达信号无损压缩的方法
US9564918B2 (en) * 2013-01-10 2017-02-07 International Business Machines Corporation Real-time reduction of CPU overhead for data compression
US20140244604A1 (en) * 2013-02-28 2014-08-28 Microsoft Corporation Predicting data compressibility using data entropy estimation
CN103152430B (zh) * 2013-03-21 2016-06-08 河海大学 一种缩减数据占用空间的云存储方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040164883A1 (en) * 2003-02-24 2004-08-26 Kimito Horie Data compressing apparatus and data decoding apparatus
CN101299611A (zh) * 2008-06-30 2008-11-05 中国电子科技集团公司第二十八研究所 一种基于集合游程的数据压缩方法
CN103346800A (zh) * 2013-07-08 2013-10-09 沈阳东软医疗系统有限公司 一种数据压缩方法及装置
CN103746702A (zh) * 2013-12-17 2014-04-23 记忆科技(深圳)有限公司 数据的无损压缩方法与装置

Also Published As

Publication number Publication date
WO2016004629A1 (zh) 2016-01-14
CN106170760B (zh) 2019-11-05
US20170117918A1 (en) 2017-04-27
US9722631B2 (en) 2017-08-01

Similar Documents

Publication Publication Date Title
CN108053028B (zh) 数据定点化处理方法、装置、电子设备及计算机存储介质
EP3451165B1 (en) Neural network operation device and method supporting few-bit floating-point number
CN105684316B (zh) 一种Polar码编码方法、装置
US10547324B2 (en) Data compression coding method, apparatus therefor, and program therefor
CN110020616B (zh) 一种目标识别方法及设备
KR20090042233A (ko) 데이터 압축
US11551785B2 (en) Gene sequencing data compression preprocessing, compression and decompression method, system, and computer-readable medium
CN108052285B (zh) 一种自适应编码长度的时序数据存储的方法和装置
CN106445890B (zh) 数据处理方法
CN116506073A (zh) 一种工业计算机平台数据快速传输方法及系统
CN104038233A (zh) 基于相邻位异或运算的测试数据压缩与解压缩方法
CN113630125A (zh) 数据压缩、编码解压缩方法、装置、电子设备及存储介质
US9998149B2 (en) Constant hamming weight coding
CN113496762B (zh) 一种生物基因序列的概要数据生成方法及系统
CN106170760B (zh) 一种计算数据的预期压缩率的方法及装置
CN103746701B (zh) 一种用于Rice无损数据压缩的快速编码选项选择方法
US8878705B1 (en) Variable bit-length reiterative lossless compression system and method
CN106484753B (zh) 数据处理方法
Hult et al. On importance sampling with mixtures for random walks with heavy tails
CN108334305B (zh) 一种除法运算方法、装置、设备和存储介质
US20180018980A1 (en) Frequency envelope vector quantization method and apparatus
CN112612762B (zh) 数据处理方法及相关设备
CN114759929A (zh) 车联网时序数据的压缩方法、装置和电子设备
CN114501011A (zh) 图像压缩方法、图像解压缩方法及装置
RU2018113995A (ru) Способ и устройство для быстрого и эффективного сжатия и распаковки изображений

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20210508

Address after: Unit 3401, unit a, building 6, Shenye Zhongcheng, No. 8089, Hongli West Road, Donghai community, Xiangmihu street, Futian District, Shenzhen, Guangdong 518040

Patentee after: Honor Device Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.

TR01 Transfer of patent right