CN103916131B - 压缩数据的方法和用于执行该方法的设备 - Google Patents

压缩数据的方法和用于执行该方法的设备 Download PDF

Info

Publication number
CN103916131B
CN103916131B CN201410001223.XA CN201410001223A CN103916131B CN 103916131 B CN103916131 B CN 103916131B CN 201410001223 A CN201410001223 A CN 201410001223A CN 103916131 B CN103916131 B CN 103916131B
Authority
CN
China
Prior art keywords
data block
data
block
current
previous
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410001223.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN103916131A (zh
Inventor
徐万根
金大旭
孙弘乐
孔骏镇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN103916131A publication Critical patent/CN103916131A/zh
Application granted granted Critical
Publication of CN103916131B publication Critical patent/CN103916131B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14—Handling requests for interconnection or transfer
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
    • H03M7/3086—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method employing a sliding window, e.g. LZ77
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6064—Selection of Compressor
    • H03M7/6082—Selection strategies

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
CN201410001223.XA 2013-01-02 2014-01-02 压缩数据的方法和用于执行该方法的设备 Active CN103916131B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020130000074A KR101992274B1 (ko) 2013-01-02 2013-01-02 데이터 압축 방법과 상기 방법을 수행할 수 있는 장치들
KR10-2013-0000074 2013-01-02

Publications (2)

Publication Number Publication Date
CN103916131A CN103916131A (zh) 2014-07-09
CN103916131B true CN103916131B (zh) 2019-05-28

Family

ID=50150526

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410001223.XA Active CN103916131B (zh) 2013-01-02 2014-01-02 压缩数据的方法和用于执行该方法的设备

Country Status (5)

Country Link
US (1) US9280287B2 (enExample)
EP (1) EP2752760B1 (enExample)
JP (1) JP6512733B2 (enExample)
KR (1) KR101992274B1 (enExample)
CN (1) CN103916131B (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9668020B2 (en) 2014-04-07 2017-05-30 The Nielsen Company (Us), Llc Signature retrieval and matching for media monitoring
US9438940B2 (en) 2014-04-07 2016-09-06 The Nielsen Company (Us), Llc Methods and apparatus to identify media using hash keys
CN105790768B (zh) * 2014-12-19 2018-12-25 珠海全志科技股份有限公司 数据存储方法和系统
CN104485967B (zh) * 2015-01-08 2017-10-03 中山大学 由序列通项表达式驱动的并行计算传输列表实时压缩方法
US10542457B2 (en) 2015-04-20 2020-01-21 Qualcomm Incorporated Enhanced compression formats for data compression
US20170038978A1 (en) * 2015-08-05 2017-02-09 HGST Netherlands B.V. Delta Compression Engine for Similarity Based Data Deduplication
US10200546B2 (en) 2015-09-25 2019-02-05 The Nielsen Company (Us), Llc Methods and apparatus to identify media using hybrid hash keys
US10394724B2 (en) 2016-08-22 2019-08-27 Qualcomm Incorporated Low power data transfer for memory subsystem using data pattern checker to determine when to suppress transfers based on specific patterns
US10497084B2 (en) * 2017-04-24 2019-12-03 Intel Corporation Efficient sharing and compression expansion of data across processing systems
US10809928B2 (en) 2017-06-02 2020-10-20 Western Digital Technologies, Inc. Efficient data deduplication leveraging sequential chunks or auxiliary databases
US10503608B2 (en) 2017-07-24 2019-12-10 Western Digital Technologies, Inc. Efficient management of reference blocks used in data deduplication
CN107622781B (zh) * 2017-10-12 2020-05-19 华中科技大学 一种提升三层忆阻器写性能的编解码方法
CN111124940B (zh) * 2018-10-31 2022-03-22 深信服科技股份有限公司 一种基于全闪存阵列的空间回收方法及系统
CN112070652A (zh) * 2019-06-10 2020-12-11 上海赜睿信息科技有限公司 数据压缩、解压方法、可读存储介质和电子设备
KR102858422B1 (ko) 2019-06-14 2025-09-12 삼성전자주식회사 스토리지 장치 및 스토리지 장치의 동작 방법
US11252460B2 (en) 2020-03-27 2022-02-15 The Nielsen Company (Us), Llc Signature matching with meter data aggregation for media identification
CN114077554B (zh) * 2022-01-20 2022-06-21 广州匠芯创科技有限公司 一种数据解码方法、系统、设备及介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101212682A (zh) * 2007-12-22 2008-07-02 深圳市同洲电子股份有限公司 一种运动搜索区域的数据加载装置和方法
CN101478311A (zh) * 2009-01-22 2009-07-08 浙江大学 bzip2压缩算法硬件加速实现方法
CN101505427A (zh) * 2009-02-20 2009-08-12 杭州爱威芯科技有限公司 视频压缩编码算法中的运动估计装置

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2259824B (en) * 1991-09-19 1995-01-18 Sony Broadcast & Communication Data compression
US5371499A (en) * 1992-02-28 1994-12-06 Intersecting Concepts, Inc. Data compression using hashing
US5521597A (en) * 1993-08-02 1996-05-28 Mircosoft Corporation Data compression for network transport
US5977977A (en) * 1995-08-04 1999-11-02 Microsoft Corporation Method and system for multi-pass rendering
US5990955A (en) * 1997-10-03 1999-11-23 Innovacom Inc. Dual encoding/compression method and system for picture quality/data density enhancement
JP3541930B2 (ja) * 1998-08-13 2004-07-14 富士通株式会社 符号化装置及び復号化装置
JP2000148656A (ja) * 1998-11-09 2000-05-30 Mitsubishi Electric Corp メモリシステム
US6819271B2 (en) 1999-01-29 2004-11-16 Quickshift, Inc. Parallel compression and decompression system and method having multiple parallel compression and decompression engines
US6601104B1 (en) * 1999-03-11 2003-07-29 Realtime Data Llc System and methods for accelerated data storage and retrieval
US6658148B1 (en) 2000-06-06 2003-12-02 Matsushita Electric Works, Ltd. Image processing method and apparatus
US6763444B2 (en) * 2001-05-08 2004-07-13 Micron Technology, Inc. Read/write timing calibration of a memory array using a row or a redundant row
TWI220959B (en) * 2003-06-05 2004-09-11 Carry Computer Eng Co Ltd Storage device with optimized compression management mechanism
MXPA06000750A (es) * 2003-07-21 2006-03-30 Fraunhofer Ges Forschung Conversion de formato de archivo de audio.
US7321991B2 (en) 2004-01-10 2008-01-22 Hynix Semiconductor Inc. Semiconductor memory device having advanced test mode
US20060069857A1 (en) 2004-09-24 2006-03-30 Nec Laboratories America, Inc. Compression system and method
US20060106870A1 (en) * 2004-11-16 2006-05-18 International Business Machines Corporation Data compression using a nested hierarchy of fixed phrase length dictionaries
US7215259B2 (en) 2005-06-03 2007-05-08 Quantum Corporation Data compression with selective encoding of short matches
EP2033128A4 (en) 2006-05-31 2012-08-15 Ibm METHOD AND SYSTEM FOR DATA TRANSFORMATION OF LOGIC OBJECTS FOR STORAGE PURPOSES
JP5481809B2 (ja) * 2008-08-12 2014-04-23 富士通株式会社 コンパレータ回路及びそれを有するアナログデジタルコンバータ
WO2010113454A1 (ja) * 2009-03-31 2010-10-07 パナソニック株式会社 記録媒体、再生装置、及び集積回路
KR20120090194A (ko) * 2011-02-07 2012-08-17 삼성전자주식회사 데이터 처리 장치 및 이를 포함하는 데이터 처리 시스템

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101212682A (zh) * 2007-12-22 2008-07-02 深圳市同洲电子股份有限公司 一种运动搜索区域的数据加载装置和方法
CN101478311A (zh) * 2009-01-22 2009-07-08 浙江大学 bzip2压缩算法硬件加速实现方法
CN101505427A (zh) * 2009-02-20 2009-08-12 杭州爱威芯科技有限公司 视频压缩编码算法中的运动估计装置

Also Published As

Publication number Publication date
JP2014132750A (ja) 2014-07-17
JP6512733B2 (ja) 2019-05-15
US20140189279A1 (en) 2014-07-03
CN103916131A (zh) 2014-07-09
KR101992274B1 (ko) 2019-09-30
EP2752760A2 (en) 2014-07-09
EP2752760B1 (en) 2019-03-20
EP2752760A3 (en) 2015-07-29
US9280287B2 (en) 2016-03-08
KR20140088319A (ko) 2014-07-10

Similar Documents

Publication Publication Date Title
CN103916131B (zh) 压缩数据的方法和用于执行该方法的设备
CN103729307B (zh) 数据压缩装置和方法以及包括数据压缩装置的存储系统
US11182667B2 (en) Minimizing memory reads and increasing performance by leveraging aligned blob data in a processing unit of a neural network environment
US11487342B2 (en) Reducing power consumption in a neural network environment using data management
CN109067405A (zh) 一种数据压缩的方法、装置、终端及计算机可读存储介质
US9934234B2 (en) Adaptive rate compression hash processor
JP2025124637A (ja) ゲノム配列データの圧縮のための方法
US9921969B2 (en) Generation of random address mapping in non-volatile memories using local and global interleaving
WO2021253346A1 (zh) 数据传输计算方法，装置及存储介质
US9444490B2 (en) Method of operating data compression circuit and devices to perform the same
CN106385260A (zh) 一种基于低延时的lz无损压缩算法的fpga实现系统
CN115905146A (zh) 数据处理方法、装置、计算设备及存储系统
US20180107919A1 (en) Hybrid compression scheme for efficient storage of synaptic weights in hardware neuromorphic cores
CN115878023B (zh) 写入数据到闪存存储器的方法及装置
CN104199352B (zh) 基于fpga的区间编码硬件实现系统
CN203632687U (zh) 用于通信加密的切换电路
CN112988236B (zh) 数据存储方法及装置、存储介质、电子装置
CN115390785A (zh) 电子设备及其数据的处理方法和介质
CN118585132A (zh) 数据存储方法及装置、存储介质、计算机设备

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant