CN108804021A - 数据压缩装置及其数据压缩方法 - Google Patents
数据压缩装置及其数据压缩方法 Download PDFInfo
- Publication number
- CN108804021A CN108804021A CN201710485512.5A CN201710485512A CN108804021A CN 108804021 A CN108804021 A CN 108804021A CN 201710485512 A CN201710485512 A CN 201710485512A CN 108804021 A CN108804021 A CN 108804021A
- Authority
- CN
- China
- Prior art keywords
- data
- compressed
- processing unit
- size
- physical blocks
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013144 data compression Methods 0.000 title claims abstract description 35
- 238000000034 method Methods 0.000 title claims abstract description 19
- 238000007906 compression Methods 0.000 claims description 15
- 230000006835 compression Effects 0.000 claims description 15
- 238000013500 data storage Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 6
- 241001269238 Data Species 0.000 description 4
- 230000006837 decompression Effects 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 230000011218 segmentation Effects 0.000 description 4
- 239000007787 solid Substances 0.000 description 3
- 239000012634 fragment Substances 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2094—Redundant storage or storage space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0643—Management of files
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
- H03M7/3091—Data deduplication
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/3053—Block-companding PCM systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
Description
Claims (12)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW106114895 | 2017-05-05 | ||
TW106114895A TWI631556B (zh) | 2017-05-05 | 2017-05-05 | 資料壓縮裝置及其資料壓縮方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108804021A true CN108804021A (zh) | 2018-11-13 |
CN108804021B CN108804021B (zh) | 2021-12-17 |
Family
ID=60142536
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710485512.5A Active CN108804021B (zh) | 2017-05-05 | 2017-06-23 | 数据压缩装置及其数据压缩方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US9806740B1 (zh) |
CN (1) | CN108804021B (zh) |
TW (1) | TWI631556B (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI673958B (zh) * | 2018-08-30 | 2019-10-01 | 英屬開曼群島商捷鼎創新股份有限公司 | 基於抽樣猜測之資料壓縮方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5761536A (en) * | 1996-08-21 | 1998-06-02 | International Business Machines Corporation | System and method for reducing memory fragmentation by assigning remainders to share memory blocks on a best fit basis |
CN1670701A (zh) * | 2004-03-17 | 2005-09-21 | 德鑫科技股份有限公司 | 压缩数据存储方法 |
CN1973287A (zh) * | 2004-04-26 | 2007-05-30 | 斯多维兹有限公司 | 压缩存储用文件以及对压缩的文件进行操作的方法和系统 |
CN101346883A (zh) * | 2005-10-26 | 2009-01-14 | 斯多维兹有限公司 | 用于块模式访问存储的数据压缩的方法和系统 |
CN103136109A (zh) * | 2013-02-07 | 2013-06-05 | 中国科学院苏州纳米技术与纳米仿生研究所 | 一种具有压缩功能的固态存储系统ftl写入及读取方法 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5627995A (en) * | 1990-12-14 | 1997-05-06 | Alfred P. Gnadinger | Data compression and decompression using memory spaces of more than one size |
IL120788A (en) * | 1997-05-06 | 2000-07-16 | Audiocodes Ltd | Systems and methods for encoding and decoding speech for lossy transmission networks |
US6292847B1 (en) * | 1997-12-03 | 2001-09-18 | Kabushiki Kaisha Kobe Seiko Sho. | Digital information reproducing apparatus and digital information distributing system |
US6003004A (en) * | 1998-01-08 | 1999-12-14 | Advanced Recognition Technologies, Inc. | Speech recognition method and system using compressed speech data |
US6647480B1 (en) * | 2000-03-31 | 2003-11-11 | International Business Machines Corporation | Data block update utilizing flash memory having unused memory size smaller than the data block size |
US7669051B2 (en) * | 2000-11-13 | 2010-02-23 | DigitalDoors, Inc. | Data security system and method with multiple independent levels of security |
JP4474153B2 (ja) * | 2003-12-04 | 2010-06-02 | 奇美電子股▲ふん▼有限公司 | データ圧縮装置、圧縮データ復号装置、データ圧縮方法、データ圧縮プログラムおよび画像表示システム |
EP1939751A1 (en) * | 2006-12-22 | 2008-07-02 | Telefonaktiebolaget LM Ericsson (publ) | Storing compressed data |
US9015301B2 (en) * | 2007-01-05 | 2015-04-21 | Digital Doors, Inc. | Information infrastructure management tools with extractor, secure storage, content analysis and classification and method therefor |
TW200833115A (en) * | 2007-01-30 | 2008-08-01 | Beyond Innovation Tech Co Ltd | Apparatus and method for compressing data |
CN101571744A (zh) * | 2008-04-30 | 2009-11-04 | 扬智科技股份有限公司 | 应用于计算机系统中的功率控制装置以及功率控制方法 |
-
2017
- 2017-05-05 TW TW106114895A patent/TWI631556B/zh active
- 2017-06-23 CN CN201710485512.5A patent/CN108804021B/zh active Active
- 2017-07-19 US US15/653,597 patent/US9806740B1/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5761536A (en) * | 1996-08-21 | 1998-06-02 | International Business Machines Corporation | System and method for reducing memory fragmentation by assigning remainders to share memory blocks on a best fit basis |
CN1670701A (zh) * | 2004-03-17 | 2005-09-21 | 德鑫科技股份有限公司 | 压缩数据存储方法 |
CN1973287A (zh) * | 2004-04-26 | 2007-05-30 | 斯多维兹有限公司 | 压缩存储用文件以及对压缩的文件进行操作的方法和系统 |
CN101346883A (zh) * | 2005-10-26 | 2009-01-14 | 斯多维兹有限公司 | 用于块模式访问存储的数据压缩的方法和系统 |
CN103136109A (zh) * | 2013-02-07 | 2013-06-05 | 中国科学院苏州纳米技术与纳米仿生研究所 | 一种具有压缩功能的固态存储系统ftl写入及读取方法 |
Also Published As
Publication number | Publication date |
---|---|
TW201843676A (zh) | 2018-12-16 |
CN108804021B (zh) | 2021-12-17 |
US9806740B1 (en) | 2017-10-31 |
TWI631556B (zh) | 2018-08-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10140065B2 (en) | Method and apparatus for storing information using an intelligent block storage controller | |
US10140064B2 (en) | Method and apparatus for storing information using an intelligent block storage controller | |
US7958331B2 (en) | Storage device with opportunistic address space | |
US10338833B1 (en) | Method for achieving sequential I/O performance from a random workload | |
US10936228B2 (en) | Providing data deduplication in a data storage system with parallelized computation of crypto-digests for blocks of host I/O data | |
US20070168569A1 (en) | Adaptive resilvering I/O scheduling | |
US11379447B2 (en) | Method and system for enhancing IOPS of a hard disk drive system based on storing metadata in host volatile memory and data in non-volatile memory using a shared controller | |
WO2015145647A1 (ja) | ストレージ装置とデータ処理方法及びストレージシステム | |
US9922039B1 (en) | Techniques for mitigating effects of small unaligned writes | |
US9973210B1 (en) | Reduction of execution stalls of LZ4 decompression via parallelization | |
US9940331B1 (en) | Proactive scavenging of file system snaps | |
US9256373B1 (en) | Invulnerable data movement for file system upgrade | |
US10613937B2 (en) | Capturing compression efficiency metrics for processing data | |
US11995057B2 (en) | Efficient database management system and method for use therewith | |
US20220129172A1 (en) | Storage system configuration change tracking for root cause/troubleshooting | |
US10585604B2 (en) | Tool for selectively deploying inline compression | |
US6912643B2 (en) | Method of flexibly mapping a number of storage elements into a virtual storage element | |
WO2024169851A1 (zh) | 一种数据压缩方法、系统、设备及计算机可读存储介质 | |
US20140156607A1 (en) | Index for deduplication | |
CN108804021A (zh) | 数据压缩装置及其数据压缩方法 | |
US8139874B2 (en) | Disk sector allocation for high performance access to images | |
US20130218851A1 (en) | Storage system, data management device, method and program | |
US11971858B2 (en) | Compression of snapshot metadata on cold storage volumes | |
JP6911443B2 (ja) | 情報処理装置 | |
US20150293949A1 (en) | Data sampling deduplication |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: Taiwan, Taipei, China, Nanhai District, 6 East section 465, 10 Applicant after: British Cayman Islands shangjieding Innovation Co.,Ltd. Address before: Taiwan, Taipei, China, Nanhai District, 6 East section 465, 10 Applicant before: Jieding Innovation Co.,Ltd. |
|
TA01 | Transfer of patent application right |
Effective date of registration: 20200410 Address after: No. 5, 237, 1 Datong Road, Taiwan, Xinbei City, Xinbei City, China Applicant after: INNODISK Corp. Address before: Taiwan, Taipei, China, Nanhai District, 6 East section 465, 10 Applicant before: British Cayman Islands shangjieding Innovation Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200608 Address after: 04-95, Fanglin building, 531a, upper section of Klaus street, Singapore City, Singapore Applicant after: Jieding Singapore Pte. Ltd. Address before: No. 5, 237, 1 Datong Road, Taiwan, Xinbei City, Xinbei City, China Applicant before: INNODISK Corp. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20200805 Address after: Building C, No. 888, Huanhu West 2nd Road, Lingang New Area, Pudong New Area (Shanghai) pilot Free Trade Zone Applicant after: Shanghai Chuanyuan Information Technology Co.,Ltd. Address before: Fong Lam building, 531a upper cross street, Singapore City, Singapore 051531 Applicant before: Jieding Singapore Pte. Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant |