TWI729284B - 資料壓縮系統、有損資料壓縮的方法和資料壓縮的方法 - Google Patents

資料壓縮系統、有損資料壓縮的方法和資料壓縮的方法 Download PDF

Info

Publication number
TWI729284B
TWI729284B TW107112343A TW107112343A TWI729284B TW I729284 B TWI729284 B TW I729284B TW 107112343 A TW107112343 A TW 107112343A TW 107112343 A TW107112343 A TW 107112343A TW I729284 B TWI729284 B TW I729284B
Authority
TW
Taiwan
Prior art keywords
data
storage device
data compression
original data
original
Prior art date
Application number
TW107112343A
Other languages
English (en)
Chinese (zh)
Other versions
TW201905689A (zh
Inventor
奇亮奭
李勇錫
傑森 馬蒂諾
Original Assignee
南韓商三星電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南韓商三星電子股份有限公司 filed Critical 南韓商三星電子股份有限公司
Publication of TW201905689A publication Critical patent/TW201905689A/zh
Application granted granted Critical
Publication of TWI729284B publication Critical patent/TWI729284B/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6064—Selection of Compressor
    • H03M7/6082—Selection strategies
    • H03M7/6088—Selection strategies according to the data type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/60—General implementation details not specific to a particular type of compression
    • H03M7/6064—Selection of Compressor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3059—Digital compression and data reduction techniques where the original information is represented by a subset or similar information, e.g. lossy compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
TW107112343A 2017-06-20 2018-04-11 資料壓縮系統、有損資料壓縮的方法和資料壓縮的方法 TWI729284B (zh)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US201762522423P 2017-06-20 2017-06-20
US62/522,423 2017-06-20
US201762542008P 2017-08-07 2017-08-07
US62/542,008 2017-08-07
US15/728,261 2017-10-09
US15/728,261 US10715177B2 (en) 2017-06-20 2017-10-09 Lossy compression drive

Publications (2)

Publication Number Publication Date
TW201905689A TW201905689A (zh) 2019-02-01
TWI729284B true TWI729284B (zh) 2021-06-01

Family

ID=64656692

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107112343A TWI729284B (zh) 2017-06-20 2018-04-11 資料壓縮系統、有損資料壓縮的方法和資料壓縮的方法

Country Status (5)

Country Link
US (1) US10715177B2 (https=)
JP (1) JP7296197B2 (https=)
KR (1) KR102435046B1 (https=)
CN (1) CN109101522B (https=)
TW (1) TWI729284B (https=)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10891758B2 (en) 2018-07-23 2021-01-12 Google Llc Geometry encoder
US10318891B1 (en) * 2018-07-23 2019-06-11 Google Llc Geometry encoder
US11106374B2 (en) * 2018-08-03 2021-08-31 EMC IP Holding Company LLC Managing inline data de-duplication in storage systems
US11209984B2 (en) * 2019-02-18 2021-12-28 Silicon Motion, Inc. Method and apparatus for performing data-compression management in a storage server
EP3971700B1 (en) * 2019-07-26 2024-09-11 Huawei Technologies Co., Ltd. Data processing method and device in storage system, and computer readable storage medium
CN111294055B (zh) * 2020-02-21 2021-10-22 南京航空航天大学 一种基于自适应字典的数据压缩的编解码方法
US12105973B2 (en) * 2020-03-25 2024-10-01 Samsung Electronics Co., Ltd. Dynamic quantization in storage devices using machine learning
CN111552669A (zh) * 2020-04-26 2020-08-18 北京达佳互联信息技术有限公司 数据处理方法、装置、计算设备和存储介质
CN111817722B (zh) 2020-07-09 2025-07-11 北京奥星贝斯科技有限公司 数据压缩方法、装置及计算机设备
CN111966648B (zh) * 2020-07-29 2023-09-08 国机智能科技有限公司 一种工业数据的处理方法和电子设备
US11456754B2 (en) 2020-10-13 2022-09-27 Western Digital Technologies, Inc. Fixed size soft bit lossy compression in flash memory
US11431350B1 (en) * 2021-02-05 2022-08-30 Cox Communications, Inc. Lossy statistical data compression
CN113076293B (zh) * 2021-04-15 2024-03-08 湖南甲万科技有限公司 一种用于智能终端的数据扩容方法
US11456758B1 (en) 2021-04-23 2022-09-27 Western Digital Technologies, Inc. Adaptive soft-bit compression in flash memory
JP7697838B2 (ja) * 2021-07-13 2025-06-24 日立ヴァンタラ株式会社 ファイルストレージ
US12081376B2 (en) * 2021-11-05 2024-09-03 Samsung Display Co., Ltd. DC balanced transition encoding
US11770434B1 (en) * 2022-10-18 2023-09-26 Dell Products L.P. Compression on-demand in a stream data platform
US12554718B1 (en) * 2025-01-08 2026-02-17 AtomBeam Technologies Inc. Codeword-native database management platform extension

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020191692A1 (en) * 2001-02-13 2002-12-19 Realtime Data, Llc Bandwidth sensitive data compression and decompression
US20050210054A1 (en) * 2004-03-22 2005-09-22 Michael Harris Information management system
US20050243610A1 (en) * 2003-06-26 2005-11-03 Copan Systems Method and system for background processing of data in a storage system
US20070237176A1 (en) * 2006-03-30 2007-10-11 Sbc Knowledge Ventures L.P. System and method for enhancing data speed over communication lines
WO2014200526A1 (en) * 2013-06-13 2014-12-18 Microsoft Corporation Page-based compressed storage management

Family Cites Families (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06309110A (ja) * 1993-04-20 1994-11-04 Kawasaki Steel Corp 複合型記憶装置
US5463772A (en) * 1993-04-23 1995-10-31 Hewlett-Packard Company Transparent peripheral file systems with on-board compression, decompression, and space management
MX9700385A (es) 1994-07-14 1998-05-31 Johnson Grace Company Metodo y aparato para comprimir imagenes.
US6121903A (en) 1998-01-27 2000-09-19 Infit Communications Ltd. On-the-fly data re-compression
CN1568466A (zh) 2001-09-26 2005-01-19 交互设备有限公司 用于传递媒体信号的系统和方法
JP2004078787A (ja) * 2002-08-22 2004-03-11 Alpine Electronics Inc 車載オーディオ装置およびデータ転送方法
US8099273B2 (en) * 2003-06-05 2012-01-17 Mentor Graphics Corporation Compression of emulation trace data
US8363837B2 (en) 2005-02-28 2013-01-29 HGST Netherlands B.V. Data storage device with data transformation capability
US20080037880A1 (en) 2006-08-11 2008-02-14 Lcj Enterprises Llc Scalable, progressive image compression and archiving system over a low bit rate internet protocol network
US8386444B2 (en) 2006-12-29 2013-02-26 Teradata Us, Inc. Techniques for selective compression of database information
US7941409B2 (en) * 2007-09-11 2011-05-10 Hitachi, Ltd. Method and apparatus for managing data compression and integrity in a computer storage system
US8832044B1 (en) * 2009-03-04 2014-09-09 Symantec Corporation Techniques for managing data compression in a data protection system
GB0915766D0 (en) 2009-09-09 2009-10-07 Apt Licensing Ltd Apparatus and method for multidimensional adaptive audio coding
US8463944B2 (en) * 2010-01-05 2013-06-11 International Business Machines Corporation Optimal compression process selection methods
US8427346B2 (en) 2010-04-13 2013-04-23 Empire Technology Development Llc Adaptive compression
WO2012016089A2 (en) 2010-07-28 2012-02-02 Fusion-Io, Inc. Apparatus, system, and method for conditional and atomic storage operations
US8345998B2 (en) 2010-08-10 2013-01-01 Xerox Corporation Compression scheme selection based on image data type and user selections
US8549518B1 (en) * 2011-08-10 2013-10-01 Nutanix, Inc. Method and system for implementing a maintenanece service for managing I/O and storage for virtualization environment
US8751830B2 (en) 2012-01-23 2014-06-10 International Business Machines Corporation Memory address translation-based data encryption/compression
US8918579B2 (en) * 2012-02-06 2014-12-23 Sandisk Technologies Inc. Storage device and method for selective data compression
US9048862B2 (en) * 2012-04-11 2015-06-02 Netapp, Inc. Systems and methods for selecting data compression for storage data in a storage system
US9118345B2 (en) 2012-10-04 2015-08-25 Altera Corporation Data compression profiler for configuration of compression
CN103023982B (zh) * 2012-11-22 2015-04-29 中国人民解放军国防科学技术大学 一种云存储客户端的低延迟元数据访问方法
CN103902632B (zh) 2012-12-31 2018-01-02 华为技术有限公司 键值存储系统中构建文件系统的方法、装置及电子设备
US9235905B2 (en) 2013-03-13 2016-01-12 Ologn Technologies Ag Efficient screen image transfer
US9448738B2 (en) 2013-03-15 2016-09-20 Western Digital Technologies, Inc. Compression and formatting of data for data storage systems
US9438426B2 (en) 2014-10-03 2016-09-06 Seagate Technology Llc Key-value data storage device with hybrid architecture
KR20160070512A (ko) * 2014-12-10 2016-06-20 삼성전자주식회사 반도체 장치 및 그 동작 방법
US9779023B1 (en) * 2015-06-30 2017-10-03 EMC IP Holding Company LLC Storing inline-compressed data in segments of contiguous physical blocks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020191692A1 (en) * 2001-02-13 2002-12-19 Realtime Data, Llc Bandwidth sensitive data compression and decompression
US20050243610A1 (en) * 2003-06-26 2005-11-03 Copan Systems Method and system for background processing of data in a storage system
US20050210054A1 (en) * 2004-03-22 2005-09-22 Michael Harris Information management system
US20070237176A1 (en) * 2006-03-30 2007-10-11 Sbc Knowledge Ventures L.P. System and method for enhancing data speed over communication lines
WO2014200526A1 (en) * 2013-06-13 2014-12-18 Microsoft Corporation Page-based compressed storage management

Also Published As

Publication number Publication date
KR102435046B1 (ko) 2022-08-22
US20180367161A1 (en) 2018-12-20
CN109101522A (zh) 2018-12-28
CN109101522B (zh) 2026-04-07
JP2019009774A (ja) 2019-01-17
KR20180138127A (ko) 2018-12-28
TW201905689A (zh) 2019-02-01
JP7296197B2 (ja) 2023-06-22
US10715177B2 (en) 2020-07-14

Similar Documents

Publication Publication Date Title
TWI729284B (zh) 資料壓縮系統、有損資料壓縮的方法和資料壓縮的方法
US8171251B2 (en) Data storage management method and device
US8595199B2 (en) Real-time selection of compression operations
EP3108371B1 (en) Modified memory compression
US10423508B2 (en) Method and system for a high-priority read based on an in-place suspend/resume write
US9792350B2 (en) Real-time classification of data into data compression domains
US20160034523A1 (en) Sub-block partitioning for hash-based deduplication
US9684665B2 (en) Storage apparatus and data compression method
KR102525061B1 (ko) 입력 데이터를 압축하여 저장하는 데이터 저장 장치
CN105474200A (zh) 具有占位符的水合和脱水
US10474385B2 (en) Managing memory fragmentation in hardware-assisted data compression
WO2014188528A1 (ja) メモリ装置、計算機システム及びメモリ装置の制御方法
CN111752479A (zh) 有效存储数据的方法和系统
CN103874987B (zh) 嵌入式多媒体卡分区存储空间调整方法和终端
CN104965835B (zh) 一种分布式文件系统的文件读写方法及装置
TWI553462B (zh) 可降低耗電之硬碟裝置以及降低硬碟裝置耗電之方法
TWI813876B (zh) 解壓縮系統、記憶體系統以及解壓縮的方法
US10324660B2 (en) Determining whether to compress data prior to storage thereof
WO2024002077A1 (zh) 数据传输的方法、多核芯片
CN121364825A (zh) 存储空间的管理方法、装置、设备、存储介质和程序产品
CN121412137A (zh) 固定压缩窗口的ssd垃圾回收压缩方法、装置、设备及介质
KR20110090230A (ko) 데이터 저장 장치에서 데이터를 인덱싱하기 위한 방법과 상기 방법을 수행할 수 있는 장치들