HK1214378A1 - 優化用於去重的數據塊大小 - Google Patents

優化用於去重的數據塊大小

Info

Publication number
HK1214378A1
HK1214378A1 HK16102166.6A HK16102166A HK1214378A1 HK 1214378 A1 HK1214378 A1 HK 1214378A1 HK 16102166 A HK16102166 A HK 16102166A HK 1214378 A1 HK1214378 A1 HK 1214378A1
Authority
HK
Hong Kong
Prior art keywords
deduplication
data block
block size
optimizing data
optimizing
Prior art date
Application number
HK16102166.6A
Other languages
English (en)
Inventor
‧拉姆
Original Assignee
Western Digital Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Western Digital Tech Inc filed Critical Western Digital Tech Inc
Publication of HK1214378A1 publication Critical patent/HK1214378A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1453—Management of the data involved in backup or backup restore using de-duplication of the data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1464—Management of the backup or restore process for networked environments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
    • G06F16/1752—De-duplication implemented within the file system, e.g. based on file segments based on file chunks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
HK16102166.6A 2012-10-01 2016-02-25 優化用於去重的數據塊大小 HK1214378A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201261708255P 2012-10-01 2012-10-01
US201261708295P 2012-10-01 2012-10-01
US13/802,167 US9626373B2 (en) 2012-10-01 2013-03-13 Optimizing data block size for deduplication
PCT/US2013/062736 WO2014055449A1 (en) 2012-10-01 2013-09-30 Optimizing data block size for deduplication

Publications (1)

Publication Number Publication Date
HK1214378A1 true HK1214378A1 (zh) 2016-07-22

Family

ID=50386176

Family Applications (1)

Application Number Title Priority Date Filing Date
HK16102166.6A HK1214378A1 (zh) 2012-10-01 2016-02-25 優化用於去重的數據塊大小

Country Status (5)

Country Link
US (2) US9626373B2 (zh)
EP (1) EP2904525B1 (zh)
CN (1) CN104871155B (zh)
HK (1) HK1214378A1 (zh)
WO (1) WO2014055449A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484570A (zh) * 2016-10-28 2017-03-08 福建平实科技有限公司 一种针对防御勒索软件文件数据的备份保护方法和系统

Families Citing this family (121)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7120692B2 (en) 1999-12-02 2006-10-10 Senvid, Inc. Access and control system for network-enabled devices
DE60038982D1 (de) 1999-12-02 2008-07-03 Western Digital Tech Inc System zum fernaufnehmen von fernsehprogrammen
US7934251B2 (en) 1999-12-02 2011-04-26 Western Digital Technologies, Inc. Managed peer-to-peer applications, systems and methods for distributed data access and storage
US7274659B2 (en) 2001-07-27 2007-09-25 Western Digital Ventures, Inc. Providing streaming media data
US8526798B2 (en) 2009-12-23 2013-09-03 Western Digital Technologies, Inc. Portable content container displaying A/V files in response to a command received from a consumer device
US10019741B2 (en) 2010-08-09 2018-07-10 Western Digital Technologies, Inc. Methods and systems for a personal multimedia content archive
US8914634B2 (en) 2012-04-10 2014-12-16 Western Digital Technologies, Inc. Digital rights management system transfer of content and distribution
US8831218B2 (en) 2012-04-10 2014-09-09 Western Digital Technologies, Inc. Digital rights management system and methods for provisioning content to an intelligent storage
US9009525B1 (en) 2012-06-07 2015-04-14 Western Digital Technologies, Inc. Methods and systems for NAS device pairing and mirroring
US9014540B1 (en) * 2012-07-17 2015-04-21 Time Warner Cable Enterprises Llc Techniques for provisioning local media players with content
US9559975B1 (en) 2012-09-29 2017-01-31 Western Digital Technologies, Inc. Real-time analysis of quality of service for multimedia traffic in a local area network
US9942161B1 (en) 2012-09-29 2018-04-10 Western Digital Technologies, Inc. Methods and systems for configuring and updating session-based quality of service for multimedia traffic in a local area network
US9280482B2 (en) 2012-12-13 2016-03-08 Western Digital Technologies, Inc. Methods and systems for provisioning a bootable image on to an external drive
US9001697B2 (en) 2012-12-14 2015-04-07 Western Digital Technologies, Inc. Methods and devices for replacing and configuring a router in a network
US9063664B1 (en) 2012-12-18 2015-06-23 Emc Corporation Method and system for processing checksum of a data stream to optimize deduplication
US9087086B1 (en) * 2012-12-18 2015-07-21 Emc Corporation Method and system for handling object boundaries of a data stream to optimize deduplication
US9058835B2 (en) 2013-03-13 2015-06-16 Western Digital Technologies, Inc. Methods and systems for optimized staggered disk drive spinup
US9171003B2 (en) 2013-03-15 2015-10-27 Western Digital Technologies, Inc. Shared media crawler database method and system
US9110758B2 (en) 2013-03-15 2015-08-18 Western Digital Technologies, Inc. Cross-platform software framework for embedded systems on data storage device
US9152490B2 (en) 2013-04-02 2015-10-06 Western Digital Technologies, Inc. Detection of user behavior using time series modeling
US10073987B2 (en) 2013-04-02 2018-09-11 Western Digital Technologies, Inc. Methods and systems for privileged execution support for file system commands on a storage device
US8984190B2 (en) 2013-05-23 2015-03-17 Western Digital Technologies, Inc. Methods and devices for booting a network attached storage with two logical units
US9213611B2 (en) 2013-07-24 2015-12-15 Western Digital Technologies, Inc. Automatic raid mirroring when adding a second boot drive
US9430031B2 (en) 2013-07-29 2016-08-30 Western Digital Technologies, Inc. Power conservation based on caching
CN105051724B (zh) * 2013-08-19 2018-09-28 华为技术有限公司 一种数据对象处理方法与装置
US9405479B1 (en) 2013-08-26 2016-08-02 Western Digital Technologies, Inc. Faster file compression using sliding compression window and backward compound pointers
US9503532B2 (en) 2013-09-03 2016-11-22 Western Digital Technologies, Inc. Rediscovery of past data
US9417863B2 (en) 2013-09-27 2016-08-16 Western Digital Technologies, Inc. System and method for expedited loading of an image onto a storage device
US9275697B2 (en) 2013-10-03 2016-03-01 Western Digital Technologies, Inc. Utilizing destructive features as RAM code for a storage device
US9584873B2 (en) 2013-10-11 2017-02-28 Western Digital Technologies, Inc. Method and apparatus for configuring an electronic device
US9871882B1 (en) 2014-01-02 2018-01-16 Western Digital Technologies, Inc. Optimized N-stream sequential media playback caching method and system
US9626376B1 (en) 2014-02-14 2017-04-18 Western Digital Technologies, Inc. Local area network distributed storage
NZ717601A (en) * 2014-02-14 2017-05-26 Huawei Tech Co Ltd Method and server for searching for data stream dividing point based on server
JP6260359B2 (ja) * 2014-03-07 2018-01-17 富士通株式会社 データ分割処理プログラム，データ分割処理装置及びデータ分割処理方法
US10091694B1 (en) 2014-03-12 2018-10-02 Western Digital Technologies, Inc. Device pairing over different networks
US10027547B1 (en) * 2014-03-28 2018-07-17 EMC IP Holding Company LLC Autonomic self-optimization of protection storage
US9886216B2 (en) 2014-04-08 2018-02-06 Western Digital Technologies, Inc. Distributed remote data storage access
US9823842B2 (en) 2014-05-12 2017-11-21 The Research Foundation For The State University Of New York Gang migration of virtual machines using cluster-wide deduplication
US9250893B2 (en) 2014-05-14 2016-02-02 Western Digital Technologies, Inc. Virtualized and automated software build system
US10652193B2 (en) 2014-06-18 2020-05-12 Western Digital Technologies, Inc. Managing and accessing data storage systems
US9569112B1 (en) 2014-09-25 2017-02-14 Western Digital Technologies, Inc. Drive compatibility information maintenance
US10162832B1 (en) * 2014-09-25 2018-12-25 Imanis Data, Inc. Data aware deduplication
US9866634B1 (en) 2014-09-26 2018-01-09 Western Digital Technologies, Inc. Managing and accessing data storage systems
US9864658B1 (en) * 2014-12-01 2018-01-09 Vce Company, Llc Automation of deduplication storage capacity sizing and trending analysis
US9552162B2 (en) * 2014-12-08 2017-01-24 Sap Se Splitting-based approach to control data and storage growth in a computer system
US9596183B2 (en) 2014-12-12 2017-03-14 Western Digital Technologies, Inc. NAS off-loading of network traffic for shared files
US9081792B1 (en) * 2014-12-19 2015-07-14 Storagecraft Technology Corporation Optimizing backup of whitelisted files
US10715595B2 (en) 2014-12-23 2020-07-14 Western Digital Technologies, Inc. Remotes metadata extraction and transcoding of files to be stored on a network attached storage (NAS)
US10063925B2 (en) 2014-12-23 2018-08-28 Western Digital Technologies, Inc. Providing digital video assets with multiple age rating levels
US9619340B1 (en) 2014-12-24 2017-04-11 Western Digital Technologies, Inc. Disaster recovery on dissimilar hardware
US9734117B2 (en) 2015-01-26 2017-08-15 Western Digital Technologies, Inc. Data storage device and method for integrated bridge firmware to be retrieved from a storage system on chip (SOC)
US9948618B2 (en) 2015-02-05 2018-04-17 Western Digital Technologies, Inc. Secure stream buffer on network attached storage
US9710170B2 (en) 2015-03-05 2017-07-18 Western Digital Technologies, Inc. Processing data storage commands for enclosure services
US9942294B1 (en) 2015-03-30 2018-04-10 Western Digital Technologies, Inc. Symmetric and continuous media stream from multiple sources
US9684569B2 (en) 2015-03-30 2017-06-20 Western Digital Technologies, Inc. Data deduplication using chunk files
US10574745B2 (en) 2015-03-31 2020-02-25 Western Digital Technologies, Inc. Syncing with a local paired device to obtain data from a remote server using point-to-point communication
US10394760B1 (en) 2015-04-16 2019-08-27 Western Digital Technologies, Inc. Browsable data backup
US9836417B2 (en) 2015-04-20 2017-12-05 Western Digital Technologies, Inc. Bridge configuration in computing devices
WO2016173648A1 (en) * 2015-04-29 2016-11-03 Hewlett-Packard Development Company, L.P. Deduplication process
US9971659B1 (en) 2015-06-24 2018-05-15 Western Digital Technologies, Inc. Memory programming providing corruption protection
US10567518B2 (en) 2015-06-26 2020-02-18 Western Digital Technologies, Inc. Automatic discovery and onboarding of electronic devices
US9846621B1 (en) 2015-06-26 2017-12-19 Western Digital Technologies, Inc. Disaster recovery—multiple restore options and automatic management of restored computing devices
US10459891B2 (en) 2015-09-30 2019-10-29 Western Digital Technologies, Inc. Replicating data across data storage devices of a logical volume
US10102138B2 (en) 2015-10-22 2018-10-16 Western Digital Technologies, Inc. Division of data storage in single-storage device architecture
US9763082B2 (en) 2015-11-09 2017-09-12 Western Digital Technologies, Inc. Optimizing setup for wireless devices
EP3182278A1 (en) 2015-12-17 2017-06-21 Vsoft Spolka Akcyjna System for automatic preparation of integrated development environments
US9772650B2 (en) 2015-12-29 2017-09-26 Western Digital Technologies, Inc. Solving unstable universal asynchronous receive transmit (UART) communication between a power manager and a universal serial bus (USB)-bridge device
US10078451B1 (en) * 2016-01-22 2018-09-18 Red Hat, Inc. Deduplicating data based on boundary identification
US10574751B2 (en) 2016-03-22 2020-02-25 International Business Machines Corporation Identifying data for deduplication in a network storage environment
US10613761B1 (en) * 2016-08-26 2020-04-07 EMC IP Holding Company LLC Data tiering based on data service status
CN108153771A (zh) * 2016-12-05 2018-06-12 天脉聚源（北京）科技有限公司 一种提高大数据队列处理效率的方法和系统
US10282175B2 (en) * 2017-01-24 2019-05-07 Salesforce.Com, Inc. Methods and systems for performing a partial build
US10621144B2 (en) 2017-03-23 2020-04-14 International Business Machines Corporation Parallel deduplication using automatic chunk sizing
US10360193B2 (en) * 2017-03-24 2019-07-23 Western Digital Technologies, Inc. Method and apparatus for smart archiving and analytics
US10972569B2 (en) * 2017-04-24 2021-04-06 International Business Machines Corporation Apparatus, method, and computer program product for heterogenous compression of data streams
US11099983B2 (en) 2017-04-27 2021-08-24 EMC IP Holding Company LLC Consolidating temporally-related data within log-based storage
US11194495B2 (en) 2017-04-27 2021-12-07 EMC IP Holding Company LLC Best-effort deduplication of data while the data resides in a front-end log along an I/O path that leads to back end storage
US11402998B2 (en) 2017-04-27 2022-08-02 EMC IP Holding Company LLC Re-placing data within a mapped-RAID environment comprising slices, storage stripes, RAID extents, device extents and storage devices
CN108984103B (zh) 2017-06-02 2021-06-22 伊姆西Ip控股有限责任公司 用于去重的方法和设备
CN108984575B (zh) * 2017-06-05 2021-08-06 上海华岭集成电路技术股份有限公司 一种三维系统集成电路晶圆测试探针台数据结构保存方法
CN107357687A (zh) * 2017-07-21 2017-11-17 长沙曙通信息科技有限公司 一种容灾备份新型重复数据删除实现方法
WO2019022631A1 (en) 2017-07-27 2019-01-31 EMC IP Holding Company LLC STORING DATA IN DIFFERENTLY SIZED WAFERS WITHIN DIFFERENT STORAGE LEVELS
US10521400B1 (en) * 2017-07-31 2019-12-31 EMC IP Holding Company LLC Data reduction reporting in storage systems
EP3659043B1 (en) 2017-08-25 2023-02-22 Huawei Technologies Co., Ltd. Apparatus and method for storing received data blocks as deduplicated data blocks
US10789211B1 (en) * 2017-10-04 2020-09-29 Pure Storage, Inc. Feature-based deduplication
US10282129B1 (en) 2017-10-24 2019-05-07 Bottomline Technologies (De), Inc. Tenant aware, variable length, deduplication of stored data
WO2019083390A1 (en) 2017-10-26 2019-05-02 EMC IP Holding Company LLC USE OF RECURRENT WRITE QUOTAS TO OPTIMIZE THE USE OF STATIC SEMICONDUCTOR DISK
WO2019083389A1 (en) 2017-10-26 2019-05-02 EMC IP Holding Company LLC MANAGING A FILE SYSTEM IN MULTIPLE LOGIC UNIT NUMBERS (LUN)
US11461250B2 (en) 2017-10-26 2022-10-04 EMC IP Holding Company LLC Tuning data storage equipment based on comparing observed I/O statistics with expected I/O statistics which are defined by operating settings that control operation
CN107766564B (zh) * 2017-11-07 2020-02-21 上海携程商务有限公司 记录式数据压缩方法、装置、电子设备、存储介质
US10579593B2 (en) 2018-01-31 2020-03-03 EMC IP Holding Company, LLC Techniques for selectively deactivating storage deduplication
CN108428457B (zh) * 2018-02-12 2021-03-23 北京百度网讯科技有限公司 音频去重方法及装置
US11119681B2 (en) 2018-04-28 2021-09-14 Hewlett Packard Enterprise Development Lp Opportunistic compression
US20200034244A1 (en) * 2018-07-26 2020-01-30 EMC IP Holding Company LLC Detecting server pages within backups
CN110968575B (zh) * 2018-09-30 2023-06-06 南京工程学院 一种大数据处理系统的去重方法
US11003629B2 (en) * 2018-10-31 2021-05-11 EMC IP Holding Company LLC Dual layer deduplication for application specific file types in an information processing system
US11838363B2 (en) 2018-11-05 2023-12-05 Netapp, Inc. Custom views of sensor data
US11221778B1 (en) 2019-04-02 2022-01-11 Pure Storage, Inc. Preparing data for deduplication
US20200356292A1 (en) * 2019-05-10 2020-11-12 Dell Products, Lp System and Method for Performance Based Dynamic Optimal Block Size Data Deduplication
US11262927B2 (en) 2019-07-30 2022-03-01 Sony Interactive Entertainment LLC Update optimization using feedback on probability of change for regions of data
US11307841B2 (en) 2019-07-30 2022-04-19 Sony Interactive Entertainment LLC Application patching using variable-sized units
US11449325B2 (en) 2019-07-30 2022-09-20 Sony Interactive Entertainment LLC Data change detection using variable-sized data chunks
CN112306372A (zh) 2019-07-31 2021-02-02 伊姆西Ip控股有限责任公司 用于处理数据的方法、设备和程序产品
US20210034576A1 (en) * 2019-08-01 2021-02-04 EMC IP Holding Company, LLC System and method for increasing data reduction with background recompression
US20210034579A1 (en) * 2019-08-01 2021-02-04 EMC IP Holding Company, LLC System and method for deduplication optimization
US11409772B2 (en) 2019-08-05 2022-08-09 International Business Machines Corporation Active learning for data matching
US11663275B2 (en) 2019-08-05 2023-05-30 International Business Machines Corporation Method for dynamic data blocking in a database system
US11449465B2 (en) * 2019-09-11 2022-09-20 International Business Machines Corporation Fixed chunk size deduplication with variable-size chunking
US20210117389A1 (en) * 2019-10-18 2021-04-22 Vmware, Inc. Network traffic optimization using deduplication information from a storage system
CN113126879B (zh) * 2019-12-30 2022-11-29 中国移动通信集团四川有限公司 一种数据存储方法、装置和电子设备
WO2021248863A1 (zh) * 2020-06-11 2021-12-16 华为技术有限公司 数据处理方法及存储设备
US11861169B2 (en) * 2020-06-26 2024-01-02 Netapp, Inc. Layout format for compressed data
US20220066991A1 (en) * 2020-09-02 2022-03-03 Micro Focus Llc Command line utility to generate user-controlled fragmentated test data on a hard disk drive
CN114816222A (zh) * 2021-01-22 2022-07-29 伊姆西Ip控股有限责任公司 数据压缩方法、电子设备和计算机程序产品
US20220245112A1 (en) * 2021-02-02 2022-08-04 Maxlinear, Inc. Hashing a data set with multiple hash engines
US20220245097A1 (en) * 2021-02-02 2022-08-04 Maxlinear, Inc. Hashing with differing hash size and compression size
US11687416B2 (en) 2021-09-27 2023-06-27 Kyndryl, Inc. Data backup optimization
CN114356212A (zh) * 2021-11-23 2022-04-15 阿里巴巴（中国）有限公司 数据处理方法、系统及计算机可读存储介质
US11748308B2 (en) 2022-02-09 2023-09-05 Seagate Technology Llc Hybrid deduplication in storage systems
CN114579050B (zh) * 2022-02-14 2024-04-02 阿里巴巴（中国）有限公司 处理压缩数据的方法以及装置
US11921644B2 (en) 2022-05-20 2024-03-05 Western Digital Technologies, Inc. Optimizing huge page management

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6091835A (en) 1994-08-31 2000-07-18 Penop Limited Method and system for transcribing electronic affirmations
US5544255A (en) 1994-08-31 1996-08-06 Peripheral Vision Limited Method and system for the capture, storage, transport and authentication of handwritten signatures
DE69802294T2 (de) 1997-08-29 2002-05-16 Hewlett Packard Co Systemen zur datensicherung und -rückgewinnung
US20040039912A1 (en) 1999-02-26 2004-02-26 Bitwise Designs, Inc. To Authentidate Holding Corp. Computer networked system and method of digital file management and authentication
US6757832B1 (en) 2000-02-15 2004-06-29 Silverbrook Research Pty Ltd Unauthorized modification of values in flash memory
US6460163B1 (en) 2000-04-05 2002-10-01 International Business Machines Corporation Software and method for digital content vending and transport
US7058978B2 (en) 2000-12-27 2006-06-06 Microsoft Corporation Security component for a computing device
AU2002367036A1 (en) 2002-01-18 2003-07-30 Telefonaktiebolaget L M Ericsson (Publ) Loading data into a mobile terminal
US7020798B2 (en) 2002-06-27 2006-03-28 Microsoft Corporation Detecting low-level data corruption
US20040158794A1 (en) 2002-07-19 2004-08-12 Niesen Joseph W. Reduced overhead CRC functionality for packets and link layer superframes
US20040153935A1 (en) 2002-07-19 2004-08-05 Niesen Joseph W. Reduced overhead CRC functionality for packets and link layer superframes
US6950517B2 (en) 2002-07-24 2005-09-27 Qualcomm, Inc. Efficient encryption and authentication for data processing systems
US7165076B2 (en) 2002-11-15 2007-01-16 Check Point Software Technologies, Inc. Security system with methodology for computing unique security signature for executable file employed across different machines
US7496959B2 (en) 2003-06-23 2009-02-24 Architecture Technology Corporation Remote collection of computer forensic evidence
US7788726B2 (en) 2003-07-02 2010-08-31 Check Point Software Technologies, Inc. System and methodology providing information lockbox
US7454443B2 (en) * 2003-08-26 2008-11-18 Tamir Ram Method, system, and program for personal data management using content-based replication
US7555531B2 (en) * 2004-04-15 2009-06-30 Microsoft Corporation Efficient algorithm and protocol for remote differential compression
US7937371B2 (en) 2008-03-14 2011-05-03 International Business Machines Corporation Ordering compression and deduplication of data
US7539710B1 (en) 2008-04-11 2009-05-26 International Business Machines Corporation Method of and system for deduplicating backed up data in a client-server environment
US7996371B1 (en) * 2008-06-10 2011-08-09 Netapp, Inc. Combining context-aware and context-independent data deduplication for optimal space savings
US8620845B2 (en) * 2008-09-24 2013-12-31 Timothy John Stoakes Identifying application metadata in a backup stream
CA2747661A1 (en) * 2008-12-18 2010-07-15 Copiun, Inc. Methods and apparatus for content-aware data partitioning and data de-duplication
US9176978B2 (en) 2009-02-05 2015-11-03 Roderick B. Wideman Classifying data for deduplication and storage
US8205065B2 (en) 2009-03-30 2012-06-19 Exar Corporation System and method for data deduplication
US8423520B2 (en) 2009-11-23 2013-04-16 Dell Products L.P. Methods and apparatus for efficient compression and deduplication
CN101706825B (zh) * 2009-12-10 2011-04-20 华中科技大学 一种基于文件内容类型的重复数据删除方法
US9201890B2 (en) 2010-10-04 2015-12-01 Dell Products L.P. Storage optimization manager
US8380681B2 (en) 2010-12-16 2013-02-19 Microsoft Corporation Extensible pipeline for data deduplication
CN103917960A (zh) * 2011-08-19 2014-07-09 株式会社日立制作所 存储装置和副本数据检测方法
CN102684827B (zh) * 2012-03-02 2015-07-29 华为技术有限公司 数据处理方法及数据处理设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484570A (zh) * 2016-10-28 2017-03-08 福建平实科技有限公司 一种针对防御勒索软件文件数据的备份保护方法和系统

Also Published As

Publication number Publication date
US9626373B2 (en) 2017-04-18
CN104871155A (zh) 2015-08-26
CN104871155B (zh) 2019-12-06
EP2904525A4 (en) 2016-06-08
US10552379B2 (en) 2020-02-04
US20140095439A1 (en) 2014-04-03
US20170286443A1 (en) 2017-10-05
EP2904525B1 (en) 2018-02-28
WO2014055449A1 (en) 2014-04-10
EP2904525A1 (en) 2015-08-12

Similar Documents

Publication Publication Date Title
HK1214378A1 (zh) 優化用於去重的數據塊大小
EP2695065A4 (en) DEDUPLICATION OF DATA
GB2515705B (en) Data syncronisation
GB2477607B (en) Sampling based data de-duplication
EP2883132A4 (en) IDENTIFICATION OF ARCHIVING DATA
EP2831739A4 (en) VISUALIZATION OF PROFILE DATA
GB201322222D0 (en) searchable data archive
EP2837218A4 (en) CONFIGURATION DATA EXCHANGE
GB201112665D0 (en) Data anonymisation
EP2810171A4 (en) SYSTEMS AND METHODS FOR DEDUPLICATING DATA BLOCKS
EP2856692A4 (en) SYNCHRONIZATION OF DATA INTERFACE
EP2820545A4 (en) FRAGMENTATION CONTROL FOR PERFORMING DISCHARGE OPERATIONS
GB201218781D0 (en) Data loading tool
GB2502663B (en) Data processing
GB201200350D0 (en) Data transport
GB2502662B (en) Data Processing
EP2912569A4 (en) DOCUMENT SYNTHESIS METHOD
EP2845107A4 (en) SEGMENT COMBINATION FOR DEDUPLICATION
EP2856310A4 (en) INTEGRATION OF MULTI-ENTITY DATA
IL241379A0 (en) A device for reducing the volume of information
EP2845106A4 (en) DETERMINATION OF SEGMENT FRONTIERS FOR DEDUPLICATION
GB201300517D0 (en) Data collection
GB2500444B (en) Data processing
GB201207379D0 (en) Data interface
EP2685340A4 (en) DATA LINE