CN103294610A - 可重复使用的内容可寻址存储 - Google Patents
可重复使用的内容可寻址存储 Download PDFInfo
- Publication number
- CN103294610A CN103294610A CN2013100325456A CN201310032545A CN103294610A CN 103294610 A CN103294610 A CN 103294610A CN 2013100325456 A CN2013100325456 A CN 2013100325456A CN 201310032545 A CN201310032545 A CN 201310032545A CN 103294610 A CN103294610 A CN 103294610A
- Authority
- CN
- China
- Prior art keywords
- storage
- sheet
- sheet storage
- block structure
- composite sheet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/137—Hash-based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/28—Using a specific disk cache architecture
- G06F2212/283—Plural cache memories
- G06F2212/284—Plural cache memories being distributed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/46—Caching storage objects of specific type in disk cache
- G06F2212/463—File
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (16)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/358,742 | 2012-01-26 | ||
US13/358,742 US8631209B2 (en) | 2012-01-26 | 2012-01-26 | Reusable content addressable stores as building blocks for creating large scale storage infrastructures |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103294610A true CN103294610A (zh) | 2013-09-11 |
CN103294610B CN103294610B (zh) | 2016-08-10 |
Family
ID=48871335
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310032545.6A Active CN103294610B (zh) | 2012-01-26 | 2013-01-28 | 可重复使用的内容可寻址存储 |
Country Status (2)
Country | Link |
---|---|
US (1) | US8631209B2 (zh) |
CN (1) | CN103294610B (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9075834B2 (en) | 2012-01-26 | 2015-07-07 | Upthere, Inc. | Detecting deviation between replicas using bloom filters |
US9176871B1 (en) | 2012-01-26 | 2015-11-03 | Upthere, Inc. | Garbage collection of chunks |
CN105046162A (zh) * | 2014-03-12 | 2015-11-11 | 阿普赛尔有限公司 | 在内容可寻址存储系统中维护并使用子对父映射的缓存 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9183212B2 (en) | 2012-01-26 | 2015-11-10 | Upthere, Inc. | Representing directory structure in content-addressable storage systems |
US8880786B2 (en) * | 2012-09-28 | 2014-11-04 | Apple Inc. | Flash translation layer (FTL) database journaling schemes |
US20150039823A1 (en) * | 2013-07-30 | 2015-02-05 | Mediatek Inc. | Table lookup apparatus using content-addressable memory based device and related table lookup method thereof |
WO2015178944A1 (en) * | 2014-05-23 | 2015-11-26 | Hewlett-Packard Development Company, L.P. | Using location addressed storage as content addressed storage |
WO2016048331A1 (en) | 2014-09-25 | 2016-03-31 | Hewlett Packard Enterprise Development Lp | Storage of a data chunk with a colliding fingerprint |
US10108503B2 (en) | 2015-08-24 | 2018-10-23 | Western Digital Technologies, Inc. | Methods and systems for updating a recovery sequence map |
US10241856B2 (en) | 2016-09-09 | 2019-03-26 | Oracle International Corporation | Memory quarantine |
US10417202B2 (en) | 2016-12-21 | 2019-09-17 | Hewlett Packard Enterprise Development Lp | Storage system deduplication |
US10394485B1 (en) * | 2018-03-29 | 2019-08-27 | EMC IP Holding Company LLC | Storage system with efficient re-synchronization mode for use in replication of data from source to target |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0934791A (ja) * | 1995-07-21 | 1997-02-07 | Ricoh Co Ltd | 情報記憶装置 |
US20040107323A1 (en) * | 2002-11-28 | 2004-06-03 | Hirokazu Matsuura | Multiprocessor system |
CN101303669A (zh) * | 2007-05-08 | 2008-11-12 | 松下电器产业株式会社 | 具备地址转换存储器访问机构的半导体装置 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1323308B1 (en) * | 2000-08-15 | 2014-08-20 | Polycom Israel Ltd. | Delay reduction for transmission and processing of video data |
WO2006043274A2 (en) * | 2004-10-22 | 2006-04-27 | Flash Networks Ltd | Method and system for accelerating downloading of web pages. |
GB2446169A (en) * | 2006-12-01 | 2008-08-06 | David Irvine | Granular accessibility to data in a distributed and/or corporate network |
GB2446199A (en) * | 2006-12-01 | 2008-08-06 | David Irvine | Secure, decentralised and anonymous peer-to-peer network |
WO2008102195A1 (en) | 2007-02-22 | 2008-08-28 | Telefonaktiebolaget Lm Ericsson (Publ) | Consistent and fault tolerant distributed hash table (dht) overlay network |
US7788220B1 (en) * | 2007-12-31 | 2010-08-31 | Emc Corporation | Storage of data with composite hashes in backup systems |
US8335889B2 (en) | 2008-09-11 | 2012-12-18 | Nec Laboratories America, Inc. | Content addressable storage systems and methods employing searchable blocks |
US9401967B2 (en) * | 2010-06-09 | 2016-07-26 | Brocade Communications Systems, Inc. | Inline wire speed deduplication system |
US8396905B2 (en) | 2010-11-16 | 2013-03-12 | Actifio, Inc. | System and method for improved garbage collection operations in a deduplicated store by tracking temporal relationships among copies |
US20120159098A1 (en) | 2010-12-17 | 2012-06-21 | Microsoft Corporation | Garbage collection and hotspots relief for a data deduplication chunk store |
US9052824B2 (en) | 2012-01-26 | 2015-06-09 | Upthere, Inc. | Content addressable stores based on sibling groups |
-
2012
- 2012-01-26 US US13/358,742 patent/US8631209B2/en active Active
-
2013
- 2013-01-28 CN CN201310032545.6A patent/CN103294610B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0934791A (ja) * | 1995-07-21 | 1997-02-07 | Ricoh Co Ltd | 情報記憶装置 |
US20040107323A1 (en) * | 2002-11-28 | 2004-06-03 | Hirokazu Matsuura | Multiprocessor system |
CN101303669A (zh) * | 2007-05-08 | 2008-11-12 | 松下电器产业株式会社 | 具备地址转换存储器访问机构的半导体装置 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9075834B2 (en) | 2012-01-26 | 2015-07-07 | Upthere, Inc. | Detecting deviation between replicas using bloom filters |
US9176871B1 (en) | 2012-01-26 | 2015-11-03 | Upthere, Inc. | Garbage collection of chunks |
US9207866B2 (en) | 2012-01-26 | 2015-12-08 | Upthere, Inc. | Chunk-level client side encryption in hierarchical content addressable storage systems |
US9411749B2 (en) | 2012-01-26 | 2016-08-09 | Upthere, Inc. | Chunk-level client side encryption in hierarchical content addressable storage systems |
CN105046162A (zh) * | 2014-03-12 | 2015-11-11 | 阿普赛尔有限公司 | 在内容可寻址存储系统中维护并使用子对父映射的缓存 |
CN105046162B (zh) * | 2014-03-12 | 2018-07-27 | 西部数据技术公司 | 在内容可寻址存储系统中维护并使用子对父映射的缓存 |
Also Published As
Publication number | Publication date |
---|---|
CN103294610B (zh) | 2016-08-10 |
US20130198462A1 (en) | 2013-08-01 |
US8631209B2 (en) | 2014-01-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103294610A (zh) | 可重复使用的内容可寻址存储 | |
US8788760B2 (en) | Adaptive caching of data | |
AU2014346369B2 (en) | Managed service for acquisition, storage and consumption of large-scale data streams | |
CN105324770B (zh) | 有效读出副本 | |
CN103150394B (zh) | 面向高性能计算的分布式文件系统元数据管理方法 | |
CN100437519C (zh) | 用于管理被存储在高速缓存中的对象的系统和方法 | |
US9052824B2 (en) | Content addressable stores based on sibling groups | |
JP5411250B2 (ja) | 冗長データ記憶システムへの指示に従ってのデータ配置 | |
US8396938B2 (en) | Providing direct access to distributed managed content | |
CN103620549B (zh) | 用于统一数据存储的存储介质抽象 | |
CN106909317B (zh) | 在存储节点上存储数据 | |
JP6880131B2 (ja) | データ処理用の方法、装置及びシステム | |
US9462056B1 (en) | Policy-based meta-data driven co-location of computation and datasets in the cloud | |
US9940042B2 (en) | Distributed storage system, and data-access method therefor | |
US20160212203A1 (en) | Multi-site heat map management | |
US20100325199A1 (en) | Client, brokerage server and method for providing cloud storage | |
CN102567224A (zh) | 高效高速缓存管理 | |
US20100180208A1 (en) | Server side data cache system | |
KR20200122086A (ko) | 메모리 시스템에서 맵 세그먼트를 전송하는 방법 및 장치 | |
US8010648B2 (en) | Replica placement in a distributed storage system | |
WO2007035580A2 (en) | Providing local access to managed content | |
CN103747072A (zh) | 一种读写数据的方法和应用服务器 | |
US20150106440A1 (en) | Autonomous network streaming | |
US20200153889A1 (en) | Method for uploading and downloading file, and server for executing the same | |
CN105704218A (zh) | 云计算平台中数据存储与管理方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1188858 Country of ref document: HK |
|
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: GR Ref document number: 1188858 Country of ref document: HK |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20171106 Address after: American California Patentee after: Western Digital Technologies, Inc. Address before: American California Patentee before: Up There Inc. |