CN103098443A - 分布式元数据高速缓存 - Google Patents
分布式元数据高速缓存 Download PDFInfo
- Publication number
- CN103098443A CN103098443A CN201180043779XA CN201180043779A CN103098443A CN 103098443 A CN103098443 A CN 103098443A CN 201180043779X A CN201180043779X A CN 201180043779XA CN 201180043779 A CN201180043779 A CN 201180043779A CN 103098443 A CN103098443 A CN 103098443A
- Authority
- CN
- China
- Prior art keywords
- metadata
- file
- speed cache
- peer
- reciprocity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 37
- 238000003860 storage Methods 0.000 claims description 73
- 230000006870 function Effects 0.000 claims description 45
- 238000004891 communication Methods 0.000 claims description 25
- 230000004044 response Effects 0.000 claims description 4
- 230000009471 action Effects 0.000 description 8
- 238000013461 design Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000014759 maintenance of location Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009418 renovation Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/134—Distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1061—Peer-to-peer [P2P] networks using node-based peer discovery mechanisms
- H04L67/1065—Discovery involving distributed pre-established resource-based relationships among peers, e.g. based on distributed hash tables [DHT]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1061—Peer-to-peer [P2P] networks using node-based peer discovery mechanisms
- H04L67/1068—Discovery involving direct consultation or announcement among potential requesting and potential source peers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
- H04L67/1076—Resource dissemination mechanisms or network resource keeping policies for optimal resource availability in the overlay network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/564—Enhancement of application control based on intercepted application data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
- H04L67/5682—Policies or rules for updating, deleting or replacing the stored data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (20)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US38241110P | 2010-09-13 | 2010-09-13 | |
US61/382,411 | 2010-09-13 | ||
PCT/US2011/026808 WO2012036757A1 (en) | 2010-09-13 | 2011-03-02 | Distributed metadata cache |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103098443A true CN103098443A (zh) | 2013-05-08 |
CN103098443B CN103098443B (zh) | 2016-07-06 |
Family
ID=44041651
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201180043779.XA Expired - Fee Related CN103098443B (zh) | 2010-09-13 | 2011-03-02 | 分布式元数据高速缓存 |
Country Status (5)
Country | Link |
---|---|
US (1) | US8468181B2 (zh) |
EP (1) | EP2617177B1 (zh) |
JP (1) | JP5824519B2 (zh) |
CN (1) | CN103098443B (zh) |
WO (1) | WO2012036757A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111399760A (zh) * | 2019-11-19 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Nas集群元数据处理方法、装置、nas网关及介质 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103559224A (zh) * | 2013-10-18 | 2014-02-05 | 华为技术有限公司 | 一种对元数据对象进行散列的方法及装置 |
US11151050B2 (en) | 2020-01-03 | 2021-10-19 | Samsung Electronics Co., Ltd. | Efficient cache eviction and insertions for sustained steady state performance |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101031918A (zh) * | 2004-09-30 | 2007-09-05 | 兄弟工业株式会社 | 节点设备、共享信息更新方法、共享信息存储方法以及程序 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7171469B2 (en) * | 2002-09-16 | 2007-01-30 | Network Appliance, Inc. | Apparatus and method for storing data in a proxy cache in a network |
US8041735B1 (en) * | 2002-11-01 | 2011-10-18 | Bluearc Uk Limited | Distributed file system and method |
US8315975B2 (en) * | 2002-12-09 | 2012-11-20 | Hewlett-Packard Development Company, L.P. | Symbiotic wide-area file system and method |
US7716323B2 (en) * | 2003-07-18 | 2010-05-11 | Netapp, Inc. | System and method for reliable peer communication in a clustered storage system |
JP4247975B2 (ja) * | 2003-08-20 | 2009-04-02 | 日本電信電話株式会社 | データ管理方法、データ管理システム、およびそのためのプログラムならびに記録媒体 |
WO2010064965A1 (en) * | 2008-12-03 | 2010-06-10 | Telefonaktiebolaget L M Ericsson (Publ) | Method for selection of suitable peers in a peer-to-peer (p2p) network |
-
2011
- 2011-03-02 CN CN201180043779.XA patent/CN103098443B/zh not_active Expired - Fee Related
- 2011-03-02 WO PCT/US2011/026808 patent/WO2012036757A1/en active Application Filing
- 2011-03-02 US US13/038,696 patent/US8468181B2/en active Active
- 2011-03-02 EP EP11707975.6A patent/EP2617177B1/en not_active Not-in-force
- 2011-03-02 JP JP2013528189A patent/JP5824519B2/ja not_active Expired - Fee Related
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101031918A (zh) * | 2004-09-30 | 2007-09-05 | 兄弟工业株式会社 | 节点设备、共享信息更新方法、共享信息存储方法以及程序 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111399760A (zh) * | 2019-11-19 | 2020-07-10 | 杭州海康威视系统技术有限公司 | Nas集群元数据处理方法、装置、nas网关及介质 |
CN111399760B (zh) * | 2019-11-19 | 2023-01-24 | 杭州海康威视系统技术有限公司 | Nas集群元数据处理方法、装置、nas网关及介质 |
Also Published As
Publication number | Publication date |
---|---|
JP5824519B2 (ja) | 2015-11-25 |
JP2013541086A (ja) | 2013-11-07 |
WO2012036757A1 (en) | 2012-03-22 |
EP2617177B1 (en) | 2015-12-30 |
CN103098443B (zh) | 2016-07-06 |
EP2617177A1 (en) | 2013-07-24 |
US20120066276A1 (en) | 2012-03-15 |
US8468181B2 (en) | 2013-06-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9703610B2 (en) | Extensible centralized dynamic resource distribution in a clustered data grid | |
AU2013347807B2 (en) | Scaling computing clusters | |
US10911536B2 (en) | Real-time synchronization of data between disparate cloud data sources | |
AU2014212780B2 (en) | Data stream splitting for low-latency data access | |
US8930316B2 (en) | System and method for providing partition persistent state consistency in a distributed data grid | |
US9164806B2 (en) | Processing pattern framework for dispatching and executing tasks in a distributed computing grid | |
KR20120072908A (ko) | 복수 개의 프락시 서버를 포함하는 분산 저장 시스템 및 그 오브젝트 관리 방법 및 컴퓨터에 의하여 독출가능한 저장 매체 | |
Chun et al. | Mobius: unified messaging and data serving for mobile apps | |
CN106777311B (zh) | 航班舱位状态缓存方法和系统 | |
WO2010121218A2 (en) | Policy-based storage structure distribution | |
CN110740155B (zh) | 分布式系统中的请求处理方法及装置 | |
CN105069128B (zh) | 数据同步方法和装置 | |
US10817512B2 (en) | Standing queries in memory | |
CN103098443A (zh) | 分布式元数据高速缓存 | |
US10713279B2 (en) | Enhanced replication | |
EP3750276A1 (en) | Electronic devices, systems and methods | |
US20150088826A1 (en) | Enhanced Performance for Data Duplication | |
US20230283663A1 (en) | Randomization of heartbeat communications among multiple partition groups | |
US10783147B2 (en) | Query result flow control in a network switch | |
CN117057799A (zh) | 资产数据处理方法、装置、设备及存储介质 | |
JP6020210B2 (ja) | クォータ管理機能付ファイルシステム、クォータ管理方法およびクォータ管理プログラム | |
Srivastava et al. | A Replication Protocol for Real Time database System | |
CN116483921A (zh) | 一种数据共享方法、装置、系统及存储介质 | |
Kadam et al. | A Review on Distributed File System in Hadoop |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
ASS | Succession or assignment of patent right |
Owner name: TOSHIBA K.K. Free format text: FORMER OWNER: MAWIER INTERNATIONAL TRADE CO., LTD. Effective date: 20140611 |
|
C41 | Transfer of patent application or patent right or utility model | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20140611 Address after: Tokyo, Japan Applicant after: Toshiba Corp. Address before: Babado J San Mega Le Applicant before: MARVELL WORLD TRADE Ltd. |
|
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20180502 Address after: Tokyo, Japan Patentee after: TOSHIBA MEMORY Corp. Address before: Tokyo, Japan Patentee before: Toshiba Corp. |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160706 |