CA2944362C - Scalable file storage service - Google Patents

Scalable file storage service Download PDF

Info

Publication number
CA2944362C
CA2944362C CA2944362A CA2944362A CA2944362C CA 2944362 C CA2944362 C CA 2944362C CA 2944362 A CA2944362 A CA 2944362A CA 2944362 A CA2944362 A CA 2944362A CA 2944362 C CA2944362 C CA 2944362C
Authority
CA
Canada
Prior art keywords
metadata
node
storage
subsystem
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2944362A
Other languages
English (en)
French (fr)
Other versions
CA2944362A1 (en
Inventor
Pradeep Vincent
Wayne William Duso
Matti Juhani Oikarinen
Matteo Frigo
Iii Sorenson James Christopher
Original Assignee
Amazon Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Amazon Technologies Inc filed Critical Amazon Technologies Inc
Publication of CA2944362A1 publication Critical patent/CA2944362A1/en
Application granted granted Critical
Publication of CA2944362C publication Critical patent/CA2944362C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/178—Techniques for file synchronisation in file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CA2944362A 2014-03-31 2015-03-31 Scalable file storage service Active CA2944362C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/231,088 2014-03-31
US14/231,088 US10372685B2 (en) 2014-03-31 2014-03-31 Scalable file storage service
PCT/US2015/023676 WO2015153663A1 (en) 2014-03-31 2015-03-31 Scalable file storage service

Publications (2)

Publication Number Publication Date
CA2944362A1 CA2944362A1 (en) 2015-10-08
CA2944362C true CA2944362C (en) 2020-01-28

Family

ID=54190651

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2944362A Active CA2944362C (en) 2014-03-31 2015-03-31 Scalable file storage service

Country Status (10)

Country Link
US (1) US10372685B2 (https=)
EP (1) EP3127000B1 (https=)
JP (1) JP6416279B2 (https=)
KR (1) KR101856402B1 (https=)
CN (1) CN106462545B (https=)
AU (1) AU2015240908B2 (https=)
BR (1) BR112016022558B1 (https=)
CA (1) CA2944362C (https=)
SG (1) SG11201608143WA (https=)
WO (1) WO2015153663A1 (https=)

Families Citing this family (121)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10235404B2 (en) * 2014-06-25 2019-03-19 Cohesity, Inc. Distributed key-value store
JP6235156B2 (ja) * 2014-08-29 2017-11-22 株式会社日立製作所 計算機システムおよび負荷平準化プログラム
US9773004B2 (en) * 2014-10-24 2017-09-26 Netapp, Inc. Methods for replicating data and enabling instantaneous access to data and devices thereof
US9697227B2 (en) 2014-10-27 2017-07-04 Cohesity, Inc. Concurrent access and transactions in a distributed file system
US10192202B2 (en) * 2014-12-31 2019-01-29 Sap Se Mapping for collaborative contribution
US10489353B2 (en) * 2015-01-05 2019-11-26 Hitachi, Ltd. Computer system and data management method
US10082985B2 (en) * 2015-03-27 2018-09-25 Pure Storage, Inc. Data striping across storage nodes that are assigned to multiple logical arrays
US10178169B2 (en) * 2015-04-09 2019-01-08 Pure Storage, Inc. Point to point based backend communication layer for storage processing
US10031785B2 (en) * 2015-04-10 2018-07-24 International Business Machines Corporation Predictive computing resource allocation for distributed environments
US9979734B2 (en) * 2015-04-20 2018-05-22 Oath Inc. Management of transactions in a distributed transaction system
US9648007B1 (en) * 2015-06-17 2017-05-09 Amazon Technologies, Inc. Token-based storage service
US11082515B2 (en) * 2015-09-26 2021-08-03 Intel Corporation Technologies for offloading data object replication and service function chain management
US10146625B2 (en) * 2015-10-28 2018-12-04 Dell Products L.P. Systems and methods for intelligent data manager for offloading of bulk data transfers
US11003621B2 (en) * 2015-11-11 2021-05-11 International Business Machines Corporation Scalable enterprise content management
US10061702B2 (en) * 2015-11-13 2018-08-28 International Business Machines Corporation Predictive analytics for storage tiering and caching
US10003645B2 (en) 2015-12-15 2018-06-19 Netapp, Inc. Method and apparatus for logical mirroring to a multi-tier target node
JP6607044B2 (ja) * 2016-01-07 2019-11-20 日本電気株式会社 サーバー装置、分散ファイルシステム、分散ファイルシステム制御方法、および、プログラム
US10476906B1 (en) 2016-03-25 2019-11-12 Fireeye, Inc. System and method for managing formation and modification of a cluster within a malware detection system
US10785255B1 (en) 2016-03-25 2020-09-22 Fireeye, Inc. Cluster configuration within a scalable malware detection system
US10601863B1 (en) 2016-03-25 2020-03-24 Fireeye, Inc. System and method for managing sensor enrollment
US10671721B1 (en) * 2016-03-25 2020-06-02 Fireeye, Inc. Timeout management services
US10180812B2 (en) * 2016-06-16 2019-01-15 Sap Se Consensus protocol enhancements for supporting flexible durability options
US10178186B2 (en) 2016-06-16 2019-01-08 Sap Se Connection reestablishment protocol for peer communication in distributed systems
CA3021772C (en) * 2016-06-23 2021-10-12 Landmark Graphics Corporation Parallel, distributed processing in a heterogeneous, distributed environment
US10652248B2 (en) * 2016-07-28 2020-05-12 Molecula Corp. Systems and methods of managing data rights and selective data sharing
CN107819729B (zh) 2016-09-13 2021-06-25 腾讯科技（深圳）有限公司 一种数据请求方法及其系统、接入设备、存储设备和存储介质
US11422719B2 (en) * 2016-09-15 2022-08-23 Pure Storage, Inc. Distributed file deletion and truncation
US10171509B2 (en) * 2016-11-10 2019-01-01 International Business Machines Corporation Filtering and redacting blockchain transactions
CN106534328B (zh) * 2016-11-28 2020-01-31 网宿科技股份有限公司 节点连接方法及分布式计算系统
US10809920B1 (en) * 2016-12-20 2020-10-20 Amazon Technologies, Inc. Block store management for remote storage systems
US10921991B1 (en) 2016-12-20 2021-02-16 Amazon Technologies, Inc. Rule invalidation for a block store management system
US11507283B1 (en) 2016-12-20 2022-11-22 Amazon Technologies, Inc. Enabling host computer systems to access logical volumes by dynamic updates to data structure rules
US10484015B2 (en) 2016-12-28 2019-11-19 Amazon Technologies, Inc. Data storage system with enforced fencing
US11301144B2 (en) 2016-12-28 2022-04-12 Amazon Technologies, Inc. Data storage system
US10509601B2 (en) 2016-12-28 2019-12-17 Amazon Technologies, Inc. Data storage system with multi-tier control plane
US10771550B2 (en) * 2016-12-28 2020-09-08 Amazon Technologies, Inc. Data storage system with redundant internal networks
US10514847B2 (en) 2016-12-28 2019-12-24 Amazon Technologies, Inc. Data storage system with multiple durability levels
US10942893B2 (en) 2017-01-30 2021-03-09 Walmart Apollo, Llc Systems and methods for a specialized computer file system
US10613935B2 (en) * 2017-01-31 2020-04-07 Acronis International Gmbh System and method for supporting integrity of data storage with erasure coding
US11010064B2 (en) 2017-02-15 2021-05-18 Amazon Technologies, Inc. Data system with flush views
US10521135B2 (en) 2017-02-15 2019-12-31 Amazon Technologies, Inc. Data system with data flush mechanism
KR102867307B1 (ko) * 2017-02-23 2025-10-01 에스케이하이닉스 주식회사 데이터 저장 장치의 동작 방법
US10936576B2 (en) * 2017-03-08 2021-03-02 Microsoft Technology Licensing, Llc Replicating storage tables used to manage cloud-based resources to withstand storage account outage
US11210270B2 (en) * 2017-03-09 2021-12-28 Microsoft Technology Licensing, Llc Mapping storage across storage providers
US10503427B2 (en) * 2017-03-10 2019-12-10 Pure Storage, Inc. Synchronously replicating datasets and other managed objects to cloud-based storage systems
US11675520B2 (en) 2017-03-10 2023-06-13 Pure Storage, Inc. Application replication among storage systems synchronously replicating a dataset
US12511068B2 (en) 2017-03-10 2025-12-30 Pure Storage, Inc. Fan out data replication in a storage system
US10771340B2 (en) * 2017-03-16 2020-09-08 Samsung Electronics Co., Ltd. Automatic ethernet storage discovery in hyperscale datacenter environment
US10360009B2 (en) * 2017-03-17 2019-07-23 Verizon Patent And Licensing Inc. Persistent data storage for a microservices application
CN108667867B (zh) 2017-03-29 2021-05-18 华为技术有限公司 数据存储方法及装置
US10572470B2 (en) 2017-04-06 2020-02-25 International Business Machines Corporation Enhanced FSCK mechanism for improved consistency in case of erasure coded object storage architecture built using clustered file system
KR102376157B1 (ko) * 2017-05-02 2022-03-21 한국전자통신연구원 메타데이터 서버 및 그것을 이용한 디렉토리 단위의 메타데이터 분산 방법
US10509774B2 (en) * 2017-06-09 2019-12-17 Red Hat, Inc. Secure containerized user specific isolated data storage
US10545829B2 (en) * 2017-08-29 2020-01-28 Western Digital Technologies, Inc. Using file system extended attributes to recover databases in hierarchical file systems
CN110019440B (zh) * 2017-08-30 2021-06-08 北京国双科技有限公司 数据的处理方法及装置
US20190073485A1 (en) * 2017-09-01 2019-03-07 Ca, Inc. Method to Process Different Files to Duplicate DDNAMEs
US10671436B2 (en) * 2018-05-02 2020-06-02 International Business Machines Corporation Lazy data loading for improving memory cache hit ratio in DAG-based computational system
CN108733832B (zh) * 2018-05-28 2019-04-30 北京阿可科技有限公司 有向无环图的分布式存储方法
US11030123B2 (en) * 2018-06-06 2021-06-08 Oracle International Corporation Fine grained memory and heap management for sharable entities across coordinating participants in database environment
US11074668B2 (en) * 2018-06-19 2021-07-27 Weka.IO Ltd. GPU based server in a distributed file system
US10956365B2 (en) * 2018-07-09 2021-03-23 Cisco Technology, Inc. System and method for garbage collecting inline erasure coded data for a distributed log structured storage system
US11288715B2 (en) * 2018-07-31 2022-03-29 Zuora, Inc. Multi-tenant extensible billing system
US11159569B2 (en) * 2018-08-20 2021-10-26 Cisco Technology, Inc. Elastic policy scaling in multi-cloud fabrics
US20200089795A1 (en) * 2018-09-17 2020-03-19 Hewlett-Packard Development Company, L.P. Dataset orchestration with metadata variance data
WO2020060455A1 (en) * 2018-09-18 2020-03-26 Telefonaktiebolaget Lm Ericsson (Publ) Methods and nodes for delivering data content
US10997158B2 (en) * 2018-09-21 2021-05-04 Microsoft Technology Licensing, Llc Techniques for updating big data tables using snapshot isolation
US11100086B2 (en) * 2018-09-25 2021-08-24 Wandisco, Inc. Methods, devices and systems for real-time checking of data consistency in a distributed heterogenous storage system
US11461015B2 (en) 2018-10-15 2022-10-04 Netapp, Inc. Available storage space in a system with varying data redundancy schemes
EP3667534B1 (en) 2018-12-13 2021-09-29 Schneider Electric Industries SAS Time stamping of data in an offline node
CN109815207A (zh) * 2018-12-28 2019-05-28 深圳市安云信息科技有限公司 数据存储方法和客户端代理
CN111381769B (zh) * 2018-12-29 2023-11-14 深圳市茁壮网络股份有限公司 一种分布式数据存储方法及系统
US10860387B2 (en) 2019-03-15 2020-12-08 Red Hat, Inc. Dynamic distributed work allocation
US11500572B2 (en) * 2019-04-03 2022-11-15 Alibaba Group Holding Limited Method of optimizing performance of a data storage system
US11169723B2 (en) 2019-06-28 2021-11-09 Amazon Technologies, Inc. Data storage system with metadata check-pointing
CN112181899A (zh) * 2019-07-05 2021-01-05 中兴通讯股份有限公司 一种元数据的处理方法、装置及计算机可读存储介质
US11301489B2 (en) 2019-08-06 2022-04-12 Microsoft Technology Licensing, Llc Synchronizing online and offline transfer of data to cloud storage system
US11157462B2 (en) * 2019-08-06 2021-10-26 Microsoft Technology Licensing, Llc Namespace data object name persistence after decoupling of transportable storage device from data server
CN110515923B (zh) * 2019-08-15 2022-12-06 福建中信网安信息科技有限公司 一种分布式数据库之间的数据迁移方法和系统
US11132138B2 (en) 2019-09-06 2021-09-28 International Business Machines Corporation Converting large extent storage pools into small extent storage pools in place
US10901645B1 (en) 2019-09-06 2021-01-26 International Business Machines Corporation Converting small extent storage pools into large extent storage pools in place
US11409781B1 (en) * 2019-09-30 2022-08-09 Amazon Technologies, Inc. Direct storage loading for adding data to a database
US11853450B2 (en) * 2019-11-05 2023-12-26 Saudi Arabian Oil Company Detection of web application anomalies using machine learning
CN111049883B (zh) * 2019-11-15 2022-09-06 北京金山云网络技术有限公司 分布式表格系统的数据读取方法、装置及系统
CA3093681C (en) 2019-11-26 2021-11-09 Citrix Systems, Inc. Document storage and management
US11893064B2 (en) * 2020-02-05 2024-02-06 EMC IP Holding Company LLC Reliably maintaining strict consistency in cluster wide state of opened files in a distributed file system cluster exposing a global namespace
US12056251B2 (en) * 2020-03-18 2024-08-06 Veritas Technologies Llc Systems and methods for protecting a folder from unauthorized file modification
CN113495869B (zh) * 2020-03-20 2024-04-26 华为技术有限公司 文件系统空间的调整方法、装置和电子设备
US11321194B2 (en) * 2020-04-03 2022-05-03 International Business Machines Corporation Recovery from a clustered file system queue failure event using a modified extended attribute of a file
US11182096B1 (en) 2020-05-18 2021-11-23 Amazon Technologies, Inc. Data storage system with configurable durability
CN111756748B (zh) * 2020-06-24 2022-11-15 中国建设银行股份有限公司 一种数据交互方法、装置、电子设备和存储介质
CN113934682B (zh) * 2020-06-29 2025-02-07 北京金山云网络技术有限公司 分布式表格系统的分片分裂方法、装置、服务器及介质
US11681443B1 (en) 2020-08-28 2023-06-20 Amazon Technologies, Inc. Durable data storage with snapshot storage space optimization
CN111966845B (zh) * 2020-08-31 2023-11-17 重庆紫光华山智安科技有限公司 图片管理方法、装置、存储节点及存储介质
US11206313B1 (en) 2020-09-09 2021-12-21 Oracle International Corporation Surrogate cache for optimized service access with compact user objects and offline database updates
CN114327249A (zh) * 2020-10-10 2022-04-12 华为云计算技术有限公司 对象存储服务的数据修改方法、服务节点、客户端及设备
US11356524B1 (en) * 2020-12-18 2022-06-07 International Business Machines Corporation Coordinating requests actioned at a scalable application
US11797522B2 (en) * 2021-01-29 2023-10-24 International Business Machines Corporation Database log writing based on log pipeline contention
US11435954B2 (en) * 2021-01-29 2022-09-06 EMC IP Holding Company LLC Method and system for maximizing performance of a storage system using normalized tokens based on saturation points
CN113190529B (zh) * 2021-04-29 2023-09-19 电子科技大学 一种适用MongoDB数据库的多租户数据共享存储系统
CN115309538B (zh) * 2021-05-08 2025-12-05 戴尔产品有限公司 存储资源之间的基于多指标的工作负荷平衡
US11960452B2 (en) 2021-06-23 2024-04-16 Nutanix, Inc. Independent encoding and transformation of related data replicas and localized background data management in a distributed file system
JP7792761B2 (ja) * 2021-08-03 2025-12-26 キヤノン株式会社 通信装置およびその制御方法
US12386541B1 (en) 2021-09-30 2025-08-12 Amazon Technologies, Inc. Data item and witness service partitioning in a distributed storage system
US12032562B1 (en) 2021-09-30 2024-07-09 Amazon Technologies, Inc. Data event management for monotonic read consistency in a distributed storage system
US11704033B1 (en) * 2021-09-30 2023-07-18 Amazon Technologies, Inc. Request routing management for a distributed storage system
US11789948B2 (en) * 2021-12-10 2023-10-17 Sap Se Computational dependency directory
CN114221946B (zh) * 2021-12-17 2023-09-29 平安壹钱包电子商务有限公司 基于对象网关管理文件的方法、装置、设备及存储介质
US11782630B1 (en) 2022-04-22 2023-10-10 International Business Machines Corporation Efficient use of optional fast replicas via asymmetric replication
US20230350727A1 (en) * 2022-04-27 2023-11-02 Netapp, Inc. Cache-aware load balancing
KR20230163235A (ko) 2022-05-23 2023-11-30 삼성전자주식회사 메모리 장치, 스토리지 장치, 그리고 메모리 장치 및 스토리지 장치를 포함하는 컴퓨팅 시스템
EP4283456B1 (en) * 2022-05-23 2026-01-14 Samsung Electronics Co., Ltd. Memory device, storage device, and computing system including memory device and storage device
US20230418683A1 (en) * 2022-06-24 2023-12-28 International Business Machines Corporation Node management for a cluster
CN115203334B (zh) * 2022-08-03 2025-11-11 中国工商银行股份有限公司 数据处理方法、装置、电子设备和存储介质
US12348522B2 (en) 2022-09-19 2025-07-01 Cisco Technology, Inc. Extended security scheme for reducing the prevalence of broken object level authorization
KR102522910B1 (ko) * 2022-12-29 2023-04-18 주식회사 에스티씨랩 프록시 방식의 서비스 지속성 보장 시스템 및 방법
US12229163B2 (en) * 2023-01-31 2025-02-18 Singlestore, Inc. High availability with consensus in database systems
US12009660B1 (en) 2023-07-11 2024-06-11 T-Mobile Usa, Inc. Predicting space, power, and cooling capacity of a facility to optimize energy usage
US12204778B1 (en) 2023-07-20 2025-01-21 Pure Storage, Inc. Event-based configuration of virtual network interfaces for use by a container system
US12443567B2 (en) * 2023-10-25 2025-10-14 Dell Products L.P. Index node distribution and disaggregation
CN117908804B (zh) * 2024-03-19 2024-05-28 中国空气动力研究与发展中心计算空气动力研究所 基于作业感知的文件条带化方法、装置、设备及介质
CN119127095B (zh) * 2024-11-15 2025-02-28 超云数字技术集团有限公司 基于gRPC的多租户分布式文件系统、请求方法及装置

Family Cites Families (79)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8619238D0 (en) 1986-08-06 1986-09-17 Ici Plc Organic photoconductor
US5701480A (en) 1991-10-17 1997-12-23 Digital Equipment Corporation Distributed multi-version commitment ordering protocols for guaranteeing serializability during transaction processing
US5454108A (en) 1994-01-26 1995-09-26 International Business Machines Corporation Distributed lock manager using a passive, state-full control-server
US5771346A (en) 1996-10-24 1998-06-23 Micron Quantum Devices, Inc. Apparatus and method for detecting over-programming condition in multistate memory device
SE521041C2 (sv) 1997-05-28 2003-09-23 Ericsson Telefon Ab L M Metod för optimering av transaktionsprotokoll inom en distribuerad databas
EP0990214A2 (en) 1998-01-26 2000-04-05 Telenor AS Database management system and method for conditional conflict serializaility of transactions and for combining meta-data of varying degrees of reliability
US7305451B2 (en) 1998-08-24 2007-12-04 Microsoft Corporation System for providing users an integrated directory service containing content nodes located in different groups of application servers in computer network
US6738971B2 (en) 1999-03-10 2004-05-18 Oracle International Corporation Using a resource manager to coordinate the comitting of a distributed transaction
US6654772B1 (en) 1999-04-28 2003-11-25 Emc Corporation Multi-volume extent based file system
US6389420B1 (en) 1999-09-30 2002-05-14 Emc Corporation File manager providing distributed locking and metadata management for shared data access by clients relinquishing locks after time period expiration
US8429248B1 (en) 1999-12-17 2013-04-23 Intel Corporation Distributed file system including multicast retrieval
US6704730B2 (en) 2000-02-18 2004-03-09 Avamar Technologies, Inc. Hash file system and method for use in a commonality factoring system
ATE296514T1 (de) 2000-10-26 2005-06-15 Prismedia Networks Inc Verfahren und vorrichtung zur parallelen nachrichtenübermittlung in echtzeit von dateisegmentierten
US20020138559A1 (en) 2001-01-29 2002-09-26 Ulrich Thomas R. Dynamically distributed file system
US7043637B2 (en) 2001-03-21 2006-05-09 Microsoft Corporation On-disk file format for a serverless distributed file system
US7062490B2 (en) 2001-03-26 2006-06-13 Microsoft Corporation Serverless distributed file system
US6842754B2 (en) 2001-04-17 2005-01-11 Hewlett Packard Development Company, L.P. Lease enforcement in a distributed file system
US7685126B2 (en) 2001-08-03 2010-03-23 Isilon Systems, Inc. System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system
US7240114B2 (en) 2001-09-25 2007-07-03 Hewlett-Packard Development Company, L.P. Namespace management in a distributed file system
JP3879594B2 (ja) 2001-11-02 2007-02-14 日本電気株式会社 スイッチ方法、装置およびプログラム
WO2003107323A1 (en) 2002-06-13 2003-12-24 Cerisent Corporation A subtree-structured xml database
US7774466B2 (en) 2002-10-17 2010-08-10 Intel Corporation Methods and apparatus for load balancing storage nodes in a distributed storage area network system
AU2003291014A1 (en) 2002-11-14 2004-06-15 Isilon Systems, Inc. Systems and methods for restriping files in a distributed file system
US7428751B2 (en) 2002-12-05 2008-09-23 Microsoft Corporation Secure recovery in a serverless distributed file system
US7065618B1 (en) 2003-02-14 2006-06-20 Google Inc. Leasing scheme for data-modifying operations
JP2004280283A (ja) 2003-03-13 2004-10-07 Hitachi Ltd 分散ファイルシステム、分散ファイルシステムサーバ及び分散ファイルシステムへのアクセス方法
US7124131B2 (en) 2003-04-29 2006-10-17 International Business Machines Corporation Discipline for lock reassertion in a distributed file system
US7409389B2 (en) 2003-04-29 2008-08-05 International Business Machines Corporation Managing access to objects of a computing environment
US7610348B2 (en) 2003-05-07 2009-10-27 International Business Machines Distributed file serving architecture system with metadata storage virtualization and data access at the data server connection speed
US7865485B2 (en) 2003-09-23 2011-01-04 Emc Corporation Multi-threaded write interface and methods for increasing the single file read and write throughput of a file server
US7386663B2 (en) 2004-05-13 2008-06-10 Cousins Robert E Transaction-based storage system and method that uses variable sized objects to store data
US20050289143A1 (en) 2004-06-23 2005-12-29 Exanet Ltd. Method for managing lock resources in a distributed storage system
US20060074980A1 (en) 2004-09-29 2006-04-06 Sarkar Pte. Ltd. System for semantically disambiguating text information
US8055711B2 (en) 2004-10-29 2011-11-08 Emc Corporation Non-blocking commit protocol systems and methods
US8229985B2 (en) 2005-02-07 2012-07-24 Cisco Technology, Inc. Arrangement for a distributed file system having data objects mapped independent of any data object attribute
JP4177339B2 (ja) 2005-02-16 2008-11-05 株式会社東芝 分散システム、コンピュータおよび分散システムの状態遷移制御方法
US20070067332A1 (en) 2005-03-14 2007-03-22 Gridiron Software, Inc. Distributed, secure digital file storage and retrieval
US7716180B2 (en) 2005-12-29 2010-05-11 Amazon Technologies, Inc. Distributed storage system with web services client interface
US7743023B2 (en) 2006-02-01 2010-06-22 Microsoft Corporation Scalable file replication and web-based access
JP2007219741A (ja) 2006-02-15 2007-08-30 Ricoh Co Ltd 情報処理装置、情報処理方法、記録媒体およびプログラム
US20080005254A1 (en) * 2006-06-30 2008-01-03 International Business Machines Corporation Instant messaging redirection and authority confirmation
US7747584B1 (en) 2006-08-22 2010-06-29 Netapp, Inc. System and method for enabling de-duplication in a storage system architecture
US7917469B2 (en) * 2006-11-08 2011-03-29 Hitachi Data Systems Corporation Fast primary cluster recovery
US8356162B2 (en) 2008-03-18 2013-01-15 International Business Machines Corporation Execution unit with data dependent conditional write instructions
WO2009134772A2 (en) 2008-04-29 2009-11-05 Maxiscale, Inc Peer-to-peer redundant file server system and methods
US8214404B2 (en) 2008-07-11 2012-07-03 Avere Systems, Inc. Media aware distributed data layout
CN101334797B (zh) 2008-08-04 2010-06-02 中兴通讯股份有限公司 一种分布式文件系统及其数据块一致性管理的方法
US8620861B1 (en) 2008-09-30 2013-12-31 Google Inc. Preserving file metadata during atomic save operations
US8375001B2 (en) 2008-10-03 2013-02-12 Telefonaktiebolaget Lm Ericsson (Publ) Master monitoring mechanism for a geographical distributed database
US8326807B2 (en) * 2009-01-23 2012-12-04 Hewlett-Packard Development Company, L.P. Methods of measuring consistability of a distributed storage system
CN101520805B (zh) 2009-03-25 2011-05-11 中兴通讯股份有限公司 一种分布式文件系统及其文件处理方法
US8447734B2 (en) 2009-11-30 2013-05-21 Hewlett-Packard Development Company, L.P. HDAG backup system with variable retention
US8335819B2 (en) 2009-12-31 2012-12-18 Nokia Corporation Method and apparatus for providing client-side caching
US8402216B1 (en) 2010-03-17 2013-03-19 Symantec Corporation Systems and methods for off-host backups
US8856593B2 (en) * 2010-04-12 2014-10-07 Sandisk Enterprise Ip Llc Failure recovery using consensus replication in a distributed flash memory system
JP2011242826A (ja) 2010-05-14 2011-12-01 Fujitsu Ltd ファイル管理システム及びファイル管理プログラム
JP5069337B2 (ja) 2010-05-26 2012-11-07 日本電信電話株式会社 分散データ管理システム、データサーバ、トランザクションサーバ、分散データ管理方法、プログラム
US9161778B2 (en) * 2010-06-11 2015-10-20 Entourage Medical Technologies, Inc. System and method for transapical access and closure
US8433685B2 (en) 2010-08-18 2013-04-30 Hewlett-Packard Development Company, L.P. Method and system for parity-page distribution among nodes of a multi-node data-storage system
US9244769B2 (en) 2010-09-28 2016-01-26 Pure Storage, Inc. Offset protection data in a RAID array
JP5541149B2 (ja) 2010-12-27 2014-07-09 富士通株式会社 スナップショット採取プログラム、サーバおよびスナップショット採取方法
US8756310B2 (en) * 2011-03-09 2014-06-17 International Business Machines Corporation Comprehensive bottleneck detection in a multi-tier enterprise storage system
US9213709B2 (en) 2012-08-08 2015-12-15 Amazon Technologies, Inc. Archival data identification
US10210169B2 (en) * 2011-03-31 2019-02-19 EMC IP Holding Company LLC System and method for verifying consistent points in file systems
US8539008B2 (en) 2011-04-29 2013-09-17 Netapp, Inc. Extent-based storage architecture
US10534830B2 (en) 2011-06-23 2020-01-14 Microsoft Technology Licensing, Llc Dynamically updating a running page
US8856582B2 (en) 2011-06-30 2014-10-07 Microsoft Corporation Transparent failover
US9286344B1 (en) * 2011-08-10 2016-03-15 Nutanix, Inc. Method and system for maintaining consistency for I/O operations on metadata distributed amongst nodes in a ring structure
US20130110781A1 (en) 2011-10-31 2013-05-02 Wojciech Golab Server replication and transaction commitment
US9805054B2 (en) 2011-11-14 2017-10-31 Panzura, Inc. Managing a global namespace for a distributed filesystem
US20130218934A1 (en) 2012-02-17 2013-08-22 Hitachi, Ltd. Method for directory entries split and merge in distributed file system
US9225780B2 (en) 2012-02-24 2015-12-29 Xyratex Technology Limited Data integrity in a networked storage system
US9317511B2 (en) 2012-06-19 2016-04-19 Infinidat Ltd. System and method for managing filesystem objects
US9563480B2 (en) 2012-08-21 2017-02-07 Rackspace Us, Inc. Multi-level cloud computing system
US9171009B1 (en) 2013-06-21 2015-10-27 Emc Corporation Cluster file system comprising storage server units each having a scale-out network attached storage cluster
US9483482B2 (en) 2014-02-17 2016-11-01 Netapp, Inc. Partitioning file system namespace
US9519510B2 (en) 2014-03-31 2016-12-13 Amazon Technologies, Inc. Atomic writes for multiple-extent operations
US9772787B2 (en) 2014-03-31 2017-09-26 Amazon Technologies, Inc. File storage using variable stripe sizes
US9424151B2 (en) * 2014-07-02 2016-08-23 Hedvig, Inc. Disk failure recovery for virtual disk with policies

Also Published As

Publication number Publication date
WO2015153663A1 (en) 2015-10-08
BR112016022558A2 (https=) 2017-08-15
AU2015240908B2 (en) 2018-02-22
CN106462545B (zh) 2020-04-24
US20150278243A1 (en) 2015-10-01
AU2015240908A1 (en) 2016-10-27
EP3127000A1 (en) 2017-02-08
CN106462545A (zh) 2017-02-22
EP3127000A4 (en) 2017-08-16
EP3127000B1 (en) 2019-07-17
JP2017515212A (ja) 2017-06-08
JP6416279B2 (ja) 2018-10-31
KR20160141797A (ko) 2016-12-09
BR112016022558B1 (pt) 2023-01-10
CA2944362A1 (en) 2015-10-08
SG11201608143WA (en) 2016-10-28
KR101856402B1 (ko) 2018-05-09
US10372685B2 (en) 2019-08-06

Similar Documents

Publication Publication Date Title
CA2944362C (en) Scalable file storage service
CA2944461C (en) Session management in distributed storage systems
CA2944451C (en) Atomic writes for multiple-extent operations
CA2944166C (en) File storage using variable stripe sizes
CA2944361C (en) Namespace management in distributed storage systems
US9710407B2 (en) Congestion control in storage systems
US9779015B1 (en) Oversubscribed storage extents with on-demand page allocation
US9602424B1 (en) Connection balancing using attempt counts at distributed storage systems
US9294558B1 (en) Connection re-balancing in distributed storage systems
US9569459B1 (en) Conditional writes at distributed storage services

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20160928

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 10TH ANNIV.) - STANDARD

Year of fee payment: 10

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250321

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20250321