SG11201703220SA - Distributed storage and replication system and method - Google Patents

Distributed storage and replication system and method

Info

Publication number
SG11201703220SA
SG11201703220SA SG11201703220SA SG11201703220SA SG11201703220SA SG 11201703220S A SG11201703220S A SG 11201703220SA SG 11201703220S A SG11201703220S A SG 11201703220SA SG 11201703220S A SG11201703220S A SG 11201703220SA SG 11201703220S A SG11201703220S A SG 11201703220SA
Authority
SG
Singapore
Prior art keywords
distributed storage
replication system
replication
distributed
storage
Prior art date
Application number
SG11201703220SA
Inventor
Daohui Wang
Feng Zhang
Xuyou Liu
Original Assignee
Huawei Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Tech Co Ltd filed Critical Huawei Tech Co Ltd
Publication of SG11201703220SA publication Critical patent/SG11201703220SA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/466—Transaction processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2064—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring while ensuring consistency
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/202—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant
    • G06F11/2023—Failover techniques
    • G06F11/2028—Failover techniques eliminating a faulty processor or activating a spare
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/202—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant
    • G06F11/2041—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant with more than one idle spare processing component
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/202—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant
    • G06F11/2048—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant where the redundant components share neither address space nor persistent storage
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2094—Redundant storage or storage space
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/273—Asynchronous replication or reconciliation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0751—Error or fault detection not based on redundancy
    • G06F11/0754—Error or fault detection not based on redundancy by exceeding limits
    • G06F11/0757—Error or fault detection not based on redundancy by exceeding limits by exceeding a time limit, i.e. time-out, e.g. watchdogs
SG11201703220SA 2014-11-06 2014-11-06 Distributed storage and replication system and method SG11201703220SA (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090445 WO2016070375A1 (en) 2014-11-06 2014-11-06 Distributed storage replication system and method

Publications (1)

Publication Number Publication Date
SG11201703220SA true SG11201703220SA (en) 2017-05-30

Family

ID=55908392

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201703220SA SG11201703220SA (en) 2014-11-06 2014-11-06 Distributed storage and replication system and method

Country Status (7)

Country Link
US (1) US10713134B2 (en)
EP (1) EP3159794B1 (en)
JP (1) JP6382454B2 (en)
CN (1) CN106062717B (en)
BR (1) BR112016030547B1 (en)
SG (1) SG11201703220SA (en)
WO (1) WO2016070375A1 (en)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9875259B2 (en) 2014-07-22 2018-01-23 Oracle International Corporation Distribution of an object in volatile memory across a multi-node cluster
US10275184B2 (en) 2014-07-22 2019-04-30 Oracle International Corporation Framework for volatile memory query execution in a multi node cluster
US10002148B2 (en) * 2014-07-22 2018-06-19 Oracle International Corporation Memory-aware joins based in a database cluster
US10025823B2 (en) 2015-05-29 2018-07-17 Oracle International Corporation Techniques for evaluating query predicates during in-memory table scans
US10567500B1 (en) * 2015-12-21 2020-02-18 Amazon Technologies, Inc. Continuous backup of data in a distributed data store
JP2018073231A (en) * 2016-11-01 2018-05-10 富士通株式会社 Storage system and storage device
JP6279780B1 (en) * 2017-02-20 2018-02-14 株式会社東芝 Asynchronous remote replication system for distributed storage and asynchronous remote replication method for distributed storage
WO2018188089A1 (en) * 2017-04-14 2018-10-18 华为技术有限公司 Data processing method, storage system and exchange device
CN107046575B (en) * 2017-04-18 2019-07-12 南京卓盛云信息科技有限公司 A kind of high density storage method for cloud storage system
CN107678918B (en) * 2017-09-26 2021-06-29 郑州云海信息技术有限公司 OSD heartbeat mechanism setting method and device of distributed file system
CN107832164A (en) * 2017-11-20 2018-03-23 郑州云海信息技术有限公司 A kind of method and device of the faulty hard disk processing based on Ceph
WO2019119212A1 (en) 2017-12-18 2019-06-27 华为技术有限公司 Method and device for identifying osd sub-health, and data storage system
CN109995813B (en) * 2017-12-29 2021-02-26 华为技术有限公司 Partition expansion method, data storage method and device
CN110096220B (en) * 2018-01-31 2020-06-26 华为技术有限公司 Distributed storage system, data processing method and storage node
CN110515535B (en) * 2018-05-22 2021-01-01 杭州海康威视数字技术股份有限公司 Hard disk read-write control method and device, electronic equipment and storage medium
CN108845772B (en) * 2018-07-11 2021-06-29 郑州云海信息技术有限公司 Hard disk fault processing method, system, equipment and computer storage medium
CN110874382B (en) * 2018-08-29 2023-07-04 阿里云计算有限公司 Data writing method, device and equipment thereof
CN109144789B (en) * 2018-09-10 2020-12-29 网宿科技股份有限公司 Method, device and system for restarting OSD
CN109144788B (en) * 2018-09-10 2021-10-22 网宿科技股份有限公司 Method, device and system for reconstructing OSD
CN109189738A (en) * 2018-09-18 2019-01-11 郑州云海信息技术有限公司 Choosing method, the apparatus and system of main OSD in a kind of distributed file system
CN111104057B (en) * 2018-10-25 2022-03-29 华为技术有限公司 Node capacity expansion method in storage system and storage system
CN109558437B (en) * 2018-11-16 2021-01-01 新华三技术有限公司成都分公司 Main OSD (on-screen display) adjusting method and device
CN111435331B (en) * 2019-01-14 2022-08-26 杭州宏杉科技股份有限公司 Data writing method and device for storage volume, electronic equipment and machine-readable storage medium
US11514024B2 (en) 2019-01-31 2022-11-29 Rubrik, Inc. Systems and methods for shard consistency in a clustered database
US10997130B2 (en) * 2019-01-31 2021-05-04 Rubrik, Inc. Systems and methods for node consistency in a clustered database
US11016952B2 (en) 2019-01-31 2021-05-25 Rubrik, Inc. Systems and methods to process a topology change in a clustered database
CN111510338B (en) * 2020-03-09 2022-04-26 苏州浪潮智能科技有限公司 Distributed block storage network sub-health test method, device and storage medium
US11223681B2 (en) * 2020-04-10 2022-01-11 Netapp, Inc. Updating no sync technique for ensuring continuous storage service in event of degraded cluster state
CN112596935B (en) * 2020-11-16 2022-08-30 新华三大数据技术有限公司 OSD (on-screen display) fault processing method and device
CN112819592B (en) * 2021-04-16 2021-08-03 深圳华锐金融技术股份有限公司 Service request processing method, system, computer equipment and storage medium
CN113254277B (en) * 2021-06-15 2021-11-02 云宏信息科技股份有限公司 Storage cluster OSD fault repairing method, storage medium, monitor and storage cluster

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790788A (en) * 1996-07-23 1998-08-04 International Business Machines Corporation Managing group events by a name server for a group of processors in a distributed computing environment
JP3563907B2 (en) * 1997-01-30 2004-09-08 富士通株式会社 Parallel computer
US6308300B1 (en) * 1999-06-04 2001-10-23 Rutgers University Test generation for analog circuits using partitioning and inverted system simulation
CN1258145C (en) * 2002-08-06 2006-05-31 中国科学院计算技术研究所 System of intellignent network storage device based on virtual storage
US7395265B2 (en) 2004-08-27 2008-07-01 Hitachi, Ltd. Data processing system and storage subsystem provided in data processing system
JP4519573B2 (en) * 2004-08-27 2010-08-04 株式会社日立製作所 Data processing system and method
US20060182050A1 (en) * 2005-01-28 2006-08-17 Hewlett-Packard Development Company, L.P. Storage replication system with data tracking
US7917469B2 (en) * 2006-11-08 2011-03-29 Hitachi Data Systems Corporation Fast primary cluster recovery
US8533155B2 (en) 2009-10-30 2013-09-10 Hitachi Data Systems Corporation Fixed content storage within a partitioned content platform, with replication
US8645460B2 (en) * 2008-10-07 2014-02-04 Huazhong University Of Science And Technology Method for managing object-based storage system
US8644188B1 (en) * 2009-06-25 2014-02-04 Amazon Technologies, Inc. Providing virtual networking functionality for managed computer networks
US8074107B2 (en) * 2009-10-26 2011-12-06 Amazon Technologies, Inc. Failover and recovery for replicated data instances
CN101751284B (en) * 2009-12-25 2013-04-24 华为技术有限公司 I/O resource scheduling method for distributed virtual machine monitor
WO2011100366A2 (en) 2010-02-09 2011-08-18 Google Inc. System and method for managing replicas of objects in a distributed storage system
US9323775B2 (en) 2010-06-19 2016-04-26 Mapr Technologies, Inc. Map-reduce ready distributed file system
CN102025550A (en) * 2010-12-20 2011-04-20 中兴通讯股份有限公司 System and method for managing data in distributed cluster
US9805108B2 (en) * 2010-12-23 2017-10-31 Mongodb, Inc. Large distributed database clustering systems and methods
US8572031B2 (en) * 2010-12-23 2013-10-29 Mongodb, Inc. Method and apparatus for maintaining replica sets
US8583773B2 (en) * 2011-01-11 2013-11-12 International Business Machines Corporation Autonomous primary node election within a virtual input/output server cluster
US8615676B2 (en) * 2011-03-24 2013-12-24 International Business Machines Corporation Providing first field data capture in a virtual input/output server (VIOS) cluster environment with cluster-aware vioses
US8713282B1 (en) * 2011-03-31 2014-04-29 Emc Corporation Large scale data storage system with fault tolerance
JP2012221419A (en) * 2011-04-13 2012-11-12 Hitachi Ltd Information storage system and data duplication method thereof
US8924974B1 (en) * 2011-06-08 2014-12-30 Workday, Inc. System for error checking of process definitions for batch processes
US20130029024A1 (en) 2011-07-25 2013-01-31 David Warren Barbeque stove
CN102355369B (en) * 2011-09-27 2014-01-08 华为技术有限公司 Virtual clustered system as well as processing method and processing device thereof
WO2013117002A1 (en) * 2012-02-09 2013-08-15 华为技术有限公司 Method, device and system for data reconstruction
CN102571452B (en) * 2012-02-20 2015-04-08 华为技术有限公司 Multi-node management method and system
CN103294675B (en) 2012-02-23 2018-08-03 上海盛大网络发展有限公司 Data-updating method and device in a kind of distributed memory system
CN102724057B (en) * 2012-02-23 2017-03-08 北京市计算中心 A kind of distributed levelization autonomous management method towards cloud computing platform
US9009421B2 (en) * 2012-11-13 2015-04-14 International Business Machines Corporation Dynamically improving memory affinity of logical partitions
CN103051691B (en) * 2012-12-12 2015-09-09 华为技术有限公司 Partition allocation method, device and distributed memory system
US10282228B2 (en) * 2014-06-26 2019-05-07 Amazon Technologies, Inc. Log-based transaction constraint management

Also Published As

Publication number Publication date
EP3159794B1 (en) 2019-01-16
JP2017534133A (en) 2017-11-16
EP3159794A4 (en) 2017-10-25
US10713134B2 (en) 2020-07-14
BR112016030547A2 (en) 2017-05-22
CN106062717A (en) 2016-10-26
BR112016030547A8 (en) 2022-07-12
CN106062717B (en) 2019-05-03
WO2016070375A1 (en) 2016-05-12
BR112016030547B1 (en) 2022-11-16
JP6382454B2 (en) 2018-08-29
US20170242767A1 (en) 2017-08-24
EP3159794A1 (en) 2017-04-26

Similar Documents

Publication Publication Date Title
SG11201703220SA (en) Distributed storage and replication system and method
GB2558052B (en) Storage systems and methods
IL252926A0 (en) System and method for releasing flavor
IL249473A0 (en) Systems and methods for modular storage and management
IL250118A0 (en) Temporary storage method and system and conveyance system using same
GB201703861D0 (en) Storage systems and methods
SG11201609892RA (en) Transport-container system and method
PL3348156T3 (en) E-cigarette system and method
SG10201405182WA (en) Method and system
GB201407711D0 (en) Communnication system and related method
HUE062438T2 (en) Storage system and method
EP3195129A4 (en) Application centric distributed storage system and method
GB201421814D0 (en) System and method
IL235729A (en) Secure storage device and method
GB2543891B (en) Multizone retrieval system and method
ZA201608830B (en) Storage product and method
SG11201705251WA (en) Point management system and point management method
SG11201602367WA (en) Redundant system and redundant system management method
GB201405488D0 (en) Decaffeination methods and systems
GB201402275D0 (en) Verification system and method
EP3224739A4 (en) Method and system for storage retrieval
HK1215318A1 (en) Method and system for reminisce and venerate the deceased
GB201523060D0 (en) Speed-limit-compliance system and method
GB201415688D0 (en) Method and Systems
GB201404184D0 (en) Method and system