WO2017101016A1 - Procédé et appareil de synchronisation de demande de service d'un nœud de stockage - Google Patents

Procédé et appareil de synchronisation de demande de service d'un nœud de stockage Download PDF

Info

Publication number
WO2017101016A1
WO2017101016A1 PCT/CN2015/097431 CN2015097431W WO2017101016A1 WO 2017101016 A1 WO2017101016 A1 WO 2017101016A1 CN 2015097431 W CN2015097431 W CN 2015097431W WO 2017101016 A1 WO2017101016 A1 WO 2017101016A1
Authority
WO
WIPO (PCT)
Prior art keywords
service request
storage node
service
request set
requests
Prior art date
Application number
PCT/CN2015/097431
Other languages
English (en)
Chinese (zh)
Inventor
于传帅
张程伟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201580002564.1A priority Critical patent/CN107710165B/zh
Priority to PCT/CN2015/097431 priority patent/WO2017101016A1/fr
Publication of WO2017101016A1 publication Critical patent/WO2017101016A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor

Definitions

  • the service request synchronization device determines, that the service request that belongs to the second service request set and does not belong to the first service request set is the first a service request lost by a storage node during a failure, the: the service request synchronization device determines a flag bitmap of the first service request set according to a key of each service request in the first service request set; the service request is synchronized The device determines, according to a key of each service request in the second service request set, a flag bitmap of the second service request set; the service request synchronization device compares the flag bit corresponding to the first service request set with the second service The corresponding flag bit of the request set is obtained, and the service request belonging to the second service request set and not belonging to the first service request set is the lost service request, so that the lost service request can be determined more intuitively.
  • the embodiment of the present invention describes a method for storing a node synchronization service request.
  • the method is applied to a storage system, and the storage system may include two key-value storage nodes as described above.
  • the service request can be executed concurrently and out of order.
  • Each key-value storage node stores the key-value data of the storage node and the log corresponding to the storage node, that is, the storage system Save two key-value data and save the logs corresponding to the two storage nodes.
  • the service request of the storage node 1 is in the log (log) 1 corresponding to the storage node because the service request in the storage node is executable in an out-of-order manner.
  • the first storage node may perform the multiple service requests in a first order, and the second storage node performs the second sequence in the second order.
  • the first sequence and the second sequence may be the same or different.
  • the order of executing multiple service requests may be inconsistent with the delivery order, and multiple service requests may be executed concurrently or in an out-of-order manner.
  • the serial number of the service request is assigned and maintained, which limits the service request throughput.
  • the first log records the service request that has been executed by the first storage node and the start execution time of the service request, and records the executed service of the second storage node by using the second log. The request and the start of execution of the business request.
  • the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be directed to the embodiments of the present invention.
  • the implementation process constitutes any limitation.
  • the first sequence may be different from the second sequence or may be the same.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Hardware Redundancy (AREA)
  • Debugging And Monitoring (AREA)

Abstract

Les modes de réalisation de la présente invention concernent un procédé et un appareil de synchronisation d'une demande de service d'un nœud de stockage. Le procédé comprend les étapes consistant à : lorsqu'un premier nœud de stockage présente une anomalie dans t1 à t2 pendant l'exécution d'une pluralité de demandes de service, déterminer un ensemble de demandes de service, qui sont enregistrées dans un premier journal et dont un moment de départ d'exécution se situe dans (t1-2 dt) à (t2+2 dt), en tant que premier ensemble de demandes de service, et déterminer un ensemble de demandes de service, qui sont enregistrées dans un second journal et dont un moment de départ d'exécution se situe dans (t1-dt) à (t2+dt), en tant que second ensemble de demandes de service, dt représentant le laps de temps maximal d'exécution des demandes de service; et déterminer qu'une demande de service appartenant au second ensemble de demandes de service mais n'appartenant pas au premier ensemble de demandes de service est une demande de service perdue par le premier nœud de stockage pendant la survenue de l'anomalie de manière à faciliter l'exécution, par le premier nœud de stockage, de la demande de service perdue.<sb /> <sb /> <sb /> <sb /> <sb /> <sp /> Dans les modes de réalisation de l'invention, au moyen du procédé et de l'appareil de synchronisation d'une demande de service d'un nœud de stockage, une demande de service perdue peut être obtenue avec précision, et des demandes de service d'un nœud de stockage normal et d'un nœud de stockage défectueux peuvent être synchronisées, de sorte que le débit d'un système de stockage dans l'exécution des demandes de service est amélioré.
PCT/CN2015/097431 2015-12-15 2015-12-15 Procédé et appareil de synchronisation de demande de service d'un nœud de stockage WO2017101016A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201580002564.1A CN107710165B (zh) 2015-12-15 2015-12-15 用于存储节点同步业务请求的方法和装置
PCT/CN2015/097431 WO2017101016A1 (fr) 2015-12-15 2015-12-15 Procédé et appareil de synchronisation de demande de service d'un nœud de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/097431 WO2017101016A1 (fr) 2015-12-15 2015-12-15 Procédé et appareil de synchronisation de demande de service d'un nœud de stockage

Publications (1)

Publication Number Publication Date
WO2017101016A1 true WO2017101016A1 (fr) 2017-06-22

Family

ID=59055361

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/097431 WO2017101016A1 (fr) 2015-12-15 2015-12-15 Procédé et appareil de synchronisation de demande de service d'un nœud de stockage

Country Status (2)

Country Link
CN (1) CN107710165B (fr)
WO (1) WO2017101016A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111352763B (zh) * 2020-03-11 2023-10-31 Oppo（重庆）智能科技有限公司 信息处理方法及相关产品
CN112181701A (zh) * 2020-09-23 2021-01-05 中国建设银行股份有限公司 一种定位异常业务请求的方法和装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1728099A (zh) * 2004-06-18 2006-02-01 微软公司 分布式容错计算系统中复制装置的有效改变
CN102693324A (zh) * 2012-01-09 2012-09-26 西安电子科技大学 一种分布式数据库同步系统、同步方法和节点管理方法
CN103064759A (zh) * 2012-12-18 2013-04-24 华为技术有限公司 数据修复的方法及装置
US20140325256A1 (en) * 2013-04-25 2014-10-30 Netapp, Inc. Systems and methods for managing disaster recovery in a storage system
CN105095013A (zh) * 2015-06-04 2015-11-25 华为技术有限公司 数据存储方法、恢复方法、相关装置以及系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079896B (zh) * 2007-06-22 2010-05-19 西安交通大学 一种构建并行存储系统多可用性机制并存架构的方法
CN102882699B (zh) * 2011-07-14 2015-07-29 华为技术有限公司 边缘节点的分配方法和装置及边缘节点控制器
CN103198159B (zh) * 2013-04-27 2016-01-06 国家计算机网络与信息安全管理中心 一种基于事务重做的异构集群多副本一致性维护方法
KR101662212B1 (ko) * 2014-05-30 2016-10-04 주식회사 알티베이스 부분동기화 지원 데이터베이스 관리 시스템 및 데이터베이스 관리 시스템에서 부분동기화 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1728099A (zh) * 2004-06-18 2006-02-01 微软公司 分布式容错计算系统中复制装置的有效改变
CN102693324A (zh) * 2012-01-09 2012-09-26 西安电子科技大学 一种分布式数据库同步系统、同步方法和节点管理方法
CN103064759A (zh) * 2012-12-18 2013-04-24 华为技术有限公司 数据修复的方法及装置
US20140325256A1 (en) * 2013-04-25 2014-10-30 Netapp, Inc. Systems and methods for managing disaster recovery in a storage system
CN105095013A (zh) * 2015-06-04 2015-11-25 华为技术有限公司 数据存储方法、恢复方法、相关装置以及系统

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHAI, MENGZHU.: "Design and Implementation of Fault Tolerant Mechanism of Lock Server Based on Distributed System", JOURNAL OF NANCHANG COLLEGE OF EDUCATION, vol. 28, no. 10, 31 October 2013 (2013-10-31) *
FAN, JIE ET AL.: "Research on the Technology of Byzantine System", JOURNAL OF SOFTWARE, vol. 24, no. 6, 30 June 2013 (2013-06-30) *

Also Published As

Publication number Publication date
CN107710165A (zh) 2018-02-16
CN107710165B (zh) 2020-01-03

Similar Documents

Publication Publication Date Title
US10298436B2 (en) Arbitration processing method after cluster brain split, quorum storage apparatus, and system
US10387255B2 (en) Data reconstruction method in distributed storage system, apparatus, and system
US10713134B2 (en) Distributed storage and replication system and method
TWI751402B (zh) 一種資料同步方法、分散式系統、電腦可讀取儲取媒體、電腦設備及分散式設備
WO2016192408A1 (fr) Procédé et appareil de détection de défaut pour un nœud dans un système en grappe
US20200099604A1 (en) Method and device for fingerprint based status detection in a distributed processing system
WO2016177231A1 (fr) Procédé et dispositif de commutation de sauvegarde active basée double commande
US10963353B2 (en) Systems and methods for cross-regional back up of distributed databases on a cloud service
CN107656705B (zh) 一种计算机存储介质和一种数据迁移方法、装置及系统
US20210320977A1 (en) Method and apparatus for implementing data consistency, server, and terminal
CN110633168A (zh) 一种分布式存储系统的数据备份方法和系统
WO2019057081A1 (fr) Procédé de stockage de données, procédé d&#39;interrogation de données, dispositif informatique et support d&#39;informations
CN105760271A (zh) 一种集群模式下计算节点可信状态监控的方法
US10397053B2 (en) Methods for managing storage virtual machine configuration changes in a distributed storage system and devices thereof
EP3896571B1 (fr) Procédé, appareil et système de sauvegarde de données
WO2017101016A1 (fr) Procédé et appareil de synchronisation de demande de service d&#39;un nœud de stockage
WO2016101409A1 (fr) Procédé, dispositif et système de commutation de données
WO2017092539A1 (fr) Procédé de réparation de machine virtuelle, dispositif de machine virtuelle, système et élément de réseau fonctionnel de service
WO2017080362A1 (fr) Procédé et dispositif de gestion de données
US10735248B2 (en) Cloudified N-way routing protection at hyper scale
US12007850B2 (en) Method and system for generating backup of a large file and optimizing resource utilization
US20230281085A1 (en) Method and system for generating backup of a large file and optimizing resource utilization
CN117499390A (zh) 文件传输方法、装置和计算机设备
CN117555493A (zh) 数据处理方法、系统、装置、存储介质及电子设备
CN113535463A (zh) 一种数据恢复的方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15910489

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15910489

Country of ref document: EP

Kind code of ref document: A1