CN104054076A - 数据存储方法、数据库存储节点故障处理方法及装置 - Google Patents

数据存储方法、数据库存储节点故障处理方法及装置 Download PDF

Info

Publication number
CN104054076A
CN104054076A CN201380000058.XA CN201380000058A CN104054076A CN 104054076 A CN104054076 A CN 104054076A CN 201380000058 A CN201380000058 A CN 201380000058A CN 104054076 A CN104054076 A CN 104054076A
Authority
CN
China
Prior art keywords
memory node
subregion
data block
node
memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201380000058.XA
Other languages
English (en)
Other versions
CN104054076B (zh
Inventor
智伟
周帅锋
殷晖
杨磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN104054076A publication Critical patent/CN104054076A/zh
Application granted granted Critical
Publication of CN104054076B publication Critical patent/CN104054076B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Software Systems (AREA)

Abstract

本发明实施例提供了一种数据存储方法，所述方法包括：将数据库中的一个表的一个分区部署在数据库中的第一存储节点；将所述分区的数据文件划分为N个数据块，所述N个数据块位于所述第一存储节点；将所述N个数据块中全部数据块的备份数据块部署在第二存储节点上，所述第二存储节点与所述第一存储节点为不同节点。本发明实施例可以使得分布式非关系型数据库中，节点故障的情况下，能够尽量减少跨节点数据范围，以减少时延、降低网络流量。

Description

PCT国内申请，说明书已公开。

Claims (1)

  1. PCT国内申请，权利要求书已公开。
CN201380000058.XA 2013-01-14 2013-01-14 数据存储方法、数据库存储节点故障处理方法及装置 Active CN104054076B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2013/070420 WO2014107901A1 (zh) 2013-01-14 2013-01-14 数据存储方法、数据库存储节点故障处理方法及装置

Publications (2)

Publication Number Publication Date
CN104054076A true CN104054076A (zh) 2014-09-17
CN104054076B CN104054076B (zh) 2017-11-17

Family

ID=51166520

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380000058.XA Active CN104054076B (zh) 2013-01-14 2013-01-14 数据存储方法、数据库存储节点故障处理方法及装置

Country Status (2)

Country Link
CN (1) CN104054076B (zh)
WO (1) WO2014107901A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106547471A (zh) * 2015-09-17 2017-03-29 北京国双科技有限公司 非关系型数据库的扩展方法和装置
CN107066330A (zh) * 2015-12-17 2017-08-18 Sap欧洲公司 模块化数据分布计划生成
CN108874918A (zh) * 2018-05-30 2018-11-23 郑州云海信息技术有限公司 一种数据处理装置、数据库一体机及其数据处理方法
CN110168516A (zh) * 2016-12-09 2019-08-23 华为技术有限公司 用于大规模并行处理的基于代价的动态计算节点分组优化

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106100882B (zh) * 2016-06-14 2019-04-30 西安电子科技大学 一种基于流量值的网络故障诊断模型的构建方法
CN108933796A (zh) * 2017-05-22 2018-12-04 中兴通讯股份有限公司 数据存储方法及装置
US11842063B2 (en) 2022-03-25 2023-12-12 Ebay Inc. Data placement and recovery in the event of partition failures

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101510223A (zh) * 2009-04-03 2009-08-19 成都市华为赛门铁克科技有限公司 一种数据处理方法和系统
CN102063438A (zh) * 2009-11-17 2011-05-18 阿里巴巴集团控股有限公司 一种受损文件的恢复方法和装置
US20110289049A1 (en) * 2010-05-19 2011-11-24 Microsoft Corporation Scaleable fault-tolerant metadata service
CN102857554A (zh) * 2012-07-26 2013-01-02 福建网龙计算机网络信息技术有限公司 基于分布式存储系统进行数据冗余处理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101510223A (zh) * 2009-04-03 2009-08-19 成都市华为赛门铁克科技有限公司 一种数据处理方法和系统
CN102063438A (zh) * 2009-11-17 2011-05-18 阿里巴巴集团控股有限公司 一种受损文件的恢复方法和装置
US20110289049A1 (en) * 2010-05-19 2011-11-24 Microsoft Corporation Scaleable fault-tolerant metadata service
CN102857554A (zh) * 2012-07-26 2013-01-02 福建网龙计算机网络信息技术有限公司 基于分布式存储系统进行数据冗余处理方法

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106547471A (zh) * 2015-09-17 2017-03-29 北京国双科技有限公司 非关系型数据库的扩展方法和装置
CN107066330A (zh) * 2015-12-17 2017-08-18 Sap欧洲公司 模块化数据分布计划生成
CN107066330B (zh) * 2015-12-17 2021-10-08 Sap欧洲公司 模块化数据分布计划生成方法及系统
CN110168516A (zh) * 2016-12-09 2019-08-23 华为技术有限公司 用于大规模并行处理的基于代价的动态计算节点分组优化
CN110168516B (zh) * 2016-12-09 2021-09-07 华为技术有限公司 用于大规模并行处理的动态计算节点分组方法及系统
CN108874918A (zh) * 2018-05-30 2018-11-23 郑州云海信息技术有限公司 一种数据处理装置、数据库一体机及其数据处理方法

Also Published As

Publication number Publication date
CN104054076B (zh) 2017-11-17
WO2014107901A1 (zh) 2014-07-17

Similar Documents

Publication Publication Date Title
US11500552B2 (en) Configurable hyperconverged multi-tenant storage system
US10977124B2 (en) Distributed storage system, data storage method, and software program
US10642704B2 (en) Storage controller failover system
CN104054076A (zh) 数据存储方法、数据库存储节点故障处理方法及装置
US20190356474A1 (en) Layout-independent cryptographic stamp of a distributed dataset
JP5539683B2 (ja) 拡張可能な２次ストレージシステムと方法
DE112019002584T5 (de) Wechseln zwischen vermittlerdiensten für ein speichersystem
JP2019101703A (ja) 記憶システム及び制御ソフトウェア配置方法
US7681001B2 (en) Storage system
US10356150B1 (en) Automated repartitioning of streaming data
US9201747B2 (en) Real time database system
US9854037B2 (en) Identifying workload and sizing of buffers for the purpose of volume replication
US11199972B2 (en) Information processing system and volume allocation method
CN108228678B (zh) 一种多副本数据恢复方法及装置
US20150169623A1 (en) Distributed File System, File Access Method and Client Device
US20200341639A1 (en) Lattice layout of replicated data across different failure domains
US20190347165A1 (en) Apparatus and method for recovering distributed file system
CN107943615B (zh) 基于分布式集群的数据处理方法与系统
CN112256204B (zh) 存储资源分配方法、装置、存储节点及存储介质
US10067949B1 (en) Acquired namespace metadata service for controlling access to distributed file system
CN107566341B (zh) 一种基于联邦分布式文件存储系统的数据持久化存储方法及系统
US9037762B2 (en) Balancing data distribution in a fault-tolerant storage system based on the movements of the replicated copies of data
CN104536764A (zh) 程序运行方法和装置
US10083121B2 (en) Storage system and storage method
JP6269120B2 (ja) ストレージシステム

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220222

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Patentee after: Huawei Cloud Computing Technology Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.