CN113168404B - 用于在分布式数据库系统中复制数据的系统和方法 - Google Patents
用于在分布式数据库系统中复制数据的系统和方法 Download PDFInfo
- Publication number
- CN113168404B CN113168404B CN202080006927.XA CN202080006927A CN113168404B CN 113168404 B CN113168404 B CN 113168404B CN 202080006927 A CN202080006927 A CN 202080006927A CN 113168404 B CN113168404 B CN 113168404B
- Authority
- CN
- China
- Prior art keywords
- page
- log
- copy
- copies
- store
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2094—Redundant storage or storage space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
- G06F11/1662—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/80—Database-specific techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/82—Solving problems relating to consistency
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (20)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/355,521 | 2019-03-15 | ||
US16/355,521 US11106541B2 (en) | 2019-03-15 | 2019-03-15 | System and method for replicating data in distributed database systems |
PCT/CN2020/078943 WO2020187120A1 (en) | 2019-03-15 | 2020-03-12 | System and method for replicating data in distributed database systems |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113168404A CN113168404A (zh) | 2021-07-23 |
CN113168404B true CN113168404B (zh) | 2022-07-22 |
Family
ID=72422563
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202080006927.XA Active CN113168404B (zh) | 2019-03-15 | 2020-03-12 | 用于在分布式数据库系统中复制数据的系统和方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US11106541B2 (zh) |
EP (1) | EP3931713A4 (zh) |
CN (1) | CN113168404B (zh) |
WO (1) | WO2020187120A1 (zh) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108228678B (zh) * | 2016-12-22 | 2020-10-16 | 华为技术有限公司 | 一种多副本数据恢复方法及装置 |
US11176174B2 (en) * | 2019-07-31 | 2021-11-16 | Mastercard International Incorporated | Systems and methods for database replication |
US11194501B2 (en) * | 2020-01-24 | 2021-12-07 | Netapp, Inc. | Standby copies withstand cascading fails |
US11657066B2 (en) | 2020-11-30 | 2023-05-23 | Huawei Cloud Computing Technologies Co., Ltd. | Method, apparatus and medium for data synchronization between cloud database nodes |
US11714794B2 (en) | 2021-03-31 | 2023-08-01 | Huawei Cloud Computing Technologies Co., Ltd. | Method and apparatus for reading data maintained in a tree data structure |
US11645254B2 (en) * | 2021-09-25 | 2023-05-09 | International Business Machines Corporation | Database index modification |
CN116866327A (zh) * | 2023-07-11 | 2023-10-10 | 创泽智能机器人集团股份有限公司 | 一种基于web查看svn日志的方法及设备 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105122241A (zh) * | 2013-03-15 | 2015-12-02 | 亚马逊科技公司 | 具有数据库引擎和独立分布式存储服务的数据库系统 |
CN105324770A (zh) * | 2013-04-30 | 2016-02-10 | 亚马逊科技公司 | 有效读出副本 |
CN106991113A (zh) * | 2015-12-18 | 2017-07-28 | Sap欧洲公司 | 数据库环境中的表格复制 |
CN108108476A (zh) * | 2018-01-03 | 2018-06-01 | 中科边缘智慧信息科技(苏州)有限公司 | 高可靠分布式日志系统的工作方法 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9558256B2 (en) | 2010-11-16 | 2017-01-31 | Linkedin Corporation | Middleware data log system |
JP2014182653A (ja) | 2013-03-19 | 2014-09-29 | Canon Inc | ログ管理システム、ログ管理方法、画像形成装置およびその制御方法、並びにプログラム |
US9507843B1 (en) * | 2013-09-20 | 2016-11-29 | Amazon Technologies, Inc. | Efficient replication of distributed storage changes for read-only nodes of a distributed database |
US9552242B1 (en) * | 2013-09-25 | 2017-01-24 | Amazon Technologies, Inc. | Log-structured distributed storage using a single log sequence number space |
US10496669B2 (en) * | 2015-07-02 | 2019-12-03 | Mongodb, Inc. | System and method for augmenting consensus election in a distributed database |
US10592528B2 (en) * | 2017-02-27 | 2020-03-17 | Sap Se | Workload capture and replay for replicated database systems |
-
2019
- 2019-03-15 US US16/355,521 patent/US11106541B2/en active Active
-
2020
- 2020-03-12 EP EP20773937.6A patent/EP3931713A4/en active Pending
- 2020-03-12 WO PCT/CN2020/078943 patent/WO2020187120A1/en unknown
- 2020-03-12 CN CN202080006927.XA patent/CN113168404B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105122241A (zh) * | 2013-03-15 | 2015-12-02 | 亚马逊科技公司 | 具有数据库引擎和独立分布式存储服务的数据库系统 |
CN105324770A (zh) * | 2013-04-30 | 2016-02-10 | 亚马逊科技公司 | 有效读出副本 |
CN106991113A (zh) * | 2015-12-18 | 2017-07-28 | Sap欧洲公司 | 数据库环境中的表格复制 |
CN108108476A (zh) * | 2018-01-03 | 2018-06-01 | 中科边缘智慧信息科技(苏州)有限公司 | 高可靠分布式日志系统的工作方法 |
Also Published As
Publication number | Publication date |
---|---|
EP3931713A4 (en) | 2022-05-04 |
EP3931713A1 (en) | 2022-01-05 |
CN113168404A (zh) | 2021-07-23 |
US11106541B2 (en) | 2021-08-31 |
US20200293407A1 (en) | 2020-09-17 |
WO2020187120A1 (en) | 2020-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113168404B (zh) | 用于在分布式数据库系统中复制数据的系统和方法 | |
US11153380B2 (en) | Continuous backup of data in a distributed data store | |
US11120152B2 (en) | Dynamic quorum membership changes | |
US10229011B2 (en) | Log-structured distributed storage using a single log sequence number space | |
US10534768B2 (en) | Optimized log storage for asynchronous log updates | |
US9081841B2 (en) | Asynchronous distributed garbage collection for replicated storage clusters | |
US20200012568A1 (en) | Scalable log-based continuous data protection for distributed databases | |
JP6404907B2 (ja) | 効率的な読み取り用レプリカ | |
US7653668B1 (en) | Fault tolerant multi-stage data replication with relaxed coherency guarantees | |
US11030055B2 (en) | Fast crash recovery for distributed database systems | |
US9672237B2 (en) | System-wide checkpoint avoidance for distributed database systems | |
US9507843B1 (en) | Efficient replication of distributed storage changes for read-only nodes of a distributed database | |
US10659225B2 (en) | Encrypting existing live unencrypted data using age-based garbage collection | |
US9047331B2 (en) | Scalable row-store with consensus-based replication | |
CN112470112A (zh) | 块存储系统的分布式副本 | |
US9652520B2 (en) | System and method for supporting parallel asynchronous synchronization between clusters in a distributed data grid | |
US10223184B1 (en) | Individual write quorums for a log-structured distributed storage system | |
US11194501B2 (en) | Standby copies withstand cascading fails | |
CN109992447B (zh) | 数据复制方法、装置及存储介质 | |
JP6376626B2 (ja) | データ格納方法、データストレージ装置、及びストレージデバイス | |
CN116868173A (zh) | 降低在恢复操作期间网络延时的影响 | |
US11038960B1 (en) | Stream-based shared storage system | |
US9794326B1 (en) | Log information transmission integrity |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Alexander de potovich Inventor after: Per AK Larson Inventor after: Chen Li Inventor before: Alexander de potovich Inventor before: Per AK Larson Inventor before: Chen Chong |
|
CB03 | Change of inventor or designer information | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220210 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Applicant after: Huawei Cloud Computing Technology Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |