CN113168404A - 用于在分布式数据库系统中复制数据的系统和方法 - Google Patents
用于在分布式数据库系统中复制数据的系统和方法 Download PDFInfo
- Publication number
- CN113168404A CN113168404A CN202080006927.XA CN202080006927A CN113168404A CN 113168404 A CN113168404 A CN 113168404A CN 202080006927 A CN202080006927 A CN 202080006927A CN 113168404 A CN113168404 A CN 113168404A
- Authority
- CN
- China
- Prior art keywords
- page
- log
- copy
- copies
- store
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000003362 replicative effect Effects 0.000 title description 3
- 230000008859 change Effects 0.000 claims abstract description 38
- 230000004044 response Effects 0.000 claims abstract description 18
- 238000011084 recovery Methods 0.000 claims description 46
- 230000010076 replication Effects 0.000 claims description 12
- 230000002085 persistent effect Effects 0.000 description 20
- 230000007774 longterm Effects 0.000 description 12
- 230000000694 effects Effects 0.000 description 10
- 230000008569 process Effects 0.000 description 8
- 230000001360 synchronised effect Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 239000004744 fabric Substances 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000002688 persistence Effects 0.000 description 3
- 230000002411 adverse Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000002427 irreversible effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
- G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2094—Redundant storage or storage space
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1469—Backup restoration techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/273—Asynchronous replication or reconciliation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
- G06F11/1662—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/80—Database-specific techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/82—Solving problems relating to consistency
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/84—Using snapshots, i.e. a logical point-in-time copy of the data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (20)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/355,521 | 2019-03-15 | ||
US16/355,521 US11106541B2 (en) | 2019-03-15 | 2019-03-15 | System and method for replicating data in distributed database systems |
PCT/CN2020/078943 WO2020187120A1 (en) | 2019-03-15 | 2020-03-12 | System and method for replicating data in distributed database systems |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113168404A true CN113168404A (zh) | 2021-07-23 |
CN113168404B CN113168404B (zh) | 2022-07-22 |
Family
ID=72422563
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202080006927.XA Active CN113168404B (zh) | 2019-03-15 | 2020-03-12 | 用于在分布式数据库系统中复制数据的系统和方法 |
Country Status (4)
Country | Link |
---|---|
US (1) | US11106541B2 (zh) |
EP (1) | EP3931713A4 (zh) |
CN (1) | CN113168404B (zh) |
WO (1) | WO2020187120A1 (zh) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108228678B (zh) * | 2016-12-22 | 2020-10-16 | 华为技术有限公司 | 一种多副本数据恢复方法及装置 |
US11176174B2 (en) * | 2019-07-31 | 2021-11-16 | Mastercard International Incorporated | Systems and methods for database replication |
US11194501B2 (en) * | 2020-01-24 | 2021-12-07 | Netapp, Inc. | Standby copies withstand cascading fails |
US11657066B2 (en) | 2020-11-30 | 2023-05-23 | Huawei Cloud Computing Technologies Co., Ltd. | Method, apparatus and medium for data synchronization between cloud database nodes |
US11714794B2 (en) | 2021-03-31 | 2023-08-01 | Huawei Cloud Computing Technologies Co., Ltd. | Method and apparatus for reading data maintained in a tree data structure |
US11645254B2 (en) * | 2021-09-25 | 2023-05-09 | International Business Machines Corporation | Database index modification |
CN116866327A (zh) * | 2023-07-11 | 2023-10-10 | 创泽智能机器人集团股份有限公司 | 一种基于web查看svn日志的方法及设备 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120215740A1 (en) * | 2010-11-16 | 2012-08-23 | Jean-Luc Vaillant | Middleware data log system |
US20140289370A1 (en) * | 2013-03-19 | 2014-09-25 | Canon Kabushiki Kaisha | Log management system, log management method, image forming apparatus and control method thereof, and non-transitory computer-readable medium |
US20140324785A1 (en) * | 2013-04-30 | 2014-10-30 | Amazon Technologies, Inc. | Efficient read replicas |
CN105122241A (zh) * | 2013-03-15 | 2015-12-02 | 亚马逊科技公司 | 具有数据库引擎和独立分布式存储服务的数据库系统 |
US20170032010A1 (en) * | 2015-07-02 | 2017-02-02 | Mongodb, Inc. | System and method for augmenting consensus election in a distributed database |
US20170132091A1 (en) * | 2013-09-25 | 2017-05-11 | Amazon Technologies, Inc. | Log-structured distributed storage using a single log sequence number space |
CN106991113A (zh) * | 2015-12-18 | 2017-07-28 | Sap欧洲公司 | 数据库环境中的表格复制 |
CN108108476A (zh) * | 2018-01-03 | 2018-06-01 | 中科边缘智慧信息科技(苏州)有限公司 | 高可靠分布式日志系统的工作方法 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9507843B1 (en) * | 2013-09-20 | 2016-11-29 | Amazon Technologies, Inc. | Efficient replication of distributed storage changes for read-only nodes of a distributed database |
US10592528B2 (en) * | 2017-02-27 | 2020-03-17 | Sap Se | Workload capture and replay for replicated database systems |
-
2019
- 2019-03-15 US US16/355,521 patent/US11106541B2/en active Active
-
2020
- 2020-03-12 WO PCT/CN2020/078943 patent/WO2020187120A1/en unknown
- 2020-03-12 CN CN202080006927.XA patent/CN113168404B/zh active Active
- 2020-03-12 EP EP20773937.6A patent/EP3931713A4/en active Pending
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120215740A1 (en) * | 2010-11-16 | 2012-08-23 | Jean-Luc Vaillant | Middleware data log system |
CN105122241A (zh) * | 2013-03-15 | 2015-12-02 | 亚马逊科技公司 | 具有数据库引擎和独立分布式存储服务的数据库系统 |
US20140289370A1 (en) * | 2013-03-19 | 2014-09-25 | Canon Kabushiki Kaisha | Log management system, log management method, image forming apparatus and control method thereof, and non-transitory computer-readable medium |
US20140324785A1 (en) * | 2013-04-30 | 2014-10-30 | Amazon Technologies, Inc. | Efficient read replicas |
CN105324770A (zh) * | 2013-04-30 | 2016-02-10 | 亚马逊科技公司 | 有效读出副本 |
US20170132091A1 (en) * | 2013-09-25 | 2017-05-11 | Amazon Technologies, Inc. | Log-structured distributed storage using a single log sequence number space |
US20170032010A1 (en) * | 2015-07-02 | 2017-02-02 | Mongodb, Inc. | System and method for augmenting consensus election in a distributed database |
CN106991113A (zh) * | 2015-12-18 | 2017-07-28 | Sap欧洲公司 | 数据库环境中的表格复制 |
CN108108476A (zh) * | 2018-01-03 | 2018-06-01 | 中科边缘智慧信息科技(苏州)有限公司 | 高可靠分布式日志系统的工作方法 |
Also Published As
Publication number | Publication date |
---|---|
US11106541B2 (en) | 2021-08-31 |
EP3931713A4 (en) | 2022-05-04 |
EP3931713A1 (en) | 2022-01-05 |
CN113168404B (zh) | 2022-07-22 |
WO2020187120A1 (en) | 2020-09-24 |
US20200293407A1 (en) | 2020-09-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113168404B (zh) | 用于在分布式数据库系统中复制数据的系统和方法 | |
US9081841B2 (en) | Asynchronous distributed garbage collection for replicated storage clusters | |
US10534768B2 (en) | Optimized log storage for asynchronous log updates | |
US20200012568A1 (en) | Scalable log-based continuous data protection for distributed databases | |
JP6404907B2 (ja) | 効率的な読み取り用レプリカ | |
US9047331B2 (en) | Scalable row-store with consensus-based replication | |
US11487468B2 (en) | Healing failed erasure-coded write attempts in a distributed data storage system configured with fewer storage nodes than data plus parity fragments | |
US7653668B1 (en) | Fault tolerant multi-stage data replication with relaxed coherency guarantees | |
US8930309B2 (en) | Interval-controlled replication | |
US10659225B2 (en) | Encrypting existing live unencrypted data using age-based garbage collection | |
US20160034357A1 (en) | Managing backup operations from a client system to a primary server and secondary server | |
US10423643B2 (en) | System and method for supporting resettable acknowledgements for synchronizing data in a distributed data grid | |
US20180101558A1 (en) | Log-shipping data replication with early log record fetching | |
US10223184B1 (en) | Individual write quorums for a log-structured distributed storage system | |
US10545667B1 (en) | Dynamic data partitioning for stateless request routing | |
CN109992447B (zh) | 数据复制方法、装置及存储介质 | |
JP6376626B2 (ja) | データ格納方法、データストレージ装置、及びストレージデバイス | |
CN111382132A (zh) | 医学影像数据云存储系统 | |
US10511656B1 (en) | Log information transmission integrity | |
US11038960B1 (en) | Stream-based shared storage system | |
US9990151B2 (en) | Methods for flexible data-mirroring to improve storage performance during mobility events and devices thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Alexander de potovich Inventor after: Per AK Larson Inventor after: Chen Li Inventor before: Alexander de potovich Inventor before: Per AK Larson Inventor before: Chen Chong |
|
CB03 | Change of inventor or designer information | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20220210 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Applicant after: Huawei Cloud Computing Technologies Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |