CN110262929A - 一种保证复制事务一致性的方法以及相应的复制装置 - Google Patents
一种保证复制事务一致性的方法以及相应的复制装置 Download PDFInfo
- Publication number
- CN110262929A CN110262929A CN201910604048.6A CN201910604048A CN110262929A CN 110262929 A CN110262929 A CN 110262929A CN 201910604048 A CN201910604048 A CN 201910604048A CN 110262929 A CN110262929 A CN 110262929A
- Authority
- CN
- China
- Prior art keywords
- transaction
- log
- sequence number
- origin
- range check
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 238000011084 recovery Methods 0.000 claims abstract description 58
- 230000015654 memory Effects 0.000 claims description 25
- 230000001360 synchronised effect Effects 0.000 claims description 12
- 238000007689 inspection Methods 0.000 claims 1
- 230000000630 rising effect Effects 0.000 claims 1
- 230000007246 mechanism Effects 0.000 abstract description 6
- 230000010076 replication Effects 0.000 description 23
- 230000008569 process Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000004888 barrier function Effects 0.000 description 4
- 238000003780 insertion Methods 0.000 description 4
- 230000037431 insertion Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 241000083513 Punctum Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910604048.6A CN110262929B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910604048.6A CN110262929B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
CN201810917819.2A CN109189608B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810917819.2A Division CN109189608B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110262929A true CN110262929A (zh) | 2019-09-20 |
CN110262929B CN110262929B (zh) | 2020-01-07 |
Family
ID=64921140
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910604048.6A Active CN110262929B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
CN201810917819.2A Active CN109189608B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810917819.2A Active CN109189608B (zh) | 2018-08-13 | 2018-08-13 | 一种保证复制事务一致性的方法以及相应的复制装置 |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN110262929B (zh) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111694800A (zh) * | 2020-04-30 | 2020-09-22 | 武汉达梦数据库有限公司 | 一种提升数据同步性能的方法和数据同步系统 |
CN111858502A (zh) * | 2020-06-02 | 2020-10-30 | 武汉达梦数据库有限公司 | 一种基于日志解析同步的日志读取方法和同步系统 |
CN111930693A (zh) * | 2020-05-28 | 2020-11-13 | 武汉达梦数据库有限公司 | 一种基于日志解析同步的事务合并执行方法及装置 |
CN112307118A (zh) * | 2020-09-30 | 2021-02-02 | 武汉达梦数据库有限公司 | 基于日志解析同步的保障数据一致性的方法和同步系统 |
WO2024198878A1 (zh) * | 2023-03-29 | 2024-10-03 | 华为云计算技术有限公司 | 数据库恢复方法及装置 |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110222009B (zh) * | 2019-05-28 | 2021-08-06 | 咪咕文化科技有限公司 | 一种Hive入库异常文件自动处理方法及装置 |
CN110457284B (zh) * | 2019-06-05 | 2022-11-29 | 黄疆 | 基于SQLServer数据库的多时间点数据恢复方法及系统 |
CN110347746B (zh) * | 2019-06-13 | 2020-06-26 | 武汉达梦数据库有限公司 | 一种异构数据库同步数据一致性校验方法及装置 |
CN110413693B (zh) * | 2019-07-31 | 2020-04-03 | 上海英方软件股份有限公司 | 一种数据库实时同步系统数据一致性的检验方法及装置 |
CN113326315A (zh) * | 2020-02-28 | 2021-08-31 | 华为技术有限公司 | 一种数据库复制系统、方法、源端设备以及目的端设备 |
US11669518B1 (en) * | 2021-12-14 | 2023-06-06 | Huawei Technologies Co., Ltd. | Method and system for processing database transactions in a distributed online transaction processing (OLTP) database |
CN114510495B (zh) * | 2022-04-21 | 2022-07-08 | 北京安华金和科技有限公司 | 一种数据库业务数据一致性处理方法和系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104346454A (zh) * | 2014-10-30 | 2015-02-11 | 上海新炬网络技术有限公司 | 基于Oracle数据库的数据一致性校验方法 |
CN105574187A (zh) * | 2015-12-23 | 2016-05-11 | 武汉达梦数据库有限公司 | 一种异构数据库复制事务一致性保障方法及系统 |
US20170270152A1 (en) * | 2013-03-15 | 2017-09-21 | Amazon Technologies, Inc. | System-wide checkpoint avoidance for distributed database systems |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3086779B2 (ja) * | 1995-06-19 | 2000-09-11 | 株式会社東芝 | メモリ状態復元装置 |
US7409587B2 (en) * | 2004-08-24 | 2008-08-05 | Symantec Operating Corporation | Recovering from storage transaction failures using checkpoints |
CN106844694B (zh) * | 2017-01-24 | 2019-11-15 | 恒生电子股份有限公司 | 用于同步数据的方法及设备 |
-
2018
- 2018-08-13 CN CN201910604048.6A patent/CN110262929B/zh active Active
- 2018-08-13 CN CN201810917819.2A patent/CN109189608B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170270152A1 (en) * | 2013-03-15 | 2017-09-21 | Amazon Technologies, Inc. | System-wide checkpoint avoidance for distributed database systems |
CN104346454A (zh) * | 2014-10-30 | 2015-02-11 | 上海新炬网络技术有限公司 | 基于Oracle数据库的数据一致性校验方法 |
CN105574187A (zh) * | 2015-12-23 | 2016-05-11 | 武汉达梦数据库有限公司 | 一种异构数据库复制事务一致性保障方法及系统 |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111694800A (zh) * | 2020-04-30 | 2020-09-22 | 武汉达梦数据库有限公司 | 一种提升数据同步性能的方法和数据同步系统 |
CN111694800B (zh) * | 2020-04-30 | 2023-03-24 | 武汉达梦数据库股份有限公司 | 一种提升数据同步性能的方法和数据同步系统 |
CN111930693A (zh) * | 2020-05-28 | 2020-11-13 | 武汉达梦数据库有限公司 | 一种基于日志解析同步的事务合并执行方法及装置 |
CN111930693B (zh) * | 2020-05-28 | 2024-02-06 | 武汉达梦数据库股份有限公司 | 一种基于日志解析同步的事务合并执行方法及装置 |
CN111858502A (zh) * | 2020-06-02 | 2020-10-30 | 武汉达梦数据库有限公司 | 一种基于日志解析同步的日志读取方法和同步系统 |
CN112307118A (zh) * | 2020-09-30 | 2021-02-02 | 武汉达梦数据库有限公司 | 基于日志解析同步的保障数据一致性的方法和同步系统 |
CN112307118B (zh) * | 2020-09-30 | 2024-03-22 | 武汉达梦数据库股份有限公司 | 基于日志解析同步的保障数据一致性的方法和同步系统 |
WO2024198878A1 (zh) * | 2023-03-29 | 2024-10-03 | 华为云计算技术有限公司 | 数据库恢复方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN109189608B (zh) | 2019-07-26 |
CN110262929B (zh) | 2020-01-07 |
CN109189608A (zh) | 2019-01-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109189608B (zh) | 一种保证复制事务一致性的方法以及相应的复制装置 | |
CN107515874B (zh) | 一种分布式非关系型数据库中同步增量数据的方法与设备 | |
CN101809558B (zh) | 远程异步数据复制系统和方法 | |
CN111797172B (zh) | 数据迁移方法、装置、设备、分布式系统及存储介质 | |
US20060095478A1 (en) | Consistent reintegration a failed primary instance | |
CN110457157B (zh) | 分布式事务异常处理方法、装置、计算机设备及存储介质 | |
CN105574187B (zh) | 一种异构数据库复制事务一致性保障方法及系统 | |
JP2022013854A (ja) | 2フェーズコミット分散トランザクションを使用することによってデータベースを更新するための方法および装置 | |
JP2006525599A (ja) | フラッシュバックデータベース | |
JP2006221628A (ja) | メタデータの複製および復元のための方法、システム、および製品 | |
CN109189852A (zh) | 一种数据同步的方法及用于数据同步的装置 | |
CN114637475A (zh) | 一种分布式存储系统控制方法、装置及可读存储介质 | |
CN111930788B (zh) | 操作请求的处理方法、装置、设备、可读存储介质及系统 | |
JP2013222373A (ja) | ストレージシステム、キャッシュ制御プログラムおよびキャッシュ制御方法 | |
EP4276651A1 (en) | Log execution method and apparatus, and computer device and storage medium | |
JP2009251853A (ja) | メモリデータベース、メモリデータベースシステム及びメモリデータベース更新方法 | |
US20090157767A1 (en) | Circular log amnesia detection | |
CN102708166B (zh) | 数据复制方法、数据恢复方法及装置 | |
CN114741449A (zh) | 一种基于分布式数据库的对象存储方法及装置 | |
CN116483284B (zh) | 一种读写虚拟硬盘的方法、装置、介质及电子设备 | |
CN112000623A (zh) | 一种元数据的存取方法、装置和计算机可读存储介质 | |
CN111858173A (zh) | 一种数据恢复方法、装置、设备和介质 | |
US11693844B2 (en) | Processing delete requests based on change feed of updates | |
JPH11127147A (ja) | 蓄積交換型電子会議システムにおける情報矛盾判定、修正装置及び方法並びに情報矛盾判定、修正プログラムを記録した媒体 | |
CN108874592B (zh) | 一种针对Log-structured存储引擎的数据冷备方法及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Fu Quan Inventor after: Sun Feng Inventor after: Zhao Jiawei Inventor before: Fu Quan Inventor before: Sun Feng Inventor before: Zhao Jiawei Inventor before: Yang Chun |
|
CB03 | Change of inventor or designer information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder |
Address after: 430000 High-tech Avenue 999, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee after: Wuhan dream database Co.,Ltd. Address before: 430000 High-tech Avenue 999, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee before: WUHAN DAMENG DATABASE Co.,Ltd. |
|
CP01 | Change in the name or title of a patent holder | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220907 Address after: 430073 16-19 / F, building C3, future science and technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee after: Wuhan dream database Co.,Ltd. Patentee after: HUAZHONG University OF SCIENCE AND TECHNOLOGY Address before: 430000 16-19 / F, building C3, future technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan, Hubei Province Patentee before: Wuhan dream database Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230803 Address after: 16-19/F, Building C3, Future Science and Technology Building, No. 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province, 430206 Patentee after: Wuhan dream database Co.,Ltd. Address before: 430073 16-19 / F, building C3, future science and technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee before: Wuhan dream database Co.,Ltd. Patentee before: HUAZHONG University OF SCIENCE AND TECHNOLOGY |
|
TR01 | Transfer of patent right |