CN110168514A - 一种事务处理方法、装置及设备 - Google Patents

一种事务处理方法、装置及设备 Download PDF

Info

Publication number
CN110168514A
CN110168514A CN201780002963.7A CN201780002963A CN110168514A CN 110168514 A CN110168514 A CN 110168514A CN 201780002963 A CN201780002963 A CN 201780002963A CN 110168514 A CN110168514 A CN 110168514A
Authority
CN
China
Prior art keywords
data
affairs
subregion
snapshot
data subregion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780002963.7A
Other languages
English (en)
Other versions
CN110168514B (zh
Inventor
刘哲
朱俊华
林晓勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110168514A publication Critical patent/CN110168514A/zh
Application granted granted Critical
Publication of CN110168514B publication Critical patent/CN110168514B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1865—Transactional file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1466—Management of the backup or restore process to make the backup process non-disruptive
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2379—Updates performed during online database operations; commit processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种事务处理方法、装置及设备，涉及数据库技术领域，所述方法包括：接收待处理事务，所述待处理事务是在至少两个数据分区中进行操作的事务(21)；获取所述至少两个数据分区对应的，且满足一致性的数据快照(22)；根据所述至少两个数据分区对应的，且满足一致性的数据快照执行所述待处理事务对应的操作(23)。通过对多分区事务涉及的各个数据分区获取满足一致性的数据快照，并基于数据快照进行多分区事务对应的操作，支持读事务和写事务之间的并行执行，避免写事务与读事务之间相互阻塞的情况，从而达到提高系统的吞吐量和服务等级的效果。

Description

PCT国内申请，说明书已公开。

Claims (26)

  1. PCT国内申请，权利要求书已公开。
CN201780002963.7A 2017-06-05 2017-06-05 一种事务处理方法、装置及设备 Active CN110168514B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/087194 WO2018223262A1 (zh) 2017-06-05 2017-06-05 一种事务处理方法、装置及设备

Publications (2)

Publication Number Publication Date
CN110168514A true CN110168514A (zh) 2019-08-23
CN110168514B CN110168514B (zh) 2022-06-10

Family

ID=64565652

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780002963.7A Active CN110168514B (zh) 2017-06-05 2017-06-05 一种事务处理方法、装置及设备

Country Status (6)

Country Link
US (1) US20200110739A1 (zh)
EP (1) EP3627359B1 (zh)
JP (1) JP6924898B2 (zh)
KR (1) KR102353141B1 (zh)
CN (1) CN110168514B (zh)
WO (1) WO2018223262A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111475262A (zh) * 2020-04-02 2020-07-31 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5287496A (en) * 1991-02-25 1994-02-15 International Business Machines Corporation Dynamic, finite versioning for concurrent transaction and query processing
US20020194206A1 (en) * 2001-06-01 2002-12-19 Oracle Corporation Consistent read in a distributed database environment
US20050138047A1 (en) * 2003-12-19 2005-06-23 Oracle International Corporation Techniques for managing XML data associated with multiple execution units
CN102819615A (zh) * 2012-08-30 2012-12-12 天津火星科技有限公司 一种基于应用快照的数据库持续数据保护方法
US8375290B1 (en) * 2004-02-25 2013-02-12 Avaya Inc. Document version marking and access method and apparatus
US20160234173A1 (en) * 1999-07-16 2016-08-11 Intertrust Technologies Corporation Trusted storage systems and methods
US20160246836A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Relaxing transaction serializability with statement-based data replication
CN106462594A (zh) * 2014-04-10 2017-02-22 华为技术有限公司 一种大规模并行处理数据库的系统和方法
US9632878B1 (en) * 2013-09-20 2017-04-25 Amazon Technologies, Inc. Verification of database table partitions during backup
CN103116596B (zh) * 2011-11-16 2017-05-03 Sap欧洲公司 在分布式数据库中执行快照隔离的系统和方法
US20170139980A1 (en) * 2015-11-17 2017-05-18 Microsoft Technology Licensing, Llc Multi-version removal manager

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7653665B1 (en) 2004-09-13 2010-01-26 Microsoft Corporation Systems and methods for avoiding database anomalies when maintaining constraints and indexes in presence of snapshot isolation
US8713046B2 (en) 2011-11-08 2014-04-29 Sybase, Inc. Snapshot isolation support for distributed query processing in a shared disk database cluster
US9098522B2 (en) 2012-11-29 2015-08-04 Sap Se Version garbage collection using snapshot lists
US9411533B2 (en) * 2013-05-23 2016-08-09 Netapp, Inc. Snapshots and versioning of transactional storage class memory
CN104461768B (zh) * 2013-09-22 2018-08-14 华为技术有限公司 副本存储装置及副本存储方法
CN106598992B (zh) * 2015-10-15 2020-10-23 南京中兴软件有限责任公司 数据库的操作方法及装置
CN106610876B (zh) * 2015-10-23 2020-11-03 中兴通讯股份有限公司 数据快照的恢复方法及装置

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5287496A (en) * 1991-02-25 1994-02-15 International Business Machines Corporation Dynamic, finite versioning for concurrent transaction and query processing
US20160234173A1 (en) * 1999-07-16 2016-08-11 Intertrust Technologies Corporation Trusted storage systems and methods
US20020194206A1 (en) * 2001-06-01 2002-12-19 Oracle Corporation Consistent read in a distributed database environment
US20050138047A1 (en) * 2003-12-19 2005-06-23 Oracle International Corporation Techniques for managing XML data associated with multiple execution units
US8375290B1 (en) * 2004-02-25 2013-02-12 Avaya Inc. Document version marking and access method and apparatus
CN103116596B (zh) * 2011-11-16 2017-05-03 Sap欧洲公司 在分布式数据库中执行快照隔离的系统和方法
CN102819615A (zh) * 2012-08-30 2012-12-12 天津火星科技有限公司 一种基于应用快照的数据库持续数据保护方法
US9632878B1 (en) * 2013-09-20 2017-04-25 Amazon Technologies, Inc. Verification of database table partitions during backup
CN106462594A (zh) * 2014-04-10 2017-02-22 华为技术有限公司 一种大规模并行处理数据库的系统和方法
US20160246836A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Relaxing transaction serializability with statement-based data replication
US20170139980A1 (en) * 2015-11-17 2017-05-18 Microsoft Technology Licensing, Llc Multi-version removal manager

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LIU FAGUI, JIE YUZHU , RUAN YONGXIONG: "A framework for lightweight data synchronization on mobile RFID devices", 《2009 ISECS INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT》 *
看风景D人: "数据一致性和并发性", 《HTTP://WWW.360DOC.COM/CONTENT/14/0901/16/15257968_406302086.SHTML》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111475262A (zh) * 2020-04-02 2020-07-31 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质
CN111475262B (zh) * 2020-04-02 2024-02-06 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质

Also Published As

Publication number Publication date
CN110168514B (zh) 2022-06-10
EP3627359A1 (en) 2020-03-25
US20200110739A1 (en) 2020-04-09
EP3627359B1 (en) 2023-10-04
KR20200006098A (ko) 2020-01-17
JP6924898B2 (ja) 2021-08-25
EP3627359A4 (en) 2020-04-22
JP2020522830A (ja) 2020-07-30
KR102353141B1 (ko) 2022-01-19
WO2018223262A1 (zh) 2018-12-13

Similar Documents

Publication Publication Date Title
CN112204513B (zh) 多租户存储系统中的基于组的数据复制
US10817501B1 (en) Systems and methods for using a reaction-based approach to managing shared state storage associated with a distributed database
CN106663103B (zh) 使用逻辑文档日志的可扩展最终一致性系统
US9852204B2 (en) Read-only operations processing in a paxos replication system
US8732282B1 (en) Model framework to facilitate robust programming of distributed workflows
US11263236B2 (en) Real-time cross-system database replication for hybrid-cloud elastic scaling and high-performance data virtualization
WO2019062699A1 (zh) 资源调度方法、调度服务器、云计算系统及存储介质
CN107807815B (zh) 分布式处理任务的方法和装置
US9313269B2 (en) Blending single-master and multi-master data synchronization techniques
JP2010500673A (ja) リモート・コピー・データの整合性を保持するストレージ管理システム、（ストレージ管理システム、ストレージ管理方法、およびコンピュータ・プログラム）
CN110737720A (zh) 一种db2数据库数据同步方法、装置、系统
US9529651B2 (en) Apparatus and method for executing agent
US20170161313A1 (en) Detection and Resolution of Conflicts in Data Synchronization
WO2022111188A1 (zh) 事务处理方法、系统、装置、设备、存储介质及程序产品
Chairunnanda et al. ConfluxDB: Multi-master replication for partitioned snapshot isolation databases
US20210132987A1 (en) Computer program for asynchronous data processing in a database management system
US20140289562A1 (en) Controlling method, information processing apparatus, storage medium, and method of detecting failure
CN110188114A (zh) 一种数据操作的优化方法、装置、系统、设备和存储介质
CN111488492A (zh) 用于检索图数据库的方法和装置
CN109614270A (zh) 基于Hbase的数据读写方法、装置、设备及存储介质
US10127270B1 (en) Transaction processing using a key-value store
CN110168514A (zh) 一种事务处理方法、装置及设备
US10824640B1 (en) Framework for scheduling concurrent replication cycles
US20200117522A1 (en) Lightweight application programming interface (api) creation and management
US20190384695A1 (en) Happens-before-based dynamic concurrency analysis for actor-based programs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant