CN110168514A - 一种事务处理方法、装置及设备 - Google Patents

一种事务处理方法、装置及设备 Download PDF

Info

Publication number
CN110168514A
CN110168514A CN201780002963.7A CN201780002963A CN110168514A CN 110168514 A CN110168514 A CN 110168514A CN 201780002963 A CN201780002963 A CN 201780002963A CN 110168514 A CN110168514 A CN 110168514A
Authority
CN
China
Prior art keywords
data
affairs
subregion
snapshot
data subregion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780002963.7A
Other languages
English (en)
Other versions
CN110168514B (zh
Inventor
刘哲
朱俊华
林晓勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110168514A publication Critical patent/CN110168514A/zh
Application granted granted Critical
Publication of CN110168514B publication Critical patent/CN110168514B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/1865—Transactional file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2365—Ensuring data consistency and integrity
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1448—Management of the data involved in backup or backup restore
    • G06F11/1451—Management of the data involved in backup or backup restore by selection of backup contents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G06F11/1466—Management of the backup or restore process to make the backup process non-disruptive
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2379—Updates performed during online database operations; commit processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种事务处理方法、装置及设备，涉及数据库技术领域，所述方法包括：接收待处理事务，所述待处理事务是在至少两个数据分区中进行操作的事务(21)；获取所述至少两个数据分区对应的，且满足一致性的数据快照(22)；根据所述至少两个数据分区对应的，且满足一致性的数据快照执行所述待处理事务对应的操作(23)。通过对多分区事务涉及的各个数据分区获取满足一致性的数据快照，并基于数据快照进行多分区事务对应的操作，支持读事务和写事务之间的并行执行，避免写事务与读事务之间相互阻塞的情况，从而达到提高系统的吞吐量和服务等级的效果。

Description

PCT国内申请，说明书已公开。

Claims (26)

  1. PCT国内申请，权利要求书已公开。
CN201780002963.7A 2017-06-05 2017-06-05 一种事务处理方法、装置及设备 Active CN110168514B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/087194 WO2018223262A1 (zh) 2017-06-05 2017-06-05 一种事务处理方法、装置及设备

Publications (2)

Publication Number Publication Date
CN110168514A true CN110168514A (zh) 2019-08-23
CN110168514B CN110168514B (zh) 2022-06-10

Family

ID=64565652

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780002963.7A Active CN110168514B (zh) 2017-06-05 2017-06-05 一种事务处理方法、装置及设备

Country Status (6)

Country Link
US (1) US20200110739A1 (zh)
EP (1) EP3627359B1 (zh)
JP (1) JP6924898B2 (zh)
KR (1) KR102353141B1 (zh)
CN (1) CN110168514B (zh)
WO (1) WO2018223262A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111475262A (zh) * 2020-04-02 2020-07-31 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5287496A (en) * 1991-02-25 1994-02-15 International Business Machines Corporation Dynamic, finite versioning for concurrent transaction and query processing
US20020194206A1 (en) * 2001-06-01 2002-12-19 Oracle Corporation Consistent read in a distributed database environment
US20050138047A1 (en) * 2003-12-19 2005-06-23 Oracle International Corporation Techniques for managing XML data associated with multiple execution units
CN102819615A (zh) * 2012-08-30 2012-12-12 天津火星科技有限公司 一种基于应用快照的数据库持续数据保护方法
US8375290B1 (en) * 2004-02-25 2013-02-12 Avaya Inc. Document version marking and access method and apparatus
US20160234173A1 (en) * 1999-07-16 2016-08-11 Intertrust Technologies Corporation Trusted storage systems and methods
US20160246836A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Relaxing transaction serializability with statement-based data replication
CN106462594A (zh) * 2014-04-10 2017-02-22 华为技术有限公司 一种大规模并行处理数据库的系统和方法
US9632878B1 (en) * 2013-09-20 2017-04-25 Amazon Technologies, Inc. Verification of database table partitions during backup
CN103116596B (zh) * 2011-11-16 2017-05-03 Sap欧洲公司 在分布式数据库中执行快照隔离的系统和方法
US20170139980A1 (en) * 2015-11-17 2017-05-18 Microsoft Technology Licensing, Llc Multi-version removal manager

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7653665B1 (en) 2004-09-13 2010-01-26 Microsoft Corporation Systems and methods for avoiding database anomalies when maintaining constraints and indexes in presence of snapshot isolation
US8713046B2 (en) 2011-11-08 2014-04-29 Sybase, Inc. Snapshot isolation support for distributed query processing in a shared disk database cluster
US9098522B2 (en) 2012-11-29 2015-08-04 Sap Se Version garbage collection using snapshot lists
US9411533B2 (en) * 2013-05-23 2016-08-09 Netapp, Inc. Snapshots and versioning of transactional storage class memory
CN104461768B (zh) * 2013-09-22 2018-08-14 华为技术有限公司 副本存储装置及副本存储方法
CN106598992B (zh) * 2015-10-15 2020-10-23 南京中兴软件有限责任公司 数据库的操作方法及装置
CN106610876B (zh) * 2015-10-23 2020-11-03 中兴通讯股份有限公司 数据快照的恢复方法及装置

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5287496A (en) * 1991-02-25 1994-02-15 International Business Machines Corporation Dynamic, finite versioning for concurrent transaction and query processing
US20160234173A1 (en) * 1999-07-16 2016-08-11 Intertrust Technologies Corporation Trusted storage systems and methods
US20020194206A1 (en) * 2001-06-01 2002-12-19 Oracle Corporation Consistent read in a distributed database environment
US20050138047A1 (en) * 2003-12-19 2005-06-23 Oracle International Corporation Techniques for managing XML data associated with multiple execution units
US8375290B1 (en) * 2004-02-25 2013-02-12 Avaya Inc. Document version marking and access method and apparatus
CN103116596B (zh) * 2011-11-16 2017-05-03 Sap欧洲公司 在分布式数据库中执行快照隔离的系统和方法
CN102819615A (zh) * 2012-08-30 2012-12-12 天津火星科技有限公司 一种基于应用快照的数据库持续数据保护方法
US9632878B1 (en) * 2013-09-20 2017-04-25 Amazon Technologies, Inc. Verification of database table partitions during backup
CN106462594A (zh) * 2014-04-10 2017-02-22 华为技术有限公司 一种大规模并行处理数据库的系统和方法
US20160246836A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Relaxing transaction serializability with statement-based data replication
US20170139980A1 (en) * 2015-11-17 2017-05-18 Microsoft Technology Licensing, Llc Multi-version removal manager

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LIU FAGUI, JIE YUZHU , RUAN YONGXIONG: "A framework for lightweight data synchronization on mobile RFID devices", 《2009 ISECS INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT》 *
看风景D人: "数据一致性和并发性", 《HTTP://WWW.360DOC.COM/CONTENT/14/0901/16/15257968_406302086.SHTML》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111475262A (zh) * 2020-04-02 2020-07-31 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质
CN111475262B (zh) * 2020-04-02 2024-02-06 百度国际科技（深圳）有限公司 区块链中事务请求处理方法、装置、设备和介质

Also Published As

Publication number Publication date
WO2018223262A1 (zh) 2018-12-13
JP6924898B2 (ja) 2021-08-25
EP3627359B1 (en) 2023-10-04
US20200110739A1 (en) 2020-04-09
JP2020522830A (ja) 2020-07-30
CN110168514B (zh) 2022-06-10
EP3627359A1 (en) 2020-03-25
KR20200006098A (ko) 2020-01-17
EP3627359A4 (en) 2020-04-22
KR102353141B1 (ko) 2022-01-19

Similar Documents

Publication Publication Date Title
CN112204513B (zh) 多租户存储系统中的基于组的数据复制
US10817501B1 (en) Systems and methods for using a reaction-based approach to managing shared state storage associated with a distributed database
CN106663103B (zh) 使用逻辑文档日志的可扩展最终一致性系统
US9852204B2 (en) Read-only operations processing in a paxos replication system
US11263236B2 (en) Real-time cross-system database replication for hybrid-cloud elastic scaling and high-performance data virtualization
US8732282B1 (en) Model framework to facilitate robust programming of distributed workflows
WO2019062699A1 (zh) 资源调度方法、调度服务器、云计算系统及存储介质
US8880488B1 (en) Efficient extent-based B-tree insertion
CN107807815B (zh) 分布式处理任务的方法和装置
WO2022111188A1 (zh) 事务处理方法、系统、装置、设备、存储介质及程序产品
US9313269B2 (en) Blending single-master and multi-master data synchronization techniques
US20170161313A1 (en) Detection and Resolution of Conflicts in Data Synchronization
US9529651B2 (en) Apparatus and method for executing agent
Chairunnanda et al. ConfluxDB: Multi-master replication for partitioned snapshot isolation databases
CN110290166B (zh) 跨集群数据交互方法、系统、装置及可读存储介质
US20210132987A1 (en) Computer program for asynchronous data processing in a database management system
CN110188114A (zh) 一种数据操作的优化方法、装置、系统、设备和存储介质
CN111488492A (zh) 用于检索图数据库的方法和装置
CN109614270A (zh) 基于Hbase的数据读写方法、装置、设备及存储介质
CN110168514A (zh) 一种事务处理方法、装置及设备
US20190384695A1 (en) Happens-before-based dynamic concurrency analysis for actor-based programs
CN111104070A (zh) 分布式系统中数据一致性的实现方法及系统
US11947517B1 (en) Stream-based transaction processing
CN113792051B (zh) 基于多模态锁的数据处理方法、系统、设备和存储介质
CN110765098B (zh) 流程运行预测系统及方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant