JP5577350B2 - 効率的なデータ同期化のための方法及びシステム - Google Patents

効率的なデータ同期化のための方法及びシステム Download PDF

Info

Publication number
JP5577350B2
JP5577350B2 JP2011540691A JP2011540691A JP5577350B2 JP 5577350 B2 JP5577350 B2 JP 5577350B2 JP 2011540691 A JP2011540691 A JP 2011540691A JP 2011540691 A JP2011540691 A JP 2011540691A JP 5577350 B2 JP5577350 B2 JP 5577350B2
Authority
JP
Japan
Prior art keywords
data
data table
target data
synchronization
current target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2011540691A
Other languages
English (en)
Japanese (ja)
Other versions
JP2012511773A (ja
JP2012511773A5 (https=
Inventor
チャオ・リン
ハン・ハイ
チャン・チン
チャン・イナ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of JP2012511773A publication Critical patent/JP2012511773A/ja
Publication of JP2012511773A5 publication Critical patent/JP2012511773A5/ja
Application granted granted Critical
Publication of JP5577350B2 publication Critical patent/JP5577350B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/178—Techniques for file synchronisation in file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2308—Concurrency control
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2379—Updates performed during online database operations; commit processing
    • G06F16/2386—Bulk updating operations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2393—Updating materialised views
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2011540691A 2008-12-10 2009-12-09 効率的なデータ同期化のための方法及びシステム Expired - Fee Related JP5577350B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
CN200810179394.6 2008-12-10
CNA2008101793946A CN101419616A (zh) 2008-12-10 2008-12-10 一种数据同步方法及装置
US12/653,091 2009-12-08
US12/653,091 US8949178B2 (en) 2008-12-10 2009-12-08 Method and system for efficient data synchronization
PCT/US2009/006457 WO2010068260A1 (en) 2008-12-10 2009-12-09 Method and system for efficient data synchronization

Publications (3)

Publication Number Publication Date
JP2012511773A JP2012511773A (ja) 2012-05-24
JP2012511773A5 JP2012511773A5 (https=) 2013-01-10
JP5577350B2 true JP5577350B2 (ja) 2014-08-20

Family

ID=40630405

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2011540691A Expired - Fee Related JP5577350B2 (ja) 2008-12-10 2009-12-09 効率的なデータ同期化のための方法及びシステム

Country Status (5)

Country Link
US (2) US8949178B2 (https=)
EP (1) EP2368178A4 (https=)
JP (1) JP5577350B2 (https=)
CN (1) CN101419616A (https=)
WO (1) WO2010068260A1 (https=)

Families Citing this family (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8473953B2 (en) 2010-07-21 2013-06-25 International Business Machines Corporation Batching transactions to apply to a database
DE102010054446A1 (de) * 2010-12-14 2012-06-14 Giesecke & Devrient Gmbh Portabler Datenträger mit Fehlbedienungszähler
CN102841897B (zh) * 2011-06-23 2016-03-02 阿里巴巴集团控股有限公司 一种实现增量数据抽取的方法、装置及系统
US9223842B2 (en) * 2011-12-05 2015-12-29 Blackberry Limited Apparatus, and associated method, for synchronizing a database
WO2014026611A1 (en) * 2012-08-14 2014-02-20 Huawei Technologies Co., Ltd. Rollback method and apparatus of transaction, relational database management system
US9253113B2 (en) 2012-09-07 2016-02-02 Oracle International Corporation Customizable model for throttling and prioritizing orders in a cloud environment
US9621435B2 (en) 2012-09-07 2017-04-11 Oracle International Corporation Declarative and extensible model for provisioning of cloud based services
US10148530B2 (en) 2012-09-07 2018-12-04 Oracle International Corporation Rule based subscription cloning
US10521746B2 (en) 2012-09-07 2019-12-31 Oracle International Corporation Recovery workflow for processing subscription orders in a computing infrastructure system
US9667470B2 (en) 2012-09-07 2017-05-30 Oracle International Corporation Failure handling in the execution flow of provisioning operations in a cloud environment
US9219749B2 (en) * 2012-09-07 2015-12-22 Oracle International Corporation Role-driven notification system including support for collapsing combinations
CN103838762B (zh) * 2012-11-26 2017-09-29 中国银联股份有限公司 基于数据表轮换的不间断数据处理装置及方法
KR102020358B1 (ko) * 2013-03-14 2019-11-05 삼성전자 주식회사 단말 및 그 단말에서 애플리케이션 동기화 방법
US9342512B1 (en) 2013-03-15 2016-05-17 Tasktop Technologies, Incorporated System and method for repairing data synchronization links
US10528590B2 (en) * 2014-09-26 2020-01-07 Oracle International Corporation Optimizing a query with extrema function using in-memory data summaries on the storage server
US9977820B1 (en) * 2013-03-15 2018-05-22 Tasktop Technologies, Incorporated System and method for synchronizing states in associated data records
US9588685B1 (en) * 2013-05-03 2017-03-07 EMC IP Holding Company LLC Distributed workflow manager
US9436724B2 (en) * 2013-10-21 2016-09-06 Sap Se Migrating data in tables in a database
CN104750744B (zh) * 2013-12-31 2018-05-22 中国移动通信集团河南有限公司 一种基于Oracle数据库的压缩数据同步方法及装置
CN104980463B (zh) * 2014-04-04 2019-03-05 腾讯科技（深圳）有限公司 同步网络数据的方法和系统
US10164901B2 (en) 2014-08-22 2018-12-25 Oracle International Corporation Intelligent data center selection
CN104268234B (zh) * 2014-09-26 2018-05-29 东软集团股份有限公司 一种基于sql语句的数据同步方法和装置
CN105701116A (zh) * 2014-11-27 2016-06-22 英业达科技有限公司 数据同步系统
US9459839B2 (en) 2014-12-15 2016-10-04 Tasktop Technologies, Incorporated Systems and methods to synchronize artifact relationships across a plurality of repositories
CN106297599A (zh) * 2015-05-12 2017-01-04 杨鸿年 一种实时动态投影系统的部署方法
KR101573663B1 (ko) 2015-07-21 2015-12-01 한다시스템 주식회사 데이터 통합 방법 및 시스템
CN106484560B (zh) * 2015-08-25 2019-01-15 阿里巴巴集团控股有限公司 数据同步方法及装置
CN106557364A (zh) * 2015-09-24 2017-04-05 阿里巴巴集团控股有限公司 一种数据同步方法和系统
US10061536B2 (en) * 2015-09-28 2018-08-28 EMC IP Holding Company LLC Disk synchronization
CN105183898A (zh) * 2015-09-29 2015-12-23 北京奇艺世纪科技有限公司 数据同步方法和数据同步系统
CN106802897A (zh) * 2015-11-26 2017-06-06 北京国双科技有限公司 查询表数据同步方法和装置
CN111510954B (zh) * 2016-02-05 2021-12-31 中兴通讯股份有限公司 调度定时间隔的确定方法及装置
CN107122354B (zh) * 2016-02-24 2020-05-08 华为技术有限公司 事务执行方法、装置及系统
CN106021494A (zh) * 2016-05-19 2016-10-12 中国银联股份有限公司 一种主数据同步方法及装置
JP6705721B2 (ja) * 2016-09-02 2020-06-03 日本電信電話株式会社 情報処理システムおよびデータ同期方法
CN106446090A (zh) * 2016-09-12 2017-02-22 浪潮软件股份有限公司 一种跨库传输海量数据的方法
CN107766132B (zh) * 2017-06-25 2019-03-15 平安科技（深圳）有限公司 多任务调度方法、应用服务器及计算机可读存储介质
CN108984337B (zh) * 2018-05-29 2021-04-16 杭州网易再顾科技有限公司 一种数据同步异常的修复方法、修复装置、介质和计算设备
CN113553313B (zh) * 2018-07-10 2023-12-05 创新先进技术有限公司 一种数据迁移方法及系统、存储介质、电子设备
US10997202B1 (en) 2018-07-27 2021-05-04 Veeva Systems Inc. System and method for synchronizing data between a customer data management system and a data warehouse
US10970255B1 (en) * 2018-07-27 2021-04-06 Veeva Systems Inc. System and method for synchronizing data between a customer data management system and a data warehouse
US11184406B1 (en) * 2018-08-20 2021-11-23 Shashank System and methods for secure user interface session recording, transmission, and replay without third party disclosure
CN109492000A (zh) * 2018-10-09 2019-03-19 郑州云海信息技术有限公司 一种数据库表的复制方法及系统
CN109785042A (zh) * 2018-12-13 2019-05-21 深圳平安财富宝投资咨询有限公司 分布式部署的异常处理方法、服务器、存储介质及装置
CN109933630B (zh) * 2019-03-19 2021-11-23 武汉达梦数据库股份有限公司 数据库数据实时同步方法及设备
CN110196786B (zh) * 2019-04-30 2021-10-08 武汉达梦数据库股份有限公司 数据库回滚同步中内存的控制方法及设备
CN110347693A (zh) * 2019-07-11 2019-10-18 招商局金融科技有限公司 数据同步方法、装置及存储介质
CN111367839B (zh) * 2020-02-21 2021-06-29 苏州浪潮智能科技有限公司 一种主机端与fpga加速器之间的数据同步方法
US11487784B2 (en) * 2020-04-17 2022-11-01 Sap Se Reload procedure to retain data in target system
CN113868237B (zh) * 2021-09-30 2025-03-28 杭州数梦工场科技有限公司 数据清洗方法及装置
CN115080569B (zh) * 2022-06-27 2025-06-27 平安银行股份有限公司 一种数据同步方法、装置、电子设备及存储介质
CN115687524A (zh) * 2022-11-02 2023-02-03 中国农业银行股份有限公司 一种数据移植方法及装置

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE456782B (sv) 1986-04-29 1988-10-31 Ibm Svenska Ab Databasprocessor i ett databehandlingssystem, metod foer tabellbehandling i en databasprocessor samt anvaendning av en databasprocessor i ett databehandlingssystem
US5333299A (en) * 1991-12-31 1994-07-26 International Business Machines Corporation Synchronization techniques for multimedia data streams
US5822588A (en) * 1995-06-09 1998-10-13 Sun Microsystem, Inc. System and method for checking the use of synchronization locks in a multi-threaded target program
US5778389A (en) * 1996-05-23 1998-07-07 Electronic Data Systems Corporation Method and system for synchronizing computer file directories
AU6151598A (en) * 1997-02-11 1998-08-26 Connected Corporation File comparison for data backup and file synchronization
US5950198A (en) * 1997-03-24 1999-09-07 Novell, Inc. Processes and apparatuses for generating file correspondency through replication and synchronization between target and source computers
US5848405A (en) * 1997-04-21 1998-12-08 Oracle Corporation Method and apparatus for identifying new data by address ranges
US6345313B1 (en) * 1997-08-22 2002-02-05 Sun Microsystems, Inc. Recovery of synchronization constructs
US6289357B1 (en) * 1998-04-24 2001-09-11 Platinum Technology Ip, Inc. Method of automatically synchronizing mirrored database objects
US6353835B1 (en) * 1998-08-03 2002-03-05 Lucent Technologies Inc. Technique for effectively maintaining materialized views in a data warehouse
US6108653A (en) * 1998-08-31 2000-08-22 Platinum Technology Ip, Inc. Method and apparatus for fast and comprehensive DBMS analysis
US6122640A (en) * 1998-09-22 2000-09-19 Platinum Technology Ip, Inc. Method and apparatus for reorganizing an active DBMS table
US6397125B1 (en) * 1998-12-18 2002-05-28 International Business Machines Corporation Method of and apparatus for performing design synchronization in a computer system
US6430577B1 (en) * 1999-10-08 2002-08-06 Unisys Corporation System and method for asynchronously receiving multiple packets of audit data from a source databased host in a resynchronization mode and asynchronously writing the data to a target host
JP3845535B2 (ja) 1999-12-10 2006-11-15 株式会社東芝 データベースシステム
US20020059299A1 (en) * 2000-07-14 2002-05-16 Frederic Spaey System and method for synchronizing databases
JP2002202906A (ja) 2000-12-28 2002-07-19 Nec Corp データベース二重化システムおよび方法
US6728736B2 (en) * 2001-03-14 2004-04-27 Storage Technology Corporation System and method for synchronizing a data copy using an accumulation remote copy trio
US6745209B2 (en) * 2001-08-15 2004-06-01 Iti, Inc. Synchronization of plural databases in a database replication system
WO2003027909A1 (en) * 2001-09-26 2003-04-03 Emc Corporation Efficient mangement of large files
CN100426875C (zh) 2001-12-20 2008-10-15 中兴通讯股份有限公司 数据主备内存处理方法
US7574652B2 (en) * 2002-06-20 2009-08-11 Canon Kabushiki Kaisha Methods for interactively defining transforms and for generating queries by manipulating existing query data
US6973452B2 (en) * 2003-05-19 2005-12-06 Netezza Corporation Limiting scans of loosely ordered and/or grouped relations using nearly ordered maps
JP2004355203A (ja) 2003-05-28 2004-12-16 Nec Corp データの更新・履歴・集計管理方式
US7873684B2 (en) * 2003-08-14 2011-01-18 Oracle International Corporation Automatic and dynamic provisioning of databases
US7440960B2 (en) * 2003-09-03 2008-10-21 International Business Machines Corporation Result set management
EP2533179A1 (en) * 2004-02-12 2012-12-12 Mobileframe LLC Smart database
US7225307B2 (en) * 2004-05-04 2007-05-29 International Business Machines Corporation Apparatus, system, and method for synchronizing an asynchronous mirror volume using a synchronous mirror volume
US20060047696A1 (en) * 2004-08-24 2006-03-02 Microsoft Corporation Partially materialized views
JP4643395B2 (ja) 2004-08-30 2011-03-02 株式会社日立製作所 ストレージシステム及びデータの移動方法
US20060085491A1 (en) * 2004-10-08 2006-04-20 Foote Jane E System and method for recovering from interruptions during data loading
CN101124537B (zh) * 2004-11-12 2011-01-26 马克森斯公司 采用术语构建知识关联的知识发现技术
JP2006301820A (ja) * 2005-04-19 2006-11-02 Hitachi Ltd ストレージシステム及びストレージシステムのデータ移行方法
JP4693540B2 (ja) * 2005-08-04 2011-06-01 富士通株式会社 データベース再構成装置、およびデータベース再構成プログラム
US7680767B2 (en) * 2006-03-23 2010-03-16 Microsoft Corporation Mapping architecture with incremental view maintenance
JP2008059367A (ja) * 2006-08-31 2008-03-13 Fujitsu Ltd システムデータ構造管理プログラム、システムデータ構造管理装置、およびシステムデータ構造管理方法
US7707298B2 (en) * 2007-05-10 2010-04-27 Microsoft Corporation Secure sharing of LOB bound information in client applications

Also Published As

Publication number Publication date
US9727576B2 (en) 2017-08-08
EP2368178A4 (en) 2016-04-06
WO2010068260A1 (en) 2010-06-17
US20150186408A1 (en) 2015-07-02
JP2012511773A (ja) 2012-05-24
US8949178B2 (en) 2015-02-03
EP2368178A1 (en) 2011-09-28
US20100145910A1 (en) 2010-06-10
CN101419616A (zh) 2009-04-29

Similar Documents

Publication Publication Date Title
JP5577350B2 (ja) 効率的なデータ同期化のための方法及びシステム
Taft et al. Cockroachdb: The resilient geo-distributed sql database
US11010262B2 (en) Database system recovery using preliminary and final slave node replay positions
EP3413215B1 (en) Dynamic snapshot isolation protocol selection
US9589041B2 (en) Client and server integration for replicating data
Yang et al. F1 Lightning: HTAP as a Service
CN109643310B (zh) 用于数据库中数据重分布的系统和方法
US9904721B1 (en) Source-side merging of distributed transactions prior to replication
CN111159252A (zh) 事务执行方法、装置、计算机设备及存储介质
US20120089566A1 (en) Method for reorganizing or moving a database table
CN102081665A (zh) 一种数据同步方法及装置
CN107870954B (zh) 一种分布式数据库的扩展方法及装置
US11003550B2 (en) Methods and systems of operating a database management system DBMS in a strong consistency mode
US12277140B2 (en) Consensus protocol for asynchronous database transaction replication with fast, automatic failover, zero data loss, strong consistency, full SQL support and horizontal scalability
WO2022002103A1 (zh) 一种在数据节点上回放日志的方法、数据节点及系统
US20250200070A1 (en) Consensus Protocol For Asynchronous Database Transaction Replication With Fast, Automatic Failover, Zero Data Loss, Strong Consistency, Full SQL Support And Horizontal Scalability
Kang et al. Remus: Efficient live migration for distributed databases with snapshot isolation
CN101226527B (zh) 双核库数据同步方法
TWI475409B (zh) Data synchronization method and device
WO2014180395A1 (zh) 海量数据融合存储方法及系统
Rosa Consistent Caching for Application Servers
WO2024081140A1 (en) Configuration and management of replication units for asynchronous database transaction replication
HK1129938A (en) Method and apparatus for data synchronization
HK1154679A (en) A data synchronization method and device
CN121858576A (zh) 分布式数据库在线重分布方法、装置、介质及设备

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20121113

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20121113

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20131213

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20140107

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140318

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20140610

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20140707

R150 Certificate of patent or registration of utility model

Ref document number: 5577350

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees