ZA200303415B - Method and apparatus for data processing. - Google Patents

Method and apparatus for data processing. Download PDF

Info

Publication number
ZA200303415B
ZA200303415B ZA200303415A ZA200303415A ZA200303415B ZA 200303415 B ZA200303415 B ZA 200303415B ZA 200303415 A ZA200303415 A ZA 200303415A ZA 200303415 A ZA200303415 A ZA 200303415A ZA 200303415 B ZA200303415 B ZA 200303415B
Authority
ZA
South Africa
Prior art keywords
database
storage space
journal
journal entries
serialisation
Prior art date
Application number
ZA200303415A
Other languages
English (en)
Inventor
James Scott Tarbell
Original Assignee
Maximum Availability Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Maximum Availability Ltd filed Critical Maximum Availability Ltd
Publication of ZA200303415B publication Critical patent/ZA200303415B/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/275—Synchronous replication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2064—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring while ensuring consistency
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)
ZA200303415A 2000-10-09 2003-05-02 Method and apparatus for data processing. ZA200303415B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
NZ50738600 2000-10-09

Publications (1)

Publication Number Publication Date
ZA200303415B true ZA200303415B (en) 2004-03-26

Family

ID=19928162

Family Applications (1)

Application Number Title Priority Date Filing Date
ZA200303415A ZA200303415B (en) 2000-10-09 2003-05-02 Method and apparatus for data processing.

Country Status (11)

Country Link
US (2) US7930271B2 (xx)
EP (3) EP1332444A4 (xx)
JP (4) JP2004511854A (xx)
CN (4) CN100533437C (xx)
AU (2) AU1284302A (xx)
CA (1) CA2436517C (xx)
ES (1) ES2395205T3 (xx)
HK (1) HK1062061A1 (xx)
IL (2) IL155217A0 (xx)
WO (1) WO2002031696A1 (xx)
ZA (1) ZA200303415B (xx)

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3966051B2 (ja) * 2002-04-16 2007-08-29 株式会社日立製作所 通信データ削減方法およびシステム
JP4186602B2 (ja) 2002-12-04 2008-11-26 株式会社日立製作所 ジャーナルログを利用した更新データ書込方法
JP2004213435A (ja) * 2003-01-07 2004-07-29 Hitachi Ltd 記憶装置システム
JP4374953B2 (ja) * 2003-09-09 2009-12-02 株式会社日立製作所 データ処理システム
JP4124348B2 (ja) 2003-06-27 2008-07-23 株式会社日立製作所 記憶システム
JP2005309550A (ja) 2004-04-19 2005-11-04 Hitachi Ltd リモートコピー方法及びリモートコピーシステム
US7130975B2 (en) * 2003-06-27 2006-10-31 Hitachi, Ltd. Data processing system
JP2005062928A (ja) * 2003-08-11 2005-03-10 Hitachi Ltd 複数のサイトにリモートコピーを行うシステム
US20060271599A1 (en) * 2003-08-21 2006-11-30 Akihiro Yamamoto Data transmission/reception system, data transmission/reception method, and recording/reproduction device
JP4412989B2 (ja) * 2003-12-15 2010-02-10 株式会社日立製作所 複数の記憶システムを有するデータ処理システム
US7756852B2 (en) * 2004-01-21 2010-07-13 Oracle International Corporation Concurrent execution of groups of database statements
JP4477370B2 (ja) * 2004-01-30 2010-06-09 株式会社日立製作所 データ処理システム
JP4519563B2 (ja) * 2004-08-04 2010-08-04 株式会社日立製作所 記憶システム及びデータ処理システム
JP2006127028A (ja) * 2004-10-27 2006-05-18 Hitachi Ltd 記憶システム及び記憶制御装置
CN101364217B (zh) * 2007-08-08 2011-06-22 华为技术有限公司 数据库中数据维护方法、设备及其系统
US7591019B1 (en) 2009-04-01 2009-09-15 Kaspersky Lab, Zao Method and system for optimization of anti-virus scan
EP2323047B1 (en) * 2009-10-09 2020-02-19 Software AG Primary database system, replication database system and method for replicating data of a primary database system
US8239390B2 (en) * 2010-02-26 2012-08-07 International Business Machines Corporation Filtered remote journal
US8930330B1 (en) 2011-06-27 2015-01-06 Amazon Technologies, Inc. Validation of log formats
US9330154B2 (en) * 2011-08-22 2016-05-03 Sybase, Inc. Multicast database replication
US9275086B2 (en) 2012-07-20 2016-03-01 Commvault Systems, Inc. Systems and methods for database archiving
US9495411B2 (en) * 2012-09-24 2016-11-15 Salesforce.Com, Inc. Increased parallelism performance of batch requests
US9766987B2 (en) 2013-01-11 2017-09-19 Commvault Systems, Inc. Table level database restore in a data storage system
US9672237B2 (en) 2013-03-15 2017-06-06 Amazon Technologies, Inc. System-wide checkpoint avoidance for distributed database systems
US9514007B2 (en) 2013-03-15 2016-12-06 Amazon Technologies, Inc. Database system with database engine and separate distributed storage service
US9501501B2 (en) 2013-03-15 2016-11-22 Amazon Technologies, Inc. Log record management
US11030055B2 (en) 2013-03-15 2021-06-08 Amazon Technologies, Inc. Fast crash recovery for distributed database systems
US10180951B2 (en) 2013-03-15 2019-01-15 Amazon Technologies, Inc. Place snapshots
US10747746B2 (en) 2013-04-30 2020-08-18 Amazon Technologies, Inc. Efficient read replicas
US9317213B1 (en) 2013-05-10 2016-04-19 Amazon Technologies, Inc. Efficient storage of variably-sized data objects in a data store
US9760596B2 (en) 2013-05-13 2017-09-12 Amazon Technologies, Inc. Transaction ordering
US9208032B1 (en) 2013-05-15 2015-12-08 Amazon Technologies, Inc. Managing contingency capacity of pooled resources in multiple availability zones
US10303564B1 (en) 2013-05-23 2019-05-28 Amazon Technologies, Inc. Reduced transaction I/O for log-structured storage systems
US9305056B1 (en) 2013-05-24 2016-04-05 Amazon Technologies, Inc. Results cache invalidation
US9047189B1 (en) 2013-05-28 2015-06-02 Amazon Technologies, Inc. Self-describing data blocks of a minimum atomic write size for a data store
US9460008B1 (en) 2013-09-20 2016-10-04 Amazon Technologies, Inc. Efficient garbage collection for a log-structured data store
US9280591B1 (en) 2013-09-20 2016-03-08 Amazon Technologies, Inc. Efficient replication of system transactions for read-only nodes of a distributed database
US9519664B1 (en) 2013-09-20 2016-12-13 Amazon Technologies, Inc. Index structure navigation using page versions for read-only nodes
US9507843B1 (en) 2013-09-20 2016-11-29 Amazon Technologies, Inc. Efficient replication of distributed storage changes for read-only nodes of a distributed database
US10216949B1 (en) 2013-09-20 2019-02-26 Amazon Technologies, Inc. Dynamic quorum membership changes
US9699017B1 (en) 2013-09-25 2017-07-04 Amazon Technologies, Inc. Dynamic utilization of bandwidth for a quorum-based distributed storage system
US9552242B1 (en) 2013-09-25 2017-01-24 Amazon Technologies, Inc. Log-structured distributed storage using a single log sequence number space
US10223184B1 (en) 2013-09-25 2019-03-05 Amazon Technologies, Inc. Individual write quorums for a log-structured distributed storage system
CN103544292B (zh) * 2013-10-29 2017-05-24 大唐移动通信设备有限公司 基于HASH表的Diameter消息处理方法和装置
US9760480B1 (en) 2013-11-01 2017-09-12 Amazon Technologies, Inc. Enhanced logging using non-volatile system memory
US10387399B1 (en) 2013-11-01 2019-08-20 Amazon Technologies, Inc. Efficient database journaling using non-volatile system memory
US9880933B1 (en) 2013-11-20 2018-01-30 Amazon Technologies, Inc. Distributed in-memory buffer cache system using buffer cache nodes
US9223843B1 (en) 2013-12-02 2015-12-29 Amazon Technologies, Inc. Optimized log storage for asynchronous log updates
US10303663B1 (en) 2014-06-12 2019-05-28 Amazon Technologies, Inc. Remote durable logging for journaling file systems
US20160210306A1 (en) * 2015-01-15 2016-07-21 Commvault Systems, Inc. Managing structured data in a data storage system
US10108687B2 (en) 2015-01-21 2018-10-23 Commvault Systems, Inc. Database protection using block-level mapping
US9904598B2 (en) 2015-04-21 2018-02-27 Commvault Systems, Inc. Content-independent and database management system-independent synthetic full backup of a database based on snapshot technology
US10423642B2 (en) 2015-06-12 2019-09-24 International Business Machines Corporation Aggregating modifications to a database for journal replay
US10394844B2 (en) * 2015-11-09 2019-08-27 Sap Se Integrating co-deployed databases for data analytics
US11914571B1 (en) 2017-11-22 2024-02-27 Amazon Technologies, Inc. Optimistic concurrency for a multi-writer database
US11269732B2 (en) 2019-03-12 2022-03-08 Commvault Systems, Inc. Managing structured data in a data storage system
US11341163B1 (en) 2020-03-30 2022-05-24 Amazon Technologies, Inc. Multi-level replication filtering for a distributed database

Family Cites Families (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4280060A (en) * 1980-06-09 1981-07-21 General Electric Company Dedicated microcomputer-based control system for steam turbine-generators
US4507751A (en) * 1982-06-21 1985-03-26 International Business Machines Corporation Method and apparatus for logging journal data using a log write ahead data set
JPS62236050A (ja) 1986-04-07 1987-10-16 Mitsubishi Electric Corp ジヨイン処理方式
US5170480A (en) 1989-09-25 1992-12-08 International Business Machines Corporation Concurrently applying redo records to backup database in a log sequence using single queue server per queue at a time
US5412801A (en) * 1990-01-17 1995-05-02 E-Net Gap recovery for off-site data storage and recovery systems
JP3020539B2 (ja) * 1990-03-07 2000-03-15 株式会社日立製作所 並列動作型データベース管理方式
JPH04168542A (ja) * 1990-11-01 1992-06-16 Okayama Nippon Denki Software Kk ジャーナル採取管理方式
US5530855A (en) * 1992-10-13 1996-06-25 International Business Machines Corporation Replicating a database by the sequential application of hierarchically sorted log records
GB2273183A (en) 1992-12-04 1994-06-08 Ibm Replicated distributed databases.
US5446871A (en) * 1993-03-23 1995-08-29 International Business Machines Corporation Method and arrangement for multi-system remote data duplexing and recovery
JPH06290124A (ja) 1993-03-31 1994-10-18 Hitachi Ltd システム間障害認識同期方式
CN1094525A (zh) 1993-04-19 1994-11-02 电子科技大学 一种大容量高速数据采集缓存方法及设备
AU7684094A (en) 1993-09-24 1995-04-10 Oracle Corporation Method and apparatus for data replication
US5553279A (en) * 1993-10-08 1996-09-03 International Business Machines Corporation Lossless distribution of time series data in a relational data base network
DE4423559A1 (de) * 1993-11-09 1995-05-11 Hewlett Packard Co Datenverbindungsverfahren und Vorrichtung für Multiprozessor-Computersysteme mit gemeinsamem Speicher
KR0128271B1 (ko) * 1994-02-22 1998-04-15 윌리암 티. 엘리스 재해회복을 위한 일관성 그룹 형성방법 및 레코드갱싱의 섀도잉 방법, 주시스템, 원격데이타 섀도잉 시스템과 비동기 원격데이타 복제 시스템
US5796999A (en) * 1994-04-15 1998-08-18 International Business Machines Corporation Method and system for selectable consistency level maintenance in a resilent database system
JPH08191463A (ja) * 1994-11-11 1996-07-23 Nintendo Co Ltd 立体画像表示装置およびそれに用いられる記憶装置
DE69614009T2 (de) * 1995-01-24 2001-11-15 Compaq Computer Corp Ferndatenbankverdopplungsvorrichtung mit Unterstützung zur Datenbankvervielfältigung für Online-DDL-Operationen
US5799322A (en) * 1995-01-24 1998-08-25 Tandem Computer, Inc. System and method for stopping updates at a specified timestamp in a remote duplicate database facility
US5919247A (en) * 1996-07-24 1999-07-06 Marimba, Inc. Method for the distribution of code and data updates
US6049809A (en) 1996-10-30 2000-04-11 Microsoft Corporation Replication optimization system and method
JPH10161916A (ja) 1996-11-28 1998-06-19 Hitachi Ltd データベースの複製に伴う更新競合の検出方法
AU6669198A (en) * 1997-02-28 1998-09-18 Siebel Systems, Inc. Partially replicated distributed database with multiple levels of remote clients
US5950198A (en) * 1997-03-24 1999-09-07 Novell, Inc. Processes and apparatuses for generating file correspondency through replication and synchronization between target and source computers
US5864851A (en) * 1997-04-14 1999-01-26 Lucent Technologies Inc. Method and system for managing replicated data with enhanced consistency and concurrency
GB2327781A (en) 1997-07-26 1999-02-03 Ibm Data replication tracking method for a distributed data processing system
US5956714A (en) * 1997-08-13 1999-09-21 Southwestern Bell Telephone Company Queuing system using a relational database
GB2330220B (en) 1997-10-07 2002-04-10 Ibm Access control for groups of related data items
US5924096A (en) * 1997-10-15 1999-07-13 Novell, Inc. Distributed database using indexed into tags to tracks events according to type, update cache, create virtual update log on demand
JP2957551B2 (ja) * 1997-12-12 1999-10-04 株式会社リコー 分散型データベースシステムの一貫性管理方法およびコンピュータ読み取り可能な記録媒体
JP2000047916A (ja) 1998-07-29 2000-02-18 Nec Corp データベース管理システム
US6289355B1 (en) * 1998-09-16 2001-09-11 International Business Machines Corp. Fast log apply
JP3578385B2 (ja) 1998-10-22 2004-10-20 インターナショナル・ビジネス・マシーンズ・コーポレーション コンピュータ、及びレプリカ同一性保持方法
US6243715B1 (en) * 1998-11-09 2001-06-05 Lucent Technologies Inc. Replicated database synchronization method whereby primary database is selected queries to secondary databases are referred to primary database, primary database is updated, then secondary databases are updated
JP2000222268A (ja) * 1999-01-29 2000-08-11 Hitachi Ltd 複数のコンピュータ間におけるファイルの同期方法
US6728713B1 (en) * 1999-03-30 2004-04-27 Tivo, Inc. Distributed database management system
JP3763992B2 (ja) * 1999-03-30 2006-04-05 富士通株式会社 データ処理装置及び記録媒体
US6480858B1 (en) * 1999-06-30 2002-11-12 Microsoft Corporation Method and apparatus for finding nearest logical record in a hash table
US6502095B2 (en) * 1999-09-09 2002-12-31 Lucent Technologies Inc. Timestamp-based system and method for serializing lazy updates in a distributed database
US6438558B1 (en) * 1999-12-23 2002-08-20 Ncr Corporation Replicating updates in original temporal order in parallel processing database systems

Also Published As

Publication number Publication date
HK1062061A1 (en) 2004-10-15
AU1284302A (en) 2002-04-22
EP1332444A1 (en) 2003-08-06
JP2004511854A (ja) 2004-04-15
CN100533437C (zh) 2009-08-26
CA2436517A1 (en) 2002-04-18
CN1619544A (zh) 2005-05-25
JP2006202337A (ja) 2006-08-03
CN100437569C (zh) 2008-11-26
EP1845460A3 (en) 2007-12-26
AU2002212843B2 (en) 2007-11-22
CN1468404A (zh) 2004-01-14
IL155217A (en) 2009-09-22
EP1332444A4 (en) 2005-10-12
IL155217A0 (en) 2003-11-23
JP2008176813A (ja) 2008-07-31
US20110179091A1 (en) 2011-07-21
CN1292370C (zh) 2006-12-27
US8818939B2 (en) 2014-08-26
ES2395205T3 (es) 2013-02-11
WO2002031696A1 (en) 2002-04-18
CN1841368A (zh) 2006-10-04
CA2436517C (en) 2011-09-20
JP2006202338A (ja) 2006-08-03
EP1845460A2 (en) 2007-10-17
US7930271B2 (en) 2011-04-19
CN100345143C (zh) 2007-10-24
US20040059738A1 (en) 2004-03-25
EP2264617A1 (en) 2010-12-22
EP2264617B1 (en) 2012-08-22
CN1619545A (zh) 2005-05-25
JP4427586B2 (ja) 2010-03-10

Similar Documents

Publication Publication Date Title
US8818939B2 (en) Method and apparatus for data processing
AU2002212843A1 (en) Method and apparatus for data processing
US5761678A (en) Creation of clone storage area with identification of base storage area and deferred cloning of metadata
US5175849A (en) Capturing data of a database system
US5481722A (en) Method and apparatus for merging change control delta structure files of a source module from a parent and a child development environment
US6834275B2 (en) Transaction processing system using efficient file update processing and recovery processing
US5890153A (en) Database lock control method
US20020198899A1 (en) Method and system of database management for replica database
JP2007122302A (ja) 情報検索システムとインデクス管理方法およびプログラム
JPWO2005086003A1 (ja) データベース・システム
US20050125458A1 (en) Chronological data record access
JPH06139120A (ja) ファイルの更新方式
US6895487B2 (en) Methods for intra-partition parallelism for inserts
US7505979B2 (en) Database accelerator
AU2007231648B2 (en) Method and apparatus for data processing
NZ537170A (en) Method and apparatus for data processing
NZ546247A (en) Method and apparatus for replicating a database
NZ546248A (en) Method and apparatus for replicating a database
GB2328531A (en) Storing a long record in a set of shorter keyed records
JP2002032251A (ja) データ処理システム
JPH09305449A (ja) データベース管理システム
Chong et al. Rapid Recovery of Very Large Memory Resident Data Objects
JPH0212438A (ja) Ｈｅａｐファイル方式