CA2439923C - System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic - Google Patents

System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic Download PDF

Info

Publication number
CA2439923C
CA2439923C CA2439923A CA2439923A CA2439923C CA 2439923 C CA2439923 C CA 2439923C CA 2439923 A CA2439923 A CA 2439923A CA 2439923 A CA2439923 A CA 2439923A CA 2439923 C CA2439923 C CA 2439923C
Authority
CA
Canada
Prior art keywords
data
database
log
computer
processors
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
CA2439923A
Other languages
English (en)
French (fr)
Other versions
CA2439923A1 (en
Inventor
David Reed
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CA2439923A1 publication Critical patent/CA2439923A1/en
Application granted granted Critical
Publication of CA2439923C publication Critical patent/CA2439923C/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2308—Concurrency control
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2358—Change logging, detection, and notification
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99951—File or database maintenance
    • Y10S707/99952—Coherency, e.g. same view to multiple users
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99951—File or database maintenance
    • Y10S707/99952—Coherency, e.g. same view to multiple users
    • Y10S707/99953—Recoverability

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CA2439923A 2001-03-09 2002-02-25 System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic Expired - Lifetime CA2439923C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/804,672 US6832229B2 (en) 2001-03-09 2001-03-09 System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic
US09/804,672 2001-03-09
PCT/US2002/005935 WO2002073465A2 (en) 2001-03-09 2002-02-25 System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic

Publications (2)

Publication Number Publication Date
CA2439923A1 CA2439923A1 (en) 2002-09-19
CA2439923C true CA2439923C (en) 2012-02-21

Family

ID=25189538

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2439923A Expired - Lifetime CA2439923C (en) 2001-03-09 2002-02-25 System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic

Country Status (7)

Country Link
US (1) US6832229B2 (enExample)
EP (1) EP1368753A2 (enExample)
JP (1) JP4414139B2 (enExample)
CN (1) CN1535434B (enExample)
AU (1) AU2002242282B2 (enExample)
CA (1) CA2439923C (enExample)
WO (1) WO2002073465A2 (enExample)

Families Citing this family (82)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9659292B1 (en) * 2001-08-30 2017-05-23 EMC IP Holding Company LLC Storage-based replication of e-commerce transactions in real time
US7249118B2 (en) * 2002-05-17 2007-07-24 Aleri, Inc. Database system and methods
US9569797B1 (en) 2002-05-30 2017-02-14 Consumerinfo.Com, Inc. Systems and methods of presenting simulated credit score information
US7028153B1 (en) * 2002-06-19 2006-04-11 Veritas Operating Corporation Backup and retrieval of data storage using catalog data
US6976022B2 (en) * 2002-09-16 2005-12-13 Oracle International Corporation Method and mechanism for batch processing transaction logging records
US6981004B2 (en) * 2002-09-16 2005-12-27 Oracle International Corporation Method and mechanism for implementing in-memory transaction logging records
CN1295613C (zh) * 2002-10-24 2007-01-17 华为技术有限公司 通用Windows程序运行日志信息记录方法
US7003532B2 (en) * 2002-11-27 2006-02-21 Microsoft Corporation System and method for scaleable multiplexed transactional log recovery
JP4327481B2 (ja) * 2003-03-17 2009-09-09 株式会社日立製作所 データベースシステム、サーバ、問い合わせ投入方法及びデータ更新方法
US20040225689A1 (en) * 2003-05-08 2004-11-11 International Business Machines Corporation Autonomic logging support
US20050096774A1 (en) * 2003-10-31 2005-05-05 Bayoumi Deia S. System and method for integrating transactional and real-time manufacturing data
US7627619B1 (en) * 2003-12-29 2009-12-01 Emc Corporation Data verification following database write
US20050192922A1 (en) * 2004-02-27 2005-09-01 Edlund Stefan B. Client-server computing system capable of validating cached data based on data transformation
US7143625B2 (en) * 2004-04-16 2006-12-05 Boston Scientific Scimed, Inc. Stent crimper
US8732004B1 (en) 2004-09-22 2014-05-20 Experian Information Solutions, Inc. Automated analysis of data to generate prospect notifications based on trigger events
US7702698B1 (en) * 2005-03-01 2010-04-20 Yahoo! Inc. Database replication across different database platforms
US9110712B2 (en) * 2005-06-10 2015-08-18 International Business Machines Corporation Method for encapsulating logical units of work using business objects
CN100449543C (zh) * 2005-09-16 2009-01-07 腾讯科技（深圳）有限公司 一种日志保存方法及装置
US7908243B2 (en) * 2005-11-25 2011-03-15 Oracle International Corporation Considering transient data also in reports generated based on data eventually stored in a data-warehouse
US7613752B2 (en) * 2005-11-28 2009-11-03 Commvault Systems, Inc. Systems and methods for using metadata to enhance data management operations
US20200257596A1 (en) 2005-12-19 2020-08-13 Commvault Systems, Inc. Systems and methods of unified reconstruction in storage systems
US20070174360A1 (en) * 2006-01-11 2007-07-26 Yuichi Yagawa Storage system embedding database
US7711636B2 (en) 2006-03-10 2010-05-04 Experian Information Solutions, Inc. Systems and methods for analyzing data
US7668878B2 (en) * 2006-07-31 2010-02-23 Oracle International Corporation Replicating data between heterogeneous data systems
US7792853B2 (en) * 2006-11-08 2010-09-07 Ragothaman Subbian Presenting data flow in legacy program
US9449047B2 (en) 2007-06-19 2016-09-20 Sybase, Inc. Dynamic modification of schemas in streaming databases
US8745012B2 (en) 2007-08-10 2014-06-03 Sybase, Inc. Log-structured store for streaming data
US9690820B1 (en) * 2007-09-27 2017-06-27 Experian Information Solutions, Inc. Database system for triggering event notifications based on updates to database records
US8549064B2 (en) * 2008-08-12 2013-10-01 Hewlett-Packard Development Company, L.P. System and method for data management
US20100174638A1 (en) 2009-01-06 2010-07-08 ConsumerInfo.com Report existence monitoring
CN102402716B (zh) * 2010-09-15 2014-05-21 香港理工大学 智能生产决策支持系统
US9558519B1 (en) 2011-04-29 2017-01-31 Consumerinfo.Com, Inc. Exposing reporting cycle information
US8930330B1 (en) 2011-06-27 2015-01-06 Amazon Technologies, Inc. Validation of log formats
US9229949B2 (en) 2011-10-07 2016-01-05 Microsoft Technology Licensing, Llc Extensible and generic framework for managing resources for data warehousing loads
US20130151398A1 (en) * 2011-12-09 2013-06-13 Dun & Bradstreet Business Information Solutions, Ltd. Portfolio risk manager
US8825664B2 (en) 2012-08-17 2014-09-02 Splunk Inc. Indexing preview
US9514007B2 (en) 2013-03-15 2016-12-06 Amazon Technologies, Inc. Database system with database engine and separate distributed storage service
US9501501B2 (en) 2013-03-15 2016-11-22 Amazon Technologies, Inc. Log record management
US10180951B2 (en) 2013-03-15 2019-01-15 Amazon Technologies, Inc. Place snapshots
US11030055B2 (en) 2013-03-15 2021-06-08 Amazon Technologies, Inc. Fast crash recovery for distributed database systems
US9672237B2 (en) 2013-03-15 2017-06-06 Amazon Technologies, Inc. System-wide checkpoint avoidance for distributed database systems
US10747746B2 (en) 2013-04-30 2020-08-18 Amazon Technologies, Inc. Efficient read replicas
US9317213B1 (en) 2013-05-10 2016-04-19 Amazon Technologies, Inc. Efficient storage of variably-sized data objects in a data store
US9760596B2 (en) 2013-05-13 2017-09-12 Amazon Technologies, Inc. Transaction ordering
US9208032B1 (en) 2013-05-15 2015-12-08 Amazon Technologies, Inc. Managing contingency capacity of pooled resources in multiple availability zones
US10303564B1 (en) 2013-05-23 2019-05-28 Amazon Technologies, Inc. Reduced transaction I/O for log-structured storage systems
US9305056B1 (en) 2013-05-24 2016-04-05 Amazon Technologies, Inc. Results cache invalidation
US9047189B1 (en) 2013-05-28 2015-06-02 Amazon Technologies, Inc. Self-describing data blocks of a minimum atomic write size for a data store
US9280591B1 (en) 2013-09-20 2016-03-08 Amazon Technologies, Inc. Efficient replication of system transactions for read-only nodes of a distributed database
US10216949B1 (en) 2013-09-20 2019-02-26 Amazon Technologies, Inc. Dynamic quorum membership changes
US9519664B1 (en) 2013-09-20 2016-12-13 Amazon Technologies, Inc. Index structure navigation using page versions for read-only nodes
US9460008B1 (en) 2013-09-20 2016-10-04 Amazon Technologies, Inc. Efficient garbage collection for a log-structured data store
US9507843B1 (en) 2013-09-20 2016-11-29 Amazon Technologies, Inc. Efficient replication of distributed storage changes for read-only nodes of a distributed database
US9699017B1 (en) 2013-09-25 2017-07-04 Amazon Technologies, Inc. Dynamic utilization of bandwidth for a quorum-based distributed storage system
US10223184B1 (en) 2013-09-25 2019-03-05 Amazon Technologies, Inc. Individual write quorums for a log-structured distributed storage system
US9552242B1 (en) 2013-09-25 2017-01-24 Amazon Technologies, Inc. Log-structured distributed storage using a single log sequence number space
US10387399B1 (en) 2013-11-01 2019-08-20 Amazon Technologies, Inc. Efficient database journaling using non-volatile system memory
US9760480B1 (en) 2013-11-01 2017-09-12 Amazon Technologies, Inc. Enhanced logging using non-volatile system memory
US9880933B1 (en) 2013-11-20 2018-01-30 Amazon Technologies, Inc. Distributed in-memory buffer cache system using buffer cache nodes
US9223843B1 (en) 2013-12-02 2015-12-29 Amazon Technologies, Inc. Optimized log storage for asynchronous log updates
US10133996B2 (en) * 2014-04-22 2018-11-20 International Business Machines Corporation Object lifecycle analysis tool
US10303663B1 (en) 2014-06-12 2019-05-28 Amazon Technologies, Inc. Remote durable logging for journaling file systems
WO2016183546A1 (en) 2015-05-14 2016-11-17 Walleye Software, LLC Computer data system current row position query language construct
US11410230B1 (en) 2015-11-17 2022-08-09 Consumerinfo.Com, Inc. Realtime access and control of secure regulated data
US10757154B1 (en) 2015-11-24 2020-08-25 Experian Information Solutions, Inc. Real-time event-based notification system
US10540516B2 (en) 2016-10-13 2020-01-21 Commvault Systems, Inc. Data protection within an unsecured storage environment
US10241965B1 (en) 2017-08-24 2019-03-26 Deephaven Data Labs Llc Computer data distribution architecture connecting an update propagation graph through multiple remote query processors
EP3483237A1 (de) 2017-11-10 2019-05-15 Evonik Degussa GmbH Verfahren zur extraktion von fettsäuren aus triglyceridölen
US11914571B1 (en) 2017-11-22 2024-02-27 Amazon Technologies, Inc. Optimistic concurrency for a multi-writer database
US20190251204A1 (en) 2018-02-14 2019-08-15 Commvault Systems, Inc. Targeted search of backup data using calendar event data
US20200074100A1 (en) 2018-09-05 2020-03-05 Consumerinfo.Com, Inc. Estimating changes to user risk indicators based on modeling of similarly categorized users
KR102119258B1 (ko) 2018-11-14 2020-06-05 주식회사 실크로드소프트 데이터베이스 관리 시스템에서의 변경 데이터 캡쳐 구현 기법
KR20200056357A (ko) 2020-03-17 2020-05-22 주식회사 실크로드소프트 데이터베이스 관리 시스템에서의 변경 데이터 캡쳐 구현 기법
US11341163B1 (en) 2020-03-30 2022-05-24 Amazon Technologies, Inc. Multi-level replication filtering for a distributed database
US12061606B1 (en) 2020-04-13 2024-08-13 State Farm Mutual Automobile Insurance Company Tracking and reporting changes in data records
CN112286892B (zh) * 2020-07-01 2024-04-05 上海柯林布瑞信息技术有限公司 后关系型数据库的数据实时同步方法及装置、存储介质、终端
US11556535B2 (en) 2020-08-19 2023-01-17 Palantir Technologies Inc. Low-latency database system
EP4016321A1 (en) * 2020-12-21 2022-06-22 Dassault Systèmes Creating a tree of database states
CN112559506B (zh) * 2020-12-22 2024-08-20 卫宁健康科技集团股份有限公司 健康数据处理方法、装置、处理设备及存储介质
CN113449043A (zh) * 2021-07-21 2021-09-28 中国人民解放军61932部队 数据同步方法、装置、计算机设备和存储介质
CN114186000B (zh) * 2021-12-14 2025-07-08 上海得物信息集团有限公司 一种基于Flink的业务数据监控方法、装置及存储介质
CN115587121A (zh) * 2022-10-08 2023-01-10 兴业银行股份有限公司 适用于银行业务的数据质量监测的方法和系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5592660A (en) * 1991-03-04 1997-01-07 Fujitsu Limited Database management system to alternately perform retrieval process and updating process
US5555404A (en) * 1992-03-17 1996-09-10 Telenor As Continuously available database server having multiple groups of nodes with minimum intersecting sets of database fragment replicas
US5565316A (en) * 1992-10-09 1996-10-15 Educational Testing Service System and method for computer based testing
US5544359A (en) * 1993-03-30 1996-08-06 Fujitsu Limited Apparatus and method for classifying and acquiring log data by updating and storing log data
WO1996034350A1 (en) * 1995-04-24 1996-10-31 Aspect Development, Inc. Modeling of object-oriented database structures, translation to relational database structures, and dynamic searches thereon
US5970502A (en) * 1996-04-23 1999-10-19 Nortel Networks Corporation Method and apparatus for synchronizing multiple copies of a database
US5903898A (en) * 1996-06-04 1999-05-11 Oracle Corporation Method and apparatus for user selectable logging
US5907848A (en) * 1997-03-14 1999-05-25 Lakeview Technology, Inc. Method and system for defining transactions from a database log
CA2243780A1 (en) * 1997-07-30 1999-01-30 Knowledge Modeling Institute Inc. Apparatus for automatically applying and preparing software and recording medium for preparing software
US6484149B1 (en) * 1997-10-10 2002-11-19 Microsoft Corporation Systems and methods for viewing product information, and methods for generating web pages
US5991772A (en) * 1997-10-31 1999-11-23 Oracle Corporation Method and apparatus for restoring a portion of a database
US6480850B1 (en) * 1998-10-02 2002-11-12 Ncr Corporation System and method for managing data privacy in a database management system including a dependently connected privacy data mart
US6308168B1 (en) * 1999-02-09 2001-10-23 Knowledge Discovery One, Inc. Metadata-driven data presentation module for database system
US6446074B1 (en) * 1999-12-27 2002-09-03 Alcatel Usa Sourcing, L.P. System and method for defining, building, and maintaining database files

Also Published As

Publication number Publication date
AU2002242282B2 (en) 2007-12-20
JP4414139B2 (ja) 2010-02-10
CA2439923A1 (en) 2002-09-19
WO2002073465A3 (en) 2003-10-02
US20020128996A1 (en) 2002-09-12
CN1535434A (zh) 2004-10-06
EP1368753A2 (en) 2003-12-10
JP2005502934A (ja) 2005-01-27
CN1535434B (zh) 2016-02-10
WO2002073465A2 (en) 2002-09-19
US6832229B2 (en) 2004-12-14

Similar Documents

Publication Publication Date Title
CA2439923C (en) System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic
AU2002242282A1 (en) System and method for maintaining large-grained database concurrency with a log monitor incorporating dynamically redefinable business logic
US11809408B2 (en) Incremental refresh of a materialized view
EP3942433B1 (en) Querying over external tables in database systems
US6775681B1 (en) Evaluation of grouping sets by reduction to group-by clause, with or without a rollup operator, using temporary tables
US5564047A (en) Trigger generation in an active database management system
Santos et al. Real-time data warehouse loading methodology
US7346628B2 (en) Time in databases and applications of databases
US7015911B2 (en) Computer-implemented system and method for report generation
US6334128B1 (en) Method and apparatus for efficiently refreshing sets of summary tables and materialized views in a database management system
US8965912B2 (en) Integrating databases
US20090006148A1 (en) Apparatus and method for materializing related business intelligence data entities
US20100235334A1 (en) Time in databases and applications of databases
US7949685B2 (en) Modeling and implementing complex data access operations based on lower level traditional operations
US20090187544A1 (en) Managing a hierarchy of databases
Samtani et al. Recent advances and research problems in data warehousing
US20080162416A1 (en) Techniques for extending database date statistics
Vitt et al. Microsoft sql server 2005 analysis services performance guide
US20210248121A1 (en) Realtime data summarization and aggregation with cubes
US7418567B2 (en) Cache for an enterprise software system
Anjard The basics of database management systems (DBMS)
Reddy et al. Research issues on data warehouse maintenance
Gorobchenko et al. Selection of oracle and PostgreSQL databases according to main user criteria
Segev et al. A data analysis model for business intelligence
Santos et al. A continuous data integration methodology for supporting real-time data warehousing.

Legal Events

Date Code Title Description
EEER Examination request