WO2023277819A3 - 数据处理方法、系统、设备、计算机程序产品及存储功能 - Google Patents

数据处理方法、系统、设备、计算机程序产品及存储功能 Download PDF

Info

Publication number
WO2023277819A3
WO2023277819A3 PCT/SG2022/050457 SG2022050457W WO2023277819A3 WO 2023277819 A3 WO2023277819 A3 WO 2023277819A3 SG 2022050457 W SG2022050457 W SG 2022050457W WO 2023277819 A3 WO2023277819 A3 WO 2023277819A3
Authority
WO
WIPO (PCT)
Prior art keywords
time
data
page
sequence identifier
data page
Prior art date
Application number
PCT/SG2022/050457
Other languages
English (en)
French (fr)
Other versions
WO2023277819A2 (zh
WO2023277819A9 (zh
Inventor
庄泽超
Original Assignee
阿里巴巴新加坡控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴新加坡控股有限公司 filed Critical 阿里巴巴新加坡控股有限公司
Publication of WO2023277819A2 publication Critical patent/WO2023277819A2/zh
Publication of WO2023277819A3 publication Critical patent/WO2023277819A3/zh
Publication of WO2023277819A9 publication Critical patent/WO2023277819A9/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2474—Sequence data queries, e.g. querying versioned data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • Fuzzy Systems (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本申请实施例提供一种数据处理方法、数据库系统及电子设备。其中，所述方法包括：数据页不满足写入磁盘的条件时，生成一复制页；其中，所述复制页包含有：所述数据页的第一时间修改对应日志的第一序列标识、所述数据页的第二时间修改对应日志的第二序列标识、所述数据页经所述第一时间至所述第二时间期间的多次修改后的数据信息；所述第一时间早于所述第二时间；所述复制页满足写入磁盘的条件，执行将所述磁盘中所述数据页对应的所述第一序列标识更新为所述第二序列标识的操作。本申请实施例提供的方案，可推进读写节点将数据页写入磁盘（即落盘）的进度，相应的，只读节点也可尽快删除内存中堆积的日志，使其具有接收新日志的能力。
PCT/SG2022/050457 2021-07-02 2022-06-30 数据处理方法、系统、设备、计算机程序产品及存储功能 WO2023277819A2 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110751374.7A CN113590596A (zh) 2021-07-02 2021-07-02 数据处理方法、系统、设备、计算机程序产品及存储介质
CN202110751374.7 2021-07-02

Publications (3)

Publication Number Publication Date
WO2023277819A2 WO2023277819A2 (zh) 2023-01-05
WO2023277819A3 true WO2023277819A3 (zh) 2023-04-20
WO2023277819A9 WO2023277819A9 (zh) 2023-05-25

Family

ID=78245778

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2022/050457 WO2023277819A2 (zh) 2021-07-02 2022-06-30 数据处理方法、系统、设备、计算机程序产品及存储功能

Country Status (2)

Country Link
CN (1) CN113590596A (zh)
WO (1) WO2023277819A2 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116010430B (zh) * 2023-03-24 2023-06-20 杭州趣链科技有限公司 数据恢复方法、数据库系统、计算机设备和存储介质
CN116501736A (zh) * 2023-04-12 2023-07-28 北京优炫软件股份有限公司 一种数据库延迟回放的控制方法以及控制系统
CN117555884B (zh) * 2024-01-12 2024-04-26 腾讯科技（深圳）有限公司 数据页的读取方法、装置、设备及可读存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109313637A (zh) * 2016-06-09 2019-02-05 万事达卡国际公司 用于监视服务器系统的改变的方法和系统
CN112182010A (zh) * 2020-11-30 2021-01-05 北京金山云网络技术有限公司 脏页刷新方法和装置、存储介质和电子设备
CN112506941A (zh) * 2021-02-03 2021-03-16 北京金山云网络技术有限公司 核查点的处理方法和装置、电子设备和存储介质
US20210089556A1 (en) * 2019-09-24 2021-03-25 Salesforce.Com, Inc. Asynchronous row to object enrichment of database change streams
CN112835528A (zh) * 2021-02-22 2021-05-25 北京金山云网络技术有限公司 脏页刷新方法和装置、电子设备和存储介质

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109313637A (zh) * 2016-06-09 2019-02-05 万事达卡国际公司 用于监视服务器系统的改变的方法和系统
US20210089556A1 (en) * 2019-09-24 2021-03-25 Salesforce.Com, Inc. Asynchronous row to object enrichment of database change streams
CN112182010A (zh) * 2020-11-30 2021-01-05 北京金山云网络技术有限公司 脏页刷新方法和装置、存储介质和电子设备
CN112506941A (zh) * 2021-02-03 2021-03-16 北京金山云网络技术有限公司 核查点的处理方法和装置、电子设备和存储介质
CN112835528A (zh) * 2021-02-22 2021-05-25 北京金山云网络技术有限公司 脏页刷新方法和装置、电子设备和存储介质

Also Published As

Publication number Publication date
CN113590596A (zh) 2021-11-02
WO2023277819A2 (zh) 2023-01-05
WO2023277819A9 (zh) 2023-05-25

Similar Documents

Publication Publication Date Title
WO2023277819A3 (zh) 数据处理方法、系统、设备、计算机程序产品及存储功能
CN100386736C (zh) 用于数据库的事务一致变化的跟踪的方法和系统
EP2168042B1 (en) Execution of point-in-time copy operations in continuous mirroring environments
CN105224237A (zh) 一种数据存储方法及装置
US11567681B2 (en) Method and system for synchronizing requests related to key-value storage having different portions
CN109471851B (zh) 数据处理方法、装置、服务器和存储介质
CN107391544B (zh) 列式存储数据的处理方法、装置、设备及计算机储存介质
CN102508913A (zh) 一种带有数据立方存储索引结构的云计算系统
CN105373541A (zh) 数据库的数据操作请求的处理方法和系统
EP3438845A1 (en) Data updating method and device for a distributed database system
US9031909B2 (en) Provisioning and/or synchronizing using common metadata
CN111414362A (zh) 数据读取方法、装置、设备及存储介质
CN110019063B (zh) 计算节点数据容灾回放的方法、终端设备及存储介质
US11748357B2 (en) Method and system for searching a key-value storage
CN103841168A (zh) 数据副本更新方法及元数据服务器
US11003540B2 (en) Method, server, and computer readable medium for index recovery using index redo log
CN102495838B (zh) 数据处理方法及装置
US8768988B2 (en) Accessing snapshots of a time based file system
CN113918535A (zh) 一种数据读取方法、装置、设备及存储介质
CN109343985A (zh) 一种数据处理方法、装置及存储介质
CN111026764B (zh) 一种数据存储方法、装置、电子产品及存储介质
CN103177085A (zh) 一种检查点操作方法及装置
CN107491363A (zh) 一种基于Linux内核的存储卷的快照方法及装置
CN114595096A (zh) 数据库热备份的方法、装置、电子设备及存储介质
CN111858480A (zh) 一种数据处理方法、装置及计算机存储介质

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE