JP7672224B2 - システムにおけるガベージ・コレクション処理中の失敗からのリカバリのための方法、システムにおけるガベージ・コレクション処理中の失敗からのリカバリのためのコンピュータ・プログラム、および装置 - Google Patents

システムにおけるガベージ・コレクション処理中の失敗からのリカバリのための方法、システムにおけるガベージ・コレクション処理中の失敗からのリカバリのためのコンピュータ・プログラム、および装置 Download PDF

Info

Publication number
JP7672224B2
JP7672224B2 JP2020543361A JP2020543361A JP7672224B2 JP 7672224 B2 JP7672224 B2 JP 7672224B2 JP 2020543361 A JP2020543361 A JP 2020543361A JP 2020543361 A JP2020543361 A JP 2020543361A JP 7672224 B2 JP7672224 B2 JP 7672224B2
Authority
JP
Japan
Prior art keywords
key
log
garbage collection
slot
update
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020543361A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021515301A5 (enExample
JP2021515301A (ja
Inventor
グプタ、アーユッシュ
セシャドリ、サンゲサ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of JP2021515301A publication Critical patent/JP2021515301A/ja
Publication of JP2021515301A5 publication Critical patent/JP2021515301A5/ja
Application granted granted Critical
Publication of JP7672224B2 publication Critical patent/JP7672224B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2358—Change logging, detection, and notification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793—Remedial or corrective actions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/073—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a memory management context, e.g. virtual memory or cache management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0766—Error or fault reporting or storing
    • G06F11/0778—Dumping, i.e. gathering error/state information after a fault for later diagnosis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1471—Error detection or correction of the data by redundancy in operations involving logging of persistent data for recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operations
    • G06F11/1474—Error detection or correction of the data by redundancy in operations in transactions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Debugging And Monitoring (AREA)
  • Retry When Errors Occur (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2020543361A 2018-02-23 2019-02-19 システムにおけるガベージ・コレクション処理中の失敗からのリカバリのための方法、システムにおけるガベージ・コレクション処理中の失敗からのリカバリのためのコンピュータ・プログラム、および装置 Active JP7672224B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/904,180 US10642680B2 (en) 2018-02-23 2018-02-23 Chronologically ordered log-structured key-value store from failures during garbage collection
US15/904,180 2018-02-23
PCT/IB2019/051323 WO2019162828A1 (en) 2018-02-23 2019-02-19 A chronologically ordered log-structured key-value store from failures during garbage collection

Publications (3)

Publication Number Publication Date
JP2021515301A JP2021515301A (ja) 2021-06-17
JP2021515301A5 JP2021515301A5 (enExample) 2024-11-01
JP7672224B2 true JP7672224B2 (ja) 2025-05-07

Family

ID=67685967

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020543361A Active JP7672224B2 (ja) 2018-02-23 2019-02-19 システムにおけるガベージ・コレクション処理中の失敗からのリカバリのための方法、システムにおけるガベージ・コレクション処理中の失敗からのリカバリのためのコンピュータ・プログラム、および装置

Country Status (6)

Country Link
US (2) US10642680B2 (enExample)
JP (1) JP7672224B2 (enExample)
CN (1) CN111656331B (enExample)
DE (1) DE112019000401B4 (enExample)
GB (1) GB2583884B (enExample)
WO (1) WO2019162828A1 (enExample)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10642680B2 (en) * 2018-02-23 2020-05-05 International Business Machines Corporation Chronologically ordered log-structured key-value store from failures during garbage collection

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140136575A1 (en) 2012-11-10 2014-05-15 Yuanyuan Zhao Log-structured garbage collection
US20160246830A1 (en) 2015-02-23 2016-08-25 International Business Machines Corporation Managing data in storage according to a log structure
US20170068599A1 (en) 2015-09-07 2017-03-09 International Business Machines Corporation Efficient index checkpointing in log-structured object stores
US20190266081A1 (en) 2018-02-23 2019-08-29 International Business Machines Corporation Chronologically ordered out-of-place update key-value storage system

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5996054A (en) 1996-09-12 1999-11-30 Veritas Software Corp. Efficient virtualized mapping space for log device data storage system
US7200623B2 (en) 1998-11-24 2007-04-03 Oracle International Corp. Methods to perform disk writes in a distributed shared disk system needing consistency across failures
US9239763B2 (en) * 2012-09-28 2016-01-19 Oracle International Corporation Container database
US6728738B2 (en) * 2002-04-03 2004-04-27 Sun Microsystems, Inc. Fast lifetime analysis of objects in a garbage-collected system
US7058670B2 (en) * 2002-12-20 2006-06-06 Sun Microsystems, Inc. Scalable, space-efficient, parallel remembered-sets
US7984180B2 (en) 2005-10-20 2011-07-19 Solarflare Communications, Inc. Hashing algorithm for network receive filtering
US7555619B2 (en) * 2005-12-07 2009-06-30 Microsoft Corporation Efficient per-object operations in software transactional memory
US20090210429A1 (en) 2008-02-19 2009-08-20 Yahoo! Inc. System and method for asynchronous update of indexes in a distributed database
US20100332240A1 (en) 2009-06-24 2010-12-30 Microsoft Corporation Decentralized account digest using signed electronic receipts
US9003159B2 (en) 2009-10-05 2015-04-07 Marvell World Trade Ltd. Data caching in non-volatile memory
US8412689B2 (en) 2010-07-07 2013-04-02 Microsoft Corporation Shared log-structured multi-version transactional datastore with metadata to enable melding trees
US10558705B2 (en) 2010-10-20 2020-02-11 Microsoft Technology Licensing, Llc Low RAM space, high-throughput persistent key-value store using secondary memory
US8805984B2 (en) 2011-07-14 2014-08-12 Red Hat, Inc. Multi-operational transactional access of in-memory data grids in a client-server environment
JP2013033345A (ja) 2011-08-01 2013-02-14 Internatl Business Mach Corp <Ibm> トランザクション処理システム、方法及びプログラム
GB2511222A (en) 2011-09-30 2014-08-27 Ibm Transaction processing system, method and program
US8949190B2 (en) * 2011-11-07 2015-02-03 Sap Se Point-in-time database recovery using log holes
CN103164345B (zh) 2011-12-08 2016-04-27 光宝科技股份有限公司 固态存储装置遭遇断电后的数据存储方法
US9021421B1 (en) 2012-05-07 2015-04-28 Google Inc. Read and write barriers for flexible and efficient garbage collection
US9400816B1 (en) 2013-02-28 2016-07-26 Google Inc. System for indexing collections of structured objects that provides strong multiversioning semantics
US9092238B2 (en) 2013-03-15 2015-07-28 Joyent, Inc. Versioning schemes for compute-centric object stores
US9519575B2 (en) 2013-04-25 2016-12-13 Sandisk Technologies Llc Conditional iteration for a non-volatile device
US8683262B1 (en) 2013-06-21 2014-03-25 Terracotta Inc. Systems and/or methods for rapid recovery from write-ahead logs
US9223843B1 (en) 2013-12-02 2015-12-29 Amazon Technologies, Inc. Optimized log storage for asynchronous log updates
US9268653B2 (en) 2014-01-17 2016-02-23 Netapp, Inc. Extent metadata update logging and checkpointing
US9697267B2 (en) 2014-04-03 2017-07-04 Sandisk Technologies Llc Methods and systems for performing efficient snapshots in tiered data structures
CN104063635B (zh) 2014-07-02 2017-09-29 北京深思数盾科技股份有限公司 目标文件的保护方法及保护系统
US10242027B2 (en) 2014-08-15 2019-03-26 Hewlett-Packard Development Company, L.P. Three phase commit for a distributed file system
US9928264B2 (en) 2014-10-19 2018-03-27 Microsoft Technology Licensing, Llc High performance transactions in database management systems
CN105677297B (zh) 2014-11-18 2018-05-04 龙芯中科技术有限公司 套锁实现方法及装置
CN107038131A (zh) 2016-02-04 2017-08-11 广明光电股份有限公司 固态硬盘断电保护装置及方法
CN107203552B (zh) 2016-03-17 2021-12-28 阿里巴巴集团控股有限公司 垃圾回收方法及装置
US10552404B2 (en) 2016-09-29 2020-02-04 International Business Machines Corporation Retrospective snapshots in log-structured storage systems
US10795779B2 (en) 2017-02-17 2020-10-06 Sap Se Asynchronous garbage collection in database redo log replay
US11210211B2 (en) 2017-08-21 2021-12-28 Western Digital Technologies, Inc. Key data store garbage collection and multipart object management
US10635523B2 (en) * 2018-02-23 2020-04-28 International Business Machines Corporation Fast recovery from failures in a chronologically ordered log-structured key-value storage system
US10642680B2 (en) * 2018-02-23 2020-05-05 International Business Machines Corporation Chronologically ordered log-structured key-value store from failures during garbage collection

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140136575A1 (en) 2012-11-10 2014-05-15 Yuanyuan Zhao Log-structured garbage collection
US20160246830A1 (en) 2015-02-23 2016-08-25 International Business Machines Corporation Managing data in storage according to a log structure
JP2018509695A (ja) 2015-02-23 2018-04-05 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ ストレージ中のデータを管理するためのコンピュータ・プログラム、システム、および方法
US20170068599A1 (en) 2015-09-07 2017-03-09 International Business Machines Corporation Efficient index checkpointing in log-structured object stores
US20190266081A1 (en) 2018-02-23 2019-08-29 International Business Machines Corporation Chronologically ordered out-of-place update key-value storage system
JP2021515299A (ja) 2018-02-23 2021-06-17 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ 時系列順のアウトオブプレース更新のためのシステム、時系列順のアウトオブプレース更新のための方法、および時系列順のアウトオブプレース更新のためのコンピュータ・プログラム

Also Published As

Publication number Publication date
CN111656331A (zh) 2020-09-11
DE112019000401B4 (de) 2022-01-05
US20200183775A1 (en) 2020-06-11
US11163636B2 (en) 2021-11-02
US20190266043A1 (en) 2019-08-29
WO2019162828A1 (en) 2019-08-29
GB202013416D0 (en) 2020-10-14
US10642680B2 (en) 2020-05-05
CN111656331B (zh) 2024-03-29
JP2021515301A (ja) 2021-06-17
GB2583884A (en) 2020-11-11
GB2583884B (en) 2021-03-24
DE112019000401T5 (de) 2020-10-22

Similar Documents

Publication Publication Date Title
US9122642B2 (en) Hybrid data backup in a networked computing environment
US10083092B2 (en) Block level backup of virtual machines for file name level based file search and restoration
CN111801661A (zh) 多主机分布式数据管理系统中的事务操作
US10140054B2 (en) Retrospective snapshots in log structured storage systems
JP7816877B2 (ja) クラスタ化されたコンピューティング環境内の処理を容易にするためのコンピュータプログラム、コンピュータシステムおよびコンピュータ実装方法（クラスタ化されたコンピューティング環境にわたるリソースロック所有権の識別）
US11150981B2 (en) Fast recovery from failures in a chronologically ordered log-structured key-value storage system
JP7228321B2 (ja) 時系列順のアウトオブプレース更新のためのシステム、時系列順のアウトオブプレース更新のための方法、および時系列順のアウトオブプレース更新のためのコンピュータ・プログラム
US10552404B2 (en) Retrospective snapshots in log-structured storage systems
US9904600B2 (en) Generating initial copy in replication initialization
JP7672224B2 (ja) システムにおけるガベージ・コレクション処理中の失敗からのリカバリのための方法、システムにおけるガベージ・コレクション処理中の失敗からのリカバリのためのコンピュータ・プログラム、および装置
US10318509B2 (en) Populating text indexes
JP2021515301A5 (enExample)
US10303782B1 (en) Method to allow multi-read access for exclusive access of virtual disks by using a virtualized copy of the disk
US20220391353A1 (en) Deduplicating data integrity checks across systems
US20200110819A1 (en) Low cost fast recovery index in storage class memory

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210413

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210721

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20220502

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220630

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220705

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20221004

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221004

RD12 Notification of acceptance of power of sub attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7432

Effective date: 20221004

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20221005

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230126

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230418

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230802

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231127

RD12 Notification of acceptance of power of sub attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7432

Effective date: 20231127

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20231127

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20231219

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20240222

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20241015

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250203

RD14 Notification of resignation of power of sub attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7434

Effective date: 20250414

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250422

R150 Certificate of patent or registration of utility model

Ref document number: 7672224

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150