SG11201606896XA - Page cache write logging at block-based storage - Google Patents
Page cache write logging at block-based storageInfo
- Publication number
- SG11201606896XA SG11201606896XA SG11201606896XA SG11201606896XA SG11201606896XA SG 11201606896X A SG11201606896X A SG 11201606896XA SG 11201606896X A SG11201606896X A SG 11201606896XA SG 11201606896X A SG11201606896X A SG 11201606896XA SG 11201606896X A SG11201606896X A SG 11201606896XA
- Authority
- SG
- Singapore
- Prior art keywords
- block
- based storage
- page cache
- cache write
- write logging
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1471—Saving, restoring, recovering or retrying involving logging of persistent data for recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3466—Performance evaluation by tracing or monitoring
- G06F11/3485—Performance evaluation by tracing or monitoring for I/O devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
- G06F12/0868—Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0804—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with main memory updating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
- G06F2201/885—Monitoring specific for caches
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/10—Providing a specific technical effect
- G06F2212/1016—Performance improvement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/10—Providing a specific technical effect
- G06F2212/1032—Reliability improvement, data loss prevention, degraded operation etc
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/31—Providing disk cache in a specific location of a storage system
- G06F2212/313—In storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/46—Caching storage objects of specific type in disk cache
- G06F2212/461—Sector or disk block
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
- Techniques For Improving Reliability Of Storages (AREA)
- Retry When Errors Occur (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/205,067 US10055352B2 (en) | 2014-03-11 | 2014-03-11 | Page cache write logging at block-based storage |
| PCT/US2015/019574 WO2015138375A2 (en) | 2014-03-11 | 2015-03-10 | Page cache write logging at block-based storage |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| SG11201606896XA true SG11201606896XA (en) | 2016-09-29 |
Family
ID=54069038
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| SG11201606896XA SG11201606896XA (en) | 2014-03-11 | 2015-03-10 | Page cache write logging at block-based storage |
Country Status (9)
| Country | Link |
|---|---|
| US (3) | US10055352B2 (ja) |
| EP (1) | EP3117325B1 (ja) |
| JP (1) | JP6437007B2 (ja) |
| KR (1) | KR101914847B1 (ja) |
| CN (2) | CN110609797B (ja) |
| AU (1) | AU2015229684B2 (ja) |
| CA (1) | CA2940246C (ja) |
| SG (1) | SG11201606896XA (ja) |
| WO (1) | WO2015138375A2 (ja) |
Families Citing this family (46)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9501418B2 (en) * | 2014-06-26 | 2016-11-22 | HGST Netherlands B.V. | Invalidation data area for cache |
| US10891264B2 (en) * | 2015-04-30 | 2021-01-12 | Vmware, Inc. | Distributed, scalable key-value store |
| US9639287B1 (en) * | 2015-06-29 | 2017-05-02 | Western Digital Technologies, Inc. | Write command reporting |
| US10489248B1 (en) | 2015-06-30 | 2019-11-26 | EMC IP Holding Company LLC | Disaster recovery in a distributed file system |
| US10649681B2 (en) * | 2016-01-25 | 2020-05-12 | Samsung Electronics Co., Ltd. | Dynamic garbage collection P/E policies for redundant storage blocks and distributed software stacks |
| JP6734536B2 (ja) * | 2016-07-29 | 2020-08-05 | 富士通株式会社 | 情報処理装置及びメモリコントローラ |
| US10445236B2 (en) * | 2016-11-14 | 2019-10-15 | Futurewei Technologies, Inc. | Method to consistently store large amounts of data at very high speed in persistent memory systems |
| US10514847B2 (en) * | 2016-12-28 | 2019-12-24 | Amazon Technologies, Inc. | Data storage system with multiple durability levels |
| US10484015B2 (en) | 2016-12-28 | 2019-11-19 | Amazon Technologies, Inc. | Data storage system with enforced fencing |
| US11301144B2 (en) | 2016-12-28 | 2022-04-12 | Amazon Technologies, Inc. | Data storage system |
| US10467143B1 (en) * | 2017-02-27 | 2019-11-05 | Amazon Technologies, Inc. | Event-driven cache |
| US11068299B1 (en) * | 2017-08-04 | 2021-07-20 | EMC IP Holding Company LLC | Managing file system metadata using persistent cache |
| US11403176B2 (en) * | 2017-09-12 | 2022-08-02 | Western Digital Technologies, Inc. | Database read cache optimization |
| US10452296B1 (en) | 2018-03-23 | 2019-10-22 | Amazon Technologies, Inc. | Accelerated volumes |
| US10908825B2 (en) * | 2018-03-29 | 2021-02-02 | Intel Corporation | SSD with persistent DRAM region for metadata |
| US10459655B1 (en) | 2018-04-30 | 2019-10-29 | Amazon Technologies, Inc. | Rapid volume backup generation from distributed replica |
| US11023157B2 (en) | 2018-04-30 | 2021-06-01 | Amazon Technologies, Inc. | Intermediary duplication to facilitate copy requests in distributed storage systems |
| US11343314B1 (en) | 2018-04-30 | 2022-05-24 | Amazon Technologies, Inc. | Stream-based logging for distributed storage systems |
| CN108959526B (zh) * | 2018-06-28 | 2021-10-15 | 郑州云海信息技术有限公司 | 日志管理方法以及日志管理装置 |
| US10976966B2 (en) * | 2018-06-29 | 2021-04-13 | Weka.IO Ltd. | Implementing coherency and page cache support in a distributed way for files |
| CN110896406A (zh) | 2018-09-13 | 2020-03-20 | 华为技术有限公司 | 数据存储方法、装置及服务器 |
| US11803468B2 (en) * | 2018-09-19 | 2023-10-31 | Seagate Technology Llc | Data storage system with write back cache |
| US10877868B2 (en) | 2018-09-21 | 2020-12-29 | Microsoft Technology Licensing, Llc | Applying a log to storage segments |
| CN110955653A (zh) * | 2018-09-26 | 2020-04-03 | 阿里巴巴集团控股有限公司 | 一种数据页面的处理方法、装置、设备及计算机系统 |
| KR102137109B1 (ko) * | 2018-11-30 | 2020-07-23 | 카페24 주식회사 | 로그 메시지의 패턴을 분류하는 방법 및 장치 |
| KR102649169B1 (ko) * | 2018-12-12 | 2024-03-20 | 에스케이하이닉스 주식회사 | 저장 장치 및 그 동작 방법 |
| US10740187B1 (en) * | 2019-01-31 | 2020-08-11 | EMC IP Holding Company LLC | Systems and methods of managing and creating snapshots in a cache-based storage system |
| CN111694703B (zh) * | 2019-03-13 | 2023-05-02 | 阿里云计算有限公司 | 缓存区管理方法、装置和计算机设备 |
| US11068192B1 (en) | 2019-03-26 | 2021-07-20 | Amazon Technologies, Inc. | Utilizing mutiple snapshot sources for creating new copy of volume in a networked environment wherein additional snapshot sources are reserved with lower performance levels than a primary snapshot source |
| US10983719B1 (en) | 2019-03-28 | 2021-04-20 | Amazon Technologies, Inc. | Replica pools to support volume replication in distributed storage systems |
| US11237730B2 (en) | 2019-05-12 | 2022-02-01 | International Business Machines Corporation | Favored cache status for selected volumes within a storage system |
| US11169919B2 (en) | 2019-05-12 | 2021-11-09 | International Business Machines Corporation | Cache preference for selected volumes within a storage system |
| US11151035B2 (en) | 2019-05-12 | 2021-10-19 | International Business Machines Corporation | Cache hit ratios for selected volumes within a storage system |
| US11163698B2 (en) | 2019-05-12 | 2021-11-02 | International Business Machines Corporation | Cache hit ratios for selected volumes using synchronous I/O |
| US11176052B2 (en) | 2019-05-12 | 2021-11-16 | International Business Machines Corporation | Variable cache status for selected volumes within a storage system |
| US11169723B2 (en) | 2019-06-28 | 2021-11-09 | Amazon Technologies, Inc. | Data storage system with metadata check-pointing |
| US10860221B1 (en) * | 2019-07-05 | 2020-12-08 | EMC IP Holding Company LLC | Page write to non-volatile data storage with failure recovery |
| CN110727608B (zh) * | 2019-09-03 | 2022-07-12 | 深圳市道通智能航空技术股份有限公司 | 一种日志数据的存储方法、电子设备及存储介质 |
| US11663144B2 (en) | 2020-01-20 | 2023-05-30 | International Business Machines Corporation | LRU list reorganization for favored and unfavored volumes |
| US11182096B1 (en) | 2020-05-18 | 2021-11-23 | Amazon Technologies, Inc. | Data storage system with configurable durability |
| US11681443B1 (en) | 2020-08-28 | 2023-06-20 | Amazon Technologies, Inc. | Durable data storage with snapshot storage space optimization |
| JP2022046887A (ja) | 2020-09-11 | 2022-03-24 | キオクシア株式会社 | 半導体記憶装置 |
| US11262918B1 (en) | 2020-09-30 | 2022-03-01 | Amazon Technologies, Inc. | Data storage system with uneven drive wear reduction |
| US11455251B2 (en) * | 2020-11-11 | 2022-09-27 | Advanced Micro Devices, Inc. | Enhanced durability for systems on chip (SOCs) |
| CN114443364B (zh) * | 2021-12-27 | 2024-07-05 | 天翼云科技有限公司 | 一种分布式块存储数据处理方法、装置、设备及存储介质 |
| CN117873405B (zh) * | 2024-03-11 | 2024-07-09 | 腾讯科技（深圳）有限公司 | 数据存储方法、装置、计算机设备和存储介质 |
Family Cites Families (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0926916A (ja) | 1995-07-12 | 1997-01-28 | Oki Electric Ind Co Ltd | 非破壊ディスク装置 |
| JP2000066843A (ja) * | 1998-08-17 | 2000-03-03 | Nec Corp | ディスクアレイ装置 |
| JP4291077B2 (ja) | 2003-07-29 | 2009-07-08 | 株式会社日立製作所 | 分散ストレージ装置のファイル管理方法及び分散ストレージシステム |
| US7165129B1 (en) * | 2004-01-26 | 2007-01-16 | Cisco Technology, Inc. | Method and apparatus for self-tuning transaction batching |
| US20050203974A1 (en) | 2004-03-09 | 2005-09-15 | Smith Gary S. | Checkpoint methods and systems utilizing non-disk persistent memory |
| JP2006012142A (ja) | 2004-06-09 | 2006-01-12 | Hewlett-Packard Development Co Lp | 非ディスク永続メモリを利用したチェックポイント方法およびシステム |
| JP4815825B2 (ja) | 2005-03-10 | 2011-11-16 | 日本電気株式会社 | ディスクアレイ装置及びその再構築方法 |
| US7487386B2 (en) | 2005-03-30 | 2009-02-03 | International Business Machines Corporation | Method for increasing file system availability via block replication |
| US7778972B1 (en) | 2005-12-29 | 2010-08-17 | Amazon Technologies, Inc. | Dynamic object replication within a distributed storage system |
| US8307359B1 (en) | 2006-06-23 | 2012-11-06 | Emc Corporation | Embedded virtual storage area network using a virtual block network fabric |
| US8706968B2 (en) | 2007-12-06 | 2014-04-22 | Fusion-Io, Inc. | Apparatus, system, and method for redundant write caching |
| US8046548B1 (en) * | 2007-01-30 | 2011-10-25 | American Megatrends, Inc. | Maintaining data consistency in mirrored cluster storage systems using bitmap write-intent logging |
| US7908448B1 (en) * | 2007-01-30 | 2011-03-15 | American Megatrends, Inc. | Maintaining data consistency in mirrored cluster storage systems with write-back cache |
| US7979652B1 (en) | 2007-12-20 | 2011-07-12 | Amazon Technologies, Inc. | System and method for M-synchronous replication |
| US7992037B2 (en) | 2008-09-11 | 2011-08-02 | Nec Laboratories America, Inc. | Scalable secondary storage systems and methods |
| US8578083B2 (en) | 2009-03-03 | 2013-11-05 | Vmware, Inc. | Block map based I/O optimization for storage virtual appliances |
| US8560639B2 (en) | 2009-04-24 | 2013-10-15 | Microsoft Corporation | Dynamic placement of replica data |
| JP4743313B2 (ja) | 2009-07-31 | 2011-08-10 | ウシオ電機株式会社 | 超高圧水銀ランプおよび超高圧水銀ランプ点灯装置 |
| US8341115B1 (en) | 2009-12-26 | 2012-12-25 | Emc Corporation | Dynamically switching between synchronous and asynchronous replication |
| CN101764712A (zh) * | 2010-01-21 | 2010-06-30 | 瑞斯康达科技发展股份有限公司 | 一种日志信息的传输系统及方法 |
| US8677055B2 (en) * | 2010-04-12 | 2014-03-18 | Sandisk Enterprises IP LLC | Flexible way of specifying storage attributes in a flash memory-based object store |
| US20110276963A1 (en) | 2010-05-04 | 2011-11-10 | Riverbed Technology, Inc. | Virtual Data Storage Devices and Applications Over Wide Area Networks |
| US20120079229A1 (en) | 2010-09-28 | 2012-03-29 | Craig Jensen | Data storage optimization for a virtual platform |
| US8694733B2 (en) | 2011-01-03 | 2014-04-08 | Sandisk Enterprise Ip Llc | Slave consistency in a synchronous replication environment |
| WO2012116369A2 (en) * | 2011-02-25 | 2012-08-30 | Fusion-Io, Inc. | Apparatus, system, and method for managing contents of a cache |
| US9146765B2 (en) | 2011-03-11 | 2015-09-29 | Microsoft Technology Licensing, Llc | Virtual disk storage techniques |
| US8725782B2 (en) | 2011-04-25 | 2014-05-13 | Microsoft Corporation | Virtual disk storage techniques |
| US9294564B2 (en) | 2011-06-30 | 2016-03-22 | Amazon Technologies, Inc. | Shadowing storage gateway |
| US8909996B2 (en) | 2011-08-12 | 2014-12-09 | Oracle International Corporation | Utilizing multiple storage devices to reduce write latency for database logging |
| US9323659B2 (en) * | 2011-08-12 | 2016-04-26 | Sandisk Enterprise Ip Llc | Cache management including solid state device virtualization |
| WO2013024485A2 (en) | 2011-08-17 | 2013-02-21 | Scaleio Inc. | Methods and systems of managing a distributed replica based storage |
| US9158568B2 (en) | 2012-01-30 | 2015-10-13 | Hewlett-Packard Development Company, L.P. | Input/output operations at a virtual block device of a storage server |
| US9069806B2 (en) | 2012-03-27 | 2015-06-30 | Google Inc. | Virtual block devices |
| CN103064765B (zh) * | 2012-12-28 | 2015-12-02 | 华为技术有限公司 | 数据恢复方法、装置及集群存储系统 |
-
2014
- 2014-03-11 US US14/205,067 patent/US10055352B2/en active Active
-
2015
- 2015-03-10 CN CN201910883965.2A patent/CN110609797B/zh active Active
- 2015-03-10 EP EP15761091.6A patent/EP3117325B1/en active Active
- 2015-03-10 WO PCT/US2015/019574 patent/WO2015138375A2/en active Application Filing
- 2015-03-10 CN CN201580012906.8A patent/CN106104511B/zh active Active
- 2015-03-10 AU AU2015229684A patent/AU2015229684B2/en active Active
- 2015-03-10 JP JP2016556704A patent/JP6437007B2/ja active Active
- 2015-03-10 KR KR1020167027931A patent/KR101914847B1/ko active IP Right Grant
- 2015-03-10 SG SG11201606896XA patent/SG11201606896XA/en unknown
- 2015-03-10 CA CA2940246A patent/CA2940246C/en active Active
-
2018
- 2018-08-20 US US16/105,481 patent/US10503650B2/en active Active
-
2019
- 2019-12-06 US US16/706,513 patent/US11188469B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015138375A2 (en) | 2015-09-17 |
| AU2015229684B2 (en) | 2017-06-29 |
| WO2015138375A3 (en) | 2015-11-05 |
| CN106104511B (zh) | 2019-10-22 |
| KR20160142311A (ko) | 2016-12-12 |
| KR101914847B1 (ko) | 2018-11-02 |
| AU2015229684A1 (en) | 2016-09-08 |
| CN110609797B (zh) | 2024-01-23 |
| JP2017515193A (ja) | 2017-06-08 |
| US11188469B2 (en) | 2021-11-30 |
| US20150261674A1 (en) | 2015-09-17 |
| CN106104511A (zh) | 2016-11-09 |
| CA2940246A1 (en) | 2015-09-17 |
| JP6437007B2 (ja) | 2018-12-12 |
| US20180357173A1 (en) | 2018-12-13 |
| CA2940246C (en) | 2022-08-16 |
| CN110609797A (zh) | 2019-12-24 |
| US20200110707A1 (en) | 2020-04-09 |
| EP3117325A2 (en) | 2017-01-18 |
| EP3117325B1 (en) | 2021-11-03 |
| EP3117325A4 (en) | 2017-11-22 |
| US10503650B2 (en) | 2019-12-10 |
| US10055352B2 (en) | 2018-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| SG11201606896XA (en) | Page cache write logging at block-based storage | |
| GB2564994B (en) | Cache memory access | |
| GB2558478B (en) | Copy-Redirect on write | |
| SG11201607071QA (en) | Reducing data volume durability state for block-based storage | |
| GB2546634B (en) | Invalidation data area for cache | |
| GB201322400D0 (en) | Oliugonucleotide data storage on solid supports | |
| EP3146524A4 (en) | Read cache memory | |
| DK3238514T3 (da) | Forbedret opbevaringsenhed | |
| EP3066571A4 (en) | Cache memory budgeted by ways on memory access type | |
| HK1245437A1 (zh) | 數據高速緩存 | |
| GB2539383B (en) | Cache coherency | |
| GB201318780D0 (en) | Write cache destaging | |
| GB2546245B (en) | Cache memory | |
| GB2539382B (en) | Cache coherency | |
| GB2525713B (en) | Memory subsystem with wrapped-to-continuous read | |
| GB2542867B (en) | Data storage | |
| GB201603295D0 (en) | Data storage | |
| GB2566470B (en) | Cache storage | |
| GB2540965B (en) | Secure configuration data storage | |
| GB201404524D0 (en) | Advanced result cache refill | |
| GB2567121B (en) | Fingerboard storage arrangement | |
| GB2566647B (en) | Cache retention data management | |
| GB2547659B (en) | Space saving storage device | |
| GB201608444D0 (en) | Extended data storage | |
| GB201619584D0 (en) | Data storage |