CN102696020B - 基于可配置缓存映射的选择性文件系统缓存 - Google Patents

基于可配置缓存映射的选择性文件系统缓存 Download PDF

Info

Publication number
CN102696020B
CN102696020B CN201080060162.4A CN201080060162A CN102696020B CN 102696020 B CN102696020 B CN 102696020B CN 201080060162 A CN201080060162 A CN 201080060162A CN 102696020 B CN102696020 B CN 102696020B
Authority
CN
China
Prior art keywords
requests
cache
caching
type
file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201080060162.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN102696020A (zh
Inventor
E·梦泽
R·马利革
B·古玛勒善
T·瑞西
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gen Digital Inc
Original Assignee
Symantec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Symantec Corp filed Critical Symantec Corp
Publication of CN102696020A publication Critical patent/CN102696020A/zh
Application granted granted Critical
Publication of CN102696020B publication Critical patent/CN102696020B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/172—Caching, prefetching or hoarding of files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0888—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches using selective caching, e.g. bypass
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1016—Performance improvement
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/30—Providing cache or TLB in specific location of a processing system
    • G06F2212/303—In peripheral interface, e.g. I/O adapter or channel

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201080060162.4A 2009-11-16 2010-11-09 基于可配置缓存映射的选择性文件系统缓存 Active CN102696020B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/619,417 US8825685B2 (en) 2009-11-16 2009-11-16 Selective file system caching based upon a configurable cache map
US12/619417 2009-11-16
PCT/US2010/056038 WO2011059979A1 (en) 2009-11-16 2010-11-09 Selective file system caching based upon a configurable cache map

Publications (2)

Publication Number Publication Date
CN102696020A CN102696020A (zh) 2012-09-26
CN102696020B true CN102696020B (zh) 2016-06-29

Family

ID=43587553

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201080060162.4A Active CN102696020B (zh) 2009-11-16 2010-11-09 基于可配置缓存映射的选择性文件系统缓存

Country Status (5)

Country Link
US (2) US8825685B2 (enExample)
EP (1) EP2502148B1 (enExample)
JP (1) JP5802983B2 (enExample)
CN (1) CN102696020B (enExample)
WO (1) WO2011059979A1 (enExample)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8473582B2 (en) * 2009-12-16 2013-06-25 International Business Machines Corporation Disconnected file operations in a scalable multi-node file system cache for a remote cluster file system
US8495250B2 (en) * 2009-12-16 2013-07-23 International Business Machines Corporation Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system
US9158788B2 (en) 2009-12-16 2015-10-13 International Business Machines Corporation Scalable caching of remote file data in a cluster file system
US8458239B2 (en) * 2009-12-16 2013-06-04 International Business Machines Corporation Directory traversal in a scalable multi-node file system cache for a remote cluster file system
US20110252208A1 (en) * 2010-04-12 2011-10-13 Microsoft Corporation Express-full backup of a cluster shared virtual machine
EP2538334B1 (en) * 2011-06-21 2019-08-21 Lantiq Beteiligungs-GmbH & Co.KG Cache streaming system
CN102521260B (zh) 2011-11-18 2014-04-02 华为技术有限公司 数据预热方法及装置
US10359972B2 (en) * 2012-08-31 2019-07-23 Sandisk Technologies Llc Systems, methods, and interfaces for adaptive persistence
US10073656B2 (en) 2012-01-27 2018-09-11 Sandisk Technologies Llc Systems and methods for storage virtualization
JP5870213B2 (ja) * 2012-05-16 2016-02-24 株式会社日立製作所 ストレージシステム及びストレージシステムにおけるデータ転送制御方法
US8984097B1 (en) 2012-05-23 2015-03-17 Symantec Corporation Efficient file replication which preserves the underlying extent structure
US10037279B1 (en) * 2012-06-20 2018-07-31 EMC IP Holding Company LLC Host device caching of a business process data
EP2877928A4 (en) * 2012-07-24 2016-03-23 Intel Corp SYSTEM AND METHOD FOR IMPLEMENTING SSD-BASED I / O CACHES
US10649961B2 (en) 2012-12-31 2020-05-12 Sandisk Technologies Llc System and method for selectively routing cached objects
US9235587B2 (en) * 2012-12-31 2016-01-12 Sandisk Technologies Inc. System and method for selectively routing cached objects
CN103544287B (zh) * 2013-10-28 2017-04-19 中国软件与技术服务股份有限公司 一种文件私有缓存建立方法和装置
RU2643642C2 (ru) * 2013-12-11 2018-02-02 Интел Корпорейшн Использование кэш-памяти и памяти другого типа в распределённой запоминающей системе
US9483310B2 (en) 2014-04-29 2016-11-01 Bluedata Software, Inc. Associating cache memory with a work process
US9378152B2 (en) 2014-05-09 2016-06-28 Avago Technologies General Ip (Singapore) Pte. Ltd. Systems and methods for I/O processing using out-of-band hinting to block driver or storage controller
US9218407B1 (en) 2014-06-25 2015-12-22 Pure Storage, Inc. Replication and intermediate read-write state for mediums
WO2016000147A1 (zh) * 2014-06-30 2016-01-07 华为技术有限公司 一种访问存储设备的方法和主机
US10713171B2 (en) * 2014-10-03 2020-07-14 Hitachi, Ltd. Computer system
US9866647B2 (en) * 2015-03-26 2018-01-09 Alcatel Lucent Hierarchical cost based caching for online media
JP2016207096A (ja) 2015-04-27 2016-12-08 富士通株式会社 階層ストレージ装置、階層ストレージシステム、階層ストレージ方法、および階層ストレージプログラム
CN106940660B (zh) * 2016-01-05 2020-08-14 阿里巴巴集团控股有限公司 缓存的实现的方法和装置
US11113247B1 (en) 2016-05-10 2021-09-07 Veritas Technologies Llc Routing I/O requests to improve read/write concurrency
CN107870872B (zh) * 2016-09-23 2021-04-02 伊姆西Ip控股有限责任公司 用于管理高速缓存的方法和设备
CN106528927B (zh) * 2016-09-29 2019-07-30 京微齐力(北京)科技有限公司 输入输出i/o工艺映射方法和装置
CN108874615A (zh) * 2017-05-16 2018-11-23 惠州市德赛西威汽车电子股份有限公司 一种车载多媒体系统性能检测装置及检测方法
US10824562B2 (en) * 2018-01-09 2020-11-03 Hossein Asadi Reconfigurable caching
CN110688329B (zh) * 2019-09-06 2021-08-10 无锡江南计算技术研究所 一种可同时支持多套Cache数据私有段动态设置的方法
US20230083798A1 (en) * 2021-09-14 2023-03-16 International Business Machines Corporation Maintaining metadata from a catalog in a repository to return to requests for the metadata

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6301605B1 (en) * 1997-11-04 2001-10-09 Adaptec, Inc. File array storage architecture having file system distributed across a data processing platform
US6463509B1 (en) * 1999-01-26 2002-10-08 Motive Power, Inc. Preloading data in a cache memory according to user-specified preload criteria
CN1682193A (zh) * 2002-07-11 2005-10-12 维瑞泰斯操作公司 存储服务与系统
US20050256976A1 (en) * 2004-05-17 2005-11-17 Oracle International Corporation Method and system for extended memory with user mode input/output operations
US20060271740A1 (en) * 2005-05-31 2006-11-30 Mark Timothy W Performing read-ahead operation for a direct input/output request
US20080040538A1 (en) * 2006-08-10 2008-02-14 Keiichi Matsuzawa File readahead method with the use of access pattern information attached to metadata
US20090150511A1 (en) * 2007-11-08 2009-06-11 Rna Networks, Inc. Network with distributed shared memory

Family Cites Families (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4399503A (en) * 1978-06-30 1983-08-16 Bunker Ramo Corporation Dynamic disk buffer control unit
US4408273A (en) 1980-05-27 1983-10-04 International Business Machines Corporation Method and means for cataloging data sets using dual keyed data sets and direct pointers
JPH0664536B2 (ja) 1986-01-17 1994-08-22 インタ−ナショナル ビジネス マシ−ンズ コ−ポレ−ション 仮想端末サブシステムの制御方法
US5097533A (en) 1988-11-29 1992-03-17 International Business Machines Corporation System and method for interfacing computer application programs written in different languages to a software system
US5544347A (en) 1990-09-24 1996-08-06 Emc Corporation Data storage system controlled remote data mirroring with respectively maintained data indices
US5301295A (en) * 1991-05-22 1994-04-05 Analog Devices, Inc. Data processor apparatus and method with selective caching of instructions
CA2121852A1 (en) * 1993-04-29 1994-10-30 Larry T. Jost Disk meshing and flexible storage mapping with enhanced flexible caching
US5854942A (en) * 1996-09-06 1998-12-29 International Business Machines Corporation Method and system for automatic storage subsystem configuration
US6092149A (en) * 1997-05-28 2000-07-18 Western Digital Corporation Disk drive cache system using a dynamic priority sequential stream of data segments continuously adapted according to prefetched sequential random, and repeating types of accesses
US6098149A (en) 1997-06-13 2000-08-01 Emc Corporation Method and apparatus for extending commands in a cached disk array
US6012104A (en) 1997-10-24 2000-01-04 International Business Machines Corporation Method and apparatus for dynamic extension of channel programs
US6044415A (en) 1998-02-27 2000-03-28 Intel Corporation System for transferring I/O data between an I/O device and an application program's memory in accordance with a request directly over a virtual connection
JPH11345164A (ja) 1998-06-03 1999-12-14 Sony Corp 情報処理装置
US6301640B2 (en) 1998-07-02 2001-10-09 Lucent Technologies, Inc. System and method for modeling and optimizing I/O throughput of multiple disks on a bus
US6349363B2 (en) * 1998-12-08 2002-02-19 Intel Corporation Multi-section cache with different attributes for each section
US6453321B1 (en) * 1999-02-11 2002-09-17 Ibm Corporation Structured cache for persistent objects
US6421761B1 (en) * 1999-11-09 2002-07-16 International Business Machines Corporation Partitioned cache and management method for selectively caching data by type
JP3710351B2 (ja) * 2000-03-17 2005-10-26 三菱電機株式会社 データ処理装置
JP4068798B2 (ja) 2000-10-31 2008-03-26 株式会社日立製作所 記憶サブシステム及びｉ／ｏインタフェースの制御方法ならびに情報処理システム
US6687765B2 (en) * 2001-01-16 2004-02-03 International Business Machines Corporation System, method, and computer program for explicitly tunable I/O device controller
US6721814B1 (en) * 2001-05-15 2004-04-13 Emc Corporation System and method of improving host performance characteristics by intelligent shift of data caching from host to cache-enabled mass storage subsystem
US7113937B2 (en) 2001-12-18 2006-09-26 International Business Machines Corporation Systems, methods, and computer program products to improve performance of ported applications, such as a database, operating on UNIX system services for the OS/390
US6754734B2 (en) 2001-12-18 2004-06-22 International Business Machines Corporation Systems, methods, and computer program products to improve performance of ported applications, such as a database
US7159025B2 (en) * 2002-03-22 2007-01-02 Microsoft Corporation System for selectively caching content data in a server based on gathered information and type of memory in the server
US6981112B2 (en) * 2002-08-26 2005-12-27 International Business Machines Corporation Dynamic cache disable
US7010645B2 (en) * 2002-12-27 2006-03-07 International Business Machines Corporation System and method for sequentially staging received data to a write cache in advance of storing the received data
JP4252828B2 (ja) 2003-03-19 2009-04-08 株式会社日立製作所 キャッシュ制御方法、ノード装置、プログラム
US7493450B2 (en) * 2003-04-14 2009-02-17 Hewlett-Packard Development Company, L.P. Method of triggering read cache pre-fetch to increase host read throughput
US7836261B2 (en) * 2004-01-12 2010-11-16 International Business Machines Corporation Managing caching of data on a client
US20050246501A1 (en) * 2004-04-30 2005-11-03 Intel Corporation Selective caching systems and methods
US7831642B1 (en) * 2004-09-30 2010-11-09 Symantec Operating Corporation Page cache management for a shared file
US7228388B2 (en) * 2004-11-19 2007-06-05 International Business Machines Corporation Enabling and disabling cache bypass using predicted cache line usage
JP4779012B2 (ja) * 2005-04-25 2011-09-21 ネットアップ，インコーポレイテッド 瞬時ボリューム復元のためのオン・デマンドでデータを復元するシステム、および方法
US7756909B2 (en) * 2005-04-29 2010-07-13 Microsoft Corporation Configuration profiles for output cached pages
US8001538B2 (en) * 2005-12-07 2011-08-16 Microsoft Corporation Software accessible cache metadata
US7685367B2 (en) * 2006-03-08 2010-03-23 Microsoft Corporation Multi-cache cooperation for response output caching
US7640395B2 (en) * 2006-03-30 2009-12-29 Intel Corporation Maintaining write ordering in a system
US7996623B2 (en) * 2006-06-30 2011-08-09 Seagate Technology Llc Read ahead storage control
JP2008090378A (ja) * 2006-09-29 2008-04-17 Seiko Epson Corp ハイブリッドファイルシステム、オペレーティングシステム、キャッシュ制御方法および記録媒体
US8224813B2 (en) 2006-10-20 2012-07-17 Oracle International Corporation Cost based analysis of direct I/O access
US20080184003A1 (en) 2007-01-30 2008-07-31 Kabushiki Kaisha Toshiba Data transmission control apparatus and data transmission control method
CA2685437C (en) 2007-02-08 2015-06-02 Aspenbio Pharma, Inc. Compositions and methods including expression and bioactivity of bovine follicle stimulating hormone
US7730265B1 (en) * 2007-03-06 2010-06-01 Oracle America, Inc. Starvation-avoiding unbounded transactional memory
US7856530B1 (en) * 2007-10-31 2010-12-21 Network Appliance, Inc. System and method for implementing a dynamic cache for a data storage system
US8255627B2 (en) * 2009-10-10 2012-08-28 International Business Machines Corporation Secondary cache for write accumulation and coalescing

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6301605B1 (en) * 1997-11-04 2001-10-09 Adaptec, Inc. File array storage architecture having file system distributed across a data processing platform
US6463509B1 (en) * 1999-01-26 2002-10-08 Motive Power, Inc. Preloading data in a cache memory according to user-specified preload criteria
CN1682193A (zh) * 2002-07-11 2005-10-12 维瑞泰斯操作公司 存储服务与系统
US20050256976A1 (en) * 2004-05-17 2005-11-17 Oracle International Corporation Method and system for extended memory with user mode input/output operations
US20060271740A1 (en) * 2005-05-31 2006-11-30 Mark Timothy W Performing read-ahead operation for a direct input/output request
US7383392B2 (en) * 2005-05-31 2008-06-03 Hewlett-Packard Development Company, L.P. Performing read-ahead operation for a direct input/output request
US20080040538A1 (en) * 2006-08-10 2008-02-14 Keiichi Matsuzawa File readahead method with the use of access pattern information attached to metadata
US20090150511A1 (en) * 2007-11-08 2009-06-11 Rna Networks, Inc. Network with distributed shared memory

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Performance Measurements of a User-Space DAFS Server with a Database Workload;Samuel A.Fineberg等;《PROCEEDINGS OT THE ACM SIGCOMM 2003 WORKSHOPS》;20030825;第185-195页 *

Also Published As

Publication number Publication date
JP2013511091A (ja) 2013-03-28
JP5802983B2 (ja) 2015-11-04
US20110119228A1 (en) 2011-05-19
WO2011059979A1 (en) 2011-05-19
US9529814B1 (en) 2016-12-27
EP2502148B1 (en) 2018-07-04
CN102696020A (zh) 2012-09-26
US8825685B2 (en) 2014-09-02
EP2502148A1 (en) 2012-09-26

Similar Documents

Publication Publication Date Title
CN102696020B (zh) 基于可配置缓存映射的选择性文件系统缓存
US10877940B2 (en) Data storage with a distributed virtual array
US8966476B2 (en) Providing object-level input/output requests between virtual machines to access a storage subsystem
US9513810B2 (en) Fast accessible compressed thin provisioning volume
US8782335B2 (en) Latency reduction associated with a response to a request in a storage system
US9268489B2 (en) Method and system for heterogeneous data volume
US8190832B2 (en) Data storage performance enhancement through a write activity level metric recorded in high performance block storage metadata
US9229870B1 (en) Managing cache systems of storage systems
US9779026B2 (en) Cache bypass utilizing a binary tree
US7222135B2 (en) Method, system, and program for managing data migration
US8595454B1 (en) System and method for caching mapping information for off-host backups
US10705853B2 (en) Methods, systems, and computer-readable media for boot acceleration in a data storage system by consolidating client-specific boot data in a consolidated boot volume
US11315028B2 (en) Method and apparatus for increasing the accuracy of predicting future IO operations on a storage system
CN103488431A (zh) 一种写数据方法及存储设备
EP2606429B1 (en) Systems and methods for efficient sequential logging on caching-enabled storage devices
US20230009942A1 (en) Using drive compression in uncompressed tier
US12153802B2 (en) Method and device for log structured merge-tree based key-value data storage
WO2021031618A1 (zh) 一种数据备份方法、数据备份装置及数据备份系统
US11537597B1 (en) Method and system for streaming data from portable storage devices
US7752392B1 (en) Method and apparatus for accessing a virtualized storage volume using a pre-loaded volume map
US10763892B1 (en) Managing inline data compression in storage systems
JP6048976B2 (ja) マルチターゲット・アーキテクチャにおけるソースと空間効率の良いターゲットとの間の関係の削除のための方法、コンピュータ・プログラム、および装置
US10394481B2 (en) Reducing application input/output operations from a server having data stored on de-duped storage

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant