CN109582222B - Method for cleaning persistent cache in host sensing tile recording disk - Google Patents
Method for cleaning persistent cache in host sensing tile recording disk Download PDFInfo
- Publication number
- CN109582222B CN109582222B CN201811281365.0A CN201811281365A CN109582222B CN 109582222 B CN109582222 B CN 109582222B CN 201811281365 A CN201811281365 A CN 201811281365A CN 109582222 B CN109582222 B CN 109582222B
- Authority
- CN
- China
- Prior art keywords
- track area
- recording disk
- persistent cache
- data
- cleaning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0653—Monitoring storage devices or systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Digital Magnetic Recording (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a method for cleaning a persistent cache in a tile record disk sensed by a host, which comprises the following steps: (1) monitoring the use condition of a disc recorded by a tile, and if a free window is detected and the remaining space of the persistent cache is lower than a preset free threshold, turning to the step (2); (2) obtaining the use information of the magnetic track area, and determining a target magnetic track area needing to be written with data when the persistent cache is cleared; (3) and constructing a sequential write request according to the use information of the target track area, and writing the sequential write request into the target track area to trigger the operation of cleaning the persistent cache of the recording disk. The invention can actively clear the data in the persistent cache by using the idle time of the system, thereby effectively improving the performance of the tile recording disk sensed by the host.
Description
Technical Field
The invention belongs to the technical field of data storage, and particularly relates to a host-perceived method for cleaning a persistent cache in a shingled recording disk.
Background
The explosive growth in data volume forces storage systems to seek devices of higher storage capacity. Disks are considered storage solutions that can immediately meet the urgent need for increased data storage capacity, and are the solutions that achieve the best balance between cost, capacity and performance. However, as conventional magnetic recording techniques are approaching the theoretical limit of disk areal density determined by the superparamagnetic effect, the capacity of conventional disks is also approaching the limit they can achieve.
Tile recording techniques are achieved by further using the space between the tracks of a diskThe storage density per unit area of the tile recording magnetic disk based on the tile recording technology can reach 10TB/in by taking the storage density per unit area higher than that of the traditional magnetic recording technology2Even higher, unlike conventional disks, the tracks in the shingle recording disk are laid out like tiles of a rooftop with partial overlap between adjacent tracks, as shown in fig. 1, where #1 to #4 respectively denote the numbers of four consecutive tracks. Since there is a partial overlap between adjacent tracks, such as the #1 track and the #2 track in fig. 1, updating the data in the #1 track will inevitably overwrite the data in the #2 track since the #2 track partially overlaps the top of the #1 track. Therefore, the shingle recording disk must read the data in the #2 track before updating the #1 track and write these read data back to the #2 track after the #1 track update is complete, which can greatly reduce the write efficiency of the shingle recording disk and introduce severe write amplification.
In order to alleviate the problems of write performance degradation and write amplification caused by track layout in the tile recording disk, a Persistent Cache (Persistent Cache) is introduced in the existing host-aware tile recording disk, and a plurality of continuous tracks are divided into track areas. The physical layout of the magnetic track area is abstracted into a continuous logical space through a controller and other auxiliary structures inside the magnetic disk, the persistent cache is used for caching data of random write requests to the magnetic track area, and when the residual space in the persistent cache is lower than a certain threshold value, the operation of cleaning the persistent cache is triggered, and the data in the persistent cache is written into the magnetic track area.
The capacity of the persistent cache is relatively small and it is very time consuming to migrate data from the persistent cache to the track region, and existing Shingle Translation Layer (STL) shingle disk schemes and optimization schemes based on shingle translation layers help to reduce unnecessary data movement between the persistent cache and the track, but do not fully utilize the persistent cache of shingle disks. When a request from a host conflicts with a clean persistent cache operation within a shingled disk, the performance of the shingled disk is greatly reduced.
Disclosure of Invention
In view of the defects and improvement requirements of the prior art, the invention provides a host-aware cleaning method for a persistent cache in a shingled recording disk, which aims to actively clean data in the persistent cache by using the idle time of a system so as to improve the performance of the host-aware shingled recording disk.
In order to achieve the above object, the present invention provides a host-aware method for cleaning persistent cache in a shingled recording disk, comprising the following steps:
(1) monitoring the use condition of a disc recorded by a tile, and if a free window is detected and the remaining space of the persistent cache is lower than a preset free threshold, turning to the step (2);
(2) obtaining the use information of the magnetic track area, and determining a target magnetic track area needing to be written with data when the persistent cache is cleared;
(3) constructing a sequential write request for accessing the target track area according to the use information of the target track area, and sending the sequential write request to the shingle recording disk to trigger the operation of cleaning the persistent cache by the shingle recording disk;
the idle window is a time period, no request is sent to the recording disk in the idle window, and the use information comprises a track area number, a write pointer offset value, a random write data volume and a highest logical address of valid data.
Further, the host computer-aware method for cleaning persistent cache in a shingled recording disk provided by the present invention further includes: and updating the use information of the track area according to the use condition of the tile recording disk.
Further, in the step (2), the determined target track area is a track area with the largest random write data amount in all track areas, so as to release more persistent buffer space.
Furthermore, in the step (2), the determined target track area is the track area with the minimum random write data amount in all the track areas, so as to avoid influencing the request of the upper-layer application to the shingled recording disk due to the time-consuming process of cleaning the persistent cache.
Further, in step (3), the logical address of the constructed sequential write request is the write pointer offset value of the target track area, and the size of the sequential write request is the minimum write unit of the shingle recording disk, so as to minimize the influence of the data written by the constructed sequential write request on the storage of the valid data by the shingle recording disk.
Generally, by the above technical solution conceived by the present invention, the following beneficial effects can be obtained:
(1) according to the method for clearing the persistent cache in the tile recording disk sensed by the host, provided by the invention, the sequential writing request is constructed and the magnetic track area is accessed when the tile recording disk is idle, so that the idle time of a system can be fully utilized, and the operation of clearing the persistent cache by the tile recording disk is actively triggered, on one hand, the condition that the residual space of the persistent cache is insufficient can be effectively avoided, and the fluctuation range of the request response time of the tile recording disk sensed by the host is reduced; on the other hand, the conflict between the request generated by the application and the operation of cleaning the persistent cache can be effectively avoided, and the overall performance of the storage system is improved.
(2) The host-perceived cleaning method for the persistent cache in the shingled recording disk determines whether the shingled recording disk is idle through the idle window, and the method provided by the invention can accurately judge whether the shingled recording disk is idle because the storage access has time locality, thereby avoiding conflict with a request generated by an upper-layer application when the operation of cleaning the persistent cache is actively triggered.
Drawings
FIG. 1 is a schematic view of a track layout of a conventional shingle recording disk;
FIG. 2 is a diagram of persistent caching in a conventional host-aware shingled disk;
fig. 3 is a flowchart of a host-aware method for cleaning persistent cache in a shingled recording disk according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
Before explaining the technical scheme of the present invention in detail, a brief introduction is made to the relevant storage mechanism in the host-aware shingled recording disk. FIG. 2 is a schematic diagram of a persistent cache in a host-aware shingled disk, which also includes a track area; the writing pointer of the track area is used for indicating the logical position where data can be directly written, and the writing pointer of the track area points to the lowest logical address at the starting moment; when a sequential write request (i.e. the logical address of the request is the same as the offset value of the write pointer) arrives, data is directly written into the logical space of the track area, and the write pointer moves along the direction of the rise of the logical address; after a random write request (i.e. the logical address of the request is different from the write pointer offset value) arrives, the data will be written into the persistent cache, and the mapping table of the persistent cache is updated accordingly, and the remaining storage space of the persistent cache is reduced accordingly. When the residual space in the persistent cache is lower than a certain threshold value, the operation of cleaning the persistent cache is triggered, and the data in the persistent cache is written into the magnetic track area. The threshold value is often set according to the practical application scenario of the storage system, so as to ensure that enough free space is available in the persistent cache to cache random write data of the track area, and data migration between the persistent cache and the track area will not frequently occur due to insufficient remaining space of the persistent cache.
In addition, when the sequential write request arrives, if random write data in the track area is cached in the persistent cache, the shingle recording disk can trigger the operation of clearing the persistent cache of the shingle recording disk besides writing the data of the sequential write request into the logical space of the track area, and the random write data of the track area is migrated from the persistent cache to the logical space of the track area; in order to transfer random write data of the magnetic track region from the persistent buffer to the magnetic track region, in the operation of cleaning the persistent buffer, the total data volume of the write magnetic track region is the difference value of the highest logical address of the effective data of the magnetic track region and the offset of the write pointer, and except the random write data, the rest data is filled with '0'.
Based on the above storage mechanism, in a first embodiment of the present invention, as shown in fig. 3, a host-aware request method for persistent cache in a shingled recording disk provided by the present invention includes the following steps:
(1) monitoring the use condition of a disc recorded by a tile, and if a free window is detected and the remaining space of the persistent cache is lower than a preset free threshold, turning to the step (2);
the idle window is a time period, no request is sent to the watt recording disk in the idle window, and the specific length of the idle window can be set according to the access time characteristic of the application; because the storage access has time locality, the fact that no request is sent to the tile recording disk is detected and a time period is waited for can accurately judge whether the tile recording disk is idle, and therefore conflict with a request generated by an upper application when the operation of cleaning the persistent cache is actively triggered is avoided;
(2) obtaining the use information of the magnetic track area, and determining a target magnetic track area needing to be written with data when the persistent cache is cleared;
wherein the usage information includes a track area number, a write pointer offset value, a random write data amount, and a highest logical address of valid data;
in this embodiment, the determined target track area is a track area with the largest random write data amount in all track areas; in the cleaning persistent cache operation of the watt recording disk, all random write data cached in a persistent cache in a target track area are written into the target track area, the track area with the maximum random write data amount is selected as the target track area, and more persistent cache space can be released in one operation;
(3) constructing a sequential write request for accessing the target track area according to the use information of the target track area, and sending the constructed sequential write request to the tile recording disk to trigger the operation of cleaning the persistent cache by the tile recording disk;
in an optional real-time manner, in step (3), the logical address of the constructed sequential write request is a write pointer offset value of the target track area, and the size of the sequential write request is the minimum write unit of the shingle recording disk, so as to minimize the influence of the data written by the constructed sequential write request on the storage of the valid data by the shingle recording disk; the write data of the sequential write request may be any data, and in this embodiment, the write data content is all "0";
in this embodiment, the method for cleaning persistent cache in a host-aware shingled recording disk provided by the present invention further includes: updating the use information of the magnetic track area according to the use condition of the tile recording magnetic disk;
specifically, as data is written in a track region, the write pointer offset value, the random write data amount, and the highest logical address of valid data for that track region are modified accordingly.
For applications such as multimedia editing with a large access interval to the shingled recording disk, the overall performance of the storage system can be greatly improved by adopting the method for cleaning the persistent cache provided by the first embodiment of the invention.
In a second embodiment of the present invention, the host-aware method for cleaning persistent cache in a shingled recording disk according to the present invention is similar to the first embodiment of the present invention, except that the target track area determined in step (2) is a track area with the smallest random write data amount in all track areas; when the persistent cache is cleaned, the time overhead is in direct proportion to the data volume of random write data written into the track area from the persistent cache, the track area with the minimum random write data volume is selected as the target track area, and the problem that the request of an upper-layer application to the watt-recording disk is influenced due to too long cleaning time can be avoided while the persistent cache is cleaned.
For applications such as a file server with a small access interval to the shingled recording disk, the overall performance of the storage system can be greatly improved by using the method for cleaning the persistent cache provided by the second embodiment of the present invention.
According to the method for clearing the persistent cache in the tile recording disk sensed by the host, provided by the invention, the sequential writing request is constructed and the magnetic track area is accessed when the tile recording disk is idle, so that the idle time of a system can be fully utilized, and the operation of clearing the persistent cache by the tile recording disk is actively triggered, on one hand, the condition that the residual space of the persistent cache is insufficient can be effectively avoided, and the fluctuation range of the request response time of the tile recording disk sensed by the host is reduced; on the other hand, the conflict between the request generated by the application and the operation of cleaning the persistent cache can be effectively avoided, and the overall performance of the storage system is improved.
It will be understood by those skilled in the art that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the invention, and that any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (4)
1. A host-aware cleaning method for persistent cache in a shingled recording disk is characterized by comprising the following steps:
(1) monitoring the service condition of the tile recording disk, and if a free window is detected and the remaining space of the persistent cache is lower than a preset free threshold, turning to the step (2);
(2) obtaining the use information of the magnetic track area, and determining a target magnetic track area needing to be written with data when the persistent cache is cleared;
(3) constructing a sequential write request for accessing the target track area according to the use information of the target track area, and sending the sequential write request to the tile recording disk to trigger the operation of cleaning the persistent cache by the tile recording disk, and migrating random write data of the target track area from the persistent cache to a logical space of the track area; in the operation of cleaning the persistent cache, the total data volume written into the track area is the difference value between the highest logical address of the effective data of the track area and the offset of a write pointer, and except the random write data, the rest data is filled with '0';
the idle window is a time period, no request is sent to the watt recording disk in the idle window, and the use information comprises a track area number, a write pointer offset value, random write data volume and the highest logical address of valid data; in the step (3), the logical address of the constructed sequential write request is a write pointer offset value of the target track area, and the size of the sequential write request is the minimum write unit of the shingle recording disc.
2. The host-aware scrubbing of persistent cache in a shingled recording disk as recited in claim 1, further comprising: and updating the use information of the track area according to the use condition of the tile recording disk.
3. The host-aware method for cleaning persistent buffer in a shingled recording disk according to claim 1 or 2, wherein in the step (2), the determined target track area is a track area with the largest random write data amount in all track areas.
4. The host-aware method for cleaning persistent buffer in a shingled recording disk according to claim 1 or 2, wherein in the step (2), the determined target track area is a track area with the smallest random write data amount in all track areas.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811281365.0A CN109582222B (en) | 2018-10-31 | 2018-10-31 | Method for cleaning persistent cache in host sensing tile recording disk |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811281365.0A CN109582222B (en) | 2018-10-31 | 2018-10-31 | Method for cleaning persistent cache in host sensing tile recording disk |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109582222A CN109582222A (en) | 2019-04-05 |
| CN109582222B true CN109582222B (en) | 2020-11-24 |
Family
ID=65920865
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811281365.0A Active CN109582222B (en) | 2018-10-31 | 2018-10-31 | Method for cleaning persistent cache in host sensing tile recording disk |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109582222B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111026329B (en) * | 2019-11-18 | 2021-04-20 | 华中科技大学 | Key value storage system based on host management tile record disk and data processing method |
| CN112214169B (en) * | 2020-09-28 | 2021-08-10 | 深圳大学 | Data storage device and stored data migration method |
| CN112463025B (en) * | 2020-10-28 | 2022-08-26 | 苏州浪潮智能科技有限公司 | Tile record disk data management method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101539842A (en) * | 2009-04-27 | 2009-09-23 | 杭州华三通信技术有限公司 | Data wiring method of disk array system and disk array system |
| US8874833B1 (en) * | 2009-03-23 | 2014-10-28 | Marvell International Ltd. | Sequential writes to flash memory |
| CN106293543A (en) * | 2016-08-25 | 2017-01-04 | 中国科学院计算技术研究所 | A kind of based on incidentally reclaim watt record a RAID write ordered method and device |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100362462C (en) * | 2005-07-15 | 2008-01-16 | 华为技术有限公司 | Method for managing magnetic disk array buffer storage |
| US9542278B2 (en) * | 2013-12-26 | 2017-01-10 | Silicon Motion, Inc. | Data storage device and flash memory control method |
| CN106095342B (en) * | 2016-06-15 | 2019-05-14 | 华中科技大学 | A kind of watt recording disc array construction method and the system of dynamically changeable long strip |
| CN106970764B (en) * | 2017-02-24 | 2019-08-16 | 中国科学院计算技术研究所 | It is a kind of based on band version watt record a RAID write ordered method and system |
-
2018
- 2018-10-31 CN CN201811281365.0A patent/CN109582222B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8874833B1 (en) * | 2009-03-23 | 2014-10-28 | Marvell International Ltd. | Sequential writes to flash memory |
| CN101539842A (en) * | 2009-04-27 | 2009-09-23 | 杭州华三通信技术有限公司 | Data wiring method of disk array system and disk array system |
| CN106293543A (en) * | 2016-08-25 | 2017-01-04 | 中国科学院计算技术研究所 | A kind of based on incidentally reclaim watt record a RAID write ordered method and device |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
Non-Patent Citations (1)
| Title |
|---|
| 高性能混合结构的瓦记录磁盘系统的设计与实现;马留英等;《高技术通讯》;20170215;第27卷(第2期);第140-149页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109582222A (en) | 2019-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8521972B1 (en) | System and method for optimizing garbage collection in data storage | |
| CN102576293B (en) | Data management in solid storage device and Bedding storage system | |
| US8327076B2 (en) | Systems and methods of tiered caching | |
| US8756382B1 (en) | Method for file based shingled data storage utilizing multiple media types | |
| US8654472B2 (en) | Implementing enhanced fragmented stream handling in a shingled disk drive | |
| US8909887B1 (en) | Selective defragmentation based on IO hot spots | |
| US9665293B2 (en) | Method for a storage device processing data and storage device | |
| US10521131B2 (en) | Storage apparatus and storage control apparatus | |
| US9229653B2 (en) | Write spike performance enhancement in hybrid storage systems | |
| CN109582222B (en) | Method for cleaning persistent cache in host sensing tile recording disk | |
| US8510504B2 (en) | SMR storage device with user controls and access to status information and parameter settings | |
| US9804786B2 (en) | Sector translation layer for hard disk drives | |
| US9189392B1 (en) | Opportunistic defragmentation during garbage collection | |
| CN109710184B (en) | Hierarchical hybrid storage method and system for tile record disk perception | |
| US10152236B2 (en) | Hybrid data storage device with partitioned local memory | |
| CN103985393B (en) | A kind of multiple optical disk data parallel management method and device | |
| CN108845957B (en) | Replacement and write-back self-adaptive buffer area management method | |
| CN102999428A (en) | Four-stage addressing method for tile recording disk | |
| CN106527987A (en) | Non-DRAM SSD master control reliability improving system and method | |
| GB2503314A (en) | Implementing remapping command with indirection update for indirected storage | |
| Wu et al. | {ZoneAlloy}: Elastic Data and Space Management for Hybrid {SMR} Drives | |
| IE20160095A1 (en) | Realm partitioning in hard drives | |
| CN111078143A (en) | Hybrid storage method and system for data layout and scheduling based on segment mapping | |
| US11275684B1 (en) | Media read cache | |
| CN111580752B (en) | Data storage method, device, computer program and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |