CN112328181A - Metadata reading and writing method and device of distributed storage system - Google Patents
Metadata reading and writing method and device of distributed storage system Download PDFInfo
- Publication number
- CN112328181A CN112328181A CN202011307683.7A CN202011307683A CN112328181A CN 112328181 A CN112328181 A CN 112328181A CN 202011307683 A CN202011307683 A CN 202011307683A CN 112328181 A CN112328181 A CN 112328181A
- Authority
- CN
- China
- Prior art keywords
- metadata
- storage pool
- storage
- heat
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000004044 response Effects 0.000 claims abstract description 42
- 230000015654 memory Effects 0.000 claims abstract description 28
- 230000002085 persistent effect Effects 0.000 claims abstract description 26
- 239000007787 solid Substances 0.000 claims abstract description 12
- 230000005055 memory storage Effects 0.000 description 3
- 230000005012 migration Effects 0.000 description 3
- 238000013508 migration Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000013403 standard screening design Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000844 transformation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a metadata read-write method and a device of a distributed storage system, wherein the method comprises the following steps: in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware; continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold; in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat; in response to the heat of metadata residing in the second storage pool exceeding the heat threshold, the metadata having a heat exceeding the heat threshold is copied to the first storage pool for direct destaging. The invention can improve the performance of metadata access, thereby improving the overall performance bottleneck of the distributed system.
Description
Technical Field
The present invention relates to the field of storage, and in particular, to a method and an apparatus for reading and writing metadata of a distributed storage system.
Background
In current distributed NAS (network attached storage) systems, data is generally stored on an HDD (hard disk drive), and metadata is generally stored on an SSD (solid state drive). Given the far superior performance of SSDs over HDDs and the far greater frequency of metadata access than data access, this combination is currently the most common application. Meanwhile, when data is written into the disk, the log is written firstly and then the data is really written, random disk writing is converted into sequential disk writing, the efficiency of data disk writing can be improved, and the overall performance is improved. Furthermore, the SSD disks are used for grading in the data layer, the data to be written is firstly written into the SSD layer and is migrated to the HDD layer in the background, and therefore the performance of writing the data is close to the performance of directly using the SSD and is far better than the performance of the HDD. Metadata is generally very small, and for a system, reading and writing of the metadata is small file reading and writing access, but the performance of small file access is very poor, and although an SSD is used for storing the metadata, the SSD still cannot be changed to be a bottleneck problem of metadata access.
For the problem that metadata access becomes a system bottleneck in the prior art, no effective solution is available at present.
Disclosure of Invention
In view of this, an object of the embodiments of the present invention is to provide a method and an apparatus for reading and writing metadata of a distributed storage system, which can improve performance of metadata access, thereby improving an overall performance bottleneck of the distributed storage system.
Based on the above object, a first aspect of the embodiments of the present invention provides a metadata read-write method for a distributed storage system, including the following steps:
in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware;
continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat;
in response to the heat of metadata residing in the second storage pool exceeding the heat threshold, the metadata having a heat exceeding the heat threshold is copied to the first storage pool for direct destaging.
In some embodiments, randomly writing metadata to the direct destage in the first storage pool comprises: the metadata is directly landed in the first storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, the copying to the second storage pool directly to the disk comprises: the metadata is directly landed in the second storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, the method further comprises: after the data is copied to the second storage pool and directly landed, the redundant metadata of the first storage pool is also deleted; after copying to the first storage pool, directly dropping the disk, also deleting the redundant metadata of the second storage pool,
in some embodiments, determining the least hot metadata comprises: metadata that is accessed the least number of times within a time period is determined as least hot metadata.
In some embodiments, the method further comprises: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
In some embodiments, adaptively modifying the heat of reading the metadata comprises: the number of times it is accessed in a time period is incremented by one each time the metadata is read.
A second aspect of the embodiments of the present invention provides a metadata read/write apparatus for a distributed storage system, including:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware;
continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat;
in response to a heat for metadata located in the second storage pool exceeding a heat threshold, the metadata having a heat exceeding the heat threshold is copied to a direct destage in the first storage pool.
In some embodiments, randomly writing metadata to the direct destage in the first storage pool comprises: directly dropping the metadata into the first storage pool in a random writing mode, and not generating sequential write data recording metadata storage addresses; the copying to the second storage pool for the direct destage comprises: the metadata is directly landed in the second storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, determining the least hot metadata comprises: determining the metadata which is accessed the least times in a time period as the metadata with the minimum heat;
the method also comprises the following steps: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
The invention has the following beneficial technical effects: according to the metadata read-write method and device for the distributed storage system, provided by the embodiment of the invention, the metadata are randomly written into a first storage pool which uses a persistent memory as hardware for direct disk-dropping by responding to a write-in request with the metadata; continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold; in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat; and in response to the fact that the heat of the metadata in the second storage pool exceeds the heat threshold, copying the metadata with the heat exceeding the heat threshold to the first storage pool for direct disk-dropping, so that the performance of metadata access can be improved, and further the overall performance bottleneck of the distributed system is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a metadata read-write method of a distributed storage system according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.
It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.
Based on the above object, a first aspect of the embodiments of the present invention provides an embodiment of a metadata read-write method for improving the performance bottleneck of the distributed system as a whole. Fig. 1 is a schematic flowchart illustrating a metadata reading and writing method of a distributed storage system according to the present invention.
The metadata reading and writing method of the distributed storage system, as shown in fig. 1, includes the following steps:
step S101, responding to a write request with metadata, and randomly writing the metadata into a first storage pool using a persistent memory as hardware for direct disk-dropping;
step S103, in response to the fact that the metadata storage amount of the first storage pool exceeds a capacity threshold, continuously determining the metadata with the minimum heat degree in the first storage pool, copying the metadata to a second storage pool which uses a solid state disk as hardware, and directly dropping the metadata until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
step S105, responding to the reading request of the metadata in the second storage pool, reading the metadata from the second storage pool and adaptively modifying the heat degree of the metadata;
and S107, in response to the fact that the heat of the metadata in the second storage pool exceeds the heat threshold, copying the metadata with the heat exceeding the heat threshold into the first storage pool for direct destaging.
The persistent memory used by the invention is a memory-level and persistent medium, has lower performance than a common memory, but is far better than an external storage medium such as an SSD (solid state drive) and has the characteristic of random byte access. The method has the greatest advantage that the read-write performance is slightly influenced by the size of read-write data, and is more suitable for a scene of small file access (such as metadata) compared with other storage media.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like. Embodiments of the computer program may achieve the same or similar effects as any of the preceding method embodiments to which it corresponds.
In some embodiments, randomly writing metadata to the direct destage in the first storage pool comprises: the metadata is directly landed in the first storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, the copying to the second storage pool directly to the disk comprises: the metadata is directly landed in the second storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, the method further comprises: after the data is copied to the second storage pool and directly landed, the redundant metadata of the first storage pool is also deleted; after copying to the first storage pool, directly dropping the disk, also deleting the redundant metadata of the second storage pool,
in some embodiments, determining the least hot metadata comprises: metadata that is accessed the least number of times within a time period is determined as least hot metadata.
In some embodiments, the method further comprises: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
In some embodiments, adaptively modifying the heat of reading the metadata comprises: the number of times it is accessed in a time period is incremented by one each time the metadata is read.
The following further illustrates embodiments of the invention in terms of specific examples.
(1) Configuring a plurality of persistent memories for each storage node and enabling the persistent mode of the persistent memories.
(2) When the cluster is deployed, the persistent memories of all the nodes are divided together to form a storage pool for storing metadata; SSDs are also partitioned together in a conventional deployment, also serving as a metadata pool.
(3) When metadata is written, the metadata is written into a storage pool formed by the persistent memory. Because the read-write time delay of the persistent memory is very low, the log is not required to be written in advance when the data is written in the persistent memory storage pool, and the actual data can be directly downloaded and stored.
(4) When the data in the persistent memory pool reaches a certain threshold, for example, about 80% of the total capacity of the persistent memory pool, data migration is started, the data with the lowest heat and the longest latest access time in the current persistent memory pool is migrated into the SSD memory pool, and is deleted from the persistent memory pool. Until the capacity of the persistent memory pool drops below a certain set threshold (which may be the same or different than the threshold at the time of migration).
(5) When data is migrated, data with low heat is preferentially selected, and when the heat is the same, data with the longest last access time is selected for migration.
(6) When the data is migrated from the persistent memory storage pool to the SSD storage pool, the migrated data is written into the SSD disk without writing logs, and the data can be directly landed.
(7) When reading data, if the accessed data is in the SSD storage pool, the hot degree is increased by 1 every time the data is accessed. And if the access heat reaches a certain threshold within a period of time, transferring the access heat from the SSD storage pool to the persistent memory storage pool, and deleting the access heat from the SSD storage pool.
It can be seen from the foregoing embodiments that, in the metadata read-write method for a distributed storage system according to an embodiment of the present invention, in response to a write request with metadata, the metadata is randomly written into a first storage pool using a persistent memory as hardware, and the first storage pool is directly landed; continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold; in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat; and in response to the fact that the heat of the metadata in the second storage pool exceeds the heat threshold, copying the metadata with the heat exceeding the heat threshold to the first storage pool for direct disk-dropping, so that the performance of metadata access can be improved, and further the overall performance bottleneck of the distributed system is improved.
It should be particularly noted that, steps in the embodiments of the metadata read/write method for the distributed storage system may be mutually intersected, replaced, added, and deleted, so that the metadata read/write method for the distributed storage system based on these reasonable permutation and combination transformations shall also belong to the scope of the present invention, and shall not limit the scope of the present invention to the described embodiments.
In view of the foregoing, a second aspect of the embodiments of the present invention provides an embodiment of a metadata read/write apparatus for improving the performance bottleneck of the distributed system as a whole. The metadata read-write device of the distributed storage system comprises:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware;
continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat;
in response to the heat of metadata residing in the second storage pool exceeding the heat threshold, the metadata having a heat exceeding the heat threshold is copied to the first storage pool for direct destaging.
In some embodiments, randomly writing metadata to the direct destage in the first storage pool comprises: directly dropping the metadata into the first storage pool in a random writing mode, and not generating sequential write data recording metadata storage addresses; the copying to the second storage pool for the direct destage comprises: the metadata is directly landed in the second storage pool in a random write manner, and sequential write data describing the metadata storage addresses is not generated.
In some embodiments, determining the least hot metadata comprises: determining the metadata which is accessed the least times in a time period as the metadata with the minimum heat;
the method also comprises the following steps: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
As can be seen from the foregoing embodiments, the metadata read/write apparatus for a distributed storage system according to an embodiment of the present invention responds to a write request with metadata, and randomly writes the metadata into a first storage pool that uses a persistent memory as hardware, and directly drops the metadata from the first storage pool; continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold; in response to a read request for metadata residing in the second storage pool, reading the metadata from the second storage pool and adaptively modifying its heat; and in response to the fact that the heat of the metadata in the second storage pool exceeds the heat threshold, copying the metadata with the heat exceeding the heat threshold to the first storage pool for direct disk-dropping, so that the performance of metadata access can be improved, and further the overall performance bottleneck of the distributed system is improved.
It should be particularly noted that, the above-mentioned embodiment of the metadata reading and writing apparatus for a distributed storage system adopts an embodiment of the metadata reading and writing method for a distributed storage system to specifically describe the working process of each module, and those skilled in the art can easily think that these modules are applied to other embodiments of the metadata reading and writing method for a distributed storage system. Of course, since all steps in the metadata reading and writing method embodiment of the distributed storage system may be intersected, replaced, added, or deleted, these metadata reading and writing apparatuses of the distributed storage system that are transformed by reasonable permutation and combination also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the above embodiment.
The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of an embodiment of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.
Claims (10)
1. A metadata read-write method of a distributed storage system is characterized by comprising the following steps:
in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware;
continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
in response to a read request for metadata residing in said second storage pool, reading metadata from said second storage pool and adaptively modifying its heat;
in response to the heat of the metadata in the second storage pool exceeding a heat threshold, copying the metadata with the heat exceeding the heat threshold to the first storage pool for direct destaging.
2. The method of claim 1, wherein randomly writing metadata to a direct destage in the first storage pool comprises: and directly dropping the metadata into the first storage pool in a random writing mode, and generating no sequential writing data for recording the storage addresses of the metadata.
3. The method of claim 1, wherein the copying to the direct destage in the second storage pool comprises: and directly dropping the metadata into the second storage pool in a random writing mode, and generating no sequential writing data for recording the storage addresses of the metadata.
4. The method of claim 1, further comprising: after the data is copied to a second storage pool for direct disk-dropping, the redundant metadata of the first storage pool is also deleted; and after the direct disk-drop of the second storage pool into the first storage pool, deleting the redundant metadata of the second storage pool.
5. The method of claim 1, wherein determining the least hot metadata comprises: metadata that is accessed the least number of times within a time period is determined as least hot metadata.
6. The method of claim 5, further comprising: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
7. The method of claim 1, wherein adaptively modifying the heat of reading the metadata comprises: the number of times it is accessed in a time period is incremented by one each time the metadata is read.
8. A metadata read-write apparatus for a distributed storage system, comprising:
a processor; and
a memory storing program code executable by the processor, the program code when executed performing the steps of:
in response to a write request with metadata, randomly writing the metadata to a direct destage in a first storage pool using a persistent memory as hardware;
continuously determining the least hot metadata in the first storage pool and copying the least hot metadata to a second storage pool using a solid state disk as hardware in response to the metadata storage amount of the first storage pool exceeding a capacity threshold until the metadata storage amount of the first storage pool does not exceed the capacity threshold;
in response to a read request for metadata residing in said second storage pool, reading metadata from said second storage pool and adaptively modifying its heat;
in response to the heat of the metadata in the second storage pool exceeding a heat threshold, copying the metadata with the heat exceeding the heat threshold to the first storage pool for direct destaging.
9. The apparatus of claim 8, wherein randomly writing metadata to a direct destage in the first storage pool comprises: directly dropping metadata into the first storage pool in a random writing mode, and not generating sequential write data recording metadata storage addresses;
the copying to the second storage pool for the direct destage comprises: and directly dropping the metadata into the second storage pool in a random writing mode, and generating no sequential writing data for recording the storage addresses of the metadata.
10. The apparatus of claim 9, wherein determining the least hot metadata comprises: determining the metadata which is accessed the least times in a time period as the metadata with the minimum heat;
the steps further include: and in response to the simultaneous existence of a plurality of metadata with the least number of times of access in a time period, determining the metadata with the earliest time of last access as the metadata with the least heat.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011307683.7A CN112328181A (en) | 2020-11-19 | 2020-11-19 | Metadata reading and writing method and device of distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011307683.7A CN112328181A (en) | 2020-11-19 | 2020-11-19 | Metadata reading and writing method and device of distributed storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112328181A true CN112328181A (en) | 2021-02-05 |
Family
ID=74321397
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011307683.7A Withdrawn CN112328181A (en) | 2020-11-19 | 2020-11-19 | Metadata reading and writing method and device of distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112328181A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116661685A (en) * | 2023-05-18 | 2023-08-29 | 清华大学 | Hierarchical storage method and system for object storage metadata of business behavior awareness |
-
2020
- 2020-11-19 CN CN202011307683.7A patent/CN112328181A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116661685A (en) * | 2023-05-18 | 2023-08-29 | 清华大学 | Hierarchical storage method and system for object storage metadata of business behavior awareness |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10671290B2 (en) | Control of storage of data in a hybrid storage system | |
| CN108647151B (en) | Full flash system metadata disk-dropping method, device, equipment and storage medium | |
| EP3617867B1 (en) | Fragment management method and fragment management apparatus | |
| US8996799B2 (en) | Content storage system with modified cache write policies | |
| KR101014040B1 (en) | Appratus and method for managing dram buffer | |
| US9189493B2 (en) | Object file system | |
| KR20100065786A (en) | Cache synchronization method and system for fast power-off | |
| WO2018171296A1 (en) | File merging method and controller | |
| CN108733306A (en) | A kind of Piece file mergence method and device | |
| CN112799595B (en) | Data processing method, device and storage medium | |
| CN111309245B (en) | Hierarchical storage writing method and device, reading method and device and system | |
| CN112379825B (en) | Distributed data storage method and device based on data feature sub-pools | |
| CN112328181A (en) | Metadata reading and writing method and device of distributed storage system | |
| JP2006079274A (en) | File management device, network system, file management method and program | |
| KR102589609B1 (en) | Snapshot management in partitioned storage | |
| US11847337B2 (en) | Data parking for ZNS devices | |
| US20110264848A1 (en) | Data recording device | |
| CN112083883B (en) | Storage system and method for use in storage system | |
| US20220137879A1 (en) | Storage server, a method of operating the same storage server and a data center including the same storage server | |
| JP2006079273A (en) | File management device, network system, file management method, and program | |
| CN117762906B (en) | Redis-based cold and hot data separation method and system | |
| US11853563B1 (en) | Key value data storage device with tiers | |
| US11966630B2 (en) | Key-to-physical table optimization for key value data storage devices | |
| JP2023502341A (en) | Duplicate copy of cache using heterogeneous memory types | |
| CN117785034A (en) | Hierarchical caching system, method and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210205 |
|
| WW01 | Invention patent application withdrawn after publication |