CN112486943A - Distributed file storage system and method based on FastDFS + Redis - Google Patents
Distributed file storage system and method based on FastDFS + Redis Download PDFInfo
- Publication number
- CN112486943A CN112486943A CN202011573535.XA CN202011573535A CN112486943A CN 112486943 A CN112486943 A CN 112486943A CN 202011573535 A CN202011573535 A CN 202011573535A CN 112486943 A CN112486943 A CN 112486943A
- Authority
- CN
- China
- Prior art keywords
- file
- redis
- fastdfs
- deletion
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims description 19
- 238000012217 deletion Methods 0.000 claims abstract description 49
- 230000037430 deletion Effects 0.000 claims abstract description 49
- 230000006835 compression Effects 0.000 claims abstract description 14
- 238000007906 compression Methods 0.000 claims abstract description 14
- 230000008030 elimination Effects 0.000 claims description 5
- 238000003379 elimination reaction Methods 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000005096 rolling process Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000002360 explosive Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/162—Delete operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
本发明涉及一种基于FastDFS+Redis的分布式文件存储系统，包括数据库和中间件；所述中间包括存储模块、查询模块和删除模块；所述存储模块利用FastDFS集群实现海量文件数据的分布式存储；所述查询模块利用Redis集群实现基于分布式缓存的高性能文件查询；所述删除模块提供分布式文件的删除功能。本发明提出一种基于Base64和Gzip压缩算法的文件压缩缓存策略，解决了Redis缓存文件时字符串长度过长、内存空间占用大的问题，并设计了一种基于文件使用频率的缓存替换算法，提高了缓存的命中率。
The invention relates to a distributed file storage system based on FastDFS+Redis, including a database and middleware; the middle includes a storage module, a query module and a deletion module; the storage module utilizes FastDFS cluster to realize distributed storage of massive file data the query module utilizes Redis cluster to realize high-performance file query based on distributed cache; the deletion module provides the deletion function of distributed files. The invention proposes a file compression caching strategy based on Base64 and Gzip compression algorithms, which solves the problems of excessively long string length and large memory space occupation when Redis caches files, and designs a cache replacement algorithm based on file usage frequency. Improve cache hit rate.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a distributed file storage system and method based on FastDFS + Redis.
Background
With the development of the internet, the arrival of a big data age is promoted. In the process, structured data is growing at an explosive rate in addition to unstructured data. Structured data typically refers to small files that are between 2KB-1MB in size. The storage of file data comprises the storage of file metadata and file contents, the storage of the file metadata usually adopts MySQL at present, and the access performance is sharply reduced when the data scale is larger and larger; the FastDFS is used as a lightweight open-source distributed file system and is suitable for storage of small and medium files, but the FastDFS stores data on a disk, the data needs to be read from the disk every time of access, and the query performance is reduced due to multiple IO. In order to reduce the access times of a disk and improve the reading speed of a file, Redis is introduced as a file cache service in an optional scheme, but the Redis is a database based on a memory, and the problems of overlarge memory space occupation and low query performance can be caused by directly utilizing the Redis cache file, so that the method cannot be applied to large-scale file data; in addition, when Redis is used as a cache service, 6 native cache elimination strategies provided by Redis have low cache hit rate for random and periodic queries.
Disclosure of Invention
In view of this, the present invention aims to provide a distributed file storage system and method based on FastDFS + Redis, which achieve more efficient storage and reading and writing of file data, solve the problems of too long length of character strings and large occupied memory space when the Redis caches files, improve the utilization rate of memory space, and have a good cache hit rate.
In order to achieve the purpose, the invention adopts the following technical scheme:
a distributed file storage system based on FastDFS + Redis comprises a database and a middleware; the middleware comprises a storage module, a query module and a deletion module; the storage module realizes distributed storage of mass file data by using a FastDFS cluster; the query module utilizes a Redis cluster to realize high-performance file query based on distributed cache; the deletion module provides a deletion function of the distributed file.
Further, the storage module comprises a file uploading component, a cache compression component and a cache replacement component.
The file uploading method of the distributed file storage system based on the FastDFS + Redis comprises the following steps:
step 1: acquiring file content and file metadata information according to the designated path, and uploading the file to FastDFS;
step 2: judging whether the file uploading is successful or not, if so, throwing out the exception, and ending;
and step 3: writing the returned FileID and metadata after successful uploading into Redis;
and 4, step 4: judging whether Redis data writing is successful or not, and if so, uploading the file successfully;
and 5: judging whether the Redis writing times are smaller than a system default setting value or not, and turning to the step 3 if the Redis writing times are smaller than the system default setting value;
step 6: the file is deleted from the FastDFS and an upload failure is returned.
Further, the metadata storage of the file specifically includes: and setting character strings formed by splicing the three fields of the owner, the file name and the file type in the metadata as keys, and writing the character strings formed by splicing the rest fields and the FileID into Redis in a key-value mode as values corresponding to the keys.
Further, the cache compression component encodes the file to be cached by using Base64, compresses the encoded file by using a Gzip algorithm, and finally writes the encoded and compressed file into Redis.
A cache replacement method of a distributed file storage system based on FastDFS + Redis comprises the following steps:
step 1: recording the use times of the file by using a history queue;
step 2: writing the file index into a history access queue, and adding 1 to the use times of the record if the index of the file already exists; if the file index does not exist, writing the file index into an access queue, and setting the use times to be 1;
and step 3: when the using times of the file reach k times, writing the file after the coding compression into a Redis cache;
and 4, step 4: judging whether the cache capacity is smaller than a preset threshold value of the system, if so, turning to step 6;
and 5: according to the file use frequency, carrying out elimination selection of cache;
step 6: and writing the encoded and compressed file data into Redis.
Preferably, the file usage frequency calculation formula is as follows:
wherein
The frequency of use of the file is indicated,
the period is represented by the number of cycles,
indicating the number of uses of the file in the period,
indicating the frequency of use of the file in the last cycle,
indicating the number of cycles.
Further, the query module queries Redis according to the query condition, and if the cache of the file exists in the Redis, the file is decompressed by a Gzip algorithm and decoded by Base 64; otherwise, the file is obtained by inquiring FastDFS by using the FileID, the recorded inquiry times are updated, and whether the execution conditions of the cache replacement algorithm are met or not is judged.
A deleting method of a distributed file storage system based on FastDFS + Redis comprises the following steps:
step 1: querying Redis according to the deletion condition to obtain the FileID of the file;
step 2: judging whether a cache of the file exists in Redis, and turning to the step 6 if the cache of the file exists in the Redis;
and step 3: deleting the files saved on the FastDFS according to the FileID;
and 4, step 4: judging whether the file deletion is successful or not, and ending if the file deletion is successful;
and 5: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 3; otherwise, ending;
step 6: copying the file as a copy;
and 7: executing the operation of simultaneous deletion, and deleting the cache on Redis and the file on FastDFS respectively;
and 8: judging whether the deletion is successful at the same time, if so, finishing the deletion;
and step 9: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 7;
step 10: and rolling back the deletion operation, rewriting the copy saved in advance into the middleware, and ending.
Compared with the prior art, the invention has the following beneficial effects:
1. the invention realizes the distributed storage of mass file data by using the FastDFS cluster, and realizes the high-performance file query based on the distributed cache by using the Redis cluster, so that the system has good query performance.
2. The invention provides a file compression caching strategy based on Base64 and Gzip compression algorithms, solves the problems of overlong character string length and large memory space occupation when a Redis caches files, and improves the utilization rate of the memory space.
3. The invention designs a cache replacement algorithm based on the file use frequency, so that the system has good cache hit rate.
Drawings
FIG. 1 is a schematic diagram of the system architecture of the present invention;
FIG. 2 is a flowchart illustrating file upload according to an embodiment of the present invention;
FIG. 3 is a flow chart of cache write in an embodiment of the present invention;
FIG. 4 is a flow diagram of a query module in accordance with an embodiment of the present invention;
FIG. 5 is a flow chart of a delete module in an embodiment of the present invention.
Detailed Description
The invention is further explained below with reference to the drawings and the embodiments.
Referring to fig. 1, the present invention provides a distributed file storage system based on FastDFS + Redis, which includes a database and a middleware; the middleware comprises a storage module, a query module and a deletion module; the storage module realizes distributed storage of mass file data by using a FastDFS cluster; the query module utilizes a Redis cluster to realize high-performance file query based on distributed cache; the deletion module provides a deletion function of the distributed file. The storage module comprises a file uploading component, a cache compression component and a cache replacement component.
Referring to fig. 2, in the present embodiment, the file upload component implements storing file metadata using a Redis cluster and storing files using a FastDFS cluster; the uploading of the file comprises the storage of the file content and the file metadata, and the file uploading can be determined to be successful only if the file content and the file metadata are stored successfully. If any one of the items fails to be uploaded, the file uploading failure is represented. The method can attempt uploading for multiple times within a threshold preset by a system, and represents that the file uploading finally fails after the threshold is reached, and specifically comprises the following steps:
step 1: acquiring file content and file metadata information according to the designated path, and uploading the file to FastDFS;
step 2: judging whether the file uploading is successful or not, if so, throwing out the exception, and ending;
and step 3: writing the returned FileID and metadata memory into Redis after the file is uploaded successfully;
and 4, step 4: judging whether Redis data writing is successful or not, and if so, uploading the file successfully;
and 5: judging whether the Redis writing times are smaller than a system default setting value or not, and turning to the step 3 if the Redis writing times are smaller than the system default setting value;
step 6: the file is deleted from the FastDFS and an upload failure is returned.
In this embodiment, the metadata storage of the file specifically includes: and setting character strings formed by splicing the three fields of the owner, the file name and the file type in the metadata as keys, and writing the character strings formed by splicing the rest fields and the FileID into Redis in a key-value mode as values corresponding to the keys.
In this embodiment, the cache compression component encodes the file to be cached using Base64, performs Gzip compression on the encoded file, and finally writes the encoded and compressed file into Redis.
Referring to fig. 3, in this embodiment, the cache replacement component calculates a final use frequency value of a file by using a current period use frequency and a historical use frequency value of the file, writes the encoded and compressed file into Redis when the number of use times of the file reaches k times, and performs cache elimination selection according to the level of the frequency value if the cache space is full.
The specific cache replacement method comprises the following steps:
step 1: recording the use times of the file by using a history queue;
step 2: writing the file index into a history access queue, and adding 1 to the use times of the record if the index of the file already exists; if the file index does not exist, writing the file index into an access queue, and setting the use times to be 1;
and step 3: when the using times of the file reach k times, writing the file after the coding compression into a Redis cache;
and 4, step 4: judging whether the cache capacity is smaller than a preset threshold value of the system, if so, turning to step 6;
and 5: according to the file use frequency, carrying out elimination selection of cache;
step 6: and writing the encoded and compressed file data into Redis.
Preferably, the file usage frequency calculation formula is as follows:
wherein
The frequency of use of the file is indicated,
the period is represented by the number of cycles,
indicating the number of uses of the file in the period,
indicating the frequency of use of the file in the last cycle,
indicating the number of cycles.
Referring to fig. 4, in this embodiment, the query module queries Redis according to a query condition, and if the file cache exists in the Redis, returns the file decompressed by Gzip algorithm and decoded by Base 64; otherwise, the file is obtained by inquiring FastDFS by using the FileID, the recorded inquiry times are updated, and whether the execution conditions of the cache replacement algorithm are met or not is judged. The method specifically comprises the following steps:
step 1: and generating a Key according to the query condition input by the user and querying Redis.
Step 2: and judging whether the file exists in the Redis, and if not, turning to the step 5.
And step 3: the recorded number of queries is updated.
And 4, step 4: and returning the file which is decompressed by the Gzip algorithm and decoded by the Base 64.
And 5: redis is queried to obtain FileID.
Step 6: query FastDFS according to FileID, return file.
Referring to fig. 5, in this embodiment, the deletion module determines the location where the file is stored by a query operation to perform a deletion operation, and when the deleted file is a hot file, the file needs to be synchronously deleted from the Redis and the FastDFS; when the file is a cold file, the file need only be deleted on the FastDFS. The file deletion method can try to delete for multiple times, and when a preset threshold value of a system is reached, the file deletion finally fails, and the method specifically comprises the following steps:
step 1: querying Redis according to the deletion condition to obtain the FileID of the file;
step 2: judging whether a cache of the file exists in Redis, and turning to the step 6 if the cache of the file exists in the Redis;
and step 3: deleting the files saved on the FastDFS according to the FileID;
and 4, step 4: judging whether the file deletion is successful or not, and ending if the file deletion is successful;
and 5: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 3; otherwise, ending;
step 6: copying the file as a copy;
and 7: executing the operation of simultaneous deletion, and deleting the cache on Redis and the file on FastDFS respectively;
and 8: judging whether the deletion is successful at the same time, if so, finishing the deletion;
and step 9: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 7;
step 10: and rolling back the deletion operation, rewriting the copy saved in advance into the middleware, and ending.
The above description is only a preferred embodiment of the present invention, and all equivalent changes and modifications made in accordance with the claims of the present invention should be covered by the present invention.
Claims (9)
1. A distributed file storage system based on FastDFS + Redis is characterized by comprising a database and middleware; the middleware comprises a storage module, a query module and a deletion module; the storage module realizes distributed storage of mass file data by using a FastDFS cluster; the query module utilizes a Redis cluster to realize high-performance file query based on distributed cache; the deletion module provides a deletion function of the distributed file.
2. The FastDFS + Redis-based distributed file storage system according to claim 1, wherein the storage module comprises a file upload component, a cache compression component, and a cache replacement component.
3. The method for file upload to a distributed file storage system based on FastDFS + Redis according to claim 2, comprising the steps of:
step 1: acquiring file content and file metadata information according to the designated path, and uploading the file to FastDFS;
step 2: judging whether the file is uploaded successfully or not, if the file fails, throwing out an exception, and ending;
and step 3: writing the returned FileID and metadata after successful uploading into Redis;
and 4, step 4: judging whether Redis data writing is successful or not, and if so, uploading the file successfully;
and 5: judging whether the Redis writing times are smaller than a system default setting value or not, and turning to the step 3 if the Redis writing times are smaller than the system default setting value;
step 6: the file is deleted from the FastDFS and an upload failure is returned.
4. The file uploading method of the distributed file storage system based on FastDFS + Redis according to claim 3, wherein the metadata storage of the file is specifically: and setting character strings formed by splicing the three fields of the owner, the file name and the file type in the metadata as keys, and writing the character strings formed by splicing the rest fields and the FileID into Redis in a key-value mode as values corresponding to the keys.
5. The FastDFS + Redis-based distributed file storage system of claim 2, wherein the cache compression component encodes the file to be cached using Base64, compresses the encoded file using Gzip algorithm, and finally writes the encoded compressed file to Redis.
6. The method for cache replacement of a FastDFS + Redis-based distributed file storage system according to claim 2, comprising the steps of:
step 1: recording the use times of the file by using a history queue;
step 2: writing the file index into a history access queue, and adding 1 to the use times of the record if the index of the file already exists; if the file index does not exist, writing the file index into an access queue, and setting the use times to be 1;
and step 3: when the using times of the file reach k times, writing the file after the coding compression into a Redis cache;
and 4, step 4: judging whether the cache capacity is smaller than a preset threshold value of the system, if so, turning to step 6;
and 5: according to the file use frequency, carrying out elimination selection of cache;
step 6: and writing the encoded and compressed file data into Redis.
7. The method for cache replacement of a distributed file storage system based on FastDFS + Redis according to claim 6, wherein the file usage frequency calculation formula is as follows:
wherein
The frequency of use of the file is indicated,
the period is represented by the number of cycles,
indicating the number of uses of the file in the period,
indicating the frequency of use of the file in the last cycle,
indicating the number of cycles.
8. The distributed file storage system based on FastDFS + Redis according to claim 1, wherein the query module queries Redis according to the query condition, and if the cache of the file exists in the Redis, the file is returned after being decompressed by Gzip algorithm and decoded by Base 64; otherwise, the file is obtained by inquiring FastDFS by using the FileID, the recorded inquiry times are updated, and whether the execution conditions of the cache replacement algorithm are met or not is judged.
9. The method for deleting a FastDFS + Redis-based distributed file storage system according to claim 1, comprising the steps of:
step 1: querying Redis according to the deletion condition to obtain the FileID of the file;
step 2: judging whether a cache of the file exists in Redis, and turning to the step 6 if the cache of the file exists in the Redis;
and step 3: deleting the files saved on the FastDFS according to the FileID;
and 4, step 4: judging whether the file deletion is successful or not, and ending if the file deletion is successful;
and 5: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 3; otherwise, ending;
step 6: copying the file as a copy;
and 7: executing the operation of simultaneous deletion, and deleting the cache on Redis and the file on FastDFS respectively;
and 8: judging whether the deletion is successful at the same time, if so, finishing the deletion;
and step 9: judging whether the attempted deletion frequency is smaller than a preset threshold value of the system, if so, adding one to the deletion frequency, and turning to the step 7;
step 10: and rolling back the deletion operation, rewriting the copy saved in advance into the middleware, and ending.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011573535.XA CN112486943A (en) | 2020-12-28 | 2020-12-28 | Distributed file storage system and method based on FastDFS + Redis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011573535.XA CN112486943A (en) | 2020-12-28 | 2020-12-28 | Distributed file storage system and method based on FastDFS + Redis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112486943A true CN112486943A (en) | 2021-03-12 |
Family
ID=74915682
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011573535.XA Pending CN112486943A (en) | 2020-12-28 | 2020-12-28 | Distributed file storage system and method based on FastDFS + Redis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112486943A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114490536A (en) * | 2022-01-26 | 2022-05-13 | 江苏东交智控科技集团股份有限公司 | Distributed file management service center based on lightweight file system FastDFS |
| CN114817176A (en) * | 2022-04-24 | 2022-07-29 | 福建财通信息科技有限公司 | A distributed file storage system and method based on Nginx+MinIO+Redis |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100049921A1 (en) * | 2008-08-25 | 2010-02-25 | International Business Machines Corporation | Distributed Shared Caching for Clustered File Systems |
| CN105549905A (en) * | 2015-12-09 | 2016-05-04 | 上海理工大学 | Method for multiple virtual machines to access distributed object storage system |
| CN107341267A (en) * | 2017-07-24 | 2017-11-10 | 郑州云海信息技术有限公司 | A kind of distributed file system access method and platform |
| CN109871367A (en) * | 2019-02-28 | 2019-06-11 | 江苏实达迪美数据处理有限公司 | A kind of distributed cold and heat data separation method based on Redis and HBase |
-
2020
- 2020-12-28 CN CN202011573535.XA patent/CN112486943A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100049921A1 (en) * | 2008-08-25 | 2010-02-25 | International Business Machines Corporation | Distributed Shared Caching for Clustered File Systems |
| CN105549905A (en) * | 2015-12-09 | 2016-05-04 | 上海理工大学 | Method for multiple virtual machines to access distributed object storage system |
| CN107341267A (en) * | 2017-07-24 | 2017-11-10 | 郑州云海信息技术有限公司 | A kind of distributed file system access method and platform |
| CN109871367A (en) * | 2019-02-28 | 2019-06-11 | 江苏实达迪美数据处理有限公司 | A kind of distributed cold and heat data separation method based on Redis and HBase |
Non-Patent Citations (1)
| Title |
|---|
| 刘秋彤: ""基于云平台的分布式医学影像数据存储技术的研究与应用"", 《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114490536A (en) * | 2022-01-26 | 2022-05-13 | 江苏东交智控科技集团股份有限公司 | Distributed file management service center based on lightweight file system FastDFS |
| CN114817176A (en) * | 2022-04-24 | 2022-07-29 | 福建财通信息科技有限公司 | A distributed file storage system and method based on Nginx+MinIO+Redis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102364474B (en) | Metadata storage system for cluster file system and metadata management method | |
| US9798754B1 (en) | Method to efficiently track I/O access history using efficient memory data structures | |
| JP5445682B2 (en) | Storage system | |
| Nam et al. | Assuring demanded read performance of data deduplication storage with backup datasets | |
| CN110347852B (en) | File system and file management method embedded in horizontally scalable key-value storage system | |
| CN115427941A (en) | Data management system and control method | |
| CN102760101A (en) | SSD-based (Solid State Disk) cache management method and system | |
| CN110196847A (en) | Data processing method and device, storage medium and electronic device | |
| CN110532200B (en) | A memory system based on hybrid memory architecture | |
| US10509769B1 (en) | Method to efficiently track I/O access history | |
| CN110795363B (en) | Hot page prediction method and paging method for storage medium | |
| CN115774699B (en) | Database shared dictionary compression method and device, electronic equipment and storage medium | |
| CN112486943A (en) | Distributed file storage system and method based on FastDFS + Redis | |
| CN111858469A (en) | A Adaptive Hierarchical Storage Method Based on Time Sliding Window | |
| US10474588B1 (en) | Method and system for memory-based data caching | |
| CN109388341A (en) | A kind of system storage optimization method based on Device Mapper | |
| CN102073690B (en) | Method for constructing memory database supporting historical Key information | |
| Carniel et al. | A generic and efficient framework for flash-aware spatial indexing | |
| Lee et al. | An efficient index buffer management scheme for implementing a B-tree on NAND flash memory | |
| CN118535089B (en) | A hybrid storage read cache design method based on elastic memory | |
| CN105988720B (en) | Data storage device and method | |
| US10417215B2 (en) | Data storage over immutable and mutable data stages | |
| CN112347044B (en) | Object storage optimization method based on SPDK | |
| CN110309081A (en) | A Method of FTL Reading and Writing Data Pages Based on Compressed Storage and Address Mapping Table Entries | |
| CN111858470A (en) | A Time Window Migration Strategy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210312 |
|
| RJ01 | Rejection of invention patent application after publication |