CN111143288A - Data storage method, system and related device - Google Patents
Data storage method, system and related device Download PDFInfo
- Publication number
- CN111143288A CN111143288A CN201911332561.0A CN201911332561A CN111143288A CN 111143288 A CN111143288 A CN 111143288A CN 201911332561 A CN201911332561 A CN 201911332561A CN 111143288 A CN111143288 A CN 111143288A
- Authority
- CN
- China
- Prior art keywords
- data
- stored
- storage
- local storage
- fingerprint value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/137—Hash-based
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/162—Delete operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
Abstract
The application provides a data storage method, which comprises the following steps: when a fingerprint value of data to be stored is received, judging whether the fingerprint value exists in a local storage or not; if yes, storing the data to be stored into an independent storage area; judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not; if so, deleting the data to be stored from the independent storage area; and if not, transferring the data to be stored from the independent storage area to the local storage. The data storage consistency is ensured by utilizing the independent storage area to solve the problem of possible data mis-deletion due to hash collision. The application also provides a data storage system, a computer readable storage medium and a server, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of data storage, and in particular, to a data storage method, system and related apparatus.
Background
In the storage field, huge resources are required to be occupied for mass data query and storage, and the performance of data storage is seriously influenced. In order to reduce the resources occupied by the stored data and improve the data storage performance, the repeated data can be completely stored in a storage medium, and the storage quantity of the data on the disk is reduced on the premise of not influencing the data consistency. The method for judging whether the data are repeated is to calculate the data fingerprint value through a Hash algorithm and compare the fingerprint value as the basis for judging whether the data are the same. But the hash algorithm has hash collision, namely different data obtains the same hash value through hash operation.
Therefore, how to solve the influence of the hash collision on the data storage is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
The application aims to provide a data storage method, a data storage system, a computer readable storage medium and a server, which can solve hash conflicts during data storage.
In order to solve the above technical problem, the present application provides a data storage method, which has the following specific technical scheme:
when a fingerprint value of data to be stored is received, judging whether the fingerprint value exists in a local storage or not;
if yes, storing the data to be stored into an independent storage area;
judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not;
if so, deleting the data to be stored from the independent storage area;
and if not, transferring the data to be stored from the independent storage area to the local storage.
Before judging whether the fingerprint value exists in the local storage, the method further comprises the following steps:
and receiving the data to be stored, and calculating the fingerprint value of the data to be stored by utilizing a Hash algorithm.
Wherein, after deleting the data to be stored from the independent storage area, the method further comprises:
and updating the LP metadata and the PL metadata of the data to be stored to the local storage.
Wherein if the fingerprint value does not exist in the local storage, the method further comprises:
and writing the data to be stored into the local storage, and storing HP metadata, LP metadata and PL metadata of the data to be stored.
Before the data to be stored is stored in the independent storage area, the method further comprises the following steps:
and dividing the independent storage area in the cache or the local storage.
Before determining whether the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage, the method further includes:
and deleting the data to be stored of which the heat value is lower than a preset threshold value in the independent storage area.
Wherein determining whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage comprises:
and judging whether the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage or not according to the sequence of the heat value of each data to be stored.
The present application further provides a data storage system, comprising:
the first judgment module is used for judging whether the fingerprint value exists in a local storage or not when the fingerprint value of the data to be stored is received;
the independent storage module is used for storing the data to be stored into an independent storage area when the judgment result of the first judgment module is negative;
the second judging module is used for judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage;
the deleting module is used for deleting the data to be stored from the independent storage area when the judgment result of the second judging module is yes;
and the unloading module is used for unloading the data to be stored from the independent storage area to the local storage when the judgment result of the second judgment module is negative.
Wherein, still include:
and the fingerprint value calculation module is used for receiving the data to be stored and calculating the fingerprint value of the data to be stored by utilizing a Hash algorithm.
Wherein the deletion module further comprises:
and the metadata updating unit is used for updating the LP metadata and the PL metadata of the data to be stored to the local storage.
Wherein, still include:
and the direct storage module is used for writing the data to be stored into the local storage and storing HP metadata, LP metadata and PL metadata of the data to be stored when the first judgment module judges that the data to be stored is positive.
Wherein, still include:
and the independent storage area dividing module is used for dividing the independent storage area in a cache or the local storage before the data to be stored is stored in the independent storage area.
Wherein, still include:
and the data deleting module is used for deleting the data to be stored of which the heat value is lower than a preset threshold value in the independent storage area before judging whether the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage.
The second determining module is specifically a module that determines, according to a magnitude order of a heat value of each piece of data to be stored, whether the piece of data to be stored is the same as stored data corresponding to the fingerprint value in the local storage.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method as set forth above.
The present application further provides a server comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the method described above when calling the computer program in the memory.
The application provides a data storage method, which comprises the following steps: when a fingerprint value of data to be stored is received, judging whether the fingerprint value exists in a local storage or not; if yes, storing the data to be stored into an independent storage area; judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not; if so, deleting the data to be stored from the independent storage area; and if not, transferring the data to be stored from the independent storage area to the local storage.
The method comprises the steps of determining whether data to be stored is stored in a local storage or not by judging a fingerprint value of the data to be stored, if the fingerprint value exists, firstly storing the data to be stored in an independent storage area, then comparing the data to be stored in the independent storage area with the stored data with the same fingerprint value in the local storage, and if the data to be stored and the stored data are consistent, indicating that the data to be stored is repeated; if the two are not consistent, the Hash conflict is confirmed to occur, at the moment, the data to be stored is transferred from the independent storage area to the local storage, the problem of data false deletion possibly caused by the Hash conflict is solved by using the independent storage area, and the consistency of data storage is ensured. The application also provides a data storage system, a computer readable storage medium and a server, which have the beneficial effects and are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of a data storage method according to an embodiment of the present application;
fig. 2 is a schematic structural diagram of a data storage system according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a flowchart of a data storage method according to an embodiment of the present application, where the method includes:
s101: when a fingerprint value of data to be stored is received, judging whether the fingerprint value exists in a local storage or not; if yes, entering S102;
in this step, when the fingerprint value is received, it is determined whether the local storage includes the fingerprint value.
The fingerprint value is generally calculated by a hash algorithm based on the characteristic information of the data, and the specific format and the like of the fingerprint value are not limited herein. The digits of the fingerprint values obtained by adopting different hash algorithms are different, and for example, the SHA-256 algorithm can be used for converting the data to be stored with any length into the fingerprint value with 256 digits. The hash algorithm has the problem of hash collision, that is, different data can obtain the same fingerprint value through the calculation of the hash algorithm. And at this point the two data sets for the same fingerprint value may not actually be the same.
When a fingerprint value is received, whether the fingerprint value exists in a local storage is judged, if the fingerprint value does not exist in the local storage, the fact that the data to be stored is not stored in the local storage is meant, and the data to be stored can be directly written into the local storage. It is readily understood that, in data storage, it is often necessary to also maintain relevant metadata. When the fingerprint value does not exist in the local storage, HP metadata (hash-pba mode data), LP metadata (lba-pba mode data) and PL metadata (pba-lba mode data) of the data to be stored can be saved. Both the LP metadata and PL metadata are metadata associated with logical block addresses and physical block addresses.
S102: storing the data to be stored into an independent storage area;
if the local storage contains the fingerprint value, it indicates that the data to be stored may already store the same data in the local storage. However, since it cannot be excluded that the fingerprint values are the same due to the hash collision, this step requires storing the data to be stored in a separate storage area.
The independent storage area is a storage block distinguished from the local storage, and can be a temporary storage area independently distinguished from the local storage and is specially used for storing data to be stored which is suspected to be the same as the stored data. The cache area may also be utilized as a separate storage area.
It will be readily appreciated that a separate storage area may also need to be partitioned in the cache or the local storage before this step is performed. The process of dividing the independent storage area only needs to be performed before the local storage has the same fingerprint value, and there is no predetermined execution order limitation with step S101.
The specific partitioning rule is not limited herein, and may be determined by a person skilled in the art according to an empirical value or according to a preset percentage of the local storage amount or the memory size. For example, whether cache or local storage is adopted, 20% can be selected as the independent storage area.
S103: judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not; if yes, entering S104; if not, entering S105;
after the data to be stored is stored in the independent storage area, the data to be stored is compared with the stored data with the same fingerprint value in the local storage, and whether the two data are the same data or not is judged.
S104: deleting the data to be stored from the independent storage area;
if the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage, the data to be stored does not need to be stored at this time, and the data to be stored can be deleted from the independent storage area.
Further, preferably, although the data to be stored already exists in the local storage, the LP metadata and PL metadata of the data to be stored may also be updated to the local storage. That is, the data metadata is updated in the local storage, which facilitates the traversal of the subsequent data.
However, it should be noted that, since it is determined that the data to be stored is the same as the data stored in the local storage, the metadata updated at this time includes only LP metadata and PL metadata, and the HP metadata does not need to be stored in the local storage because the two pieces of data are actually the same piece of data and the fingerprint values obtained by the corresponding hash algorithms are the same.
S105: and unloading the data to be stored from the independent storage area to the local storage.
If the data to be stored is different from the stored data corresponding to the fingerprint value in the local storage, the data to be stored needs to be stored in the local storage, namely, the data to be stored is transferred from the independent storage area to the local storage.
It can be seen that the independent storage area is actually used as a temporary storage area, in which a process of determining whether data of both sides of a conflict are consistent when a hash conflict occurs is performed. Once the data of the two conflicting parties are inconsistent, that is, the different data obtained the same fingerprint value due to the hash algorithm, the data to be stored needs to be transferred from the independent storage area to the local storage. And once the data of the two conflicting parties are consistent, the data to be stored is already stored in the local storage, and the data to be stored can be directly deleted from the independent storage area.
The method includes the steps that whether data to be stored are stored in a local storage or not is determined by judging a fingerprint value of the data to be stored, if the fingerprint value exists, the data to be stored are stored in an independent storage area, then the data to be stored in the independent storage area and the stored data with the same fingerprint value in the local storage are compared, and if the data to be stored and the stored data are consistent, the data to be stored are repeated; if the two are not consistent, the Hash conflict is confirmed to occur, at the moment, the data to be stored is transferred from the independent storage area to the local storage, the problem of data false deletion possibly caused by the Hash conflict is solved by using the independent storage area, and the consistency of data storage is ensured.
Further, on the basis of the above embodiment, as a preferred embodiment, before step S103, the data to be stored in the independent storage area may be divided into hot degree, and the data to be stored with a lower hot value may be deleted. Specifically, the data to be stored with the heat value lower than the preset threshold value may be deleted according to the sequence of the heat values of the data to be stored from high to low. When the heat value is low, the usage amount and the retrieval rate are low, namely the data is not common data, so that when the fingerprint value of the data to be stored exists in the local storage, the fingerprint value is directly deleted.
After that, after the data to be stored with the heat value lower than the preset threshold value is deleted, the remaining data to be stored are sorted according to the heat value, and the judgment process in the step S103 is preferentially performed on the data to be stored with the higher heat value, so that the data to be stored with the higher heat value can be preferentially landed when the stored data corresponding to the same fingerprint value in the local storage is different, and the high-value data storage rate of data storage is improved.
Then the whole execution process at this time may be as follows:
s201: when receiving a fingerprint value of data to be stored, judging whether the fingerprint value exists in a local storage; if yes, entering S202;
s202: storing data to be stored into an independent storage area;
s203: deleting the data to be stored of which the heat value in the independent storage area is lower than a preset threshold value;
s204: judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not according to the sequence of the heat value of each data to be stored; if yes, go to S205; if not, the step S206 is entered;
s205: deleting data to be stored from the independent storage area;
s206: and transferring the data to be stored from the independent storage area to the local storage.
On the basis of the embodiment, the data to be stored with the heat value lower than the preset threshold value is deleted, and the data to be stored with the higher heat value is preferentially compared with the data to be stored and the stored data, so that the local storage can preferentially store the high-heat data, the high-value data can be ensured to be dropped off as soon as possible, the low-heat data is simultaneously eliminated, and the problems that the effective utilization rate of a magnetic disk is reduced due to the fact that the local storage stores too much low-heat data and the like are solved.
In the following, a data storage system provided by an embodiment of the present application is introduced, and the data storage system described below and the data storage method described above may be referred to correspondingly.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a data storage system according to an embodiment of the present application, and the present application further provides a data storage system, including:
a first determining module 100, configured to determine whether a fingerprint value exists in a local storage when the fingerprint value of data to be stored is received;
the independent storage module 200 is used for storing the data to be stored into an independent storage area when the judgment result of the first judgment module is negative;
a second determining module 300, configured to determine whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage;
a deleting module 400, configured to delete the to-be-stored data from the independent storage area when the determination result of the second determining module is yes;
a dump module 500, configured to dump the data to be stored from the independent storage area to the local storage when the determination result of the second determining module is negative.
Based on the above embodiment, as a preferred embodiment, the method further includes:
and the fingerprint value calculation module is used for receiving the data to be stored and calculating the fingerprint value of the data to be stored by utilizing a Hash algorithm.
Based on the foregoing embodiment, as a preferred embodiment, the deleting module 400 may further include:
and the metadata updating unit is used for updating the LP metadata and the PL metadata of the data to be stored to the local storage.
Based on the above embodiment, as a preferred embodiment, the method may further include:
and the direct storage module is used for writing the data to be stored into the local storage and storing HP metadata, LP metadata and PL metadata of the data to be stored when the first judgment module judges that the data to be stored is positive.
Based on the above embodiment, as a preferred embodiment, the method further includes:
and the independent storage area dividing module is used for dividing the independent storage area in a cache or the local storage before the data to be stored is stored in the independent storage area.
Based on the above embodiment, as a preferred embodiment, the method further includes:
and the data deleting module is used for deleting the data to be stored of which the heat value is lower than a preset threshold value in the independent storage area before judging whether the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage.
Based on the foregoing embodiment, as a preferred embodiment, the second determining module is specifically a module that determines, according to a magnitude order of a heat value of each piece of data to be stored, whether the piece of data to be stored is the same as stored data corresponding to the fingerprint value in the local storage.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed, may implement the steps provided by the above-described embodiments. The storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The application also provides a server, which may include a memory and a processor, where the memory stores a computer program, and the processor may implement the steps provided by the foregoing embodiments when calling the computer program in the memory. Of course, the server may also include various network interfaces, power supplies, and the like.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the method provided by the embodiment, the description is relatively simple because the method corresponds to the method provided by the embodiment, and the relevant points can be referred to the description of the method part.
The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It is further noted that, in the present specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method of storing data, comprising:
when a fingerprint value of data to be stored is received, judging whether the fingerprint value exists in a local storage or not;
if yes, storing the data to be stored into an independent storage area;
judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage or not;
if so, deleting the data to be stored from the independent storage area;
and if not, transferring the data to be stored from the independent storage area to the local storage.
2. The data storage method of claim 1, wherein before determining whether the fingerprint value exists in the local storage, further comprising:
and receiving the data to be stored, and calculating the fingerprint value of the data to be stored by utilizing a Hash algorithm.
3. The data storage method according to claim 1, further comprising, after deleting the data to be stored from the independent storage area:
and updating the LP metadata and the PL metadata of the data to be stored to the local storage.
4. The data storage method of claim 1, wherein if the fingerprint value does not exist in the local storage, further comprising:
and writing the data to be stored into the local storage, and storing HP metadata, LP metadata and PL metadata of the data to be stored.
5. The data storage method according to claim 1, wherein before storing the data to be stored in the independent storage area, the method further comprises:
and dividing the independent storage area in the cache or the local storage.
6. The data storage method according to claim 1, wherein before determining whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage, the method further comprises:
and deleting the data to be stored of which the heat value is lower than a preset threshold value in the independent storage area.
7. The data storage method of claim 6, wherein determining whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage comprises:
and judging whether the data to be stored is the same as the stored data corresponding to the fingerprint value in the local storage or not according to the sequence of the heat value of each data to be stored.
8. A data storage system, comprising:
the first judgment module is used for judging whether the fingerprint value exists in a local storage or not when the fingerprint value of the data to be stored is received;
the independent storage module is used for storing the data to be stored into an independent storage area when the judgment result of the first judgment module is negative;
the second judging module is used for judging whether the data to be stored is the same as stored data corresponding to the fingerprint value in the local storage;
the deleting module is used for deleting the data to be stored from the independent storage area when the judgment result of the second judging module is yes;
and the unloading module is used for unloading the data to be stored from the independent storage area to the local storage when the judgment result of the second judgment module is negative.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 4.
10. A server, comprising a memory having a computer program stored therein and a processor that implements the steps of the method according to any one of claims 1-4 when called upon by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911332561.0A CN111143288A (en) | 2019-12-22 | 2019-12-22 | Data storage method, system and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911332561.0A CN111143288A (en) | 2019-12-22 | 2019-12-22 | Data storage method, system and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111143288A true CN111143288A (en) | 2020-05-12 |
Family
ID=70519285
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911332561.0A Withdrawn CN111143288A (en) | 2019-12-22 | 2019-12-22 | Data storage method, system and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111143288A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113064556A (en) * | 2021-04-29 | 2021-07-02 | 山东英信计算机技术有限公司 | BIOS data storage method, device, equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880628A (en) * | 2012-06-15 | 2013-01-16 | 福建星网锐捷网络有限公司 | Hash data storage method and device |
| CN103309975A (en) * | 2013-06-09 | 2013-09-18 | 华为技术有限公司 | Duplicated data deleting method and apparatus |
| CN109857339A (en) * | 2019-01-10 | 2019-06-07 | 平安科技（深圳）有限公司 | File memory method, device, computer equipment and storage medium |
| CN109918018A (en) * | 2017-12-13 | 2019-06-21 | 华为技术有限公司 | A kind of date storage method and storage equipment |
| CN110275884A (en) * | 2019-05-31 | 2019-09-24 | 阿里巴巴集团控股有限公司 | Date storage method and node |
| CN110399348A (en) * | 2019-07-19 | 2019-11-01 | 苏州浪潮智能科技有限公司 | File deletes method, apparatus, system and computer readable storage medium again |
-
2019
- 2019-12-22 CN CN201911332561.0A patent/CN111143288A/en not_active Withdrawn
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102880628A (en) * | 2012-06-15 | 2013-01-16 | 福建星网锐捷网络有限公司 | Hash data storage method and device |
| CN103309975A (en) * | 2013-06-09 | 2013-09-18 | 华为技术有限公司 | Duplicated data deleting method and apparatus |
| CN109918018A (en) * | 2017-12-13 | 2019-06-21 | 华为技术有限公司 | A kind of date storage method and storage equipment |
| CN109857339A (en) * | 2019-01-10 | 2019-06-07 | 平安科技（深圳）有限公司 | File memory method, device, computer equipment and storage medium |
| CN110275884A (en) * | 2019-05-31 | 2019-09-24 | 阿里巴巴集团控股有限公司 | Date storage method and node |
| CN110399348A (en) * | 2019-07-19 | 2019-11-01 | 苏州浪潮智能科技有限公司 | File deletes method, apparatus, system and computer readable storage medium again |
Non-Patent Citations (2)
| Title |
|---|
| 张志珂等: "相似索引:适用于重复数据删除的二级索引", 《计算机应用研究》 * |
| 朱东妹: "《数据仓库与数据挖掘概念、方法及图书馆应用》", 31 August 2017, 安徽师范大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113064556A (en) * | 2021-04-29 | 2021-07-02 | 山东英信计算机技术有限公司 | BIOS data storage method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102629247B (en) | Method, device and system for data processing | |
| CN106776368B (en) | Cache management method, device and system during data reading | |
| CN107729558B (en) | Method, system and device for defragmenting file system and computer storage medium | |
| CN108733306B (en) | File merging method and device | |
| CN107817947B (en) | Data storage method, device and system | |
| CN110888837B (en) | Object storage small file merging method and device | |
| CN111857597A (en) | Hot spot data caching method, system and related device | |
| CN109558456A (en) | A kind of file migration method, apparatus, equipment and readable storage medium storing program for executing | |
| CN111198856A (en) | File management method and device, computer equipment and storage medium | |
| CN111399765B (en) | Data processing method and device, electronic equipment and readable storage medium | |
| CN110399101B (en) | Write operation processing method, device and system of disk and storage medium | |
| CN110245129B (en) | Distributed global data deduplication method and device | |
| CN113867627B (en) | Storage system performance optimization method and system | |
| CN110716924B (en) | Method and device for deleting expired data | |
| CN109213450B (en) | Associated metadata deleting method, device and equipment based on flash memory array | |
| CN111190537A (en) | Method and system for managing sequential storage disks in write-addition scene | |
| CN108205559B (en) | Data management method and equipment thereof | |
| CN111143288A (en) | Data storage method, system and related device | |
| CN111552438B (en) | Method, device, server and storage medium for writing object | |
| CN113157600A (en) | Space allocation method of shingled hard disk, file storage system and server | |
| CN106354793B (en) | Method and device for monitoring hot spot object | |
| CN111913913A (en) | Access request processing method and device | |
| KR102071072B1 (en) | Method for managing of memory address mapping table for data storage device | |
| CN114780489A (en) | Method and device for realizing distributed block storage bottom layer GC | |
| CN109284237B (en) | Garbage recovery method and system in full flash memory array |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200512 |
|
| WW01 | Invention patent application withdrawn after publication |