CN113778964A - Recording device for storing multiple temporary storage files and management method of temporary storage files - Google Patents

Recording device for storing multiple temporary storage files and management method of temporary storage files Download PDF

Info

Publication number
CN113778964A
CN113778964A CN202010655534.3A CN202010655534A CN113778964A CN 113778964 A CN113778964 A CN 113778964A CN 202010655534 A CN202010655534 A CN 202010655534A CN 113778964 A CN113778964 A CN 113778964A
Authority
CN
China
Prior art keywords
file
temporary
storage
temporary storage
files
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010655534.3A
Other languages
Chinese (zh)
Other versions
CN113778964B (en
Inventor
温景翔
张圣安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial Technology Research Institute ITRI
Original Assignee
Industrial Technology Research Institute ITRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial Technology Research Institute ITRI filed Critical Industrial Technology Research Institute ITRI
Publication of CN113778964A publication Critical patent/CN113778964A/en
Application granted granted Critical
Publication of CN113778964B publication Critical patent/CN113778964B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/12Replacement control
    • G06F12/121Replacement control using replacement algorithms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0875Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with dedicated cache, e.g. instruction or stack
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G06F12/0868Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G06F16/162Delete operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/1734Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10Providing a specific technical effect
    • G06F2212/1041Resource optimization
    • G06F2212/1044Space efficiency improvement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/46Caching storage objects of specific type in disk cache
    • G06F2212/463File

Abstract

The present disclosure provides a recording apparatus for storing a plurality of temporary files and a management method of the temporary files, the management method of the temporary files comprising: a temporary storage file state table is formed, wherein the temporary storage file state table records a plurality of file names of the temporary storage files and a plurality of file states of a plurality of characteristics corresponding to each temporary storage file, whether the storage state of the storage space is in accordance with the health state is judged, when the storage state of the storage space is judged not to be in accordance with the health state, a label corresponding to the file state is given to the characteristics of each temporary storage file, a temporary storage file sorting table is formed, the last file name in the temporary storage file sorting table and the temporary storage file corresponding to the last file name in the storage space are deleted, and the temporary storage file sorting table records the deletable grade marked by the labels of the temporary storage files which are most required to be kept, and sorts the temporary storage files which are most required to be deleted according to the temporary storage file sorting table.

Description

Recording device for storing multiple temporary storage files and management method of temporary storage files
Technical Field
The invention relates to a recording device for storing a plurality of temporary storage files and a management method of the temporary storage files.
Background
Under the background that the analysis and prediction of a project by huge Data (Big Data) are very popular, in the process of analyzing and predicting the project, various parameters, processing and analysis methods are often adjusted to carry out research, and even the same Data group derives various relay Data according to different research targets. The relay data can be regarded as a temporary File (Cache File) of the project, so that the additional time cost and the operation cost caused by executing the same project again to produce the relay data can be avoided when different analyses and applications are carried out subsequently.
In order to maintain the storage state of the storage space in a good state, a conventional method for maintaining the storage space deletes the temporary file in the storage space in a timely manner. For example, a common method for clearing storage space includes deleting a temporary file that is less frequently read and deleting a temporary file with a larger file capacity, or deleting some or all of the temporary files periodically to maintain the storage space. Since the temporary file is usually managed by a file with a smaller capacity, and the time cost for forming the temporary file is not considered, the conventional temporary file management method is not suitable for the temporary management of the relay file as described above when the generation time of the temporary file is longer as the capacity of the temporary file is larger.
Under the circumstance that the temporary storage file necessarily occupies the storage resource, how to properly plan the storage resource of the storage space and the time cost for generating the temporary storage file is an important issue.
Disclosure of Invention
The invention provides a recording device for storing a plurality of temporary storage files and a management method of the temporary storage files, which are beneficial to managing the temporary storage files in a storage space and maintaining the storage state of the storage space in a healthy state.
According to an embodiment of the present invention, a method for managing temporary storage files in a storage space is applicable to a storage space including a plurality of temporary storage files, the method comprising: forming a temporary storage file state table, wherein the temporary storage file state table records a plurality of file names of the temporary storage files and a plurality of file states of a plurality of characteristics corresponding to each temporary storage file; judging whether a storage state of the storage space conforms to a health state; when the storage state does not accord with the health state, a plurality of labels corresponding to the file states are given to the characteristics of each temporary storage file, and a temporary storage file sorting table is formed, wherein the labels are used for marking deletable levels of the file states of the corresponding temporary storage files, the temporary storage file sorting table records the file names of the temporary storage files, and the file names in the temporary storage file sorting table are sorted from the file name of the temporary storage file which is most required to be reserved to the file name of the temporary storage file which is most required to be deleted according to the deletable levels marked by the labels of the temporary storage files; and deleting the last file name in the temporary storage file sorting table to update the temporary storage file sorting table, and deleting the temporary storage file corresponding to the file name in the storage space.
Preferably, after deleting the temporary file corresponding to the file name in the storage space, the management method further comprises: judging whether the storage state of the storage space accords with the health state, finishing the management method and deleting the temporary storage file sorting table when the storage state of the storage space accords with the health state; and deleting the last file name in the updated temporary storage file sorting table and the corresponding temporary storage file when the storage state of the storage space is judged not to accord with the health state.
Preferably, determining whether the storage status of the storage space meets the health status is:
judging whether a storage proportion of the storage space falls within an expected proportion or not;
when the storage ratio is judged to be within the expected ratio, judging that the storage state of the storage space conforms to the health state; and
when the storage ratio is judged not to fall within the expected ratio, the storage state of the storage space is judged not to accord with the health state.
Preferably, the features include a reference execution count, and the reference execution count is the number of times that all temporary files having the same generation procedure as the temporary file are executed in a system having a plurality of storage spaces including the storage space.
Preferably, the features include a file capacity, which is a capacity occupied by each of the temporary files in the storage space.
Preferably, the temporary files include a first temporary file and a second temporary file, and when the capacity of the first temporary file in the storage space is larger than the capacity of the second temporary file in the storage space, the management method further includes: the label of the deletable level is given to the first temporary storage file to be higher than that of the second temporary storage file.
Preferably, the characteristics include a last execution time, and the last execution time is a time when the temporary file was last read.
Preferably, the tags include a first deletable level tag and a second deletable level tag, and the level of the first deletable level tag is different from the level of the second deletable level tag, and the file names in the temporary file sorting table are sorted from the file name of the temporary file most required to be retained to the file name of the temporary file most required to be deleted according to the deletable level indicated by the tags of the temporary files, and the step of sorting the file names includes: and sorting the file names in the temporary storage file sorting table according to the accumulated quantity of the first deletable grade label and the second deletable grade label of each temporary storage file.
Preferably, the tags further include a highest-level tag and a lowest-level tag, and the file names in the temporary file sorting table are sorted from the file name of the temporary file most required to be retained to the file name of the temporary file most required to be deleted according to the levels indicated by the tags of the temporary files, including: when the temporary storage file has the highest-level label, sorting the file name of the temporary storage file at the last of the temporary storage file sorting list; when the temporary storage file has the lowest grade label, the file name of the temporary storage file is sorted at the top of the sorting list of the temporary storage file.
Preferably, the plurality of features includes a first feature, and the first feature has the highest importance among the plurality of features, the plurality of temporary files includes a first temporary file and a second temporary file, when the accumulated number of the first class labels of the first temporary file and the accumulated number of the second class labels of the second temporary file are the same, the management method further includes: and sorting the first temporary storage file and the second temporary storage file according to the grades of the labels corresponding to the first characteristics of the first temporary storage file and the second temporary storage file so as to sort the temporary storage files with high grades behind.
Preferably, the management method further comprises determining whether the storage status of the storage space meets the health status every a predetermined time interval.
Preferably, before forming the temporary file sorting table, the management method further comprises: setting a separation parameter for separating each label.
Preferably, before forming the temporary file state table, the management method further comprises: executing a project and obtaining the temporary storage files generated in the process of executing the project.
According to an embodiment of the present invention, a recording apparatus for storing a plurality of temporary files comprises: a storage space storing a temporary storage file state table and a temporary storage file sorting table, wherein the temporary storage file state table records a plurality of file names of the temporary storage files and a plurality of file states of a plurality of characteristics corresponding to each temporary storage file, the temporary storage file sorting table records the file names of the temporary storage files, and the file names in the temporary storage file sorting table are sorted from the file name of the temporary storage file which needs to be kept most to the file name of the temporary storage file which needs to be deleted most according to the deletable grade marked by a plurality of labels of the temporary storage files, wherein the labels are used for marking the deletable grade of the file states of the corresponding temporary storage files; and a processor, electrically connected to the storage space, the processor adjusting the temporary storage file sorting table according to the deletable level indicated by the labels of the temporary storage files, so as to sort the file names of the temporary storage files which are most required to be reserved in the temporary storage file sorting table to the file names of the temporary storage files which are most required to be deleted, the processor endows the labels corresponding to the file states to each of the characteristics when judging that a storage state of the storage space does not accord with a health state, and forms the temporary storage file sorting table, and the processor also deletes the last file name in the temporary storage file sorting table to update the temporary storage file sorting table and delete the temporary storage files corresponding to the file names in the storage space.
Preferably, after deleting the temporary storage file corresponding to the file name in the storage space, the processor further determines whether the storage status of the storage space is in accordance with the health status, deletes the last file name and the corresponding temporary storage file in the updated temporary storage file sorting table when determining that the storage status of the storage space is not in accordance with the health status, and deletes the temporary storage file sorting table when determining that the storage status of the storage space is in accordance with the health status.
Preferably, the processor determines whether the storage status of the storage space meets the health status by: the processor judges whether a storage ratio of the storage space falls within an expected ratio, and when the storage ratio is judged to fall within the expected ratio, the processor judges that the storage state of the storage space conforms to the health state; the processor determines that the storage status of the storage space does not conform to the healthy status when determining that the storage percentage is outside the expected percentage.
Preferably, the features include a reference execution count, and the reference execution count is the number of times that all temporary files having the same generation procedure as the temporary file are executed in a system having a plurality of storage spaces including the storage space.
Preferably, the characteristics include a last execution time, and the last execution time is a time when the temporary file was last read.
Preferably, the features include a file capacity, which is a capacity occupied by each of the temporary files in the storage space.
Preferably, the temporary storage files include a first temporary storage file and a second temporary storage file, and when the capacity of the first temporary storage file in the storage space is greater than the capacity of the second temporary storage file in the storage space, the processor assigns the label of the first temporary storage file to a higher grade than the label of the second temporary storage file.
The foregoing summary of the invention, as well as the following detailed description of the embodiments, is provided to illustrate and explain the principles and spirit of the invention, and to provide further explanation of the invention as claimed.
Drawings
FIG. 1 is a block diagram of a recording apparatus for storing a plurality of temporary files according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a method for managing a temporary storage file according to an embodiment of the present invention.
Fig. 3 is a partial flowchart according to steps S0 and S14 shown in fig. 2.
[ notation ] to show
10-a storage space;
20-a processor.
Detailed Description
The detailed features and advantages of the present invention are described in detail in the embodiments below, which are sufficient for those skilled in the art to understand the technical contents of the present invention and to implement the present invention, and any person skilled in the art can easily understand the objects and advantages related to the present invention based on the disclosure of the present specification, the claims and the accompanying drawings. The following examples further illustrate aspects of the present invention in detail, but are not intended to limit the scope of the invention in any way.
Referring to fig. 1, fig. 1 is a block diagram of a recording apparatus for storing a plurality of temporary files according to an embodiment of the invention. The recording apparatus for storing a plurality of temporary files in the embodiment includes a storage space 10 and a processor 20, and the processor 20 is electrically connected to the storage space 10, where the storage space 10 is, for example, a storage space of hardware with a storage function such as a hard disk, and the temporary file is, for example, obtained by the processor 20 executing a project, that is, the temporary file is, for example, a temporary file generated by the processor 20 during the process of executing the project, but the invention is not limited to the manner of obtaining the temporary file. The file size of the temporary storage file is different according to the difference between the size of the used original Data (project) and the processing mode, but if the original Data is huge Data (Big Data), the file size of the temporary storage file can reach the size range of more than dozens of GB or hundreds of GB, and the time required for executing the project to generate the temporary storage files can reach the time length of taking days as a unit along with the increasing size of the Data and the complexity of the processing procedure in the situation of processing or analyzing the huge Data.
Because the time cost for forming the temporary storage file is not considered by the existing management method, the file size of the temporary storage file suitable for the existing management method is about in the range of taking GB as a unit; the time cost and the file size for forming the temporary storage file are considered in the process of managing the temporary storage file, so that the method is more suitable for the situation of analyzing and predicting the project through Big Data (Big Data).
The storage space 10 may be a storage space 10 of an ata (Advanced Technology attachment) hard disk, an sata (serial Advanced Technology attachment) hard disk, an sas (serial Advanced Small Computer System interface) hard disk, a Solid-State Drive (SSD), or the like; the Processor 20 may be a Central Processing Unit (CPU), a Digital Signal Processor (DSP), or the like, and the storage space 10 and the Processor 20 are not limited to the above types.
For a more clear description of the embodiments of the present invention, please refer to fig. 1 and fig. 2 together, in which fig. 2 is a flowchart illustrating a method for managing a temporary storage file in a storage space according to an embodiment of the present invention, and the method for managing a temporary storage file in a storage space is applicable to a storage space 10 including a plurality of temporary storage files.
Please refer to step S10 of fig. 2: form a temporary file status table.
The processor 20 forms a temporary file status table, and the temporary file status table is stored in the storage space 10. The temporary file state table records a plurality of file names of the temporary files stored in the storage space 10 and a plurality of file states of each temporary file corresponding to a plurality of characteristics.
Step S12: and judging whether the storage state of the storage space accords with the health state or not.
In this step, the processor 20 determines whether a storage ratio of the storage space 10 falls within an expected ratio, wherein the storage ratio is preferably a ratio of the storage space 10 occupied; the anticipated proportion is preferably the upper proportion of the storage space 10 that can be occupied. When the storage ratio of the storage space 10 falls within the expected ratio, the processor 20 determines that the storage state of the storage space 10 is in accordance with the healthy state; when the storage ratio of the storage space 10 does not fall within the expected ratio, the processor 20 determines that the storage status of the storage space 10 is in accordance with the unhealthy status. In addition, the processor 20 may further determine whether the storage state of the storage space is in accordance with the health state every a preset time period, wherein the preset time period is, for example, 8 hours, 24 hours, and the like.
Taking percentage as an example of the storage space 10, the total storage space of the storage space 10 is 100%, and the expected percentage is, for example, 80%, which means that the occupied space in the storage space 10 preferably does not exceed 80% of the total storage space. That is, assuming that the total storage space of the storage space 10 has 100TB, when the storage space occupied by the temporary storage file in the storage space 10 is 90TB, the storage proportion is 90%, which exceeds the expected proportion by 80%, and thus it is determined that the storage state of the storage space 10 does not conform to the healthy state; on the contrary, when the storage space occupied by the temporary file in the storage space 10 is 60TB, the storage occupancy is 60%, so that the storage state of the storage space 10 is determined to be in accordance with the healthy state.
Therefore, when the storage status of the storage space 10 does not conform to the healthy status, step S14 is continued to form a temporary file sorting table. Otherwise, when the storage status of the storage space 10 is in accordance with the healthy status, step S16 is continued to end the method.
Step S14: forming a temporary file sorting table, deleting the last file name in the temporary file sorting table, and deleting the temporary file corresponding to the last file name in the storage space 10.
The processor 20 forms a temporary file sorting table, which records the file names of the temporary files stored in the storage space 10, and the file names of each of the temporary files are arranged according to the deletable level, so that when the temporary files in the storage space 10 need to be deleted, the processor 20 can delete the last file name in the temporary file sorting table according to the sequence listed in the temporary file sorting table, and delete the temporary file corresponding to the last file name in the storage space 10. A partial description of the formation of the temporary file ordering table will be described in detail below.
In addition, after the step S14 is executed to delete the temporary file corresponding to the last file name, the management method of the embodiment may continue to execute step S12, determine whether the storage state of the storage space 10 after deleting the temporary file conforms to the healthy state, and delete the last file name and the corresponding temporary file of the updated temporary file sorting table when the storage state of the storage space 10 does not conform to the healthy state, so as to reliably restore the storage state of the storage space 10 and maintain the healthy state.
If the processor 20 determines that the storage status of the storage space 10 after deleting the temporary file corresponds to the healthy status after executing the step S14 to delete the temporary file corresponding to the last file name, the processor 20 may delete the temporary file sorting table in the storage space 10, and continue to step S16 to finish the method, so as to save the storage capacity of the storage space 10.
In addition, the management method of the embodiment may be periodically executed, i.e., periodically updating the temporary file state table (S10), or periodically checking the storage state of the storage space 10 after forming the temporary file state table (S12), and starting to form the temporary file sorting table (S14) when the storage state of the storage space 10 does not conform to the healthy state, so as to timely maintain the storage state of the storage space 10. After the step S14 is executed to delete the temporary file corresponding to the last file name, the management method of the embodiment may also be a method that continues to the end of the step S16 and determines whether to execute the step S14 again based on the result of the next step S12, so as to reserve the temporary file stored in the storage space 10 as much as possible.
The operation of the management method shown in fig. 2 is described below by way of example. Please refer to fig. 2 in conjunction with table 1 below, wherein table 1 is an example of a temporary file status table.
TABLE 1
Figure BDA0002581257060000081
Taking the temporary file status table shown in table 1 as an example, the plurality of file names of the temporary file are A, B and C, each file name represents a temporary file, and each file name corresponds to each feature and has a corresponding file status, for example, the file status of the file name a corresponds to the feature "number of temporary files for project" is "5".
After obtaining the temporary file state table of the temporary file, if the processor 20 determines that the storage state of the storage space 10 does not conform to the healthy state, the corresponding label of each of the file states may be assigned to form the temporary file sorting table shown in table 2 below. The labels are preferably used to indicate the deletable levels of the file status of the scratch file for each feature, wherein the deletable levels are ordered from high to low, such as "deleted", "deletable", "can be left", and "must be left".
TABLE 2
Figure BDA0002581257060000091
The file names A to C shown in Table 2 are sorted according to the number of labels, wherein the labels are preferably used to indicate the deletable levels of the file states of the corresponding temporary files, and the deletable levels of the labels are sorted from high to low, such as "deleted", "deletable", "reserved", and "reserved". In detail, in the temporary file status table of table 1, each file status corresponds to a tag (for example, in table 1, the file status of file name a corresponding to the file capacity is 10G, so that the file status of "10G" can correspond to the tag "deletable" shown in table 2). Continuing with Table 2, the filename B has two "deleted" tags; the file name C has a 'must delete' label; the profile name a does not have a "must delete" label. The processor 20 can determine that the deletable level of the file name B is the highest and the deletable level of the file name C is higher than the file name a according to the number of the "must-delete" tags, so that the file name B is sorted at the last of the temporary file sorting table and the file name a is sorted at the top of the temporary file sorting table.
In another example (not shown in Table 2), if the file names A to C all have the same number of "deleted" tags, the processor 20 may then sort the file names A to C according to the number of "deleted" tags when forming the temporary file sorting table.
If the number of tags in each of the file names a-C is the same (not shown in table 2), the processor 20 may sort the file names a-C in the file sorting table according to the deletable level of the tag corresponding to the most important feature of the files, so that the file names corresponding to the most important feature with the higher deletable level are sorted later. In other words, if the number of tags at each level from the file name a to the file name C is the same, wherein the tag of the file name C is "deleted" in accordance with the feature of "number of temporary files of project" with the highest importance, and the file names a and B are "deletable" tags with the lower levels, the processor can also sort the file name C after the file names a and B.
The plurality of characteristics of the temporary storage file may include "temporary storage file generation time", "last execution time", "temporary storage file number of the project", "number of uses", "file capacity", "number of reference executions", and "last execution time of the project", etc. It should be noted that the features described are merely exemplary, the number and types of features of the present invention are not limited in this list, and the processor 20 may adjust the number and types of features based on user instructions.
In detail, the "temporal file generation time" is preferably the time cost and calculation cost required for generating the temporal file when executing the project, for example, the higher the time cost for generating the temporal file, the lower the deletable level thereof; the "last execution time" is preferably an interval from the time when the temporary file is read last to the current time, and may also be an interval from the time when the temporary file is generated to the current time if the temporary file has not been read after the temporary file is generated; the "number of temporary storage files for project" is preferably the total number of temporary storage files generated when the project for generating the temporary storage files is executed; the "number of uses" is preferably the number of times the scratch file is used/read; "file capacity" is preferably the capacity of the temporary file in the storage space 10; the "reference execution times" is preferably the times that all the temporary files having the same or similar generation steps as the temporary file are executed in a system having a plurality of storage spaces including the storage space 10, and the higher the reference execution times, the lower the deletable level, so as to avoid the erroneous deletion of the temporary files that may be executed many times in the future; the "project last execution time" is preferably the time when the project generating the temporary storage file was executed last time, or the time when the temporary storage file is generated, and the closer the project last execution time is to the current time, the lower the deletion level is, so as to avoid the mistaken deletion of the temporary storage file which may be used in the near future.
In summary, as shown in table 1 and table 2, the temporary storage file status table is used to present the file status of each feature corresponding to the temporary storage file, and the file names in the temporary storage file sorting table are arranged according to the number of the labels corresponding to the file statuses, so that the file names of the temporary storage files are sorted from the file name of the temporary storage file most needed to be retained to the file name of the temporary storage file most needed to be deleted in the temporary storage file sorting table. In table 2, the file name of the temporary storage file that needs to be reserved is a; the file name of the temporary storage file which should be deleted is B. However, the file name of the temporary storage file to be deleted can be sorted to the file name of the temporary storage file to be reserved, and the invention is not limited by the sorting method of the file names.
After forming the temporary file status table and determining that the storage status of the storage space 10 does not conform to the healthy status in step S12, step S14 is executed to form a temporary file sorting table, and delete the last file name in the temporary file sorting table and the temporary file corresponding to the last file name in the storage space 10.
Please continue to refer to step S14 of fig. 2 (forming the temporary file sorting table, deleting the last file name in the temporary file sorting table, and deleting the temporary file corresponding to the file name in the storage space 10) and match table 2.
Taking the temporary file sorting table shown in table 2 as an example, the processor 20 deletes the file name B and deletes the temporary file B (hereinafter referred to as "file B") corresponding to the file name B in the storage space 10, so that the temporary file sorting table in table 2 only has the file names a and C; only the temporary file A corresponding to the file name A (hereinafter referred to as "file A") and the temporary file C corresponding to the file name C (hereinafter referred to as "file C") are stored in the storage space 10, so as to update the temporary file sorting table.
Referring to step S14 of fig. 2 and taking table 2 as an example, after deleting the file name B and the file B in the storage space 10, if the storage state of the storage space 10 is determined not to be in the healthy state in step S12, the file name C in the updated temporary file sorting table and the file C in the storage space 10 are deleted. Accordingly, the storage space 10 can be prevented from being occupied by the temporary files with lower importance, and the temporary files with higher importance can be prevented from being deleted by mistake while the storage space 10 is adjusted, so that the state of the storage space 10 can be maintained in a healthy state.
Fig. 3 is a partial flowchart according to steps S0 and S14 shown in fig. 2. In order to more clearly illustrate the details of step S0 and step S14 and how to specify the corresponding label of each file status in the embodiment of the present invention, the temporary files include a first temporary file (file a), a second temporary file (file B), and a third temporary file (file C); these labels include a first deletable rating label (deleted), a second deletable rating label (deleted), and a third deletable rating label (left available) for illustration.
Please refer to fig. 3 in conjunction with the example of the tag assigned to the file state by the processor 20 shown in table 3, i.e. table 3 shows a transient table in the process of forming the temporary file sorting table according to the temporary file state table when the processor 20 is operating in the background, rather than the temporary file sorting table arranged according to the final deletable level.
TABLE 3
Grade name File capacity Number of times of use
A Can be deleted Can be deleted
B Can stay Can stay
C Must be deleted Can stay
The management method of this embodiment may further include step S0: setting a separation parameter for separating each label. It is noted that the step S0 can be performed before the temporary file state table is formed, or before the temporary file list is formed. That is, the user can set the separation parameter between two adjacent tags to assign the corresponding tags according to different file states. Taking the feature of "number of times of use" as an example, the user can set the separation parameter between the label "can be left" and the label "can be deleted" corresponding to the feature of "number of times of use" as "20 times", so when the file status (number of times of use) corresponding to the feature of "number of times of use" is more than 20 times, the corresponding label is "can be left"; when the file status is 15-20 times, the corresponding label is "deletable".
The aforementioned step S14 further includes the substeps of steps S141, S143, S145 and S147. In detail, please refer to step S10: form a temporary file status table. That is, the processor 20 forms a temporary file state table to record the file state of each feature of the temporary file, and the processor 20 can update the temporary file state table periodically, or the processor 20 can update the temporary file state table in real time when the temporary file state changes.
In step S10, the file status of each temporary file corresponding to each feature is recorded, and after determining in step S12 that the storage status of the storage space 10 does not conform to the healthy status, the processor 20 performs the sub-step S141 of step S14: and assigning a plurality of labels corresponding to the file states to the characteristics of each temporary storage file.
The file capacity feature is described below, wherein the processor 20 may assign the labels corresponding to the file states according to the partition parameter, or assign the labels corresponding to the file states according to the relative relationship between each file state (e.g. the relative size between each file capacity), which is not limited by the invention. In particular, for the "file capacity" feature, the tags of files A through C can be set according to the separation parameters as described above (e.g., when the separation parameter between the tag "reserved" and the tag "deletable" is "5 GB"; the separation parameter between the tag "deletable" and the tag "deletable" is "30 GB", a file can be given a "deletable" tag when the file capacity of the file is greater than 5GB and less than 30 GB). Alternatively, in the case where the user sets that the file capacity is larger and the file should be deleted, if the file C has the largest file capacity (file state) corresponding to the "file capacity" feature, and the file capacity of the file a is larger than that of the file B, in order to avoid the storage space 10 from being occupied with too much capacity, the file state of the file C is assigned with the "delete-required" tag having the highest deletable level, the file a is assigned with the "delete-capable" tag having a deletable level lower than that of the file C, and the file B is assigned with the "leave" tag having a deletable level lower than that of the file a.
In addition, in the case that the larger the file capacity set by the user, the more the file should be reserved, when the capacity occupied by one temporary file in the storage space 10 is larger than the capacity occupied by another temporary file in the storage space 10, the processor 20 may assign a label with a deletable level to the file state of the temporary file higher than the file state of the other temporary file when assigning the label corresponding to each file state. In other words, when the file size of the temporary storage file is larger, it means that the operation cost and time cost for generating the temporary storage file again are higher. Therefore, if the file capacity of file B is the largest of the three, and the file capacity of file C is the smallest of the three, the deletable level of file C may be the highest, and the deletable level of file B may be the lowest. Therefore, it is able to avoid mistakenly deleting the temporary file that needs to consume higher operation cost and time cost when generating again in order to save the storage space 10.
For example, the capacity of file A is, for example, 10 GB; the file B has a capacity of, for example, 50 GB; the file C has a capacity of, for example, 1 GB. Because the capacity of the file A is larger than that of the file C, the calculation cost required for regenerating the file A is higher compared with that of the file C; since the capacity of the file B is larger than that of the file a, which means that the calculation cost required for generating the file B again is higher than that of the file a, if the corresponding label is given according to the separation parameter, and the separation parameter between the label "can be reserved" and the label "can be deleted" is, for example, "80 GB"; if the separation parameter between the label "deletable" and the label "deleted" is, for example, "5 GB", the label of the file a is "deletable"; the label of file B is "deletable"; the label of the file C is "must delete". If the corresponding label is assigned according to the relative relationship between the states of each file, the label of the file A is "deletable", for example; the label of archive B is, for example, "Return"; the label of the archive C is, for example, "deleted".
However, the deletable level of the scratch file may not be fully positively or negatively correlated with the file size. In particular, in the case where the user setting is to adjust the deletable level of the scratch file based on a relationship between the file size and a size threshold, processor 20 may store the setting of the size threshold, and processor 20 may adjust the deletable level of the scratch file based on the relationship between the size threshold and the file size of the scratch file. The capacity threshold may be a proportional value of the entire storage space 10, such as an intermediate value of the entire storage space 10, or an intermediate value of the expected duty ratio, and the invention is not limited to the capacity threshold.
For example, in the range smaller than the capacity threshold, the processor 20 assigns the scratch file with a higher deletable level when the file capacity of the scratch file is farther from the capacity threshold (i.e., the file capacity is smaller); in the range larger than the capacity threshold, the processor 20 assigns the temporary file a higher deletable level when the file capacity of the temporary file is farther from the capacity threshold (i.e., the file capacity is larger); when the file size of the temporary file falls within the size threshold, the processor 20 assigns the temporary file with the lowest deletable level.
The capacity threshold may be a capacity range, and the processor 20 assigns the temporary file a higher deletable level when the file capacity of the temporary file falls outside the capacity range and is farther from the boundary of the capacity range. Otherwise, when the file capacity of the temporary file falls within the capacity range, the processor 20 assigns the temporary file with the lowest deletable level.
In other words, in the interval smaller than the capacity threshold or smaller than the lower limit of the capacity range, the smaller the file capacity of the temporary storage file is, the less the time cost for reproducing the temporary storage file is, so the higher the deletion grade can be; in the interval larger than the capacity threshold or larger than the upper limit of the capacity range, the larger the file capacity of the temporary storage file is, the higher the possibility that the storage space occupied by the temporary storage file affects the whole temporary storage operation is, and therefore the deletable level is also higher.
Accordingly, the corresponding label with the deletable level can be effectively given according to the file capacity of the temporary storage file, so as to avoid the storage space 10 from being excessively occupied while keeping the temporary storage file with more data.
The processor 20 then assigns a corresponding tag to the temporary file according to the file status corresponding to the "number of uses" feature. For example, if file B and file C are used equal and higher than file A, processor 20 assigns file A a tag of, for example, "deletable" for the file state corresponding to the "number of uses" feature; the label assigned to files B and C is, for example, "survivable".
Step S143: and counting the number of the labels of each level of each temporary storage file.
Continuing with the example of Table 3, processor 20 counts the number of tags in each level of each scratch file, and obtains a file name A with two "deletable" tags; the file name B has two labels of 'can stay'; the file name C has a "deleted" tag and a "reserved" tag.
The processor 20 then executes step S145: the file names of the temporary storage files are sorted according to the number of the labels at each level, and step S147 is executed: and deleting the last file name in the temporary storage file sorting list, and deleting the temporary storage file corresponding to the file name in the storage space.
According to the above statistical results, although the file name a has two "deletable" tags, the deletable level of the file name C is higher than that of the file name a because the file name C has a "must-delete" tag; since the file name A has two "deletable" tags, the deletable level of the file name A is higher than that of the file name B whose two tags are both "deletable". In other words, as shown in table 4 below, the processor 20 sorts the temporary files according to the number of each level tag to form a temporary file sorting table, and the temporary file sorting table shown in table 4 is the temporary file sorting table formed in step S14 of fig. 1. After the temporary file sorting table is formed, the processor 20 deletes the last file name in the temporary file sorting table and the corresponding temporary file in the storage space 10.
TABLE 4
Grade name File capacity Number of times of use
B Can stay Can stay
A Can be deleted Can be deleted
C Must be deleted Can stay
In addition, the tags can also comprise a highest-level tag and a lowest-level tag, so that the processor can more accurately adjust the temporary storage file sorting table according to the highest-level tag and the lowest-level tag, thereby avoiding the temporary storage files which absolutely need to be reserved from being deleted and really deleting the temporary storage files which do not need to be reserved.
For example, the highest level label may be "absolute delete"; the lowest level label may be "absolute reserved". For example, if a temporary file is read 360 days before the last time, and the file status corresponding to the "last execution time" feature is given an "absolute delete" tag, the temporary file can be moved to the last of the temporary file sorting table (i.e. the position with the highest deletion level) when the temporary file sorting table is formed; if a temporary file is given an "absolute reservation" label in the file status corresponding to the "file capacity" feature due to the large file capacity, the temporary file can be moved to the top of the temporary file sorting table (i.e. the position with the lowest deletion level).
Therefore, if the temporary storage file has the label of 'absolute deletion', no matter what other labels of the temporary storage file are, the temporary storage file can be ensured to be sorted at the end of the temporary storage file sorting table; similarly, if the temporary file has an "absolute reserved" tag, it is ensured that the temporary file is sorted at the top of the temporary file sorting table regardless of other tags of the temporary file. Accordingly, when the storage state of the storage space does not conform to the healthy state, the processor can determine that the deleted temporary storage file is deletable and retain an important temporary storage file to ensure that the storage space is properly utilized.
In summary, according to the management method of temporary storage files in storage space and the recording apparatus for storing multiple temporary storage files of one or more embodiments of the present invention, the temporary storage files can be automatically managed to reduce the requirement of expanding the storage space and ensure that the storage state of the storage space can be maintained in a healthy state. In addition, according to the management method of temporary storage files in storage space and the recording apparatus for storing multiple temporary storage files of one or more embodiments of the present invention, a temporary storage file with a large file capacity or a temporary storage file with a high operation cost for reproducing the temporary storage file can not be easily deleted, so that a temporary storage file with a high importance or a temporary storage file with a high reproduction cost can be truly reserved, and the deleted temporary storage file is a temporary storage file with a low importance or a temporary storage file with a low reproduction cost.

Claims (20)

1. A management method of temporary storage files is suitable for a storage space containing a plurality of temporary storage files, and comprises the following steps:
forming a temporary storage file state table, wherein the temporary storage file state table records a plurality of file names of the temporary storage files and a plurality of file states of a plurality of characteristics corresponding to each temporary storage file;
judging whether a storage state of the storage space conforms to a health state;
when the storage state does not accord with the health state, a plurality of labels corresponding to the file states are given to the characteristics of each temporary storage file, and a temporary storage file sorting table is formed, wherein the labels are used for marking deletable levels of the file states of the corresponding temporary storage files, the temporary storage file sorting table records the file names of the temporary storage files, and the file names in the temporary storage file sorting table are sorted from the file name of the temporary storage file which is most required to be reserved to the file name of the temporary storage file which is most required to be deleted according to the deletable levels marked by the labels of the temporary storage files; and
deleting the last file name in the temporary storage file sorting list to update the temporary storage file sorting list, and deleting the temporary storage file corresponding to the file name in the storage space.
2. The method for managing a temporary file as claimed in claim 1, wherein after deleting the temporary file corresponding to the file name in the storage space, the method further comprises: judging whether the storage state of the storage space accords with the health state, finishing the management method and deleting the temporary storage file sorting table when the storage state of the storage space accords with the health state; and deleting the last file name in the updated temporary storage file sorting table and the corresponding temporary storage file when the storage state of the storage space is judged not to accord with the health state.
3. The method as claimed in claim 2, wherein determining whether the storage status of the storage space meets the health status comprises:
judging whether a storage proportion of the storage space falls within an expected proportion or not;
when the storage ratio is judged to be within the expected ratio, judging that the storage state of the storage space conforms to the health state; and
when the storage ratio is judged not to fall within the expected ratio, the storage state of the storage space is judged not to accord with the health state.
4. The method as claimed in claim 1, wherein the characteristics include a reference execution count, and the reference execution count is the number of times that all the temporary files having the same generation procedure as the temporary file are executed in a system having a plurality of storage spaces including the storage space.
5. The method as claimed in claim 1, wherein the characteristics include a file capacity, and the file capacity is a capacity occupied by each of the temporary files in the storage space.
6. The method as claimed in claim 5, wherein the temporary files include a first temporary file and a second temporary file, and when the capacity of the first temporary file in the storage space is larger than the capacity of the second temporary file in the storage space, the method further comprises: the label of the deletable level is given to the first temporary storage file to be higher than that of the second temporary storage file.
7. The method as claimed in claim 1, wherein the characteristics include a last execution time, and the last execution time is a time when the temporary file was last read.
8. The method as claimed in claim 1, wherein the plurality of tags includes a first deletable level tag and a second deletable level tag, and the first deletable level tag has a level different from that of the second deletable level tag, and the file names in the file sorting table are sorted from the file name of the most-needed temporary file to the file name of the most-needed temporary file according to the deletable level indicated by the tags of the plurality of temporary files comprises: and sorting the file names in the temporary storage file sorting table according to the accumulated quantity of the first deletable grade label and the second deletable grade label of each temporary storage file.
9. The method as claimed in claim 8, wherein the tags further comprise a highest-level tag and a lowest-level tag, and the sorting of the file names in the temporary file sorting table from the file name of the temporary file to be most reserved to the file name of the temporary file to be most deleted according to the levels of the tags of the temporary files comprises: when the temporary storage file has the highest-level label, sorting the file name of the temporary storage file at the last of the temporary storage file sorting list; when the temporary storage file has the lowest grade label, the file name of the temporary storage file is sorted at the top of the sorting list of the temporary storage file.
10. The method of claim 8, wherein the plurality of features includes a first feature having a highest importance among the plurality of features, the plurality of temporary files includes a first temporary file and a second temporary file, and when the first and second temporary files have the same number of accumulated first class tags and the first and second temporary files have the same number of accumulated second class tags, the method further comprises: and sorting the first temporary storage file and the second temporary storage file according to the grades of the labels corresponding to the first characteristics of the first temporary storage file and the second temporary storage file so as to sort the temporary storage files with high grades behind.
11. The method as claimed in claim 2, wherein the method further comprises determining whether the storage status of the storage space meets the health status every a predetermined period of time.
12. The method of claim 1, wherein before forming the temporary file sorting table, the method further comprises: setting a separation parameter for separating each label.
13. The method of claim 1, wherein prior to forming the temporary file state table, the method further comprises: executing a project and obtaining the temporary storage files generated in the process of executing the project.
14. A recording apparatus for storing a plurality of temporary files, comprising:
a storage space storing a temporary storage file status table and a temporary storage file sorting table,
wherein the temporary storage file state table records a plurality of file names of the temporary storage files and a plurality of file states of each temporary storage file corresponding to a plurality of characteristics,
the temporary storage file sorting table records the file names of the temporary storage files, and the file names in the temporary storage file sorting table are sorted from the file name of the temporary storage file which needs to be kept most to the file name of the temporary storage file which needs to be deleted most according to the deletable level marked by a plurality of labels of the temporary storage files, wherein the labels are used for marking the deletable level of the file states of the corresponding temporary storage files; and
a processor electrically connected to the storage space, the processor adjusting the temporary storage file sorting table according to the grades indicated by the labels of the temporary storage files, so as to sort the file names of the temporary storage files which need to be preserved most to the file names of the temporary storage files which need to be deleted most in the temporary storage file sorting table, the processor judging whether a storage state of the storage space conforms to a health state, the processor endowing the labels corresponding to the file states to each of the characteristics when judging that the storage state does not conform to the health state, and forming the temporary storage file sorting table, the processor also deleting the last file name in the temporary storage file sorting table to update the temporary storage file sorting table, and deleting the temporary storage files corresponding to the file names in the storage space.
15. The recording apparatus as claimed in claim 14, wherein after deleting the temporary file corresponding to the file name in the storage space, the processor further determines whether the storage status of the storage space is in accordance with the healthy status, and deletes the last file name and the corresponding temporary file in the updated temporary file sorting table when determining that the storage status of the storage space is not in accordance with the healthy status, and deletes the temporary file sorting table when determining that the storage status of the storage space is in accordance with the healthy status.
16. The recording apparatus according to claim 14, wherein the processor determines whether the storage status of the storage space meets the health status by: the processor judges whether a storage ratio of the storage space falls within an expected ratio, and when the storage ratio is judged to fall within the expected ratio, the processor judges that the storage state of the storage space conforms to the health state; the processor determines that the storage status of the storage space does not conform to the healthy status when determining that the storage percentage is outside the expected percentage.
17. The recording apparatus of claim 14, wherein the features include a reference number of times that all of the scratch files having the same generation procedure as the scratch file are executed in a system having a plurality of storage spaces including the storage space.
18. The recording apparatus of claim 14, wherein the features include a last execution time, and the last execution time is a time when the temporary file was last read.
19. The recording apparatus as claimed in claim 14, wherein the features include a file capacity, and the file capacity is a capacity occupied by each of the temporary files in the storage space.
20. The recording apparatus as claimed in claim 19, wherein the plurality of temporary files include a first temporary file and a second temporary file, and when the capacity of the first temporary file in the storage space is larger than the capacity of the second temporary file in the storage space, the processor assigns the label of the first temporary file to a higher grade than the label of the second temporary file.
CN202010655534.3A 2020-06-10 2020-07-13 Recording device for storing multiple temporary storage files and management method of temporary storage files Active CN113778964B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW109119558 2020-06-10
TW109119558A TWI751580B (en) 2020-06-10 2020-06-10 Management method of cache files in storage space and recording device for storing cache files

Publications (2)

Publication Number Publication Date
CN113778964A true CN113778964A (en) 2021-12-10
CN113778964B CN113778964B (en) 2024-03-22

Family

ID=78825473

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010655534.3A Active CN113778964B (en) 2020-06-10 2020-07-13 Recording device for storing multiple temporary storage files and management method of temporary storage files

Country Status (3)

Country Link
US (1) US11392510B2 (en)
CN (1) CN113778964B (en)
TW (1) TWI751580B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11485578B2 (en) * 2019-09-04 2022-11-01 Target Brands, Inc. Utilization of multiple order sortation systems
US11650984B2 (en) * 2021-07-28 2023-05-16 Red Hat, Inc. Using a caching layer for key-value storage in a database

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200511065A (en) * 2003-09-03 2005-03-16 Icp Electronics Inc Method and system of managing files in intelligent network attached storage
US20140114923A1 (en) * 2012-10-18 2014-04-24 Siemens Aktiengesellschaft Method, system, and computer readable medium for long term archiving of data in a mes system
CN106776846A (en) * 2016-11-28 2017-05-31 桂林远望智能通信科技有限公司 A kind of method and system for discharging database space
CN108932236A (en) * 2017-05-22 2018-12-04 北京金山云网络技术有限公司 A kind of file management method, scratch file delet method and device

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7103794B2 (en) * 1998-06-08 2006-09-05 Cacheflow, Inc. Network object cache engine
US20020112116A1 (en) * 2000-11-17 2002-08-15 Nelson Mark Edward Methods, systems, and computer program products for storing data in collections of tagged data pieces
US20030110190A1 (en) * 2001-12-10 2003-06-12 Hitachi, Ltd. Method and system for file space management
JP4244572B2 (en) * 2002-07-04 2009-03-25 ソニー株式会社 Cache device, cache data management method, and computer program
US8285692B2 (en) * 2010-01-15 2012-10-09 Oracle America, Inc. Method and system for attribute encapsulated data resolution and transcoding
US20140122774A1 (en) 2012-10-31 2014-05-01 Hong Kong Applied Science and Technology Research Institute Company Limited Method for Managing Data of Solid State Storage with Data Attributes
US9430376B2 (en) 2012-12-26 2016-08-30 Western Digital Technologies, Inc. Priority-based garbage collection for data storage systems
US8880838B2 (en) 2013-01-08 2014-11-04 Lyve Minds, Inc. Storage network data allocation
US10437470B1 (en) * 2015-06-22 2019-10-08 Amazon Technologies, Inc. Disk space manager
US11531468B2 (en) * 2016-06-10 2022-12-20 Apple Inc. System and method for managing storage space
US10620931B2 (en) * 2016-07-13 2020-04-14 At&T Mobility Ii Llc Automated device memory clean up mechanism

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200511065A (en) * 2003-09-03 2005-03-16 Icp Electronics Inc Method and system of managing files in intelligent network attached storage
US20140114923A1 (en) * 2012-10-18 2014-04-24 Siemens Aktiengesellschaft Method, system, and computer readable medium for long term archiving of data in a mes system
CN106776846A (en) * 2016-11-28 2017-05-31 桂林远望智能通信科技有限公司 A kind of method and system for discharging database space
CN108932236A (en) * 2017-05-22 2018-12-04 北京金山云网络技术有限公司 A kind of file management method, scratch file delet method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
冯学斌;洪帆;龙涛;刘铭;: "多级安全XML文档删除操作安全策略研究", 计算机工程与应用, no. 22, 1 August 2008 (2008-08-01) *

Also Published As

Publication number Publication date
CN113778964B (en) 2024-03-22
TW202147121A (en) 2021-12-16
US20210390062A1 (en) 2021-12-16
US11392510B2 (en) 2022-07-19
TWI751580B (en) 2022-01-01

Similar Documents

Publication Publication Date Title
US8782011B2 (en) System and method for scalable reference management in a deduplication based storage system
US7933938B2 (en) File storage system, file storing method and file searching method therein
EP2026184B1 (en) Device, method, and program for selecting data storage destination from a plurality of tape recording devices
KR101663547B1 (en) Method and apparatus for archiving and searching database
CN110888837B (en) Object storage small file merging method and device
US9280551B2 (en) De-duplication deployment planning
CN113778964B (en) Recording device for storing multiple temporary storage files and management method of temporary storage files
US7752206B2 (en) Method and data processing system for managing a mass storage system
CN110727406A (en) Data storage scheduling method and device
EP3422205A1 (en) Database-archiving method and apparatus that generate index information, and method and apparatus for searching archived database comprising index information
CN109918448A (en) A kind of cloud storage data classification method based on user behavior
CN108021484B (en) Method and system for prolonging expected life value of disk in cloud service system
CN109189343B (en) Metadata disk-dropping method, device, equipment and computer-readable storage medium
CN110019017B (en) High-energy physical file storage method based on access characteristics
US8095768B2 (en) VSAM smart reorganization
CN113609090A (en) Data storage method and device, computer readable storage medium and electronic equipment
US11789639B1 (en) Method and apparatus for screening TB-scale incremental data
CN112328587A (en) Data processing method and device for ElasticSearch
TW202203018A (en) Method for training machine learning model and data system
US11775515B2 (en) Dataset optimization framework
CN115185742A (en) Repeated data identification and deletion method based on interval detection
CN113392069A (en) Method and system for cleaning and maintaining elastic search log index file
CN117609181A (en) Method and system for migrating TCHouse database
CN116501257A (en) Data processing method, device, cache system, electronic equipment and storage medium
CN112764960A (en) Method and system for disk failure prediction, detection and non-sensing replacement

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant