CN105787012A - Method for improving small file processing capability of storage system and storage system - Google Patents
Method for improving small file processing capability of storage system and storage system Download PDFInfo
- Publication number
- CN105787012A CN105787012A CN201610098733.2A CN201610098733A CN105787012A CN 105787012 A CN105787012 A CN 105787012A CN 201610098733 A CN201610098733 A CN 201610098733A CN 105787012 A CN105787012 A CN 105787012A
- Authority
- CN
- China
- Prior art keywords
- file
- memory space
- stored
- size
- deleted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method for improving small file processing capability of a storage system and the storage system.The storage system comprises a first storage space, a second storage space and a third storage space, and read-write performance of the second storage space is superior to that of the first storage space.The method comprises the steps of receiving a file to be stored; judging whether the size of the file to be stored is greater than a threshold value or not; if the size of the file to be stored is greater than the threshold value, storing the file to be stored into the first storage space; if the size of the file to be stored is less than or equal to the threshold value, storing the file to be stored into the second storage space; storing file identification and the size of the file to be stored as well as a storage address of the file to be stored in the first storage space or the second storage space as metadata, and establishing the corresponding relation among the file identification and the size of the file to be stored and the storage address.By means of the method, the read-write speed of the file with the size being less than the threshold value can be raised.
Description
Technical field
The present invention relates to storage processing technology field, particularly relate to a kind of storage system that improves and process method and the storage system of small documents.
Background technology
Along with the development of science and technology, electronic equipment is more and more less, and people increasingly like being undertaken handling official business by electronic equipment, learn, amusement etc..
In order to facilitate strange land to fetch data, user increasingly likes the storage system storing data in high in the clouds, and the stored data of storage system thereby resulting in high in the clouds present volatile growth, and storage system is also more and more huger.Huge storage data to the process performance of storage system it is also proposed that higher requirement.In order to tackle huge storage data, heritage storage system improves process performance mainly through the mode increasing processor, and its cost is much more expensive.
Find in long-term research present inventor: in most storage system, in stored data, major part file is smaller than the small documents of 1M, under some application scenarios, the quantity of small documents can reach millions not more than, and the read-write frequency of small documents is also very high, but heritage storage system is as broad as long small documents and big file, and unified storage, therefore, many times, storage system frequently reads and writes the performance bottleneck that the limit is storage system of small documents.
Summary of the invention
The technical problem that present invention mainly solves is to provide a kind of storage system that improves and processes the method for small documents and storage system, it is possible to increase to the size read or write speed less than the file of threshold value.
For solving above-mentioned technical problem, the technical scheme that the present invention adopts is: provides a kind of and improves the method that storage system processes small documents, storage system includes the first memory space, the second memory space and the 3rd memory space, the readwrite performance of described second memory space is better than the readwrite performance of the first memory space, and described method includes: receive file to be stored；Judge that whether the size of file to be stored is more than threshold value；If more than threshold value, described file to be stored is stored to the first memory space；If less than or equal to threshold value, described file to be stored is stored to the second memory space；The file identification of described file to be stored, size and described file to be stored are stored to metadata in the storage address of the first memory space or the second memory space, and sets up the corresponding relation between the file identification of described file to be stored, size and storage address.
Wherein, described method includes: receiving file increases request, and wherein, described file increases to ask to carry to be waited increase content and wait to increase the file identification of file；According to the described file identification waiting to increase file, wait increase the stored storage address of file and wait to increase the size of file from described in described 3rd memory space acquisition；According to described wait increase file size, it is judged that described in wait increase file whether be stored in the second memory space；If so, wait to increase the size of content described in then judging and wait that whether the size sum increasing file is more than threshold value；If more than threshold value, then wait described in basis that increasing the stored storage address acquisition of file waits to increase file, and wait that increasing file is transferred to the first memory space by described；Wait to increase content and store to waiting by described and increase in file, and be updated to threeth memory space in the storage address of the first memory space and the size waiting to increase file after increasing content by described wait increasing file.
Wherein, described method includes: receive file content removal request, and wherein, described file content removal request is carried the file identification of file to be deleted and deletes mark；File identification according to file described to be deleted, from the size of file to be deleted stored storage address and file to be deleted described in described 3rd memory space acquisition；According to the stored storage address of file described to be deleted, file to be deleted described in acquisition, and combine and delete the mark content to file described to be deleted and delete；Size according to file to be deleted, it is judged that described in file to be deleted whether be positioned at the first memory space, and judge that whether the size of the file to be deleted after deleting content is less than or equal to threshold value；If described in file to be deleted be positioned at the first memory space, and the size of the file described to be deleted after deletion content is less than or equal to threshold value, then the file to be deleted after described deletion content is transferred to the second memory space, and the size of the described file to be deleted storage address in the second memory space and the file described to be deleted after deletion content is updated to the 3rd memory space.
Wherein, described method also includes: receiving file read request, wherein, described file read request carries the file identification of the file that continues；File identification according to the described file that continues, from the stored storage address of file of continuing described in described 3rd memory space acquisition；According to the stored storage address of the described file that continues, continue described in extraction file, and the file that continues described in return.
Wherein, described first memory space is mechanical hard disk, and described second memory space and the 3rd memory space are solid state hard disc.
For solving above-mentioned technical problem, another technical solution used in the present invention is: provide a kind of storage system, including the first memory space, the second memory space and the 3rd memory space, the readwrite performance of described second memory space is better than the readwrite performance of the first memory space, described storage system also includes: the first receiver module, is used for receiving file to be stored；Whether first judge module, be used for the size judging file to be stored more than threshold value；First memory module, for when described first judge module determines the size of described storage file more than threshold value, storing described file to be stored to the first memory space；Second memory module, for when described first judge module determines the size of described storage file less than or equal to threshold value, storing described file to be stored to the second memory space；First updating block, for the file identification of described file to be stored, size and described file to be stored being stored to metadata in the storage address of the first memory space or the second memory space, and set up corresponding relation between the file identification of described file to be stored, size and storage address.
Wherein, described storage system includes: the second receiver module, is used for receiving file and increases request, and wherein, described file increases to ask to carry to be waited increase content and wait to increase the file identification of file；First extraction module, waits to increase the file identification of file described in basis, waits increase the stored storage address of file and treat the size of increasing file from described in described 3rd memory space acquisition；Second judge module, for according to described in wait increase file size, it is judged that described in wait increase file whether be stored in the second memory space；3rd judge module, for described in determining at described second judge module in time increasing file and be stored in the second memory space, it is judged that described in wait increase the size of content and wait that whether the size sum increasing file is more than threshold value；First modular converter, for determining wait increasing the size of content and when the size sum of increasing file is more than threshold value at described 3rd judge module, wait that increasing the stored storage address acquisition of file waits to increase file according to described, and wait that increasing file is transferred to the first memory space by described, and wait that increasing file is updated to the 3rd memory space in the storage address of the first memory space by described；By described, 3rd memory module, for waiting that increasing content stores to treating in increasing file.
Wherein, described storage system includes: the 3rd receiver module, is used for receiving file content removal request, and wherein, described file deletion requests is carried the file identification of file to be deleted and deletes mark；Second extraction module, the file identification of file to be deleted described in basis, from the size of file to be deleted stored storage address and file to be deleted described in described 3rd memory space acquisition；Removing module, for according to described in the stored storage address of file to be deleted, file to be deleted described in acquisition, and combine and delete mark the content of file described to be deleted is deleted；4th judge module, for according to the size of file to be deleted, it is judged that described in file to be deleted whether be positioned at the first memory space, and judge that whether the size of the file to be deleted after deletion content is less than or equal to threshold value；Second modular converter, it is positioned at the first memory space for file to be deleted described in determining at described 4th judge module, and the size of the file described to be deleted after deletion content less than or equal to threshold value time, file to be deleted after described deletion content is transferred to the second memory space, and the size of the described file to be deleted storage address in the second memory space and the file described to be deleted after deletion content is updated to the 3rd memory space.
Wherein, described storage system includes: the 4th receiver module, is used for receiving file read request, and wherein, described file read request carries the file identification of the file that continues；3rd extraction module, the file identification of the file that continues described in basis, from the stored storage address of file of continuing described in described 3rd memory space acquisition；Returning module, the stored storage address of file of continuing described in basis, continue described in extraction file, and the file that continues described in return.
Wherein, described first memory space is mechanical hard disk, and described second memory space and the 3rd memory space are solid state hard disc.
The invention has the beneficial effects as follows: be different from the situation of prior art, size is stored in the second memory space less than the file of threshold value by the present invention, size is stored in the first memory space more than or equal to the file of threshold value, owing to the readwrite performance of the second memory space is better than the first memory space, improve the size read or write speed less than the file of threshold value, be especially suitable for the application scenarios that small documents is had performance requirement.
Accompanying drawing explanation
Fig. 1 is the flow chart that the present invention improves that storage system processes the method embodiment of small documents；
Fig. 2 is that the present invention improves storage system and processes in the method embodiment of small documents when the size of the file in the second memory space exceedes threshold value, and the flow process that moved by file to the first memory space is intended to；
Fig. 3 is that the present invention improves storage system when processing that in the method embodiment of small documents, the size of file in the first memory space is lower than threshold value, and file moves the flow chart to the second memory space；
Fig. 4 is that the present invention improves storage system and processes in the method embodiment of small documents and return, according to file read request, the flow chart of file of continuing；
Fig. 5 is the schematic diagram that the present invention stores system embodiment.
Detailed description of the invention
Below in conjunction with drawings and embodiments, the present invention is described in detail.
Storage system includes the first memory space, the second memory space and the 3rd memory space, the readwrite performance of the first memory space is better than the second memory space, in the present embodiment, first memory space is mechanical hard disk, second memory space and the 3rd memory space are solid state hard disc, referring to Fig. 1, method includes:
Step S201: receive file to be stored；
Step S202: judge that whether the size of file to be stored is more than threshold value, if more than threshold value, then enters step S203, otherwise enters step S204；
Threshold value is arranged to adjustable, so that staff can regulate the size of threshold value according to practical situation.
Step S203: file to be stored is stored to the first memory space；
Step S204: file to be stored is stored to the second memory space；
Step S205: the file identification of file to be stored, size and file to be stored are stored to the 3rd memory space in the storage address of the first memory space or the second memory space, and sets up the corresponding relation between the file identification of file to be stored, size and storage address.
To store to the second memory space less than the file of threshold value, the file above or equal to threshold value stores to the first memory space, and the readwrite performance of the second memory space is better, is conducive to improving storage system and processes the speed of small documents.
Further, when the content change of the file in storage system, the position at file place also can be adjusted according to the size of the file after variation, processing speed to ensure small documents is better, concrete, when the size of the file in the second memory space exceedes threshold value, file is moved to the first memory space, referring to Fig. 2, method also includes:
Step: S301: receiving file increases request, wherein, file increases to ask to carry to be waited increase content and wait to increase the file identification of file；
Step S302: according to waiting to increase the file identification of file, obtains from the 3rd memory space and waits increase the stored storage address of file and wait to increase the size of file；
Step S303: according to waiting to increase the size of file, it is judged that wait to increase whether file is stored in the second memory space, if so, then enters step S304, does not otherwise process；
Step S304: judge the size waiting to increase content and wait that whether the size sum increasing file is more than threshold value, if more than threshold value, then entering step S305, otherwise do not process；
Step S305: according to waiting that increasing the stored storage address acquisition of file waits to increase file, and will wait that increasing file is transferred to the first memory space；
After increasing file and increasing content, waiting that the size increasing file can exceed threshold value, therefore, first will wait that increasing file is transferred to the first memory space, then for waiting that increasing file increases content, reduces the number of times of write in the first memory space.If first treating that increasing content is write to wait to increase file, more mobile waiting increasing file, then wait that increasing content needs twice write operation of execution, wastes resource.
Step S306: will wait to increase content and store to waiting and increase in file, and the 3rd memory space will be updated in the storage address of the first memory space and the size waiting to increase file after increasing content wait increasing file；
By after increasing the file size waiting to increase file behind the storage address of the first memory space and increase content and being updated to the 3rd memory space, wait to increase file all capped in the former storage address of the 3rd memory space and life size, in order to avoid makeing mistakes.
It addition, when the size of the file in the first memory space is lower than threshold value, it is possible to file is moved to the second memory space, it is ensured that small documents is positioned at the second memory space, and big file is positioned at the first memory space, refers to Fig. 3, and method includes:
Step S401: receive file content removal request, wherein, file content removal request is carried the file identification of file to be deleted and deletes mark；
Delete mark is used for indicating which part content of deletion file to be deleted.
Step S402: the file identification according to file to be deleted, obtains the size of file to be deleted stored storage address and file to be deleted from the 3rd memory space；
Step S403: according to the stored storage address of file to be deleted, file to be deleted described in acquisition, and combine deletion mark and treat the content deleting file and delete；
Step S404: the size according to file to be deleted, judge whether file to be deleted is positioned at the first memory space, and judge that whether the size deleting the file to be deleted after content is less than or equal to threshold value, if file to be deleted is positioned at the first memory space, and the size of the file to be deleted after deletion content is less than or equal to threshold value, then enter step S405, otherwise do not process；
Step S405: the file to be deleted after deleting content is transferred to the second memory space, and the size of the file to be deleted storage address in the second memory space and the file to be deleted after deletion content is updated to the 3rd memory space；
First according to deleting to identify, content to be deleted is deleted, more mobile file to be deleted, advantageously reduce the amount of movement of mobile file to be deleted, reduce the resource overhead of storage system.
Further, referring to Fig. 4, method also includes:
Step S501: receiving file read request, wherein, file read request carries the file identification of the file that continues；
Step S502: the file identification according to the file that continues, obtains, from the 3rd memory space, the stored storage address of file of continuing；
Step S503: according to the stored storage address of the file that continues, extracts the file that continues, and returns the file that continues.
When the size of the file that continues is less than threshold value, the file that continues can be stored in the second memory space, when the size of the file that continues is more than threshold value, the file that continues can be stored in the first memory space, and the readwrite performance of the second memory space is better than the first memory space, therefore, read, from the first memory space, the speed of file of continuing fast.
In embodiments of the present invention, size is stored in the second memory space less than the file of threshold value, size is stored in the first memory space more than or equal to the file of threshold value, owing to the readwrite performance of the second memory space is better than the first memory space, improve the size read or write speed less than the file of threshold value, be especially suitable for the application scenarios that small documents is had performance requirement.
The present invention provides again storage system embodiment.Referring to Fig. 5, storage system 60 includes the first memory space the 61, second memory space the 62, the 3rd memory space the 63, first receiver module the 64, first judge module the 65, first memory module the 66, second memory module 67 and the first updating block 68.The readwrite performance of the second memory space 62 is better than the readwrite performance of the first memory space 61, and in the present embodiment, the first memory space 61 is mechanical hard disk, and the second memory space 62 and the 3rd memory space 63 are solid state hard disc.
First receiver module 64 is used for receiving file to be stored.Whether first judge module 65 is used for the size judging file to be stored more than threshold value.First memory module 66 is for when the first judge module 65 determines the size storing file more than threshold value, storing file to be stored to the first memory space 61.Second memory module 67 is for when the first judge module 65 determines the size storing file less than or equal to threshold value, storing file to be stored to the second memory space 62.First updating block 68 is for storing the file identification of file to be stored, size and file to be stored to metadata in the storage address of the first memory space 61 or the second memory space 62, and sets up corresponding relation between file identification, size and storage address.
When file in storage system 60 changes, can according to the size of the file after changing, readjust the position at file place, then storage system 60 also includes second receiver module the 69, first extraction module the 70, second judge module the 71, the 3rd judge module the 72, first modular converter the 73, the 3rd memory module the 74, the 3rd receiver module the 75, second extraction module 76, removing module the 77, the 4th judge module 78 and the second modular converter 79.
Second receiver module 69 is used for receiving file and increases request, and wherein, file increases to ask to carry to be waited increase content and wait to increase the file identification of file.First extraction module 70 is for according to waiting to increase the file identification of file, obtaining from the 3rd memory space 63 and wait increase the stored storage address of file and wait to increase the size of file.Second judge module 71 is for according to waiting to increase the size of file, it is judged that wait to increase whether file is stored in the second memory space 62.3rd judge module 72 is for determining in time increasing file and be stored in the second memory space 62 at the second judge module 71, it is judged that wait increase the size of content and wait that whether the size sum increasing file is more than threshold value.First modular converter 73 is for determining wait increasing the size of content and when the size sum of increasing file is more than threshold value at the 3rd judge module 72, according to waiting that increasing the stored storage address acquisition of file waits to increase file, and will wait that increasing file is transferred to the first memory space 61, and will wait that increasing file is updated to the 3rd memory space 63 in the storage address of the first memory space 61.3rd memory module 74 will be for waiting that increasing content stores to treating in increasing file.
3rd receiver module 75, is used for receiving file content removal request, and wherein, file deletion requests is carried the file identification of file to be deleted and deletes mark.Second extraction module 76, for according to the file identification of file to be deleted, from the 3rd memory space 63 obtain described in the size of file to be deleted stored storage address and file to be deleted.Removing module 77, for according to the stored storage address of file to be deleted, obtains file to be deleted, and combines deletion mark and treat the content deleting file and delete.4th judge module 78, for according to the size of file to be deleted, it is judged that whether file to be deleted is positioned at the first memory space 61, and judges that whether the size of the file to be deleted after deletion content is less than or equal to threshold value.Second modular converter 79, it is positioned at the first memory space 61 for determining file to be deleted at the 4th judge module 78, and the size of the file to be deleted after deletion content less than or equal to threshold value time, file to be deleted after deleting content is transferred to the second memory space 62, and the size of the file to be deleted storage address in the second memory space 62 and the file to be deleted after deletion content is updated to the 3rd memory space 63.
Storage system 60 also includes the 4th receiver module the 80, the 3rd extraction module 81 and returns module 82.4th receiver module 80, is used for receiving file read request, and wherein, described file read request carries the file identification of the file that continues.3rd extraction module 81, for the file identification according to the file that continues, obtains, from the 3rd memory space 63, the stored storage address of file of continuing.Return module 82, for according to continuing the stored storage address of file, extracting the file that continues, and return the file that continues.
In embodiments of the present invention, when the size of file to be stored is less than threshold value, file to be stored is stored to the second memory space 62, when the size of file to be stored is more than or equal to threshold value, file to be stored is stored to the first memory space 61, owing to the readwrite performance of the second memory space 62 is better than the first memory space 61, improves the size read or write speed less than the file of threshold value, be especially suitable for the application scenarios that small documents is had performance requirement.
The foregoing is only embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every equivalent structure utilizing description of the present invention and accompanying drawing content to make or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, all in like manner include in the scope of patent protection of the present invention.
Claims (10)
1. one kind is improved the method that storage system processes small documents, it is characterized in that, described storage system includes the first memory space, the second memory space and the 3rd memory space, and the readwrite performance of described second memory space is better than the readwrite performance of the first memory space, and described method includes:
Receive file to be stored；
Judge that whether the size of file to be stored is more than threshold value；
If more than threshold value, described file to be stored is stored to the first memory space；
If less than or equal to threshold value, described file to be stored is stored to the second memory space；
The file identification of described file to be stored, size and described file to be stored are stored to metadata in the storage address of the first memory space or the second memory space, and sets up the corresponding relation between the file identification of described file to be stored, size and storage address.
2. method according to claim 1, it is characterised in that described method includes:
Receiving file and increase request, wherein, described file increases to ask to carry to be waited increase content and wait to increase the file identification of file；
According to the described file identification waiting to increase file, wait increase the stored storage address of file and wait to increase the size of file from described in described 3rd memory space acquisition；
According to described wait increase file size, it is judged that described in wait increase file whether be stored in the second memory space；
If so, wait to increase the size of content described in then judging and wait that whether the size sum increasing file is more than threshold value；
If more than threshold value, then wait described in basis that increasing the stored storage address acquisition of file waits to increase file, and wait that increasing file is transferred to the first memory space by described；
Wait to increase content and store to waiting by described and increase in file, and be updated to threeth memory space in the storage address of the first memory space and the size waiting to increase file after increasing content by described wait increasing file.
3. method according to claim 2, it is characterised in that described method includes:
Receiving file content removal request, wherein, described file content removal request is carried the file identification of file to be deleted and deletes mark；
File identification according to file described to be deleted, from the size of file to be deleted stored storage address and file to be deleted described in described 3rd memory space acquisition；
According to the stored storage address of file described to be deleted, file to be deleted described in acquisition, and combine and delete the mark content to file described to be deleted and delete；
Size according to file to be deleted, it is judged that described in file to be deleted whether be positioned at the first memory space, and judge that whether the size of the file to be deleted after deleting content is less than or equal to threshold value；
If described in file to be deleted be positioned at the first memory space, and the size of the file described to be deleted after deletion content is less than or equal to threshold value, then the file to be deleted after described deletion content is transferred to the second memory space, and the size of the described file to be deleted storage address in the second memory space and the file described to be deleted after deletion content is updated to the 3rd memory space.
4. method according to claim 3, it is characterised in that described method also includes:
Receiving file read request, wherein, described file read request carries the file identification of the file that continues；
File identification according to the described file that continues, from the stored storage address of file of continuing described in described 3rd memory space acquisition；
According to the stored storage address of the described file that continues, continue described in extraction file, and the file that continues described in return.
5. method according to claim 1, it is characterised in that
Described first memory space is mechanical hard disk, and described second memory space and the 3rd memory space are solid state hard disc.
6. a storage system, it is characterised in that including the first memory space, the second memory space and the 3rd memory space, the readwrite performance of described second memory space is better than the readwrite performance of the first memory space, and described storage system also includes:
First receiver module, is used for receiving file to be stored；
Whether first judge module, be used for the size judging file to be stored more than threshold value；
First memory module, for when described first judge module determines the size of described storage file more than threshold value, storing described file to be stored to the first memory space；
Second memory module, for when described first judge module determines the size of described storage file less than or equal to threshold value, storing described file to be stored to the second memory space；
First updating block, for the file identification of described file to be stored, size and described file to be stored being stored to metadata in the storage address of the first memory space or the second memory space, and set up corresponding relation between the file identification of described file to be stored, size and storage address.
7. storage system according to claim 6, it is characterised in that described storage system includes:
Second receiver module, is used for receiving file and increases request, and wherein, described file increases to ask to carry to be waited increase content and wait to increase the file identification of file；
First extraction module, waits to increase the file identification of file described in basis, waits increase the stored storage address of file and treat the size of increasing file from described in described 3rd memory space acquisition；
Second judge module, for according to described in wait increase file size, it is judged that described in wait increase file whether be stored in the second memory space；
3rd judge module, for described in determining at described second judge module in time increasing file and be stored in the second memory space, it is judged that described in wait increase the size of content and wait that whether the size sum increasing file is more than threshold value；
First modular converter, for determining wait increasing the size of content and when the size sum of increasing file is more than threshold value at described 3rd judge module, wait that increasing the stored storage address acquisition of file waits to increase file according to described, and wait that increasing file is transferred to the first memory space by described, and wait that increasing file is updated to the 3rd memory space in the storage address of the first memory space by described；
By described, 3rd memory module, for waiting that increasing content stores to treating in increasing file.
8. storage system according to claim 6, it is characterised in that described storage system includes:
3rd receiver module, is used for receiving file content removal request, and wherein, described file deletion requests is carried the file identification of file to be deleted and deletes mark；
Second extraction module, the file identification of file to be deleted described in basis, from the size of file to be deleted stored storage address and file to be deleted described in described 3rd memory space acquisition；
Removing module, for according to described in the stored storage address of file to be deleted, file to be deleted described in acquisition, and combine and delete mark the content of file described to be deleted is deleted；
4th judge module, for according to the size of file to be deleted, it is judged that described in file to be deleted whether be positioned at the first memory space, and judge that whether the size of the file to be deleted after deletion content is less than or equal to threshold value；
Second modular converter, it is positioned at the first memory space for file to be deleted described in determining at described 4th judge module, and the size of the file described to be deleted after deletion content less than or equal to threshold value time, file to be deleted after described deletion content is transferred to the second memory space, and the size of the described file to be deleted storage address in the second memory space and the file described to be deleted after deletion content is updated to the 3rd memory space.
9. storage system according to claim 6, it is characterised in that described storage system includes:
4th receiver module, is used for receiving file read request, and wherein, described file read request carries the file identification of the file that continues；
3rd extraction module, the file identification of the file that continues described in basis, from the stored storage address of file of continuing described in described 3rd memory space acquisition；
Returning module, the stored storage address of file of continuing described in basis, continue described in extraction file, and the file that continues described in return.
10. storage system according to claim 6, it is characterised in that
Described first memory space is mechanical hard disk, and described second memory space and the 3rd memory space are solid state hard disc.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610098733.2A CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610098733.2A CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105787012A true CN105787012A (en) | 2016-07-20 |
| CN105787012B CN105787012B (en) | 2019-08-27 |
Family
ID=56402875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610098733.2A Active CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105787012B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106412093A (en) * | 2016-10-25 | 2017-02-15 | 广东欧珀移动通信有限公司 | Method, device and system for uploading data |
| CN107968818A (en) * | 2017-11-17 | 2018-04-27 | 北京联想超融合科技有限公司 | Storage method, device and the server cluster of data |
| WO2018133580A1 (en) * | 2017-01-23 | 2018-07-26 | 北京奇虎科技有限公司 | Method and device for protecting local file of smart terminal |
| CN109857548A (en) * | 2019-01-04 | 2019-06-07 | 平安科技（深圳）有限公司 | Memory space optimization method, device, computer equipment and storage medium |
| CN110018788A (en) * | 2019-03-01 | 2019-07-16 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN107886008B (en) * | 2016-09-30 | 2020-11-03 | 北京京东尚科信息技术有限公司 | File management method, system, device and computer readable storage medium |
| CN111897485A (en) * | 2019-05-05 | 2020-11-06 | 北京兆易创新科技股份有限公司 | Data storage method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102508789A (en) * | 2011-10-14 | 2012-06-20 | 浪潮电子信息产业股份有限公司 | Grading storage method for system |
| CN102713824A (en) * | 2009-10-29 | 2012-10-03 | 康德斯威技术公司 | Allocating storage memory based on future use estimates |
| CN103678143A (en) * | 2012-09-25 | 2014-03-26 | 联想(北京)有限公司 | File storage method and device and electronic equipment |
| CN105094695A (en) * | 2015-06-29 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Storing method and system |
-
2016
- 2016-02-23 CN CN201610098733.2A patent/CN105787012B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102713824A (en) * | 2009-10-29 | 2012-10-03 | 康德斯威技术公司 | Allocating storage memory based on future use estimates |
| CN102508789A (en) * | 2011-10-14 | 2012-06-20 | 浪潮电子信息产业股份有限公司 | Grading storage method for system |
| CN103678143A (en) * | 2012-09-25 | 2014-03-26 | 联想(北京)有限公司 | File storage method and device and electronic equipment |
| CN105094695A (en) * | 2015-06-29 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Storing method and system |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107886008B (en) * | 2016-09-30 | 2020-11-03 | 北京京东尚科信息技术有限公司 | File management method, system, device and computer readable storage medium |
| CN106412093A (en) * | 2016-10-25 | 2017-02-15 | 广东欧珀移动通信有限公司 | Method, device and system for uploading data |
| CN106412093B (en) * | 2016-10-25 | 2019-07-23 | Oppo广东移动通信有限公司 | A kind of method for uploading of data, apparatus and system |
| WO2018133580A1 (en) * | 2017-01-23 | 2018-07-26 | 北京奇虎科技有限公司 | Method and device for protecting local file of smart terminal |
| CN107968818A (en) * | 2017-11-17 | 2018-04-27 | 北京联想超融合科技有限公司 | Storage method, device and the server cluster of data |
| CN107968818B (en) * | 2017-11-17 | 2021-06-04 | 北京联想超融合科技有限公司 | Data storage method and device and server cluster |
| CN109857548A (en) * | 2019-01-04 | 2019-06-07 | 平安科技（深圳）有限公司 | Memory space optimization method, device, computer equipment and storage medium |
| CN109857548B (en) * | 2019-01-04 | 2023-08-22 | 平安科技（深圳）有限公司 | Storage space optimization method, storage space optimization device, computer equipment and storage medium |
| CN110018788A (en) * | 2019-03-01 | 2019-07-16 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN111897485A (en) * | 2019-05-05 | 2020-11-06 | 北京兆易创新科技股份有限公司 | Data storage method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105787012B (en) | 2019-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105787012A (en) | Method for improving small file processing capability of storage system and storage system | |
| CN101826107B (en) | Hash data processing method and device | |
| EP2898430B1 (en) | Mail indexing and searching using hierarchical caches | |
| CN102479250A (en) | Disk caching method for embedded browser | |
| CN104092670A (en) | Method for utilizing network cache server to process files and device for processing cache files | |
| CN105677742A (en) | Method and apparatus for storing files | |
| CN103678166A (en) | Method and system for using solid-state disk as cache of computer | |
| CN104778222A (en) | Media library establishing and updating method on basis of USB (Universal Serial Bus) storage equipment | |
| CN103473732A (en) | Mobile GIS (Geographic Information System) slice map showing method based on concurrent control and double-cache technologies | |
| CN102737068A (en) | Method and equipment for performing cache management on retrieval data | |
| CN103136215A (en) | Data read-write method and device of storage system | |
| CN104391653A (en) | Data block-based cache design method | |
| CN103942301A (en) | Distributed file system oriented to access and application of multiple data types | |
| CN112463730A (en) | Method, system and medium for hierarchical optimization of storage of massive small files | |
| CN104158863A (en) | Cloud storage mechanism based on transaction-level whole-course high-speed buffer | |
| CN102841894A (en) | Data storage method of file allocation table | |
| CN104391947B (en) | Magnanimity GIS data real-time processing method and system | |
| CN111427920B (en) | Data acquisition method, device, system, computer equipment and storage medium | |
| CN103488772A (en) | Method, system and equipment for caching files through external storage | |
| CN106250473B (en) | Remote sensing image cloud storage method | |
| CN105045540A (en) | Data layout method of solid-state disk array | |
| CN103176753A (en) | Storage device and data management method of storage device | |
| CN107967306B (en) | Method for rapidly mining association blocks in storage system | |
| CN102495902B (en) | Method and system for simultaneously realizing ETL (Extract Transform and Load) process of spatial data and attribute data | |
| CN108958657A (en) | A kind of date storage method, storage equipment and storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |