CN105787012B - A kind of method and storage system improving storage system processing small documents - Google Patents
A kind of method and storage system improving storage system processing small documents Download PDFInfo
- Publication number
- CN105787012B CN105787012B CN201610098733.2A CN201610098733A CN105787012B CN 105787012 B CN105787012 B CN 105787012B CN 201610098733 A CN201610098733 A CN 201610098733A CN 105787012 B CN105787012 B CN 105787012B
- Authority
- CN
- China
- Prior art keywords
- file
- memory space
- stored
- deleted
- size
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the methods and storage system of a kind of raising storage system processing small documents, the storage system includes the first memory space, the second memory space and third memory space, the readwrite performance of second memory space is better than the readwrite performance of the first memory space, which comprises receives file to be stored；Judge whether the size of file to be stored is greater than threshold value；If more than threshold value, the file to be stored is stored to the first memory space；If being less than or equal to threshold value, the file to be stored is stored to the second memory space；The file identification of the file to be stored, size and the file to be stored are stored in the storage address of the first memory space or the second memory space to metadata, and establish the corresponding relationship between file identification, size and the storage address of the file to be stored.By the above-mentioned means, the present invention can be improved the read or write speed for being less than the file of threshold value to size.
Description
Technical field
The present invention relates to storage processing technology fields, more particularly to a kind of method of raising storage system processing small documents
And storage system.
Background technique
With the development of science and technology, electronic equipment is smaller and smaller, and people increasingly like doing by electronic equipment
Public, study, amusement etc..
In order to facilitate strange land access evidence, user increasingly likes storing data in the storage system in cloud, thereby results in
Volatile growth is presented in the data that the storage system in cloud is stored, and storage system is also more and more huger.Huge storage number
It is also put forward higher requirements according to the process performance to storage system.In order to cope with huge storing data, heritage storage system master
Process performance is improved by way of increasing processor, cost is very expensive.
It is found in long-term research in present inventor: big in the data stored in most storage system
Partial document is smaller than the small documents of 1M, and under certain application scenarios, the quantity of small documents can reach ten million rank or more, and
And the read-write frequency of small documents is also very high, but heritage storage system is not different small documents and big file, and uniformly store,
Therefore, many times, storage system frequently reads and writes the performance bottleneck that the limit of small documents is storage system.
Summary of the invention
The invention mainly solves the technical problem of providing a kind of method of raising storage system processing small documents and deposit
Storage system can be improved the read or write speed for being less than the file of threshold value to size.
In order to solve the above technical problems, one technical scheme adopted by the invention is that: it provides at a kind of raising storage system
The method for managing small documents, storage system include the first memory space, the second memory space and third memory space, and described second deposits
The readwrite performance for storing up space is better than the readwrite performance of the first memory space, which comprises receives file to be stored；Judge to
Whether the size of storage file is greater than threshold value；If more than threshold value, the file to be stored is stored to the first memory space；If small
In or equal to threshold value, the file to be stored is stored to the second memory space；By the file identification of the file to be stored, greatly
The small and described file to be stored is stored in the storage address of the first memory space or the second memory space to metadata, and is built
Found the corresponding relationship between file identification, size and the storage address of the file to be stored.
Wherein, which comprises receive file and increase request, wherein the file increases request and carries content to be increased
With the file identification of file to be increased；According to the file identification of the file to be increased, from the third memory space obtain it is described to
Increase the size of storage address and file to be increased that file is stored；According to the size of the file to be increased, the text to be increased is judged
Whether part is stored in the second memory space；If so, judging that the sum of size and size of file to be increased of the content to be increased are
It is no to be greater than threshold value；If more than threshold value, then file to be increased is obtained according to the storage address that the file to be increased is stored, and will be described
File to be increased is transferred to the first memory space；The content to be increased is stored to wait increase in file, and by the file to be increased and is existed
The storage address of first memory space and the size for increasing the file to be increased after content are updated to third memory space.
Wherein, which comprises receive file content removal request, wherein the file content removal request carries
The file identification and deletion mark of file to be deleted；According to the file identification of the file to be deleted, obtained from the third memory space
The size of the storage address and file to be deleted that take the file to be deleted to be stored；The storage stored according to the file to be deleted
Location obtains the file to be deleted, and deletes in conjunction with mark is deleted the content of the file to be deleted；According to file to be deleted
Size, judges whether the file to be deleted is located at the first memory space, and the big of the file to be deleted after content is deleted in judgement
It is small whether to be less than or equal to threshold value；If the file to be deleted is located at the first memory space, and delete after content it is described to
The size for deleting file is less than or equal to threshold value, then the file to be deleted after the deletion content is transferred to the second storage sky
Between, and the file to be deleted by the file to be deleted in the storage address in the second memory space and after deleting content
Size be updated to third memory space.
Wherein, the method also includes: receive file read request, wherein file read request carrying is continued text
The file identification of part；According to the file identification of the file that continues, from file institute of continuing described in third memory space acquisition
The storage address of storage；According to the storage address that the file that continues is stored, continue file described in extraction, and return it is described to
Read file.
Wherein, first memory space is mechanical hard disk, and second memory space and third memory space are solid
State hard disk.
In order to solve the above technical problems, another technical solution used in the present invention is: a kind of storage system is provided, including
The readwrite performance of first memory space, the second memory space and third memory space, second memory space is deposited better than first
Store up the readwrite performance in space, the storage system further include: the first receiving module, for receiving file to be stored；First judgement
Module, for judging whether the size of file to be stored is greater than threshold value；First memory module, in the first judgment module
When determining the size of the storage file greater than threshold value, the file to be stored is stored to the first memory space；Second deposits
Module is stored up, it, will be described when the size for determining the storage file in the first judgment module is less than or equal to threshold value
File to be stored is stored to the second memory space；First updating unit, for by the file identification of the file to be stored, size
And the file to be stored is stored in the storage address of the first memory space or the second memory space to metadata, and is established
Corresponding relationship between the file identification of the file to be stored, size and storage address.
Wherein, the storage system includes: the second receiving module, increases request for receiving file, wherein the file
Increase the file identification that request carries content to be increased and file to be increased；First extraction module, for according to the file to be increased
File identification obtains the size of storage address and file to be increased that the file to be increased is stored from the third memory space；
Second judgment module judges whether the file to be increased is stored in the second storage sky for the size according to the file to be increased
Between；Third judgment module, for second judgment module determine it is described store wait increase file in the second memory space,
Judge whether the sum of the size of the content to be increased and the size of file to be increased are greater than threshold value；First conversion module, in institute
When stating third judgment module and determining the sum of the size wait increase content and the size wait increase file greater than threshold value, according to described wait increase
The storage address that file is stored obtains file to be increased, and the file to be increased is transferred to the first memory space, and by institute
It states file to be increased and is updated to third memory space in the storage address of the first memory space；Third memory module, being used for will be described
Content to be increased is stored to wait increase in file.
Wherein, the storage system includes: third receiving module, for receiving file content removal request, wherein described
File deletion requests carry the file identification of file to be deleted and delete mark；Second extraction module, for according to the text to be deleted
The file identification of part obtains the big of storage address that the file to be deleted is stored and file to be deleted from the third memory space
It is small；Removing module, the storage address for being stored according to the file to be deleted, obtains the file to be deleted, and combine and delete
Mark deletes the content of the file to be deleted；4th judgment module, for according to the size of file to be deleted, described in judgement
Whether file to be deleted is located at the first memory space, and judge delete content after file to be deleted size whether be less than or
Equal to threshold value；Second conversion module is located at the first storage sky for determining the file to be deleted in the 4th judgment module
Between, and delete content after the file to be deleted size be less than or equal to threshold value when, after the deletion content
File to be deleted is transferred to the second memory space, and by storage address of the file to be deleted in the second memory space and
The size of the file to be deleted after deleting content is updated to third memory space.
Wherein, the storage system includes: the 4th receiving module, for receiving file read request, wherein the file
Read requests carry the file identification for the file that continues；Third extraction module, for the file identification for the file that continues according to, from
The storage address that the file that continues described in the third memory space acquisition is stored；Return module, for the text that continues according to
The storage address that part is stored, continue described in extraction file, and the file that continues described in returning.
Wherein, first memory space is mechanical hard disk, and second memory space and third memory space are solid
State hard disk.
The beneficial effects of the present invention are: being in contrast to the prior art, the present invention deposits the file that size is less than threshold value
Storage is stored in the first memory space in the second memory space, by the file that size is greater than or equal to threshold value, since the second storage is empty
Between readwrite performance be better than the first memory space, improve to size be less than threshold value file read or write speed, be very suitable to small
File has the application scenarios of performance requirement.
Detailed description of the invention
Fig. 1 is the flow chart for the method implementation that the present invention improves storage system processing small documents；
Fig. 2 is that the present invention improves in the method implementation of storage system processing small documents when the text in the second memory space
When the size of part is more than threshold value, file is moved to the process in the first memory space and is intended to；
Fig. 3 is the text in the method implementation of present invention raising storage system processing small documents in the first memory space
When the size of part is lower than threshold value, file is moved to the flow chart in the second memory space；
Fig. 4 is to be returned in the method implementation of the invention for improving storage system processing small documents according to file read request
Continue the flow chart of file；
Fig. 5 is the schematic diagram of storage system embodiment of the present invention.
Specific embodiment
The present invention is described in detail with embodiment with reference to the accompanying drawing.
Storage system includes the first memory space, the second memory space and third memory space, the reading of the first memory space
Write performance is better than the second memory space, and in the present embodiment, the first memory space is mechanical hard disk, the second memory space and the
Three memory spaces are solid state hard disk, referring to Fig. 1, method includes:
Step S201: file to be stored is received；
Step S202: judging whether the size of file to be stored is greater than threshold value, if more than threshold value, then enters step S203,
Otherwise S204 is entered step；
Threshold value be arranged to it is adjustable so that staff can adjust the size of threshold value according to the actual situation.
Step S203: file to be stored is stored to the first memory space；
Step S204: file to be stored is stored to the second memory space；
Step S205: by the file identification of file to be stored, size and file to be stored in the first memory space or
The storage address of second memory space is stored to third memory space, and is established the file identification of file to be stored, size and deposited
Store up the corresponding relationship between address.
The file for being less than threshold value is stored to the second memory space, stores to first and deposits above or equal to the file of threshold value
Space is stored up, and the readwrite performance of the second memory space is more preferable, is conducive to the speed for improving storage system processing small documents.
It further, can also be according to the big of the file after variation when the content of the file in storage system changes
Position where small adjustment file, the processing speed to guarantee small documents is more preferable, specifically, the file in the second memory space
Size be more than threshold value when, file is moved in the first memory space, referring to Fig. 2, method further include:
Step: it S301: receives file and increases request, wherein file increases request and carries content to be increased and file to be increased
File identification；
Step S302: according to the file identification of file to be increased, obtain that file to be increased stored from third memory space is deposited
Store up the size of address and file to be increased；
Step S303: according to the size of file to be increased, judging whether file to be increased is stored in the second memory space, if so,
S304 is then entered step, is not otherwise handled；
Step S304: judging whether the sum of the size of content to be increased and the size of file to be increased are greater than threshold value, if more than threshold
Value, then enter step S305, otherwise do not handle；
Step S305: file to be increased is obtained according to the storage address that file to be increased is stored, and file to be increased is transferred to
First memory space；
After increasing file and increasing content, therefore file to be increased can be first transferred to by the size of file to be increased beyond threshold value
First memory space, then increase content in the first memory space for file to be increased, reduce the number of write-in.If first will be wait in increasing
Appearance writes file to be increased, then mobile file to be increased, then content to be increased needs to be implemented write operation twice, waste of resource.
Step S306: content to be increased is stored to wait increase in file, and by file to be increased the first memory space storage
Address and the size for increasing the file to be increased after content are updated to third memory space；
By wait increase file the storage address of the first memory space and increase content after file to be increased size more
Newly to after third memory space, file to be increased is capped in the former storage address and life size of third memory space, in order to avoid
Error.
In addition, file can also be moved to the second storage when the size of the file in the first memory space is lower than threshold value
In space, guarantee that small documents are located at the second memory space, big file is located at the first memory space, referring to Fig. 3, method includes:
Step S401: file content removal request is received, wherein file content removal request carries the file of file to be deleted
Mark and deletion mark；
It deletes mark and is used to indicate file to be deleted any part content deleted.
Step S402: according to the file identification of file to be deleted, obtain that file to be deleted stored from third memory space is deposited
Store up the size of address and file to be deleted；
Step S403: the storage address stored according to file to be deleted obtains the file to be deleted, and combines and delete mark
It treats and deletes the content of file and deleted；
Step S404: according to the size of file to be deleted, judge whether file to be deleted is located at the first memory space, and judgement
Whether the size of the file to be deleted after deleting content is less than or equal to threshold value, if file to be deleted is located at the first memory space,
And the size for deleting the file to be deleted after content then enters step S405, does not otherwise handle less than or equal to threshold value；
Step S405: the file to be deleted after deletion content is transferred to the second memory space, and file to be deleted is existed
The size of the file to be deleted after storage address and deletion content in second memory space is updated to third memory space；
First content to be deleted is deleted according to deletion mark, then mobile file to be deleted, advantageously reduces mobile file to be deleted
Amount of movement reduces the resource overhead of storage system.
Further, referring to Fig. 4, method further include:
Step S501: file read request is received, wherein file read request carries the file identification for the file that continues；
Step S502: according to the file identification for the file that continues, obtain that the file that continues stored from third memory space is deposited
Store up address；
Step S503: the storage address stored according to the file that continues extracts the file that continues, and returns to the file that continues.
When the size for the file that continues is less than threshold value, the file that continues can be stored in the second memory space, when the file that continues
When size is greater than threshold value, the file that continues can be stored in the first memory space, and the readwrite performance of the second memory space is better than first
Memory space, therefore, the speed for reading the file that continues from the first memory space are fast.
In embodiments of the present invention, the file that size is less than threshold value is stored in the second memory space, size is greater than
Or it is stored in the first memory space equal to the file of threshold value, since the readwrite performance of the second memory space is empty better than the first storage
Between, the read or write speed for being less than the file of threshold value to size is improved, the application scenarios for having performance requirement to small documents are very suitable to.
The present invention provides storage system embodiment again.Referring to Fig. 5, storage system 60 include the first memory space 61,
Second memory space 62, third memory space 63, the first receiving module 64, first judgment module 65, the first memory module 66,
Two memory modules 67 and the first updating unit 68.The readwrite performance of second memory space 62 is better than the read-write of the first memory space 61
Performance, in the present embodiment, the first memory space 61 are mechanical hard disk, and the second memory space 62 and third memory space 63 are equal
For solid state hard disk.
First receiving module 64 is for receiving file to be stored.First judgment module 65 is for judging the big of file to be stored
It is small whether to be greater than threshold value.The size that first memory module 66 is used to determine storage file in first judgment module 65 is greater than threshold value
When, file to be stored is stored to the first memory space 61.Second memory module 67 in first judgment module 65 for determining
When the size of storage file is less than or equal to threshold value, file to be stored is stored to the second memory space 62.First updating unit
68 for empty in the first memory space 61 or the second storage by the file identification of file to be stored, size and file to be stored
Between 62 storage address store to metadata, and establish corresponding relationship between file identification, size and storage address.
When file in storage system 60 changes, it can be readjusted according to the size of the file after change
Position where file, then storage system 60 further includes the second receiving module 69, the first extraction module 70, the second judgment module
71, third judgment module 72, the first conversion module 73, third memory module 74, third receiving module 75, the second extraction module
76, removing module 77, the 4th judgment module 78 and the second conversion module 79.
Second receiving module 69 for receive file increase request, wherein file increase request carry content to be increased and to
Increase the file identification of file.First extraction module 70 is used for the file identification according to file to be increased, and obtains from third memory space 63
The size of the storage address and file to be increased that take file to be increased to be stored.Second judgment module 71 is used for according to the big of file to be increased
It is small, judge whether file to be increased is stored in the second memory space 62.Third judgment module 72 in the second judgment module 71 for sentencing
Break to wait increase file and store in the second memory space 62, whether judges the sum of the size of content to be increased and the size of file to be increased
Greater than threshold value.First conversion module 73 be used for third judgment module 72 determine content to be increased size and file to be increased it is big
It is the sum of small be greater than threshold value when, file to be increased is obtained according to the storage address that file to be increased is stored, and file to be increased is transferred to
First memory space 61, and storage address by file to be increased in the first memory space 61 are updated to third memory space 63.
Third memory module 74 is for storing content to be increased to wait increase in file.
Third receiving module 75, for receiving file content removal request, wherein file deletion requests carry file to be deleted
File identification and delete mark.Second extraction module 76, for the file identification according to file to be deleted, from third memory space
63 obtain the size of storage address and file to be deleted that the file to be deleted is stored.Removing module 77, for according to text to be deleted
The storage address that part is stored, obtains file to be deleted, and combines to delete mark and treat and delete the content of file and deleted.4th sentences
Disconnected module 78 judges whether file to be deleted is located at the first memory space 61 for the size according to file to be deleted, and judgement is deleted
Except whether the size of the file to be deleted after content is less than or equal to threshold value.Second conversion module 79, in the 4th judgement
Module 78 determines file to be deleted and is located at the first memory space 61, and delete the file to be deleted after content size be less than or
When person is equal to threshold value, the file to be deleted after content will be deleted and be transferred to the second memory space 62, and by file to be deleted the
The size of the file to be deleted after storage address and deletion content in two memory spaces 62 is updated to third memory space 63.
Storage system 60 further includes the 4th receiving module 80, third extraction module 81 and return module 82.4th receives mould
Block 80, for receiving file read request, wherein the file read request carries the file identification for the file that continues.Third mentions
Modulus block 81 obtains the storage that the file that continues is stored from third memory space 63 for the file identification according to the file that continues
Address.Return module 82, the storage address for being stored according to the file that continues extract the file that continues, and return to the file that continues.
In embodiments of the present invention, when the size of file to be stored is less than threshold value, file to be stored is stored to the
Two memory spaces 62 store file to be stored empty to the first storage when the size of file to be stored is greater than or equal to threshold value
Between 61, due to the second memory space 62 readwrite performance be better than the first memory space 61, improve to size be less than threshold value file
Read or write speed, be very suitable to the application scenarios for having performance requirement to small documents.
Mode the above is only the implementation of the present invention is not intended to limit the scope of the invention, all to utilize this
Equivalent structure or equivalent flow shift made by description of the invention and accompanying drawing content, it is relevant to be applied directly or indirectly in other
Technical field is included within the scope of the present invention.
Claims (4)
1. a kind of method for improving storage system processing small documents, which is characterized in that the storage system includes that the first storage is empty
Between, the second memory space and third memory space, the readwrite performance of second memory space is better than the reading of the first memory space
Write performance, first memory space are mechanical hard disk, and second memory space and third memory space are solid state hard disk,
The described method includes:
Receive file to be stored；
Judge whether the size of file to be stored is greater than threshold value；
If more than threshold value, the file to be stored is stored to the first memory space；
If being less than or equal to threshold value, the file to be stored is stored to the second memory space；
The file identification of the file to be stored, size and the file to be stored are deposited in the first memory space or second
The storage address in storage space is stored to metadata, and the metadata is stored to third memory space, and establishes the text to be stored
Corresponding relationship between the file identification of part, size and storage address；
It receives file and increases request, wherein the file increases the file identification that request carries content to be increased and file to be increased；
According to the file identification of the file to be increased, the storage that the file to be increased is stored is obtained from the third memory space
The size of address and file to be increased；
According to the size of the file to be increased, judge whether the file to be increased is stored in the second memory space；
If so, judging whether the sum of the size of the content to be increased and the size of file to be increased are greater than threshold value；
If more than threshold value, then file to be increased is obtained according to the storage address that the file to be increased is stored, and first by described wait increase
File is transferred to the first memory space, then stores the content to be increased to wait increase in file in the first memory space, and will
The size wait increase to be increased file of the file in the storage address of the first memory space and after increasing content is updated to third
Memory space；
Receive file content removal request, wherein the file content removal request carries the file identification of file to be deleted and deletes
Except mark；
According to the file identification of the file to be deleted, the storage that the file to be deleted is stored is obtained from the third memory space
The size of address and file to be deleted；
According to the storage address that the file to be deleted is stored, obtain the file to be deleted, and in conjunction with delete mark to it is described to
The content for deleting file is deleted；
According to the size of file to be deleted, judge whether the file to be deleted is located at the first memory space, and content is deleted in judgement
Whether the size of file to be deleted afterwards is less than or equal to threshold value；
If the file to be deleted is located at the first memory space, and delete the file to be deleted after content size be less than or
Person is equal to threshold value, then is first deleted content to be deleted according to deletion mark, then the file to be deleted after the deletion content is shifted
To the second memory space, and the institute by the file to be deleted in the storage address in the second memory space and after deleting content
The size for stating file to be deleted is updated to third memory space.
2. the method according to claim 1, wherein the method also includes:
Receive file read request, wherein the file read request carries the file identification for the file that continues；
According to the file identification of the file that continues, from the third memory space obtain described in continue the storage that file stored
Address；
According to the storage address that the file that continues is stored, continue file described in extraction, and the file that continues described in return.
3. a kind of storage system, which is characterized in that including the first memory space, the second memory space and third memory space, institute
The readwrite performance for stating the second memory space is better than the readwrite performance of the first memory space, and first memory space is mechanical hard
Disk, second memory space and third memory space are solid state hard disk, the storage system further include:
First receiving module, for receiving file to be stored；
First judgment module, for judging whether the size of file to be stored is greater than threshold value；
First memory module will when the size for determining the storage file in the first judgment module is greater than threshold value
The file to be stored is stored to the first memory space；
Second memory module, the size for determining the storage file in the first judgment module are less than or equal to threshold value
When, the file to be stored is stored to the second memory space；
First updating unit, for by the file identification of the file to be stored, size and the file to be stored first
The storage address of memory space or the second memory space is stored to metadata, and the metadata is stored to third memory space,
And establish corresponding relationship between file identification, size and the storage address of the file to be stored；
Second receiving module increases request for receiving file, wherein the file increases request and carries content to be increased and wait increase
The file identification of file；
First extraction module, for the file identification according to the file to be increased, from the third memory space obtain it is described to
Increase the size of storage address and file to be increased that file is stored；
Second judgment module judges whether the file to be increased is stored in second and deposits for the size according to the file to be increased
Store up space；
Third judgment module is stored in the second memory space for determining the file to be increased in second judgment module
When, judge whether the sum of the size of the content to be increased and the size of file to be increased are greater than threshold value；
First conversion module, for determined in the third judgment module content to be increased size and file to be increased size it
When with being greater than threshold value, file to be increased is obtained according to the storage address that the file to be increased is stored, and first by the file to be increased
It is transferred to the first memory space, and the file to be increased is updated to third storage sky in the storage address of the first memory space
Between；
Third memory module, for storing the content to be increased to wait increase in file in the first memory space；
Third receiving module, for receiving file content removal request, wherein the file deletion requests carry file to be deleted
File identification and deletion mark；
Second extraction module, for the file identification according to the file to be deleted, from the third memory space obtain it is described to
Delete the size of storage address and file to be deleted that file is stored；
Removing module, the storage address for being stored according to the file to be deleted, obtains the file to be deleted, and combine and delete
Mark deletes the content of the file to be deleted；
4th judgment module judges whether the file to be deleted is located at the first memory space for the size according to file to be deleted,
And judge whether the size for deleting the file to be deleted after content is less than or equal to threshold value；
Second conversion module is located at the first memory space for determining the file to be deleted in the 4th judgment module, with
It, first will content be deleted according to deletion mark and when deleting the size of the file to be deleted after content less than or equal to threshold value
It deletes, then the file to be deleted after the deletion content is transferred to the second memory space, and by the file to be deleted the
The size of the file to be deleted after storage address and deletion content in two memory spaces is updated to third memory space.
4. storage system according to claim 3, which is characterized in that the storage system includes:
4th receiving module, for receiving file read request, wherein the file read request carries the file for the file that continues
Mark；
Third extraction module, for the file identification for the file that continues according to, from the third memory space obtain it is described to
Read the storage address that file is stored；
Return module, for the storage address that the file that continues according to is stored, continue file described in extraction, and described in return
Continue file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610098733.2A CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610098733.2A CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105787012A CN105787012A (en) | 2016-07-20 |
| CN105787012B true CN105787012B (en) | 2019-08-27 |
Family
ID=56402875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610098733.2A Active CN105787012B (en) | 2016-02-23 | 2016-02-23 | A kind of method and storage system improving storage system processing small documents |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105787012B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107886008B (en) * | 2016-09-30 | 2020-11-03 | 北京京东尚科信息技术有限公司 | File management method, system, device and computer readable storage medium |
| CN106412093B (en) * | 2016-10-25 | 2019-07-23 | Oppo广东移动通信有限公司 | A kind of method for uploading of data, apparatus and system |
| CN106845273B (en) * | 2017-01-23 | 2019-11-29 | 北京奇虎科技有限公司 | A kind of method and apparatus for protecting intelligent terminal local file |
| CN107968818B (en) * | 2017-11-17 | 2021-06-04 | 北京联想超融合科技有限公司 | Data storage method and device and server cluster |
| CN109857548B (en) * | 2019-01-04 | 2023-08-22 | 平安科技（深圳）有限公司 | Storage space optimization method, storage space optimization device, computer equipment and storage medium |
| CN110018788A (en) * | 2019-03-01 | 2019-07-16 | 平安科技（深圳）有限公司 | It is classified storage method, device, electronic equipment and computer readable storage medium |
| CN111897485A (en) * | 2019-05-05 | 2020-11-06 | 北京兆易创新科技股份有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN114398000A (en) * | 2021-11-30 | 2022-04-26 | 北京旷视科技有限公司 | Data processing method, device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102508789A (en) * | 2011-10-14 | 2012-06-20 | 浪潮电子信息产业股份有限公司 | Grading storage method for system |
| CN102713824A (en) * | 2009-10-29 | 2012-10-03 | 康德斯威技术公司 | Allocating storage memory based on future use estimates |
| CN103678143A (en) * | 2012-09-25 | 2014-03-26 | 联想(北京)有限公司 | File storage method and device and electronic equipment |
| CN105094695A (en) * | 2015-06-29 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Storing method and system |
-
2016
- 2016-02-23 CN CN201610098733.2A patent/CN105787012B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102713824A (en) * | 2009-10-29 | 2012-10-03 | 康德斯威技术公司 | Allocating storage memory based on future use estimates |
| CN102508789A (en) * | 2011-10-14 | 2012-06-20 | 浪潮电子信息产业股份有限公司 | Grading storage method for system |
| CN103678143A (en) * | 2012-09-25 | 2014-03-26 | 联想(北京)有限公司 | File storage method and device and electronic equipment |
| CN105094695A (en) * | 2015-06-29 | 2015-11-25 | 浪潮(北京)电子信息产业有限公司 | Storing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105787012A (en) | 2016-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105787012B (en) | A kind of method and storage system improving storage system processing small documents | |
| US9933979B2 (en) | Device and method for storing data in distributed storage system | |
| CN110188108B (en) | Data storage method, device, system, computer equipment and storage medium | |
| CN104111804B (en) | A kind of distributed file system | |
| CN102147711B (en) | Storage method and device based on data content identification | |
| CN107391774B (en) | The rubbish recovering method of log file system based on data de-duplication | |
| CN104281414B (en) | Distributed file system and its small documents access method | |
| CN103885728A (en) | Magnetic disk cache system based on solid-state disk | |
| CN108710639A (en) | A kind of mass small documents access optimization method based on Ceph | |
| CN102479250A (en) | Disk caching method for embedded browser | |
| CN104899297A (en) | Hybrid index structure with storage perception | |
| KR20160003682A (en) | Hydration and dehydration with placeholders | |
| CN105550246B (en) | The system and method for load networks picture under Android platform | |
| CN106776375A (en) | Data cache method and device inside a kind of disk | |
| CN106407355A (en) | Data storage method and device | |
| CN107888687B (en) | Proxy client storage acceleration method and system based on distributed storage system | |
| CN103942301A (en) | Distributed file system oriented to access and application of multiple data types | |
| CN104572505A (en) | System and method for ensuring eventual consistency of mass data caches | |
| CN107729504A (en) | A kind of method and system for handling large data objectses | |
| CN104281673A (en) | Cache building system and method for database | |
| CN104158863A (en) | Cloud storage mechanism based on transaction-level whole-course high-speed buffer | |
| CN104391961A (en) | Read-write solution strategy for tens of millions of small file data | |
| CN104391947B (en) | Magnanimity GIS data real-time processing method and system | |
| CN102609335B (en) | Device and method for protecting metadata by copy-on-write | |
| CN106462591A (en) | Partition filtering using smart index in memory |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |