CN110399348A - File deletes method, apparatus, system and computer readable storage medium again - Google Patents
File deletes method, apparatus, system and computer readable storage medium again Download PDFInfo
- Publication number
- CN110399348A CN110399348A CN201910656838.9A CN201910656838A CN110399348A CN 110399348 A CN110399348 A CN 110399348A CN 201910656838 A CN201910656838 A CN 201910656838A CN 110399348 A CN110399348 A CN 110399348A
- Authority
- CN
- China
- Prior art keywords
- file
- stored
- finger print
- print information
- search module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000001360 synchronised effect Effects 0.000 claims abstract description 12
- 238000004321 preservation Methods 0.000 claims abstract description 8
- 238000004590 computer program Methods 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000012217 deletion Methods 0.000 description 4
- 230000037430 deletion Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/174—Redundancy elimination performed by the file system
- G06F16/1748—De-duplication implemented within the file system, e.g. based on file segments
Abstract
The invention discloses a kind of files to delete method again, it first receives the finger print information of file to be stored and is sent to search module, it wherein whether there is same finger print information using search module retrieval, if receiving the presence instruction of search module return, the data volume of file to be stored is not received then, and it generates the metadata including finger print information of file to be stored and saves into object storage system, if what is received is no instruction, then by the meta-data preservation including finger print information of the data volume of file to be stored and the file to be stored of generation into object storage system, and metadata is synchronized in search module.As it can be seen that this method in the case where file to be stored is duplicate file, greatly reduces the occupancy of network bandwidth and memory space, the storage efficiency of object storage system is improved.The invention also discloses a kind of files to delete device, system and computer readable storage medium again, has and deletes the identical beneficial effect of method again with above-mentioned file.
Description
Technical field
The present invention relates to files to delete field again, and deleting method, apparatus, system and computer again more particularly to a kind of file can
Read storage medium.
Background technique
A large amount of repeated data is constantly present in object storage system, it is common in order to improve its space efficiency utilization
Object storage system is provided with the function that data are deleted again.The principle that data are deleted again are as follows: sentenced by the finger print information of correlation data
Whether disconnected data are consistent, if unanimously, duplicate storing data deleted, to reach section space-efficient purpose.File weight
Deleting is the progress finger print information calculating as unit of file, and file common at present deletes method needs again and file is first stored in object
In storage system, being searched for by object storage system itself whether there is believes with the consistent fingerprint of finger print information of deposit file
Breath, and if it exists, then delete the file of deposit, otherwise retain the file of deposit.Due to it is this it is heavy delete method deposit be repeat
In the case where file, first it is stored in file and is deleted again again, finally delete file again, to occupy a large amount of network bandwidth and deposit
Space is stored up, causes object storage system storage efficiency low.
Summary of the invention
The object of the present invention is to provide a kind of files to delete method, apparatus, system and computer readable storage medium again, can
In the case where file to be stored is duplicate file, greatly reduce the occupancy of network bandwidth and memory space, improves object storage
The storage efficiency of system.
In order to solve the above technical problems, the present invention provides a kind of files to delete method again, comprising:
Receive the request for the finger print information including file to be stored that client is sent；
The finger print information is sent to search module, to whether there is in described search module retrieval described search module
Finger print information identical with the finger print information；
If receiving the presence instruction of described search module return, the data volume of the file to be stored is not received,
It generates the metadata including the finger print information of the file to be stored and saves into object storage system；
If receiving the no instruction of described search module return, by the data volume of the file to be stored and
The meta-data preservation including the finger print information of the file to be stored generated is into the object storage system, and by institute
Metadata is stated to be synchronized in described search module.
Preferably, in the data volume for not receiving the file to be stored, generate the file to be stored includes the finger
The metadata of line information and after saving into object storage system, further includes:
The reference count of data volume with the consistent file of the finger print information of the file to be stored is added one.
Preferably, the file deletes method again further include:
It receives the file that the client is sent and deletes instruction, and judge that the file is deleted and instruct the corresponding object
Whether the reference count of the file of storage system is greater than one；
If so, not deleting the file deletes the file for instructing the corresponding object storage system, by the reference
Counting subtracts one；
Otherwise, the reference count is reset, and deletes the file in the object storage system.
Preferably, it includes object oriented that the metadata and the file, which delete instruction,.
Preferably, in the data volume for not receiving the file to be stored, generate the file to be stored includes the finger
The metadata of line information and after saving into object storage system, and the metadata is being synchronized to described search module
In after, further include:
Send successfully upload information to the client.
Preferably, described search module is ElasticSearch search engine.
In order to solve the above technical problems, the present invention also provides a kind of files to delete device again, comprising:
Receiving module, the request of the finger print information including file to be stored for receiving client transmission；
Sending module, for sending the finger print information to search module, so that described search module retrieves described search
It whether there is finger print information identical with the finger print information in module；
Processing module does not receive described wait store if the presence instruction for receiving the return of described search module
The data volume of file generates the metadata including the finger print information of the file to be stored and saves to object storage system
In；
If receiving the no instruction of described search module return, by the data volume of the file to be stored and
The meta-data preservation including the finger print information of the file to be stored generated is into the object storage system, and by institute
Metadata is stated to be synchronized in described search module.
In order to solve the above technical problems, the present invention also provides a kind of files to delete system again, comprising:
Memory, for storing computer program；
Processor realizes the step of file as described above deletes method again when for executing the computer program.
In order to solve the above technical problems, the computer can the present invention also provides a kind of computer readable storage medium
It reads to be stored with computer program on storage medium, the computer program realizes file weight as described above when being executed by processor
The step of deleting method.
The present invention provides a kind of files to delete method again, carries out again without being first stored in file to be stored into object storage system
Operation is deleted again, but by first receiving the finger print information of file to be stored and being sent to search module, it is retrieved using search module
Wherein with the presence or absence of with its consistent finger print information, do not receive the data volume of file to be stored then if it exists, otherwise receive and protect
The data volume of file to be stored is deposited into object storage system.As it can be seen that this method is the case where file to be stored is duplicate file
Under, the occupancy of network bandwidth and memory space is greatly reduced, the storage efficiency of object storage system is improved.
The present invention also provides a kind of files to delete device, system and computer readable storage medium again, has and above-mentioned text
Part deletes the identical beneficial effect of method again.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to institute in the prior art and embodiment
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without creative efforts, can also obtain according to these attached drawings
Obtain other attached drawings.
Fig. 1 is the flow chart that a kind of file provided by the invention deletes method again；
Fig. 2 is the structural schematic diagram that a kind of file provided by the invention deletes device again；
Fig. 3 is the structural schematic diagram that a kind of file provided by the invention deletes system again.
Specific embodiment
Core of the invention is to provide a kind of file and deletes method, apparatus, system and computer readable storage medium again, can
In the case where file to be stored is duplicate file, greatly reduce the occupancy of network bandwidth and memory space, improves object storage
The storage efficiency of system.
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Fig. 1 is please referred to, Fig. 1 is the flow chart that a kind of file provided in an embodiment of the present invention deletes method again, specific steps packet
It includes:
S1: the request for the finger print information including file to be stored that client is sent is received；
In the application, each file to be stored has the finger print information for guaranteeing file uniqueness, is used to refer to for specific
File to be stored, different files to be stored has different finger print informations, when the content changing of file to be stored, fingerprint letter
Breath also can accordingly change, to ensure that the uniqueness of file.
Specifically, the put request that client is sent is received, includes the finger print information of file to be stored in put request, it should
Finger print information is obtained from being calculated with specific algorithm file to be stored as client.
S2: finger print information is sent to search module, to whether there is and above-mentioned finger in search module retrieval search module
The identical finger print information of line information；
Specifically, the finger print information of file to be stored is sent to search module, and search module receives the finger of file to be stored
Line information compares retrieval with the finger print information that the finger print information and search module itself have stored in advance, judges itself in advance
It whether there is finger print information identical with the finger print information of file to be stored in the finger print information stored.Wherein, search module
The finger print information itself stored in advance is the finger print information of stored file in object storage system.
S3: if receiving the presence instruction of search module return, not receiving the data volume of file to be stored, generate to
The metadata including finger print information of storage file is simultaneously saved into object storage system；
If search module, which retrieves itself, has finger print information identical with the finger print information of file to be stored, show
The file to be stored is duplicate file, does not need to store into object storage system, then search module, which is sent, has instruction.It is connecing
After the presence instruction for receiving search module return, the data volume of file to be stored is not received, and generate first number of file to be stored
According to, the finger print information of file to be stored is contained in metadata, meanwhile, by meta-data preservation into object storage system, and refer to
Into object storage system with the data volume of file identical with above-mentioned finger print information.
S4: if the no instruction of search module return is received, by the data volume of file to be stored and generation
The meta-data preservation including finger print information of file to be stored be synchronized to search mould into object storage system, and by metadata
In block.
If search module, which does not retrieve itself, has finger print information identical with the finger print information of file to be stored,
Show that the file to be stored is not duplicate file, can store into object storage system, then search module sends to be not present and refer to
It enables.After the no instruction for receiving search module return, receives the data volume of file to be stored and be stored in object storage system
In system, and the metadata of file to be stored is generated, the finger print information of file to be stored is contained in metadata, meanwhile, by first number
According to the data volume for saving into object storage system and being directed toward file to be stored, finally metadata is synchronized in search module,
So that search module compares retrieval with it during deleting again later.
Wherein, the finger print information of file to be stored can be calculated by hash algorithm, hash algorithm be it is a kind of can be from
The method for generating finger print information is calculated in any file, if this algorithm uses the very big file to be stored of original storage volume
A character is done to record, this several character is the finger print information of file to be stored, each of file to be stored byte
Change can all make the finger print information of this document change, to ensure that the uniqueness of file.It is calculated by this algorithm
Each of finger print information out and file to be stored byte is all related, to largely ensure that file to be stored
Uniqueness.Certainly, in addition to hash algorithm, the application can also use any finger print information that can calculate generation file to be stored
Algorithm is determined according to the actual situation, and the application do not limit particularly herein.
To sum up, this application provides a kind of files to delete method again, without being first stored in file to be stored into object storage system
Deleted operation again again, but by first receiving the finger print information of file to be stored and being sent to search module, utilize search mould
Block retrieval wherein whether there is with its consistent finger print information, do not receive the data volume of file to be stored then if it exists, otherwise connect
It receives and saves the data volume of file to be stored into object storage system.As it can be seen that this method is duplicate file in file to be stored
In the case where, the occupancy of network bandwidth and memory space is greatly reduced, the storage efficiency of object storage system is improved.
On the basis of the above embodiments:
Embodiment as one preferred, in the data volume for not receiving file to be stored, generate file to be stored includes
The metadata of finger print information and after saving into object storage system, further includes:
The reference count of data volume with the consistent file of the finger print information of file to be stored is added one.
In the present embodiment, is generating the metadata including finger print information of file to be stored and saving to object storage system
In after, which is directed toward the data volume with the consistent file of finger print information of file to be stored, and will be with text to be stored
The reference count of the data volume of the consistent file of the finger print information of part adds one, is closed with establishing client to the reference of the data volume
System, reference count quoted to record the data volume of the file in object storage system by several clients, whenever there is a visitor
File in the reference object storage system of family end, reference count add one.In this way, so as to the file of subsequently received client transmission
When deleting instruction, according to reference count to determine whether there is multiple client to quote this document, so that can judgement delete this article
Part.
Embodiment as one preferred, file delete method again further include:
It receives the file that client is sent and deletes instruction, and judge that file deletes the text for instructing corresponding object storage system
Whether the reference count of part is greater than one；
If so, not deleting file deletes the file for instructing corresponding object storage system, reference count is subtracted one；
Otherwise, reference count is reset, and deletes the file in object storage system.
Specifically, it receives the file that client is sent and deletes instruction, the information in instruction is deleted according to file and is deposited in object
File is found in storage system deletes the specified file of instruction.Then the reference count for obtaining this document, judges that the reference count is
It is no to be greater than one, if it is greater than one, then shows that this document is quoted by multiple client, cannot directly delete this document, so
Its reference count is subtracted one, cancels reference of the client for sending file deletion instruction to this document.If the reference count is not
Greater than one, then shows that this document is only quoted by a client, then reset the reference count of this document, and directly delete this article
Part.
As it can be seen that by judging whether the reference count of the file of object storage system is one, to judge that this article can be deleted
Part, it is therefore prevented that the file in object storage system is deleted when reference by multiple client, causes file that cannot be cited
The problem of.
It includes object oriented that embodiment as one preferred, metadata and file, which delete instruction,.
It in the present embodiment, receives the file that client is sent and deletes instruction, and obtain the object name in file deletion instruction
Claim, then, includes the metadata of same object title with file deletion instruction by finding, and then find the need of metadata direction
File in the object storage system to be deleted, and be deleted.As it can be seen that object oriented is recorded in metadata and file deletion
In instruction, the specified file of instruction is deleted convenient for locating file.Certain metadata and file delete the information for including in instruction can
With but be not limited only to object oriented, can also may indicate that the information of specific file, the application are not made particularly herein for other
It limits.
Embodiment as one preferred, in the data volume for not receiving file to be stored, generate file to be stored includes
The metadata of finger print information and after saving into object storage system, and metadata is being synchronized to it in search module
Afterwards, further include:
Send successfully upload information to client.
In the present embodiment, successfully upload information is sent to client, after client receives the transmission successful information, is reminded
User, so that user knows that file to be stored is successfully stored in object storage system.Specifically, client is receiving the hair
After sending successful information, user's file to be stored can be reminded to upload successfully in the form of sound and/or text, the application is for visitor
Which kind of mode family end specifically select user is reminded not limit particularly, determines according to the actual situation.In addition, in practical application
In, if the metadata including finger print information of file to be stored and/or file to be stored is not stored in object storage system,
It can be sent to client and upload failure information, upload the reason of failing so that user checks, again upper transmitting file.
Embodiment as one preferred, search module are ElasticSearch search engine.
In the present embodiment, the finger print information of the file to be stored received is sent to ElasticSearch search engine,
Finger print information and the finger print information that is in advance stored in own database of the ElasticSearch search engine using file to be stored
Search comparison is done, if there is finger print information identical with the finger print information of file to be stored in discovery own database, is sent
There are instructions, otherwise, send no instruction.And after ElasticSearch search engine receives synchronous metadata, extract
Finger print information in metadata is simultaneously stored in the database of itself, for next search comparison.Certainly, the application can also use
The search module of the finger print information retrieval of file may be implemented in other, for specifically selecting which kind of search module to carry out finger print information
Retrieval, the application do not limit particularly herein.
As it can be seen that going to retrieve without object storage system itself using ElasticSearch search engine as search module
The finger print information of file reduces the workload of object storage system, so that object storage system more efficiently goes to complete file
Work is deleted again, and since ElasticSearch search engine is existing data searching technology, staff can be directly by it
It is integrated into object storage system, alleviates the workload of staff's development object storage system.
Referring to figure 2., Fig. 2 is the structural schematic diagram that a kind of file provided by the invention deletes device again, and this document deletes dress again
It sets and includes:
Receiving module 21, the request of the finger print information including file to be stored for receiving client transmission；
Sending module 22, for sending finger print information to search module, so as in search module retrieval search module whether
In the presence of finger print information identical with finger print information；
Processing module 23, if the presence instruction for receiving search module return, does not receive file to be stored
Data volume generates the metadata including finger print information of file to be stored and saves into object storage system；
If receive the no instruction of search module return, by the data volume of file to be stored and generation to
The meta-data preservation including finger print information of storage file is synchronized to search module into object storage system, and by metadata
In.
The present embodiment deletes the corresponding file of method for file again and deletes Installation practice again, for file provided in this embodiment
The introduction for deleting device again please refers to above-described embodiment, and details are not described herein by the present invention.
Referring to figure 3., Fig. 3 is the structural schematic diagram that a kind of file provided by the invention deletes system again, and this document is deleted again is
System includes:
Memory 31, for storing computer program；
Processor 32 realizes the step of deleting method again such as above-mentioned file when for executing computer program.
The present embodiment deletes the corresponding file of method for file again and deletes system embodiment again, for file provided in this embodiment
The introduction for deleting system again please refers to above-described embodiment, and details are not described herein by the present invention.
Further, the present invention also provides a kind of computer readable storage mediums calculates for storing computer program
The step of deleting method again such as above-mentioned file is realized when machine program is executed by processor 32.
The present embodiment be file delete the corresponding computer readable storage medium embodiment of method again, for the present embodiment provides
The introduction of computer readable storage medium please refer to above-described embodiment, details are not described herein by the present invention.
It should also be noted that, in the present specification, the terms "include", "comprise" or its any other variant are intended to contain
Lid non-exclusive inclusion, so that process, scheme, article or equipment including a series of elements are not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, scheme, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, scheme, article or equipment including element.
The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (9)
1. a kind of file deletes method again characterized by comprising
Receive the request for the finger print information including file to be stored that client is sent；
The finger print information is sent to search module, to whether there is and institute in described search module retrieval described search module
State the identical finger print information of finger print information；
If receiving the presence instruction of described search module return, the data volume of the file to be stored is not received, is generated
The metadata including the finger print information of the file to be stored is simultaneously saved into object storage system；
If the no instruction of described search module return is received, by the data volume of the file to be stored and generation
The file to be stored the meta-data preservation including the finger print information into the object storage system, and by the member
Data are synchronized in described search module.
2. file as described in claim 1 deletes method again, which is characterized in that in the data for not receiving the file to be stored
Body, after generating the metadata including the finger print information of the file to be stored and saving into object storage system, also
Include:
The reference count of data volume with the consistent file of the finger print information of the file to be stored is added one.
3. file as claimed in claim 2 deletes method again, which is characterized in that further include:
It receives the file that the client is sent and deletes instruction, and judge that the file deletes the corresponding object storage of instruction
Whether the reference count of the file of system is greater than one；
If so, not deleting the file deletes the file for instructing the corresponding object storage system, by the reference count
Subtract one；
Otherwise, the reference count is reset, and deletes the file in the object storage system.
4. file as claimed in claim 3 deletes method again, which is characterized in that the metadata and the file delete instruction
Including object oriented.
5. file as described in claim 1 deletes method again, which is characterized in that in the data for not receiving the file to be stored
Body, after generating the metadata including the finger print information of the file to be stored and saving into object storage system, with
And after the metadata is synchronized in described search module, further include:
Send successfully upload information to the client.
6. deleting method again such as file described in any one of claim 1 to 5, which is characterized in that described search module is
ElasticSearch search engine.
7. a kind of file deletes device again characterized by comprising
Receiving module, the request of the finger print information including file to be stored for receiving client transmission；
Sending module, for sending the finger print information to search module, so that described search module retrieves described search module
In whether there is finger print information identical with the finger print information；
Processing module, if the presence instruction for receiving the return of described search module, does not receive the file to be stored
Data volume, generate the metadata including the finger print information of the file to be stored and save into object storage system；
If the no instruction of described search module return is received, by the data volume of the file to be stored and generation
The file to be stored the meta-data preservation including the finger print information into the object storage system, and by the member
Data are synchronized in described search module.
8. a kind of file deletes system again characterized by comprising
Memory, for storing computer program；
Processor is realized when for executing the computer program as again file as claimed in any one of claims 1 to 6 deletes method
The step of.
9. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program realizes that the file as described in any one of claim 1 to 6 deletes the step of method again when the computer program is executed by processor
Suddenly.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910656838.9A CN110399348A (en) | 2019-07-19 | 2019-07-19 | File deletes method, apparatus, system and computer readable storage medium again |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910656838.9A CN110399348A (en) | 2019-07-19 | 2019-07-19 | File deletes method, apparatus, system and computer readable storage medium again |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110399348A true CN110399348A (en) | 2019-11-01 |
Family
ID=68324747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910656838.9A Pending CN110399348A (en) | 2019-07-19 | 2019-07-19 | File deletes method, apparatus, system and computer readable storage medium again |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110399348A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908966A (en) * | 2019-11-15 | 2020-03-24 | 浪潮电子信息产业股份有限公司 | Method, device and equipment for calculating deduplication rate and readable storage medium |
| CN111090620A (en) * | 2019-12-06 | 2020-05-01 | 浪潮电子信息产业股份有限公司 | File storage method, device, equipment and readable storage medium |
| CN111143288A (en) * | 2019-12-22 | 2020-05-12 | 北京浪潮数据技术有限公司 | Data storage method, system and related device |
| CN111177088A (en) * | 2019-12-29 | 2020-05-19 | 北京浪潮数据技术有限公司 | Data deduplication method and device, electronic equipment and storage medium |
| CN111581166A (en) * | 2020-04-03 | 2020-08-25 | 北京明略软件系统有限公司 | File storage method and device |
| CN111737206A (en) * | 2020-06-06 | 2020-10-02 | 苏州浪潮智能科技有限公司 | File deduplication processing method, system, terminal and storage medium |
| CN111970381A (en) * | 2020-09-06 | 2020-11-20 | 苏州浪潮智能科技有限公司 | File deduplication additional uploading method, system, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917396A (en) * | 2010-06-25 | 2010-12-15 | 清华大学 | Real-time repetition removal and transmission method for data in network file system |
| CN102915278A (en) * | 2012-09-19 | 2013-02-06 | 浪潮(北京)电子信息产业有限公司 | Data deduplication method |
| CN105511814A (en) * | 2015-12-11 | 2016-04-20 | 上海爱数信息技术股份有限公司 | Storage method of static data file |
| CN105955675A (en) * | 2016-06-22 | 2016-09-21 | 南京邮电大学 | Repeated data deletion system and method for de-centralization cloud environment |
| CN107391761A (en) * | 2017-08-28 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data managing method and device based on data de-duplication technology |
-
2019
- 2019-07-19 CN CN201910656838.9A patent/CN110399348A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101917396A (en) * | 2010-06-25 | 2010-12-15 | 清华大学 | Real-time repetition removal and transmission method for data in network file system |
| CN102915278A (en) * | 2012-09-19 | 2013-02-06 | 浪潮(北京)电子信息产业有限公司 | Data deduplication method |
| CN105511814A (en) * | 2015-12-11 | 2016-04-20 | 上海爱数信息技术股份有限公司 | Storage method of static data file |
| CN105955675A (en) * | 2016-06-22 | 2016-09-21 | 南京邮电大学 | Repeated data deletion system and method for de-centralization cloud environment |
| CN107391761A (en) * | 2017-08-28 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of data managing method and device based on data de-duplication technology |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110908966A (en) * | 2019-11-15 | 2020-03-24 | 浪潮电子信息产业股份有限公司 | Method, device and equipment for calculating deduplication rate and readable storage medium |
| CN110908966B (en) * | 2019-11-15 | 2022-06-10 | 浪潮电子信息产业股份有限公司 | Method, device and equipment for calculating deduplication rate and readable storage medium |
| CN111090620A (en) * | 2019-12-06 | 2020-05-01 | 浪潮电子信息产业股份有限公司 | File storage method, device, equipment and readable storage medium |
| CN111090620B (en) * | 2019-12-06 | 2022-04-22 | 浪潮电子信息产业股份有限公司 | File storage method, device, equipment and readable storage medium |
| CN111143288A (en) * | 2019-12-22 | 2020-05-12 | 北京浪潮数据技术有限公司 | Data storage method, system and related device |
| CN111177088A (en) * | 2019-12-29 | 2020-05-19 | 北京浪潮数据技术有限公司 | Data deduplication method and device, electronic equipment and storage medium |
| CN111581166A (en) * | 2020-04-03 | 2020-08-25 | 北京明略软件系统有限公司 | File storage method and device |
| CN111737206A (en) * | 2020-06-06 | 2020-10-02 | 苏州浪潮智能科技有限公司 | File deduplication processing method, system, terminal and storage medium |
| CN111737206B (en) * | 2020-06-06 | 2023-01-10 | 苏州浪潮智能科技有限公司 | File deduplication processing method, system, terminal and storage medium |
| CN111970381A (en) * | 2020-09-06 | 2020-11-20 | 苏州浪潮智能科技有限公司 | File deduplication additional uploading method, system, equipment and storage medium |
| CN111970381B (en) * | 2020-09-06 | 2022-06-21 | 苏州浪潮智能科技有限公司 | File deduplication, addition and uploading method, system, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110399348A (en) | File deletes method, apparatus, system and computer readable storage medium again | |
| US9792340B2 (en) | Identifying data items | |
| CN104331428B (en) | The storage of a kind of small documents and big file and access method | |
| CN102117309B (en) | Data caching system and data query method | |
| US6754799B2 (en) | System and method for indexing and retrieving cached objects | |
| CN103548003B (en) | Method and system for improving the client-side fingerprint cache of deduplication system backup performance | |
| CN102542052B (en) | Priority hash index | |
| CN104618482B (en) | Access method, server, conventional memory device, the system of cloud data | |
| CN104834713A (en) | Method and system for storing and transmitting image data of terminal equipment | |
| US20160335243A1 (en) | Webpage template generating method and server | |
| CN102467572B (en) | Data block inquiring method for supporting data de-duplication program | |
| CN109766318B (en) | File reading method and device | |
| CN101867607A (en) | Distributed data access method, device and system | |
| CN104778270A (en) | Storage method for multiple files | |
| CN104679898A (en) | Big data access method | |
| CN106874348A (en) | File is stored and the method for indexing means, device and reading file | |
| RU2005124131A (en) | INFORMATION PROCESSING DEVICE, CONTENT MANAGEMENT METHOD, CONTENT INFORMATION MANAGEMENT METHOD AND COMPUTER PROGRAM | |
| CN108694188B (en) | Index data updating method and related device | |
| CN108540510B (en) | Cloud host creation method and device and cloud service system | |
| CN104899161B (en) | A kind of caching method of the continuous data protection based on cloud storage environment | |
| CN110287201A (en) | Data access method, device, equipment and storage medium | |
| US20080071992A1 (en) | Method and Apparatus for Space Efficient Identification of Candidate Objects for Eviction from a Large Cache | |
| CN106161193B (en) | Mail processing method, device and system | |
| CN108090186A (en) | A kind of electric power data De-weight method on big data platform | |
| CN110245129A (en) | Distributed global data deduplication method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191101 |