CN108347459A - A kind of high in the clouds data quick storage method and device - Google Patents
A kind of high in the clouds data quick storage method and device Download PDFInfo
- Publication number
- CN108347459A CN108347459A CN201710056378.7A CN201710056378A CN108347459A CN 108347459 A CN108347459 A CN 108347459A CN 201710056378 A CN201710056378 A CN 201710056378A CN 108347459 A CN108347459 A CN 108347459A
- Authority
- CN
- China
- Prior art keywords
- file
- unique mapping
- information table
- mark
- uploaded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
- G06F16/134—Distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of high in the clouds data quick storage method and device, the method includes：Server by utilizing presets mapping algorithm and carries out mapping calculation to the content of each file of storage, generates unique mapping mark of file；The unique mapping mark and the file reference count value for recording file upload request number that each file is recorded in file information table；The file upload request that receiving terminal apparatus is sent, the file upload request include that unique mapping of file to be uploaded identifies；Unique mapping mark of file to be uploaded and unique mapping mark of each file in file information table are compared, when judging to identify comprising the identical unique mapping of unique mapping mark with the file to be uploaded in the file information table, the response message being used to indicate without executing upload operation is sent to the terminal device, and the file reference count value of this file in file information table is increased by one.The present invention can reduce network bandwidth consumption, improve server process performance.
Description
Technical field
The present invention relates to Internet technical fields, and in particular to a kind of high in the clouds data quick storage method and device.
Background technology
Cloud storage service is a kind of online storage service that Internet service provider provides to user, enterprise, provides a user text
The file management facilities such as the storage of part, access, backup, shared.
Mode is uploaded using common in the prior art, judgement is not added with to file content, after user submits upload demand, client
API is called at end, to server up transfer file, even current already existing file on server, can also repeat to upload.It is existing
There is technical solution that can occupy more parts of memory spaces in server, repeating to upload can cause storage server redundant storage excessive, carry
The high carrying cost of itself；Meanwhile repeating to upload and also resulting in the raising of bandwidth cost, cause totle drilling cost to rise.For different heat
The file of degree is caused using identical storage processing, and the access procedure of hot spot file is made to expend the process resource of server.
Invention content
Present invention seek to address that problem as described above.The object of the present invention is to provide a kind of high in the clouds for solving problem above
Data quick storage method and device.
The present invention provides a kind of high in the clouds data quick storage methods, including：Server by utilizing presets mapping algorithm to depositing
The content of each file of storage carries out mapping calculation, generates unique mapping mark of file；Each file is recorded in file information table
Unique mapping mark and the file reference count value for recording file upload request number；The text that receiving terminal apparatus is sent
Part upload request, the file upload request include that unique mapping of file to be uploaded identifies；Only by file to be uploaded
One mapping mark in file information table each file unique mapping identify compared, judge include in the file information table
When the identical unique mapping of unique mapping mark with the file to be uploaded identifies, sent to the terminal device for referring to
Show the response message without executing upload operation, the file reference count value of this file in file information table is increased by one.
Above-mentioned high in the clouds data quick storage method also has the characteristics that：
The method further includes：File reference count value is stored in first more than or equal to each file of default thresholding to deposit
Equipment is stored up, each file that file reference count is worth to small default thresholding is stored in the second storage device, first memory block
Storage performance is more than the storage performance of second memory block, and the storage performance includes at least one of following parameter：It deposits
Take speed, equipment cost, mean time between failures duration.
Above-mentioned high in the clouds data quick storage method also has the characteristics that：
The file upload request also includes file name to be uploaded,
The method further includes：Waiting for of including in each file upload request of each file is recorded in file information table
Transmitting file title；Judge identical unique comprising unique mapping mark with the file to be uploaded in the file information table
When mapping mark, the name information of file is determined according to the corresponding each file name of this unique mapping mark, by name information
The terminal device of pushed information can be received by pushing to.
Above-mentioned high in the clouds data quick storage method also has the characteristics that：
It is described that mapping calculation is carried out to the content of each file of storage using default mapping algorithm, it generates the unique of file and reflects
Penetrating mark includes：Mapping calculation is carried out to the content of each file of storage using hash algorithm, using the cryptographic Hash of generation as institute
State unique mapping mark.
Above-mentioned high in the clouds data quick storage method also has the characteristics that：
The method further includes：Judge not including unique mapping with the file to be uploaded in the file attribute table
When identifying identical unique mapping mark, is sent to the terminal device and be used to indicate the response message for executing upload operation,
After receiving the file that the terminal device uploads, the file information table is updated according to this file.
The present invention also provides a kind of high in the clouds data speed storage devices, are applied in server, described device includes：
File identification generation module, by being carried out based on mapping to the content of each file of storage using default mapping algorithm
It calculates, generates unique mapping mark of file；
File information table update module, unique mapping for recording each file in file information table identify and for remembering
Record the file reference count value of file upload request number；
Upload request receiving module, for the file upload request that receiving terminal apparatus is sent, the file upload request
Include unique mapping mark of file to be uploaded；For including in the fileinfo judgment module judgement file information table
When the identical unique mapping of unique mapping mark with the file to be uploaded identifies, by the text of this file in file information table
Part reference count value increases by one；
File identification contrast module, for identifying and the file information table unique mapping of the file to be uploaded
In each file unique mapping mark compared；
Fileinfo judgment module, for judge in the file information table whether include and the file to be uploaded
Unique mapping identifies identical unique mapping mark；
Sending module, in judging the file information table in fileinfo judgment module comprising with it is described to be uploaded
When the identical unique mapping of unique mapping mark of file identifies, it is used to indicate to terminal device transmission without executing upload
The response message of operation.
Above-mentioned apparatus also has the characteristics that：
Described device further includes memory module；
Institute's memory module, each file for file reference count value to be greater than or equal to default thresholding are stored in first and deposit
Equipment is stored up, each file that file reference count is worth to small default thresholding is stored in the second storage device, first memory block
Storage performance is more than the storage performance of second memory block, and the storage performance includes at least one of following parameter：It deposits
Take speed, equipment cost, mean time between failures duration.
Above-mentioned apparatus also has the characteristics that：
The file information table update module, each file upload for being additionally operable to record each file in file information table are asked
The file name to be uploaded for including in asking；
The sending module, be additionally operable in the fileinfo judgment module judges the file information table include and institute
It is each corresponding to this unique mapping mark when stating the identical unique mapping mark of unique mapping mark of file to be uploaded
File name determines the name information of file, and name information is pushed to the terminal device that can receive pushed information.
Above-mentioned apparatus also has the characteristics that：
The file identification generation module carries out mapping calculation using hash algorithm to the content of each file of storage, will give birth to
At cryptographic Hash identified as the unique mapping.
Above-mentioned apparatus also has the characteristics that：
Described device further includes the upload file reception module for receiving upper transmitting file from terminal device；
The sending module, be additionally operable to not include in fileinfo judgment module judges the file attribute table with it is described
When the identical unique mapping of unique mapping mark of file to be uploaded identifies, execution is used to indicate to terminal device transmission
The response message of upload operation；
The file information table update module is additionally operable to receive the terminal device in the upload file reception module
After the file of upload, the file information table is updated according to this file.
To sum up, the present invention includes following technique effect：
1, the repetition of same file can be effectively prevent to upload, reduce redundant file in server, network bandwidth is reduced and disappear
Consumption improves server process performance.
2, enable the server to know in time the point of interest of user, understand user demand, improve the intelligent of server and
Analysis ability.
3, the memory block for different storage performances of being distributed according to need according to the temperature of file, the processing money of reasonable distribution server
Source makes the frequent hot spot file of reading obtain faster processing, further increases server process speed, promote the place of server
Reason ability.
Description of the drawings
The attached drawing for constituting the part of the present invention is used to provide further understanding of the present invention, schematic reality of the invention
Example and its explanation are applied for explaining the present invention, is not constituted improper limitations of the present invention.In the accompanying drawings：
Fig. 1 is a kind of flow chart of a high in the clouds data quick storage method provided according to an embodiment of the invention；
Fig. 2 is two kinds of building mode schematic diagrames according to file information table provided by the invention；
Fig. 3 is a kind of flow chart of the two high in the clouds data quick storage methods provided according to an embodiment of the invention；
Fig. 4 is a kind of high in the clouds data speed storage device for server of three offers according to an embodiment of the invention
Structural schematic diagram；
Fig. 5 is a kind of high in the clouds data speed storage device for terminal device of four offers according to an embodiment of the invention
Structural schematic diagram.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
The every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.It needs
Illustrate, in the absence of conflict, the features in the embodiments and the embodiments of the present application mutually can be combined arbitrarily.
A kind of high in the clouds data quick storage method of detailed description of the present invention exemplary embodiment and dress below in conjunction with the accompanying drawings
It sets.
Embodiment one
Fig. 1 is the flow chart for showing an a kind of high in the clouds data quick storage method provided according to an embodiment of the invention.
The method includes：
Step 101, server by utilizing presets mapping algorithm and carries out mapping calculation to the content of each file of storage, generates text
Unique mapping of part identifies；Unique mapping mark of each file is recorded in file information table and for recording file upload request
The file reference count value of number；
Step 102, the file upload request that receiving terminal apparatus is sent, file upload request include file to be uploaded
Unique mapping mark；
Step 103, unique mapping mark of file to be uploaded and unique mapping of each file in file information table are marked
Knowledge is compared, and is judged identical unique comprising unique mapping mark with the file to be uploaded in the file information table
When mapping mark, the response message being used to indicate without executing upload operation is sent to the terminal device, by file information table
In this file file reference count value increase by one.
This method can effectively prevent the repetition of same file to upload, and reduce redundant file in server, reduce Netowrk tape
Width consumption, improves server process performance.
Further include that server determines hot spot file according to the file reference count value of file in this method, to make server
The point of interest of user is known in time, is understood user demand, is improved the intelligent and analysis ability of server.
This method further includes step 104, and each file that file reference count value is greater than or equal to default thresholding is stored in
First storage device, each file that file reference count is worth to small default thresholding are stored in the second storage device, and described first deposits
The storage performance of storage area is more than the storage performance of second memory block, and the storage performance includes at least one in following parameter
Kind：Access speed, equipment cost, mean time between failures duration.According to the different storages of the temperature of file distribution according to need in this step
The memory block of performance, the process resource of reasonable distribution server make the frequent hot spot file of reading obtain faster processing, into one
Step improves server process speed, promotes the processing capacity of server.
In above-mentioned steps 101, server by utilizing hash algorithm carries out mapping calculation to the content of each file of storage, will
The cryptographic Hash of generation is identified as unique mapping.
Fig. 2 shows two kinds of building modes according to file information table provided by the invention：
Mode one：As shown in Fig. 2 (a), file information table includes but not limited to that file uniquely maps mark, file reference
Counting, file name, file size, the store path in file system, file creation time etc.；
Mode two：As shown in Fig. 2 (b), file information table is made of file attribute table and file reference count table, wherein
File attribute table includes but not limited to that file uniquely maps mark, file name, file size, file creation time etc., file
Reference count table includes but not limited to that file uniquely maps mark, file reference count, the store path in file system
Deng.File attribute table and file reference count table uniquely map mark by file to be associated, and keeps wherein identical file unique
Mapping mark is directed toward same file.
Wherein, the file reference count is used for recording file upload request number.
In above-mentioned steps 103, judge in file information table comprising identical as unique mapping mark of file to be uploaded
Unique mapping mark when, send and be used to indicate without executing the response message of upload operation to terminal device；Judge the text
When being identified not comprising the identical unique mapping of unique mapping mark with the file to be uploaded in part attribute list, to the end
End equipment sends the response message for being used to indicate and executing upload operation, after receiving the file that the terminal device uploads, root
File updates the file information table accordingly.
Wherein, the response message sent to terminal device includes file download path, can also include following information
At least one of：File name, file creation time, file size.
In this method, file upload request also includes file name to be uploaded.The method further includes pushing hot spot to terminal
The method of file, specifically includes：Include in each file upload request of each file to be uploaded is recorded in file information table
File name；Judge identical uniquely to reflect comprising identifying with unique mapping of the file to be uploaded in the file information table
When penetrating mark, the name information of file is determined according to the corresponding each file name of this unique mapping mark, name information is pushed away
It send to the terminal device that can receive pushed information.
Embodiment two
Fig. 3 is the process chart for showing two terminal equipment sides provided according to an embodiment of the invention.The method packet
It includes：
Step 301, mapping calculation is carried out to the content of file to be uploaded using default mapping algorithm, generates text to be uploaded
Unique mapping of part identifies；
Step 302, file upload request is sent to server, file upload request includes unique mapping of file to be uploaded
Mark；
Step 303, the response message that server is sent is received, if instruction executes upload operation in response message, on
Pass file to be uploaded；If instruction is without executing upload operation in response message, then it is assumed that upload and complete.
In above-mentioned steps 301, terminal device carries out mapping calculation using hash algorithm to the content of file to be uploaded, will
The cryptographic Hash of generation is identified as unique mapping.
In above-mentioned steps 302, the file upload request is set to the request entity portion of hypertext transfer protocol information
Point, this hypertext transfer protocol information is sent to server.The file upload request further include in following information at least
It is a kind of：File name, file size.
In above-mentioned steps 303, the response message that the server of reception is sent includes file download path, can also include
At least one of following information：File name, file creation time, file size.
Specifically, if terminal device is not necessarily to upper transmitting file, the available cloud storage space shown on terminal device is in number
File size to be uploaded is subtracted in value, finally, it is empty that user can see the cloud storage that user can use on the terminal device
Between reduce, the cloud storage space of reduction is the file size uploaded, meanwhile, the storage road of transmitting file on premises equipment requests
Diameter is the store path that identical file is identified with unique mapping of upper transmitting file of server memory storage.
If user deletes the file uploaded, corresponding file reference count value subtracts in the file information table in server
One, if file reference count value is 0, then it represents that this document is deleted in server.
Embodiment three
Fig. 4 is to show the three a kind of high in the clouds data quick storage dress for server provided according to an embodiment of the invention
The structural schematic diagram set can be used for executing the method and step of embodiment as shown in Figure 1.
With reference to Fig. 4, above-mentioned apparatus includes：
File identification generation module 401, for being mapped the content of each file of storage using default mapping algorithm
It calculates, generates unique mapping mark of file；
File information table update module 402, unique mapping for recording each file in file information table are identified and are used
In the file reference count value of record file upload request number；
Upload request receiving module 403, for the file upload request that receiving terminal apparatus is sent, the file upload is asked
Unique mapping comprising file to be uploaded is asked to identify；
File identification contrast module 404, for believing unique mapping mark of the file to be uploaded with the file
Unique mapping mark of each file is compared in breath table；
Fileinfo judgment module 405, for judge in the file information table whether include and the text to be uploaded
The identical unique mapping mark of unique mapping mark of part；
Sending module 406, for including to be waited for described in judging the file information table in fileinfo judgment module
When the identical unique mapping of unique mapping mark of the file of biography identifies, it is used to indicate to terminal device transmission without executing
The response message of upload operation.
Above-mentioned apparatus further includes memory module 407.Memory module 407, for file reference count value to be greater than or equal to
Each file of default thresholding is stored in the first storage device, and each file that file reference count is worth to small default thresholding is stored in the
Two storage devices, the storage performance of first memory block are more than the storage performance of second memory block, the storage performance
Including at least one of following parameter：Access speed, equipment cost, mean time between failures duration.
Above-mentioned file identification generation module 401 carries out mapping calculation using hash algorithm to the content of each file of storage,
It is identified the cryptographic Hash of generation as unique mapping.
In above-mentioned file information table update module 402, the file information table of the file information table and step 101 description
Identical, for details, reference can be made to the contents of above-mentioned steps 101, repeat no more again.
Above-mentioned fileinfo judgment module 405 judges to mark comprising unique mapping with file to be uploaded in file information table
When knowing identical unique mapping mark, it is used to indicate to terminal device transmission without executing upload operation by sending module 406
Response message；The unique mapping mark for judging not including in the file attribute table with the file to be uploaded is identical only
When one mapping mark, is sent to the terminal device by sending module 406 and is used to indicate the response message for executing upload operation,
After receiving the file that the terminal device uploads, the file information table is updated according to this file.
Wherein, the response message sent to terminal device includes file download path, can also include following information
At least one of：File name, file creation time, file size.
Example IV
Fig. 5 is to show the four a kind of high in the clouds data quick storage for terminal device provided according to an embodiment of the invention
The structural schematic diagram of device can be used for executing the method and step of embodiment as shown in Figure 3.
With reference to Fig. 5, described device includes：
File identification generation module 501, for being mapped the content of file to be uploaded using default mapping algorithm
It calculates, generates unique mapping mark of the file to be uploaded；
Upload request sending module 502, for sending file upload request to server, the file upload request includes
Unique mapping of the file to be uploaded identifies；
Response message receiving module 503, the response message for receiving server transmission；
Processing module 504, for judging that instruction executes upload operation in the response message, then uploads the text to be uploaded
Part is additionally operable to judge that instruction is without executing upload operation in the response message, then it is assumed that upload and complete；
File identification generation module 501 carries out mapping calculation using hash algorithm to the content of file to be uploaded, will generate
Cryptographic Hash identified as the unique mapping.
In above-mentioned upload request sending module 502, the file upload request is set to hypertext transfer protocol information
Request entity part, this hypertext transfer protocol information is sent to server.The file upload request further includes following
At least one of information：File name, file size.
In above-mentioned response message receiving module 503, the response message that the server of reception is sent includes file download road
Diameter can also include at least one of following information：File name, file creation time, file size.
In above-mentioned processing module 504, if terminal device is not necessarily to upper transmitting file, the available cloud shown on terminal device
Memory space numerically subtracts file size to be uploaded, and finally, user can see user on the terminal device to be made
Cloud storage space reduces, and the cloud storage space of reduction is the file size uploaded, meanwhile, premises equipment requests upload
The store path of file is the store path that identical file is identified with unique mapping of upper transmitting file of server memory storage.
If user deletes the file uploaded, corresponding file reference count value subtracts in the file information table in server
One, if file reference count value is 0, then it represents that this document is deleted in server.
To sum up, the present invention includes following technique effect：
1, the repetition of same file can be effectively prevent to upload, reduce redundant file in server, network bandwidth is reduced and disappear
Consumption improves server process performance.
2, enable the server to know in time the point of interest of user, understand user demand, improve the intelligent of server and
Analysis ability.
3, the memory block for different storage performances of being distributed according to need according to the temperature of file, the processing money of reasonable distribution server
Source makes the frequent hot spot file of reading obtain faster processing, further increases server process speed, promote the place of server
Reason ability.
Descriptions above can combine implementation individually or in various ways, and these variants all exist
Within protection scope of the present invention.
One of ordinary skill in the art will appreciate that all or part of step in the above method can be instructed by program
Related hardware is completed, and described program can be stored in computer readable storage medium, such as read-only memory, disk or CD
Deng.Optionally, all or part of step of above-described embodiment can also be realized using one or more integrated circuits, accordingly
Ground, the form that hardware may be used in each device/unit in above-described embodiment are realized, the shape of software function device can also be used
Formula is realized.The present invention is not limited to the combinations of the hardware and software of any particular form.
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that article or equipment including a series of elements include not only those elements, but also includes not having
There is the other element being expressly recited, or further includes for this article or the intrinsic element of equipment.Do not limiting more
In the case of system, the element that is limited by sentence " including ... ", it is not excluded that including the element article or equipment in
There is also other identical elements.
The above examples are only used to illustrate the technical scheme of the present invention and are not limiting, reference only to preferred embodiment to this hair
It is bright to be described in detail.It will be understood by those of ordinary skill in the art that can modify to technical scheme of the present invention
Or equivalent replacement should all cover the claim model in the present invention without departing from the spirit of the technical scheme of the invention and range
In enclosing.
Claims (10)
1. a kind of high in the clouds data quick storage method, which is characterized in that the method includes：
Server by utilizing presets mapping algorithm and carries out mapping calculation to the content of each file of storage, generates unique mapping of file
Mark；The unique mapping mark and the file for recording file upload request number that each file is recorded in file information table are drawn
Use count value；
The file upload request that receiving terminal apparatus is sent, the file upload request include unique mapping of file to be uploaded
Mark；
Unique mapping mark of file to be uploaded and unique mapping mark of each file in file information table are compared, sentenced
When being identified comprising the identical unique mapping of unique mapping mark with the file to be uploaded in the fixed file information table, to
The terminal device sends the response message being used to indicate without executing upload operation, by the file of this file in file information table
Reference count value increases by one.
2. data quick storage method in high in the clouds as described in claim 1, which is characterized in that
The method further includes：File reference count value is stored in the first storage more than or equal to each file of default thresholding to set
Standby, each file that file reference count is worth to small default thresholding is stored in the second storage device, the storage of first memory block
Performance is more than the storage performance of second memory block, and the storage performance includes at least one of following parameter：Access speed
Degree, equipment cost, mean time between failures duration.
3. data quick storage method in high in the clouds as described in claim 1, which is characterized in that
The file upload request also includes file name to be uploaded,
The method further includes：The text to be uploaded for including in each file upload request of each file is recorded in file information table
Part title；Judge to identify identical unique mapping comprising unique mapping with the file to be uploaded in the file information table
When mark, the name information of file is determined according to the corresponding each file name of this unique mapping mark, name information is pushed
The terminal device of pushed information can extremely be received.
4. the method as described in claim 1, which is characterized in that
It is described that mapping calculation is carried out to the content of each file of storage using default mapping algorithm, generate unique mapping mark of file
Knowledge includes：Mapping calculation is carried out to the content of each file of storage using hash algorithm, as described in only using the cryptographic Hash of generation
One mapping mark.
5. the method as described in claim 1, which is characterized in that the method further includes：
The method further includes：Judge that the unique mapping not included in the file attribute table with the file to be uploaded identifies
When identical unique mapping mark, is sent to the terminal device and be used to indicate the response message for executing upload operation, received
After the file uploaded to the terminal device, the file information table is updated according to this file.
6. a kind of high in the clouds data speed storage device, it is applied in server, which is characterized in that described device includes：
File identification generation module, it is raw for carrying out mapping calculation to the content of each file of storage using default mapping algorithm
It is identified at unique mapping of file；
File information table update module, unique mapping for recording each file in file information table identify and for recording text
The file reference count value of part upload request number；
Upload request receiving module, for the file upload request that receiving terminal apparatus is sent, the file upload request includes
Unique mapping of file to be uploaded identifies；For including and institute in judging the file information table in fileinfo judgment module
When stating the identical unique mapping of unique mapping mark of file to be uploaded and identifying, the file of this file in file information table is drawn
Increase by one with count value；
File identification contrast module, for will the file to be uploaded unique mapping mark and the file information table in respectively
Unique mapping mark of file is compared；
Fileinfo judgment module, for whether judging in the file information table comprising unique with the file to be uploaded
The identical unique mapping mark of mapping mark；
Sending module, for including and the file to be uploaded in judging the file information table in fileinfo judgment module
Unique mapping mark identical unique mapping mark when, be used to indicate to terminal device transmission and be not necessarily to execute upload operation
Response message.
7. device as claimed in claim 6, which is characterized in that
Described device further includes memory module；
Institute's memory module, each file for file reference count value to be greater than or equal to default thresholding are stored in the first storage and set
Standby, each file that file reference count is worth to small default thresholding is stored in the second storage device, the storage of first memory block
Performance is more than the storage performance of second memory block, and the storage performance includes at least one of following parameter：Access speed
Degree, equipment cost, mean time between failures duration.
8. device as claimed in claim 6, which is characterized in that
The file information table update module is additionally operable in each file upload request for recording each file in file information table
Including file name to be uploaded；
The sending module is additionally operable in the fileinfo judgment module judges the file information table include to wait for described
When the identical unique mapping of unique mapping mark of the file of upload identifies, according to the corresponding each file of this unique mapping mark
Title determines the name information of file, and name information is pushed to the terminal device that can receive pushed information.
9. device as claimed in claim 6, which is characterized in that
The file identification generation module carries out mapping calculation using hash algorithm to the content of each file of storage, by generation
Cryptographic Hash is identified as unique mapping.
10. device as claimed in claim 6, which is characterized in that
Described device further includes the upload file reception module for receiving upper transmitting file from terminal device；
The sending module, be additionally operable to not include in fileinfo judgment module judges the file attribute table on described wait for
When the identical unique mapping of unique mapping mark of the file of biography identifies, it is used to indicate to terminal device transmission and executes upload
The response message of operation；
The file information table update module is additionally operable to receive the terminal device upload in the upload file reception module
File after, the file information table is updated according to this file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056378.7A CN108347459A (en) | 2017-01-25 | 2017-01-25 | A kind of high in the clouds data quick storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056378.7A CN108347459A (en) | 2017-01-25 | 2017-01-25 | A kind of high in the clouds data quick storage method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108347459A true CN108347459A (en) | 2018-07-31 |
Family
ID=62961852
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710056378.7A Pending CN108347459A (en) | 2017-01-25 | 2017-01-25 | A kind of high in the clouds data quick storage method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108347459A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109597798A (en) * | 2018-12-04 | 2019-04-09 | 平安科技（深圳）有限公司 | Network file delet method, device, computer equipment and storage medium |
| CN109684870A (en) * | 2018-12-18 | 2019-04-26 | 郑州云海信息技术有限公司 | A kind of self-contained the file information configuration method and system |
| CN111049891A (en) * | 2019-12-05 | 2020-04-21 | 浩云科技股份有限公司 | Method for uploading and downloading cascade files in centralized storage |
| CN111083222A (en) * | 2019-12-13 | 2020-04-28 | 中富通集团股份有限公司 | Data uploading method and terminal |
| CN112966133A (en) * | 2021-03-25 | 2021-06-15 | 深圳康佳电子科技有限公司 | Data storage processing method, server and computer readable storage medium |
| CN114168536A (en) * | 2021-11-27 | 2022-03-11 | 深圳市连用科技有限公司 | Method for uploading file and terminal equipment |
| CN114647620A (en) * | 2018-09-10 | 2022-06-21 | 创新先进技术有限公司 | File uploading method, device, equipment, program product and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645837A (en) * | 2009-09-04 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Method and device for realizing load balancing |
| CN102841931A (en) * | 2012-08-03 | 2012-12-26 | 中兴通讯股份有限公司 | Storage method and storage device of distributive-type file system |
| CN103002029A (en) * | 2012-11-26 | 2013-03-27 | 北京百度网讯科技有限公司 | Management method, system and client for uploaded files |
| CN103177005A (en) * | 2011-12-21 | 2013-06-26 | 深圳市腾讯计算机系统有限公司 | Processing method and system of data access |
| CN103778071A (en) * | 2014-01-20 | 2014-05-07 | 华为技术有限公司 | Cache space distribution method and device |
-
2017
- 2017-01-25 CN CN201710056378.7A patent/CN108347459A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101645837A (en) * | 2009-09-04 | 2010-02-10 | 成都市华为赛门铁克科技有限公司 | Method and device for realizing load balancing |
| CN103177005A (en) * | 2011-12-21 | 2013-06-26 | 深圳市腾讯计算机系统有限公司 | Processing method and system of data access |
| CN102841931A (en) * | 2012-08-03 | 2012-12-26 | 中兴通讯股份有限公司 | Storage method and storage device of distributive-type file system |
| CN103002029A (en) * | 2012-11-26 | 2013-03-27 | 北京百度网讯科技有限公司 | Management method, system and client for uploaded files |
| CN103778071A (en) * | 2014-01-20 | 2014-05-07 | 华为技术有限公司 | Cache space distribution method and device |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114647620A (en) * | 2018-09-10 | 2022-06-21 | 创新先进技术有限公司 | File uploading method, device, equipment, program product and storage medium |
| CN109597798A (en) * | 2018-12-04 | 2019-04-09 | 平安科技（深圳）有限公司 | Network file delet method, device, computer equipment and storage medium |
| CN109684870A (en) * | 2018-12-18 | 2019-04-26 | 郑州云海信息技术有限公司 | A kind of self-contained the file information configuration method and system |
| CN109684870B (en) * | 2018-12-18 | 2021-10-29 | 郑州云海信息技术有限公司 | Self-contained file information configuration method and system |
| CN111049891A (en) * | 2019-12-05 | 2020-04-21 | 浩云科技股份有限公司 | Method for uploading and downloading cascade files in centralized storage |
| CN111083222A (en) * | 2019-12-13 | 2020-04-28 | 中富通集团股份有限公司 | Data uploading method and terminal |
| CN111083222B (en) * | 2019-12-13 | 2022-11-18 | 中富通集团股份有限公司 | Data uploading method and terminal |
| CN112966133A (en) * | 2021-03-25 | 2021-06-15 | 深圳康佳电子科技有限公司 | Data storage processing method, server and computer readable storage medium |
| CN114168536A (en) * | 2021-11-27 | 2022-03-11 | 深圳市连用科技有限公司 | Method for uploading file and terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108347459A (en) | A kind of high in the clouds data quick storage method and device | |
| ES2553428T3 (en) | Method, device and content processing system | |
| US10901619B2 (en) | Selecting pages implementing leaf nodes and internal nodes of a data set index for reuse | |
| CN108011929A (en) | Data request processing method, apparatus, computer equipment and storage medium | |
| CN105224255B (en) | A kind of storage file management method and device | |
| CN107026876B (en) | A kind of file data access system and method | |
| CN104679665A (en) | Method and system for achieving block storage of distributed file system | |
| EP2710477B1 (en) | Distributed caching and cache analysis | |
| CN108845877B (en) | Method, device and system for managing memory | |
| CN103607424B (en) | Server connection method and server system | |
| CN105187523B (en) | A kind of directory access method and device | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| CN108399050B (en) | Data processing method and device | |
| CN109873855A (en) | A kind of resource acquiring method and system based on block chain network | |
| CN107087031A (en) | A kind of storage resource load-balancing method and device | |
| CN106126374A (en) | Method for writing data, method for reading data and device | |
| CN109391487A (en) | A kind of configuration update method and system | |
| CN103327036B (en) | The identification method of internet browsing equipment and Cookie server | |
| CN105187565A (en) | Method for utilizing network storage data | |
| CN108154024A (en) | A kind of data retrieval method, device and electronic equipment | |
| CN103997518B (en) | A kind of CDN node file synchronisation method and device | |
| CN102833295B (en) | Data manipulation method and device in distributed cache system | |
| CN105849704B (en) | Cache management device and buffer memory management method | |
| KR100801217B1 (en) | VIRTUAL STORAGE SYSTEM AND METHOD FOR MANAGEMENTING VIRTUAL STORAGE BASED ON Ad-HOC NETWORK | |
| US8874726B1 (en) | Automated load balancing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 550003 Building No. 12 in the Southern Park of Gui'an High-end Equipment Industrial Park, Guizhou Province Applicant after: Guizhou Baishan cloud Polytron Technologies Inc Address before: 100015 5 floor, block E, 201 IT tower, electronic city, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Applicant before: Guizhou white cloud Technology Co., Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180731 |