CN103873505B - Method, system and the device uploaded offline to cloud storage service device - Google Patents

Method, system and the device uploaded offline to cloud storage service device Download PDF

Info

Publication number
CN103873505B
CN103873505B CN201210534064.0A CN201210534064A CN103873505B CN 103873505 B CN103873505 B CN 103873505B CN 201210534064 A CN201210534064 A CN 201210534064A CN 103873505 B CN103873505 B CN 103873505B
Authority
CN
China
Prior art keywords
file
cloud storage
check value
service device
file block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210534064.0A
Other languages
Chinese (zh)
Other versions
CN103873505A (en
Inventor
高小兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN201210534064.0A priority Critical patent/CN103873505B/en
Publication of CN103873505A publication Critical patent/CN103873505A/en
Application granted granted Critical
Publication of CN103873505B publication Critical patent/CN103873505B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a kind of method uploaded offline to cloud storage service device, system and device.This method includes:Client calculates the check value of file to be uploaded, the file block information table for including file verification value is sent to cloud storage service device, client end response in receive cloud storage service device return uploading instructions, to offline uploading unit on transmitting file and file block information table;File is sent from offline uploading unit to cloud storage service device;Cloud storage service device calculates the check value of received file, whether identical compare the check value for calculating the check value of acquisition and being included in file block information table, the check value obtained in response to calculating is identical with the check value included in file block information table, cloud storage service device storage file.Technical solution provided by the invention, there is provided for the offline file transmission mechanism of cloud storage so that user improves the user experience that user uses cloud to store without keeping presence for a long time.

Description

Method, system and the device uploaded offline to cloud storage service device
Technical field
The present invention relates to network communication field, more particularly to a kind of method uploaded offline to cloud storage service device, system With device.
Background technology
With the development of cloud computing (Cloud Computing) technology, in the conceptive of cloud computing and extend and develop Carry out the concept of cloud storage.Cloud storage be by functions such as cluster application, grid or distributed file systems, will be big in network Measure various types of storage device and collaborative work is gathered by application software, it is common that data storage and industry are externally provided One system of access function of being engaged in.When the core of cloud computing system computing and processing is the storage and management of mass data, cloud Substantial amounts of storage device is needed to configure in computing system, cloud computing system is transformed into cloud storage system, and cloud storage is considered as The cloud computing system for core is stored and managed with data.
From the point of view of the concept of cloud storage and current application, the purpose is to provide a user a kind of transparent network storage clothes Business.As long as user is connected into internet, you can enjoys network storage service, as accessed the data being locally stored, whenever and wherever possible Manage its data stored beyond the clouds.
However, in the cloud storage of the prior art, user can only pass through PC(PC)Or professional client etc. is used Family terminal uploads storage content online to cloud storage service device, realizes that cloud is synchronous, it is necessary to which user terminal is always maintained at presence It could realize the upload of this content.For example, the technology that domestic user accesses internet at present is mainly ADSL (Asymmetric Digital Subscriber Line, ADSL)Technology, its uploading bandwidth generally exist Below 512Kb/S.Exemplified by uploading the file of a 1GB size, theory, which uploads, needs the time to be(1GB×1024×1024× 8)/ 512=16384S, takes around 4.5 hours.It can be seen from the above that upload procedure not only takes, but also need user for a long time Presence is kept, not only user experience reduces, while is also consumed by resource.For example, the energy consumption of user's PC machine is generally in 200w- Between 300w, and upload the general power consumption 0.9-1.35KWH of file of a 1GB.
The content of the invention
One side according to embodiments of the present invention, a technical problem to be solved are:There is provided a kind of to cloud storage Method, system and the device that servers off-line uploads, to realize under user terminal off-line state, upload to cloud storage service device Data.
A kind of method uploaded offline to cloud storage service device provided in an embodiment of the present invention, the described method includes:
Client calculates the check value of file to be uploaded, and file block information table is sent to cloud storage service device, described The check value of the file is included in file block information table;
The client end response is in the uploading instructions for receiving the cloud storage service device return, in offline uploading unit Pass the file and the file block information table;
The offline uploading unit sends the file to the cloud storage service device;
The cloud storage service device calculates the check value of received file, compares and calculates the check value obtained and the text Whether the check value included in part blocking information table is identical;
Identical with the check value included in the file block information table in response to calculating the check value obtained, the cloud is deposited Store up file described in server storage.
Preferably, the method further includes:
Size in response to identifying the file meets predetermined file declustering threshold value, and the client is according to default File declustering rule, calculates the check value for each file block after multiple file blocks by file declustering to be uploaded, Check value and file declustering rule comprising each file block in the file block information table;
The offline uploading unit sends the file to the cloud storage service device, specifically includes:
The offline uploading unit is according to the file declustering rule included in the file block information table, by described in File declustering is multiple file blocks, and the multiple file block is sent to the cloud storage service device;
The cloud storage service device calculates the check value of received file, compares and calculates the check value obtained and the text Whether the check value included in part blocking information table is identical, specifically includes:
The cloud storage service device calculates the check value of each file block of the multiple file block received, The check value for comparing the file block for calculating acquisition is corresponding with the file block included in the file block information table Whether check value is identical;
It is described identical with the check value included in the file block information table in response to calculating the check value obtained, it is described Cloud storage service device stores the file, specifically includes:
In response to the check value for calculating the file block obtained and the file included in the file block information table The corresponding check value of piecemeal is identical, and the cloud storage service device stores the file block.
Preferably, before file block information table is sent to cloud storage service device, the method further includes:
The client calculates the check value of the file, and the school of the file is also included in the file block information table Test value;
The cloud storage service device identifies whether according to the file declustering rule included in the file block information table Each file block after storage fractionation;
In response to having stored each file block after splitting, the cloud storage service device merges each described file Piecemeal forms complete file, calculates the check value of the complete file;
Check value and the verification of the file included in the file block information table in response to the complete file It is worth identical, the cloud storage service device storage complete file.
Preferably, the method further includes:
In response to the check value for calculating the file block obtained and the file included in the file block information table The corresponding check value of piecemeal is identical, and the cloud storage service device is sent for the file block to the offline uploading unit Upload success message;
The offline uploading unit deletes the corresponding text of the upload success message in response to receiving upload success message Part piecemeal.
Preferably, the offline uploading unit starts to perform described to the multiple file of cloud storage service device transmission After the operation of piecemeal, the method further includes:
The parallel uploading instructions sent in response to receiving the client, the offline uploading unit identification is not yet to institute State the file block of cloud storage server transmission;
The upload task assignment negotiation for the file block that the offline uploading unit is not yet uploaded with the client;
According to negotiation as a result, the offline uploading unit is sent to the cloud storage server respectively with the client The file block not yet uploaded distributed.
Preferably, after the cloud storage service device receives the file block information table, the method further includes:
The cloud storage service device retrieves whether the cloud storage service device has been stored with according to the check value of the file The file;
The file is stored with response to retrieving, the cloud storage service device is returned to the client and uploaded successfully Message;
The client end response terminates offline upload flow in receiving the upload success message.
Preferably, the method further includes:
The client sends inquiry upload progress message to the cloud storage service device;
The cloud storage service device returns to stored fileinfo to the client.
Preferably, the client is located in same LAN with the offline uploading unit, and the method further includes:
The client sends inquiry upload progress message to the offline uploading unit;
The offline uploading unit returns to upper send to the fileinfo of the cloud storage server to the client.
Preferably, the check value especially by Message Digest Algorithm 5 MD5, Message Digest Algorithm 5 SHA, Any one algorithm in message authentication code algorithm MAC algorithms, which calculates, to be obtained.
A kind of system uploaded offline to cloud storage service device provided in an embodiment of the present invention, the system comprises:
Client, for calculating the check value of file to be uploaded, file block information table is sent to cloud storage service device, The check value of the file is included in the file block information table;In response to receiving the upper of the cloud storage service device return Teletype command, the file and the file block information table are uploaded to offline uploading unit;
Offline uploading unit, for receiving the file of client upload, the file is sent to the cloud storage service device;
Cloud storage service device, for calculating the check value of the file received from the offline uploading unit, compares calculating and obtains Whether the check value obtained and the check value included in the file block information table are identical;In response to calculate obtain check value with The check value included in the file block information table is identical, stores the file.
Preferably, the client, is additionally operable in response to identifying that the size of the file meets predetermined file declustering Threshold value, the client are calculated file declustering to be uploaded as after multiple file blocks according to default file declustering rule Each file block check value, check value comprising each file block in the file block information table with And the file declustering rule;
The offline uploading unit, is additionally operable to advise according to the file declustering included in the file block information table Then, it is multiple file blocks by the file declustering, the multiple file block is sent to the cloud storage service device;
The cloud storage service device, each file block specifically for calculating the multiple file block received Check value, compare the file point included in the check value and the file block information table that calculate the file block obtained Whether the corresponding check value of block is identical;In check value and the file block information table in response to calculating the file block obtained Comprising the corresponding check value of the file block it is identical, store the file block.
Preferably, the client, is additionally operable to before file block information table is sent to cloud storage service device, calculates institute The check value of file is stated, the check value of the file is also included in the file block information table;
The cloud storage service device, is additionally operable to, according to the file declustering rule included in the file block information table, know Each file block after splitting whether has not been stored;In response to having stored each file block after splitting, merge institute State each file block and form complete file, calculate the check value of the complete file;In response to the school of the complete file It is identical to test the check value of the file of the value with being included in the file block information table, stores the complete file.
Preferably, the cloud storage service device, is additionally operable to calculate the check value of the file block obtained, in response to calculating institute The check value of acquisition is identical with the corresponding check value of the file block included in the file block information table, to it is described from Line uploading unit sends the upload success message for the file block;
The offline uploading unit, is additionally operable to, in response to receiving upload success message, delete the upload success message Corresponding file block.
Preferably, the client, is additionally operable to start to perform in the offline uploading unit described to cloud storage clothes It is engaged in after the operation of the multiple file block of device transmission, parallel uploading instructions is sent to the offline uploading unit;With it is described from The upload task assignment negotiation for the file block that line uploading unit is not yet uploaded;According to negotiation as a result, being stored up to the cloud Deposit server and send the file block not yet uploaded distributed;
The offline uploading unit, is additionally operable to the parallel uploading instructions sent in response to receiving the client, identification The file block not yet sent to the cloud storage server;The upload of the file block not yet uploaded with the client Task assignment negotiation;According to negotiation as a result, the file block not yet uploaded distributed to cloud storage server transmission.
Preferably, the cloud storage service device, is additionally operable to after the file block information table is received, according to the file Check value, retrieve whether the cloud storage service device has been stored with the file;The text has been stored with response to retrieving Part, returns to the client and uploads success message;
The client, is additionally operable to, in response to receiving the upload success message, terminate offline upload flow.
Preferably, the client, is additionally operable to send inquiry upload progress message to the cloud storage service device;
The cloud storage service device, is additionally operable to return to stored fileinfo to the client.
Preferably, the client is located in same LAN with the offline uploading unit;The client, is additionally operable to Inquiry upload progress message is sent to the offline uploading unit;
The offline uploading unit, is additionally operable to return to upper send to the text of the cloud storage server to the client Part information.
Preferably, the check value is calculated especially by any one algorithm in MD5, SHA, MAC algorithm and obtained.
A kind of offline upload device provided in an embodiment of the present invention, the offline device that uploads include:
First communication unit, for receiving the file and file block information table of client upload, the file includes For multiple file blocks after fractionation, each file comprising the multiple file block point in the file block information table The check value of block and file declustering rule;
File declustering unit, for regular according to the file declustering included in the file block information table, by institute It is multiple file blocks to state file declustering;
Second communication unit, for sending the multiple file block to cloud storage service device.
Preferably, the offline device that uploads further includes:
Negotiation element, for the parallel uploading instructions sent in response to receiving the client, identifies not yet to described The file block that cloud storage server is sent;The upload task distribution association of the file block not yet uploaded with the client Business;
Second communication unit, is additionally operable to according to negotiation as a result, sending what is distributed to the cloud storage server The file block not yet uploaded.
The method uploaded offline to cloud storage service device, system and the device provided based on the above embodiment of the present invention, visitor Family end calculates the check value of file to be uploaded, and the file block information for including file verification value is sent to cloud storage service device Table, client end response in receive cloud storage service device return uploading instructions, to offline uploading unit on transmitting file and text Part blocking information table.Afterwards, client can be offline, and file is sent from offline uploading unit to cloud storage service device.Cloud storage Server calculates the check value of received file, compares the school for calculating the check value obtained and being included in file block information table Test whether value is identical, the check value obtained in response to calculating is identical with the check value included in file block information table, cloud storage Server storage file.So as to provide the offline file transmission mechanism for cloud storage so that user without being maintained at for a long time Wire state, improves the user experience that user uses cloud to store, can intensively be carried out for multi-user in offline uploading unit File uploads, and saves the resource consumption of user terminal.
By referring to the drawings to the present invention exemplary embodiment detailed description, further feature of the invention and its Advantage will be made apparent from.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is attached drawing needed in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also To obtain other attached drawings according to these attached drawings.
At the same time, it should be appreciated that for the ease of description, the size of the various pieces shown in attached drawing is not according to reality Proportionate relationship draw.Similar label and letter represents similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined, then it need not be further discussed in subsequent attached drawing in a attached drawing.
The attached drawing of a part for constitution instruction the embodiment that the invention has been described, and be used to solve together with the description Release the principle of the present invention.
Referring to the drawings, according to following detailed description, the present invention can be more clearly understood, wherein:
Fig. 1 shows a kind of flow signal of embodiment of the method uploaded offline to cloud storage service device provided by the present invention Figure;
Fig. 2 shows that the flow of the method another kind embodiment provided by the present invention uploaded offline to cloud storage service device is shown It is intended to;
Fig. 3 shows that the flow of method another embodiment provided by the present invention uploaded offline to cloud storage service device is shown It is intended to;
Fig. 4 shows that the flow of the method another embodiment provided by the present invention uploaded offline to cloud storage service device is shown It is intended to;
Fig. 5 shows a kind of structural representation for applying example of the system provided by the present invention uploaded offline to cloud storage service device Figure;
Fig. 6 shows offline upload a kind of structure diagram for applying example of device provided by the present invention;
Fig. 7 shows the offline structure diagram for uploading device another kind and applying example provided by the present invention.
Embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, instead of all the embodiments.It should note Anticipate and arrive:Unless specifically stated otherwise, the component and the positioned opposite of step otherwise illustrated in these embodiments does not limit this hair Bright scope.
The description only actually at least one exemplary embodiment is illustrative to be never used as to the present invention below And its application or any restrictions that use.Based on the embodiments of the present invention, those of ordinary skill in the art are not making wound All other embodiments obtained under the premise of the property made work, belong to the scope of protection of the invention.
It may be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable In the case of, the technology, method and apparatus should be considered as authorizing part for specification.
In shown here and discussion all examples, any occurrence should be construed as merely exemplary, without It is as limitation.Therefore, the other examples of exemplary embodiment can have different values.
Shown in Figure 1, Fig. 1, which shows that the method provided by the present invention uploaded offline to cloud storage service device is a kind of, to be implemented The flow diagram of example.The method that the embodiment provides includes:
101, client calculates the check value of file to be uploaded, and file block information table is sent to cloud storage service device, The check value of file is included in file block information table;
102, client end response uploads text in the uploading instructions for receiving the return of cloud storage service device to offline uploading unit Part and file block information table;
103, offline uploading unit sends file to cloud storage service device;
104, cloud storage service device calculates the check value of received file, compares the check value and file point for calculating and obtaining Whether the check value included in block information table is identical;
105, cloud storage clothes identical with the check value included in file block information table in response to calculating the check value obtained Business device storage file.
The method uploaded offline to cloud storage service device provided based on above-described embodiment, client calculate text to be uploaded The check value of part, the file block information table for including file verification value is sent to cloud storage service device, client end response is in reception To cloud storage service device return uploading instructions, to offline uploading unit on transmitting file and file block information table, by offline Uploading unit caches file to be uploaded.
After performing 102 operation, client can be offline, and file is sent from offline uploading unit to cloud storage service device. Cloud storage service device calculates the check value of received file, compares the check value for calculating and obtaining with being wrapped in file block information table Whether the check value contained is identical, identical with the check value included in file block information table in response to calculating the check value obtained, Cloud storage service device storage file.As a result, user need not keep presence for a long time, by offline uploading unit in user File uploads under off-line state.
In addition, after 101 operations are performed, can also be by signing in offline uploading unit by client, by client The log-on message that user is registered in cloud storage service device in advance, for example, username information and encrypted message, are uploaded to client End is signed in by LAN.Perform 103 offline uploading units to cloud storage service device send file operation before, by from Line uploading unit accesses cloud storage service device using the log-on message of client user.Client can also directly access with it Offline uploading unit in same LAN, or access cloud storage service device with log-on message.Thus, there is provided deposited using cloud Store up the security of server.
Shown in Figure 2, Fig. 2 shows that the method provided by the present invention uploaded offline to cloud storage service device is another real Apply the flow diagram of example.Another specific example of embodiment of the method includes the operation introduced as follows according to the present invention.
200, the size in response to identifying file meets predetermined file declustering threshold value, and client is according to default file Rule is split, calculates the check value for each file block after multiple file blocks by file declustering to be uploaded.
201, client sends file block information table to cloud storage service device, and file is included in file block information table Check value file, and the check value of each file block and file declustering rule.
It is for example, objective when file, which is more than this document, splits threshold value according to the size of file, the non-512KB of file declustering threshold value Family end is according to default file declustering rule.
The check value of each file block after calculation document fractionation, can be used for the check value in 204 operation, Cloud storage service device docks received file block and carries out completeness check, so as to ensure the correctness of file transmission.
202, client end response uploads text in the uploading instructions for receiving the return of cloud storage service device to offline uploading unit Part and file block information table.
203, file declustering is more according to the file declustering rule included in file block information table by offline uploading unit A file block, multiple file blocks are sent to cloud storage service device.For example, file declustering rule can include file declustering into How many pieces, build and the block tail tag of file block are remembered.
204, cloud storage service device calculates the check value of each file block of the multiple file blocks received, compares Calculate obtain file block check value check value corresponding with the file block included in file block information table whether phase Together.
205, in response to the check value for calculating the file block obtained and the file block included in file block information table Corresponding check value is identical, cloud storage service device storage file piecemeal.
File is carried out to the offline method for uploading of cloud storage service device, offline uploading unit based on what above-described embodiment provided The file block of more subsection is uploaded after fractionation, the check value that cloud storage service device individually calculates each file block carries out school Test, improve the correctness and security of file transmission.
Shown in Figure 3, Fig. 3 shows another reality of the method uploaded offline to cloud storage service device provided by the present invention Apply the flow diagram of example.Compared with Fig. 2 embodiments, sent according to the method that Fig. 3 embodiments provide to cloud storage service device Before file block information table, this method further includes:
Client goes back the check value of calculation document before file block information table is sent.In above-mentioned 201 operation, The check value of file is also included in file block information table;
301, cloud storage service device identifies whether to have stored according to the file declustering rule included in file block information table Each file block after fractionation;
302, in response to having stored each file block after splitting, cloud storage service device merges each file block Complete file is formed, calculates the check value of complete file;
303, cloud identical in response to the check value of file of the check value with being included in file block information table of complete file Storage server stores complete file.
Based on the method uploaded offline to cloud storage service device of above-described embodiment offer, also wrapped in file block information table Check value containing complete file, so that cloud storage service device utilizes the school after merging file block and forming complete file The file after value verification merges is tested, ensures the integrality of whole file stored.
With continued reference to shown in Fig. 3, one specific example of embodiment of the method, this method further include according to the present invention:
The check value of file block in response to calculating acquisition is corresponding with the file block included in file block information table Check value it is identical, cloud storage service device to offline uploading unit send for file block upload success message;On offline Leaflet member deletes in response to receiving upload success message and uploads the corresponding file block of success message.In Fig. 3, text is only shown Part piecemeal 1 is example, and cloud storage service device and the other file blocks of offline uploading unit processing are similar.
Based on the method uploaded offline to cloud storage service device of above-described embodiment offer, cached in offline uploading unit Substantial amounts of file, can need onboard flash memory to provide the memory or other storage resources of large capacity, increase the cost of system.Cause This, the file block finished for upload, after cloud storage service device verifies, offline uploading unit, which receives, to be uploaded successfully Message, deletes and uploads the corresponding file block of success message, to reach the maximization of storage resource use
Alternatively, it is also possible to provide external storage for offline uploading unit, offline uploading unit has external expansion interface, branch Exterior massive store is held, for extension storage space.Such as the interface such as USB, SD, SATA, for supporting movable storage device.
Shown in Figure 4, Fig. 4 shows another reality of the method uploaded offline of cloud storage service device provided by the present invention Apply the flow diagram of example.Start to perform the operation that multiple file blocks are sent to cloud storage service device in offline uploading unit Afterwards, this method further includes:
401, the parallel uploading instructions in response to receiving client transmission, offline uploading unit identification is not yet stored to cloud The file block that server is sent;
402, the upload task assignment negotiation for the file block that offline uploading unit is not yet uploaded with client;
403, according to negotiation as a result, offline uploading unit sends what is distributed to cloud storage server respectively with client The file block not yet uploaded.As shown in Figure 4, exemplarily, offline uploading unit uploads file block m, and client uploads File block n.
Based on above-described embodiment provide the method uploaded offline to cloud storage service device, can provide client it is parallel on Arq mode.Such as.When user local terminal signs in another network, startup client, is connected to cloud storage service device, opens Dynamic arq mode upper parallel.Cloud storage service device is held consultation with client and offline uploading unit, by remaining blocks of files Biography task is distributed to two sides and is undertaken, and can number and distribute according to the odd even of blocks of files, can also be randomly assigned.So as to so that use Family client and offline uploading unit upload file block parallel, improve uploading speed.
One specific example of embodiment of the method according to the present invention, should after cloud storage service device receives file block information table Method further includes:Cloud storage service device retrieves whether cloud storage service device has been stored with file according to the check value of file;Response File is stored with retrieving, cloud storage service device returns to client and uploads success message;Client end response is in receiving Success message is uploaded, terminates offline upload flow.
The method uploaded offline to cloud storage service device provided based on above-described embodiment, can be considered as high in the clouds synchronization mould Formula.When cloud storage service device can judge whether it has same file to deposit by the check value of file for cloud storage server File is being stored with when retrieving, then is no longer being uploaded, so as to save the resource of user and network.
To upload the file of 10GB sizes, exemplified by upstream bandwidth is 512Kb/S, this document has been stored in cloud storage service device In the case of, show that the used time of foregoing upload mode compares in following table:
Normal mode Upper arq mode parallel High in the clouds synchronous mode
Required time (h) 45 22.5 0
The energy consumption comparison of the file of the upload 10GB sizes of foregoing upload mode is shown in above-mentioned example, in following table.
Desktop PC Laptop Offline uploading unit
Power (w) 200-300 50-90 5-10
Energy consumption (KWH) 9-13.5 2.25-4.05 0.225-0.45
One specific example of embodiment of the method, this method further include according to the present invention:Client is sent out to cloud storage service device Send inquiry upload progress message;Cloud storage service device returns to stored fileinfo to client.
One specific example of embodiment of the method according to the present invention, client are located at same LAN with offline uploading unit In, this method further includes:Client sends inquiry upload progress message to offline uploading unit;Offline uploading unit is to client Return to upper send to the fileinfo of cloud storage server.When client and offline uploading module are in same LAN, visitor Family end can inquire about upload progress to offline uploading module or high in the clouds storage server.
Offline uploading unit and high in the clouds storage server can carry out real-time, interactive, therefore two kinds of query results are consistent.
One specific example of embodiment of the method according to the present invention, check value is especially by Message Digest Algorithm 5 (Message Digest Algorithm 5, MD5), Secure Hash Algorithm (SecureHash Algorithm, SHA), message Any one algorithm in authentication code algorithm (Message AuthenticationCode, MAC), which calculates, to be obtained.
Shown in Figure 5, Fig. 5 shows that system one kind provided by the present invention uploaded offline to cloud storage service device applies example Structure diagram.The system includes:
Client 501, for calculating the check value of file to be uploaded, file block information is sent to cloud storage service device Table, the check value of file is included in file block information table;Uploading instructions in response to receiving the return of cloud storage service device, to Transmitting file and file block information table in offline uploading unit;
Offline uploading unit 502, for receiving the file of client upload, file is sent to cloud storage service device;
Cloud storage service device 503, for calculating the check value of the file received from offline uploading unit, compares calculating and obtains Check value and the check value that is included in file block information table it is whether identical;In response to calculating the check value obtained and file point The check value included in block information table is identical, storage file.
One specific example of system according to the invention embodiment, client 501, is additionally operable in response to identifying the big of file Small to meet predetermined file declustering threshold value, client is calculated file declustering to be uploaded according to default file declustering rule For the check value of each file block after multiple file blocks, comprising each file block in file block information table Check value and file declustering rule;
Offline uploading unit, is additionally operable to according to the file declustering rule included in file block information table, by file declustering For multiple file blocks, multiple file blocks are sent to cloud storage service device;
Cloud storage service device, the verification of each file block specifically for calculating the multiple file blocks received Value, compares the check value check value corresponding with the file block included in file block information table for calculating the file block obtained It is whether identical;The check value of file block in response to calculating acquisition is corresponding with the file block included in file block information table Check value it is identical, storage file piecemeal.
One specific example of system according to the invention embodiment, client 501, is additionally operable to send to cloud storage service device Before file block information table, the check value of calculation document, the check value of file is also included in file block information table.Cloud storage Server 503, is additionally operable to, according to the file declustering rule included in file block information table, identify whether after having stored fractionation Each file block;In response to having stored each file block after splitting, merge each file block and formed completely File, calculates the check value of complete file;In response to the file included in the check value and file block information table of complete file Check value it is identical, store complete file.
One specific example of system according to the invention embodiment, cloud storage service device 503, is additionally operable to calculate the file obtained The check value of piecemeal, in response to calculating obtained check value school corresponding with the file block included in file block information table Test that value is identical, the upload success message for file block is sent to offline uploading unit;
Offline uploading unit 502, is additionally operable to, in response to receiving upload success message, it is corresponding to delete upload success message File block.
One specific example of system according to the invention embodiment, client 501 are additionally operable to start to hold in offline uploading unit After row sends the operation of multiple file blocks to cloud storage service device, parallel uploading instructions are sent to offline uploading unit;With from The upload task assignment negotiation for the file block that line uploading unit is not yet uploaded;According to being taken as a result, being stored to cloud for negotiation Business device sends the file block not yet uploaded distributed;
Offline uploading unit 502, is additionally operable to the parallel uploading instructions in response to receiving client transmission, identification not yet to The file block that cloud storage server is sent;The upload task assignment negotiation of the file block not yet uploaded with client; According to negotiation as a result, the file block not yet uploaded distributed to the transmission of cloud storage server.
One specific example of system according to the invention embodiment, cloud storage service device 503 are additionally operable to receiving file block After information table, according to the check value of file, whether retrieval cloud storage service device has been stored with file;Stored in response to retrieving There is file, returned to client and upload success message;Client, is additionally operable in response to receiving upload success message, terminate from Line uploads flow.
One specific example of system according to the invention embodiment, client 501 are additionally operable to send to cloud storage service device and look into Ask upload progress message;Cloud storage service device 503 is additionally operable to return to stored fileinfo to client.
One specific example of system according to the invention embodiment, client are located at same LAN with offline uploading unit In;Client 501 is additionally operable to send inquiry upload progress message to offline uploading unit;Offline uploading unit 502, be additionally operable to Client returns to upper send to the fileinfo of cloud storage server.
In the above-mentioned each system embodiment of the present invention, check value is especially by any one in MD5, SHA, MAC algorithm Algorithm, which calculates, to be obtained.
Shown in Figure 6, Fig. 6 shows offline upload a kind of structure diagram for applying example of device provided by the present invention.Should The offline upload device that embodiment provides, including:
First communication unit 601, for receiving the file and file block information table of client upload, file is including being Multiple file blocks after fractionation, the check value of each file block comprising multiple file blocks in file block information table And file declustering rule;
File declustering unit 602, for regular according to the file declustering included in file block information table, by file declustering For multiple file blocks;
Second communication unit 603, for sending multiple file blocks to cloud storage service device.
First communication unit 601 may be used to provide with the second communication unit 603 and be connect including gigabit ethernet interface, WIFI The interface modules such as mouth access network.
Upload one specific example of device embodiment offline according to the present invention, this uploads device offline, further includes:
Negotiation element 604, for the parallel uploading instructions in response to receiving client transmission, identification is not yet stored to cloud The file block that server is sent;The upload task assignment negotiation of the file block not yet uploaded with client;
Second communication unit 603, be additionally operable to it is according to negotiation as a result, to cloud storage server send distributed not yet on The file block of biography.
Shown in Figure 7, Fig. 7 shows offline upload a kind of structure diagram for applying example of device provided by the present invention.From Line uploads device and can be integrated in as a function module in router, home gateway or modem Modem, with reality Ready-made and energy consumption it is optimal.As shown in 7 figures, integrating the router software structure of offline upload function includes:Man-machine interface and Application layer, api layer, hardware abstraction layer, hardware drive program layer, hardware device level.The offline device that uploads is integrated in Fig. 7 people In machine interface and application layer.If offline uploading unit is integrated in Modem or home gateway, its power consumption will be more Low, in the case of the storage device of plug-in mobile hard disk class, highest energy consumption is also no more than 3w.
So far, a kind of method uploaded offline to cloud storage service device, system according to the present invention is described in detail With device.In order to avoid the design of the masking present invention, some details known in the field are not described.Those skilled in the art As described above, completely it can be appreciated how implementing technical solution disclosed herein.
Each embodiment is described by the way of progressive in this specification, what each embodiment stressed be and its The difference of its embodiment, the same or similar part cross-reference between each embodiment.For system and device For embodiment, since it is substantially corresponding with embodiment of the method, so description is fairly simple, related part is implemented referring to method The part explanation of example.
The method uploaded offline to cloud storage service device, system and the device of the present invention may be achieved in many ways. For example, it can realize being taken to cloud storage for the present invention by any combinations of software, hardware, firmware or software, hardware, firmware Method, system and the device that business device uploads offline.The said sequence of the step of for the method is merely to illustrate, originally The step of method of invention, is not limited to order described in detail above, unless specifically stated otherwise.In addition, in some realities Apply in example, the present invention can be also embodied as recording program in the recording medium, these programs include being used for realization according to this hair The machine readable instructions of bright method.Thus, the present invention also covering storage is used for the program for performing the method according to the invention Recording medium.
Although some specific embodiments of the present invention are described in detail by example, the skill of this area Art personnel it should be understood that above example merely to illustrating, the scope being not intended to be limiting of the invention.The skill of this area Art personnel are it should be understood that without departing from the scope and spirit of the present invention can modify above example.This hair Bright scope is defined by the following claims.

Claims (17)

  1. A kind of 1. method uploaded offline to cloud storage service device, it is characterised in that the described method includes:
    Client calculates the check value of file to be uploaded, and file block information table, the file are sent to cloud storage service device The check value of the file is included in blocking information table;
    The client end response uploads institute in the uploading instructions for receiving the cloud storage service device return to offline uploading unit State file and the file block information table;
    The offline uploading unit sends the file to the cloud storage service device;
    The cloud storage service device calculates the check value of received file, compares the check value and the file point for calculating and obtaining Whether the check value included in block information table is identical;
    It is identical with the check value included in the file block information table in response to calculating the check value obtained, the cloud storage clothes Business device stores the file;
    Wherein, the offline uploading unit sends the file to the cloud storage service device, specifically includes:
    The offline uploading unit is according to the file declustering rule included in the file block information table, by the file declustering For multiple file blocks, the multiple file block is sent to the cloud storage service device;
    Wherein, the offline uploading unit starts to perform described sends the multiple file block to the cloud storage service device After operation, the method further includes:
    The parallel uploading instructions sent in response to receiving the client, the offline uploading unit identification is not yet to the cloud The file block that storage server is sent;
    The upload task assignment negotiation for the file block that the offline uploading unit is not yet uploaded with the client;
    According to negotiation as a result, the offline uploading unit sends to the cloud storage service device and divides respectively with the client The file block not yet uploaded matched somebody with somebody.
  2. 2. according to the method described in claim 1, it is characterized in that, the method further includes:
    Size in response to identifying the file meets predetermined file declustering threshold value, and the client is according to default file Rule is split, calculates the check value for each file block after multiple file blocks by file declustering to be uploaded, it is described Check value and file declustering rule comprising each file block in file block information table;
    The cloud storage service device calculates the check value of received file, compares the check value and the file point for calculating and obtaining Whether the check value included in block information table is identical, specifically includes:
    The cloud storage service device calculates the check value of each file block of the multiple file block received, compares Calculate the check value verification corresponding with the file block included in the file block information table of the file block obtained Whether value is identical;
    Described identical with the check value included in the file block information table in response to calculating the check value obtained, the cloud is deposited File described in storing up server storage, specifically includes:
    In response to the check value for calculating the file block obtained and the file block included in the file block information table Corresponding check value is identical, and the cloud storage service device stores the file block.
  3. 3. according to the method described in claim 2, it is characterized in that, to cloud storage service device send file block information table it Before, the method further includes:
    The client calculates the check value of the file, and the verification of the file is also included in the file block information table Value;
    The cloud storage service device identifies whether to have stored according to the file declustering rule included in the file block information table Each file block after fractionation;
    In response to having stored each file block after splitting, the cloud storage service device merges each described file block Complete file is formed, calculates the check value of the complete file;
    In response to the check value and the check value phase of the file included in the file block information table of the complete file Together, the cloud storage service device stores the complete file.
  4. 4. according to the method described in claim 3, it is characterized in that, the method further includes:
    In response to the check value for calculating the file block obtained and the file block included in the file block information table Corresponding check value is identical, and the cloud storage service device sends the upload for the file block to the offline uploading unit Success message;
    The offline uploading unit deletes the corresponding file point of the upload success message in response to receiving upload success message Block.
  5. 5. according to the method described in claim 1, it is characterized in that, the cloud storage service device receives the file block information After table, the method further includes:
    The cloud storage service device according to the check value of the file, retrieve the cloud storage service device whether be stored with it is described File;
    The file is stored with response to retrieving, the cloud storage service device returns to upload to the client successfully to disappear Breath;
    The client end response terminates offline upload flow in receiving the upload success message.
  6. 6. according to the method described in claim 5, it is characterized in that, the method further includes:
    The client sends inquiry upload progress message to the cloud storage service device;
    The cloud storage service device returns to stored fileinfo to the client.
  7. 7. according to the method described in claim 6, it is characterized in that, the client with the offline uploading unit positioned at same In LAN, the method further includes:
    The client sends inquiry upload progress message to the offline uploading unit;
    The offline uploading unit returns to upper send to the fileinfo of the cloud storage service device to the client.
  8. 8. according to the method described in claim 1 to 7 any one, it is characterised in that the check value is plucked especially by message Want any one algorithm meter in the 5th edition MD5 of algorithm, Message Digest Algorithm 5 SHA, message authentication code algorithm MAC algorithms Calculate and obtain.
  9. A kind of 9. system uploaded offline to cloud storage service device, it is characterised in that the system comprises:
    Client, for calculating the check value of file to be uploaded, file block information table is sent to cloud storage service device, described The check value of the file is included in file block information table;The upload returned in response to receiving the cloud storage service device refers to Order, the file and the file block information table are uploaded to offline uploading unit;
    Offline uploading unit, for receiving the file of client upload, the file is sent to the cloud storage service device;
    Cloud storage service device, for calculating the check value of the file received from the offline uploading unit, compares and calculates what is obtained Whether check value and the check value included in the file block information table are identical;In response to calculate obtain check value with it is described The check value included in file block information table is identical, stores the file;
    Wherein, the offline uploading unit, is additionally operable to according to the file declustering rule included in the file block information table, will The file declustering is multiple file blocks, and the multiple file block is sent to the cloud storage service device;
    Wherein, the client, is additionally operable to start to perform in the offline uploading unit described to cloud storage service device hair After the operation for sending the multiple file block, parallel uploading instructions are sent to the offline uploading unit;With the offline upload The upload task assignment negotiation for the file block that unit is not yet uploaded;According to negotiation as a result, to the cloud storage service Device sends the file block not yet uploaded distributed;
    The offline uploading unit, is additionally operable to the parallel uploading instructions sent in response to receiving the client, identification is not yet The file block sent to the cloud storage service device;The upload task of the file block not yet uploaded with the client Assignment negotiation;According to negotiation as a result, the file block not yet uploaded distributed to cloud storage service device transmission.
  10. 10. system according to claim 9, it is characterised in that the client, is additionally operable in response to identifying the text The size of part meets predetermined file declustering threshold value, and for the client according to default file declustering rule, calculating will be to be uploaded File declustering be each file block after multiple file blocks check value, include institute in the file block information table State the check value and file declustering rule of each file block;
    The cloud storage service device, the school of each file block specifically for calculating the multiple file block received Value is tested, compares the check value for calculating the file block obtained and the file block pair included in the file block information table Whether the check value answered is identical;In response to calculating the check value of the file block obtained with being included in the file block information table The corresponding check value of the file block it is identical, store the file block.
  11. 11. system according to claim 10, it is characterised in that the client, is additionally operable to cloud storage service device Before sending file block information table, the check value of the file is calculated, the text is also included in the file block information table The check value of part;
    The cloud storage service device, is additionally operable to according to the file declustering rule included in the file block information table, identification is No each file block stored after splitting;In response to having stored each file block after splitting, merge described every One file block forms complete file, calculates the check value of the complete file;In response to the check value of the complete file The check value of the file with being included in the file block information table is identical, stores the complete file.
  12. 12. system according to claim 11, it is characterised in that the cloud storage service device, is additionally operable to calculate what is obtained The check value of file block, in response to the file for calculating obtained check value with being included in the file block information table The corresponding check value of piecemeal is identical, and the upload success message for the file block is sent to the offline uploading unit;
    The offline uploading unit, is additionally operable to, in response to receiving upload success message, delete the upload success message and correspond to File block.
  13. 13. system according to claim 9, it is characterised in that the cloud storage service device, is additionally operable to receiving the text After part blocking information table, according to the check value of the file, retrieve whether the cloud storage service device has been stored with the file; The file has been stored with response to retrieving, has been returned to the client and uploads success message;
    The client, is additionally operable to, in response to receiving the upload success message, terminate offline upload flow.
  14. 14. system according to claim 13, it is characterised in that the client, is additionally operable to the cloud storage service Device sends inquiry upload progress message;
    The cloud storage service device, is additionally operable to return to stored fileinfo to the client.
  15. 15. system according to claim 14, it is characterised in that the client is with the offline uploading unit positioned at same In one LAN;The client, is additionally operable to send inquiry upload progress message to the offline uploading unit;
    The offline uploading unit, is additionally operable to return to upper send to the file letter of the cloud storage service device to the client Breath.
  16. 16. according to the system described in claim 9 to 15 any one, it is characterised in that the check value especially by MD5, Any one algorithm in SHA, MAC algorithm, which calculates, to be obtained.
  17. 17. a kind of offline upload device, it is characterised in that the offline device that uploads includes:
    First communication unit, for receiving the file and file block information table of client upload, the file includes splitting Multiple file blocks afterwards, the school of each file block comprising the multiple file block in the file block information table Test value and file declustering rule;
    File declustering unit, for regular according to the file declustering included in the file block information table, by the text Part is split as multiple file blocks;
    Second communication unit, for sending the multiple file block to cloud storage service device;
    Wherein, the offline device that uploads further includes:
    Negotiation element, for the parallel uploading instructions sent in response to receiving the client, identification is not yet deposited to the cloud Store up the file block that server is sent;The upload task assignment negotiation of the file block not yet uploaded with the client;
    Second communication unit, is additionally operable to according to negotiation as a result, being distributed not yet to cloud storage service device transmission The file block of upload.
CN201210534064.0A 2012-12-12 2012-12-12 Method, system and the device uploaded offline to cloud storage service device Active CN103873505B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210534064.0A CN103873505B (en) 2012-12-12 2012-12-12 Method, system and the device uploaded offline to cloud storage service device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210534064.0A CN103873505B (en) 2012-12-12 2012-12-12 Method, system and the device uploaded offline to cloud storage service device

Publications (2)

Publication Number Publication Date
CN103873505A CN103873505A (en) 2014-06-18
CN103873505B true CN103873505B (en) 2018-05-11

Family

ID=50911628

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210534064.0A Active CN103873505B (en) 2012-12-12 2012-12-12 Method, system and the device uploaded offline to cloud storage service device

Country Status (1)

Country Link
CN (1) CN103873505B (en)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI553489B (en) * 2014-09-02 2016-10-11 緯創資通股份有限公司 Methods for accessing data in cloud storage space and apparatuses using the same
TW201617922A (en) * 2014-11-14 2016-05-16 廣達電腦股份有限公司 Data accessing system and method for data storing method and data reading
CN104503862B (en) * 2014-12-09 2017-12-19 北京奇虎科技有限公司 The method and apparatus for obtaining the check value using channel bag
CN105245578B (en) * 2015-09-11 2019-06-07 北京金山安全软件有限公司 Data uploading method, data uploading system and data uploading device
CN105187551A (en) * 2015-09-29 2015-12-23 成都四象联创科技有限公司 Distributed computing method based on cloud platform
CN105389514B (en) * 2015-10-19 2018-01-16 浪潮集团有限公司 A kind of transmission method of virtual machine template, transmitting terminal and receiving terminal
WO2017113088A1 (en) * 2015-12-29 2017-07-06 深圳大学 Cloud service-based data storage method, integrity detection method and apparatus, and terminal device
CN105978951A (en) * 2016-04-27 2016-09-28 努比亚技术有限公司 Rapid file transmission method applied to mobile terminal and system thereof
CN106487795A (en) * 2016-10-31 2017-03-08 努比亚技术有限公司 A kind of device and method of adnexa upload, server
CN107544940A (en) * 2017-09-06 2018-01-05 深圳市金蝶精斗云网络科技有限公司 A kind of WEB computational methods and device
CN108881400B (en) * 2018-05-28 2019-05-28 济南万联信息科技有限公司 A kind of system for realizing that multi-channel data uploads in real time based on more network interface cards
CN110278202B (en) * 2019-06-18 2020-07-31 南京科源信息技术有限公司 File uploading system
CN111404959A (en) * 2020-03-26 2020-07-10 中车青岛四方车辆研究所有限公司 Method and system for realizing transmission of non-real-time offline file
CN117041305B (en) * 2023-10-10 2024-01-23 成都秦川物联网科技股份有限公司 Offline data management method, device and medium for gas flowmeter based on Internet of things

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963982A (en) * 2010-09-27 2011-02-02 清华大学 Method for managing metadata of redundancy deletion and storage system based on location sensitive Hash
CN102368737A (en) * 2011-11-25 2012-03-07 裘嘉 Cloud storage system and data access method thereof
CN102710630A (en) * 2012-05-29 2012-10-03 新华网股份有限公司 Cloud upload and download method and system of multi-threaded slice

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101963982A (en) * 2010-09-27 2011-02-02 清华大学 Method for managing metadata of redundancy deletion and storage system based on location sensitive Hash
CN102368737A (en) * 2011-11-25 2012-03-07 裘嘉 Cloud storage system and data access method thereof
CN102710630A (en) * 2012-05-29 2012-10-03 新华网股份有限公司 Cloud upload and download method and system of multi-threaded slice

Also Published As

Publication number Publication date
CN103873505A (en) 2014-06-18

Similar Documents

Publication Publication Date Title
CN103873505B (en) Method, system and the device uploaded offline to cloud storage service device
CN106294585B (en) A kind of storage method under cloud computing platform
CN106156359B (en) A kind of data synchronization updating method under cloud computing platform
CN109491758A (en) Docker mirror image distribution method, system, data gateway and computer readable storage medium
Huh et al. Design and test bed experiments of server operation system using virtualization technology
CN104811473B (en) A kind of method, system and management system for creating virtual non-volatile storage medium
CN101986651B (en) Remote storage method, remote storage system and client
CN107819891A (en) Data processing method, device, computer equipment and storage medium
CN103731487A (en) Download method, device, system and router for resource file
CN106506620A (en) A kind of cloud desktop intelligent terminal's management system
CN103795530B (en) A kind of method, device and the main frame of cross-domain controller certification
CN106559392A (en) A kind of file sharing method, device and system
CN105338016B (en) Data high-speed caching method and device and resource request response method and device
CN103281361A (en) Personal cloud cooperation system and data management method
CN106789956B (en) A kind of P2P order method and system based on HLS
CN104199683A (en) ISO mirror image document loading method and device
CN109962961A (en) A kind of reorientation method and system of content distribution network CDN service node
CN109711122A (en) A kind of right management method, device, system, equipment and readable storage medium storing program for executing
CN104901999B (en) A kind of virtual data center cross-domain mapping method that reliability perceives
CN108563697A (en) A kind of data processing method, device and storage medium
CN105302486A (en) Virtual offline desktop block device storage synchronization method
CN105591959A (en) System and method for load balancing by SSL session resuming
CN105357260B (en) Realize system, VDI data cache method and the VDI buffer memory device of virtual desktop
CN105357239A (en) Method and device for providing service, and method and device for acquiring service
CN109710502A (en) Log transmission method, apparatus and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20140618

Assignee: Tianyiyun Technology Co.,Ltd.

Assignor: CHINA TELECOM Corp.,Ltd.

Contract record no.: X2024110000020

Denomination of invention: Method, system, and device for offline uploading to cloud storage servers

Granted publication date: 20180511

License type: Common License

Record date: 20240315

EE01 Entry into force of recordation of patent licensing contract