CN101150593A - A method and system for data upload - Google Patents

A method and system for data upload Download PDF

Info

Publication number
CN101150593A
CN101150593A CNA2007101628412A CN200710162841A CN101150593A CN 101150593 A CN101150593 A CN 101150593A CN A2007101628412 A CNA2007101628412 A CN A2007101628412A CN 200710162841 A CN200710162841 A CN 200710162841A CN 101150593 A CN101150593 A CN 101150593A
Authority
CN
China
Prior art keywords
file
server
data
content
files
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007101628412A
Other languages
Chinese (zh)
Inventor
胡茂伟
罗海江
甘南南
朱峰
张志伟
王奇丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Xunlei Network Technology Co Ltd
Original Assignee
Shenzhen Xunlei Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Xunlei Network Technology Co Ltd filed Critical Shenzhen Xunlei Network Technology Co Ltd
Priority to CNA2007101628412A priority Critical patent/CN101150593A/en
Publication of CN101150593A publication Critical patent/CN101150593A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method for uploading data, which is used for improving data uploading efficiency. The method is characterized in connecting a user terminal and a server side; the user terminal sends content data of the uploaded file to the server side; according to description information of the file, the server side determines a device which stores the file, and acquires content data of the file from the determined device. The invention also discloses a user termnal, a server and a system.

Description

A kind of method and system of uploading data
Technical field
The present invention relates to the computer and the communications field, particularly relate to the method and system of uploading data.
Background technology
One of main application of the Internet is exactly resource-sharing, and operator provides value-added services such as blog, blog and network hard disc for the user, and the user can upload files such as literal class, audio class and video class by the user end to server at place.When client is directly transmitted data, if client after fire compartment wall, then can not directly be transmitted data between two clients, must be through the transfer of server, so need user end to server to upload data equally.
The process of uploading data in the prior art realizes one to one at present, and referring to shown in Figure 1, a client is only uploaded data to a server, has certain limitation, if a client is uploaded data to a plurality of servers, then uploading speed is slower.And, though ADSL (Asymmetric Digital Subscriber Line) (AsymmetricDigital Subscriber Line, ADSL) etc. broadband access technology has obtained using widely, but because the asymmetry of the uplink and downlink link of ADSL, the bandwidth of uploading link is subjected to limiting largely, makes that the speed of uploading data is undesirable.
To sum up, owing to be subjected to the limitation of the mode of uploading and the restriction of broadband access technology, the efficient of uploading data is undesirable.
Summary of the invention
The embodiment of the invention provides a kind of method and system of uploading data, is used to improve the efficient of uploading data.
A kind of method of uploading data may further comprise the steps:
Client and server side connect;
Described user end to server side sends the content-data of uploading described file;
Server side determines to have the equipment of described file according to described description information of files, and obtains the content-data of described file from the equipment of determining.
A kind of client comprises:
Computing module is used for calculating according to the content-data of default algorithm to file, and obtains the content signature of described file;
Interface module is used for connecting with server, and uploads the content-data and the content signature of described file to server.
A kind of server comprises:
Interface module is used for connecting with client, and receives the content-data of the file of client upload;
Processing module is used for determining to have the equipment of described file according to described description information of files, and notifies described interface module to obtain the content-data of described file from the equipment of determining.
A kind of system comprises:
Client is used for connecting with server, and to the content-data of server upload file;
Described server is used to receive the content-data of described file, and determines to have the equipment of described file and the content-data that obtains described file from the equipment of determining according to described description information of files.
The embodiment of the invention is by providing a plurality of data sources in uploading the process of data, make the recipient receive data from a plurality of data sources, no longer be uploading of single equipment, do not need to be subjected to single equipment to upload the influence of the restriction of bandwidth, improved the efficient of uploading data.
Description of drawings
Fig. 1 is the schematic diagram of upload procedure in the prior art;
Fig. 2 is the basic block diagram of system in the embodiment of the invention;
Fig. 3 is the detailed structure view of system in the embodiment of the invention;
Fig. 4 is the structure chart of client in the embodiment of the invention;
Fig. 5 is the structure chart of server in the embodiment of the invention;
Fig. 6 is for uploading the main method flow chart of data in the embodiment of the invention;
Fig. 7 uploads the method flow diagram of data when signing for client upload content in the embodiment of the invention;
Fig. 8 uploads the method flow diagram of data when calculating content-data for server in the embodiment of the invention.
Embodiment
In the embodiment of the invention, when a user end to server is uploaded data, make other equipment that has these data also upload data, upload the efficient of data with raising to this server.
Referring to Fig. 2, the system in the present embodiment comprises server 201 and client 202.
Client 202 is used for connecting with server 201, and to the content-data and the descriptor of server 201 upload files.Descriptor in the present embodiment comprises the content signature of filename and/or file.Wherein, content-data specifically is meant the binary data of file, comprises the data etc. of filename, file size and the pure content part of file.Content signature is according to default algorithm the content-data of file to be calculated the back to obtain.Algorithm in the present embodiment comprises all algorithms that different data processing obtained different results, result (be content signature) but data before unique identification is handled get final product, as Message-Digest Algorithm 5 (MD5) and Secure Hash Algorithm (Safe-Hash Algorithm, SHA) etc.Obtaining required content signature can have multiple mode, obtains required content signature as the full content data of file are handled; Be divided into a plurality of data segments as full content data, each data segment handled obtaining a plurality of content signatures respectively, again these a plurality of content signatures are merged into required content signature file; After a plurality of content signatures in the last example are merged, further handle according to algorithm, obtain required content signature; As from the content-data of file, selecting the part content-data, after being handled, these partial content data obtain required content signature; As the partial content data in the last example are divided into a plurality of data segments, each data segment is handled obtained a plurality of content signatures respectively, again these a plurality of content signatures are merged into required modes such as content signature.
Server 201 is used for connecting with client 202, the content-data and the descriptor of the file that reception client 202 is uploaded, and determine to have the equipment of described file and the content-data that obtains described file from described equipment according to described description information of files.The equipment that has described file can be client or server, and has not only one of the equipment of described file.
When the client 202 content signature of upload file not, and server 201 need determine to have the equipment of described file the time according to content signature, server 201 particularly calculates the partial content data of described file according to the content signature of default algorithm to the described file of content-data calculating back acquisition of described file.Preferentially upload this partial content data, then better effects if if require client 202.
Server 201 in the present embodiment is the general references to server, specifically can be made of a plurality of servers, and these a plurality of servers comprise upload server 203 and index server 204, referring to shown in Figure 3.
Wherein, upload server 203 is used for connecting with client 202 (and server), and receives and preserve description information of files and the content-data that client 202 is uploaded, and description information of files is sent to index server 204.If client 202 not upload file content signature and index server 204 need determine to have the equipment of described file according to the content signature, then upload server 203 also is used for according to default algorithm the content-data of described file being calculated the content signature that the back obtains described file.Index server 204 is used for determining to have the equipment of described file according to description information of files, and notifies upload server 203 to receive the content-data of the described file of definite equipment transmission.
Present embodiment is that the content-data of preserving file with upload server 203 is that example describes, also can utilize file server (this figure is not shown) to preserve the content-data of file, client 202 is to the content-data of file server upload file, to the descriptor of upload server 203 upload files, dispatch operation with equally loaded by 203 pairs of each file servers of upload server.
Referring to Fig. 4, the client 202 in the present embodiment comprises computing module 401 and interface module 402.
Computing module 401 is used for calculating according to the content-data of default algorithm to file, and obtains the content signature of described file.
Interface module 402 is used for connecting with server 201, and signs to the content-data and the content of server 201 upload files.
Client 202 can also comprise the memory module of the content-data that is used for storage file, and this figure is not shown.
Referring to Fig. 5, the server 201 in the present embodiment comprises interface module 501, processing module 502 and computing module 503.
Interface module 501 is used for connecting with client 202, and receives the content-data and the descriptor of the file that client 202 (and server) uploads.
Processing module 502 is used for determining to have the equipment of described file according to described description information of files, and notifies described interface module to receive the content-data of the described file of definite equipment transmission.
Server 201 also can comprise computing module 503, and computing module 503 is used for according to the content signature of default algorithm to the described file of content-data calculating back acquisition of described file, and the content signature is sent to processing module 502.
Server 201 also can comprise the memory module of the content-data that is used for storage file, and this figure is not shown.
Wherein, can be to processing module 502 further refinements, it comprises searches module 503 or spider module 504.
Search module 503 and be used for, and determine to have the equipment of described file according to the facility information that finds according to the descriptor of described description information of files locating file and the corresponding relation of facility information.Wherein, the corresponding relation of description information of files and facility information can be stored in searches module 503 this locality, also can be stored in the memory module in the server 201.This corresponding relation can be set up by the lookup result of spider module 504, perhaps receives and directly acquisition by interface module 501.
Spider module 504 is used for the file of the equipment in the communication network of searching according to described description information of files, and determines to have the equipment of described file.
Because the server 201 in the present embodiment is the general references to server, so interface module 501, computing module 503 and memory module can be positioned at upload server 203, processing module 502 can be positioned at index server 204.Upload server 203 is undertaken by interface module separately with index server 204 alternately.
More than be description, the process of uploading data had gained some understanding by above description to system and device, below the main method of uploading data of introducing, referring to shown in Figure 6, the main method flow process is as follows:
Step 601: client and server side connect.
Step 602: described user end to server side sends the content-data of uploading described file.
Step 603: server side determines to have the equipment of described file according to described description information of files, and obtains the content-data of described file from the equipment of determining.
Wherein, server side is by the described description information of files of the direct acquisition of uploading of described client; Perhaps, server side obtains described description information of files according to the content-data of described file.Described client can upload file in the process that connects with server side descriptor.Described client also can be in the descriptor of upload file when server side sends the content-data of uploading described file.
At the upload server 203 and the index server 204 of server side, the method for uploading data is described in detail below, the scene of the content of client upload file signature particularly, referring to shown in Figure 7, realization flow is as follows:
Step 701: client 202 connects by the mode and the upload server 203 of interacting message.
Step 702: the initialization upload procedure, promptly client 202 mainly is the content signature of upload file to the descriptor of upload server 203 upload files.
Step 703: client 202 is to the content-data of upload server 203 upload files.
Step 704: upload server 203 sends to index server 204 with the content signature of file.
Step 705: index server 204 is according to the corresponding relation of the content of described description information of files locating file signature with facility information, and determines to have the equipment of described file by the facility information that finds.Wherein, facility information comprises Internet protocol (the Internet Protocol of device name, equipment, IP) address and unified resource location (the Uniform Resource Locator corresponding with the address of device storage file, URL) address etc., the content signature of a file is as follows with the example of the corresponding relation of facility information:
Table 1
Filename The content signature Facility information
File 1 4DA01BCC8AAD66 IP address 1
File 2 4DA01BCC8AAD66 IP address 2
File 3 57CBA3CD22A099 IP address 2
File 4 3B77CCA6AB44BD URL address 1
…… …… ……
Step 706: index server 204 sends to upload server 203 with the facility information that finds.
Step 707: upload server 203 connects according to facility information and the corresponding apparatus received, and sends the message of request file in download.
Step 708: upload server 203 receives the content-data of the file of the equipment transmission that is connected to.
In step 707 and 708, upload server 203 is directly visited corresponding apparatus by upload server 203 after connecting with corresponding apparatus, duplicates the content-data of the file that needs and passes this locality back.
Wherein, step 703 is relatively independent process with step 704-708, does not have strict execution sequence.
Referring to Fig. 8, the method flow of uploading data when calculating the content signature by server side is as follows:
Step 801: client 202 connects by the mode and the upload server 203 of interacting message.
Step 802: client 202 is to the content-data of upload server 203 upload files, the content-data of each 50K before, during and after the especially preferential upload file.
Step 803: 203 pairs of upload servers receive before, during and after the content-data of each 50K, obtain the content signature of this document according to default algorithm computation.
Step 804: upload server 203 sends to index server 204 with the content signature of file.
Step 805: index server 204 is according to the corresponding relation of the content of described description information of files locating file signature with facility information, and determines to have the equipment of described file by the facility information that finds.
Step 806: index server 204 sends to upload server 203 with the facility information that finds.
Step 807: upload server 203 sends a request message to corresponding apparatus according to the facility information of receiving, and connects.
Step 808: upload server 203 receives the content-data of the file of the equipment transmission that is connected to.
Each memory module in the embodiment of the invention can be storage mediums such as floppy disk, hard disk, tape and flash memory, is used to realize that the software of the embodiment of the invention can be stored in storage mediums such as floppy disk, hard disk, tape and flash memory.
The embodiment of the invention is by providing a plurality of data sources in uploading the process of data, make the recipient receive data from a plurality of data sources, no longer be uploading of single equipment, do not need to be subjected to single equipment to upload the influence of the restriction of bandwidth, improved the efficient of uploading data.And the embodiment of the invention has been done careful division to the equipment of server side, is convenient to the distributed setting and the management of system configuration, helps the flexible foundation of system and is applicable to the various distribution situations of equipment.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (18)

1. a method of uploading data is characterized in that, may further comprise the steps:
Client and server side connect;
Described user end to server side sends the content-data of uploading described file;
Server side determines to have the equipment of described file according to described description information of files, and obtains the content-data of described file from the equipment of determining.
2. the method for uploading data as claimed in claim 1 is characterized in that, server side is by the described description information of files of the direct acquisition of uploading of described client; Perhaps, server side obtains described description information of files according to the content-data of described file.
3. the method for uploading data as claimed in claim 2 is characterized in that, the step of the descriptor of described user end to server side upload file and described user end to server side send the step of the content-data of uploading described file and carry out synchronously.
4. the method for uploading data as claimed in claim 2 is characterized in that, described description information of files comprises the content signature of filename and/or file.
5. the method for uploading data as claimed in claim 4 is characterized in that, the content of described file signature is according to default algorithm the content-data of file to be calculated the back to obtain.
6. the method for uploading data as claimed in claim 1 is characterized in that, the step that server side determines to have the equipment of described file according to described description information of files comprises:
Server side is according to the descriptor of described description information of files locating file and the corresponding relation of facility information, and determines to have the equipment of described file according to the facility information that finds; Perhaps
Server side is searched the file in the equipment in the communication network according to described description information of files, and determines to have the equipment of described file.
7. the method for uploading data as claimed in claim 1 is characterized in that, described definite equipment comprises client and/or server.
8. a client is characterized in that, comprising:
Computing module is used for calculating according to the content-data of default algorithm to file, and obtains the content signature of described file;
Interface module is used for connecting with server, and uploads the content-data and the content signature of described file to server.
9. a server is characterized in that, comprising:
Interface module is used for connecting with client, and receives the content-data of the file of client upload;
Processing module is used for determining to have the equipment of described file according to described description information of files, and notifies described interface module to obtain the content-data of described file from the equipment of determining.
10. server as claimed in claim 9 is characterized in that, described description information of files is that described interface module obtains from described client; Perhaps, described description information of files is that the computing module that described server comprises obtains according to the content-data calculating back of default algorithm to described file.
11. a system is characterized in that, comprising:
Client is used for connecting with server, and to the content-data of server upload file;
Described server is used to receive the content-data of described file, and determines to have the equipment of described file and the content-data that obtains described file from the equipment of determining according to described description information of files.
12. system as claimed in claim 11 is characterized in that, described server is a plurality of; A plurality of servers comprise:
Upload server is used for connecting with described client, and receives and preserve the content-data of the described file of described client upload;
Index server is used for determining to have the equipment of described file according to described description information of files, and notifies described upload server to receive the content-data of the described file of definite equipment transmission.
13. system as claimed in claim 12 is characterized in that, to be described upload server directly be transmitted to described index server with the described description information of files of described client upload to described description information of files; Perhaps, described description information of files is to send to described index server after the content-data calculating of the default algorithm of described upload server basis to described file.
14. system as claimed in claim 12 is characterized in that, described index server comprises:
Interface module is used for obtaining described description information of files from described upload server;
Processing module is used for determining to have the equipment of described file according to described description information of files, and notifies described interface module that the equipment of determining is informed described upload server.
15. system as claimed in claim 14 is characterized in that, described processing module comprises:
Search module, be used for, and determine to have the equipment of described file according to the facility information that finds according to the descriptor of described description information of files locating file and the corresponding relation of facility information;
Perhaps
Spider module is used for the file of the equipment in the communication network of searching according to described description information of files, and determines to have the equipment of described file.
16. system as claimed in claim 11 is characterized in that, described description information of files comprises the content signature of filename and/or file.
17. system as claimed in claim 16, it is characterized in that, when the content of the described file of described client upload signature, described client comprises computing module, and this computing module is used for according to default algorithm the content-data of described file being calculated and obtain the content signature.
18. system as claimed in claim 11 is characterized in that, described definite equipment comprises client and/or server.
CNA2007101628412A 2007-10-15 2007-10-15 A method and system for data upload Pending CN101150593A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2007101628412A CN101150593A (en) 2007-10-15 2007-10-15 A method and system for data upload

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2007101628412A CN101150593A (en) 2007-10-15 2007-10-15 A method and system for data upload

Publications (1)

Publication Number Publication Date
CN101150593A true CN101150593A (en) 2008-03-26

Family

ID=39250930

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007101628412A Pending CN101150593A (en) 2007-10-15 2007-10-15 A method and system for data upload

Country Status (1)

Country Link
CN (1) CN101150593A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101895536A (en) * 2010-06-30 2010-11-24 北京新媒传信科技有限公司 Multimedia information sharing method
CN101924785A (en) * 2010-04-28 2010-12-22 华为技术有限公司 Data uploading and downloading methods and system
CN102118451A (en) * 2011-03-28 2011-07-06 宇龙计算机通信科技(深圳)有限公司 Method and device for handling uploaded user resources
CN103401933A (en) * 2013-08-05 2013-11-20 天闻数媒科技(湖南)有限公司 Method and system for batch uploading resource information and corresponding resource file
CN103581242A (en) * 2012-07-27 2014-02-12 腾讯科技(深圳)有限公司 Method, client-side equipment, server and system for uploading files
CN103812915A (en) * 2012-11-15 2014-05-21 中兴通讯股份有限公司 Resource sharing method, device and system, terminal and resource management center
CN104156376A (en) * 2013-05-15 2014-11-19 腾讯科技(深圳)有限公司 Storage method, device and server for file
CN105743966A (en) * 2015-12-28 2016-07-06 哈尔滨安天科技股份有限公司 File block multi-point uploading method and system
CN108494838A (en) * 2018-03-12 2018-09-04 百途新媒体技术(北京)有限公司 A kind of matchmaker's money docking system based on IPTV high loads, Auto-matching

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101924785A (en) * 2010-04-28 2010-12-22 华为技术有限公司 Data uploading and downloading methods and system
WO2011134410A1 (en) * 2010-04-28 2011-11-03 华为技术有限公司 Method for uploading data, method for downloading data, and data system
CN101895536A (en) * 2010-06-30 2010-11-24 北京新媒传信科技有限公司 Multimedia information sharing method
CN102118451B (en) * 2011-03-28 2013-12-11 宇龙计算机通信科技(深圳)有限公司 Method and device for handling uploaded user resources
CN102118451A (en) * 2011-03-28 2011-07-06 宇龙计算机通信科技(深圳)有限公司 Method and device for handling uploaded user resources
CN103581242A (en) * 2012-07-27 2014-02-12 腾讯科技(深圳)有限公司 Method, client-side equipment, server and system for uploading files
CN103581242B (en) * 2012-07-27 2018-06-15 腾讯科技(深圳)有限公司 Method, client device, server and the system of upper transmitting file
CN103812915A (en) * 2012-11-15 2014-05-21 中兴通讯股份有限公司 Resource sharing method, device and system, terminal and resource management center
WO2014075478A1 (en) * 2012-11-15 2014-05-22 中兴通讯股份有限公司 Resource sharing method, apparatus, system, and terminal, and resource management center
CN104156376A (en) * 2013-05-15 2014-11-19 腾讯科技(深圳)有限公司 Storage method, device and server for file
CN104156376B (en) * 2013-05-15 2019-03-26 腾讯科技(深圳)有限公司 A kind of storage method of file, device and server
CN103401933A (en) * 2013-08-05 2013-11-20 天闻数媒科技(湖南)有限公司 Method and system for batch uploading resource information and corresponding resource file
CN105743966A (en) * 2015-12-28 2016-07-06 哈尔滨安天科技股份有限公司 File block multi-point uploading method and system
CN108494838A (en) * 2018-03-12 2018-09-04 百途新媒体技术(北京)有限公司 A kind of matchmaker's money docking system based on IPTV high loads, Auto-matching

Similar Documents

Publication Publication Date Title
CN101150593A (en) A method and system for data upload
CN107819828B (en) Data transmission method and device, computer equipment and storage medium
US11194719B2 (en) Cache optimization
US10681127B2 (en) File upload method and system
US9390200B2 (en) Local caching device, system and method for providing content caching service
US9277006B2 (en) Peer-to-peer communication of non-common data
EP2091202A1 (en) Data distributing method, data distributing system and correlative devices in edge network
US10367871B2 (en) System and method for all-in-one content stream in content-centric networks
WO2015117570A1 (en) Network acceleration method, apparatus and device based on router device
CN102546836A (en) Method, terminal, server and system for uploading files
CN103455439B (en) Local cache device and for providing the system and method for content caching service
US9467492B2 (en) System and method for reconstructable all-in-one content stream
US10237075B2 (en) Reconstructable content objects
CN102708192A (en) Method, system and device for sharing documents
WO2019242359A1 (en) File processing method and device
CN110572422A (en) Data downloading method and device
CN109214855B (en) Material receiving method, device and system
CN103297447A (en) Resource sharing method and resource sharing equipment
EP2966834A1 (en) System and method for parallel secure content bootstrapping in content-centric networks
US8924439B2 (en) System for and method of partial file hashing
CN102316139A (en) Peer-to-peer (P2P) content resource distribution system and content resource processing method
CN104283955A (en) Browser, server, downloading system and downloading method
CN101146130B (en) A method and system for transmitting data between clients
WO2019196225A1 (en) Resource file feedback method and apparatus
CN113312355A (en) Data management method and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20080326