CN108810111A - Method, client and the system of downloading data - Google Patents
Method, client and the system of downloading data Download PDFInfo
- Publication number
- CN108810111A CN108810111A CN201810518014.0A CN201810518014A CN108810111A CN 108810111 A CN108810111 A CN 108810111A CN 201810518014 A CN201810518014 A CN 201810518014A CN 108810111 A CN108810111 A CN 108810111A
- Authority
- CN
- China
- Prior art keywords
- server
- resource
- client
- file
- downloaded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Abstract
The present invention provides a kind of method of downloading data, including:Client downloads file fragmentation to be downloaded from resource downloading server and peer client respectively;The client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, is verified to the file fragmentation completed of downloading;If verifying out the file fragmentation for downloading completion and the file fragmentation to be downloaded being inconsistent, the file verification information, the download resource url list of the corresponding resource downloading server of the file fragmentation to be downloaded and IP address are then reported to statistical server, or the identity of the peer client is reported to the statistical server.
Description
The application is application number 201310293521.6, and the applying date is:It is on 07 12nd, 2013, entitled:It downloads
The method of data, the divisional application of client and system.
Technical field
The present invention relates to a kind of computer communication technology field more particularly to method of downloading data, client and systems.
Background technology
P2SP (Peer to Server and Peer, point to server and point), is a kind of multi-source content ways of distribution,
Because peer client (peer) in third-party server and P2P (Peer to Peer, point-to-point) network can be utilized simultaneously
Source, to greatly improving the performance of download, therefore have been widely used.In P2SP, due to downloading data source
In multiple and different point such as third-party server and peer client logarithm is needed in order to ensure the correctness of downloading data
It is verified according to fragment.
However, being mainly at present CDN (Content as the third-party server in source in content distribution field
Delivery Network, content distributing network) (Internet Service Provider are interconnected cache server with ISP
Net service provider) cache server.Although CDN can substantially accelerate content to the distribution efficiency of client, the middle parts CDN
Multiple points are affixed one's name to, sometimes due to internal cause, it may appear that the nonsynchronous phenomenon of multiple spot downloading data so that the number of client downloads
It according to always there is some to be wrong in fragment, can not pass through so as to cause terminal check, waste a large amount of download resource and bandwidth number
According to.And small ISP rents the link of main ISP by then passing through, and then provides some distinctive services to develop the width of oneself
Band user, in order to solve the inter-network settling problems of great number, small ISP would generally cache part hot spot by modes such as Domain Hijackings
Content uses on the outlets the ISP cache server of oneself for accelerating to download, due to the abduction of domain name link, if ISP is cached
The downloading data update stored in server not in time, then can cause client downloads to the data fragmentation of mistake, final same
Also resulting in verification can not pass through, and waste a large amount of download resource and band data.Therefore, how to ensure the correct of downloading data
Property, the success rate for effectively improving data download is that industry is currently badly in need of a great problem to be solved.
Invention content
In view of this, the present invention provides a kind of method of downloading data, client and system, data download can be effectively improved
Success rate.
A kind of method of downloading data, including:Client is used as entrance to the inquiry of resource index server by original URL
The download resource url list of resource downloading server, the IP address of spare true source server and to tracking server inquire
Peer client list;Download resource url list and peer client list of the client according to the resource downloading server,
File fragmentation to be downloaded is downloaded from the resource downloading server and the peer client;Client is according to by the money
The file verification information obtained on the index server of source is verified to downloading the file fragmentation completed;If verify out it is described under
Carry the file fragmentation completed and the file fragmentation to be downloaded be inconsistent, then client according to the IP address to described spare
File fragmentation identical with the file fragmentation to be downloaded is downloaded in true source server request.
A kind of method of downloading data, including:Client is downloaded from resource downloading server and peer client respectively
File fragmentation to be downloaded;The client inquires the file of the current file fragmentation downloaded and completed from resource index server
Check information verifies the file fragmentation completed of downloading;If verifying out the file fragmentation for downloading completion and institute
State that file fragmentation to be downloaded is inconsistent, then by the file verification information, the corresponding resource of the file fragmentation to be downloaded
The download resource url list and IP address of download server are reported to the statistical server, or by the peer client
Identity is reported to the statistical server.
A kind of client, including:Enquiry module is inquired for being used as entrance by original URL to resource index server
The download resource url list of resource downloading server, the IP address of spare true source server and to tracking server inquire
Peer client list;Download module, for the download resource url list and peer client according to the resource downloading server
List is held, file fragmentation to be downloaded is downloaded from the resource downloading server and the peer client;Correction verification module is used
According to the file verification information by being obtained on the resource index server, verified to downloading the file fragmentation completed;
The download module described downloads the file fragmentation completed and the file fragmentation to be downloaded is inconsistent if being additionally operable to verify out
When, text identical with the file fragmentation to be downloaded is downloaded to the spare true source server request according to the IP address
Part fragment.
A kind of client, including:Download module, for being waited for respectively from resource downloading server and peer client download
The file fragmentation of download;Correction verification module, for inquiring the current text for downloading the file fragmentation completed from resource index server
Part check information verifies the file fragmentation completed of downloading;Download module, if being additionally operable to verify out described downloaded
At file fragmentation and the file fragmentation to be downloaded it is inconsistent, then by the file verification information, the text to be downloaded
The download resource url list and IP address of the corresponding resource downloading server of part fragment are reported to the statistical server, or will
The identity of the peer client is reported to the statistical server.
A kind of system of downloading data, including:Client, resource index server, resource downloading server, follow-up service
Device, spare true source server and peer client.Wherein, the client, for being used as entrance to institute by original URL
State the download resource url list of resource index server query resource download server, the IP address of spare true source server,
And inquire peer client list to tracking server, according to the download resource url list of the resource downloading server and
Peer client list downloads file fragmentation to be downloaded, root from the resource downloading server and the peer client
According to the file verification information by being obtained on the resource index server, verified to downloading the file fragmentation completed, if school
It tests out the file fragmentation for downloading completion and the file fragmentation to be downloaded is inconsistent, then taken according to the spare real source
The IP address of business device downloads file point identical with the file fragmentation to be downloaded to the spare true source server request
Piece.The resource index server, for the inquiry request according to the client, by the download of the resource downloading server
Resource url list, the spare true source server IP address be sent to the client.The tracking server, is used for
According to the inquiry request of the client, peer client list is sent to the client, receives the note of peer client
The peer client list is added in the peer client of new registration by volume.The resource downloading server, peer client with
And the spare true source server sends out the file fragmentation of the client request for the request according to the client
Give the client.
A kind of system of downloading data, including:Client, resource index server, statistical server, resource downloading service
Device and peer client;The wherein described client, for being waited for respectively from resource downloading server and peer client download
The file fragmentation of download inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, right
It is described download complete file fragmentation verified, and when verify out it is described download complete file fragmentation with it is described to be downloaded
When file fragmentation is inconsistent, by the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded
Download resource url list and IP address be reported to the statistical server, or will be in the identity of the peer client
Offer the statistical server;The resource index server waits for down for the inquiry request according to the client by described
The check information of the file fragmentation of load is sent to the client;The statistical server, for receiving the client in school
Test out it is described download file fragmentation and the file fragmentation to be downloaded completed it is inconsistent when, the check information that reports,
The download resource url list and IP address or peer client of the corresponding resource downloading server of the file fragmentation to be downloaded
The identity at end;The resource downloading server and peer client will be described for the request according to the client
The file fragmentation of client request is sent to the client.
In the method, apparatus and system of above-mentioned downloading data, by client in the file for verifying out download completion
When fragment and file fragmentation to be downloaded are inconsistent, according to the IP address of spare true source server to spare true source server
File fragmentation identical with file fragmentation to be downloaded is downloaded in request, since the data in spare true source server are by original fortune
It seeks resource publisher actively to construct, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to have
Effect improves the success rate that data are downloaded.
For the above and other objects, features and advantages of the present invention can be clearer and more comprehensible, preferred embodiment cited below particularly,
And coordinate institute's accompanying drawings, it is described in detail below.
Description of the drawings
Fig. 1 is the applied environment figure of the method for the downloading data that first embodiment of the invention provides.
Fig. 2 is the flow chart of the method for the downloading data that first embodiment of the invention provides.
Fig. 3 is the applied environment figure of the method for the downloading data that second embodiment of the invention is provided with 3rd embodiment.
Fig. 4 is the flow chart of the method for the downloading data that second embodiment of the invention provides.
Fig. 5 is the flow chart of the method for the downloading data that fourth embodiment of the invention provides.
Fig. 6 is the flow chart of the method for the downloading data that fifth embodiment of the invention provides.
Fig. 7 is the structural schematic diagram for the client that sixth embodiment of the invention provides.
Fig. 8 is the structural schematic diagram for the client that seventh embodiment of the invention provides.
Fig. 9 is the structural schematic diagram for the client that eighth embodiment of the invention provides.
Figure 10 is the structural schematic diagram for the client that ninth embodiment of the invention provides.
Figure 11 is the schematic diagram of the system for the downloading data that twelveth embodiment of the invention provides.
Specific implementation mode
Further to illustrate that the present invention is the technological means and effect realized predetermined goal of the invention and taken, below in conjunction with
Specific implementation mode, structure, feature and its effect according to the present invention is described in detail as after in attached drawing and preferred embodiment.
First embodiment
Referring to Fig. 1, showing the applied environment figure of the method for the downloading data of first embodiment of the invention offer.Such as figure
Shown in 1, client 101 is located at wirelessly or non-wirelessly in network, by this wirelessly or non-wirelessly network and resource downloading server 102,
Spare true source server 103, the 106 phase intercommunication of resource index server 104, tracking server 105 and peer client
Letter, and data downloading system 10 is constituted together.
It should be understood that above-mentioned client 101, resource downloading server 102, spare true source server 103, resource rope
Each device drawn in server 104, tracking server 105 and peer client 106 is not necessarily referring to single individual,
Can be multiple groups of individuals, such as:Resource downloading server 102 can be single resource downloading server, can also be
The resource downloading server group being made of multiple resource downloading servers.
Referring to Fig. 2, showing the flow chart of the method for the downloading data of first embodiment of the invention offer.Such as Fig. 2 institutes
Show, which describes the process flow of client, and in conjunction with Fig. 1, the method for downloading data provided in this embodiment includes
Following steps:
Step S21, client are used as entrance to resource index server query resource download server by original URL
It downloads resource url list, the IP address of spare true source server and inquires peer client list to tracking server.
In this step, client 101 passes through original URL (Uniform Resource Locator, unified resource positioning
Symbol) the download resource for being stored with the resource downloading server 102 for downloading resource is inquired to resource index server 104 as entrance
Url list, spare true source server 103 (Internet Protocol, the procotol) addresses IP and to tracking take
Business device 105 inquires peer client list.Resource index server 104 is according to the inquiry request of client 101, by resource downloading
The download resource url list of server and the file verification information for downloading resource are sent to client 101.Tracking server 105
According to the inquiry request of client 101, peer client list is sent to client 101.
Step S22, download resource url list and peer client list of the client according to resource downloading server, from
Resource downloading server and peer client download file fragmentation to be downloaded.
In this step, client 101 is according to the download resource url list and equity of the resource downloading server inquired
Client side list downloads file fragmentation to be downloaded from resource downloading server 102 and peer client 106 respectively.Resource
The file fragmentation that client 101 is asked is sent to client 101 by download server 102 and peer client 106 respectively.
Specifically, multiple file fragmentations can be divided by downloading resource, client 101 according to preset download policy,
File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, and all to be downloaded respectively
After the completion of file fragmentation is downloaded, it is reduced to all file fragmentation combinations to download resource.
Step S23, client is according to the file verification information by being obtained on resource index server, to downloading the text completed
Part fragment is verified.
In this step, client 101 is according to the file verification information by being obtained on resource index server 104, under
The file fragmentation completed is carried to be verified.
File verification information includes the cryptographic Hash (Hash) of the URL for each file fragmentation for downloading resource, specifically, example
Such as:SHA1 (the Secure Hash Algorithm) values or MD5 (Message Digest, message of the URL of each file fragmentation
Digest algorithm the 5th edition) value.
Client 101 using the file verification information obtained from resource index server 104 as unique believable information,
As soon as often completing the download of a file fragmentation, judged by check information.
Step S24, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, client root
It is identical with file fragmentation to be downloaded to spare true source server request download according to the IP address of spare true source server
File fragmentation.
In this step, if client 101 goes out to download the file fragmentation completed according to file verification information checking and waits for down
The file fragmentation of load is inconsistent, then client 101 can be according to the IP address of spare true source server 103 to spare real source
File fragmentation identical with file fragmentation to be downloaded is downloaded in the request of server 103.Spare true source server 103 is according to client
The request at end 101, client 101 is sent to by the file fragmentation that client 101 is asked.
That is, only when verifying out the file fragmentation and inconsistent file fragmentation to be downloaded of download completion, visitor
Family end 101 can just ask to download file fragmentation identical with file fragmentation to be downloaded to spare true source server 103.Namely
In the case where the file fragmentation to be downloaded on being stored in resource downloading server 102 and peer client 106 is without mistake,
Client 101 will not send to spare true source server 103 and download request, can ensure spare true source server in this way
103 stability will not cause to overload, cause the collapse of spare true source server 103 because visit capacity is too big.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator
Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry
The success rate that high data are downloaded.
Second embodiment
Referring to Fig. 3, showing the applied environment figure of the method for the downloading data of second embodiment of the invention offer.Such as figure
Shown in 3, unlike Fig. 1, in addition to resource downloading server 102, spare true source server 103, resource index server
104, except tracking server 105 and peer client 106, client 101 also enters with resource publisher server 201, resource
Library server 202, statistical server 203, resource index database 204, download authentication server 205 constitute data download together
System 20.
Above-mentioned client 101, resource downloading server 102, spare true source server 103, resource index server
104, tracking server 105, peer client 106, resource publisher server 201, goods receiving server 202, statistical fractals
Each device in device 203, resource index database 204 and download authentication server 205 is not necessarily referring to single individual,
Can also be multiple groups of individuals, such as:Resource downloading server 102 can be single resource downloading server, can also
It is the resource downloading server group being made of multiple resource downloading servers.
Referring to Fig. 4, showing the flow chart of the method for the downloading data of second embodiment of the invention offer.Such as Fig. 4 institutes
Show, which describes the process flow of client, and in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes
Following steps:
Step S401, client are used as entrance to resource index server query resource download server by original URL
Download resource url list, spare true source server IP address and to tracking server inquiry peer client row
Table.
It is multiple file fragmentations that resource publisher server 201 will download division of resources first, in accordance with default segmentation strategy, so
Resource will be downloaded afterwards and is published to resource downloading server 102 and spare true source server 103, and will be downloaded after the completion of publication
Under the original URL (Uniform Resource Locator, uniform resource locator) of resource, resource downloading server 102
Carry resource url list, IP (Internet Protocol, procotol) address of spare true source server 103 is sent to money
Source is put in storage server 202.
Exist comprising the multiple file fragmentations for downloading resource in the download resource url list of above-mentioned resource downloading server 102
URL in different resource download server.Resource downloading server 102 may include ISP (Internet Service
Provider, Internet Service Provider) cache server and CDN (Content Delivery Network, content delivery network
Network) cache server.Due to CDN cache server ratio ISP cache server error rates are lower, service quality and safety more
It is high, it is preferable that resource publisher server 201 is published to CDN cache servers by resource is downloaded.
The download for the resource downloading server 102 that goods receiving server 202 is sent according to resource publisher server 201 provides
Origin url list calculates the cryptographic Hash of the URL of each file fragmentation, and by the cryptographic Hash of the URL of calculated each file fragmentation,
The cryptographic Hash of the URL of each file fragmentation and the mapping relations of the URL of each file fragmentation, the original URL for downloading resource, resource
The download resource url list of download server 102, the IP address of spare true source server 103 are stored in resource index data
Library 204 directly covers the relative recording if having there is relative recording in resource index database 204.
In this step, original URL can be downloaded from resource downloading website by client 101 and be obtained.Client 101 is logical first
It crosses original URL and sends inquiry request to resource index server 104 as entrance, resource index server 104 is according to the inquiry
Request inquires whether local cache has respective record first, if there is then directly reading resource downloading server from local cache
102 download resource url list, the IP address of spare true source server 103 and file verification information are simultaneously sent to client
End 101;If there is no respective record in local cache, inquiry request is sent to resource index database 204, then will be passed through
The download resource url list for the resource downloading server 102 that the inquiry of resource index database 204 obtains, spare real source service
The IP address and file verification information of device 103 are sent to client 101.
Client 101 sends inquiry request to tracking server 105, and tracking server 105, will be right according to the inquiry request
Etc. client side lists be sent to client 101.Peer client list is generated by tracking server 105, wherein may include storing
There are the information such as the download resource that possesses of IP address, peer client 106 for the peer client 106 for downloading resource.Follow-up service
According to the registration request of client 101 peer client list is added in the client 101 of new registration by device 105.And according to client
The resource information that the online situation and client 101 for the client 101 that end 101 periodically reports possess, update peer client row
Table.
Step S402, download resource url list and peer client list of the client according to resource downloading server, from
Resource downloading server and peer client download file fragmentation to be downloaded.
This step can refer to the corresponding steps in first embodiment, and which is not described herein again.
Step S403, client inquire the file verification letter of the current file fragmentation downloaded and completed from resource index server
Breath.
In this step, client 101 inquires the text of the current file fragmentation downloaded and completed from resource index server 104
Part check information.If client 101 does not inquire the text of the current file fragmentation downloaded and completed on resource index server 104
Part check information, thens follow the steps S404:According to presetting rule, the file corresponding to the current file fragmentation downloaded and completed is generated
Check information.
Specifically, client 101 does not inquire the current file downloaded and completed from resource index server 104 for the first time
The file verification information of fragment will then download the file fragmentation completed and be considered as new file, according to the file fragmentation for downloading completion
URL calculates the file verification information for generating the file fragmentation that the download is completed, such as:Cryptographic Hash.
Step S405:By the file verification information of generation and the current identification-information reporting for downloading the file fragmentation completed
Goods receiving server is given, so that the file that goods receiving server completes the file verification information of generation and current download
Resource index database is written in the identification information of fragment.
Specifically, goods receiving server 202 receives the file verification information and currently downloaded that client 101 reports
At file fragmentation identification information, first to resource index database 204 inquiry whether have corresponding information, if can not inquire
Corresponding information, then the file verification information directly reported client 101 and the current mark for downloading the file fragmentation completed
Resource index database 204 is written in information, if there is corresponding information, check relevant field (such as:File size, Hash marks)
Whether content is consistent, if inconsistent, calls legitimacy, the validity for downloading the verification storage data of authentication server 205, and root
According to verification result, the text of the current file fragmentation for downloading completion reported with client 101 in update resource index database 204
The part check information information corresponding with identification information.Wherein, authentication server 205 is downloaded to be sent to for verifying client 101
The storage data of goods receiving server 202.
If inquiring the file verification information of the current file fragmentation downloaded and completed, S406 is thened follow the steps:According to by providing
The file verification information obtained on source index server 104 is verified to downloading the file fragmentation completed.
If the file fragmentation and the file fragmentation to be downloaded that verify out download completion are inconsistent, S407 is thened follow the steps:Visitor
Fragment to be downloaded is downloaded by original URL in family end 101.
Step S408 provides the download of file verification information, the corresponding resource downloading server of file fragmentation to be downloaded
The IP address of origin url list and corresponding resource downloading server is reported to statistical server, or by the identity of peer client
Mark is reported to statistical server.
Specifically, if downloading the file fragmentation completed is downloaded from resource downloading server 102, client 101 will
The download resource url list of the corresponding resource downloading server of file verification information, file fragmentation to be downloaded 102 and corresponding
The IP address of resource downloading server 102 is reported to statistical server 203;If it is from peer client to download the file fragmentation completed
What end 106 was downloaded, then client 101 is by the body of the corresponding peer client of file verification information, file fragmentation to be downloaded 106
Part mark is reported to statistical server 203.
The above- mentioned information that client 101 reports is reported to goods receiving server 202 by statistical server 203, and resource enters
The above- mentioned information that library server 202 is reported according to statistical server 203 updates the data in resource index database 204, example
Such as:Remove the download resource URL that check results are the corresponding resource downloading server of inconsistent file fragmentation to be downloaded 102
List.
If inconsistent by the original URL file fragmentations downloaded and file fragmentation to be downloaded, S409 is thened follow the steps:To
File fragmentation identical with file fragmentation to be downloaded is downloaded in spare true source server request.
This step can refer to the corresponding contents of first embodiment, and details are not described herein.
Step S410, when file fragmentation identical with file fragmentation to be downloaded download complete, by with file to be downloaded
The download information of the identical file fragmentation of fragment is reported to statistical server.
Specifically, after the completion of file fragmentation identical with file fragmentation to be downloaded is downloaded, client 101 will be to be downloaded
The identical file fragmentation of file fragmentation download information, including:Download used time, speed of download, download result, file fragmentation are big
Small and security attribute information etc. is reported to statistical server 203.
Statistical server 203 stores the download information of the transmission of client 101 in a manner of flowing water daily record, for subsequent statistical
Analysis.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator
Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry
The success rate that high data are downloaded.
3rd embodiment
Fig. 3 is refer again to, the application environment in Fig. 3 is equally applicable to the present embodiment.The place of the system of the present embodiment description
Flow is managed, the method for downloading data provided in this embodiment includes the following steps:
Step S501, resource publisher server 201 will download resource be published to resource downloading server 102 with it is spare true
Source server 103.
Resource downloading server 102 may include that (Internet Service Provider, Internet service provide ISP
Quotient) cache server and CDN (Content Delivery Network, content distributing network) cache server.
Step S502, resource publisher server 201 will download the download of the original URL, resource downloading server 102 of resource
The IP address of resource url list and spare true source server 103 is sent to goods receiving server 202.
Step S503, goods receiving server 202 calculate the file verification information for downloading resource, will download the original of resource
URL, the download resource url list of resource downloading server 102, the IP address of spare true source server 103 and download money
The file verification information in source is sent to resource index database 204, so that resource index database 204 stores above- mentioned information.
It is divided into multiple file fragmentations due to downloading resource, it is possible to understand that, the download money of resource downloading server 102
Include the URL for the multiple file fragmentations for downloading resource in origin url list.
Specifically, the resource downloading server that goods receiving server 202 is sent according to resource publisher server 201 first
102 download resource url list, using Predistribution Algorithm (such as:Hash algorithm) it is each file fragmentation calculating for downloading resource
Hash (cryptographic Hash), then by the Hash of calculated each file fragmentation, the URL of each file fragmentation, each file fragmentation
The mapping relations of URL of Hash and each file fragmentation, the IP address of spare true source server 103 and be used to indicate by
The Hash of each file fragmentation is sent to resource index database labeled as the mark instructions of the check information of proactive dissemination resource
204.Resource index database 204 receives and stores above- mentioned information, and is marked the Hash of each file fragmentation according to mark instructions
It is denoted as the check information of proactive dissemination resource, to become unique credible check information.
It should be understood that resource index database 204 can be a module in goods receiving server 202, also may be used
To be an individual server in network.
Step S504, client 101 are used as entrance by original URL and send inquiry request to resource index server 104,
The download resource url list of requesting query resource downloading server 102, the IP address of spare true source server 103, and pass through
Original URL sends inquiry request, requesting query peer client list as entrance to tracking server 105.
Step S505, the inquiry request that resource index server 104 is sent according to client 101, resource downloading is serviced
The download resource url list of device 102, the IP address of spare true source server 103 feed back to client 101.
Step S506, the inquiry request that tracking server 105 is sent according to client 101 are anti-by peer client list
Client of feeding 101.
Step S507, client 101 take according to the download resource url list of resource downloading server 102 from resource downloading
Business device 102 downloads file fragmentation to be downloaded, and text to be downloaded is downloaded from peer client 106 according to peer client list
Part fragment.
Step S508, client 101 are sent out when having monitored that file fragmentation downloads completion to resource index server 104
Inquiry request is sent, the file verification information of the current file fragmentation downloaded and completed is inquired.
It should be understood that it includes currently to have downloaded that client 101, which is sent in the inquiry request of resource index server 104,
At file fragmentation URL, resource index server 104 is corresponding with the current file fragmentation for downloading completion according to URL inquiries
Hash.
Step S509, resource index server 104 is according to the inquiry request of client 101, to resource index database 204
Inquire file verification information corresponding with the file fragmentation that currently download is completed of client 101.
Resource index server 104 is in the corresponding file verification information of the file fragmentation that inquires with currently download completion
When, execute step S510:File verification information corresponding with the file fragmentation that currently download is completed of client 101 is fed back into visitor
Family end 101.
Client 101 receive it is that resource index server 104 feeds back with the current file fragmentation downloaded and completed
When corresponding file verification information, step S511 is executed:The file verification information checking sent according to resource index server 104
It is current to download the file fragmentation completed.
Client 101 is held when check results are to download the file fragmentation completed and inconsistent file fragmentation to be downloaded
Row step S512:File fragmentation to be downloaded is downloaded by original URL, while the file verification of file fragmentation to be downloaded being believed
Breath, the download resource url list of the corresponding resource downloading server of file fragmentation to be downloaded 102 and corresponding resource downloading clothes
The IP address of business device 102 is reported to statistical server 203, or the identity of peer client 106 is reported to statistical fractals
Device 203.
Check results are that the file fragmentation that download is completed and file fragmentation to be downloaded are inconsistent, have illustrated client 101
The source for the file fragmentation to be downloaded downloaded is problematic, thus client 101 by with the file fragmentation to be downloaded downloaded
File verification information, the download resource url list of corresponding resource downloading server 102 and corresponding resource downloading server
The relevant informations such as 102 IP address are reported to statistical server 203.
Step S513, the file verification letter for the file fragmentation to be downloaded that statistical server 203 reports client 101
Breath, the download resource url list of the corresponding resource downloading server of file fragmentation to be downloaded 102 and corresponding resource downloading clothes
The IP address of business device 102 is reported to goods receiving server 202.
Step S514, the information that goods receiving server 202 is reported according to statistical server 203 in step S514, hair
Send the more new command of the information reported in step S513 comprising statistical server 203 to resource index database 204, so that money
Source index data base 204 updates corresponding data.
Update mode may include, such as:Delete the letter reported with client 101 stored in resource index database 204
Cease the download resource url list of the corresponding resource downloading server of related file fragmentation to be downloaded 102.
Step S515, client 101 pass through original according to the file verification Information Authentication obtained from resource index server 104
The file fragmentation that beginning URL downloads, and when the file fragmentation downloaded by original URL and inconsistent file fragmentation to be downloaded,
File fragmentation identical with file fragmentation to be downloaded is downloaded to the request of spare true source server 103.
If all URL include original URL incorrect, spare 103 downloading data of true source server is used at this time,
Since only there are one sources, multi-source is not present, so file can not have to verification at this time, by the number of spare true source server 103
According to correctness ensure final correctness.
The file of the file fragmentation of mistake is carried in the presence of being reported in real time according to client 101 due to statistical server 203
The download resource url list of the corresponding resource downloading server of check information, file fragmentation to be downloaded 102 and corresponding resource
The IP address of download server 102, or by the identity of peer client 106, can determine that ISP multi-sources are downloaded not quickly
It is synchronous, and the reparation for carrying out CDN synchronization distributions can be synchronized, simultaneously because the presence of spare true source server 103, it is ensured that
The current download of normal users.In addition, even if ISP operators have cached the copy of mistake, as long as original publisher passes through resource
Correct file verification information, which is written, in storage server 202 would not influence final download number to resource index database 204
According to correctness.
Step S516, client 101 file fragmentation identical with file fragmentation to be downloaded download complete when, will with wait for
The download information of the identical file fragmentation of file fragmentation of download is reported to statistical server 203.
Download information may include:It downloads the used time, speed of download, download result, file fragmentation size and security attribute information
Deng.Statistical server 203 stores above- mentioned information in a manner of flowing water daily record, for subsequent statistical analysis.
Client 101 is not in receiving that resource index server 104 feeds back and currently downloaded in preset time
At the corresponding file verification information of file fragmentation, or receive be not query result feedback information, then follow the steps
S517:By the identification-information reporting of the current file fragmentation downloaded and completed to goods receiving server 202.
The current identification information for downloading the file fragmentation completed may include the size of this document fragment, URL etc..
Step S518, goods receiving server 202 send check information and report instruction to client 101, indicate client
101 report the file fragmentation check information of the current file fragmentation downloaded and completed.
Step S519, client 101 generate the fragment corresponding to the current file fragmentation downloaded and completed according to presetting rule
File verification information, and the slicing files check information is reported to goods receiving server 202.
Specifically, the use of client 101 Predistribution Algorithm (such as:Hash algorithm) according to the file fragmentation for downloading completion
URL calculates the Hash for generating the file fragmentation that the download is completed.
Step S520, goods receiving server 202 receive the file verification information that client 101 is sent, and to resource rope
Draw database 204 and send inquiry request, whether is stored in query resource index data base 204 and works as with what client 101 reported
The preceding identification information and the corresponding data information of file verification information for downloading the file fragmentation completed.
Query result is fed back to goods receiving server 202 by step S521, resource index database 204.
Goods receiving server 202 is held when not being stored with corresponding information during query result is resource index database 204
Row step S522:The current identification information and file verification information for downloading the file fragmentation completed that client 101 is reported
It is sent to resource index database 204, so that resource index database 204 stores above- mentioned information.
Goods receiving server 202 is executed when being stored with corresponding information during query result is resource index database 204
Step S523:Working as being reported with client 101 included in the query result of 204 feedback of inspection resource index database is front lower
Carry the file fragmentation completed identification information and the information-related relevant field of file verification (such as:File size, Hash marks
Know) content it is whether consistent with the above- mentioned information that client 101 reports.And when inspection result is inconsistent, execute step
S524:It sends verification instruction and gives download authentication server 205.
Step S525 downloads authentication server 205 and is instructed according to the verification that goods receiving server 202 is sent, verification visitor
The legitimacy for the current identification information and file verification information for downloading the file fragmentation completed that family end 101 reports, and will test
Card result feeds back to goods receiving server 202.
Specifically, downloading during authentication server 205 is instructed by the verification that is sent according to goods receiving server 202 and including
The current URL for downloading the file fragmentation completed that reports of client 101 download file fragmentation, calculate what client 101 reported
The field inconsistent with the content in the corresponding informance that is stored in resource index database 204 in information.
Goods receiving server 202, which receives, downloads the verification result that authentication server 205 is sent, and is downloading authentication server
The current identification information for downloading the file fragmentation completed and file school that the verification result of 205 feedbacks is reported with client 101
Test information it is consistent when, execute step S526:The current mark letter for downloading the file fragmentation completed that will be reported comprising client 101
The more new command of breath and file verification information is sent to resource index database 204, so that 204 basis of resource index database
Corresponding information in the information update resource index database 204 that client reports.
Specifically, assuming that the information stored in resource index database 204 is old information, the information that client 101 reports
Old information is not updated if the verification result for downloading authentication server 205 is consistent with old information for information, if downloading verification clothes
The verification result of business device 205 is consistent with new information, then with the old information stored in new information update resource index database 204.
For U2H (URL to Hash mapping tables), a URL has been only possible to a record in resource index database 204, directly updates
The record;For H2U, if the corresponding Hash of URL change, should first by H2U (the map record table of Hash to URL) table with
The corresponding URL record deletions of preceding Hash are fallen, and new record is inserted into;For fragment check information, a Hash only corresponds to one
A record directly updates the record stored in resource index database 204;If downloading the verification knot of authentication server 205
Fruit and new information and old information are all inconsistent, then in the verification result update resource index database 204 for downloading verification return
Corresponding information.
The method of downloading data provided in an embodiment of the present invention downloads the same of resource by resource publisher server in publication
When, a spare real source is constructed in spare true source server, when client is in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, client reports statistics by the corresponding loading source URL of file fragmentation completed is downloaded
Server, and being shielded by goods receiving server, at the same client according to the IP address of spare true source server to
File fragmentation identical with file fragmentation to be downloaded is downloaded in spare true source server request, can get around ISP buffer services
The mistake generated because the original download data issued with resource publisher server are asynchronous stored in device and CDN cache servers
Accidentally data, correct data is downloaded to from spare true source server, so that it is guaranteed that client downloads to file be one consistent
Property version, be not in that a part of data come from new version, the case where a part of data come from legacy version, and then can effectively carry
The success rate that high data are downloaded.
Fourth embodiment
Fig. 5 is the flow chart of the method for the downloading data that fourth embodiment of the invention provides.As shown in figure 5, the embodiment
The report flow for describing client, in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes the following steps:
Step S61, client download file fragmentation to be downloaded from resource downloading server and peer client respectively.
Specifically, multiple file fragmentations can be divided by downloading resource, client 101 according to preset download policy,
File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, and all to be downloaded respectively
After the completion of file fragmentation is downloaded, it is reduced to all file fragmentation combinations to download resource.
Step S62, client inquire the file verification of the current file fragmentation downloaded and completed from resource index server
Information verifies the file fragmentation completed of downloading.
Specifically, client 101 is calculated according to preset create-rule according to the URL of the current file fragmentation downloaded and completed
Then cryptographic Hash carries out calculated cryptographic Hash with the file verification information obtained is inquired from resource index server 104
Compare, judges whether the two is consistent.
Step S63, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, by file school
Test the download resource url list of the corresponding resource downloading server of information, file fragmentation to be downloaded and corresponding resource downloading
The IP address of server is reported to statistical server, or the identity of peer client is reported to statistical server.
Specifically, if downloading the file fragmentation completed is downloaded from resource downloading server 102, client 101 will
The download resource url list of the corresponding resource downloading server of file verification information, file fragmentation to be downloaded 102 and corresponding
The IP address of resource downloading server 102 is reported to statistical server 203;If it is from peer client to download the file fragmentation completed
What end 106 was downloaded, then client 101 is by the body of the corresponding peer client of file verification information, file fragmentation to be downloaded 106
Part mark is reported to statistical server 203.
The above- mentioned information that client 101 reports is reported to goods receiving server 202 by statistical server 203, and resource enters
The above- mentioned information that library server 202 is reported according to statistical server 203 updates the data in resource index database 204, example
Such as:Remove the download resource URL that check results are the corresponding resource downloading server of inconsistent file fragmentation to be downloaded 102
List.Goods receiving server 202 can also send early warning to resource downloading server 102 and resource publisher server 201 simultaneously
Notice, the download resource URL column that notice resource downloading server 102 is repaired and is eliminated as early as possible with resource publisher server 201
The corresponding file fragmentation of table.Resource publisher server 201 can after receiving pre-alert notification, by with the download resource that is eliminated
On the resource downloading server 102 that the corresponding file fragmentation of url list is issued again.Resource downloading server 102 is receiving
After pre-alert notification, file point corresponding with the download resource url list being eliminated can be downloaded from spare true source server 103
Piece, or obtain file fragmentation corresponding with the download resource url list being eliminated from resource publisher server 201.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, by file verification information, file fragmentation to be downloaded source-information via statistics
Server is reported to goods receiving server, and goods receiving server sync updates resource index database data, shields mistake
Download resource URL, so as to effectively prevent other clients from mistake downloads resource URL download to mistake file divide
Piece improves the success rate that data are downloaded.
5th embodiment
Fig. 6 is the flow chart of the method for the downloading data that fifth embodiment of the invention provides.As shown in fig. 6, the embodiment
The report flow for describing client, in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes the following steps:
Step S71, client download file fragmentation to be downloaded from resource downloading server and peer client respectively.
Step S72, client inquire the file verification of the current file fragmentation downloaded and completed from resource index server
Information.
If client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server,
Then step S73:The file fragmentation completed of downloading is verified.
Step S74, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, by file school
Test the download resource url list of the corresponding resource downloading server of information, file fragmentation to be downloaded and corresponding resource downloading
The IP address of server is reported to statistical server, or the identity of peer client is reported to statistical server.
Step S71 can refer to the corresponding steps of fourth embodiment to step S74, repeat no more herein.
If the client does not inquire the text of the current file fragmentation downloaded and completed on the resource index server
Part check information, thens follow the steps S75:According to presetting rule, generate and the text corresponding to the current file fragmentation downloaded and completed
Part check information.
Specifically, if client 101 does not inquire the current file point downloaded and completed from resource index server 104
The file verification information of piece will then download the file fragmentation completed and be considered as new file, according to the URL for downloading the file fragmentation completed
The file verification information for generating the file fragmentation that the download is completed is calculated, such as:Cryptographic Hash.
Step S76, by the file verification information of generation and the current identification information for downloading the file fragmentation completed
It is reported to goods receiving server, so that the goods receiving server is by the file verification information of the generation and described works as
Resource index database is written in the preceding identification information for downloading the file fragmentation completed.
Specifically, goods receiving server 202 receives the file verification information and currently downloaded that client 101 reports
At file fragmentation identification information, first to resource index database 204 inquiry whether have corresponding information, if can not inquire
Corresponding information, then the file verification information directly reported client 101 and the current mark for downloading the file fragmentation completed
Resource index database 204 is written in information, if there is corresponding information, check relevant field (such as:File size, Hash marks)
Whether content is consistent, if inconsistent, calls legitimacy, the validity for downloading the verification storage data of authentication server 205, and root
According to verification result, the text of the current file fragmentation for downloading completion reported with client 101 in update resource index database 204
The part check information information corresponding with identification information.Wherein, authentication server 205 is downloaded to be sent to for verifying client 101
The storage data of goods receiving server 202.
The method of downloading data provided in an embodiment of the present invention is not being looked into from resource index server by client
When asking the file verification information of the current file fragmentation downloaded and completed, the current file downloaded and completed is generated according to presetting rule
The file verification information of fragment is simultaneously reported to goods receiving server, then by the verified rear write-in resource of goods receiving server
Index data base, it can be ensured that the correctness of file check information in resource index database is prevented because of file verification information
Data failed download caused by mistake, and then improve the success rate that data are downloaded.
Sixth embodiment
Fig. 7 is the structural schematic diagram for the client that sixth embodiment of the invention provides.Client provided in this embodiment can
Method for realizing the downloading data in first embodiment.As shown in fig. 7, client 700 includes:Enquiry module 701, under
Carry module 702, correction verification module 703.
Wherein enquiry module 701 is used to be used as entrance by original URL to download to resource index server query resource and take
The downloads resource url list of device, the IP address of spare true source server of being engaged in and to tracking server inquiry peer client
List.
Download module 702 is used to be arranged according to the download resource url list and peer client of the resource downloading server
Table downloads file fragmentation to be downloaded from the resource downloading server and the peer client;If being additionally operable to verify out
When the file fragmentation for downloading completion and the file fragmentation to be downloaded are inconsistent, according to the spare true source server
IP address download file fragmentation identical with the file fragmentation to be downloaded to the spare true source server request.
Correction verification module 703 is used for according to the file verification information by being obtained on the resource index server, to having downloaded
At file fragmentation verified.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 700 refers to above-mentioned Fig. 1 to scheming
Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for
When the file fragmentation of download is inconsistent, downloaded to spare true source server request according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded, since the data in spare true source server are sent out by original operator resource
Cloth person actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively improve number
According to the success rate of download.
7th embodiment
Fig. 8 is the structural schematic diagram for the client that fifth embodiment of the invention provides.Client provided in this embodiment can
Method for realizing second embodiment and the downloading data in 3rd embodiment.As shown in figure 8, client 800 includes:It looks into
Ask module 801, download module 802, correction verification module 803, reporting module 804, generation module 805.
Enquiry module 801 is used to be used as entrance to resource index server query resource download server by original URL
Download resource url list, spare true source server IP address and to tracking server inquiry peer client row
Table.
Download module 802 is used to be arranged according to the download resource url list and peer client of the resource downloading server
Table downloads file fragmentation to be downloaded from the resource downloading server and the peer client;If being additionally operable to verify out
When the file fragmentation for downloading completion and the file fragmentation to be downloaded are inconsistent, according to the spare true source server
IP address download file fragmentation identical with the file fragmentation to be downloaded to the spare true source server request;Also
If verifying out the file fragmentation for downloading completion for the correction verification module and the file fragmentation to be downloaded being inconsistent,
Slicing files to be downloaded are downloaded by the original URL;If being additionally operable to through the original URL file fragmentations downloaded and institute
It is inconsistent to state file fragmentation to be downloaded, then execute it is described to the spare true source server request download with it is described to be downloaded
The identical file fragmentation of file fragmentation.
Preferably, the file fragmentation identical with the file fragmentation to be downloaded is existed by the resource publisher server
Resource will be downloaded while be sent to the resource downloading server, be sent to the spare true source server.
Correction verification module 803 is used for according to the file verification information by being obtained on the resource index server, to having downloaded
At file fragmentation verified;It is additionally operable to according to the verification cryptographic Hash obtained from the resource index server, to downloading
The file fragmentation of completion is verified.
Preferably, the verification cryptographic Hash by the goods receiving server according to resource publisher server send described in
It downloads the file fragmentation completed and calculates generation in the download resource url list of the resource downloading server, and be sent to described
Resource index server.
If reporting module 804 is used to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded not
Unanimously, then by the file verification information, the download resource of the corresponding resource downloading server of the file fragmentation to be downloaded
The IP address of url list and the corresponding resource downloading server is reported to the statistical server, or the equity is objective
The identity at family end is reported to the statistical server;It is additionally operable to the file verification information that will be generated and the current download
The identification-information reporting of the file fragmentation of completion gives goods receiving server, so that the goods receiving server is by the generation
File verification information and it is described it is current download complete file fragmentation identification information be written resource index database;Also use
The identical file fragmentation of file fragmentation to be downloaded described in Yu Dangyu, which is downloaded, to be completed, then by with the file fragmentation phase to be downloaded
With the download information of file fragmentation be reported to the statistical server, the download information include download the used time, speed of download,
Download result, file fragmentation size and security attribute information.
If generation module 805 is used to not inquire the current file fragmentation downloaded and completed on the resource index server
File verification information generate the current file verification downloaded corresponding to the file fragmentation completed then according to presetting rule
Information.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 800 refers to above-mentioned Fig. 1 to scheming
Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for
When the file fragmentation of download is inconsistent, downloaded to spare true source server request according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded, since the data in spare true source server are sent out by original operator resource
Cloth person actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively improve number
According to the success rate of download.
8th embodiment
Fig. 9 is the structural schematic diagram for the client that eighth embodiment of the invention provides.Client provided in this embodiment can
Method for realizing the downloading data in fourth embodiment.As shown in figure 9, client 900 includes:Download module 901, school
Test module 902.
Wherein download module 901 from resource downloading server and peer client for downloading file to be downloaded respectively
Fragment.
Correction verification module 902 from resource index server for inquiring the current file verification for downloading the file fragmentation completed
Information verifies the file fragmentation completed of downloading.
If download module 901 is additionally operable to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded
It is inconsistent, then the download of the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded is provided
Origin url list and IP address are reported to the statistical server, or the identity of the peer client are reported to described
Statistical server.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 900 refers to above-mentioned Fig. 1 to scheming
Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for
When the file fragmentation of download is inconsistent, by file verification information, file fragmentation to be downloaded source-information via statistical fractals
Device is reported to goods receiving server, and goods receiving server sync updates resource index database data, shields under mistake
Resource URL is carried, so as to effectively prevent other clients to download to wrong file fragmentation from the download resource URL of mistake, is carried
The success rate that high data are downloaded.
9th embodiment
Figure 10 is the structural schematic diagram for the client that ninth embodiment of the invention provides.Client provided in this embodiment can
Method for realizing the downloading data in the 5th embodiment.As shown in Figure 10, client 1000 includes:Download module
1010, correction verification module 1020, check information generation module 1030 and reporting module 1040.
Wherein download module 101 from resource downloading server and peer client for downloading file to be downloaded respectively
Fragment.
Correction verification module 1020 from resource index server for inquiring the current file school for downloading the file fragmentation completed
Information is tested, the file fragmentation completed of downloading is verified.
If download module 1010 is additionally operable to verify out the file fragmentation for downloading completion and the file to be downloaded point
Piece is inconsistent, then by the file verification information, the download of the corresponding resource downloading server of the file fragmentation to be downloaded
Resource url list and IP address are reported to the statistical server, or the identity of the peer client is reported to institute
State statistical server.
Work as if check information generation module 1030 does not inquire for the client on the resource index server
The preceding file verification information for downloading the file fragmentation completed generates and the current file point downloaded and completed then according to presetting rule
File verification information corresponding to piece.
The file fragmentation that the file verification information and the current download that reporting module 1040 is used to generate are completed
Identification-information reporting gives goods receiving server so that the goods receiving server by the file verification information of the generation with
And resource index database is written in the current identification information for downloading the file fragmentation completed.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 1000, refers to above-mentioned Fig. 1 extremely
Particular content described in embodiment illustrated in fig. 6, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by not inquired from resource index server
When the current file verification information for downloading the file fragmentation completed, the current file fragmentation downloaded and completed is generated according to presetting rule
File verification information and be reported to goods receiving server, then by goods receiving server it is verified after be written resource index
Database, it can be ensured that the correctness of file check information in resource index database prevents the mistake because of file verification information
Caused by data failed download, and then improve data download success rate.
Tenth embodiment
The application environment of the method for the downloading data of first embodiment of the invention offer is provided referring again to Fig. 1, Fig. 1
Figure can also be used as the structural schematic diagram of the system of the downloading data of tenth embodiment of the invention offer.As shown in Figure 1, this hair
The system 10 for the downloading data that bright sixth embodiment provides includes:Client 101 passes through wirelessly or non-wirelessly network and client
101 be in communication with each other resource downloading server 102, spare true source server 103, resource index server 104, follow-up service
Device 105 and peer client 106.
Client 101 is used as entrance by original URL (Uniform Resource Locator, uniform resource locator)
The download resource url list, spare true for being stored with the resource downloading server for downloading resource is inquired to resource index server 104
The IP address of actual source server 103 and to tracking server 105 inquire peer client list.
Resource index server 104 is according to the inquiry request of client 101, by the download resource of resource downloading server
Url list and the file verification information for downloading resource are sent to client 101.
Peer client list is sent to client 101 by tracking server 105 according to the inquiry request of client 101.
Download resource url list and peer client list of the client 101 according to the resource downloading server inquired,
File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, according to by resource index server
The file verification information obtained on 104 is verified to downloading the file fragmentation completed, if verifying out the file point of download completion
Piece and file fragmentation to be downloaded are inconsistent, then according to the IP address of spare true source server 103 to spare real source service
File fragmentation identical with file fragmentation to be downloaded is downloaded in the request of device 103.
Spare true source server 103 is according to the request of client 101, the file fragmentation transmission that client 101 is asked
To client 101.
The system of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator
Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry
The success rate that high data are downloaded.
11st embodiment
Referring to Fig. 3, showing the applied environment figure of the method for the downloading data of second embodiment of the invention offer, also may be used
Using the structural schematic diagram of the system of the downloading data provided as eleventh embodiment of the invention.As shown in figure 3, different from Fig. 1
, system 20 provided in this embodiment is in addition to resource downloading server 102, spare true source server 103, resource index clothes
It is engaged in except device 104, tracking server 105 and peer client 106, further includes resource publisher server 201, goods receiving
Server 202, resource index database 204, downloads authentication server 205 at statistical server 203.
It is multiple file fragmentations that resource publisher server 201 will download division of resources first, in accordance with default segmentation strategy, so
Resource will be downloaded afterwards and is published to resource downloading server 102 and spare true source server 103, and will be downloaded after the completion of publication
Under the original URL (Uniform Resource Locator, uniform resource locator) of resource, resource downloading server 102
Carry resource url list, IP (Internet Protocol, procotol) address of spare true source server 103 is sent to money
Source is put in storage server 202.Include the multiple texts for downloading resource in the download resource url list of above-mentioned resource downloading server 102
URL of the part fragment in different resource download server.Resource downloading server 102 may include ISP (Internet
Service Provider, Internet Service Provider) and cache server and CDN (Content Delivery Network, it is interior
Content distributing network) cache server.Since CDN cache server ratio ISP cache server error rates are lower, service quality and peace
Full property higher, it is preferable that resource publisher server 201 is published to CDN cache servers by resource is downloaded.
The download for the resource downloading server 102 that goods receiving server 202 is sent according to resource publisher server 201 provides
Origin url list calculates the cryptographic Hash of the URL of each file fragmentation, and by the cryptographic Hash of the URL of calculated each file fragmentation,
The cryptographic Hash of the URL of each file fragmentation and the mapping relations of the URL of each file fragmentation, the original URL for downloading resource, resource
The download resource url list of download server 102, the IP address of spare true source server 103 are stored in resource index data
Library 204 directly covers the relative recording if having there is relative recording in resource index database 204.
Statistical server 203 counts the check information and download information that client 101 reports, and client 101 is reported
Check information is reported to goods receiving server 202, the verification reported according to client 101 so as to goods receiving server 202
Data in information update resource index database 204, while improving data query service for goods receiving server 202.
Authentication server 205 is downloaded for verifying the storage data that client 101 is sent to goods receiving server 202.
The system of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion
When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server
File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator
Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry
The success rate that high data are downloaded.
12nd embodiment
1 is please referred to Fig.1, the structural schematic diagram of the system of the downloading data of twelveth embodiment of the invention offer is provided.
As shown in figure 11, the system 1100 of downloading data provided in this embodiment includes:Client 1110, resource index server
1120, statistical server 1130, resource downloading server 1140 and peer client 1150.
Each device realizes that the detailed process of function is please referred to Fig.1 to Fig. 6 pairs in the system of downloading data in the present embodiment
Answer embodiment method and Fig. 7 to the device of Figure 10 corresponding embodiments, details are not described herein again.
It should be noted that each embodiment in this specification is described in a progressive manner, each embodiment weight
Point explanation is all difference from other examples, and the same or similar parts between the embodiments can be referred to each other.
For device class embodiment, since it is basically similar to the method embodiment, so fairly simple, the related place ginseng of description
See the part explanation of embodiment of the method.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that process, method, article or device including a series of elements are not only wanted including those
Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or device
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or device including the element.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only
A kind of division of logic function, formula that in actual implementation, there may be another division manner, such as:Multiple units or component can combine, or
It is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition portion
It can be the INDIRECT COUPLING by some interfaces, equipment or unit to divide mutual coupling or direct-coupling or communication connection
Or communication connection, can be electrical, mechanical or other forms.
The above-mentioned unit illustrated as separating component can be or may not be and be physically separated, aobvious as unit
The component shown can be or may not be physical unit, you can be located at a place, may be distributed over multiple network lists
In member;Some or all of wherein unit can be selected according to the actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in various embodiments of the present invention can be fully integrated into a processing module, also may be used
It, can also be during two or more units be integrated in one unit to be each unit individually as a unit;It is above-mentioned
The form that hardware had both may be used in integrated unit is realized, can also be realized in the form of hardware adds SFU software functional unit.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned includes:It is movable storage device, read-only
Memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or
The various media that can store program code such as person's CD.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (5)
1. a kind of method of downloading data, which is characterized in that including:
Client downloads file fragmentation to be downloaded from resource downloading server and peer client respectively;
The client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, to institute
The file fragmentation downloaded and completed is stated to be verified;
If verifying out the file fragmentation for downloading completion and the file fragmentation to be downloaded being inconsistent, by the file school
Information, the download resource url list of the corresponding resource downloading server of the file fragmentation to be downloaded and IP address is tested to report
It is reported to the statistical server to statistical server, or by the identity of the peer client.
2. according to the method described in claim 1, it is characterized in that, the method further includes:
If the client does not inquire the file school of the current file fragmentation downloaded and completed on the resource index server
Information is tested, then according to presetting rule, is generated and the file verification information corresponding to the current file fragmentation downloaded and completed;
The file verification information of generation and the current identification-information reporting for downloading the file fragmentation completed are entered to resource
Library server, so that the goods receiving server completed the file verification information of the generation and the current download
Resource index database is written in the identification information of file fragmentation.
3. a kind of client, which is characterized in that including:
Download module, for downloading file fragmentation to be downloaded from resource downloading server and peer client respectively;
Correction verification module, for inquiring the current file verification information for downloading the file fragmentation completed from resource index server,
The file fragmentation completed of downloading is verified;
Wherein, download module, if being additionally operable to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded
It is inconsistent, then the download of the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded is provided
Origin url list and IP address are reported to statistical server, or the identity of the peer client is reported to the statistics
Server.
4. client according to claim 3, which is characterized in that further include:
Check information generation module has currently been downloaded if not inquired on the resource index server for the client
At file fragmentation file verification information, then according to presetting rule, generate with corresponding to the current file fragmentation downloaded and completed
File verification information;
Reporting module, the file verification information for that will generate and the current identification information for downloading the file fragmentation completed
It is reported to goods receiving server, so that the goods receiving server is by the file verification information of the generation and described works as
Resource index database is written in the preceding identification information for downloading the file fragmentation completed.
5. a kind of system of downloading data, which is characterized in that the system comprises:
Client, resource index server, statistical server, resource downloading server and peer client;
The wherein described client, for downloading file to be downloaded point from resource downloading server and peer client respectively
Piece is inquired the file verification information of the current file fragmentation downloaded and completed from resource index server, is completed to the download
File fragmentation verified, and when verify out it is described download complete file fragmentation differ with the file fragmentation to be downloaded
When cause, by the file verification information, the download resource URL of the corresponding resource downloading server of the file fragmentation to be downloaded
List and IP address are reported to the statistical server, or the identity of the peer client is reported to the statistics and is taken
Business device;
The resource index server, for the inquiry request according to the client, by the file fragmentation to be downloaded
Check information is sent to the client;
The statistical server, for receive the client verify out it is described download complete file fragmentation with it is described wait under
When the file fragmentation of load is inconsistent, the corresponding resource downloading of the check information, the file fragmentation to be downloaded reported takes
The download resource url list of business device and the identity of IP address or peer client;
The resource downloading server and peer client ask the client for the request according to the client
The file fragmentation asked is sent to the client.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810518014.0A CN108810111B (en) | 2013-07-12 | 2013-07-12 | Method, client and system for downloading data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810518014.0A CN108810111B (en) | 2013-07-12 | 2013-07-12 | Method, client and system for downloading data |
CN201310293521.6A CN104283933B (en) | 2013-07-12 | 2013-07-12 | Method, client and the system of downloading data |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310293521.6A Division CN104283933B (en) | 2013-07-12 | 2013-07-12 | Method, client and the system of downloading data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108810111A true CN108810111A (en) | 2018-11-13 |
CN108810111B CN108810111B (en) | 2020-08-07 |
Family
ID=52258409
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310293521.6A Active CN104283933B (en) | 2013-07-12 | 2013-07-12 | Method, client and the system of downloading data |
CN201810518014.0A Active CN108810111B (en) | 2013-07-12 | 2013-07-12 | Method, client and system for downloading data |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310293521.6A Active CN104283933B (en) | 2013-07-12 | 2013-07-12 | Method, client and the system of downloading data |
Country Status (1)
Country | Link |
---|---|
CN (2) | CN104283933B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109413200A (en) * | 2018-11-26 | 2019-03-01 | Oppo(重庆)智能科技有限公司 | A kind of method, client, MES and electronic equipment that resource imports |
CN109492436A (en) * | 2018-11-29 | 2019-03-19 | 深圳市网心科技有限公司 | A kind of file verification method and relevant apparatus |
CN111314403A (en) * | 2018-12-12 | 2020-06-19 | 阿里巴巴集团控股有限公司 | Method and device for checking resource consistency |
CN113411364A (en) * | 2020-03-16 | 2021-09-17 | 北京金山云网络技术有限公司 | Resource acquisition method and device and server |
CN114422507A (en) * | 2022-01-27 | 2022-04-29 | 北京金山云网络技术有限公司 | File downloading method and device and electronic equipment |
WO2023226887A1 (en) * | 2022-05-27 | 2023-11-30 | 华为技术有限公司 | Service disaster recovery method, terminal device, software development kit server, and communication system |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105357543B (en) * | 2015-10-23 | 2019-01-22 | 深圳市网心科技有限公司 | The cross-platform point-to-point video transmission method of one kind and device |
CN106254440B (en) * | 2016-07-29 | 2019-12-06 | 杭州迪普科技股份有限公司 | AP upgrading method and device |
CN106791884B (en) * | 2016-08-19 | 2019-11-19 | 炫熵(上海)互联网科技有限公司 | The holding system and method for the video data consistency of P2P live streaming |
CN108111561B (en) * | 2016-11-25 | 2021-03-02 | 腾讯科技(深圳)有限公司 | Data downloading method and equipment thereof |
CN106686083B (en) * | 2016-12-29 | 2019-09-17 | 北京奇艺世纪科技有限公司 | A kind of video file method for down loading and device |
CN107528825A (en) * | 2017-07-06 | 2017-12-29 | 努比亚技术有限公司 | A kind of resource downloading method, terminal and computer-readable recording medium |
CN109040190B (en) * | 2018-07-02 | 2022-03-22 | 咪咕文化科技有限公司 | Scheduling method, device and computer readable storage medium |
CN110889143B (en) * | 2018-09-07 | 2023-05-30 | 阿里巴巴集团控股有限公司 | File verification method and device |
CN111586170B (en) * | 2020-05-07 | 2023-05-23 | 广州博冠信息科技有限公司 | Resource downloading method, device, equipment and computer readable storage medium |
CN112422603A (en) * | 2020-06-09 | 2021-02-26 | 上海哔哩哔哩科技有限公司 | Resource downloading method, system and device |
CN114157644A (en) * | 2021-11-29 | 2022-03-08 | 广东明创软件科技有限公司 | Resource downloading method and device, electronic equipment and storage medium |
CN117240478B (en) * | 2023-11-13 | 2024-02-13 | 深圳合纵富科技有限公司 | POS machine data transmission method and system |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060212584A1 (en) * | 2005-03-15 | 2006-09-21 | Qian Xiang Shi Ji (Beijing) Technology Development Co. Ltd. | Method and system for accelerating downloading of web page content by a peer-to-peer network |
CN101079709A (en) * | 2006-06-15 | 2007-11-28 | 腾讯科技(深圳)有限公司 | Single-node-to-multi-node concurrent download system and method |
US20110131336A1 (en) * | 2009-12-01 | 2011-06-02 | Synacast Computer System (Shanghai) Co., Ltd. | Method and device for file transmission based on multiple protocols |
CN102750287A (en) * | 2011-04-21 | 2012-10-24 | 腾讯科技(深圳)有限公司 | Method for including index information and download authentication server |
CN102752326A (en) * | 2011-04-19 | 2012-10-24 | 腾讯科技(深圳)有限公司 | Method, client, server and system for processing data in file downloading |
CN102833293A (en) * | 2011-06-17 | 2012-12-19 | 腾讯科技(深圳)有限公司 | Method for downloading resources in peer to server and peer (P2SP) network, and client |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102005058006A1 (en) * | 2005-12-05 | 2007-06-06 | Siemens Ag | Method and peer network for determining the peer network originating stadium of a file |
CN102025444A (en) * | 2009-09-09 | 2011-04-20 | 腾讯科技(深圳)有限公司 | Resource publishing method, resource downloading method and data verification system |
CN102325167A (en) * | 2011-07-21 | 2012-01-18 | 杭州微元科技有限公司 | Verifying method for network file transmission |
CN103108008B (en) * | 2011-11-14 | 2017-09-22 | 腾讯科技(深圳)有限公司 | A kind of method and file download system for downloading file |
-
2013
- 2013-07-12 CN CN201310293521.6A patent/CN104283933B/en active Active
- 2013-07-12 CN CN201810518014.0A patent/CN108810111B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060212584A1 (en) * | 2005-03-15 | 2006-09-21 | Qian Xiang Shi Ji (Beijing) Technology Development Co. Ltd. | Method and system for accelerating downloading of web page content by a peer-to-peer network |
CN101079709A (en) * | 2006-06-15 | 2007-11-28 | 腾讯科技(深圳)有限公司 | Single-node-to-multi-node concurrent download system and method |
US20110131336A1 (en) * | 2009-12-01 | 2011-06-02 | Synacast Computer System (Shanghai) Co., Ltd. | Method and device for file transmission based on multiple protocols |
CN102752326A (en) * | 2011-04-19 | 2012-10-24 | 腾讯科技(深圳)有限公司 | Method, client, server and system for processing data in file downloading |
CN102750287A (en) * | 2011-04-21 | 2012-10-24 | 腾讯科技(深圳)有限公司 | Method for including index information and download authentication server |
CN102833293A (en) * | 2011-06-17 | 2012-12-19 | 腾讯科技(深圳)有限公司 | Method for downloading resources in peer to server and peer (P2SP) network, and client |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109413200A (en) * | 2018-11-26 | 2019-03-01 | Oppo(重庆)智能科技有限公司 | A kind of method, client, MES and electronic equipment that resource imports |
CN109413200B (en) * | 2018-11-26 | 2021-04-23 | Oppo(重庆)智能科技有限公司 | Resource import method, client, MES and electronic equipment |
CN109492436A (en) * | 2018-11-29 | 2019-03-19 | 深圳市网心科技有限公司 | A kind of file verification method and relevant apparatus |
CN111314403A (en) * | 2018-12-12 | 2020-06-19 | 阿里巴巴集团控股有限公司 | Method and device for checking resource consistency |
CN113411364A (en) * | 2020-03-16 | 2021-09-17 | 北京金山云网络技术有限公司 | Resource acquisition method and device and server |
CN113411364B (en) * | 2020-03-16 | 2022-10-11 | 北京金山云网络技术有限公司 | Resource acquisition method and device and server |
CN114422507A (en) * | 2022-01-27 | 2022-04-29 | 北京金山云网络技术有限公司 | File downloading method and device and electronic equipment |
WO2023226887A1 (en) * | 2022-05-27 | 2023-11-30 | 华为技术有限公司 | Service disaster recovery method, terminal device, software development kit server, and communication system |
Also Published As
Publication number | Publication date |
---|---|
CN104283933A (en) | 2015-01-14 |
CN108810111B (en) | 2020-08-07 |
CN104283933B (en) | 2018-11-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104283933B (en) | Method, client and the system of downloading data | |
US7076608B2 (en) | Invalidating cached data using secondary keys | |
US9137190B2 (en) | System and method for content-based message distribution | |
CN104283723B (en) | Network access log processing method and processing device | |
CN105045770B (en) | A kind of document redaction automatic reminding method | |
CN102985921B (en) | There is the client terminal device high speed caching electronic document resources of e-sourcing data base | |
CN107203541A (en) | Page loading method and its page loading device | |
US10089395B2 (en) | Third party content integration for search engine optimization | |
CN103365865A (en) | Methods and devices for storing and downloading data | |
CN112367684B (en) | Flow control method, device, storage medium and computer equipment | |
CN108683668A (en) | Resource checksum method, apparatus, storage medium and equipment in content distributing network | |
CN108710681A (en) | File acquisition method, device, equipment and storage medium | |
US20020032781A1 (en) | Intermediary server apparatus and an information providing method | |
CN104410546A (en) | Testing method and device of real-time processing system | |
CN109729183A (en) | Request processing method, device, equipment and storage medium | |
CN108153776A (en) | Data query method and device | |
CN104935653A (en) | Bypass cache method for visiting hot spot resource and device | |
CN112260988B (en) | Abnormal request processing method and device | |
CN107992350B (en) | Method and device for generating configuration overview page | |
US10320731B2 (en) | System and method for threading electronic messages | |
CN108063835B (en) | Outer net domain name analytic method, server and system | |
CN111767306A (en) | Shared information query system, method, device and equipment | |
CN103731399A (en) | Data access method, system and device based on CDN | |
RU2372656C2 (en) | System and method of forming and distributing information on goods | |
AU2017379313B2 (en) | Method and system for collecting digital documents from a plurality of sources |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |