CN108810111A - Method, client and the system of downloading data - Google Patents

Method, client and the system of downloading data Download PDF

Info

Publication number
CN108810111A
CN108810111A CN201810518014.0A CN201810518014A CN108810111A CN 108810111 A CN108810111 A CN 108810111A CN 201810518014 A CN201810518014 A CN 201810518014A CN 108810111 A CN108810111 A CN 108810111A
Authority
CN
China
Prior art keywords
server
resource
client
file
downloaded
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810518014.0A
Other languages
Chinese (zh)
Other versions
CN108810111B (en
Inventor
刘刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201810518014.0A priority Critical patent/CN108810111B/en
Publication of CN108810111A publication Critical patent/CN108810111A/en
Application granted granted Critical
Publication of CN108810111B publication Critical patent/CN108810111B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]

Abstract

The present invention provides a kind of method of downloading data, including:Client downloads file fragmentation to be downloaded from resource downloading server and peer client respectively;The client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, is verified to the file fragmentation completed of downloading;If verifying out the file fragmentation for downloading completion and the file fragmentation to be downloaded being inconsistent, the file verification information, the download resource url list of the corresponding resource downloading server of the file fragmentation to be downloaded and IP address are then reported to statistical server, or the identity of the peer client is reported to the statistical server.

Description

Method, client and the system of downloading data
The application is application number 201310293521.6, and the applying date is:It is on 07 12nd, 2013, entitled:It downloads The method of data, the divisional application of client and system.
Technical field
The present invention relates to a kind of computer communication technology field more particularly to method of downloading data, client and systems.
Background technology
P2SP (Peer to Server and Peer, point to server and point), is a kind of multi-source content ways of distribution, Because peer client (peer) in third-party server and P2P (Peer to Peer, point-to-point) network can be utilized simultaneously Source, to greatly improving the performance of download, therefore have been widely used.In P2SP, due to downloading data source In multiple and different point such as third-party server and peer client logarithm is needed in order to ensure the correctness of downloading data It is verified according to fragment.
However, being mainly at present CDN (Content as the third-party server in source in content distribution field Delivery Network, content distributing network) (Internet Service Provider are interconnected cache server with ISP Net service provider) cache server.Although CDN can substantially accelerate content to the distribution efficiency of client, the middle parts CDN Multiple points are affixed one's name to, sometimes due to internal cause, it may appear that the nonsynchronous phenomenon of multiple spot downloading data so that the number of client downloads It according to always there is some to be wrong in fragment, can not pass through so as to cause terminal check, waste a large amount of download resource and bandwidth number According to.And small ISP rents the link of main ISP by then passing through, and then provides some distinctive services to develop the width of oneself Band user, in order to solve the inter-network settling problems of great number, small ISP would generally cache part hot spot by modes such as Domain Hijackings Content uses on the outlets the ISP cache server of oneself for accelerating to download, due to the abduction of domain name link, if ISP is cached The downloading data update stored in server not in time, then can cause client downloads to the data fragmentation of mistake, final same Also resulting in verification can not pass through, and waste a large amount of download resource and band data.Therefore, how to ensure the correct of downloading data Property, the success rate for effectively improving data download is that industry is currently badly in need of a great problem to be solved.
Invention content
In view of this, the present invention provides a kind of method of downloading data, client and system, data download can be effectively improved Success rate.
A kind of method of downloading data, including:Client is used as entrance to the inquiry of resource index server by original URL The download resource url list of resource downloading server, the IP address of spare true source server and to tracking server inquire Peer client list;Download resource url list and peer client list of the client according to the resource downloading server, File fragmentation to be downloaded is downloaded from the resource downloading server and the peer client;Client is according to by the money The file verification information obtained on the index server of source is verified to downloading the file fragmentation completed;If verify out it is described under Carry the file fragmentation completed and the file fragmentation to be downloaded be inconsistent, then client according to the IP address to described spare File fragmentation identical with the file fragmentation to be downloaded is downloaded in true source server request.
A kind of method of downloading data, including:Client is downloaded from resource downloading server and peer client respectively File fragmentation to be downloaded;The client inquires the file of the current file fragmentation downloaded and completed from resource index server Check information verifies the file fragmentation completed of downloading;If verifying out the file fragmentation for downloading completion and institute State that file fragmentation to be downloaded is inconsistent, then by the file verification information, the corresponding resource of the file fragmentation to be downloaded The download resource url list and IP address of download server are reported to the statistical server, or by the peer client Identity is reported to the statistical server.
A kind of client, including:Enquiry module is inquired for being used as entrance by original URL to resource index server The download resource url list of resource downloading server, the IP address of spare true source server and to tracking server inquire Peer client list;Download module, for the download resource url list and peer client according to the resource downloading server List is held, file fragmentation to be downloaded is downloaded from the resource downloading server and the peer client;Correction verification module is used According to the file verification information by being obtained on the resource index server, verified to downloading the file fragmentation completed; The download module described downloads the file fragmentation completed and the file fragmentation to be downloaded is inconsistent if being additionally operable to verify out When, text identical with the file fragmentation to be downloaded is downloaded to the spare true source server request according to the IP address Part fragment.
A kind of client, including:Download module, for being waited for respectively from resource downloading server and peer client download The file fragmentation of download;Correction verification module, for inquiring the current text for downloading the file fragmentation completed from resource index server Part check information verifies the file fragmentation completed of downloading;Download module, if being additionally operable to verify out described downloaded At file fragmentation and the file fragmentation to be downloaded it is inconsistent, then by the file verification information, the text to be downloaded The download resource url list and IP address of the corresponding resource downloading server of part fragment are reported to the statistical server, or will The identity of the peer client is reported to the statistical server.
A kind of system of downloading data, including:Client, resource index server, resource downloading server, follow-up service Device, spare true source server and peer client.Wherein, the client, for being used as entrance to institute by original URL State the download resource url list of resource index server query resource download server, the IP address of spare true source server, And inquire peer client list to tracking server, according to the download resource url list of the resource downloading server and Peer client list downloads file fragmentation to be downloaded, root from the resource downloading server and the peer client According to the file verification information by being obtained on the resource index server, verified to downloading the file fragmentation completed, if school It tests out the file fragmentation for downloading completion and the file fragmentation to be downloaded is inconsistent, then taken according to the spare real source The IP address of business device downloads file point identical with the file fragmentation to be downloaded to the spare true source server request Piece.The resource index server, for the inquiry request according to the client, by the download of the resource downloading server Resource url list, the spare true source server IP address be sent to the client.The tracking server, is used for According to the inquiry request of the client, peer client list is sent to the client, receives the note of peer client The peer client list is added in the peer client of new registration by volume.The resource downloading server, peer client with And the spare true source server sends out the file fragmentation of the client request for the request according to the client Give the client.
A kind of system of downloading data, including:Client, resource index server, statistical server, resource downloading service Device and peer client;The wherein described client, for being waited for respectively from resource downloading server and peer client download The file fragmentation of download inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, right It is described download complete file fragmentation verified, and when verify out it is described download complete file fragmentation with it is described to be downloaded When file fragmentation is inconsistent, by the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded Download resource url list and IP address be reported to the statistical server, or will be in the identity of the peer client Offer the statistical server;The resource index server waits for down for the inquiry request according to the client by described The check information of the file fragmentation of load is sent to the client;The statistical server, for receiving the client in school Test out it is described download file fragmentation and the file fragmentation to be downloaded completed it is inconsistent when, the check information that reports, The download resource url list and IP address or peer client of the corresponding resource downloading server of the file fragmentation to be downloaded The identity at end;The resource downloading server and peer client will be described for the request according to the client The file fragmentation of client request is sent to the client.
In the method, apparatus and system of above-mentioned downloading data, by client in the file for verifying out download completion When fragment and file fragmentation to be downloaded are inconsistent, according to the IP address of spare true source server to spare true source server File fragmentation identical with file fragmentation to be downloaded is downloaded in request, since the data in spare true source server are by original fortune It seeks resource publisher actively to construct, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to have Effect improves the success rate that data are downloaded.
For the above and other objects, features and advantages of the present invention can be clearer and more comprehensible, preferred embodiment cited below particularly, And coordinate institute's accompanying drawings, it is described in detail below.
Description of the drawings
Fig. 1 is the applied environment figure of the method for the downloading data that first embodiment of the invention provides.
Fig. 2 is the flow chart of the method for the downloading data that first embodiment of the invention provides.
Fig. 3 is the applied environment figure of the method for the downloading data that second embodiment of the invention is provided with 3rd embodiment.
Fig. 4 is the flow chart of the method for the downloading data that second embodiment of the invention provides.
Fig. 5 is the flow chart of the method for the downloading data that fourth embodiment of the invention provides.
Fig. 6 is the flow chart of the method for the downloading data that fifth embodiment of the invention provides.
Fig. 7 is the structural schematic diagram for the client that sixth embodiment of the invention provides.
Fig. 8 is the structural schematic diagram for the client that seventh embodiment of the invention provides.
Fig. 9 is the structural schematic diagram for the client that eighth embodiment of the invention provides.
Figure 10 is the structural schematic diagram for the client that ninth embodiment of the invention provides.
Figure 11 is the schematic diagram of the system for the downloading data that twelveth embodiment of the invention provides.
Specific implementation mode
Further to illustrate that the present invention is the technological means and effect realized predetermined goal of the invention and taken, below in conjunction with Specific implementation mode, structure, feature and its effect according to the present invention is described in detail as after in attached drawing and preferred embodiment.
First embodiment
Referring to Fig. 1, showing the applied environment figure of the method for the downloading data of first embodiment of the invention offer.Such as figure Shown in 1, client 101 is located at wirelessly or non-wirelessly in network, by this wirelessly or non-wirelessly network and resource downloading server 102, Spare true source server 103, the 106 phase intercommunication of resource index server 104, tracking server 105 and peer client Letter, and data downloading system 10 is constituted together.
It should be understood that above-mentioned client 101, resource downloading server 102, spare true source server 103, resource rope Each device drawn in server 104, tracking server 105 and peer client 106 is not necessarily referring to single individual, Can be multiple groups of individuals, such as:Resource downloading server 102 can be single resource downloading server, can also be The resource downloading server group being made of multiple resource downloading servers.
Referring to Fig. 2, showing the flow chart of the method for the downloading data of first embodiment of the invention offer.Such as Fig. 2 institutes Show, which describes the process flow of client, and in conjunction with Fig. 1, the method for downloading data provided in this embodiment includes Following steps:
Step S21, client are used as entrance to resource index server query resource download server by original URL It downloads resource url list, the IP address of spare true source server and inquires peer client list to tracking server.
In this step, client 101 passes through original URL (Uniform Resource Locator, unified resource positioning Symbol) the download resource for being stored with the resource downloading server 102 for downloading resource is inquired to resource index server 104 as entrance Url list, spare true source server 103 (Internet Protocol, the procotol) addresses IP and to tracking take Business device 105 inquires peer client list.Resource index server 104 is according to the inquiry request of client 101, by resource downloading The download resource url list of server and the file verification information for downloading resource are sent to client 101.Tracking server 105 According to the inquiry request of client 101, peer client list is sent to client 101.
Step S22, download resource url list and peer client list of the client according to resource downloading server, from Resource downloading server and peer client download file fragmentation to be downloaded.
In this step, client 101 is according to the download resource url list and equity of the resource downloading server inquired Client side list downloads file fragmentation to be downloaded from resource downloading server 102 and peer client 106 respectively.Resource The file fragmentation that client 101 is asked is sent to client 101 by download server 102 and peer client 106 respectively.
Specifically, multiple file fragmentations can be divided by downloading resource, client 101 according to preset download policy, File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, and all to be downloaded respectively After the completion of file fragmentation is downloaded, it is reduced to all file fragmentation combinations to download resource.
Step S23, client is according to the file verification information by being obtained on resource index server, to downloading the text completed Part fragment is verified.
In this step, client 101 is according to the file verification information by being obtained on resource index server 104, under The file fragmentation completed is carried to be verified.
File verification information includes the cryptographic Hash (Hash) of the URL for each file fragmentation for downloading resource, specifically, example Such as:SHA1 (the Secure Hash Algorithm) values or MD5 (Message Digest, message of the URL of each file fragmentation Digest algorithm the 5th edition) value.
Client 101 using the file verification information obtained from resource index server 104 as unique believable information, As soon as often completing the download of a file fragmentation, judged by check information.
Step S24, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, client root It is identical with file fragmentation to be downloaded to spare true source server request download according to the IP address of spare true source server File fragmentation.
In this step, if client 101 goes out to download the file fragmentation completed according to file verification information checking and waits for down The file fragmentation of load is inconsistent, then client 101 can be according to the IP address of spare true source server 103 to spare real source File fragmentation identical with file fragmentation to be downloaded is downloaded in the request of server 103.Spare true source server 103 is according to client The request at end 101, client 101 is sent to by the file fragmentation that client 101 is asked.
That is, only when verifying out the file fragmentation and inconsistent file fragmentation to be downloaded of download completion, visitor Family end 101 can just ask to download file fragmentation identical with file fragmentation to be downloaded to spare true source server 103.Namely In the case where the file fragmentation to be downloaded on being stored in resource downloading server 102 and peer client 106 is without mistake, Client 101 will not send to spare true source server 103 and download request, can ensure spare true source server in this way 103 stability will not cause to overload, cause the collapse of spare true source server 103 because visit capacity is too big.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry The success rate that high data are downloaded.
Second embodiment
Referring to Fig. 3, showing the applied environment figure of the method for the downloading data of second embodiment of the invention offer.Such as figure Shown in 3, unlike Fig. 1, in addition to resource downloading server 102, spare true source server 103, resource index server 104, except tracking server 105 and peer client 106, client 101 also enters with resource publisher server 201, resource Library server 202, statistical server 203, resource index database 204, download authentication server 205 constitute data download together System 20.
Above-mentioned client 101, resource downloading server 102, spare true source server 103, resource index server 104, tracking server 105, peer client 106, resource publisher server 201, goods receiving server 202, statistical fractals Each device in device 203, resource index database 204 and download authentication server 205 is not necessarily referring to single individual, Can also be multiple groups of individuals, such as:Resource downloading server 102 can be single resource downloading server, can also It is the resource downloading server group being made of multiple resource downloading servers.
Referring to Fig. 4, showing the flow chart of the method for the downloading data of second embodiment of the invention offer.Such as Fig. 4 institutes Show, which describes the process flow of client, and in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes Following steps:
Step S401, client are used as entrance to resource index server query resource download server by original URL Download resource url list, spare true source server IP address and to tracking server inquiry peer client row Table.
It is multiple file fragmentations that resource publisher server 201 will download division of resources first, in accordance with default segmentation strategy, so Resource will be downloaded afterwards and is published to resource downloading server 102 and spare true source server 103, and will be downloaded after the completion of publication Under the original URL (Uniform Resource Locator, uniform resource locator) of resource, resource downloading server 102 Carry resource url list, IP (Internet Protocol, procotol) address of spare true source server 103 is sent to money Source is put in storage server 202.
Exist comprising the multiple file fragmentations for downloading resource in the download resource url list of above-mentioned resource downloading server 102 URL in different resource download server.Resource downloading server 102 may include ISP (Internet Service Provider, Internet Service Provider) cache server and CDN (Content Delivery Network, content delivery network Network) cache server.Due to CDN cache server ratio ISP cache server error rates are lower, service quality and safety more It is high, it is preferable that resource publisher server 201 is published to CDN cache servers by resource is downloaded.
The download for the resource downloading server 102 that goods receiving server 202 is sent according to resource publisher server 201 provides Origin url list calculates the cryptographic Hash of the URL of each file fragmentation, and by the cryptographic Hash of the URL of calculated each file fragmentation, The cryptographic Hash of the URL of each file fragmentation and the mapping relations of the URL of each file fragmentation, the original URL for downloading resource, resource The download resource url list of download server 102, the IP address of spare true source server 103 are stored in resource index data Library 204 directly covers the relative recording if having there is relative recording in resource index database 204.
In this step, original URL can be downloaded from resource downloading website by client 101 and be obtained.Client 101 is logical first It crosses original URL and sends inquiry request to resource index server 104 as entrance, resource index server 104 is according to the inquiry Request inquires whether local cache has respective record first, if there is then directly reading resource downloading server from local cache 102 download resource url list, the IP address of spare true source server 103 and file verification information are simultaneously sent to client End 101;If there is no respective record in local cache, inquiry request is sent to resource index database 204, then will be passed through The download resource url list for the resource downloading server 102 that the inquiry of resource index database 204 obtains, spare real source service The IP address and file verification information of device 103 are sent to client 101.
Client 101 sends inquiry request to tracking server 105, and tracking server 105, will be right according to the inquiry request Etc. client side lists be sent to client 101.Peer client list is generated by tracking server 105, wherein may include storing There are the information such as the download resource that possesses of IP address, peer client 106 for the peer client 106 for downloading resource.Follow-up service According to the registration request of client 101 peer client list is added in the client 101 of new registration by device 105.And according to client The resource information that the online situation and client 101 for the client 101 that end 101 periodically reports possess, update peer client row Table.
Step S402, download resource url list and peer client list of the client according to resource downloading server, from Resource downloading server and peer client download file fragmentation to be downloaded.
This step can refer to the corresponding steps in first embodiment, and which is not described herein again.
Step S403, client inquire the file verification letter of the current file fragmentation downloaded and completed from resource index server Breath.
In this step, client 101 inquires the text of the current file fragmentation downloaded and completed from resource index server 104 Part check information.If client 101 does not inquire the text of the current file fragmentation downloaded and completed on resource index server 104 Part check information, thens follow the steps S404:According to presetting rule, the file corresponding to the current file fragmentation downloaded and completed is generated Check information.
Specifically, client 101 does not inquire the current file downloaded and completed from resource index server 104 for the first time The file verification information of fragment will then download the file fragmentation completed and be considered as new file, according to the file fragmentation for downloading completion URL calculates the file verification information for generating the file fragmentation that the download is completed, such as:Cryptographic Hash.
Step S405:By the file verification information of generation and the current identification-information reporting for downloading the file fragmentation completed Goods receiving server is given, so that the file that goods receiving server completes the file verification information of generation and current download Resource index database is written in the identification information of fragment.
Specifically, goods receiving server 202 receives the file verification information and currently downloaded that client 101 reports At file fragmentation identification information, first to resource index database 204 inquiry whether have corresponding information, if can not inquire Corresponding information, then the file verification information directly reported client 101 and the current mark for downloading the file fragmentation completed Resource index database 204 is written in information, if there is corresponding information, check relevant field (such as:File size, Hash marks) Whether content is consistent, if inconsistent, calls legitimacy, the validity for downloading the verification storage data of authentication server 205, and root According to verification result, the text of the current file fragmentation for downloading completion reported with client 101 in update resource index database 204 The part check information information corresponding with identification information.Wherein, authentication server 205 is downloaded to be sent to for verifying client 101 The storage data of goods receiving server 202.
If inquiring the file verification information of the current file fragmentation downloaded and completed, S406 is thened follow the steps:According to by providing The file verification information obtained on source index server 104 is verified to downloading the file fragmentation completed.
If the file fragmentation and the file fragmentation to be downloaded that verify out download completion are inconsistent, S407 is thened follow the steps:Visitor Fragment to be downloaded is downloaded by original URL in family end 101.
Step S408 provides the download of file verification information, the corresponding resource downloading server of file fragmentation to be downloaded The IP address of origin url list and corresponding resource downloading server is reported to statistical server, or by the identity of peer client Mark is reported to statistical server.
Specifically, if downloading the file fragmentation completed is downloaded from resource downloading server 102, client 101 will The download resource url list of the corresponding resource downloading server of file verification information, file fragmentation to be downloaded 102 and corresponding The IP address of resource downloading server 102 is reported to statistical server 203;If it is from peer client to download the file fragmentation completed What end 106 was downloaded, then client 101 is by the body of the corresponding peer client of file verification information, file fragmentation to be downloaded 106 Part mark is reported to statistical server 203.
The above- mentioned information that client 101 reports is reported to goods receiving server 202 by statistical server 203, and resource enters The above- mentioned information that library server 202 is reported according to statistical server 203 updates the data in resource index database 204, example Such as:Remove the download resource URL that check results are the corresponding resource downloading server of inconsistent file fragmentation to be downloaded 102 List.
If inconsistent by the original URL file fragmentations downloaded and file fragmentation to be downloaded, S409 is thened follow the steps:To File fragmentation identical with file fragmentation to be downloaded is downloaded in spare true source server request.
This step can refer to the corresponding contents of first embodiment, and details are not described herein.
Step S410, when file fragmentation identical with file fragmentation to be downloaded download complete, by with file to be downloaded The download information of the identical file fragmentation of fragment is reported to statistical server.
Specifically, after the completion of file fragmentation identical with file fragmentation to be downloaded is downloaded, client 101 will be to be downloaded The identical file fragmentation of file fragmentation download information, including:Download used time, speed of download, download result, file fragmentation are big Small and security attribute information etc. is reported to statistical server 203.
Statistical server 203 stores the download information of the transmission of client 101 in a manner of flowing water daily record, for subsequent statistical Analysis.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry The success rate that high data are downloaded.
3rd embodiment
Fig. 3 is refer again to, the application environment in Fig. 3 is equally applicable to the present embodiment.The place of the system of the present embodiment description Flow is managed, the method for downloading data provided in this embodiment includes the following steps:
Step S501, resource publisher server 201 will download resource be published to resource downloading server 102 with it is spare true Source server 103.
Resource downloading server 102 may include that (Internet Service Provider, Internet service provide ISP Quotient) cache server and CDN (Content Delivery Network, content distributing network) cache server.
Step S502, resource publisher server 201 will download the download of the original URL, resource downloading server 102 of resource The IP address of resource url list and spare true source server 103 is sent to goods receiving server 202.
Step S503, goods receiving server 202 calculate the file verification information for downloading resource, will download the original of resource URL, the download resource url list of resource downloading server 102, the IP address of spare true source server 103 and download money The file verification information in source is sent to resource index database 204, so that resource index database 204 stores above- mentioned information.
It is divided into multiple file fragmentations due to downloading resource, it is possible to understand that, the download money of resource downloading server 102 Include the URL for the multiple file fragmentations for downloading resource in origin url list.
Specifically, the resource downloading server that goods receiving server 202 is sent according to resource publisher server 201 first 102 download resource url list, using Predistribution Algorithm (such as:Hash algorithm) it is each file fragmentation calculating for downloading resource Hash (cryptographic Hash), then by the Hash of calculated each file fragmentation, the URL of each file fragmentation, each file fragmentation The mapping relations of URL of Hash and each file fragmentation, the IP address of spare true source server 103 and be used to indicate by The Hash of each file fragmentation is sent to resource index database labeled as the mark instructions of the check information of proactive dissemination resource 204.Resource index database 204 receives and stores above- mentioned information, and is marked the Hash of each file fragmentation according to mark instructions It is denoted as the check information of proactive dissemination resource, to become unique credible check information.
It should be understood that resource index database 204 can be a module in goods receiving server 202, also may be used To be an individual server in network.
Step S504, client 101 are used as entrance by original URL and send inquiry request to resource index server 104, The download resource url list of requesting query resource downloading server 102, the IP address of spare true source server 103, and pass through Original URL sends inquiry request, requesting query peer client list as entrance to tracking server 105.
Step S505, the inquiry request that resource index server 104 is sent according to client 101, resource downloading is serviced The download resource url list of device 102, the IP address of spare true source server 103 feed back to client 101.
Step S506, the inquiry request that tracking server 105 is sent according to client 101 are anti-by peer client list Client of feeding 101.
Step S507, client 101 take according to the download resource url list of resource downloading server 102 from resource downloading Business device 102 downloads file fragmentation to be downloaded, and text to be downloaded is downloaded from peer client 106 according to peer client list Part fragment.
Step S508, client 101 are sent out when having monitored that file fragmentation downloads completion to resource index server 104 Inquiry request is sent, the file verification information of the current file fragmentation downloaded and completed is inquired.
It should be understood that it includes currently to have downloaded that client 101, which is sent in the inquiry request of resource index server 104, At file fragmentation URL, resource index server 104 is corresponding with the current file fragmentation for downloading completion according to URL inquiries Hash.
Step S509, resource index server 104 is according to the inquiry request of client 101, to resource index database 204 Inquire file verification information corresponding with the file fragmentation that currently download is completed of client 101.
Resource index server 104 is in the corresponding file verification information of the file fragmentation that inquires with currently download completion When, execute step S510:File verification information corresponding with the file fragmentation that currently download is completed of client 101 is fed back into visitor Family end 101.
Client 101 receive it is that resource index server 104 feeds back with the current file fragmentation downloaded and completed When corresponding file verification information, step S511 is executed:The file verification information checking sent according to resource index server 104 It is current to download the file fragmentation completed.
Client 101 is held when check results are to download the file fragmentation completed and inconsistent file fragmentation to be downloaded Row step S512:File fragmentation to be downloaded is downloaded by original URL, while the file verification of file fragmentation to be downloaded being believed Breath, the download resource url list of the corresponding resource downloading server of file fragmentation to be downloaded 102 and corresponding resource downloading clothes The IP address of business device 102 is reported to statistical server 203, or the identity of peer client 106 is reported to statistical fractals Device 203.
Check results are that the file fragmentation that download is completed and file fragmentation to be downloaded are inconsistent, have illustrated client 101 The source for the file fragmentation to be downloaded downloaded is problematic, thus client 101 by with the file fragmentation to be downloaded downloaded File verification information, the download resource url list of corresponding resource downloading server 102 and corresponding resource downloading server The relevant informations such as 102 IP address are reported to statistical server 203.
Step S513, the file verification letter for the file fragmentation to be downloaded that statistical server 203 reports client 101 Breath, the download resource url list of the corresponding resource downloading server of file fragmentation to be downloaded 102 and corresponding resource downloading clothes The IP address of business device 102 is reported to goods receiving server 202.
Step S514, the information that goods receiving server 202 is reported according to statistical server 203 in step S514, hair Send the more new command of the information reported in step S513 comprising statistical server 203 to resource index database 204, so that money Source index data base 204 updates corresponding data.
Update mode may include, such as:Delete the letter reported with client 101 stored in resource index database 204 Cease the download resource url list of the corresponding resource downloading server of related file fragmentation to be downloaded 102.
Step S515, client 101 pass through original according to the file verification Information Authentication obtained from resource index server 104 The file fragmentation that beginning URL downloads, and when the file fragmentation downloaded by original URL and inconsistent file fragmentation to be downloaded, File fragmentation identical with file fragmentation to be downloaded is downloaded to the request of spare true source server 103.
If all URL include original URL incorrect, spare 103 downloading data of true source server is used at this time, Since only there are one sources, multi-source is not present, so file can not have to verification at this time, by the number of spare true source server 103 According to correctness ensure final correctness.
The file of the file fragmentation of mistake is carried in the presence of being reported in real time according to client 101 due to statistical server 203 The download resource url list of the corresponding resource downloading server of check information, file fragmentation to be downloaded 102 and corresponding resource The IP address of download server 102, or by the identity of peer client 106, can determine that ISP multi-sources are downloaded not quickly It is synchronous, and the reparation for carrying out CDN synchronization distributions can be synchronized, simultaneously because the presence of spare true source server 103, it is ensured that The current download of normal users.In addition, even if ISP operators have cached the copy of mistake, as long as original publisher passes through resource Correct file verification information, which is written, in storage server 202 would not influence final download number to resource index database 204 According to correctness.
Step S516, client 101 file fragmentation identical with file fragmentation to be downloaded download complete when, will with wait for The download information of the identical file fragmentation of file fragmentation of download is reported to statistical server 203.
Download information may include:It downloads the used time, speed of download, download result, file fragmentation size and security attribute information Deng.Statistical server 203 stores above- mentioned information in a manner of flowing water daily record, for subsequent statistical analysis.
Client 101 is not in receiving that resource index server 104 feeds back and currently downloaded in preset time At the corresponding file verification information of file fragmentation, or receive be not query result feedback information, then follow the steps S517:By the identification-information reporting of the current file fragmentation downloaded and completed to goods receiving server 202.
The current identification information for downloading the file fragmentation completed may include the size of this document fragment, URL etc..
Step S518, goods receiving server 202 send check information and report instruction to client 101, indicate client 101 report the file fragmentation check information of the current file fragmentation downloaded and completed.
Step S519, client 101 generate the fragment corresponding to the current file fragmentation downloaded and completed according to presetting rule File verification information, and the slicing files check information is reported to goods receiving server 202.
Specifically, the use of client 101 Predistribution Algorithm (such as:Hash algorithm) according to the file fragmentation for downloading completion URL calculates the Hash for generating the file fragmentation that the download is completed.
Step S520, goods receiving server 202 receive the file verification information that client 101 is sent, and to resource rope Draw database 204 and send inquiry request, whether is stored in query resource index data base 204 and works as with what client 101 reported The preceding identification information and the corresponding data information of file verification information for downloading the file fragmentation completed.
Query result is fed back to goods receiving server 202 by step S521, resource index database 204.
Goods receiving server 202 is held when not being stored with corresponding information during query result is resource index database 204 Row step S522:The current identification information and file verification information for downloading the file fragmentation completed that client 101 is reported It is sent to resource index database 204, so that resource index database 204 stores above- mentioned information.
Goods receiving server 202 is executed when being stored with corresponding information during query result is resource index database 204 Step S523:Working as being reported with client 101 included in the query result of 204 feedback of inspection resource index database is front lower Carry the file fragmentation completed identification information and the information-related relevant field of file verification (such as:File size, Hash marks Know) content it is whether consistent with the above- mentioned information that client 101 reports.And when inspection result is inconsistent, execute step S524:It sends verification instruction and gives download authentication server 205.
Step S525 downloads authentication server 205 and is instructed according to the verification that goods receiving server 202 is sent, verification visitor The legitimacy for the current identification information and file verification information for downloading the file fragmentation completed that family end 101 reports, and will test Card result feeds back to goods receiving server 202.
Specifically, downloading during authentication server 205 is instructed by the verification that is sent according to goods receiving server 202 and including The current URL for downloading the file fragmentation completed that reports of client 101 download file fragmentation, calculate what client 101 reported The field inconsistent with the content in the corresponding informance that is stored in resource index database 204 in information.
Goods receiving server 202, which receives, downloads the verification result that authentication server 205 is sent, and is downloading authentication server The current identification information for downloading the file fragmentation completed and file school that the verification result of 205 feedbacks is reported with client 101 Test information it is consistent when, execute step S526:The current mark letter for downloading the file fragmentation completed that will be reported comprising client 101 The more new command of breath and file verification information is sent to resource index database 204, so that 204 basis of resource index database Corresponding information in the information update resource index database 204 that client reports.
Specifically, assuming that the information stored in resource index database 204 is old information, the information that client 101 reports Old information is not updated if the verification result for downloading authentication server 205 is consistent with old information for information, if downloading verification clothes The verification result of business device 205 is consistent with new information, then with the old information stored in new information update resource index database 204. For U2H (URL to Hash mapping tables), a URL has been only possible to a record in resource index database 204, directly updates The record;For H2U, if the corresponding Hash of URL change, should first by H2U (the map record table of Hash to URL) table with The corresponding URL record deletions of preceding Hash are fallen, and new record is inserted into;For fragment check information, a Hash only corresponds to one A record directly updates the record stored in resource index database 204;If downloading the verification knot of authentication server 205 Fruit and new information and old information are all inconsistent, then in the verification result update resource index database 204 for downloading verification return Corresponding information.
The method of downloading data provided in an embodiment of the present invention downloads the same of resource by resource publisher server in publication When, a spare real source is constructed in spare true source server, when client is in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, client reports statistics by the corresponding loading source URL of file fragmentation completed is downloaded Server, and being shielded by goods receiving server, at the same client according to the IP address of spare true source server to File fragmentation identical with file fragmentation to be downloaded is downloaded in spare true source server request, can get around ISP buffer services The mistake generated because the original download data issued with resource publisher server are asynchronous stored in device and CDN cache servers Accidentally data, correct data is downloaded to from spare true source server, so that it is guaranteed that client downloads to file be one consistent Property version, be not in that a part of data come from new version, the case where a part of data come from legacy version, and then can effectively carry The success rate that high data are downloaded.
Fourth embodiment
Fig. 5 is the flow chart of the method for the downloading data that fourth embodiment of the invention provides.As shown in figure 5, the embodiment The report flow for describing client, in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes the following steps:
Step S61, client download file fragmentation to be downloaded from resource downloading server and peer client respectively.
Specifically, multiple file fragmentations can be divided by downloading resource, client 101 according to preset download policy, File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, and all to be downloaded respectively After the completion of file fragmentation is downloaded, it is reduced to all file fragmentation combinations to download resource.
Step S62, client inquire the file verification of the current file fragmentation downloaded and completed from resource index server Information verifies the file fragmentation completed of downloading.
Specifically, client 101 is calculated according to preset create-rule according to the URL of the current file fragmentation downloaded and completed Then cryptographic Hash carries out calculated cryptographic Hash with the file verification information obtained is inquired from resource index server 104 Compare, judges whether the two is consistent.
Step S63, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, by file school Test the download resource url list of the corresponding resource downloading server of information, file fragmentation to be downloaded and corresponding resource downloading The IP address of server is reported to statistical server, or the identity of peer client is reported to statistical server.
Specifically, if downloading the file fragmentation completed is downloaded from resource downloading server 102, client 101 will The download resource url list of the corresponding resource downloading server of file verification information, file fragmentation to be downloaded 102 and corresponding The IP address of resource downloading server 102 is reported to statistical server 203;If it is from peer client to download the file fragmentation completed What end 106 was downloaded, then client 101 is by the body of the corresponding peer client of file verification information, file fragmentation to be downloaded 106 Part mark is reported to statistical server 203.
The above- mentioned information that client 101 reports is reported to goods receiving server 202 by statistical server 203, and resource enters The above- mentioned information that library server 202 is reported according to statistical server 203 updates the data in resource index database 204, example Such as:Remove the download resource URL that check results are the corresponding resource downloading server of inconsistent file fragmentation to be downloaded 102 List.Goods receiving server 202 can also send early warning to resource downloading server 102 and resource publisher server 201 simultaneously Notice, the download resource URL column that notice resource downloading server 102 is repaired and is eliminated as early as possible with resource publisher server 201 The corresponding file fragmentation of table.Resource publisher server 201 can after receiving pre-alert notification, by with the download resource that is eliminated On the resource downloading server 102 that the corresponding file fragmentation of url list is issued again.Resource downloading server 102 is receiving After pre-alert notification, file point corresponding with the download resource url list being eliminated can be downloaded from spare true source server 103 Piece, or obtain file fragmentation corresponding with the download resource url list being eliminated from resource publisher server 201.
The method of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, by file verification information, file fragmentation to be downloaded source-information via statistics Server is reported to goods receiving server, and goods receiving server sync updates resource index database data, shields mistake Download resource URL, so as to effectively prevent other clients from mistake downloads resource URL download to mistake file divide Piece improves the success rate that data are downloaded.
5th embodiment
Fig. 6 is the flow chart of the method for the downloading data that fifth embodiment of the invention provides.As shown in fig. 6, the embodiment The report flow for describing client, in conjunction with Fig. 3, the method for downloading data provided in this embodiment includes the following steps:
Step S71, client download file fragmentation to be downloaded from resource downloading server and peer client respectively.
Step S72, client inquire the file verification of the current file fragmentation downloaded and completed from resource index server Information.
If client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, Then step S73:The file fragmentation completed of downloading is verified.
Step S74, if verify out download completion file fragmentation and file fragmentation to be downloaded it is inconsistent, by file school Test the download resource url list of the corresponding resource downloading server of information, file fragmentation to be downloaded and corresponding resource downloading The IP address of server is reported to statistical server, or the identity of peer client is reported to statistical server.
Step S71 can refer to the corresponding steps of fourth embodiment to step S74, repeat no more herein.
If the client does not inquire the text of the current file fragmentation downloaded and completed on the resource index server Part check information, thens follow the steps S75:According to presetting rule, generate and the text corresponding to the current file fragmentation downloaded and completed Part check information.
Specifically, if client 101 does not inquire the current file point downloaded and completed from resource index server 104 The file verification information of piece will then download the file fragmentation completed and be considered as new file, according to the URL for downloading the file fragmentation completed The file verification information for generating the file fragmentation that the download is completed is calculated, such as:Cryptographic Hash.
Step S76, by the file verification information of generation and the current identification information for downloading the file fragmentation completed It is reported to goods receiving server, so that the goods receiving server is by the file verification information of the generation and described works as Resource index database is written in the preceding identification information for downloading the file fragmentation completed.
Specifically, goods receiving server 202 receives the file verification information and currently downloaded that client 101 reports At file fragmentation identification information, first to resource index database 204 inquiry whether have corresponding information, if can not inquire Corresponding information, then the file verification information directly reported client 101 and the current mark for downloading the file fragmentation completed Resource index database 204 is written in information, if there is corresponding information, check relevant field (such as:File size, Hash marks) Whether content is consistent, if inconsistent, calls legitimacy, the validity for downloading the verification storage data of authentication server 205, and root According to verification result, the text of the current file fragmentation for downloading completion reported with client 101 in update resource index database 204 The part check information information corresponding with identification information.Wherein, authentication server 205 is downloaded to be sent to for verifying client 101 The storage data of goods receiving server 202.
The method of downloading data provided in an embodiment of the present invention is not being looked into from resource index server by client When asking the file verification information of the current file fragmentation downloaded and completed, the current file downloaded and completed is generated according to presetting rule The file verification information of fragment is simultaneously reported to goods receiving server, then by the verified rear write-in resource of goods receiving server Index data base, it can be ensured that the correctness of file check information in resource index database is prevented because of file verification information Data failed download caused by mistake, and then improve the success rate that data are downloaded.
Sixth embodiment
Fig. 7 is the structural schematic diagram for the client that sixth embodiment of the invention provides.Client provided in this embodiment can Method for realizing the downloading data in first embodiment.As shown in fig. 7, client 700 includes:Enquiry module 701, under Carry module 702, correction verification module 703.
Wherein enquiry module 701 is used to be used as entrance by original URL to download to resource index server query resource and take The downloads resource url list of device, the IP address of spare true source server of being engaged in and to tracking server inquiry peer client List.
Download module 702 is used to be arranged according to the download resource url list and peer client of the resource downloading server Table downloads file fragmentation to be downloaded from the resource downloading server and the peer client;If being additionally operable to verify out When the file fragmentation for downloading completion and the file fragmentation to be downloaded are inconsistent, according to the spare true source server IP address download file fragmentation identical with the file fragmentation to be downloaded to the spare true source server request.
Correction verification module 703 is used for according to the file verification information by being obtained on the resource index server, to having downloaded At file fragmentation verified.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 700 refers to above-mentioned Fig. 1 to scheming Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for When the file fragmentation of download is inconsistent, downloaded to spare true source server request according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded, since the data in spare true source server are sent out by original operator resource Cloth person actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively improve number According to the success rate of download.
7th embodiment
Fig. 8 is the structural schematic diagram for the client that fifth embodiment of the invention provides.Client provided in this embodiment can Method for realizing second embodiment and the downloading data in 3rd embodiment.As shown in figure 8, client 800 includes:It looks into Ask module 801, download module 802, correction verification module 803, reporting module 804, generation module 805.
Enquiry module 801 is used to be used as entrance to resource index server query resource download server by original URL Download resource url list, spare true source server IP address and to tracking server inquiry peer client row Table.
Download module 802 is used to be arranged according to the download resource url list and peer client of the resource downloading server Table downloads file fragmentation to be downloaded from the resource downloading server and the peer client;If being additionally operable to verify out When the file fragmentation for downloading completion and the file fragmentation to be downloaded are inconsistent, according to the spare true source server IP address download file fragmentation identical with the file fragmentation to be downloaded to the spare true source server request;Also If verifying out the file fragmentation for downloading completion for the correction verification module and the file fragmentation to be downloaded being inconsistent, Slicing files to be downloaded are downloaded by the original URL;If being additionally operable to through the original URL file fragmentations downloaded and institute It is inconsistent to state file fragmentation to be downloaded, then execute it is described to the spare true source server request download with it is described to be downloaded The identical file fragmentation of file fragmentation.
Preferably, the file fragmentation identical with the file fragmentation to be downloaded is existed by the resource publisher server Resource will be downloaded while be sent to the resource downloading server, be sent to the spare true source server.
Correction verification module 803 is used for according to the file verification information by being obtained on the resource index server, to having downloaded At file fragmentation verified;It is additionally operable to according to the verification cryptographic Hash obtained from the resource index server, to downloading The file fragmentation of completion is verified.
Preferably, the verification cryptographic Hash by the goods receiving server according to resource publisher server send described in It downloads the file fragmentation completed and calculates generation in the download resource url list of the resource downloading server, and be sent to described Resource index server.
If reporting module 804 is used to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded not Unanimously, then by the file verification information, the download resource of the corresponding resource downloading server of the file fragmentation to be downloaded The IP address of url list and the corresponding resource downloading server is reported to the statistical server, or the equity is objective The identity at family end is reported to the statistical server;It is additionally operable to the file verification information that will be generated and the current download The identification-information reporting of the file fragmentation of completion gives goods receiving server, so that the goods receiving server is by the generation File verification information and it is described it is current download complete file fragmentation identification information be written resource index database;Also use The identical file fragmentation of file fragmentation to be downloaded described in Yu Dangyu, which is downloaded, to be completed, then by with the file fragmentation phase to be downloaded With the download information of file fragmentation be reported to the statistical server, the download information include download the used time, speed of download, Download result, file fragmentation size and security attribute information.
If generation module 805 is used to not inquire the current file fragmentation downloaded and completed on the resource index server File verification information generate the current file verification downloaded corresponding to the file fragmentation completed then according to presetting rule Information.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 800 refers to above-mentioned Fig. 1 to scheming Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for When the file fragmentation of download is inconsistent, downloaded to spare true source server request according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded, since the data in spare true source server are sent out by original operator resource Cloth person actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively improve number According to the success rate of download.
8th embodiment
Fig. 9 is the structural schematic diagram for the client that eighth embodiment of the invention provides.Client provided in this embodiment can Method for realizing the downloading data in fourth embodiment.As shown in figure 9, client 900 includes:Download module 901, school Test module 902.
Wherein download module 901 from resource downloading server and peer client for downloading file to be downloaded respectively Fragment.
Correction verification module 902 from resource index server for inquiring the current file verification for downloading the file fragmentation completed Information verifies the file fragmentation completed of downloading.
If download module 901 is additionally operable to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded It is inconsistent, then the download of the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded is provided Origin url list and IP address are reported to the statistical server, or the identity of the peer client are reported to described Statistical server.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 900 refers to above-mentioned Fig. 1 to scheming Particular content described in 6 illustrated embodiments, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by verify out download completion file fragmentation with wait for When the file fragmentation of download is inconsistent, by file verification information, file fragmentation to be downloaded source-information via statistical fractals Device is reported to goods receiving server, and goods receiving server sync updates resource index database data, shields under mistake Resource URL is carried, so as to effectively prevent other clients to download to wrong file fragmentation from the download resource URL of mistake, is carried The success rate that high data are downloaded.
9th embodiment
Figure 10 is the structural schematic diagram for the client that ninth embodiment of the invention provides.Client provided in this embodiment can Method for realizing the downloading data in the 5th embodiment.As shown in Figure 10, client 1000 includes:Download module 1010, correction verification module 1020, check information generation module 1030 and reporting module 1040.
Wherein download module 101 from resource downloading server and peer client for downloading file to be downloaded respectively Fragment.
Correction verification module 1020 from resource index server for inquiring the current file school for downloading the file fragmentation completed Information is tested, the file fragmentation completed of downloading is verified.
If download module 1010 is additionally operable to verify out the file fragmentation for downloading completion and the file to be downloaded point Piece is inconsistent, then by the file verification information, the download of the corresponding resource downloading server of the file fragmentation to be downloaded Resource url list and IP address are reported to the statistical server, or the identity of the peer client is reported to institute State statistical server.
Work as if check information generation module 1030 does not inquire for the client on the resource index server The preceding file verification information for downloading the file fragmentation completed generates and the current file point downloaded and completed then according to presetting rule File verification information corresponding to piece.
The file fragmentation that the file verification information and the current download that reporting module 1040 is used to generate are completed Identification-information reporting gives goods receiving server so that the goods receiving server by the file verification information of the generation with And resource index database is written in the current identification information for downloading the file fragmentation completed.
The detailed process of the respective function of each Implement of Function Module of the present embodiment client 1000, refers to above-mentioned Fig. 1 extremely Particular content described in embodiment illustrated in fig. 6, details are not described herein again.
The client of downloading data provided in an embodiment of the present invention, by not inquired from resource index server When the current file verification information for downloading the file fragmentation completed, the current file fragmentation downloaded and completed is generated according to presetting rule File verification information and be reported to goods receiving server, then by goods receiving server it is verified after be written resource index Database, it can be ensured that the correctness of file check information in resource index database prevents the mistake because of file verification information Caused by data failed download, and then improve data download success rate.
Tenth embodiment
The application environment of the method for the downloading data of first embodiment of the invention offer is provided referring again to Fig. 1, Fig. 1 Figure can also be used as the structural schematic diagram of the system of the downloading data of tenth embodiment of the invention offer.As shown in Figure 1, this hair The system 10 for the downloading data that bright sixth embodiment provides includes:Client 101 passes through wirelessly or non-wirelessly network and client 101 be in communication with each other resource downloading server 102, spare true source server 103, resource index server 104, follow-up service Device 105 and peer client 106.
Client 101 is used as entrance by original URL (Uniform Resource Locator, uniform resource locator) The download resource url list, spare true for being stored with the resource downloading server for downloading resource is inquired to resource index server 104 The IP address of actual source server 103 and to tracking server 105 inquire peer client list.
Resource index server 104 is according to the inquiry request of client 101, by the download resource of resource downloading server Url list and the file verification information for downloading resource are sent to client 101.
Peer client list is sent to client 101 by tracking server 105 according to the inquiry request of client 101.
Download resource url list and peer client list of the client 101 according to the resource downloading server inquired, File fragmentation to be downloaded is downloaded from resource downloading server 102 and peer client 106, according to by resource index server The file verification information obtained on 104 is verified to downloading the file fragmentation completed, if verifying out the file point of download completion Piece and file fragmentation to be downloaded are inconsistent, then according to the IP address of spare true source server 103 to spare real source service File fragmentation identical with file fragmentation to be downloaded is downloaded in the request of device 103.
Spare true source server 103 is according to the request of client 101, the file fragmentation transmission that client 101 is asked To client 101.
The system of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry The success rate that high data are downloaded.
11st embodiment
Referring to Fig. 3, showing the applied environment figure of the method for the downloading data of second embodiment of the invention offer, also may be used Using the structural schematic diagram of the system of the downloading data provided as eleventh embodiment of the invention.As shown in figure 3, different from Fig. 1 , system 20 provided in this embodiment is in addition to resource downloading server 102, spare true source server 103, resource index clothes It is engaged in except device 104, tracking server 105 and peer client 106, further includes resource publisher server 201, goods receiving Server 202, resource index database 204, downloads authentication server 205 at statistical server 203.
It is multiple file fragmentations that resource publisher server 201 will download division of resources first, in accordance with default segmentation strategy, so Resource will be downloaded afterwards and is published to resource downloading server 102 and spare true source server 103, and will be downloaded after the completion of publication Under the original URL (Uniform Resource Locator, uniform resource locator) of resource, resource downloading server 102 Carry resource url list, IP (Internet Protocol, procotol) address of spare true source server 103 is sent to money Source is put in storage server 202.Include the multiple texts for downloading resource in the download resource url list of above-mentioned resource downloading server 102 URL of the part fragment in different resource download server.Resource downloading server 102 may include ISP (Internet Service Provider, Internet Service Provider) and cache server and CDN (Content Delivery Network, it is interior Content distributing network) cache server.Since CDN cache server ratio ISP cache server error rates are lower, service quality and peace Full property higher, it is preferable that resource publisher server 201 is published to CDN cache servers by resource is downloaded.
The download for the resource downloading server 102 that goods receiving server 202 is sent according to resource publisher server 201 provides Origin url list calculates the cryptographic Hash of the URL of each file fragmentation, and by the cryptographic Hash of the URL of calculated each file fragmentation, The cryptographic Hash of the URL of each file fragmentation and the mapping relations of the URL of each file fragmentation, the original URL for downloading resource, resource The download resource url list of download server 102, the IP address of spare true source server 103 are stored in resource index data Library 204 directly covers the relative recording if having there is relative recording in resource index database 204.
Statistical server 203 counts the check information and download information that client 101 reports, and client 101 is reported Check information is reported to goods receiving server 202, the verification reported according to client 101 so as to goods receiving server 202 Data in information update resource index database 204, while improving data query service for goods receiving server 202.
Authentication server 205 is downloaded for verifying the storage data that client 101 is sent to goods receiving server 202.
The system of downloading data provided in an embodiment of the present invention, by client in the file fragmentation for verifying out download completion When inconsistent with file fragmentation to be downloaded, asked to spare true source server according to the IP address of spare true source server File fragmentation identical with file fragmentation to be downloaded is downloaded, since the data in spare true source server are provided by original operator Source publisher actively constructs, and is accessed by IP address, it is thus ensured that the correctness of resource is downloaded, so as to effectively carry The success rate that high data are downloaded.
12nd embodiment
1 is please referred to Fig.1, the structural schematic diagram of the system of the downloading data of twelveth embodiment of the invention offer is provided. As shown in figure 11, the system 1100 of downloading data provided in this embodiment includes:Client 1110, resource index server 1120, statistical server 1130, resource downloading server 1140 and peer client 1150.
Each device realizes that the detailed process of function is please referred to Fig.1 to Fig. 6 pairs in the system of downloading data in the present embodiment Answer embodiment method and Fig. 7 to the device of Figure 10 corresponding embodiments, details are not described herein again.
It should be noted that each embodiment in this specification is described in a progressive manner, each embodiment weight Point explanation is all difference from other examples, and the same or similar parts between the embodiments can be referred to each other. For device class embodiment, since it is basically similar to the method embodiment, so fairly simple, the related place ginseng of description See the part explanation of embodiment of the method.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that process, method, article or device including a series of elements are not only wanted including those Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or device Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or device including the element.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it Its mode is realized.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only A kind of division of logic function, formula that in actual implementation, there may be another division manner, such as:Multiple units or component can combine, or It is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition portion It can be the INDIRECT COUPLING by some interfaces, equipment or unit to divide mutual coupling or direct-coupling or communication connection Or communication connection, can be electrical, mechanical or other forms.
The above-mentioned unit illustrated as separating component can be or may not be and be physically separated, aobvious as unit The component shown can be or may not be physical unit, you can be located at a place, may be distributed over multiple network lists In member;Some or all of wherein unit can be selected according to the actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in various embodiments of the present invention can be fully integrated into a processing module, also may be used It, can also be during two or more units be integrated in one unit to be each unit individually as a unit;It is above-mentioned The form that hardware had both may be used in integrated unit is realized, can also be realized in the form of hardware adds SFU software functional unit.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above method embodiment can pass through The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned includes:It is movable storage device, read-only Memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or The various media that can store program code such as person's CD.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.

Claims (5)

1. a kind of method of downloading data, which is characterized in that including:
Client downloads file fragmentation to be downloaded from resource downloading server and peer client respectively;
The client inquires the file verification information of the current file fragmentation downloaded and completed from resource index server, to institute The file fragmentation downloaded and completed is stated to be verified;
If verifying out the file fragmentation for downloading completion and the file fragmentation to be downloaded being inconsistent, by the file school Information, the download resource url list of the corresponding resource downloading server of the file fragmentation to be downloaded and IP address is tested to report It is reported to the statistical server to statistical server, or by the identity of the peer client.
2. according to the method described in claim 1, it is characterized in that, the method further includes:
If the client does not inquire the file school of the current file fragmentation downloaded and completed on the resource index server Information is tested, then according to presetting rule, is generated and the file verification information corresponding to the current file fragmentation downloaded and completed;
The file verification information of generation and the current identification-information reporting for downloading the file fragmentation completed are entered to resource Library server, so that the goods receiving server completed the file verification information of the generation and the current download Resource index database is written in the identification information of file fragmentation.
3. a kind of client, which is characterized in that including:
Download module, for downloading file fragmentation to be downloaded from resource downloading server and peer client respectively;
Correction verification module, for inquiring the current file verification information for downloading the file fragmentation completed from resource index server, The file fragmentation completed of downloading is verified;
Wherein, download module, if being additionally operable to verify out the file fragmentation for downloading completion and the file fragmentation to be downloaded It is inconsistent, then the download of the file verification information, the corresponding resource downloading server of the file fragmentation to be downloaded is provided Origin url list and IP address are reported to statistical server, or the identity of the peer client is reported to the statistics Server.
4. client according to claim 3, which is characterized in that further include:
Check information generation module has currently been downloaded if not inquired on the resource index server for the client At file fragmentation file verification information, then according to presetting rule, generate with corresponding to the current file fragmentation downloaded and completed File verification information;
Reporting module, the file verification information for that will generate and the current identification information for downloading the file fragmentation completed It is reported to goods receiving server, so that the goods receiving server is by the file verification information of the generation and described works as Resource index database is written in the preceding identification information for downloading the file fragmentation completed.
5. a kind of system of downloading data, which is characterized in that the system comprises:
Client, resource index server, statistical server, resource downloading server and peer client;
The wherein described client, for downloading file to be downloaded point from resource downloading server and peer client respectively Piece is inquired the file verification information of the current file fragmentation downloaded and completed from resource index server, is completed to the download File fragmentation verified, and when verify out it is described download complete file fragmentation differ with the file fragmentation to be downloaded When cause, by the file verification information, the download resource URL of the corresponding resource downloading server of the file fragmentation to be downloaded List and IP address are reported to the statistical server, or the identity of the peer client is reported to the statistics and is taken Business device;
The resource index server, for the inquiry request according to the client, by the file fragmentation to be downloaded Check information is sent to the client;
The statistical server, for receive the client verify out it is described download complete file fragmentation with it is described wait under When the file fragmentation of load is inconsistent, the corresponding resource downloading of the check information, the file fragmentation to be downloaded reported takes The download resource url list of business device and the identity of IP address or peer client;
The resource downloading server and peer client ask the client for the request according to the client The file fragmentation asked is sent to the client.
CN201810518014.0A 2013-07-12 2013-07-12 Method, client and system for downloading data Active CN108810111B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810518014.0A CN108810111B (en) 2013-07-12 2013-07-12 Method, client and system for downloading data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810518014.0A CN108810111B (en) 2013-07-12 2013-07-12 Method, client and system for downloading data
CN201310293521.6A CN104283933B (en) 2013-07-12 2013-07-12 Method, client and the system of downloading data

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201310293521.6A Division CN104283933B (en) 2013-07-12 2013-07-12 Method, client and the system of downloading data

Publications (2)

Publication Number Publication Date
CN108810111A true CN108810111A (en) 2018-11-13
CN108810111B CN108810111B (en) 2020-08-07

Family

ID=52258409

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201310293521.6A Active CN104283933B (en) 2013-07-12 2013-07-12 Method, client and the system of downloading data
CN201810518014.0A Active CN108810111B (en) 2013-07-12 2013-07-12 Method, client and system for downloading data

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201310293521.6A Active CN104283933B (en) 2013-07-12 2013-07-12 Method, client and the system of downloading data

Country Status (1)

Country Link
CN (2) CN104283933B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109413200A (en) * 2018-11-26 2019-03-01 Oppo(重庆)智能科技有限公司 A kind of method, client, MES and electronic equipment that resource imports
CN109492436A (en) * 2018-11-29 2019-03-19 深圳市网心科技有限公司 A kind of file verification method and relevant apparatus
CN111314403A (en) * 2018-12-12 2020-06-19 阿里巴巴集团控股有限公司 Method and device for checking resource consistency
CN113411364A (en) * 2020-03-16 2021-09-17 北京金山云网络技术有限公司 Resource acquisition method and device and server
CN114422507A (en) * 2022-01-27 2022-04-29 北京金山云网络技术有限公司 File downloading method and device and electronic equipment
WO2023226887A1 (en) * 2022-05-27 2023-11-30 华为技术有限公司 Service disaster recovery method, terminal device, software development kit server, and communication system

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105357543B (en) * 2015-10-23 2019-01-22 深圳市网心科技有限公司 The cross-platform point-to-point video transmission method of one kind and device
CN106254440B (en) * 2016-07-29 2019-12-06 杭州迪普科技股份有限公司 AP upgrading method and device
CN106791884B (en) * 2016-08-19 2019-11-19 炫熵(上海)互联网科技有限公司 The holding system and method for the video data consistency of P2P live streaming
CN108111561B (en) * 2016-11-25 2021-03-02 腾讯科技(深圳)有限公司 Data downloading method and equipment thereof
CN106686083B (en) * 2016-12-29 2019-09-17 北京奇艺世纪科技有限公司 A kind of video file method for down loading and device
CN107528825A (en) * 2017-07-06 2017-12-29 努比亚技术有限公司 A kind of resource downloading method, terminal and computer-readable recording medium
CN109040190B (en) * 2018-07-02 2022-03-22 咪咕文化科技有限公司 Scheduling method, device and computer readable storage medium
CN110889143B (en) * 2018-09-07 2023-05-30 阿里巴巴集团控股有限公司 File verification method and device
CN111586170B (en) * 2020-05-07 2023-05-23 广州博冠信息科技有限公司 Resource downloading method, device, equipment and computer readable storage medium
CN112422603A (en) * 2020-06-09 2021-02-26 上海哔哩哔哩科技有限公司 Resource downloading method, system and device
CN114157644A (en) * 2021-11-29 2022-03-08 广东明创软件科技有限公司 Resource downloading method and device, electronic equipment and storage medium
CN117240478B (en) * 2023-11-13 2024-02-13 深圳合纵富科技有限公司 POS machine data transmission method and system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060212584A1 (en) * 2005-03-15 2006-09-21 Qian Xiang Shi Ji (Beijing) Technology Development Co. Ltd. Method and system for accelerating downloading of web page content by a peer-to-peer network
CN101079709A (en) * 2006-06-15 2007-11-28 腾讯科技(深圳)有限公司 Single-node-to-multi-node concurrent download system and method
US20110131336A1 (en) * 2009-12-01 2011-06-02 Synacast Computer System (Shanghai) Co., Ltd. Method and device for file transmission based on multiple protocols
CN102750287A (en) * 2011-04-21 2012-10-24 腾讯科技(深圳)有限公司 Method for including index information and download authentication server
CN102752326A (en) * 2011-04-19 2012-10-24 腾讯科技(深圳)有限公司 Method, client, server and system for processing data in file downloading
CN102833293A (en) * 2011-06-17 2012-12-19 腾讯科技(深圳)有限公司 Method for downloading resources in peer to server and peer (P2SP) network, and client

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005058006A1 (en) * 2005-12-05 2007-06-06 Siemens Ag Method and peer network for determining the peer network originating stadium of a file
CN102025444A (en) * 2009-09-09 2011-04-20 腾讯科技(深圳)有限公司 Resource publishing method, resource downloading method and data verification system
CN102325167A (en) * 2011-07-21 2012-01-18 杭州微元科技有限公司 Verifying method for network file transmission
CN103108008B (en) * 2011-11-14 2017-09-22 腾讯科技(深圳)有限公司 A kind of method and file download system for downloading file

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060212584A1 (en) * 2005-03-15 2006-09-21 Qian Xiang Shi Ji (Beijing) Technology Development Co. Ltd. Method and system for accelerating downloading of web page content by a peer-to-peer network
CN101079709A (en) * 2006-06-15 2007-11-28 腾讯科技(深圳)有限公司 Single-node-to-multi-node concurrent download system and method
US20110131336A1 (en) * 2009-12-01 2011-06-02 Synacast Computer System (Shanghai) Co., Ltd. Method and device for file transmission based on multiple protocols
CN102752326A (en) * 2011-04-19 2012-10-24 腾讯科技(深圳)有限公司 Method, client, server and system for processing data in file downloading
CN102750287A (en) * 2011-04-21 2012-10-24 腾讯科技(深圳)有限公司 Method for including index information and download authentication server
CN102833293A (en) * 2011-06-17 2012-12-19 腾讯科技(深圳)有限公司 Method for downloading resources in peer to server and peer (P2SP) network, and client

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109413200A (en) * 2018-11-26 2019-03-01 Oppo(重庆)智能科技有限公司 A kind of method, client, MES and electronic equipment that resource imports
CN109413200B (en) * 2018-11-26 2021-04-23 Oppo(重庆)智能科技有限公司 Resource import method, client, MES and electronic equipment
CN109492436A (en) * 2018-11-29 2019-03-19 深圳市网心科技有限公司 A kind of file verification method and relevant apparatus
CN111314403A (en) * 2018-12-12 2020-06-19 阿里巴巴集团控股有限公司 Method and device for checking resource consistency
CN113411364A (en) * 2020-03-16 2021-09-17 北京金山云网络技术有限公司 Resource acquisition method and device and server
CN113411364B (en) * 2020-03-16 2022-10-11 北京金山云网络技术有限公司 Resource acquisition method and device and server
CN114422507A (en) * 2022-01-27 2022-04-29 北京金山云网络技术有限公司 File downloading method and device and electronic equipment
WO2023226887A1 (en) * 2022-05-27 2023-11-30 华为技术有限公司 Service disaster recovery method, terminal device, software development kit server, and communication system

Also Published As

Publication number Publication date
CN104283933A (en) 2015-01-14
CN108810111B (en) 2020-08-07
CN104283933B (en) 2018-11-23

Similar Documents

Publication Publication Date Title
CN104283933B (en) Method, client and the system of downloading data
US7076608B2 (en) Invalidating cached data using secondary keys
US9137190B2 (en) System and method for content-based message distribution
CN104283723B (en) Network access log processing method and processing device
CN105045770B (en) A kind of document redaction automatic reminding method
CN102985921B (en) There is the client terminal device high speed caching electronic document resources of e-sourcing data base
CN107203541A (en) Page loading method and its page loading device
US10089395B2 (en) Third party content integration for search engine optimization
CN103365865A (en) Methods and devices for storing and downloading data
CN112367684B (en) Flow control method, device, storage medium and computer equipment
CN108683668A (en) Resource checksum method, apparatus, storage medium and equipment in content distributing network
CN108710681A (en) File acquisition method, device, equipment and storage medium
US20020032781A1 (en) Intermediary server apparatus and an information providing method
CN104410546A (en) Testing method and device of real-time processing system
CN109729183A (en) Request processing method, device, equipment and storage medium
CN108153776A (en) Data query method and device
CN104935653A (en) Bypass cache method for visiting hot spot resource and device
CN112260988B (en) Abnormal request processing method and device
CN107992350B (en) Method and device for generating configuration overview page
US10320731B2 (en) System and method for threading electronic messages
CN108063835B (en) Outer net domain name analytic method, server and system
CN111767306A (en) Shared information query system, method, device and equipment
CN103731399A (en) Data access method, system and device based on CDN
RU2372656C2 (en) System and method of forming and distributing information on goods
AU2017379313B2 (en) Method and system for collecting digital documents from a plurality of sources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant