CN106850817A

CN106850817A - A kind of download management equipment, method and data downloading system

Info

Publication number: CN106850817A
Application number: CN201710084177.8A
Authority: CN
Inventors: 徐铁城; 陈超
Original assignee: Beijing Qihoo Technology Co Ltd
Current assignee: Beijing Qihoo Technology Co Ltd
Priority date: 2012-12-10
Filing date: 2012-12-10
Publication date: 2017-06-13
Also published as: CN103036967A; CN103036967B

Abstract

The invention discloses a kind of download management equipment, method and data downloading system, wherein, the download management equipment includes：Buffer, is configured as caching the synopsis of each file and each file obtained from data source nodes, and the synopsis of this document is the data generated using specific data conversion to the content of file；Resolver, is configured as obtaining the file download request from client device, and the synopsis of asked file is parsed according to the download address that file download is asked；Finger, is configured as being searched in both the buffers according to the synopsis of file, if found, the file that will be asked is transmitted to client device；And source device is returned, when being configured as not finding in both the buffers, asked file is obtained from related data source nodes, and transmit to client device, and the file that will be asked is supplied to buffer to be cached.

Description

A kind of download management equipment, method and data downloading system

Technical field

The present invention relates to data downloading technology field, and in particular to a kind of download management equipment in fringe node, A kind of data downloading system, and a kind of downloading management method in data downloading system.

Background technology

Existing CDN (Content Delivery Network, content distributing network) is by by data distribution to each side Edge node, furthers with the distance of client to improve data access speed.Its basic ideas is to avoid having on internet as far as possible The bottleneck and link of data transmission bauds and stability may be influenceed, make content transmission faster, it is more stable.CDN system can Connection in real time according to network traffics and each node, load state and to the integrated information such as the distance of user and response time The request of user is re-directed on the service node nearest from user.

But, due to existing each CDN node can all of file in source data cached as much as possible, therefore can band Carry out larger carrying cost.And the content of some files does not change, only download address, such as URL of file Change is there occurs, according to the cache way of existing CDN, many parts of texts that content is identical, URL is different can be also cached in a node Part, i.e. repeated data are cached, so as to further cause the relatively costly of storage.

The content of the invention

In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on State problem for download management equipment, the data downloading system in fringe node, and under in data downloading system Carry management method.

According to one aspect of the present invention, there is provided a kind of download management equipment in fringe node, including：Caching Device, is configured as caching the synopsis of each file and each file obtained from data source nodes, and the content of file is plucked If the data generated using specific data conversion to the content of file；Resolver, is configured as obtaining from client device File download request, and the synopsis of asked file is parsed according to the download address that file download is asked；Search Device, the synopsis of the file asked for being configured as being parsed according to resolver searches asked text in both the buffers Part, if found, the file that will be asked is transmitted to client device；And source device is returned, it is configured as finger and exists When not finding asked file in buffer, asked text is obtained from the related data source nodes of the file asked Part, and transmit to client device, and the file that will be asked is supplied to buffer to be cached.

Optionally, each several part that source device is suitable to partly be obtained from data source nodes one by one asked file is returned, and together When transmit acquired part in asked file to client device, until obtaining asked file completely untill.

Optionally, returning source device includes：Data source query module, is configured as according to the known text for returning source table and being asked The download address of part inquires about the related data source nodes of asked file；Source module is directly returned, fringe node is configured as It is the fringe node of the first carrier network, and the data source nodes of the file the asked correlation for being inquired include first During the data source nodes of carrier network, directly asked file is obtained from the data source nodes of the first carrier network；Generation Source module is managed back, fringe node is configured as and is the fringe node of the first carrier network, and being asked of being inquired File related data source nodes when being the data source nodes of the second carrier network, by the first carrier network to second The Agent cluster of carrier network obtains asked file from the related data source nodes of the second carrier network；And caching Notification module, is configured as by directly returning source module or act on behalf of back after source module gets asked file, notice Buffer is cached to the file asked.

Optionally, the synopsis of file includes：One kind in secure Hash calculation sha series datas, or, informative abstract One kind in calculation MD series datas.

Optionally, download management equipment is varniash caching servers.

According to another aspect of the invention, there is provided a kind of data downloading system, including fringe node, be different operators The Agent cluster of information exchange service, and data source nodes are provided between network, wherein fringe node includes above-described Download management equipment.

Optionally, also include：The above-described management equipment for providing file download address, fringe node is received File download request download address provided by for providing the management equipment of file download address.

Optionally, it is that the Agent cluster that information exchange service is provided between different operators network includes first operator's net Network to the second carrier network Agent cluster, and the second carrier network is to the Agent cluster of the first carrier network, its In, the first carrier network to the Agent cluster of the second carrier network includes：Edge side the first carrier network Agent cluster, It is configured as receiving the file download request of the fringe node from the first carrier network, and to the first carrier network Fringe node returns to asked file；Transmission channel, is configured as from edge side the first carrier network Agent cluster to source Side the second carrier network Agent cluster transmission information, and from source node side the second carrier network Agent cluster to edge side First carrier network Agent cluster transmission information；And source node side the second carrier network Agent cluster, it is configured as root Asked according to the file download from edge side the first carrier network Agent cluster received by transmission channel, to the second operation The related data source nodes of business's network send file download request, and receive the related data source nodes of the second carrier network The file asked for returning, and transmitted to edge side the first carrier network Agent cluster by transmission channel；

Second carrier network to the Agent cluster of the first carrier network includes：The carrier network of edge side second is acted on behalf of Cluster, is configured as receiving the file download request of the fringe node from the second carrier network, and to the second operator The fringe node of network returns to asked file；Transmission channel, is configured as acting on behalf of collection from the carrier network of edge side second Group acts on behalf of collection to source node side the first carrier network Agent cluster transmission information, and from the carrier network of source node side first Group is to edge side the second carrier network Agent cluster transmission information；And source node side the first carrier network Agent cluster, It is configured as being asked according to the file download from edge side the second carrier network Agent cluster received by transmission channel, File download is sent to the related data source nodes of the first carrier network to ask, and receive the first carrier network correlation The file asked that data source nodes are returned, and transmitted to the carrier network of edge side second agency's collection by transmission channel Group.

According to another aspect of the present invention, there is provided a kind of downloading management method in data downloading system, data Download system at least includes fringe node and data source nodes, and the downloading management method includes：Fringe node is obtained and comes from client The file download request of end equipment, and plucked according to the content that the download address that file download is asked parses asked file Will；Fringe node searches whether there is asked file in the buffer according to the synopsis of the file asked, if deposited The file that will then be asked is transmitted to client device；And if not finding asked file in the buffer, then Fringe node obtains asked file from the related data source nodes of the file asked, and transmits to client device；Side File and the synopsis of file that edge nodal cache is obtained from data source nodes, the synopsis of file is in file Hold the data using the generation of specific data conversion.

Embodiments in accordance with the present invention, will can be parsed from requested document download address file content summary as Whether cache file inquires about foundation, inquires about stored asked file in the buffer, rather than according to the whole of file URL is also in the buffer to judge whether according to whether the synopsis of file is identical during storage file similarly as search index It is same text document.Therefore, if two URL of file are different, but the content-data of file is substantially identical, then this document Synopsis is exactly identical, and then, if this document has been cached in fringe node before this, then subsequently even Client device sends a different file download address URL again, if the synopsis of this document with caching in it is consistent, So fringe node also will not again remove data source nodes repeated downloads this document, but directly the synopsis according to this document from This document is found in caching and is supplied to client device.Thus, the repeated data in caching is on the one hand reduced, on the other hand Improve the efficiency that file is downloaded for client device.

Further, fringe node obtains file by Agent cluster from data source nodes, when file is larger, can be one by one The partial each several part that requested document is obtained from data source nodes, and simultaneously in client device transmission requested document The Hui Yuan of the part of acquisition, i.e. non-blocking mode, it is possible to achieve allow client device to download in caching.Avoid and use CDN When, it is necessary to wait until the problem that whole file total caching could be downloaded, whole process client device without waiting for.

Described above is only the general introduction of technical solution of the present invention, in order to better understand technological means of the invention, And can be practiced according to the content of specification, and in order to allow the above and other objects of the present invention, feature and advantage can Become apparent, below especially exemplified by specific embodiment of the invention.

Brief description of the drawings

By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit is common for this area Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：

Fig. 1 shows data downloading system schematic diagram according to an embodiment of the invention；

Fig. 2 shows the management equipment schematic diagram for providing file download address according to an embodiment of the invention；

Fig. 3 shows the cache logic schematic diagram in buffer according to an embodiment of the invention；

Fig. 4 shows the Agent cluster schematic diagram of telecommunications according to an embodiment of the invention to Netcom；

Fig. 5 shows data downloading system schematic diagram according to an embodiment of the invention；

Fig. 6 shows the management method flow chart for providing file download address according to an embodiment of the invention； And

Fig. 7 shows the downloading management method flow in data downloading system according to an embodiment of the invention Figure.

Specific embodiment

The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here Limited.Conversely, there is provided these embodiments are able to be best understood from the disclosure, and can be by the scope of the present disclosure Complete conveys to those skilled in the art.

Fig. 1 is referred to, it is the data downloading system schematic diagram according to one embodiment of the invention.The download system includes The fringe node 100 of the first carrier network, the fringe node 200 of the second carrier network, the first carrier network to second The Agent cluster 300 of carrier network, the Agent cluster 400, first of the second carrier network to the first carrier network are runed The data source nodes 600 of the carrier network of data source nodes 500 and second of business's network.Additionally, be also show and this in figure Data downloading system has the client of the carrier network of client device 700 and second of the first carrier network of data interaction Equipment 800.It should be noted that the system fringe node, data source nodes, Agent cluster for including etc. can be one Or it is multiple.

Include downloading in the fringe node 200 of the carrier network of fringe node 100 and second of the first carrier network Management equipment 110, the download management equipment 110 specifically includes buffer 102, resolver 104, finger 106 and returns source device 108.The Agent cluster 300 of the first carrier network to the second carrier network specifically includes edge side the first carrier network generation Reason cluster 302, the first transmission channel 304 and source node side the second carrier network Agent cluster 306.Second carrier network Agent cluster 400 to the first carrier network specifically includes the transmission of the second carrier network of edge side Agent cluster 402, second Passage 404 and source node side the first carrier network Agent cluster 406.The data source nodes 500 of the first carrier network are wrapped Include multiple data source sections in the first carrier network such as data source nodes 1, data source nodes 2 and data source nodes n Point.The data source nodes 600 of the second carrier network are including data source nodes 1, data source nodes 2 and data source nodes n etc. Data source nodes of the multiple in the second carrier network.

Included due to the fringe node 200 of the carrier network of fringe node 100 and second of the first carrier network The structure of download management equipment 110 is identical, and flow chart of data processing is also just the same, only the operator residing for two fringe nodes Network is different, is responsible for the client device of connection different operators network, so the main side with the first carrier network below Illustrated as a example by the operation principle of edge node 100, the internal structure of the fringe node 200 of the second carrier network and work are former Reason is repeated no more with reference to the related embodiment content of the fringe node 100 of the first carrier network.

In one embodiment of the invention, file, tool are downloaded in certain client device 700 connection fringe node 100 request For body, client device 700 sends a file download and asks to fringe node 100, and the download request includes asking text The download address of part, after file download request is obtained, the download address according to this document download request is parsed resolver 104 The synopsis of the file asked.The download address comprising requested document in download request, download address is most common It is the URL (Uniform Resource Locator, URL) of requested document.In one of the invention implementation In example, client device 700 issues the URL and prior art of the requested document of the fringe node 100 of the first carrier network In URL it is different, URL of the prior art generally comprises protocol type, the host domain name of storage file, path and filename, The general format of URL is (with square brackets [] is option)：protocol://hostname[:Port ports]/path/ [； parameters][Query is inquired about] #fragment fragments；And the URL of requested document is except bag in embodiments of the present invention Containing more than beyond routine URL contents, the also synopsis of the file including being asked.

For example, traditionally, the existing conventional URL of demand file is：

http://wsdl11.yunpan.cn/share.phpMethod=Share.download＆xqid=X XXX＆ Nid=XXXX＆cqid=XXXX＆fname=1.txt＆e=XXXX＆st=XXXXX.Wherein, XXXX represents file path and text The specifying information of part name.

And in embodiments of the present invention, the URL of demand file is：

http://wsdl11.yunpan.cn/share.phpMethod=Share.download＆fhash= 4c9a055de0a290341abf7fff6a4d8c0f2af7f155＆xqid=XXXX＆nid=X XXX＆cqid=X XXX＆ Fname=1.txt＆e=XXXX＆st=XXXXX.

By contrasting two above URL, second URL a part of content more than first URL, i.e.,：

" fhash=4c9a055de0a290341abf7fff6a4d8c0f2af7f155 ", this partial content is asks Seek the synopsis of file.The synopsis of file is primarily referred to as using specific data transfer device next life for the content of file Into the data that can be identified to file content, synopsis computational algorithm is, for example, secure Hash calculation sha serial algorithms One kind, informative abstract in (sha1, sha224 and sha256 etc.) calculate MD serial algorithms (such as md3, md4 and md5) In one kind and other algorithms known in the art.As long as synopsis can be identical as the unique mark of file content The file corresponding content summary of content is identical, and the corresponding synopsis of file of different content is different, it is possible to generate this The method of synopsis is all within protection scope of the present invention.In general, carrying out certain number by the full content of file Unique mark according to the synopsis generated after conversion is stronger, but is also not precluded within some cases, only according to file The unique mark of synopsis that is generated of Partial key content can also meet actual demand, being also in this case can Capable.

The URL of file is usually that file is generated when data source nodes are uploaded to.With reference to an example, visitor is introduced How the URL of requested document is in the download request that family end equipment 100 is sent to the fringe node 100 of the first carrier network Obtain.Please also refer to Fig. 2, it illustrates the management for providing file download address according to an embodiment of the invention Equipment schematic diagram, the management equipment 210 includes resource localizer 212, summary generator 214 and download address maker 216. The management equipment 210 can be arranged in corresponding data source nodes, such as the data source nodes 500 of the first carrier network or Person is the data source nodes 600 of the second carrier network, it is also possible to set independently of outside data source nodes.Work as management equipment 210 independently of data source nodes when setting, and equivalent to each data source nodes server substantially only stored as a file, and management sets Standby 210 it is stored as a file outside, be responsible for the management equipment of the work such as file related management, maintenance, but management equipment 210 Can be in communication with each other between each data source nodes, be obtained in that various information mutually desired.

Specifically, on the one hand, after certain files passe to certain data source nodes, the money in management equipment 210 Source locator 212 is obtained with store path of this document in this data source nodes, and then is given birth to according to the store path Into the resource location information of file, i.e., equivalent to the content of path and this part of filename in generation this document URL, for example, generate Above this partial content in that URL example：wsdl11.yunpan.cn/share.phpMethod= Share.download＆xqid=XXXX＆nid=XXX X＆cqid=XXXX＆fname=1.txt＆e=XXXX＆st= XXXXX。

On the other hand, the summary generator 214 in management equipment 210 can know the tool of this document by data source nodes Hold in vivo, and then calculate the content of this document using various synopsis computational methods to generate the synopsis of file, before By the agency of crosses the various specific implementations of file content summary, and here is omitted.For example generate above that URL example In this partial content：

Fhash=4c9a055de0a290341abf7fff6a4d8c0f2af7f155.

Hereafter, this document that the download address maker 216 in management equipment 210 is provided according to resource localizer 212 The synopsis of this document that resource location information and summary generator 214 are provided, the complete download address of generation this document, such as URL, the synopsis of resource location information and this document in the URL at least including this document.For example generate to above that Complete URL in individual URL examples：

It can thus be seen that can be the various files for having uploaded to certain data source nodes by management equipment 210 Generate corresponding download address, such as URL.And then, when client device 100 needs to download certain file, it is possible to by point The various ways such as this document hit on website or the URL that checks this document obtain the download address of this document, then to edge Node sends includes the download request of the download address.So that the grade of the fringe node 100 edge section of the first carrier network Point obtains the URL of the file that client device 100 is asked, and not only includes conventional URL parameter in the URL, also includes The synopsis of requested document.As can be seen here, substantially, the requested document of client device 700 that fringe node 100 is obtained URL be that management equipment 210 is provided.

In one embodiment of the invention, in order to preferably ensure the security of data transfer, management equipment 210 for While file generated URL, can also be according in the full content or Partial key of preset signature generating mode and file URL Hold generation signature, such as the generation of the key message such as file content summary, file store path in URL is signed, when there is visitor When family end equipment 700 needs to download this document, file URL and corresponding signature are supplied to client device 700 together, and then Client device 700 includes file URL and corresponding signature when sending download request to fringe node 100.Fringe node 100 is tieed up Shield and the identical of management equipment 210 signature generating mode, the file download of client device 700 is received in fringe node 100 After request, resolver 104 voluntarily generates this document URL pairs according to the file URL for being asked and preset signature generating mode The signature answered, the signature comparison carried in the file download request that the signature that will voluntarily generate sends with client device 700, If consistent, judge that URL is not changed, carry out the relevant treatment of subsequent download file；If it is inconsistent, explanation client The file URL contents that end equipment 700 sends are changed, for instance it can be possible that the file content in the URL that has been maliciously tampered is plucked Will, and then mistake or illegal prompting can be returned to client device 700, no longer carry out the file download treatment of follow-up correlation.

It has been mentioned hereinbefore that the resolver 104 of fringe node 100 is after the download request for receiving client device 700, It is additionally operable to be parsed according to the download address of this document download request the synopsis of asked file.And then, fringe node The synopsis of the requested document that the finger 106 in 100 is parsed according to resolver 104 is searched in buffer 102, such as Fruit finds asked file, then the file that will directly be asked is transmitted to client device 700, without removing data source section again Point obtains this document.

Buffer 102 has been cached from each data source nodes (data source nodes 500 and second of such as the first carrier network Each data source nodes such as the data source nodes 600 of carrier network) obtain each file and each file synopsis. In one embodiment of the invention, if the file that client device 700 is asked has in buffer 102, directly will This document in buffer is supplied to client device 700；If do not had in buffer 102, it is necessary to related data source Node goes to download, and after the file for obtaining asked from data source nodes, is on the one hand cached to buffer 102 subsequently to use, On the other hand it is supplied to client device 700.

By process above as can be seen that each file stored in buffer 102 is obtained from data source nodes 's.Being additionally, since resolver 104 can parse the synopsis of file, if not having the synopsis pair in buffer 102 The file answered, will obtain according to file download request from related data source nodes, and the download address of file download request In the just synopsis comprising file, therefore buffer 102 has just known this article after this document is obtained from data source nodes What the corresponding synopsis of part is, and then the synopsis of this document and this document will be cached in buffer 102.Above Carried, the synopsis of file there are various specific implementations, such as can be the sha1, or MD5 of file.Additionally, Due to the general long but unique marks of sha1 more preferably, MD5 is shorter, be more conducive to storage, therefore, it can sha1 and MD5 It is used in combination with.Such as, the file content summary for being recorded in the URL of requested document is sha1, but buffer 102 can To carry out a data conversion again to sha1, generate shorter hash values, i.e. MD5, then store in the buffer be file with And the corresponding MD5 of file, using this MD5 as the locating file data in buffer 102 indexing key words key, such as Fig. 3 institutes Show the cache logic schematic diagram in buffer according to an embodiment of the invention.

Optionally, buffer 102 can also set caching effective time for each file, because buffer memory capacity is limited, By setting caching effective time, occupancy of the long-term no file to caching can be in time removed.Further, it is also possible to judge text Whether part needs caching, if some files are not suitable for caching, even if obtaining required file, buffer from data source nodes 108 will not also cache to it, and subsequently if client device 700 asks this document again, fringe node 100 can be again from number File is obtained according to source node be supplied to client device 700.In addition, buffer 102 can also be safeguarded to forbid for one downloading list, If the synopsis of the file that client device 700 is asked in this forbids downloading list, both will not by fringe node 100 This document is searched from buffer 102 and is sent to client device 700, will not also sent out by obtaining this document to data source nodes Client device 700 is given, but informs that this document of client device 700 is forbidden downloading.

Because buffer 102 has cache logic said before, therefore finger 106 can be according to requested document Synopsis is searched in buffer 102, if exist with the file content corresponding file of summary, if found, just This document in caching is directly sent to client device 700.

It should be noted that general each carrier network there can be multiple fringe nodes, can there are multiple operators again Network, the cache logic of buffer 102 can be all fringe nodes maintenance one, such as institute jointly of each carrier network There is same patrolling in the file for thering is telecommunications fringe node to safeguard that a cache logic, i.e. each telecommunications fringe node are obtained jointly The file cached in buffer 102 on volume, and then in the buffer 102 can be used for all telecommunications fringe nodes, that is, look into The file for looking for device 106 to be gone in the buffer 102 that this all telecommunications fringe node is safeguarded jointly needed for searching.Additionally, Can also be in units of region, i.e., multiple fringe nodes in certain region of same operator safeguard a buffer jointly 102, such as Pekinese's multiple telecommunications fringe node safeguards a buffer jointly, and multiple telecommunications fringe nodes in Shanghai are tieed up jointly Another buffer is protected, Pekinese's telecommunications fringe node can search whether required file in Pekinese's buffer, If do not found, it is considered as not having, data source nodes can only be gone to obtain；The telecommunications fringe node in Shanghai can be in Shanghai Required file is searched whether in buffer, if it did not, also can only again go data source nodes to obtain.Again or, can be with It is that each fringe node separately maintains a cache logic, i.e., each safeguards respective buffer 102, each fringe node is only The buffer of oneself can be searched, if do not found, it is necessary to go to obtain file to data source nodes.In a word, buffer 102 is slow Depositing logic can according to actual needs carry out different settings, and these are all within protection scope of the present invention.

If finger 106 does not find corresponding file according to the synopsis of file in buffer 102, lead to Know back source device 108, and then return source device 108 according to time source table and the download address from requested document from related data source nodes Asked file is obtained, and is transmitted and is stated client device 700, and the file that will be asked is supplied to the buffer 102 to carry out Caching.Specifically, one Hui Yuanbiao of maintenance in source device 108 is returned, documentary synopsis and/or number is recorded in this time source table Numbered according to source node, and the corresponding relation between data source nodes address.

So-called data source nodes numbering, it can be understood as be the numbering of data source nodes server or server cluster, still The right explanation by taking URL examples above as an example：

http://wsdl11.yunpan.cn/share.phpMethod=Share.download＆fhash= 4c9a055de0a290341abf7fff6a4d8c0f2af7f155＆xqid=XXXX＆nid=X XXX＆cqid=X XXX＆ Fname=1.txt＆e=XXXX＆st=XXXXX." 11 " in the URL behind " wsdl " are exactly the numbering of data source nodes, are led to Crossing the label can find host address corresponding with the numbering, such as the specific IP address of data source nodes in source table is returned. If it is a cluster for data source nodes that the label is corresponding, then can find many numbers in source table is returned by the numbering According to the host address of source node, and then any one main frame that time source device 108 can be therefrom obtains required file.

It is previously noted that the synopsis of file and the data source nodes of storage this document can also be preserved in the table of source due to returning Corresponding relation between address, and hence it is also possible to the address of the synopsis searching data source node using requested document. In Hui Yuanbiao, the synopsis of same file is likely to correspond to multiple data source nodes addresses, returns source device 108 and therefrom selects One address to corresponding data source nodes go obtain needed for file.

Either the data source nodes numbering in the URL of requested document searches the data source section of storage this document Point, the synopsis according further to requested document searches the data source nodes of storage this document, if only finding a data The file that source node storage has been asked, then directly go to obtain number of files according to the data source nodes address for returning the offer of source table According to.If finding multiple data source nodes, can according to actual needs there is multiple choices mode.For example, can preferentially from same The data source nodes of one operator obtain required file, if client device 700 is the first carrier network, fringe node 100 is also the first carrier network, then, if existing in multiple data source nodes of file needed for the storage for finding The data source nodes of one carrier network also have the data source nodes of the second carrier network, then return the prioritizing selection of source device 108 File needed for being obtained from the data source nodes of the first carrier network.Again for example, it may be considered that the multiple of file needed for storage The load state of data source nodes, i.e., the principle selection according to load balancing loads a relatively most light data source nodes and obtains Required file.

The content returned in the Hui Yuanbiao that source device 108 is safeguarded, can be according to the information generation obtained from each data source nodes. For example, whenever having files passe to certain data source nodes, a stored record can be all updated to Hui Yuanbiao, in this record The data source nodes of the synopsis and/or storage this document that record this document are numbered, and corresponding data source nodes Specific address, and then, the address information of the data source nodes of each file and storage this document just can be recorded in Hui Yuanbiao. Hui Yuanbiao is not limited to storage in fringe node 100, it is also possible to store in other special management equipments, as long as data source section Point can be communicated with fringe node 100 or the special management equipment so that the information in Hui Yuanbiao can be according to number Updated according to the renewal of source node storage file, time source device 108 in fringe node 100 can get in Hui Yuanbiao in time Information.It is previously noted that return source device 108 can be according only to the numbering inquiry phase of the data source nodes in the URL of requested document The data source nodes address of pass, it is also possible to according only to the related data source nodes address of the synopsis inquiry of requested document, Therefore it is corresponding, only record data source node can also be numbered and the incidence relation between data source node address in Hui Yuanbiao, Or the incidence relation only between the synopsis of log file and data source node address.It is, of course, also possible to preferentially use number According to source node numbering query-relevant data source node address, if searched less than suitable, such as same carrier network, then Whether the synopsis for continuing through file continues to inquire about the data source of the storage this document for also having other same carrier networks Node, it is in this case corresponding, be accomplished by Hui Yuanbiao simultaneously record data source node numbering, the synopsis of file and Corresponding relation between data source nodes address.

Returning source device 108 can include data source query module, directly return source module, act on behalf of back source module and caching notice Module.Specifically, if data source query module returns the download address of source table and file download request according to known to, specifically It is the synopsis of the data source nodes numbering or file obtained according to time source table and according to download address, finds storage The data source nodes of this document and fringe node 100 are same carrier networks, such as be the data of the first carrier network Source node 500, then directly return source module and file download request be transmitted to the data source nodes 500 for finding, from the data source Node 500 obtains required file.Because fringe node 100 and data source nodes 500 are all the nodes of the first carrier network, because Directly communication speed is carried out between this they quickly, without by Agent cluster, it is possible to be directly connected to download.Meanwhile, delay Deposit notification module and notify that buffer 102 pairs is cached by the file asked that directly time source module gets.

If the data source query module in the fringe node 100 of the first carrier network, return source table in search less than The file that the data source nodes storage for belonging to same carrier network with fringe node 100 has been asked, only finds the second operation The data source nodes 600 of business's network store requested document, then act on behalf of back source module by the first carrier network to the The Agent cluster 300 of two carrier networks obtains asked file from the related data source nodes 600 of the second carrier network. Meanwhile, caching notification module notifies that the file asked that buffer 102 pairs is obtained by acting on behalf of back source module is cached.

In order to preferably describe to act on behalf of back the generation how source module passes through the first carrier network to the second carrier network Reason cluster 300 obtains asked file from the data source nodes 600 of the second carrier network, and lower Agent cluster is first introduced below 300 concrete structure.Agent cluster 300 is runed including the first carrier network of edge side Agent cluster 302, source node side second Business's network agent cluster 306, and the first transmission channel 304.For example, the electricity according to an embodiment of the invention shown in Fig. 4 Believe to the Agent cluster schematic diagram of Netcom.The Agent cluster includes telegraphic authority's cluster, Netcom's Agent cluster, and two agencies Optical fiber transport channel between cluster.Wherein telegraphic authority's cluster 412 is equivalent to edge side the first carrier network Agent cluster 302, Netcom's Agent cluster 416 is equivalent to source node side the second carrier network Agent cluster 306.Telegraphic authority's cluster 412 leads to Cross telecommunications outlet to be communicated with telecommunications download node (i.e. telecommunications fringe node), network agent cluster 416 is exported by Netcom Communicated with Netcom data source nodes.

First, under time file of the source device 108 according to client device 700 of the rim node 100 of the first carrier network The address of request and the data source nodes 600 for finding is carried, to edge side the first carrier network generation in Agent cluster 300 Reason cluster 302 sends the request that file is downloaded in request from data source nodes 600, then the carrier network of edge side first agency File download request is transmitted to source node side second and runed by cluster 302 by the first transmission channel 304, typically all optical fiber Business's network agent cluster 306.And then, source node side the second carrier network Agent cluster 306 is again to the second related operator The data source nodes 600 of network send file download request, and asked file is obtained from the data source nodes 600.Source node After the file that side the second carrier network Agent cluster 306 obtains asked from data source nodes 600, then the text that will be asked Part is transmitted to the first carrier network of edge side Agent cluster 302, and then again by edge side first by the first transmission channel 304 The agency that this document is transferred to fringe node 100 is returned source module, final fringe node 100 by carrier network Agent cluster 302 Agency return source module 108 this document be back to client device 100.So far, the client device of the first carrier network 700 fringe node 100, the Agent clusters of the first carrier network to the second carrier network for passing through the first carrier network 300 have successfully downloaded the file asked from the data source nodes of the second carrier network.

The structure of the Agent cluster 400 of the second carrier network to the first carrier network and the first carrier network are to the The Agent cluster structure of two carrier networks duplicates, therefore repeats no more, only simple to introduce.Agent cluster 400 includes edge side the Two carrier network Agent clusters 402, receive the file download request of the fringe node 200 from the second carrier network, with And return to asked file to the fringe node 200 of the second carrier network.Second transmission channel 404 is transported from edge side second Battalion's business's network agent cluster 402 to the transmission information of source node side the first carrier network Agent cluster 406, and from source node side First carrier network Agent cluster 406 is to the transmission information of the second carrier network of edge side Agent cluster 402；Source node side One carrier network Agent cluster 406 by the second transmission channel 404 according to being received from the carrier network of edge side second The file download request of Agent cluster 402, sending file download to the related data source nodes 500 of the first carrier network please Ask, and receive the file asked that the related data source nodes 500 of the first carrier network are returned, and by the second transmission Passage 404 is transmitted to the second carrier network of edge side Agent cluster 200.

By above description, time source device 108 in the fringe node 100 of the first carrier network can be from data Source node (data source nodes 600 of the carrier network of data source nodes 500 or second of such as the first carrier network) gets File needed for client device 700, and it is transferred to client device 700.In one embodiment of the invention, Hui Yuanqi 108 each several parts that can partly obtain asked file from data source nodes one by one, and pass to client device 700 simultaneously Acquired part in defeated this document, untill obtaining this document completely.Specifically, when data source nodes are to edge section Point 100 in return source device 108 return file header header information after, fringe node 100 with will the header information return To client device 700, the size of the file for asking to download just is aware of after the acquisition header information of client device 100, Then can keep being linked with fringe node 100, wait and receive the data of fringe node return, be until downloading whole file Only.Fringe node 100 can continue to obtain the content-data of file from data source nodes after data source nodes are connected to, while Continue for acquisition content-data to be transmitted directly to client device 700, untill this document end of transmission.Fringe node 100 After whole file is obtained from data source nodes, header information and file content can be put into caching.

It can thus be seen that fringe node 100 can be while obtain asked file, while to visitor from data source nodes Family end equipment 700 transmits the partial content of this document for having got, without waiting fringe node 100 completely from data source Node is downloaded to after whole file content, then starts to transmit this document to client device 700.In such cases, edge section Returning source device 108 and can regard that one non-is blocked back source device as in point 100.

In one embodiment of the invention, download management equipment 110 can be given by varniash caching servers Realize, in other words fringe node fully or partially through varniash caching servers realize.Cached by varniash and taken Business device can be realized during file is downloaded from data source nodes, synchronous to transmit file to client device, i.e., with non- Block back source device.Fig. 5 is specifically referred to, it illustrates data downloading system schematic diagram according to an embodiment of the invention, its In, telecommunications downloads the instantiation that node 512 is the fringe node 100 of the first carrier network in Fig. 1, and telecommunications downloads section Point 512 includes multiple varniash nodes；Netcom downloads the fringe node 200 that node 514 is the second carrier network in Fig. 1 One instantiation, Netcom downloads node 514 also includes multiple varniash；Telecommunications->During Netcom's Agent cluster 516 is Fig. 1 One instantiation of the Agent cluster 300 of the first carrier network to the second carrier network, it can include Agent cluster 1st, the multiple such as Agent cluster 2 Agent cluster, can backup each other each other；Netcom->Telegraphic authority's cluster 518 is second in Fig. 1 Carrier network to the Agent cluster 400 of the first carrier network an instantiation, its also include Agent cluster 1, agency The grade of cluster 2 multiple Agent cluster, can backup each other；Teledata source 520 is the data source section of the first carrier network in Fig. 1 One instantiation of point 500, it can include multiple data source nodes；Network data source 522 is second operator's net in Fig. 1 600 1 instantiations of data source nodes of network, it can include multiple data source nodes.Each varniash node is corresponded to One group of Agent cluster, therefore using failover (failure backup) mechanism of Varnish nodes itself, can be in certain agency During clustering fault, other Agent clusters are automatically switched to, so as to reduce the disabled risk of service.

Fig. 6 is referred to, it illustrates the manager for providing file download address according to an embodiment of the invention Method flow chart.

The management method starts from step S610, in step S610, the storage first according to file in data source nodes The resource location information of coordinates measurement this document.After certain files passe to certain data source nodes, data source nodes or Person other management equipments that can be in communication with each other with data source nodes, it is possible to obtain this document in this data source nodes Store path, and then the resource location information of file can be generated according to the store path, i.e., equivalent in generation this document URL Path and filename this partial content.The step can be performed by the resource localizer 212 in Fig. 2, and correlation technique can be with With reference to the description in foregoing embodiments about resource localizer 212, here is omitted.

On the one hand the resource location information of file is generated by step S610, on the other hand, in step S620, to this article The content of part generates the synopsis of file using specific data conversion.The synopsis of file is substantially the mark of file content Knowledge information, file content summary is corresponded with file data, and the file of different content, synopsis is also different.The step can Realized with by the summary generator 214 in Fig. 2, correlation technique may be referred to relevant summary generator in foregoing embodiments 214 description, here is omitted.

It should be noted that the order between step S610 and step S620 is adjustable, such as step S610 can With before step S620, afterwards or with step S620 while performing.

In the resource location information by step S610 acquisition files, and plucked by the content that step S620 obtains file After wanting, in step S630, the synopsis of resource location information and file according at least to file generates the download of file Address, such as URL, the synopsis of resource location information and file in the download address at least including file.So far, file Download address is generated as, and hereafter, the client device for needing to download this document can be supplied to be used.For example, client When end equipment clicks on certain file on website or listed files needs to download this document, you can obtain the URL of this document, enter And, subsequent clients end equipment can send file download and ask according to the download address to fringe node, so that fringe node The URL of this document is obtained, the not only resource location information, the also content including file such as including the store path of file in the URL Summary.The step can realize that correlation technique may be referred to foregoing embodiments by the download address maker 216 in Fig. 2 In about download address maker 216 description, here is omitted.

Then Fig. 7 is refer to, it illustrates the download in data downloading system according to an embodiment of the invention Management method flow chart.The data downloading system can include the fringe node and data source nodes of previous embodiments description, The Agent cluster of previous embodiments description can also further be included.

The downloading management method starts from step S710, and in step S710, fringe node is obtained from client device File download is asked, and the synopsis of asked file is parsed according to the download address of this document download request.Preceding By the agency of mistake in the embodiment flow that face Fig. 6 is given, client device can obtain the URL of the file for needing to download, and When the synopsis of file, therefore client device are also included in the URL to fringe node transmission download request, in download request Download address URL in can include requested document synopsis.

The download request of client device is obtained by step S710 in fringe node, and is parsed according to download request After the synopsis of requested document, in step S720, fringe node is delaying according to the synopsis of the file asked Search whether there is asked file in depositing.If it is, into step S730：Asked file is obtained from caching to pass Transport to client device.If not, file i.e. in the buffer not without needed for, then into step S740：Fringe node is from institute The related data source nodes of the file of request obtain asked file, and transmit to client device.

The step of one embodiment in S740, fringe node can partly be obtained from data source nodes and asked one by one File each several part, and to client device acquired part in asked file is transmitted simultaneously, until obtaining completely Untill the file asked.By this clog-free time source mode, fringe node can be made to wait from data source nodes Obtain and be transmitted further to client device after whole file, the process of asked file can be being obtained from data source nodes In, while transmitted to client device, so as to further increase the speed of download of file.

The step of one embodiment in S740, in order to further improve download efficiency, if fringe node and data source Node is not the node of same carrier network, then fringe node can also obtain institute by Agent cluster from data source nodes The file of request, for example, the data downloading system also Agent cluster including the first carrier network to the second carrier network.Step Rapid S740 is specifically included：Fringe node returns source table according to known to and the download address inquiry of the file asked is asked first The data source nodes of the file correlation asked；When fringe node is the fringe node of the first carrier network, and inquire and ask When the data source nodes of the file correlation asked include the data source nodes of first carrier network, directly from first operator The data source nodes of network obtain asked file；When fringe node is the fringe node of the first carrier network, and look into Ask to the related data source nodes of the file asked be the data source nodes of the second carrier network when, then by the first operation Business's network to the Agent cluster of the second carrier network obtains what is asked from the related data source nodes of the second carrier network File.

Directly asked file processes are obtained for fringe node from the data source nodes of same carrier network to compare Simply, no longer describe in detail, below main introduction lower institute is obtained from the data source nodes of non-same carrier network by Agent cluster The process of demand file.Specifically, the Agent cluster of the first carrier network to the second carrier network includes edge side the One carrier network Agent cluster, transmission channel and source node side the second carrier network Agent cluster, first, edge side first Carrier network Agent cluster receives the file download request of the fringe node from the first carrier network, and logical by transmission Transmit to source node side the second carrier network Agent cluster in road；Source node side the second carrier network Agent cluster is being received After file download request, send file download to the related data source nodes of the second carrier network accordingly and ask, and reception should The file asked that the related data source nodes of second carrier network are returned, and this document is transmitted by transmission channel To edge side the first carrier network Agent cluster；And then, the first carrier network of edge side Agent cluster is again by this document Transmit to the fringe node of the first carrier network.

When fringe node by step S740 obtain client requested document while or after, in step S750 In, this document content obtained by the synopsis of this document and from data source nodes is cached, under subsequently having again Carry this document download request when, fringe node need not go again data source nodes obtain file, directly pass through step S730 from This document is transferred to client device in the caching of oneself.By the continuous accumulation of step S750, fringe node caching In file it is more and more, largely can directly provide the file asked by client device, and without go again Data source nodes are downloaded, the download efficiency of the file for thus improving, and decrease the communication time between data source nodes Number, and alleviate the load burden of data source nodes.

In above-mentioned data handling procedure, step S710 can be performed by the resolver 104 in Fig. 1, step S720 and S730 can be performed by the finger 106 in Fig. 1, and step S740 can be performed by the source device 108 that returns in Fig. 1, step S750 can be performed by the buffer 102 in Fig. 1, and each step that above fringe node is performed can be by varniash Caching server is performed.Correlation technique realizes may be referred to the description of corresponding component in foregoing embodiments, and here is omitted.

Fringe node is can be seen that by above various embodiments of the present invention to be parsed according to from requested document download address Whether the file content for going out is made a summary as indexing key words, inquires about stored asked file in the buffer, rather than Whole URL according to file, as search index, is also in the buffer to be during storage file according to the synopsis of file similarly It is no it is identical determine whether same text document, i.e. file synopsis be file content data mark, as long as file is interior Hold the different file datas of summary inherently different, as long as conversely, the synopsis of file it is identical with regard to supporting paper data inherently It is same.Therefore, if two URL of file are different, but the content-data of file is substantially identical, then the content of this document Summary is exactly identical, and then, if this document has been cached in fringe node before this, then follow-up even client End equipment sends a different file download address URL again, if in URL the synopsis of this document and caching in one Cause, then fringe node also will not again remove data source nodes repeated downloads this document and cache, but directly according to this document Synopsis finds this document from caching and is supplied to client device.It can thus be seen that on the one hand reducing caching Repeated data, on the other hand also improves the efficiency that file is downloaded for client device, while reducing fringe node to data The number of communications of source node, and then reduce the load of data source nodes and the bandwidth consumption of Agent cluster.

Further, in some cases, file URL does not change, but the content-data of substantive file has occurred that Update.If using only basis does not carry the URL of file content summary info as the rope of query caching file in the prior art Draw keyword, then be likely to for substance data to have occurred and that the file that change, URL there are not change is sent to client device, And then cause client device to be downloaded less than newest, most correct file.And using the scheme of the embodiment of the present invention, due to being root Judge to whether there is this document in caching according to the file content summary in file URL, if URL does not have change, substantial data content to become If change, then when being cached by file content digest challenge, can not find corresponding file, then will automatically from Data source nodes obtain newest file and are supplied to client device, that is, the file in caching to be updated in time.For changing It, in the embodiment of the present invention cache renewal be by fringe node actively initiate, rather than as in existing CDN by data What source node was initiated, therefore avoid the problem for using existing CDN data buffer storages renewal efficiency low.

Further, fringe node obtains file by Agent cluster from data source nodes, when file is larger, can be with profit With the Stream non-blocking modes of edge node server (such as Varnish), it is possible to achieve allowed under client device in caching Carry.Avoid during using CDN, it is necessary to wait until the problem that whole file total caching could be downloaded, whole process client device Without waiting for.

Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein. Various general-purpose systems can also be used together with based on teaching in this.As described above, construct required by this kind of system Structure be obvious.Additionally, the present invention is not also directed to any certain programmed language.It is understood that, it is possible to use it is various Programming language realizes the content of invention described herein, and the description done to language-specific above is to disclose this hair Bright preferred forms.

In specification mentioned herein, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be put into practice in the case of without these details.In some instances, known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this description.

Similarly, it will be appreciated that in order to simplify one or more that the disclosure and helping understands in each inventive aspect, exist Above to the description of exemplary embodiment of the invention in, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor The application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as following Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore, Thus the claims for following specific embodiment are expressly incorporated in the specific embodiment, and wherein each claim is in itself All as separate embodiments of the invention.

Those skilled in the art are appreciated that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment Unit or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or Sub-component.In addition at least some in such feature and/or process or unit exclude each other, can use any Combine to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so disclosed appoint Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power Profit is required, summary and accompanying drawing) disclosed in each feature can the alternative features of or similar purpose identical, equivalent by offer carry out generation Replace.

Although additionally, it will be appreciated by those of skill in the art that some embodiments described herein include other embodiments In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention Within the scope of and form different embodiments.For example, in the following claims, embodiment required for protection is appointed One of meaning mode can be used in any combination.

All parts embodiment of the invention can be realized with hardware, or be run with one or more processor Software module realize, or with combinations thereof realize.It will be understood by those of skill in the art that can use in practice Microprocessor or digital signal processor (DSP) realize download management equipment, management equipment according to embodiments of the present invention And some or all functions of some or all parts in data downloading system.The present invention be also implemented as Some or all equipment or program of device of method as described herein are performed (for example, computer program and calculating Machine program product).It is such to realize that program of the invention be stored on a computer-readable medium, or can have one Or the form of multiple signals.Such signal can be downloaded from internet website and obtained, or be provided on carrier signal, Or provided in any other form.

It should be noted that above-described embodiment the present invention will be described rather than limiting the invention, and ability Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol being located between bracket should not be configured to limitations on claims.Word "comprising" is not excluded the presence of not Element listed in the claims or step.Word "a" or "an" before element is not excluded the presence of as multiple Element.The present invention can come real by means of the hardware for including some different elements and by means of properly programmed computer It is existing.If in the unit claim for listing equipment for drying, several in these devices can be by same hardware branch To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame Claim.

It can be seen that, the present invention provides at following scheme：

A1, a kind of download management equipment in fringe node, including：

Buffer, is configured as caching the synopsis of each file and each file obtained from data source nodes, The synopsis of the file is the data generated using specific data conversion to the content of the file；

Resolver, is configured as obtaining the file download request from client device, and please according to the file download The download address asked parses the synopsis of asked file；

Finger, is configured as the synopsis of described asked file parsed according to the resolver described Asked file is searched in buffer, if found, the file that will be asked is transmitted to client device；And

Source device is returned, when being configured as the finger and not finding asked file in the buffer, from The related data source nodes of the file asked obtain asked file, and transmit to the client device, and by institute The file of request is supplied to the buffer to be cached.

A2, the download management equipment as described in A1, described time source device are suitable to partly be obtained from the data source nodes one by one The each several part of asked file is taken, and simultaneously to part acquired in the asked file of client device transmission, Untill until obtaining asked file completely.

A3, the download management equipment as described in A1 or A2, described time source device includes：

Data source query module, is configured as according to the known download address inquiry institute for returning source table and the file asked State the related data source nodes of asked file；

Source module is directly returned, the fringe node that the fringe node is the first carrier network, and institute is configured as When the data source nodes of the file the asked correlation for inquiring include the data source nodes of first carrier network, directly Asked file is obtained from the data source nodes of first carrier network；

Source module is acted on behalf of back, the fringe node that the fringe node is the first carrier network, and institute is configured as When the related data source nodes of the file asked that inquires are the data source nodes of the second carrier network, by described the The Agent cluster of one carrier network to the second carrier network is obtained from the related data source nodes of second carrier network Take asked file；And

Caching notification module, is configured as by the direct time source module or to act on behalf of back source module and getting and asked File after, notify that file of the buffer to being asked is cached.

A4, the download management equipment as any one of A1 to A3, the synopsis of the file include：Secure Hash One kind in calculation sha series datas, or, the one kind in informative abstract calculation MD series datas.

A5, the download management equipment as any one of claim A1 to A4, the download management equipment is Varniash caching servers.

B6, a kind of data downloading system, including fringe node, be between different operators network provide information exchange service Agent cluster, and data source nodes, wherein the fringe node includes the download as any one of claim 1 to 5 Management equipment.

B7, the system according to B6, also include：Management equipment for providing file download address, the edge section The download address of the file download request that point is received is provided by described for providing the management equipment of file download address；Its In,

It is described to include for providing the management equipment of file download address：

Resource localizer, is configured as the resource that the store path according to file in data source nodes generates the file Location information；

Summary generator, is configured as generating the content of the file using specific data conversion the content of the file Summary；And

Download address maker, is configured as the Resource orientation of the file according at least to resource localizer offer The synopsis of the file that information and the summary generator are provided, generates the download address of the file, the download The synopsis of resource location information and the file in address at least including the file.

B8, the system according to B7, the download address of the file of the download address maker generation is described The uniform resource position mark URL of file.

B9, the system according to any one of B6 to B8, information exchange is provided between the network for different operators The Agent cluster of service includes the Agent cluster of the first carrier network to the second carrier network, and the second carrier network To the Agent cluster of the first carrier network, wherein,

First carrier network to the Agent cluster of the second carrier network includes：

Edge side the first carrier network Agent cluster, is configured as receiving the fringe node from the first carrier network File download request, and return to asked file to the fringe node of first carrier network；

Transmission channel, is configured as being runed to the source second from the edge side the first carrier network Agent cluster Business's network agent cluster transmission information, and from source node side the second carrier network Agent cluster to the edge side One carrier network Agent cluster transmission information；And

Source node side the second carrier network Agent cluster, is configured as according to by coming from that the transmission channel is received The file download request of the edge side the first carrier network Agent cluster, to the related data of second carrier network Source node sends file download request, and receives being asked for the related data source nodes return of second carrier network File, and transmitted to the edge side the first carrier network Agent cluster by the transmission channel；

Second carrier network to the Agent cluster of the first carrier network includes：

Edge side the second carrier network Agent cluster, is configured as receiving the fringe node from the second carrier network File download request, and return to asked file to the fringe node of second carrier network；

Transmission channel, is configured as being runed to source node side first from the edge side the second carrier network Agent cluster Business's network agent cluster transmission information, and from source node side the first carrier network Agent cluster to the edge side Two carrier network Agent cluster transmission informations；And

Source node side the first carrier network Agent cluster, is configured as according to by coming from that the transmission channel is received The file download request of the edge side the second carrier network Agent cluster, to the related data of first carrier network Source node sends file download request, and receives being asked for the related data source nodes return of first carrier network File, and transmitted to the edge side the second carrier network Agent cluster by the transmission channel.

C10, a kind of downloading management method in data downloading system, the data downloading system at least include edge Node and data source nodes, the downloading management method include：

Fringe node obtains the file download request from client device, and the download asked according to the file download Address resolution goes out the synopsis of asked file；

Fringe node searches whether there is asked file in the buffer according to the synopsis of the file asked, such as Fruit is present, then the file that will be asked is transmitted to client device；And

If not finding asked file in the buffer, data of the fringe node from the file correlation asked Source node obtains asked file, and transmits to the client device；

The synopsis of the fringe node file that is obtained from data source nodes of caching and the file, the file it is interior It is the data generated using specific data conversion to the content of the file to hold summary.

C11, the downloading management method as described in C10, the data source nodes related from the file asked obtain institute The step of file of request, includes：

The each several part of asked file is partly obtained from the data source nodes one by one, and simultaneously to the client Equipment transmits acquired part in asked file, until obtaining asked file completely untill.

C12, the downloading management method as described in C10 or 11, the data downloading system also include the first carrier network To the Agent cluster of the second carrier network, the data source nodes related from the file asked obtain asked file The step of include：

The related data source of asked file is inquired about according to known time source table and the download address of the file asked Node；

When the fringe node is the fringe node of the first carrier network, and the file asked for inquiring is related Data source nodes including first carrier network data source nodes when, directly from the number of first carrier network Asked file is obtained according to source node；

When the fringe node is the fringe node of the first carrier network, and the file asked for inquiring is related Data source nodes when being the data source nodes of the second carrier network, by first carrier network to the second operator The Agent cluster of network obtains asked file from the related data source nodes of second carrier network.

C13, the downloading management method as any one of C10 to C12, first carrier network to the second operation The Agent cluster of business's network includes the first carrier network of edge side Agent cluster, transmission channel and the operator of source node side second Network agent cluster, the fringe node is by first carrier network to the Agent cluster of the second carrier network from institute Stating the step of the related data source nodes of the second carrier network obtain asked file includes：

The first carrier network of edge side Agent cluster is received under the file of the fringe node from the first carrier network Request is carried, and is transmitted to the second carrier network of source node side Agent cluster by transmission channel；

Source node side the second carrier network Agent cluster acts on behalf of collection according to from the carrier network of the edge side first The file download request of group, sends file download and asks, and receive to the related data source nodes of second carrier network The file asked that the related data source nodes of second carrier network are returned；

The file that source node side the second carrier network Agent cluster will be asked is transmitted by the transmission channel To the edge side the first carrier network Agent cluster；

The file that the edge side the first carrier network Agent cluster will be asked is transmitted to first operator net The fringe node of network.

C14, the downloading management method as any one of C10 to C13, each step are cached by varniash and taken Business device is performed.

Claims

1. a kind of download management equipment in fringe node, including：

Buffer, is configured as caching the synopsis of each file and each file obtained from data source nodes, described The synopsis of file is the data generated using specific data conversion to the content of the file；

Resolver, is configured as obtaining the file download request from client device, and according to file download request Download address parses the synopsis of asked file；

Finger, is configured as the synopsis of described asked file parsed according to the resolver in the caching Asked file is searched in device, if found, the file that will be asked is transmitted to client device；And

Source device is returned, when being configured as the finger and not finding asked file in the buffer, from asking The data source nodes of the file correlation asked obtain asked file, and transmit to the client device, and will be asked File be supplied to the buffer to be cached.

2. download management equipment as claimed in claim 1, described time source device is suitable to one by one partly from the data source nodes The each several part of asked file is obtained, and simultaneously to portion acquired in the asked file of client device transmission Point, until obtaining asked file completely untill.

3. download management equipment as claimed in claim 1 or 2, described time source device includes：

Data source query module, is configured as inquiring about the institute according to the known download address for returning source table and the file asked The related data source nodes of the file of request；

Source module is directly returned, the fringe node is configured as and is the fringe node of the first carrier network, and inquired about To the related data source nodes of the file asked include the data source nodes of first carrier network when, directly from institute The data source nodes for stating the first carrier network obtain asked file；

Source module is acted on behalf of back, the fringe node is configured as and is the fringe node of the first carrier network, and inquired about To the related data source nodes of the file asked be the data source nodes of the second carrier network when, transported by described first Battalion's business's network to the Agent cluster of the second carrier network obtains institute from the related data source nodes of second carrier network The file of request；And

Caching notification module, is configured as by the direct time source module or to act on behalf of back source module and getting asked text After part, notify that file of the buffer to being asked is cached.

4. download management equipment as claimed any one in claims 1 to 3, the synopsis of the file includes：Safety is breathed out One kind in uncommon calculation sha series datas, or, the one kind in informative abstract calculation MD series datas.

5. the download management equipment as any one of Claims 1-4, the download management equipment is varniash cachings Server.

6. a kind of data downloading system, including fringe node, the generation to provide information exchange service between different operators network Reason cluster, and data source nodes, wherein the fringe node includes the download management as any one of claim 1 to 5 Equipment.

7. system according to claim 6, also includes：Management equipment for providing file download address, the edge The download address of the file download request that node is received is provided by described for providing the management equipment of file download address； Wherein,

Resource localizer, is configured as the Resource orientation that the store path according to file in data source nodes generates the file Information；

Summary generator, is configured as plucking the content of the file using the content that specific data conversion generates the file Will；And

Download address maker, is configured as the resource location information of the file according at least to resource localizer offer The synopsis of the file provided with the summary generator, generates the download address of the file, the download address In at least including the file resource location information and the file synopsis.

8. system according to claim 7, the download address of the file of the download address maker generation is institute State the uniform resource position mark URL of file.

9. the system according to any one of claim 6 to 8, information exchange is provided between the network for different operators The Agent cluster of service includes the Agent cluster of the first carrier network to the second carrier network, and the second carrier network To the Agent cluster of the first carrier network, wherein,

Edge side the first carrier network Agent cluster, is configured as receiving the text of the fringe node from the first carrier network Part download request, and return to asked file to the fringe node of first carrier network；

Transmission channel, is configured as from the edge side the first carrier network Agent cluster to the second operator of source net Network Agent cluster transmission information, and transported to the edge side first from source node side the second carrier network Agent cluster Battalion's business's network agent cluster transmission information；And

Source node side the second carrier network Agent cluster, be configured as according to by the transmission channel receive from described The file download request of edge side the first carrier network Agent cluster, to the related data source section of second carrier network Point sends file download request, and receives the text asked that the related data source nodes of second carrier network are returned Part, and transmitted to the edge side the first carrier network Agent cluster by the transmission channel；

Edge side the second carrier network Agent cluster, is configured as receiving the text of the fringe node from the second carrier network Part download request, and return to asked file to the fringe node of second carrier network；

Transmission channel, is configured as from the edge side the second carrier network Agent cluster to the first operator of source node side net Network Agent cluster transmission information, and transported to the edge side second from source node side the first carrier network Agent cluster Battalion's business's network agent cluster transmission information；And

Source node side the first carrier network Agent cluster, be configured as according to by the transmission channel receive from described The file download request of edge side the second carrier network Agent cluster, to the related data source section of first carrier network Point sends file download request, and receives the text asked that the related data source nodes of first carrier network are returned Part, and transmitted to the edge side the second carrier network Agent cluster by the transmission channel.

10. a kind of downloading management method in data downloading system, the data downloading system at least includes fringe node And data source nodes, the downloading management method includes：

Fringe node obtains the file download request from client device, and the download address asked according to the file download Parse the synopsis of asked file；

Fringe node searches whether there is asked file in the buffer according to the synopsis of the file asked, if deposited The file that will then be asked is transmitted to client device；And

If not finding asked file in the buffer, data source section of the fringe node from the file correlation asked Point obtains asked file, and transmits to the client device；

File and the synopsis of the file that fringe node caching is obtained from data source nodes, the content of the file are plucked If the data generated using specific data conversion to the content of the file.