CN102750287B - Include method and the download authentication server of index information - Google Patents
Include method and the download authentication server of index information Download PDFInfo
- Publication number
- CN102750287B CN102750287B CN201110100730.5A CN201110100730A CN102750287B CN 102750287 B CN102750287 B CN 102750287B CN 201110100730 A CN201110100730 A CN 201110100730A CN 102750287 B CN102750287 B CN 102750287B
- Authority
- CN
- China
- Prior art keywords
- file
- cryptographic hash
- download
- piece
- index information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Storage Device Security (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of method including index information and download authentication server, belonging to field of computer technology.Described method includes: obtain the download link that crawler server pushes；Download the partial content of file from described download link；Calculate the index information of described file according to the partial content downloaded；Set up the mapping relations between the index information of described file and described download link, and report database server and include.Described device includes: the first acquisition module, download module, computing module and set up module.The present invention is by only downloading the partial content of file, index information according to the partial content calculation document downloaded, it is used as unique mark of this file content, and no longer use in prior art the content downloading whole file to carry out computation index information, improve file index information and the speed of link warehouse-in, significantly improve the efficiency that resource is included；In addition, decrease the file transit space taking.
Description
Technical field
The present invention relates to field of computer technology, test particularly to a kind of method including index information and download
Card server.
Background technology
P2SP (Peer to Server & Peer, point is to server and point) is a kind of user's download technology,
" Peer " (point) i.e. network node or terminal are it can be understood as subscriber computer herein.So-called P2SP refers to
Download no longer as traditional approach can only reliance server, downloading client can server from network
With download content in other any terminals.P2SP backstage is made up of one group of function server, including reptile service
Device, download authentication server and database server etc., it is achieved the major function of P2SP.Database service
Device is stored with for Hash (Hash) value of unique mark file and with this hash value corresponding URL
(Universal Resource Locator, URL) links, and these URL link all may be used
For downloading the file that this Ha sh value represents.
In P2SP download technology, when download client to download certain file, with the entrance downloading this document
URL link goes to search corresponding hash value in database server, obtains corresponding with this hash value after finding
Other URL link, as the auxiliary source downloaded, auxiliary source is more, and speed of download is faster.Database service
In device, the available sources of auxiliary source has two, and one is the hash value of calculation document after client downloads completes, and
This hash value and URL link are reported database server, two be by crawler server from internet
Include download the page and therefrom extract for download URL link, be pushed to after these URL link duplicate removals
Download authentication server, then download authentication server is downloaded corresponding file from URL link, treat whole
After file download finishes, read the content calculation document hash value of whole file, then by the URL chain of file
Connect mapping relations mutual between hash value and be stored in database server.Same file is generally different
There is different linking website, say, that same hash value can map multiple URL link, therefore at P2SP
With the hash value of file as index information in system.
During realizing the present invention, inventor finds that prior art at least has the disadvantage in that
When prior art actively includes auxiliary source by crawler server and download authentication server, owing to including
During download authentication server and need to download and read the content of whole file to calculate hash value, with this
Hash value, as index information, causes the speed included slow；When crawler server crawls a large amount of new URL chain
Connect when need warehouse-in, need substantial amounts of transit space to preserve the file of interim download, result in the need for throwing
Enter to be largely used to the space of transfer.
Content of the invention
In order to realize quickly including of file index information, saving file transit space, the embodiment of the present invention carries
Supply a kind of method including index information and downloaded authentication server.Described technical scheme is as follows:
On the one hand, providing a kind of method including index information, described method includes:
Obtain the download link that crawler server pushes；
Download the partial content of file from described download link；
Calculate the index information of described file according to the partial content downloaded；
Set up the mapping relations between the index information of described file and described download link, and report data
Storehouse server is included.
Wherein, the described partial content downloading file from described download link, comprising:
Download the head of file, middle and afterbody three partial content from described download link；
Correspondingly, the described index information calculating described file according to the partial content downloaded, comprising:
Calculate the cryptographic Hash of head, centre and afterbody three partial content of described file respectively；
Calculated three cryptographic Hash are combined calculating cryptographic Hash again, and will be finally calculated
Cryptographic Hash is as the index information of described file.
Further, the described head from described download link download file, middle and afterbody three partial content,
Including:
Obtaining the corresponding fileinfo of described download link, described fileinfo includes the size of file；
Size according to described file and default burst size are by described file fragmentation；
Download the first piece of described file, centre according to described burst size and side-play amount from described download link
A piece of and last a piece of content fragment；
Correspondingly, the cryptographic Hash of described head, centre and afterbody three partial content calculating described file respectively,
Including:
Calculate first piece, the cryptographic Hash of middle a piece of and last a piece of content fragment of described file respectively.
Alternatively, described be combined calculated three cryptographic Hash calculates before cryptographic Hash, also again
Including:
Obtain the auxiliary information of described file；
Correspondingly, described be combined calculated three cryptographic Hash calculates cryptographic Hash again, and will
Rear calculated cryptographic Hash is as the index information of described file, comprising:
Calculated three cryptographic Hash and described auxiliary information are stitched together and again calculate cryptographic Hash, and
Using last calculated cryptographic Hash as the index information of described file；Or,
Calculated three cryptographic Hash are stitched together and again calculate cryptographic Hash, and will finally be calculated
Cryptographic Hash and described auxiliary information be stitched together the index information as described file.
Wherein, described auxiliary information is the size of described file, or, file extension.
On the other hand, providing a kind of download authentication server, described download authentication server includes:
First acquisition module, for obtaining the download link that crawler server pushes；
Download module, the download link for obtaining from described first acquisition module downloads the partial content of file；
Computing module, the partial content for downloading according to described download module calculates the index letter of described file
Breath；
Set up module, for setting up the index information of the described file that described computing module calculates and described download
Mapping relations between link, and report database server and include.
Wherein, described download module, downloads specifically for the download link obtaining from described first acquisition module
The head of file, middle and afterbody three partial content；
Correspondingly, described computing module, specifically for calculating the head of the file that described download module is downloaded respectively
The cryptographic Hash of portion, centre and afterbody three partial content；Calculated three cryptographic Hash are combined again
Calculate cryptographic Hash, and using last calculated cryptographic Hash as the index information of described file.
Further, described download module, specifically for obtaining the corresponding fileinfo of described download link,
Described fileinfo includes the size of file；Size according to described file and the burst size preset are by described
File fragmentation；According to described burst size and side-play amount from described download link download described file first piece,
Middle a piece of and last a piece of content fragment；
Correspondingly, described computing module for calculate respectively the file that described download module is downloaded head, in
Between and during the cryptographic Hash of afterbody three partial content, specifically for calculating first piece, the centre of described file respectively
The cryptographic Hash of a piece of and last a piece of content fragment.
Alternatively, described download authentication server also includes:
Second acquisition module, for being combined calculated three cryptographic Hash at described computing module again
Before secondary calculating cryptographic Hash, obtain the auxiliary information of described file；
Correspondingly, described computing module is breathed out for being combined calculated three cryptographic Hash again to calculate
Uncommon value, and using last calculated cryptographic Hash as the index information of described file when, specifically for will meter
The auxiliary information that three cryptographic Hash obtaining and described second acquisition module obtain is stitched together and again calculates
Cryptographic Hash, and using last calculated cryptographic Hash as the index information of described file；Or, will calculate
To three cryptographic Hash be stitched together and again calculate cryptographic Hash, and by last calculated cryptographic Hash and institute
State the auxiliary information that the second acquisition module obtains to be stitched together the index information as described file.
The technical scheme that the embodiment of the present invention provides provides the benefit that:
By only downloading the partial content of file, according to the index information of the partial content calculation document downloaded,
It is used as unique mark of this file content, and no longer use in prior art and download the interior of whole file
Holding to come computation index information, result substantially increases file index information and the speed of link warehouse-in, significantly
Improve the efficiency that resource is included；Download all in addition, only download in the partial content of file and prior art
File is compared, and the file transit space taking greatly reduces, and has saved resource.
Brief description
For the technical scheme being illustrated more clearly that in the embodiment of the present invention, institute in embodiment being described below
The accompanying drawing using is needed to be briefly described, it should be apparent that, the accompanying drawing in describing below is only the present invention
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work,
Other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the method flow diagram including index information that the embodiment of the present invention one provides；
Fig. 2 is the method flow diagram including index information that the embodiment of the present invention two provides；
Fig. 3 is the structural representation of the download authentication server that the embodiment of the present invention three provides；
Fig. 4 is the another kind of structural representation downloading authentication server that the embodiment of the present invention three provides.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Embodiment is described in further detail.
Embodiment one
Embodiments providing a kind of method including index information, seeing Fig. 1, method flow is specifically such as
Under:
101: obtain the download link that crawler server pushes, and download the partial content of file from download link；
102: calculate the index information of this document according to the partial content downloaded；
103: set up the mapping relations between the index information of this document and download link, and report database
Server is included.
The method that the embodiment of the present invention provides, by only downloading the partial content of file, according to the part downloaded
The index information of content calculation document, is used as unique mark of this file content, and no longer uses existing
Having in technology the content downloading whole file to carry out computation index information, result substantially increases file index information
With the speed of link warehouse-in, significantly improve the efficiency that resource is included；In addition, only download the part of file
Content is compared with download all files in prior art, and the file transit space taking greatly reduces, and saves
Resource.
Embodiment two
Embodiments provide a kind of method including index information, mainly in P2SP background system
Download authentication server function improvement, i.e. the mistake to the download address and index information actively including file
The improvement of journey.The embodiment of the present invention have employed a kind of new index information, by the rope based on file part content
Fuse breath, as unique mark of file, sees Fig. 2, and method flow is specific as follows:
201: obtain the download link that crawler server pushes；
Specifically, crawler server is running always, ceaselessly includes the download page therefrom from internet
Extraction is for the download link downloaded.Owing to existing link form is generally URL link, download link and
Other pagefiles link can by link extension name distinguish, such as extend entitled exe, rar, iso,
The URL link of zip etc. an all directly corresponding binary file that can download.Crawler server will crawl
To URL link duplicate removal after be pushed to download authentication server, download authentication server and receive and push
URL link.
202: download the partial content of file from download link；
Download beginning resource after authentication server gets download link and include process, download link is entered one by one
Row is downloaded and computation index information.
Specifically, being different from prior art needs to download the content of whole file from download link, and the present invention is real
Execute example provide method be download file partial content, specifically can from download link download file head,
Centre and afterbody three partial content.
Further, head, centre and afterbody three partial content of downloading file can be in the following way:
Obtaining the corresponding fileinfo of this download link, this document information includes the size of file；Big according to file
Little and default burst size is by this document burst；Download from this download link according to burst size and side-play amount
The first piece of this document, middle a piece of and last a piece of content fragment.For example, the size of a file is T,
The burst size preset is P (T), and P (T) generally takes 20KB, then this document can be divided into N piece,
N=(T+P (T)-1)/P (T) piece, then downloads the 1st, centre respectively according to P (T) and side-play amount
1, and N piece.
It should be noted that download the partial content of file from download link, be not limited to use above-mentioned under
The form of head, middle and end three partial content of published article part, can also use download other partial contents of file, or
The form of other guide burst, the function of its essence is the same with the effect reaching, i.e. by the part of file
Content replaces full content.
203: calculate the index information of this document according to the partial content downloaded；
The embodiment of the present invention is not defined to by the mode of partial content computation index information, as long as under according to
The index information that the partial content carrying calculates can uniquely identify this document.
Specifically, when in the manner described above from the head of download link download file, middle and afterbody three part
During content, correspondingly, calculate the index information of this document according to the partial content downloaded, concrete mode is permissible
For calculating the cryptographic Hash of head, centre and afterbody three partial content of this document respectively；By calculated three
Individual cryptographic Hash is combined calculating cryptographic Hash again, and using last calculated cryptographic Hash as this document
Index information.Wherein, if head, middle and end three partial content downloaded is the first piece of this document, centre respectively
During a piece of and last a piece of content fragment, then just calculate the first piece of this document, middle a piece of and the most respectively
The cryptographic Hash of rear piece of content burst.
For example, it is assumed that preset burst size P (T)=20KB, first respectively calculate this document first piece, in
Between a piece of and last a piece of content fragment MD5 (Message Digest Algorithm 5, eap-message digest calculate
Method the 5th edition) value, the MD5 value of each burst is 16B, then the MD5 value of above-mentioned 3 bursts is altogether
48B, after this 3 MD5 values are spliced together, then calculate they SHA1 (Secure Hash Algorithm,
Secure Hash Algorithm) value, the SHA1 value obtaining is 20B, and this SHA1 value is the index information of this document,
Three sections of Hash can also be referred to as.
Further, in order to make the index information calculating have more representativeness, by calculated three
Cryptographic Hash is combined before again calculating cryptographic Hash, can also obtain the auxiliary information of this document, this auxiliary
Information can be the attribute informations such as the size of this document or file extension, wherein, obtains the auxiliary of this document
The step of information can be combined after step 201, by calculated three cryptographic Hash and again calculate
Any time before cryptographic Hash performs, and this is not especially limited by the embodiment of the present invention, for example, can divide
Not Ji Suan the head of this document, after the middle and cryptographic Hash of afterbody three partial content, by calculated
Three cryptographic Hash are combined before again calculating cryptographic Hash and perform, it is also possible in step 202 from download link
When downloading the partial content of file, obtain the auxiliary information of this document simultaneously.Correspondingly, by calculated
Three cryptographic Hash are combined calculating cryptographic Hash again, and using last calculated cryptographic Hash as this document
Index information can be in the concrete following two mode that uses:
First kind of way: the auxiliary information of calculated three cryptographic Hash and acquisition is stitched together again
Calculate cryptographic Hash, and using last calculated cryptographic Hash as the index information of this document；Or,
The second way: calculated three cryptographic Hash are stitched together and again calculate cryptographic Hash, and will
The auxiliary information of last calculated cryptographic Hash and acquisition is stitched together the index information as this document.
For example, it is assumed that the auxiliary information obtaining takies 8B, continuing above example, first kind of way is for by 3
Individual MD5 value and auxiliary information are spliced together, and 56B, calculates their SHA1 value, the SHA1 value obtaining altogether
For 20B, this SHA1 value is the index information of this document；The second way is for being spliced to 3 MD5 values
Together, altogether 48B, calculates their SHA1 value, and the SHA1 value obtaining is 20B, then by this SHA1 value with
Auxiliary information is spliced together, altogether 28B, by them collectively as the index information of this document.
204: set up the mapping relations between the index information of this document and download link, and report database
Server is included.
Specifically, after calculating the index information for unique mark this document, by this index information be used for
The download link downloading this document associates, and reports database server and includes.If finding this number
There is this index information according in the server of storehouse, then add in the download link associating with this index information
Add this download link newly included；If found, this database server does not exist this index information, that
Add the download link of this index information and associated.
It should be noted that after using the above-mentioned new method including index information, for entirely in P2SP system
Portion uses the form of the index information that this is new uniquely to identify a file.
The computational methods of the extraction of above-mentioned partial content and index information can avoid certain conflict, if adopted
Avoid the effect of conflict by head, middle and end three partial content of above-mentioned extracted file the method calculating three sections of Hash more
Add substantially.Because if being only merely the head of extracted file, or afterbody, to some audio frequency or video
For file, head or afterbody after being truncated are identical, then calculate hash value and easily occur that Hash rushes
Prominent.In order to part Hash making extraction is representative, representational place, three, the head, middle and end of extracted file,
And calculate three sections of Hash as the unique mark representing this document, the most files in internet, lead to
Cross and practice have shown that, use three sections of Hash, regardless of file format, the head, middle and end of file occur hardly
Three sections of contents identical and three sections outside the different situation of content, also avoid the Hash conflict of file.As
Fruit considers the auxiliary information such as the size of file simultaneously, it is to avoid the effect of conflict can be more preferably.If the part of extraction
Content is not conflicted, it is possible to calculate, by the contents of the section, unique mark that hash value is used as file.
The method that the embodiment of the present invention provides, by only downloading the partial content of file, according to the part downloaded
The index information of content calculation document, is used as unique mark of this file content, and no longer uses existing
Having in technology the content downloading whole file to carry out computation index information, result substantially increases file index information
With the speed of link warehouse-in, significantly improve the efficiency that resource is included；Owing to new resources storage accelerates,
Indirectly accelerate the issue speed of new resources in P2SP system, decrease from file distribution initially to this document tool
The time of standby the whole network P2SP ability, make user start just can quickly obtain speed in download, improve client
The downloading experience of end, reduces the peak bandwidth pressure of original source server simultaneously；In addition, only download file
Partial content with in prior art download all files compare, the file transit space taking greatly reduces,
Save resource.
Embodiment three
See Fig. 3, embodiments provide a kind of download authentication server, this download authentication server bag
Include:
First acquisition module 301, for obtaining the download link that crawler server pushes；
Download module 302, in the part from the download link download file that the first acquisition module 301 obtains
Hold；
Computing module 303, the partial content for downloading according to download module 302 calculates the index letter of this document
Breath；
Set up module 304, for setting up index information and the download link of this document that computing module 303 calculates
Between mapping relations, and report database server and include.
Further, download module 302, specifically under the download link that the first acquisition module 301 obtains
The head of published article part, middle and afterbody three partial content；
Correspondingly, computing module 303, specifically for calculate respectively download module 302 download file head,
The middle cryptographic Hash with afterbody three partial content；Calculated three cryptographic Hash are combined and again calculate
Cryptographic Hash, and using last calculated cryptographic Hash as the index information of this document.
Further, download module 302, specifically for obtaining the corresponding fileinfo of download link, this article
Part information includes the size of file；Size according to file and default burst size are by this document burst；Root
According to burst size and side-play amount from download link download the first piece of this document, middle a piece of and last a piece of in
Hold burst；
Correspondingly, computing module 303 for calculate respectively the file that download module 302 is downloaded head, in
Between and during the cryptographic Hash of afterbody three partial content, specifically for calculate respectively this document first piece, middle one
Piece and the cryptographic Hash of last a piece of content fragment.
Alternatively, seeing Fig. 4, this download authentication server also includes:
Second acquisition module 305, for being combined calculated three cryptographic Hash at computing module 303
Before again calculating cryptographic Hash, obtaining the auxiliary information of this document, wherein, the second acquisition module 305 is permissible
Optional position before computing module 303 performs, and this is not especially limited by the embodiment of the present invention, Fig. 4
Only as a example by the second acquisition module 305 performs after download module 302, before computing module 303, also
Can perform after the first acquisition module 301, before download module 302；
Correspondingly, computing module 303 is breathed out for being combined calculated three cryptographic Hash again to calculate
Uncommon value, and using last calculated cryptographic Hash as the index information of this document when, specifically for calculating
The auxiliary information that three cryptographic Hash obtaining and the second acquisition module 305 obtain is stitched together again to calculate and breathes out
Uncommon value, and using last calculated cryptographic Hash as the index information of this document；Or, by calculated
Three cryptographic Hash are stitched together and again calculate cryptographic Hash, and obtain last calculated cryptographic Hash and second
The auxiliary information that delivery block 305 obtains is stitched together the index information as this document.
In sum, the embodiment of the present invention is by only downloading the partial content of file, according in the part downloaded
Hold the index information of calculation document, be used as unique mark of this file content, and no longer use existing
The content downloading whole file in technology carrys out computation index information, result substantially increase file index information and
The speed of link warehouse-in, significantly improves the efficiency that resource is included；Owing to new resources storage accelerates,
Indirectly accelerate the issue speed of new resources in P2SP system, decrease from file distribution initially to this document tool
The time of standby the whole network P2SP ability, make user start just can quickly obtain speed in download, improve client
The downloading experience of end, reduces the peak bandwidth pressure of original source server simultaneously；In addition, only download file
Partial content with in prior art download all files compare, the file transit space taking greatly reduces,
Save resource.
It should be understood that the download authentication server that above-described embodiment provides is when including index information, only
It is illustrated with the division of above-mentioned each functional module, in actual application, can be as desired by above-mentioned
Function distribution is completed by different functional modules, and the internal structure that will download authentication server is divided into difference
Functional module, to complete all or part of function described above.In addition, what above-described embodiment provided
Downloading authentication server and belonging to same design with the embodiment of the method including index information, it implements process
Refer to embodiment of the method, repeat no more here.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
All or part of step in the embodiment of the present invention, it is possible to use software realizes, corresponding software program
Can be stored in the storage medium that can read, such as CD or hard disk etc..
The foregoing is only presently preferred embodiments of the present invention, not in order to limit the present invention, all the present invention's
Within spirit and principle, any modification, equivalent substitution and improvement etc. made, should be included in the present invention's
Within protection domain.
Claims (7)
1. the method including index information, it is characterised in that described method includes:
Obtain the download link that crawler server pushes；
Download the partial content of file from described download link；
Calculate the index information of described file according to the partial content downloaded；
Set up the mapping relations between the index information of described file and described download link, and report data
Storehouse server is included；
The described partial content downloading file from described download link, comprising:
Download the head of file, middle and afterbody three partial content from described download link；
Correspondingly, the described index information calculating described file according to the partial content downloaded, comprising:
Calculate the cryptographic Hash of head, centre and afterbody three partial content of described file respectively；
Calculated three cryptographic Hash are combined calculating cryptographic Hash again, and will be finally calculated
Cryptographic Hash is as the index information of described file；
The cryptographic Hash of described head, centre and afterbody three partial content calculating described file respectively, comprising:
Size according to described file and default burst size, by described file fragmentation, download described file
First piece, middle a piece of and last a piece of content fragment, and calculate respectively described first piece, middle a piece of and
The cryptographic Hash of last a piece of content fragment.
2. method according to claim 1, it is characterised in that described published article from described download link
The head of part, middle and afterbody three partial content, comprising:
Obtaining the corresponding fileinfo of described download link, described fileinfo includes the size of file；
Size according to described file and default burst size are by described file fragmentation；
Download the first piece of described file, centre according to described burst size and side-play amount from described download link
A piece of and last a piece of content fragment；
Correspondingly, the cryptographic Hash of described head, centre and afterbody three partial content calculating described file respectively,
Including:
Calculate first piece, the cryptographic Hash of middle a piece of and last a piece of content fragment of described file respectively.
3. method according to claim 1, it is characterised in that described by calculated three Hash
Value is combined before again calculating cryptographic Hash, also includes:
Obtain the auxiliary information of described file；
Correspondingly, described be combined calculated three cryptographic Hash calculates cryptographic Hash again, and will
Rear calculated cryptographic Hash is as the index information of described file, comprising:
Calculated three cryptographic Hash and described auxiliary information are stitched together and again calculate cryptographic Hash, and
Using last calculated cryptographic Hash as the index information of described file；Or,
Calculated three cryptographic Hash are stitched together and again calculate cryptographic Hash, and will finally be calculated
Cryptographic Hash and described auxiliary information be stitched together the index information as described file.
4. method according to claim 3, it is characterised in that described auxiliary information is described file
Size, or, file extension.
5. download authentication server for one kind, it is characterised in that described download authentication server includes:
First acquisition module, for obtaining the download link that crawler server pushes；
Download module, the download link for obtaining from described first acquisition module downloads the partial content of file；
Computing module, the partial content for downloading according to described download module calculates the index letter of described file
Breath；
Set up module, for setting up the index information of the described file that described computing module calculates and described download
Mapping relations between link, and report database server and include.
Described download module, downloads file specifically for the download link obtaining from described first acquisition module
Head, centre and afterbody three partial content；
Correspondingly, described computing module, specifically for calculating the head of the file that described download module is downloaded respectively
The cryptographic Hash of portion, centre and afterbody three partial content；Calculated three cryptographic Hash are combined again
Calculate cryptographic Hash, and using last calculated cryptographic Hash as the index information of described file；
Described head, centre and afterbody three partial content calculating the file that described download module is downloaded respectively
Cryptographic Hash, comprising:
Size according to described file and default burst size, by described file fragmentation, download described file
First piece, middle a piece of and last a piece of content fragment, and calculate respectively described first piece, middle a piece of and
The cryptographic Hash of last a piece of content fragment.
6. download authentication server according to claim 5, it is characterised in that described download module,
Specifically for obtaining the corresponding fileinfo of described download link, described fileinfo includes the size of file；
Size according to described file and default burst size are by described file fragmentation；According to described burst size and
Side-play amount downloads the first piece of described file, middle a piece of and last a piece of content fragment from described download link；
Correspondingly, described computing module for calculate respectively the file that described download module is downloaded head, in
Between and during the cryptographic Hash of afterbody three partial content, specifically for calculating first piece, the centre of described file respectively
The cryptographic Hash of a piece of and last a piece of content fragment.
7. download authentication server according to claim 5, it is characterised in that described download checking clothes
Business device also includes:
Second acquisition module, for being combined calculated three cryptographic Hash at described computing module again
Before secondary calculating cryptographic Hash, obtain the auxiliary information of described file；
Correspondingly, described computing module is breathed out for being combined calculated three cryptographic Hash again to calculate
Uncommon value, and using last calculated cryptographic Hash as the index information of described file when, specifically for will meter
The auxiliary information that three cryptographic Hash obtaining and described second acquisition module obtain is stitched together and again calculates
Cryptographic Hash, and using last calculated cryptographic Hash as the index information of described file；Or, will calculate
To three cryptographic Hash be stitched together and again calculate cryptographic Hash, and by last calculated cryptographic Hash and institute
State the auxiliary information that the second acquisition module obtains to be stitched together the index information as described file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110100730.5A CN102750287B (en) | 2011-04-21 | 2011-04-21 | Include method and the download authentication server of index information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110100730.5A CN102750287B (en) | 2011-04-21 | 2011-04-21 | Include method and the download authentication server of index information |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102750287A CN102750287A (en) | 2012-10-24 |
| CN102750287B true CN102750287B (en) | 2016-10-05 |
Family
ID=47030479
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110100730.5A Active CN102750287B (en) | 2011-04-21 | 2011-04-21 | Include method and the download authentication server of index information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102750287B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103795765B (en) * | 2012-11-02 | 2018-09-28 | 腾讯科技（深圳）有限公司 | A kind of file uploads method of calibration and system |
| CN108810111B (en) * | 2013-07-12 | 2020-08-07 | 腾讯科技（深圳）有限公司 | Method, client and system for downloading data |
| CN105320883B (en) * | 2015-11-11 | 2018-05-15 | 北京奇虎科技有限公司 | File security loads implementation method and device |
| CN108520077A (en) * | 2018-04-20 | 2018-09-11 | 广东五科技股份有限公司 | A kind of method and apparatus avoiding repeated downloads |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101442558B (en) * | 2008-12-26 | 2011-10-19 | 中国科学院计算技术研究所 | Method and system for providing index service for P2SP network |
| CN101719936A (en) * | 2009-12-09 | 2010-06-02 | 成都市华为赛门铁克科技有限公司 | Method, device and cache system for providing file downloading service |
-
2011
- 2011-04-21 CN CN201110100730.5A patent/CN102750287B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN102750287A (en) | 2012-10-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109345388B (en) | Block chain intelligent contract verification method and device and storage medium | |
| CN110058873A (en) | Application page update method, device, equipment and storage medium | |
| CN103377053B (en) | Method, device and system for controlling application | |
| CN105718276B (en) | Method and device for providing APK download and NGINX server | |
| CN105871587A (en) | Log uploading method and device | |
| US20200226102A1 (en) | Application aware deduplication allowing random access to compressed files | |
| CN102750287B (en) | Include method and the download authentication server of index information | |
| CN104378234A (en) | Cross-data-center data transmission processing method and system | |
| CN108415714A (en) | The method for upgrading system and device of mobile terminal | |
| US20140359066A1 (en) | System, method and device for offline downloading resource and computer storage medium | |
| CN106227893A (en) | A kind of file type acquisition methods and device | |
| CN109086307A (en) | The method and device of file process | |
| CN110543324A (en) | Plug-in increment updating method and device for application program | |
| CN104052626A (en) | Method, device and system for configuring network element data | |
| US20140156809A1 (en) | Data downloading method, terminal, server, and system | |
| CN108133026B (en) | Multi-data processing method, system and storage medium | |
| CN106326258B (en) | URL matching method and device | |
| CN103778114B (en) | File repair system and method | |
| CN103220327B (en) | user information storage method and device | |
| CN107026888B (en) | Large-capacity data transmission device and method | |
| CN107977381B (en) | Data configuration method, index management method, related device and computing equipment | |
| CN110895583A (en) | Method, device and system for acquiring data resources | |
| CN108008984A (en) | A kind of resource file downloading updating method and device | |
| CN110896391B (en) | Message processing method and device | |
| US10908888B2 (en) | Enhanceable cross-domain rules engine for unmatched registry entries filtering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190731 Address after: 518000 Guangdong city of Shenzhen province Futian District SEG Science Park 2 East Room 403 Co-patentee after: Tencent cloud computing (Beijing) limited liability company Patentee after: Tencent Technology (Shenzhen) Co., Ltd. Address before: 518000 Guangdong city of Shenzhen province Futian District SEG Science Park 2 East Room 403 Patentee before: Tencent Technology (Shenzhen) Co., Ltd. |
|
| TR01 | Transfer of patent right |