CN101534320B - Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode - Google Patents
Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode Download PDFInfo
- Publication number
- CN101534320B CN101534320B CN2008102436359A CN200810243635A CN101534320B CN 101534320 B CN101534320 B CN 101534320B CN 2008102436359 A CN2008102436359 A CN 2008102436359A CN 200810243635 A CN200810243635 A CN 200810243635A CN 101534320 B CN101534320 B CN 101534320B
- Authority
- CN
- China
- Prior art keywords
- thunder
- file
- http
- flow
- fast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The method provides a method for controlling and managing file downloading flow of a fast thunder client based on HTTP mode. The method comprises the following steps: firstly, identifying a protocol of fast thunder self so as to determine that whether a local host applies the fast thunder or not, and calculating the number of resources acquired by the fast thunder client from a fast thunder resource server; secondly, carrying out statistic on the property of external data communication flow of the local host based on the HTTP mode, and simultaneously storing, counting and calculating key fields, domains and state codes in HTTP standard application; thirdly, determining that whether each HTTP session transmits different file sections of the same file or not; fourthly, determining that whether file downloading of single-server single-thread, single-server hyper-thread and multi-server hyper-thread is based on the HTTP mode or not; and finally, carrying out blockage and flow control through combining the file downloading flow based on the HTTP mode with the determined file flow downloaded by the fast thunder self. The controlling and managing method separates the file flow downloading based on the HTTP mode from common WEB application, thereby greatly optimizing the network.
Description
Technical field
The present invention relates in the flow control system method for blocking about common application software file download flow on the Internet, especially on the present the Internet based on the control and management method of a mainstream applications software sudden peal of thunder (the comprising a WEB sudden peal of thunder) client of multiple downloading mode.
Background technology
Along with the high speed development of the Internet, IP network data carried by data flow is increasing, needs the overall performance of control IP network and traffic conditions to adapt to professional development; Also becoming such as the application software of one type of a sudden peal of thunder becomes more and more popular, and this type application software combines to have used P2P technology and MHT technology, and multiple downloading modes such as P2P, HTTP, FTP are provided.
If the corporate intranet user uses fast thunder client in the loading internet document resource; And be hot resource; According to data analysis, consider the sudden and locality of network traffics simultaneously, after continuing a short time; The flow proportion that a sudden peal of thunder is downloaded through the HTTP mode is much lower unlike the flow proportion of downloading through the P2P mode, even taller sometimes; Because traditional fire compartment wall and general network flow control system all are open to 80 ports that are used for the Web application; Do not do keyholed back plate; So traditional fire compartment wall and general network flow control system can't be downloaded through the big flow file of HTTP mode a sudden peal of thunder and control and shutoff; Negative consumption appears in the network bandwidth, has influenced the overall performance of enterprise network and the carrying out of key business, and control has brought difficulty to network traffics.In order to ensure the normal use of web browsing, again a sudden peal of thunder is carried out management and control with the HTTP mode of P2P mode and MHT simultaneously, control and management method has been proposed, next combine sudden peal of thunder explanation.
A sudden peal of thunder is based on a downloaded software of P2SP, can strengthen speed of download greatly.If certain identical file is arranged on a plurality of servers, when this file on one of them server of certain user's download, a sudden peal of thunder can find other several servers automatically, downloads this file simultaneously, reaches the purpose of speed-raising.Generally speaking, its original download speed is very slow, but the speed of candidate's resource is but very fast.The download principle is: 1) user is the link of the Thunder.exe file on the A.B.C.D through clicking server address; 2) sudden peal of thunder on the user PC obtains unique check value of this document; 3) sudden peal of thunder is searched on the Resource Server of trend oneself, finds other the server list of depositing identical file; 4) obtain catalogue and the filename of file on this server, promptly each mirror image candidate resource website E.F.G.H and I.J.K.L or the like and the P2P public network resource network station address of oneself are M.N.O.P; 5) sudden peal of thunder is gone up the different blocks of files of downloading this document from trend E.F.G.H with I.J.K.L, to reach the purpose of quickening download; 6) user sends the UDP resource request to P2P public network resource network user M.N.O.P; 7) whether P2P public network resource network user M.N.O.P responds, and whether required file is arranged; 8) if the P2P user response has required file, promptly to the port initiation request of M.N.O.P, and the transmission data; 9) after download finishes, if on the sudden peal of thunder Resource Server, do not have present user to click the server A .B.C.D of download in the server list of this document, then that this is new server address joins the server list of this document.
Above-mentioned steps 2) in; File on the Internet much is that filename is identical but content different; Much be filename difference but content is identical, unique file verification value that a sudden peal of thunder obtains is to use the file verification mechanism of oneself, has guaranteed the correctness and the integrality of user's download file.
Above-mentioned steps 3) in, a sudden peal of thunder is searched on the Resource Server of trend oneself, each all can send resource request message to the tcp port 80,8000 or 8080 of the address realm of 58.254.39.4～58.254.39.22; This address realm is write dead in fast thunder client software, if filter out this message, fast thunder client just can't be accomplished resource request so, can't download from multiple spot, can only be from original connection download.
Above-mentioned steps 6), 7), 8) in, implied a process: whether judges is public network user.If public network user, then this user's IP address with provide the port of download service also will be recorded in the Resource Server of a sudden peal of thunder, subsequent user can be downloaded from this user.
Through analyzing the download principle of a sudden peal of thunder; The interaction data message that uses the packet capturing of Sniffer instrument to analyze it mainly is classified as several several kinds down: 1) resource request message; 2) resource searching back message using; 3) the mutual message of file transfer; 3.1) the mutual message of file transfer (P2P mode) between user and the user, 3.2) user and sudden peal of thunder own resource server file transmit mutual message (C/S mode), 3.3) user and mirror image candidate station resource dot file transmit mutual message (generally using the http protocol of standard to use many resources multithreading downloads); 4) the mutual message of resource information between the user, 5) the new resource information message of submission.The DFA deep layer bag of existing AOS equipment detects the mode of engine through label to 1 in the above-mentioned data message), 2), 3.1), 3.2), 4), 5) etc. several kinds of messages discern and control; And 3.3) the mutual message of indication is because use the http protocol of standard; So traditional fire compartment wall and general network flow control system are judged as the HTTP flow with it, wouldn't do whole control to a sudden peal of thunder.Actual data packet is analyzed: like Fig. 1 is in the above-mentioned download principle, and mutual actual message in the third step filters out this message, and fast thunder client just can't be accomplished resource request, and the place of the underlining among the figure is the tagged word in the data message.
A sudden peal of thunder is searched on the Resource Server of oneself; Find other the server list of depositing identical file; And the file transfer interaction data that carries out between a sudden peal of thunder and these servers to have be to download (when particularly mutual the and P2P resource network of self server resource of a sudden peal of thunder is downloaded Be Controlled alternately) through using http protocol greatly; The HTTP standard agreement is again by many internet download tool applications; And these internet download instruments are of a great variety, have brought difficulty for the integral body control of a sudden peal of thunder.
Summary of the invention
The objective of the invention is to overcome the deficiency that prior art exists, the control and management method of a kind of fast thunder client based on HTTP mode file download flow is provided.
The object of the invention is realized through following technical scheme:
Fast thunder client specifically may further comprise the steps based on the control and management method of HTTP mode file download flow---
1. at first through the mode of label a sudden peal of thunder self agreement is discerned, whether used a sudden peal of thunder, and calculate the number of resources that fast thunder client gets access to from sudden peal of thunder Resource Server to judge local host through the DFA deep layer bag detection engine of AOS equipment;
2. add up for the external data communication traffic characteristic of local host, simultaneously the critical field in the HTTP standard application, territory, conditional code are stored, add up, calculated based on the HTTP mode;
3. according to each based on the file size in the session of HTTP mode document flow, judge that each http session is whether at the different file sections of the same file of transmission;
4. combine again each local host IP, port pair based on HTTP mode document flow with the IP of target file server, port to and the statistics of the number of resources information that gets access to from sudden peal of thunder Resource Server of fast thunder client carry out various combinations with the operation NOR operation, the Single-Server that whether is based on the HTTP mode is single-threaded, the file of Single-Server hyperthread, multiserver hyperthread is downloaded;
5. combine a sudden peal of thunder self the institute downloaded files flow judged, these file download flows based on the HTTP mode are combined stop and flow control.
Further, above-mentioned fast thunder client in the document flow transmission based on the HTTP mode, obtains the total bytes of each file in download based on the control and management method of HTTP mode file download flow.
Further, above-mentioned fast thunder client is based on the control and management method of HTTP mode file download flow, and the key state sign indicating number that relates to has 200,206; The crucial header field that relates to has Content-Encoding, Content-Length, Content-Range, Content-Type.
Further, above-mentioned fast thunder client is based on the control and management method of HTTP mode file download flow, and what fast thunder client adopted is hyperthread mode file in download, and this has brought convenience to integral body control sudden peal of thunder flow.
Substantive distinguishing features and obvious improvement that technical scheme of the present invention is outstanding are mainly reflected in:
Control and management method of the present invention will be downloaded with the common web application division based on HTTP mode document flow and come, and optimize network greatly; Not still to the download based on HTTP mode document flow of a sudden peal of thunder, and can control the download tool based on HTTP mode document flow commonly used on the present the Internet; The file of a later sudden peal of thunder is downloaded or the refinement of the precision flow control that the file of similar means is downloaded has put forward new approach.
Description of drawings
Below in conjunction with accompanying drawing technical scheme of the present invention is described further:
Fig. 1: demand file downloaded resources data message;
Fig. 2: session both sides IP, PORT are to statistical chart;
Fig. 3: the state message that the source material server returns;
Fig. 4: the state message that the mirror image resources server returns.
Embodiment
Fast thunder client is based on the control and management method of HTTP mode file download flow; Its detailed process: 1) at first through the mode of label a sudden peal of thunder self agreement is discerned through the DFA deep layer bag detection engine of AOS equipment; Whether using a sudden peal of thunder, and calculate the number of resources that fast thunder client gets access to from sudden peal of thunder Resource Server to judge local host; 2) add up for the external data communication traffic characteristic of local host, simultaneously the critical field in the HTTP standard application, territory, conditional code are stored, add up, calculated based on the HTTP mode; 3) according to each based on the file size in the session of HTTP mode document flow, judge that each http session is whether at the different file sections of the same file of transmission; 4) combine again each local host IP, port pair based on HTTP mode document flow with the IP of target file server, port to and the statistics of the number of resources information that gets access to from sudden peal of thunder Resource Server of fast thunder client carry out various combinations with the operation NOR operation, the Single-Server that whether is based on the HTTP mode is single-threaded, the file of Single-Server hyperthread, multiserver hyperthread is downloaded; 5) combine a sudden peal of thunder self the institute downloaded files flow judged, these file download flows based on the HTTP mode are combined to stop and flow control.In the document flow transmission based on the HTTP mode, can obtain the total bytes of each file in download.The key state sign indicating number that relates to has 200,206; The crucial header field that relates to has Content-Encoding, Content-Length, Content-Range, Content-Type.Generally speaking, what fast thunder client adopted is hyperthread mode file in download, and this has brought convenience to integral body control sudden peal of thunder flow.
With reference to RFC 2616 documents of IETF (The Internet Engineering Task Force, the Internet engineering duty group), self agreement identification of the concrete definition of each field, territory, conditional code in the HTTP standard application agreement and a sudden peal of thunder is combined analysis:
To statistical chart, illustrated main HTTP file download service device to tabulate like Fig. 2 session both sides IP, PORT, can find out that it is the mode of many resources hyperthread that a sudden peal of thunder adopts when using the http protocol download.
The state message that source material server shown in Figure 3 returns; Illustrated the response packet that long-range http server returns; Conditional code is 200, expression OK (with reference to RFC 2616 6.1.1 joint), and this conditional code generally all is the state that is returned by the original address server; The Content-Length territory of back occurs, and (occurring then having ignored the Content-Length territory) can appear in Transfer-Encoding territory scarcely.The value in Content-Length territory is total size of institute's file in download, is decimal system syllable sequence.
The state message that mirror image resources server shown in Figure 4 returns; Also illustrated the response packet that long-range http server returns; Conditional code is 206, expression Partial Content (with reference to RFC 2616 6.1.1 joint), explain to download be the partial document fragment; This state generally is the state that is returned by candidate's Resource Server; Byte count sizes is institute's downloaded files clip size in the Content-Length territory of back, and digital 3 mark also are total sizes of institute's file in download among the figure, these data be with Fig. 3 in the Content-Length territory after data be unified; The value only here is behind the Content-Range territory, and the front of this value is the start-stop scope of this dialogue institute file in download fragment.
Through the test of many times analysis, also to the analysis of contrasting of the popular several similar download tool of current internet, obtain simultaneously to draw a conclusion:
Judging that conditional code that all http servers return is 200 and 206, get the value of the institute's download file size in this message, conditional code is 200, just directly gets the value in Content-Length territory; Conditional code is 206 the value of getting file fragment size back behind the Content-Range territory; Through statistics; Find that these values equate and the destination server address of these connections is mostly different; While makes a decision according to the response that the fast thunder client on the active user PC has received resource request message, and these connections all are the HTTP flow of a sudden peal of thunder.
In the above-mentioned conclusion; Because on the Internet; The HTTP download tool similar with a sudden peal of thunder is a lot; Downloading if it were not for the multithreading of an address, perhaps is exactly the downloading mode of multithreading multiserver, at this moment preferably seven layers of condition code of each known download tool, number of servers that resource request message is responded is combined and takes all factors into consideration.
Control and management method of the present invention will be downloaded with the common web application division based on HTTP mode document flow and come, and optimize network greatly; Not still to the download based on HTTP mode document flow of a sudden peal of thunder, and can control the download tool based on HTTP mode document flow commonly used on the present the Internet; The file of a later sudden peal of thunder is downloaded or the refinement of the precision flow control that the file of similar means is downloaded has put forward new approach.
What need understand is: above-mentioned explanation is not to be limitation of the present invention, and in concept of the present invention, the interpolation of being carried out, conversion, replacement etc. also should belong to protection scope of the present invention.
Claims (4)
1. fast thunder client is characterized in that based on the control and management method of HTTP mode file download flow: specifically may further comprise the steps---
1. at first through the mode of label a sudden peal of thunder self agreement is discerned, whether used a sudden peal of thunder, and calculate the number of resources that fast thunder client gets access to from sudden peal of thunder Resource Server to judge local host through the DFA deep layer bag detection engine of AOS equipment;
2. add up for the external data communication traffic characteristic of local host, simultaneously the critical field in the HTTP standard application, territory, conditional code are stored, add up, calculated based on the HTTP mode;
3. according to each based on the file size in the session of HTTP mode document flow, judge that each http session is whether at the different file sections of the same file of transmission;
4. combine again each local host IP, port pair based on HTTP mode document flow with the IP of target file server, port to and the statistics of the number of resources information that gets access to from sudden peal of thunder Resource Server of fast thunder client carry out various combinations with the operation NOR operation, the Single-Server that judges whether to be based on the HTTP mode is single-threaded, the file of Single-Server hyperthread or multiserver hyperthread is downloaded;
5. combine a sudden peal of thunder self the institute downloaded files flow judged, will combine based on the file download flow of HTTP mode to stop and flow control.
2. fast thunder client according to claim 1 is characterized in that based on the control and management method of HTTP mode file download flow: in the document flow transmission based on the HTTP mode, obtain the total bytes of each file in download.
3. fast thunder client according to claim 1 is characterized in that based on the control and management method of HTTP mode file download flow: the key state sign indicating number that relates to has 200,206; The key that relates to has Content-Encoding, Content-Length, Content-Range, Content-Type.
4. fast thunder client according to claim 1 is characterized in that based on the control and management method of HTTP mode file download flow: what fast thunder client adopted is hyperthread mode file in download.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102436359A CN101534320B (en) | 2008-12-04 | 2008-12-04 | Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008102436359A CN101534320B (en) | 2008-12-04 | 2008-12-04 | Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101534320A CN101534320A (en) | 2009-09-16 |
| CN101534320B true CN101534320B (en) | 2012-04-25 |
Family
ID=41104707
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008102436359A Expired - Fee Related CN101534320B (en) | 2008-12-04 | 2008-12-04 | Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101534320B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101848156A (en) * | 2010-05-19 | 2010-09-29 | 苏州迈科网络安全技术有限公司 | Method of FLV (Flash Video) flow localization |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1368691A (en) * | 2001-02-07 | 2002-09-11 | 无敌科技(西安)有限公司 | Method for browsing network document by palm-type data processor |
| CN1852101A (en) * | 2005-08-10 | 2006-10-25 | 华为技术有限公司 | Parallel downloading method and terminal |
-
2008
- 2008-12-04 CN CN2008102436359A patent/CN101534320B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1368691A (en) * | 2001-02-07 | 2002-09-11 | 无敌科技(西安)有限公司 | Method for browsing network document by palm-type data processor |
| CN1852101A (en) * | 2005-08-10 | 2006-10-25 | 华为技术有限公司 | Parallel downloading method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101534320A (en) | 2009-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11340931B2 (en) | Recommendation generation based on selection of selectable elements of visual representation | |
| US10867307B2 (en) | System and method for applying tracing tools for network locations | |
| US11436075B2 (en) | Offloading anomaly detection from server to host | |
| US11398987B2 (en) | Host-based flow aggregation | |
| US11176157B2 (en) | Using keys to aggregate flows at appliance | |
| US11288256B2 (en) | Dynamically providing keys to host for flow aggregation | |
| US7089304B2 (en) | Metered Internet usage | |
| CN108400909B (en) | Traffic statistical method, device, terminal equipment and storage medium | |
| KR101420548B1 (en) | Method and system for supporting the selection of communication peers in an overlay network | |
| EP2591573B1 (en) | Method and apparatus for traffic classification | |
| EP2556632B1 (en) | Real-time adaptive processing of network data packets for analysis | |
| EP1530859B1 (en) | Heuristics-based routing of a query message in peer to peer networks | |
| US20210029051A1 (en) | Analyzing flow group attributes using configuration tags | |
| US20100054128A1 (en) | Near Real-Time Alerting of IP Traffic Flow to Subscribers | |
| US20080162690A1 (en) | Application Management System | |
| CN101127690A (en) | Identification method for next generation of network service traffic | |
| KR101136529B1 (en) | A system for traffic analysis based on session | |
| CN102035750A (en) | Peer-to-peer (P2P) flow recognizing method and device | |
| KR102423039B1 (en) | Real-time packet data storing method and apparatus for mass network monitoring | |
| CN101534320B (en) | Method for controlling and managing file downloading flow of fast thunder client based on HTTP mode | |
| KR102423038B1 (en) | Real-time packet data collection method and apparatus for mass network monitoring | |
| CN107147731A (en) | The active measuring method and system of a kind of BT network node informations | |
| CN114201659A (en) | Message track transmission query method, device and system | |
| Riikonen | Mobile internet usage-network traffic measurements | |
| CN102035725B (en) | Relevant technology system for one-way flow uniform resource identifier (URI) under asymmetric routing and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120425 Termination date: 20151204 |
|
| EXPY | Termination of patent right or utility model |