CN1937554A - Method for making P2P file download flow localized - Google Patents
Method for making P2P file download flow localized Download PDFInfo
- Publication number
- CN1937554A CN1937554A CNA2006100965594A CN200610096559A CN1937554A CN 1937554 A CN1937554 A CN 1937554A CN A2006100965594 A CNA2006100965594 A CN A2006100965594A CN 200610096559 A CN200610096559 A CN 200610096559A CN 1937554 A CN1937554 A CN 1937554A
- Authority
- CN
- China
- Prior art keywords
- file
- download
- client
- network
- file download
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a P2P file download flow localizing method, comprising the steps of: analyzing and recognizing P2P file download data packet by protocol and obtaining the current popular download file list, downloading the corresponding P2P files and buffering locally. On the condition of not requiring terminal user to update P2P client ends, it actively provides file download service for local P2P download users through custom-made P2P client ends, thus reducing download waiting time for terminal users; besides, it also actively cuts off P2P file download connection from local P2P client end to extranet, thus reducing network outlet bandwidth occupation by P2P file download. And it can optimize outlet bandwidths of Internet service providers and besides improve user satisfaction.
Description
One, technical field
The present invention relates to a kind of file download flow localized method of P2P in the internet that makes, be applicable to that Internet service provides the field.
Two, background technology
Along with popularizing of technique of internet,, be that the P2P (peer-to-peer) of representative uses beginning popular on the internet with Napster in the later stage nineties.In the P2P system, terminal P2P program be client also be server.Than traditional Client/Server pattern, in P2P uses, the issue of information and exchange are no longer dependent on specific server, thus make information issue and exchange more convenient, thereby make the terminal personal user become possibility releasing news on the internet.At the initial stage in the 2000's, be that the P2P exchange files network of representative comes into vogue with Gnutella and KaZZa.Document exchange system based on P2P has developed into the second generation at present, is representative with BitTorrent and eDonkey series.
Because a large amount of Internet users use P2P software to download and shared file, and these files are based on video file and software (these file sizes can reach hundreds of million, even a few GB), so the download of P2P file has occupied a large amount of network bandwidths.Simultaneously because current P2P file-sharing software has certain blindness when selecting partner (peer), may select to download the segment of a file there as a user of Pekinese, but also have this user to want downloaded contents the user of Pekinese that coexists outside his building, a few building from one far away from the user of the U.S..So just caused the serious waste of valuable core net bandwidth.On the other hand,, make network congestion, caused P2P to use the decline of self and the service quality of other network application (as web browsing, Email etc.) because the P2P file downloads the taking of bandwidth.
Based on above background, the present invention proposes a kind of method of the P2P file download flow being carried out localization, the basic thought of this method is that initiatively the P2P file of current popular is downloaded to this locality carries out buffer memory, when there are these files that are buffered of P2P user's download this locality, present technique can initiatively be given this P2P user these files on the one hand, can initiatively close this P2P user on the other hand again and be connected with the P2P of outer net.Because being limited in this locality, the flow that the P2P file is downloaded carries out, we have saved the core net bandwidth on the one hand, make these bandwidth can be used for improving the service quality that all-network is used, carry out the also corresponding raising of speed that P2P downloads owing to be loaded in this locality under the file on the other hand.
Three, summary of the invention
1, goal of the invention: the purpose of this invention is to provide a kind of method that makes the network traffics localization that the P2P file is downloaded in the internet, after making in this way, can reduce the core the Internet traffic significantly, improve terminal use's P2P file downloading rate and the service quality that other internet is used simultaneously, when optimizing the network bandwidth, improve end-user satisfaction.
2, technical scheme: the file download flow localized method of a kind of P2P of making of the present invention comprises that two subsystem: P2P download detection and control subsystem and P2P file cache and distribution subsystem.Wherein P2P download to detect and control subsystem is used for the P2P file downloaded and monitors and control; P2P file cache and distribution subsystem are carried out buffer memory and are provided local P2P file to download to the user the P2P file.But these two subsystems are flexible configuration when concrete the deployment: P2P file download detect and control subsystem can with the P2P file cache and the distribution subsystem cooperating of one or more classifications.Its method comprises the steps:
Step 1: utilize the image feature of the optical splitter or the network equipment to derive initial data, can monitor all the IP groupings on certain communication link of flowing through.These IP groupings are analyzed with known P2P file download protocol (for example BitTorrent and eDonkey), just can be obtained belonging to the grouping of special P 2 P file download protocol.Content to agreement is analyzed, and can obtain being requested the downloaded files name and send the ID value of client of request and information such as IP address and listening port number.For example the download request of BitTorrent client transmission is based on the TCP connection, has the data of following form:
" GET/URI? info_hash=Wen JianID ﹠amp; Peer_id=Ke HuduanID ﹠amp; The local listening port of port=number ... " wherein info_hash is the ID value of the file of being asked, and peer_id is the ID value of client self, and port is the port numbers that is used for accepting other client connection request.According to the content in the download request packet of BitTorrent, can obtain the file ID of being asked, the IP address of client and ID number, and the port numbers monitored of client.Similarly, also can analyze accordingly agreements such as eDonkey.
Data according to obtaining can further obtain following statistical information:
1) tabulation (table 1) of file popularity degree
| Filename | Total request download time | Special time period (as one day) request download time |
| File-1 | 1000 | 100 |
| File-2 | 600 | 80 |
| … | ||
| File-n | 1 | 1 |
Table 1 has reflected the popularity degree of files different in the P2P file download network.For example file-1 is requested to have downloaded in current slot 100 times, and its total request number of times is 1000 inferior.
2) file clients corresponding information list (table 2)
| Filename | The client-side information tabulation |
| File-1 | (client_1_1，ip_1_1，port_1_1) |
| File-2 | (client_2_1，ip_2_1，port_2_1)，(client_2_2，ip_2_2， port_2_2)，(client_2_3，ip_2_3，port_2_3) |
| … | … |
| File-n | (client_n_1，ip_n_1，port_n_1)，(client_n_2，ip_n_2， port_n_2)，…，(client_n_x，ip_n_x，port_n_x) |
Table 2 has reflected the current information of enlivening client of asking same file.Be 1 in the number of clients of demand file-1 just for example, the ID of this client is client_1_1, and the IP address is ip_1_1, and the port numbers that is used for monitoring other client connection request is port_1_1.
3) client is downloaded TCP connection tabulation (table 3) to the P2P file of outer net
| Client id | P2P file to outer net is downloaded the TCP link information |
| Client_1 | connection_1_1 |
| Client_2 | connection_2_1，connection_2_2，…，connection_2_x |
| … | … |
| Client_m | connection_m_1，connection_m_2，…，connection_m_y |
Table 3 has reflected a TCP link information that client is downloaded to the P2P file of outer net.For example Client_1 has a file to outer net to download the TCP connection.Each TCP connection is here represented with a four-tuple (source IP address, source port number, purpose IP address, destination slogan).Which file a P2P download connection is being downloaded and can judged by the information in the table 2, for example, if a source IP address and the port numbers that connects to the TCP of external network of client_1_1 is respectively ip_1_1 and port_1_1, then this P2P that is connected to file in download-1 downloads and connects.
Step 2: according to table 1, after the popularity degree of a certain file had surpassed specific thresholding, P2P download detection and control subsystem notice P2P file cache and distribution subsystem downloaded to this locality to this file and carry out buffer memory.The standard of file popularity degree can be: it is inferior that the requested number of times of file surpasses X (as 5) in specified time interval (as 24 hours); Or file request meets a certain specific distribution in time.
Step 3: receive when P2P file cache and distribution subsystem that P2P downloads and detect and after control subsystem downloaded the request of a certain file, file in download also was buffered in this locality.When file in download, preferentially download in the network internally, have only in the time can not downloading this file in the internal network, just from external network, download.
Step 4: after being cached with certain file (or partial content of file) in P2P file cache and the distribution subsystem, P2P downloads and control subsystem just can be according to the information of table 2 and table 3, press certain mode (for example according to the P2P bulk flow, or the flow of single connection, or mode at random etc.) disconnecting the TCP to external network that downloads this file connects.The method that disconnect to connect can send TCP by the P2P client that connects two ends to TCP and connect the grouping that reset grouping or indication network equipment filter this connection.The P2P file is downloaded and is connected control subsystem and notifies P2P file cache and distribution subsystem to provide file download service for the P2P client that these connections are disconnected simultaneously.
Step 5: after P2P file cache and distribution subsystem receive that P2P client for certain internal network provides the instruction of content, it will initiatively initiate one or more connections to this P2P client, and beginning provides file content to this client.
Functional module: two subsystems that the present invention comprises: the P2P file is downloaded detection and control subsystem, P2P file cache and distribution subsystem, and their structure as shown in Figure 1.The function of these two subsystems is as described below:
The P2P file is downloaded and control subsystem is finished following function:
(1) initial data is analyzed, therefrom obtained the grouping of P2P file data download, and carry out specific P2P protocal analysis (the P2P file is downloaded detection module).
(2) listed files of extraction current popular from the P2P grouping, the pairing active customer client information of file, and the pairing P2P file of each client is downloaded link information (P2P content statistics modules) such as (table 1-3).
(3) the P2P file that is connected to outer net is downloaded connection and manage, the P2P file transfer that is disconnected to outer net by rule connects (P2P link control module).
P2P file cache and distribution subsystem are made up of buffer memory and control module and customization P2P client, and the function that buffer memory and control module are finished is as follows:
(1) goes initiatively to download and the specific file of buffer memory according to the popularity degree commander customization P2P client of file in download.
(2) the P2P file to buffer memory manages, and optimizes the dynamics (as provide the higher network bandwidth, access speed etc.) faster of buffer memory for the high file of popularity; In time remove scratch file.
Customization P2P client is finished following function:
(1) finish the P2P file download protocol of standard, as BitTorrent, eDonkey.
(2) according to the instruction of buffer memory and control module, initiatively initiate to connect and file transfer requests to other P2P client of appointment.
(3) compare with standard P 2P client, customization P2P client is not established flow control, even it does not ask for blocks of files to other standard client, it can not refuse to provide file content to other client yet.
3, beneficial effect: the present invention can reduce the P2P file and download taking the network core resource; Improve the speed of download of P2P file download user; Improve Internet user's service quality.
Four, description of drawings
Fig. 1: the structure chart of the file download flow localized method of P2P.
Fig. 2: a P2P file is downloaded and is detected and make the situation that subsystem cooperates with a plurality of P2P file caches and distribution subsystem.
Five, embodiment
The specific embodiment of the present invention as shown in Figure 1.Metropolitan area network/province territory Netcom crosses router-1 and links to each other with the router-2 of the Internet backbone.By beam split or mirror image, obtain all IP packets of-2 of router-1 and routers.The P2P file that the IP packet is sent in P2P file download detection and the control subsystem is downloaded detection module, detect the P2P file through this module and download grouping, and download TCP through tabulation, file clients corresponding information list, client that P2P content statistics module analysis obtains the file popularity degree to the P2P file of outer net and connect information such as tabulation.
Buffer memory in P2P file cache and the distribution subsystem and control module are initiatively downloaded and cache file according to the Client group of the tabulation commander customization of file popularity degree.When this locality of the P2P of this locality client-requested buffer memory (or partial buffering) during file, the P2P file is downloaded and is detected and the Client group of control subsystem notice customization initiatively provides corresponding file to P2P user; The P2P link control module that while P2P file is downloaded in detection and the control subsystem is initiatively cut off the file download connection of local P2P user to external network.
Fig. 2 has shown that a P2P file downloads the situation that detection and control subsystem and a plurality of P2P file cache and distribution subsystem cooperate.In this case, the P2P file is downloaded detection and control subsystem is installed in exit, provincial the Internet, and a plurality of P2P file cache and distribution subsystem are installed in the outlet of metropolitan area network.This mode will make the more close terminal use of P2P buffer memory, thereby reduce the P2P file download flow between metropolitan area network.
Claims (2)
1, a kind of file download flow localized method of P2P that makes is characterized in that this method comprises following step:
(1) utilizes the image feature of the optical splitter or the network equipment to derive initial data, monitor all the IP groupings on certain communication link of flowing through;
(2) with P2P file download protocol above-mentioned IP is divided into groups to carry out protocal analysis, obtain the pairing network connection information tabulation of popularity degree tabulation, the pairing current active P2P client side list of file in download, P2P client of file in download;
(3) according to resulting file in download popularity degree tabulation, the file that the current popular degree is high downloads to this locality and carries out buffer memory;
(4) download a this locality during the file of buffer memory or partial buffering when monitoring certain P2P file download user to the P2P network requests, P2P agreement by standard initiatively provides this document content to this user, and the network that cuts off other P2P client of this user and external network is connected.
2, a kind of file download flow localized method of P2P that makes according to claim 1 is characterized in that when file in download is carried out local cache, preferentially fetches data from the P2P client of this locality.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006100965594A CN1937554A (en) | 2006-09-30 | 2006-09-30 | Method for making P2P file download flow localized |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2006100965594A CN1937554A (en) | 2006-09-30 | 2006-09-30 | Method for making P2P file download flow localized |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1937554A true CN1937554A (en) | 2007-03-28 |
Family
ID=37954834
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2006100965594A Pending CN1937554A (en) | 2006-09-30 | 2006-09-30 | Method for making P2P file download flow localized |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1937554A (en) |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101729581A (en) * | 2008-10-28 | 2010-06-09 | 华为技术有限公司 | Method, system and device for realizing re-orientation in P2P network |
| CN101873348A (en) * | 2010-06-09 | 2010-10-27 | 清华大学 | Cloud storage system based on network gateway devices and network access method thereof |
| WO2011147251A1 (en) * | 2010-05-24 | 2011-12-01 | 华为技术有限公司 | Method, device and system for controlling localization traffic exchange in mobile wideband network |
| CN101478559B (en) * | 2008-05-29 | 2012-08-29 | 北京东方网信科技股份有限公司 | Multi-domain supporting P2P flow buffering scheme |
| CN102739712A (en) * | 2011-04-08 | 2012-10-17 | 中国移动通信集团贵州有限公司 | Method and system for network cache data distribution |
| CN103067517A (en) * | 2012-12-31 | 2013-04-24 | 网宿科技股份有限公司 | Peer-to-peer (P2P) cache server system and implementation method combing redirection and active connection |
| CN103747105A (en) * | 2014-01-26 | 2014-04-23 | 深圳市远行科技有限公司 | Cache method and system for network files |
| CN103825916A (en) * | 2012-11-16 | 2014-05-28 | 腾讯科技（深圳）有限公司 | Resource downloading method and resource downloading system |
| CN104137133A (en) * | 2012-02-21 | 2014-11-05 | 维亚塞斯公司 | Audience-measuring method |
| CN104243344A (en) * | 2014-10-11 | 2014-12-24 | 网宿科技股份有限公司 | Effective data packet capturing method and request redirection server |
| CN104822084A (en) * | 2015-04-30 | 2015-08-05 | 华南理工大学 | Concurrent-stream-based rapid channel switching method of P2P real-time playing system |
| CN107231423A (en) * | 2017-06-07 | 2017-10-03 | 北京奇艺世纪科技有限公司 | A kind of document distribution method and system |
| US9998533B2 (en) | 2009-05-31 | 2018-06-12 | International Business Machines Corporation | P2P content caching system and method |
-
2006
- 2006-09-30 CN CNA2006100965594A patent/CN1937554A/en active Pending
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101478559B (en) * | 2008-05-29 | 2012-08-29 | 北京东方网信科技股份有限公司 | Multi-domain supporting P2P flow buffering scheme |
| CN101729581A (en) * | 2008-10-28 | 2010-06-09 | 华为技术有限公司 | Method, system and device for realizing re-orientation in P2P network |
| US9998533B2 (en) | 2009-05-31 | 2018-06-12 | International Business Machines Corporation | P2P content caching system and method |
| WO2011147251A1 (en) * | 2010-05-24 | 2011-12-01 | 华为技术有限公司 | Method, device and system for controlling localization traffic exchange in mobile wideband network |
| CN101873348A (en) * | 2010-06-09 | 2010-10-27 | 清华大学 | Cloud storage system based on network gateway devices and network access method thereof |
| CN102739712A (en) * | 2011-04-08 | 2012-10-17 | 中国移动通信集团贵州有限公司 | Method and system for network cache data distribution |
| CN104137133A (en) * | 2012-02-21 | 2014-11-05 | 维亚塞斯公司 | Audience-measuring method |
| CN104137133B (en) * | 2012-02-21 | 2017-11-10 | 维亚塞斯公司 | The method for measuring spectators |
| CN103825916A (en) * | 2012-11-16 | 2014-05-28 | 腾讯科技（深圳）有限公司 | Resource downloading method and resource downloading system |
| CN103825916B (en) * | 2012-11-16 | 2018-07-10 | 腾讯科技（深圳）有限公司 | A kind of resource downloading method and system |
| CN103067517B (en) * | 2012-12-31 | 2016-03-30 | 网宿科技股份有限公司 | In conjunction with being redirected and the P2P caching server system be initiatively connected and implementation method |
| CN103067517A (en) * | 2012-12-31 | 2013-04-24 | 网宿科技股份有限公司 | Peer-to-peer (P2P) cache server system and implementation method combing redirection and active connection |
| CN103747105A (en) * | 2014-01-26 | 2014-04-23 | 深圳市远行科技有限公司 | Cache method and system for network files |
| CN104243344A (en) * | 2014-10-11 | 2014-12-24 | 网宿科技股份有限公司 | Effective data packet capturing method and request redirection server |
| CN104243344B (en) * | 2014-10-11 | 2018-06-19 | 网宿科技股份有限公司 | A kind of effective data packets catching method and request Redirect Server |
| CN104822084A (en) * | 2015-04-30 | 2015-08-05 | 华南理工大学 | Concurrent-stream-based rapid channel switching method of P2P real-time playing system |
| CN104822084B (en) * | 2015-04-30 | 2018-01-05 | 华南理工大学 | Based on the P2P real-time playing system fast channel switching methods concurrently flowed |
| CN107231423A (en) * | 2017-06-07 | 2017-10-03 | 北京奇艺世纪科技有限公司 | A kind of document distribution method and system |
| CN107231423B (en) * | 2017-06-07 | 2019-12-13 | 北京奇艺世纪科技有限公司 | File distribution method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1937554A (en) | Method for making P2P file download flow localized | |
| KR101453594B1 (en) | Resilient service quality in a managed multimedia delivery network | |
| US8606846B2 (en) | Accelerating peer-to-peer content distribution | |
| CN101641685B (en) | Method for file transfer by a peer-to-peer file transfer model and a client-server transfer model | |
| CN100556129C (en) | A kind of equity connects flow medium live system and device | |
| CN104836821B (en) | A kind of network accelerating method based on router device, device and equipment | |
| US20090100128A1 (en) | Accelerating peer-to-peer content distribution | |
| CN103108008B (en) | A kind of method and file download system for downloading file | |
| CN101039281B (en) | Method for sharing load of stream media server | |
| CN102231762B (en) | Peer-to-peer (p2p) server architecture capable of being unlimitedly and horizontally expanded | |
| Roverso et al. | Smoothcache 2.0: Cdn-quality adaptive http live streaming on peer-to-peer overlays | |
| CN102231761A (en) | Peer-to-Peer (P2P) data interaction method | |
| CN103001964A (en) | Cache acceleration method under local area network environment | |
| Haßlinger et al. | Efficiency of caches for content distribution on the internet | |
| CN110990448B (en) | Distributed query method and device supporting fault tolerance | |
| WO2009076251A2 (en) | Accelerating peer-to-peer content distribution | |
| US20150058420A1 (en) | Method for broadcasting a piece of content in an it network | |
| Li et al. | Challenges, designs, and performances of large-scale open-P2SP content distribution | |
| CN101964741B (en) | Method and equipment for sending node list | |
| CN101179705B (en) | Fellow resource node selecting method and apparatus | |
| CN102340522A (en) | Data transmission method and device | |
| CN103916328B (en) | flow control method and system for content distribution network and peer-to-peer network | |
| Ghareeb et al. | P2PWeb: A Client/Server and P2P hybrid architecture for content delivery over internet | |
| KR100648572B1 (en) | Contents Delivery Network SYSTEM | |
| JP2004343186A (en) | Traffic separation method, traffic separation apparatus, address information collection node, and traffic separation system apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |