WO2011144245A1 - System and method for managing data delivery in a peer-to-peer network - Google Patents
System and method for managing data delivery in a peer-to-peer network Download PDFInfo
- Publication number
- WO2011144245A1 WO2011144245A1 PCT/EP2010/056996 EP2010056996W WO2011144245A1 WO 2011144245 A1 WO2011144245 A1 WO 2011144245A1 EP 2010056996 W EP2010056996 W EP 2010056996W WO 2011144245 A1 WO2011144245 A1 WO 2011144245A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- tracker
- domain
- content data
- network
- content
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1061—Peer-to-peer [P2P] networks using node-based peer discovery mechanisms
- H04L67/1063—Discovery through centralising entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/44—Distributed routing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1059—Inter-group management mechanisms, e.g. splitting, merging or interconnection of groups
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1087—Peer-to-peer [P2P] networks using cross-functional networking aspects
- H04L67/1093—Some peer nodes performing special functions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/52—Network services specially adapted for the location of the user terminal
Definitions
- the present invention relates to managing data delivery in a peer-to-peer (P2P) communications network.
- P2P peer-to-peer
- the invention relates to the management of trackers in a P2P network.
- peer nodes In P2P computer networks, peer nodes (or peers) cooperate to deliver data content to one another.
- the diverse connectivity and the cumulative bandwidth of the peers is used for sharing data content such as, for example, files containing audio, video, data or anything in digital format, telephony traffic, video streaming or video download.
- a P2P network can, in many cases, provide a much more efficient distribution of data content than a hierarchical network topology with a relatively low number of centralised servers providing data content to end nodes.
- clients or servers In a pure P2P network there is no notion of clients or servers, but only of equal peers.
- There are, however, many types of hybrid P2P networks which combine a client-server structure with the P2P structure, since different network structures may be preferred for different types of tasks.
- P2P network is intended to encompass both pure P2P networks and hybrid P2P networks.
- protocols include BitTorrent, Gnutella, CAN, FastTrack, and JXTA.
- the BitTorrent protocol is one of the most widely used P2P protocols and is described in "The BitTorrent Protocol Specification", version 1 1031 , by Cohen, Bram, last edited 28 February 2008, available at http://www.bittorrent.org/beps/bep_0003.html.
- a tracker is a software server application that centrally coordinates the P2P communication among users.
- Tracker software manages torrent swarms to be used by peers - a torrent swarm essentially contains information about clients interested in a content. Specifically, the tracker identifies the IP address of each client either uploading or downloading the content associated with a torrent.
- BitTorrent clients connect to a tracker specified in the torrent file in order to join a swarm.
- the tracker sends to the client (peer) a list of peers that are part of the swarm, and from that point on most of the interaction happens between clients. Clients will send messages of interest, exchange bit maps, and finally requests for given content chunks.
- the list of peers initially obtained from the tracker is of major importance - those are the peers that will be used for downloading content.
- the tracker performs a central role in the BitTorrent model.
- the original BitTorrent architecture uses one or a set of trackers in which BitTorrent clients (peers) connect in order to request a list of potential sources in a swarm.
- peer BitTorrent clients
- the tracker responds with a list of randomly selected peers. By default, the number of peers in the list is 50 peers.
- a BitTorrent client can utilize several trackers that have the same content by joining each swarm managed by them. If there are multiple trackers for the same content, each tracker manages one swarm of that content. Subsequently, the BitTorrent client applies standard BitTorrent policies (optimist unchoking, rarest first, buffer emptiness prioritization) to choose the peers, obtain the content and share the acquired content parts. Even though a list of 50 peers is received from the tracker, the default simultaneous number of peers used to acquire the content is four.
- a well-known problem related to the BitTorrent architecture is the lack of locality awareness. That is, a client who joins a swarm will receive a list of peers that is randomly selected by the tracker. A client may download content from peers that are very distant network wise, even though many peers nearby (network wise) have the same content.
- Some solutions to this problem utilize databases of IP geo location to create locality awareness. These solutions are not very accu rate since these databases contain errors and, most importantly, geographical distance does not imply network distance.
- the tracker does not take into account the usage of the network resources when selecting the peers on behalf of a client. Since the client chooses other peers out of the list obtained from the tracker based on the standard BitTorrent policies (which are intended to incentive the content sharing and keep the content available on the swarm), network resources are often sub-optimally utilized.
- the tracker model for delivery of P2P content is far from ideal for utilization in a managed operator network, since the operator does have a lot of information about network topology and current network load on links.
- P2P techniques for delivery of VoD or time shift content as described, for example, in WO 2009/152865
- the BitTorrent tracker does not know which peers contain specific parts of the content (blocks) in the swarm. It is therefore possible that the peer list returned to a client contains peers that do not have the desired parts of the content. The effort wasted by communicating with unusable peers could affect the quality of the service.
- a tracker module for use in a peer-to-peer communications network.
- the tracker module is configured to manage content data transfers between a discrete set of network elements forming a tracker domain within the network, and comprises a storage medium having a content table stored therein, the content table including a record of content data available to each network element within the tracker domain.
- the tracker module also comprises a communications interface for receiving a content data request from a requesting network element in the tracker domain, and a processing unit for interrogating the content table stored in the storage medium and determining whether the requested content data is available to any of the network elements within the tracker domain.
- the tracker module is configured so that, if the requested content data is available to any of the network elements within the tracker domain, the processing unit determines a list of network elements through which the content data is available, and the communications interface sends said list to the requesting network element.
- the tracker module is further configured so that, if the requested content data is not ava i l a b l e to a ny of th e n etwork e l e m e nts with i n the tracker domain, the communications interface sends a supplementary request for the content data to another tracker module in the network, the other tracker module being higher up in a tracker hierarchy in the network.
- This provides for a distributed hierarchical set of trackers where each tracker is responsible for a portion of the network.
- the content data may be subdivided into blocks, and the content table may include a record of which blocks are available to each network element in the tracker domain.
- the requesting network element may be an end user peer in the tracker domain, and the content table may include a record of the content blocks stored by other peers in the tracker domain.
- the requesting network element may be another tracker module in the tracker domain which is lower in the tracker hierarchy, and the content table may include a record of content data available to other tracker modules in the tracker domain. If this is the case, the record of content data available to each other tracker module in the tracker domain does not need to include a record of the individual peer on which the content data is stored. This enables the aggregation, or condensation, of information up the hierarchy.
- the communications interface may be configured to receive content data updates from network elements within the tracker domain, the content data updates informing the tracker module of changes to the content data available to the respective network elements.
- the processing unit may then be configured to update the content table to reflect the content data updates. This ensures that the record of the data held by peers, or available within the domains of hierarchically lower tracker modules, is up to date.
- the tracker module may further be configured so that, if a supplementary request for the content data is sent to the other tracker module higher up in the tracker hierarchy, the communications interface is configured to receive a content data location response from the other tracker module.
- the content data location response may provide a list of tracker modules in the network through which the requested content data is available.
- the communications interface may be configured to contact the other tracker modules in the network to obtain a list of peers in the network from which the requested content data can be obtained. This list of peers may identify the peers at which specific blocks of the content data can be obtained.
- the hierarchical system of tracker modules can be used to find a domain (and, ultimately, the peers themselves), in which it is present.
- the tracker module may be configured to hold the list of peers in the storage medium for a finite period of time so that it is available to other network elements in the tracker domain within that finite period. If no peer requests the content within the period, the list may expire so that it is no longer maintained in the tracker module.
- the storage medium may have stored therein a record of the network topology of the tracker domain, and the communications interface may be configured to receive a notification of current network conditions within the tracker domain.
- the processing unit may then be configured to take the network topology and/or network conditions into account when determining the list of network elements through which the content data is available so as to optimise use of network resources.
- a system for managing content data transfers in a peer-to-peer communications network comprises a hierarchical arrangement of tracker modules, each tracker module being responsible for managing a tracker domain of network elements.
- Each tracker module has stored therein a content table including a record of content data available to the network elements within its respective tracker domain.
- Each tracker module responsible for a tracker domain containing end user peers is configured so that, if a content data request is received from a requesting peer in its respective tracker domain, and if the requested content is held by enough other peers in that tracker domain to supply the content data, a list of peers having the content data stored thereon is sent to the requesting peer.
- the content data request is transferred to the next tracker module up in the hierarchy.
- the content data request may be passed up the tracker module hierarchy until a tracker module is reached in which the content table includes a record of the requested content data.
- the content data may be separated into blocks.
- the content table of each tracker module having end user peers in its respective tracker domain may identify the blocks stored by each end user peer in that tracker domain, and the content table of each tracker module having hierarchically lower tracker modules in its respective tracker domain may identify the blocks stored within the tracker domain of each hierarchically lower tracker module. This provides a mechanism for aggregation of information so that tracker modules high up the hierarchy do not need to have information about the peers on which each block is stored, merely the hierarchically lower domains in which they can be found.
- Each tracker module may include a record of network topology and current network conditions in its respective tracker domain, and the list of peers may be calculated on the basis of the network topology and current network conditions so as to optimise network resources.
- the record of network topology may include a weighted graph with transmission costs for each link.
- the list of peers may contain the minimum number of peers possible to provide the content data.
- a network element configured to operate as a peer in a tracker domain managed by a tracker module in a peer-to-peer communications network.
- the network element comprises a storage medium for storing content data in the form of content blocks.
- the network element also comprises a communications interface for receiving content blocks from other peers in the network, forwarding content blocks to other peers in the network, and notifying the tracker module of the content blocks stored in the storage medium and available for forwarding to other peers.
- a control unit is provided for controlling the storage medium and communications interface.
- the communications interface may be configured to send a request for content data to the tracker module in the tracker domain.
- the method comprises maintaining a content table at each tracker module, the content table including a record of content data available to the network elements within its respective tracker domain.
- a content data request is sent from a peer in one of the tracker domains to the tracker module responsible for that domain.
- the content table maintained by that tracker module indicates that the content data is held by enough other peers within the domain to supply the data
- a list of peers holding the content data is sent from the tracker module to the requesting peer, and the content is downloaded to the requesting peer from the peers on the list.
- the content table indicates that the content data is not held by enough other peers within the domain
- the content data request is forwarded to tracker modules further up the hierarchy until one is reached whose content table indicates that the content data is available to one or more network elements within its tracker domain.
- Contact is then established between the tracker module at which the original request was received and the tracker module with access to the contact data.
- a list of peers having the content is forwarded to the requesting peer, and the content is downloaded to the requesting peer.
- this list of peers may include a combination of peers in the tracker domain of the requesting network element and peers external to this original tracker domain.
- the information contained in the content tables of tracker modules is aggregated up the hierarchy, so that tracker modules which are contacted directly by peers have a record of content data blocks stored by those peers, and tracker modules which are contacted by hierarchically lower tracker modules have a record of content data blocks stored under those hierarchically lower tracker modules, without having a record of the peers at which those content data blocks are stored.
- Each tracker module may have a record of network topology and network conditions within its tracker domain, and may configure the list of peers to send to the requesting peer taking these into account.
- a content data request from a requesting network element within the tracker domain is received at a tracker module responsible for managing content data transfers between a discrete set of network elements forming a tracker domain within the network.
- a content table stored at the tracker module and including a record of content data available to each network element within the tracker domain is interrogated.
- the tracker module determines whether the requested content data is available to enough network elements within the tracker domain to supply the content data. If the requested content data is available to enough network elements within the tracker domain, a list of network elements through which the content data is available is determined, and sent to the requesting network element. If the requested content data is not available to enough network elements within the tracker domain, a supplementary request for the content data is sent to another tracker module in the network, the other tracker module being higher up in a tracker hierarchy in the network.
- the invention also provides a computer program, comprising computer readable code which, when run by a tracker module, causes the tracker module to operate any of the methods described above or to operate as a tracker module as described above.
- the invention also provides a computer program product comprising a computer readable medium and a computer program as just described, wherein the computer program is stored on the computer readable medium.
- Figure 1 is a schematic illustration of a portion of an exemplary P2P network
- Figure 2 is a schematic illustration of the network of Figure 1 showing tracker domains
- Figure 3 is a weighted graph illustrating the network cost of communication between nodes in one tracker domain
- Figure 4 is a weighted graph illustrating uplink and downlink costs between nodes in the domain of figure 3;
- Figure 5 is a flow chart illustrating the actions taken by a local tracker, and trackers higher up the hierarchy, in response to a content data request from a peer;
- Figure 6 is a schematic illustration of a tracker module
- Figure 7 is a schematic illustration of a network element configured to operate as a peer in a P2P network.
- the general approach described is the static partition of a network into "tracker domains", each having a tracker responsible for it.
- the size of a tracker domain can be dependent on the number of network nodes, number of managed content assets, amongst others.
- the trackers are arranged in a hierarchy. A peer will contact the tracker that is responsible for its respective domain when joining a swarm. If content is not available in this "local" tracker, the request is then forwarded to the next tracker in the hierarchy, until the content is found or deemed to be inexistent in the entire network. Moreover, the peers will notify their own local tracker which video/content chunks they have available.
- the hierarchy scheme provides a powerful and natural locality mechanism - nearby peers will always be preferred.
- Each tracker is designed to return a peer list containing the minimum number of peers necessary to obtain the content according to locality criteria. This characteristic avoids obtaining content from network distant peers.
- Each tracker domain can be configured individually in order to use the locality criteria that best fits the domain necessities.
- the proposed solution is also flexible allowing a good degree of configurability for most different network scenarios and topologies.
- FIG. 1 is a schematic illustration of a portion of an exemplary network 100 in which peers are capable of sharing data using P2P protocols such as BitTorrent.
- the network includes nodes in a Wide Area Network (WAN) 101 , Metropolitan Area Network (MAN) 102 and Edge Network 103.
- WAN Wide Area Network
- MAN Metropolitan Area Network
- Edge Network 103 To simplify the Figure only a small number of peers are depicted. A real deployment will encompass many more peers.
- Six peer nodes (Peerl to Peer6) 1 1 1 1 -1 16 in the edge network are connected, via edge network routers 121 -123 and MAN routers 124, 125, to WAN routers 127, 128.
- Two peer nodes (Peer7, Peer8) 1 17, 1 18 in the MAN are also connected to WAN routers 127, 128.
- the Peer7 1 17 and Peer8 1 18 nodes can be operator managed cache servers strategically positioned in the network to provide content chunks to end-users. Peer7
- a root tracker 131 is responsible for managing data transmission between the peer nodes (Peerl to Peer8) 1 1 1 -1 1 6.
- the root tracker does not manage the task in isolation: the network is portioned into three domains (or "scopes") 141 , 142, 143.
- a local tracker 151 , 152, 153 is responsible for each of these domains 141 , 142, 143.
- the trackers 131 , 151 , 152, 153 are organised in a hierarchy, and information is aggregated as one traverses the tree of trackers, as will be described in more detail below.
- Each tracker 151 , 152, 153 is responsible for a partition of the whole network 100.
- domain in this context is not necessarily a geographical region: it represents a collection of nodes relatively close to each other in a network sense. For example, as shown in Figure 1 , one of the domains 142 extends from the MAN 102 into the edge network 103.
- a peer When a peer (e.g. Peer5 15) wishes to obtain data, it contacts the tracker 152 responsible for its domain 142, to obtain a list of peers of a swarm. Similarly, each peer (e.g. Peer5 15) notifies its local tracker 152 of the data content it has available (e.g. video chunks).
- a tracker 152 When a tracker 152 does not have information to respond to a given client request (for example, if the other peers 1 13, 1 14, 1 16, 1 17 in the domain 152 do not have the necessary data) it will contact the next tracker up in the hierarchy. If that tracker has the information it will reply immediately with a tracker list of other trackers 151 , 153 which have the requested content available under their scope (in their domains). Otherwise it will send another request upwards in the hierarchy and that process will be repeated, until the request is answered or the root tracker 131 is reached.
- Each tracker 151 , 152, 153 is also enhanced with network topology and network load information. This allows the tracker to perform enforcement of advanced network traffic policies.
- the list of peers a tracker sends to a requesting peer will not be random, but instead the result of an informed calculation.
- FIG. 1 is a simple example, in which the hierarchical tracker architecture is divided in two hierarchical levels, but that multiple levels of hierarchy may also be used.
- the "two level" model is used as an example for the following discussion, but it should be understood that the same principles will apply however many levels are used, and that a hierarchical tree of trackers may be built up.
- the lower level is formed by trackers 151 -153, network elements (routers) 121 -125 and peers 1 1 1 1 -1 18.
- One tracker 151 and one or more peers 1 1 1 1 , 1 12 are grouped taking into account a criterion such as their network or geographical area. This group of nodes defines a tracker domain or scope 141 , and an operator can have many tracker domains.
- Each tracker 151 controls swarms composed by peers 1 1 1 , 1 12 in its domain, and also knows the network topology that is covered by its domain.
- the peers 1 1 1 1 , 1 12 report to their local tracker 151 what content (and which parts) they have available so that the tracker can know about all the content available in its domain.
- the higher level is formed by the root tracker 131 , which concentrates the information about all the content available on all of the operators' trackers and knows all trackers in the operator domain.
- Figure 2 illustrates the relationship between the high level root tracker 131 and lower level "local" trackers 151-153.
- a root tracker domain 144 is formed by all the operators' trackers 131 , 151 , 152, 153 and network elements 121 - 124, 126-128.
- Each tracker 151 -153 reports to the root tracker 131 which content (and which parts of that content) are available in their domain in order to make it possible to identify all available content (delivered by P2P) under the operator domain.
- the root tracker only deals with the other trackers 151 -153, and does not receive requests directly from the peers 1 1 1 1 -1 18.
- each tracker 151 -153 contains more information than simply the peers having the requested content.
- Each tracker also contains details of the network topology and conditions of its respective domain. The network topology is known by the operator, and the topology of the relevant portion of each network may therefore be passed to each tracker by the network operator. Current conditions may be determined by each tracker 151 -1 53 for their domain, for example using Simple Network Management Protocol (SNMP) probes.
- SNMP Simple Network Management Protocol
- each tracker 131 , 151 , 152, 153 (including the root tracker 131 ) operates one weighted graph with the network topology of its domain, in which: - Edges are the network links;
- - Nodes are peers and network elements
- Weights of the edges are computed by previously defined criteria.
- the weight of the edges may, be calculated depending on the current load conditions in the link plus operator policies.
- the distance between two peers indicates the cost for that connection. Therefore, if a requesting peer can download the desired content from several other peers, the one with the lowest cost represents the best option for acquiring the content. Consequently, the criteria adopted to compute the edge weight and the algorithm for determining the shortest path will define the quality of the peer selection, impacting on the usage of the network resources.
- FIG. 3 illustrates a simple weighted graph for tracker2 152 shown in Figure 1 .
- the nodes peer 1 13-1 17 and routers 122, 123) are labelled in the same way as in Figure 1.
- Each link between network nodes is assigned a weight (or cost) illustrated by a number in Figure 3.
- the link between Peer5 1 15 and its associated router 123 has a cost of 5.
- the link costs should be calculated using up to date information available to the tracker.
- Information that can be used by the tracker includes, but it is not limited to: total and used link bandwidth, latency, type of link (copper, fibre), business rules, amongst others.
- Network links can be asymmetric, as a result of different bandwidth rates for upstream and downstream data transfer.
- directed graphs may be used to allow the configuration of asymmetric links. This characteristic results on two weights to each graph edge. An example of such a graph is shown in Figure 4.
- Peer7 1 17 could be provided to act as a "cache" peer rather than a "client” peer.
- Peer7 may not be used by a user to view content, but may be maintained by the operator simply to store content. If any of the other peers 1 13-1 16 in the same domain 142 as Peer7 1 17 request content, blocks of that content may be copied automatically to Peer7 1 17.
- Figure 5 illustrates how a tracker (e.g. Trackerl 151 ) deals with client requests and how locality is achieved in the network. Since each tracker is responsible for peers (or hierarchically lower trackers) in a very well defined domain, the hierarchy will provide inherent locality. If there are available peers in the local tracker domain those will always be preferred.
- the tracker 151 when a peer (e.g. Peerl 1 1 1 ) makes a request to its local tracker (Trackerl 151 ) for content 501 , the tracker 151 first determines 502 whether or not that content that is unavailable in its domain 141 . If the content is available within that domain 141 (e.g. at Peer2 1 12), the tracker checks 503 that the required number of peers with the necessary blocks are available in the domain 141. If so, then the peer list with the required blocks is returned 504 to the peer 1 1 1.
- the tracker 151 contacts 505 the root tracker 131 (or tracker next up in the hierarchy if there are more than two levels) in order to obtain a list of other trackers that have the requested content in their domains.
- the root tracker 131 verifies 506 its table to identify the trackers that have the requested content in their domains. If there are no other domains in which the requested content is present, a message is returned 507 to the original tracker 151 indicating this. If more than one tracker has the content in its domain, the root tracker 131 uses its graph to select the most appropriate tracker(s). If these trackers have peers with the necessary blocks 508, then a list of these trackers is returned 509 to the original tracker 151 which has the requesting peer 1 1 1 in its domain. The original tracker 151 communicates 510 with these other trackers, (which have the content in their domains) in order to obtain a list of peers to add temporarily to its swarm/scope.
- This peer list is then sent 51 1 to the requesting peer 1 1 1.
- the external peers are removed from the swarm/scope by the original tracker 151 .
- the temporary list of peers may be maintained by the original tracker 151 for a predetermined period of time (e.g. a few minutes) as a list of sources for the requested content. These entries need to be marked in some way in the content table so show that they are external. If another peer node (e.g. Peer2 1 12) in the original tracker domain 141 requests the same content, the original trackerl 151 will already know where this content can be found. If no peer requests that content in the predetermined time period then the entry expires.
- trackers which have the content in their domain do not, collectively, have the required number of peers with the desired blocks, then a list of those peers 512 which do have some of the content is returned to the original tracker 151 and thence to the requesting peer 1 1 1 .
- the process described above requires each tracker to know what content is present in its domain, and also requires trackers higher up the hierarchy to be able to identify what content is present in all the domains lower down the hierarchy.
- the tracker graphs (of the type shown in Figures 3 and 4) are used to compute the best route between the origin (requesting the content) and destination (having the content) peer.
- Content can be divided into blocks, or chunks, and it will be appreciated that among all the peers available, only a subset have each requested content chunk. Thus, it is necessary to identify those in order to provide adequate information to apply the shortest path algorithm to the required peer.
- the original tracker 151 verifies if the content is available by performing the following steps (shown in Figure 5):
- the tracker 151 uses a local content table to identify if there are peers with the requested content. The tracker 151 will only return 503 a list of peers if there are enough peers in the Trackerl domain 141 that, when grouped, can satisfy the client request;
- the tracker module tries 506 to locate the content inside other tracker domains by communicating with the root tracker.
- Both steps require the tracker 151 or root tracker 131 to verify the content availability in their domain.
- the tracker 151 does the verification by consulting a Content ID + content blocks on a content table maintained by it.
- the tracker content table is maintained by the tracker and updated according to the information provided by peers in its domain. It will be appreciated that this requires a modification of the BitTorrent protocol.
- the fields defined in the tracker content table are:
- ⁇ Content ID obtained by the client (peer) from the EPG (Electronic Programming Guide) or other configuration means;
- Client ID the universal identification of the client (peer).
- Content blocks a bit field containing all available blocks in the peer.
- the inclusion of an entry on the table happens when a peer joins a swarm on the tracker. Thereafter, the registry information is updated based on the information provided by the client using messages of keep alive or update chunk list. A registry line is deleted due to the active disconnection of the client from the swarm or a connection time-out.
- a similar exemplary content table for Tracker2 152 may be as follows:
- Peer6 0001 1 1 1000 A similar exemplary content table for Tracker3 153 may be as follows:
- the Content ID field indexes these tables, and the content blocks indicate which blocks are possessed by each peer.
- a root tracker content table is maintained by the root tracker 131 and updated according to the information provided by the lower level trackers available in its domain.
- the root tracker content table includes the following fields:
- Tracker ID a unique tracker identification in the operator domain
- Content blocks a bit field containing all available blocks in the lower level tracker domain.
- each tracker When a tracker starts to manage a new content, a new entry must be inserted on the root tracker content table. Furthermore, the update of an entry on the tracker content table must produce an update on the root tracker content table. As soon as a peer finishes downloading a new block, the tracker updates its table entry corresponding to that content. If the downloaded block is new in that domain, the tracker triggers the update of the root tracker table.
- a root tracker registry will only be deleted when the content is no longer available in any of the trackers within the root tracker domain. In order to implement this, each tracker sends a compilation of the content available in its domain to the root tracker according to insertion, modification or deletion of registries.
- the root tracker 131 content table is populated from the content tables of Trackerl 151 , Tracker2 152 and Tracker3 153, and is as follows:
- the root tracker thus concentrates information about the content available in all trackers in the operator domain.
- the Content ID also indexes this information on the root tracker. Data aggregation is achieved since trackers up in the hierarchy only know that a given content chunk/block is available in a given domain. Trackers further up in the hierarchy do not know which peers actually possess that block.
- tracker and root tracker content tables allows the identification of the content distribution in the entire operator domain, and also the location of all peers and trackers. Therefore, when a peer requests a content block, the tracker can find all peers that seed the desired content, whether they are in its domain or in other trackers' domains. However, it does not define which of them will be on the peer list returned to the requesting peer. This definition will be made based on the lowest cost results provided by the selected algorithm applied to the defined graphs shown in Figures 3 and 4. One example of such an algorithm is the shortest path algorithm.
- FIG. 6 is a schematic illustration of a tracker module 601.
- the tracker module 601 could be a root tracker 131 , or tracker 151 , 152, 153 further down the hierarchy as shown in Figures 1 and 2.
- the tracker module 601 includes a storage medium 602 for storing a content table thereon.
- a communications interface 603 is configured to communicate with other network elements, and in particular to receive and respond to content data requests from peers in the domain controlled by the tracker module, and to send content data requests further up the tracker hierarchy if required.
- a processing unit 604 is configured to identify whether or not the requested data is available in peers in the tracker's own domain, and to manage the data transfer within the domain. It will be appreciated that the functions of the tracker module 601 may be carried out as a result of the use of software or hardware or a combination of the two.
- FIG 7 is a schematic illustration of a network element 701 configured to operate as a peer (or client).
- the network element could be any of the peers 1 1 1 -1 18 shown in Figures 1 and 2.
- the network element 701 includes a storage medium 702 for storing content data in the form of content blocks.
- a communications interface 703 communicates with other network elements, and in particular receives content blocks from other peers in the network, and sends content blocks to other peers. In addition, the communications interface notifies the tracker module of the tracker domain in which the network element is located of which content blocks are contained in the storage medium and which are therefore available for forwarding to other peers.
- the peer wishes to receive content data, a request for that content is sent from the communications interface 703 to the local tracker module.
- a control unit 704 controls the operation of the storage medium 702 and communications interface 703. It will be appreciated that the functions of the network element 701 may be carried out as a result of the use of software or hardware or a combination of the two.
- the tracker model described above allows operators to utilize P2P technology in a cost efficient way without compromising on service quality.
- the operator that utilizes the proposed model will be able to optimize network resources usage in order to reduce the costs of content distribution by utilizing better selection criteria of the network areas in which the peers will obtain the content.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Computer And Data Communications (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/698,977 US9635107B2 (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
EP10721153.4A EP2572495B1 (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
PCT/EP2010/056996 WO2011144245A1 (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
BRPI1014815A BRPI1014815A2 (en) | 2010-05-20 | 2010-05-20 | crawler module for use in a non-hierarchical communications network, system and method for managing content data transfers in a non-hierarchical communications network, network element, method for managing data in a non-hierarchical communications network, computer program, and, computer program product. |
CN201080066873.2A CN102907065B (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2010/056996 WO2011144245A1 (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011144245A1 true WO2011144245A1 (en) | 2011-11-24 |
Family
ID=43478029
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2010/056996 WO2011144245A1 (en) | 2010-05-20 | 2010-05-20 | System and method for managing data delivery in a peer-to-peer network |
Country Status (5)
Country | Link |
---|---|
US (1) | US9635107B2 (en) |
EP (1) | EP2572495B1 (en) |
CN (1) | CN102907065B (en) |
BR (1) | BRPI1014815A2 (en) |
WO (1) | WO2011144245A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10911337B1 (en) * | 2018-10-10 | 2021-02-02 | Benjamin Thaddeus De Kosnik | Network activity monitoring service |
US10951510B2 (en) | 2018-06-05 | 2021-03-16 | Fujitsu Limited | Communication device and communication method |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
FR2962620B1 (en) * | 2010-07-08 | 2013-05-10 | Alcatel Lucent | ACCESS TO A NETWORK OF KNOTS DISTRIBUTED OVER A COMMUNICATION ARCHITECTURE USING A TOPOLOGY SERVER WITH MULTICRITERIAL SELECTION |
US20190188122A1 (en) * | 2017-12-20 | 2019-06-20 | Rainforest Qa, Inc. | Electronic product testing systems |
JP5776339B2 (en) * | 2011-06-03 | 2015-09-09 | 富士通株式会社 | File distribution method, file distribution system, master server, and file distribution program |
EP3022887B1 (en) * | 2013-07-17 | 2016-11-09 | Hive Streaming AB | Distributing data content in private networks |
CN104349399B (en) * | 2013-07-24 | 2018-02-23 | 中国移动通信集团公司 | A kind of method and wlan system that up-downgoing covering matching is realized in wlan system |
US10080058B2 (en) * | 2014-04-11 | 2018-09-18 | Panasonic Intellectual Property Management Co., Ltd. | Communication system, information processing device, and communication method |
EP3131305B1 (en) * | 2014-04-11 | 2019-07-03 | Panasonic Intellectual Property Management Co., Ltd. | Communication system, information processing device, and communication method |
JP6432598B2 (en) * | 2014-04-30 | 2018-12-05 | ソニー株式会社 | Client device, server, recording medium, and information processing method |
US20160094653A1 (en) * | 2014-09-30 | 2016-03-31 | International Business Machines Corporation | Optimizing resource downloads or streams using a collection of trusted network connected endpoints |
CN105991720B (en) * | 2015-02-13 | 2019-06-18 | 阿里巴巴集团控股有限公司 | Configuration change method, equipment and system |
IL282920B2 (en) | 2018-11-08 | 2024-07-01 | Iagon As | Intelligent, decentralized and autonomous marketplace for distributed computing and storage |
US11386233B2 (en) | 2019-04-30 | 2022-07-12 | JFrog, Ltd. | Data bundle generation and deployment |
US11886390B2 (en) | 2019-04-30 | 2024-01-30 | JFrog Ltd. | Data file partition and replication |
US11340894B2 (en) | 2019-04-30 | 2022-05-24 | JFrog, Ltd. | Data file partition and replication |
US10972289B2 (en) | 2019-07-19 | 2021-04-06 | JFrog, Ltd. | Software release verification |
US10999314B2 (en) | 2019-07-19 | 2021-05-04 | JFrog Ltd. | Software release tracking and logging |
US10771524B1 (en) * | 2019-07-31 | 2020-09-08 | Theta Labs, Inc. | Methods and systems for a decentralized data streaming and delivery network |
WO2021072417A1 (en) * | 2019-10-11 | 2021-04-15 | Theta Labs, Inc. | Methods and systems for decentralized data streaming and delivery network |
US11695829B2 (en) * | 2020-01-09 | 2023-07-04 | JFrog Ltd. | Peer-to-peer (P2P) downloading |
US11860680B2 (en) | 2020-11-24 | 2024-01-02 | JFrog Ltd. | Software pipeline and release validation |
US20220182444A1 (en) * | 2020-12-04 | 2022-06-09 | Kollective Technology, Inc. | Peer-managed content distribution network |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1630684A1 (en) * | 2004-08-31 | 2006-03-01 | Onkyo Corporation | Data distribution system based on a Peer-to-Peer architecture |
US20090083390A1 (en) * | 2007-09-24 | 2009-03-26 | The Research Foundation Of State University Of New York | Automatic clustering for self-organizing grids |
EP2106086A1 (en) * | 2008-03-14 | 2009-09-30 | Thomson Licensing | Method for managing requests for obtaining peer identifiers to access stored contents in p2p mode, and associated management device and network equipment |
WO2009152865A2 (en) | 2008-06-20 | 2009-12-23 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for ingesting media content in a peer-to-peer network |
Family Cites Families (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7594030B2 (en) * | 2000-11-22 | 2009-09-22 | Microsoft Corporation | Locator and tracking service for peer to peer resources |
US20040254977A1 (en) * | 2003-06-13 | 2004-12-16 | Microsoft Corporation | Extensible peer-to-peer graphing messages |
US7379967B2 (en) * | 2005-01-28 | 2008-05-27 | Grid Solutions, Inc. | Download method for file by bit torrent protocol |
EP1801720A1 (en) * | 2005-12-22 | 2007-06-27 | Microsoft Corporation | Authorisation and authentication |
US7970835B2 (en) * | 2006-04-04 | 2011-06-28 | Xerox Corporation | Peer-to-peer file sharing system and method using downloadable data segments |
CN101090360A (en) * | 2006-06-12 | 2007-12-19 | 朗迅科技公司 | Charged reciprocal file loading system |
CN101110759A (en) * | 2006-07-20 | 2008-01-23 | 朗迅科技公司 | Peer-to-peer file download system for IPTV network |
GB2440759A (en) * | 2006-08-11 | 2008-02-13 | Cachelogic Ltd | Selecting a download cache for digital data |
GB2440774B (en) * | 2006-08-11 | 2011-07-27 | Cachelogic Ltd | Content Delivery System For Digital Object |
WO2008024037A1 (en) * | 2006-08-21 | 2008-02-28 | Telefonaktiebolaget Lm Ericsson (Publ) | A distributed server network for providing triple and play services to end users |
US8775562B2 (en) * | 2006-12-05 | 2014-07-08 | International Business Machines Corporation | Mapping file fragments to file information and tagging in a segmented file sharing system |
CN101207531A (en) | 2006-12-21 | 2008-06-25 | 浙江工业大学 | Method and system for establishing P2P covering network capable of spanning multilevel subnetwork |
US8028019B2 (en) * | 2007-02-28 | 2011-09-27 | Solid State Networks, Inc. | Methods and apparatus for data transfer in networks using distributed file location indices |
CN101257396B (en) | 2007-03-02 | 2010-12-08 | 中国科学院声学研究所 | System for distributing multi-field content based on P2P technique as well as corresponding method |
US20080285577A1 (en) * | 2007-05-15 | 2008-11-20 | Yehuda Zisapel | Systems and Methods for Providing Network-Wide, Traffic-Aware Dynamic Acceleration and Admission Control for Peer-to-Peer Based Services |
KR101404008B1 (en) * | 2007-08-30 | 2014-06-05 | 톰슨 라이센싱 | A unified peer-to-peer and cache system for content services in wireless mesh networks |
US8606846B2 (en) * | 2007-10-15 | 2013-12-10 | Nbcuniversal Media, Llc | Accelerating peer-to-peer content distribution |
US20090100128A1 (en) * | 2007-10-15 | 2009-04-16 | General Electric Company | Accelerating peer-to-peer content distribution |
EP2086206A1 (en) * | 2008-01-31 | 2009-08-05 | Alcatel Lucent | System for operating a peer-to-peer network taking into account access network subscriber information |
US8082290B2 (en) * | 2008-03-19 | 2011-12-20 | Verizon Patent And Licensing Inc. | Intelligent establishment of peer-to-peer communication |
CN101262487B (en) * | 2008-04-25 | 2011-06-08 | 北京中企开源信息技术有限公司 | Data transmission processing method and device for point-to-point client |
WO2009134905A2 (en) * | 2008-04-30 | 2009-11-05 | Motion Picture Laboratories, Inc. | Cooperative monitoring of peer-to-peer network activity |
US9106668B2 (en) * | 2008-06-24 | 2015-08-11 | Azureus Software, Inc. | Distributed peer location in peer-to-peer file transfers |
CN101729273A (en) * | 2008-10-27 | 2010-06-09 | 中国移动通信集团公司 | Streaming media distribution system, method and device |
US8631072B2 (en) * | 2008-12-03 | 2014-01-14 | Telefonaktiebolaget L M Ericsson (Publ) | Method for selection of suitable peers in a peer-to-peer (P2P) network |
WO2010090562A1 (en) * | 2009-02-06 | 2010-08-12 | Telefonaktiebolaget L M Ericsson (Publ) | Network aware peer to peer |
WO2010097647A1 (en) * | 2009-02-24 | 2010-09-02 | Telefonaktiebolaget L M Ericsson (Publ) | Personalized data distribution based on peer-to-peer content delivery |
ES2430345T3 (en) | 2009-03-03 | 2013-11-20 | Telefonaktiebolaget L M Ericsson (Publ) | Methods and prioritization arrangements in a peer-to-peer network |
US20100293294A1 (en) * | 2009-05-15 | 2010-11-18 | Alcatel-Lucent Usa Inc. | Peer-to-peer communication optimization |
US9165004B2 (en) * | 2009-07-10 | 2015-10-20 | Azureus Software, Inc. | Associated content system |
WO2011009489A1 (en) * | 2009-07-23 | 2011-01-27 | Telefonica, S.A. | Tracker in p2 p systems with dvd functionalities |
US20110060721A1 (en) * | 2009-08-10 | 2011-03-10 | Vuze, Inc. | Offline downloader |
CN101997901B (en) * | 2009-08-28 | 2014-04-30 | 国际商业机器公司 | P2P file transfer management method and system |
US8325733B2 (en) * | 2009-09-09 | 2012-12-04 | Exafer Ltd | Method and system for layer 2 manipulator and forwarder |
US20110078312A1 (en) * | 2009-09-30 | 2011-03-31 | Alcatel-Lucent | Method and system for monitoring incoming connection requests in a Peer-to-Peer network |
US20110087915A1 (en) * | 2009-10-09 | 2011-04-14 | Meng Zhang | Hybrid reliable streaming protocol for peer-to-peer multicasting |
US20110099372A1 (en) * | 2009-10-23 | 2011-04-28 | Siddhartha Annapureddy | Method and system for providing peer-to-peer video on demand |
WO2011050966A1 (en) * | 2009-10-30 | 2011-05-05 | Nec Europe Ltd. | Method and system for supporting the selection of communication peers in an overlay network |
US20110138437A1 (en) * | 2009-12-07 | 2011-06-09 | Shivakumar Mahadevappa | Method and system for providing both live viewing and video on demand |
AU2011220490A1 (en) * | 2010-02-26 | 2012-09-13 | Interdigital Patent Holdings, Inc | Mobility in peer-to-peer communications |
US20110225312A1 (en) * | 2010-03-10 | 2011-09-15 | Thomson Licensing | Unified cache and peer-to-peer method and apparatus for streaming media in wireless mesh networks |
US8447875B2 (en) * | 2010-03-10 | 2013-05-21 | Thomson Licensing | Unified cache and peer-to-peer method and apparatus for streaming media in wireless mesh networks |
US20110258016A1 (en) * | 2010-04-14 | 2011-10-20 | Optify, Inc. | Systems and methods for generating lead intelligence |
WO2011133167A1 (en) * | 2010-04-20 | 2011-10-27 | Zte Corporation | Method and system for hierarchical tracking of content and cache for networking and distribution to wired and mobile devices |
US8688775B2 (en) * | 2010-05-28 | 2014-04-01 | Juniper Network, Inc. | Application-layer traffic optimization service spanning multiple networks |
-
2010
- 2010-05-20 EP EP10721153.4A patent/EP2572495B1/en not_active Not-in-force
- 2010-05-20 BR BRPI1014815A patent/BRPI1014815A2/en not_active IP Right Cessation
- 2010-05-20 US US13/698,977 patent/US9635107B2/en active Active
- 2010-05-20 WO PCT/EP2010/056996 patent/WO2011144245A1/en active Application Filing
- 2010-05-20 CN CN201080066873.2A patent/CN102907065B/en not_active Expired - Fee Related
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1630684A1 (en) * | 2004-08-31 | 2006-03-01 | Onkyo Corporation | Data distribution system based on a Peer-to-Peer architecture |
US20090083390A1 (en) * | 2007-09-24 | 2009-03-26 | The Research Foundation Of State University Of New York | Automatic clustering for self-organizing grids |
EP2106086A1 (en) * | 2008-03-14 | 2009-09-30 | Thomson Licensing | Method for managing requests for obtaining peer identifiers to access stored contents in p2p mode, and associated management device and network equipment |
WO2009152865A2 (en) | 2008-06-20 | 2009-12-23 | Telefonaktiebolaget Lm Ericsson (Publ) | System and method for ingesting media content in a peer-to-peer network |
Non-Patent Citations (1)
Title |
---|
TING WANG ET AL: "Traffic Shaping in BitTorrent Systems by Centralized Hierarchical Peer-Node Assignment", COMMUNICATIONS, 2008. ICC '08. IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 19 May 2008 (2008-05-19), pages 1787 - 1791, XP031265664, ISBN: 978-1-4244-2075-9 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10951510B2 (en) | 2018-06-05 | 2021-03-16 | Fujitsu Limited | Communication device and communication method |
US10911337B1 (en) * | 2018-10-10 | 2021-02-02 | Benjamin Thaddeus De Kosnik | Network activity monitoring service |
Also Published As
Publication number | Publication date |
---|---|
BRPI1014815A2 (en) | 2017-01-31 |
EP2572495A1 (en) | 2013-03-27 |
CN102907065B (en) | 2017-04-26 |
US9635107B2 (en) | 2017-04-25 |
EP2572495B1 (en) | 2016-07-06 |
US20130073727A1 (en) | 2013-03-21 |
CN102907065A (en) | 2013-01-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9635107B2 (en) | System and method for managing data delivery in a peer-to-peer network | |
USRE49943E1 (en) | System and method for a context layer switch | |
US8606846B2 (en) | Accelerating peer-to-peer content distribution | |
US9300729B1 (en) | Distributing information over a network | |
JP5745169B2 (en) | Content processing method, content processing device, and content processing system | |
US20090100128A1 (en) | Accelerating peer-to-peer content distribution | |
US20110078230A1 (en) | Method and system for providing a cdn with granular quality of service | |
US20110047272A1 (en) | Dissemination of Network Management Tasks in a Distributed Communication Network | |
KR101485610B1 (en) | Distributed content delivery system based on network awareness and method thereof | |
JP2010522386A (en) | Method, system, and node for P2P content sharing | |
CN101938508A (en) | Method and system for shortening time delay in peer-to-peer network streaming media live broadcast system | |
Tuncer et al. | Scalable cache management for ISP-operated content delivery services | |
JP2010157016A (en) | P2p distribution system and distribution method | |
WO2009076251A2 (en) | Accelerating peer-to-peer content distribution | |
Fiorese et al. | OMAN–a management architecture for P2P service overlay networks | |
Ma et al. | A cloud‐assisted publish/subscribe service for time‐critical dissemination of bulk content | |
Singh et al. | Resource-Cardinality Based Scheme to Reduce Resource Lookup Cost in Structured P2P Networks | |
Moon et al. | A point-based inventive system to prevent free-riding on p2p network environments | |
Hisada et al. | P2P live streaming system suitable for private contents distribution | |
Ardaiz et al. | Multicast injection for application network deployment | |
Deltouzos et al. | SeekStream: adapting to dynamic user behavior in P2P video‐on‐demand | |
Al Ridhawi | Dynamic composition of service specific overlay networks | |
Huang et al. | Agiler: A P2P live streaming system with low playback lag | |
Hammami et al. | HLPSP: A hybrid live P2P streaming protocol | |
Lai et al. | A construction of peer-to-peer streaming system based on flexible locality-aware overlay networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080066873.2 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10721153 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
REEP | Request for entry into the european phase |
Ref document number: 2010721153 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010721153 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13698977 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: PI1014815 Country of ref document: BR |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01E Ref document number: PI1014815 Country of ref document: BR Free format text: REGULARIZE A PETICAO 020110138086 RETIFICANDO O NOME DO DEPOSITANTE PARA TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), ENVIE PROCURACAO EM NOME DO MESMO E POSTERIORMENTE SOLICITE A ALTERACAO DO TITULAR ATRAVES DE GRU ESPECIFICA. |
|
ENP | Entry into the national phase |
Ref document number: PI1014815 Country of ref document: BR Kind code of ref document: A2 Effective date: 20111229 |