EP2171600B1 - Transmission multimédia en continu poste-à-poste assistée - Google Patents

Transmission multimédia en continu poste-à-poste assistée Download PDF

Info

Publication number
EP2171600B1
EP2171600B1 EP08794531.7A EP08794531A EP2171600B1 EP 2171600 B1 EP2171600 B1 EP 2171600B1 EP 08794531 A EP08794531 A EP 08794531A EP 2171600 B1 EP2171600 B1 EP 2171600B1
Authority
EP
European Patent Office
Prior art keywords
peer
connection
network
data source
disruption
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP08794531.7A
Other languages
German (de)
English (en)
Other versions
EP2171600A4 (fr
EP2171600A2 (fr
Inventor
Eric Setton
John Apostolopoulos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Development Co LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co LP filed Critical Hewlett Packard Development Co LP
Publication of EP2171600A2 publication Critical patent/EP2171600A2/fr
Publication of EP2171600A4 publication Critical patent/EP2171600A4/fr
Application granted granted Critical
Publication of EP2171600B1 publication Critical patent/EP2171600B1/fr
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
    • H04L67/1078—Resource delivery mechanisms
    • H04L67/1085—Resource delivery mechanisms involving dynamic management of active down- or uploading connections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/40—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1044—Group management mechanisms 
    • H04L67/1048—Departure or maintenance mechanisms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1087—Peer-to-peer [P2P] networks using cross-functional networking aspects
    • H04L67/1091—Interfacing with client-server systems or between P2P systems

Definitions

  • Various embodiments of the present invention relate to the field of streaming media.
  • Peer-to-peer (P2P) networks are computer networks that rely on the distributed bandwidth of participant clients, referred to as "peers,” for transmitting data.
  • P2P networks are used for sharing data and for streaming media data. Media streaming to a large audience may be achieved by using a P2P network, where peers act both as receivers and as relays for the stream.
  • P2P networks provide the benefit of distributing the throughput over a large number of peer devices.
  • P2P networks typically include little infrastructure, and thus are subject to disruptions in streaming media. For example, the system could run out of bandwidth or peer devices may randomly disconnect from the P2P network.
  • LEI ZHANG ET AL "A peer-to-peer architecture for on-demand video streaming on Internet” COMMUNICATIONS, CIRCUITS AND SYSTEMS, 2004. ICCCAS 2004. 2004 INTERNAT IONAL CONFERENCE ON CHENGDU, CHINA 27-29 JUNE 2004, PIS-CATAWAY, NJ, USA,IEEE, US, 27 June 2004 (2004-06-27), pages 525-528VOL.1, XP010731694 ISBN: 978-0-7803-8647-1 describes a peer-to-peer architecture for on-demand video streaming on the internet comprising a P2P forwarding chain, wherein for maintaining a continuous playback at the peer a standby FEC server is maintained to provide a FEC coded media stream to peers when their buffer content is almost exhausted.
  • YUFENG SHAN ET AL "Hybrid video downloading/streaming over peer-to-peer networks" PROCEEDINGS OF THE 2003 INTERNATIONAL CONFERENCE ON MULTI-MEDIA AND EXPO: 6 - 9 JULY 2003, BALTIMORE MARRIOTT WATERFRONT HOTEL, BALTIMORE, MARYLAND, USA, IEEE OPERATIONS CENTER, US, vol. 2, 6 July 2003 (2003-07-06), pages 665-668, XP010650559 ISBN: 978-0-7803-7965-7 describes a peer-to-peer network used for assisting in video streaming and applying a hybrid video downloading/streaming scheme that integrates traditional client/server based video streaming and peer-to-peer based media distribution.
  • a receiver starts to receive streaming traffic from a video server and also a supplying peer. Once the streaming session catches up to the video content the server "suspends" the streaming mode.
  • assisted peer-to-peer (P2P) media streaming are described herein.
  • a method for assisted P2P media streaming is described.
  • a first connection to at least one peer of a P2P network is initiated for receiving media content from the P2P network.
  • Responsive to a disruption of delivery of the media content over the first connection from the peer the media content is received over a second connection with a data source, wherein the data source comprises the media content.
  • Embodiments of the present invention enable a P2P streaming system to achieve similar performance as a content delivery network (CDN) while reducing the bandwidth cost.
  • a limited number of data sources e.g., servers
  • embodiments of the present invention are useful for P2P streaming systems where a media stream is relayed to a large audience via a network of connected peers acting as receivers as well as potential forwarders of the stream. In such a system, access to servers can significantly improve performance.
  • servers can be instrumental in achieving fast connection times (e.g., on the order of a second), whereas startup times on the order of a minute are usually observed in state-of-the-art P2P streaming systems.
  • servers may act as reliable retransmission agents.
  • Various embodiments of the present invention provide assisted P2P media streaming.
  • the media content over a connection to a data source.
  • the disruption is a startup delay in establishing the connection to the P2P network.
  • the disruption is a peer disconnecting from the P2P network, requiring the reestablishment of the connection to the P2P network.
  • the disruption is packet loss from the P2P network.
  • embodiments of the present invention are described with respect to the streaming of video data, it should be understood that embodiments of the present invention are not limited to the streaming of video data. It should be appreciated that embodiments of the present invention also apply to other types of media, including without limitation: audio-based data, image-based data, graphics data, video-based data, text-based data, web page-based data, and the like. Moreover, it should be appreciated that embodiments of the present invention can also be applied to on-demand transmission, including synchronous (e.g., live), asynchronous (e.g., time-shifted), or download.
  • synchronous e.g., live
  • asynchronous e.g., time-shifted
  • Embodiments of the present invention utilize a P2P network to distribute, in real-time, a media stream to a large population of peers at low cost, as well as a data source, such as a small number of servers, to ensure fast connection times and error-resilience.
  • a data source such as a small number of servers
  • embodiments of the present invention utilize a connection to a data source to provide fast recover from various events such as packet loss or parent peer disconnection.
  • embodiments of the present invention provide a significant cost reduction compared to current commercial media multicasting.
  • embodiments of the present invention improve the startup latency and quality of P2P streaming systems.
  • FIG. 1 is a block diagram of an example peer 100, in accordance with one embodiment of the present invention.
  • Peer 100 includes P2P connection module 110, P2P disruption detection module 120 and data source connection module 130.
  • peer 100 is implemented in a computing device capable of communicating over a network connection (not shown).
  • peer 100 may be any type of computing device, including without limitation computers, cellular telephones, personal digital assistants, television sets, set-top boxes, and any other computing device capable of receiving and transmitting data over a network.
  • P2P connection module 110 P2P disruption detection module 120 and data source connection module 130 can be implemented as software, hardware, firmware, or any combination thereof.
  • peer 100 may include additional components that are not shown so as to not unnecessarily obscure aspects of the embodiments of the present invention.
  • Peer 100 in conjunction with a data source, e.g., data source 330 of Figure 3A , is operable to provide assisted P2P media streaming.
  • Peer 100 is operable to act as a receiver and a forwarder of a media stream. For instance, when connected to a P2P network, peer 100 receives a media stream from the P2P network. It should be appreciated that peer 100 may be communicatively connected to any number of other peers of the P2P network for receiving different or multiple portions of the media stream. Moreover, peer 100 may forward the received media stream, or portions thereof, to other peers of the P2P network.
  • P2P connection module 110 is operable to establish and maintain at least one connection to a P2P network. Where P2P connection module 110 is establishing an initial connection to a P2P network, in accordance with one embodiment, P2P connection module 110 performs the following operations. First, P2P connection module 110 makes initial contact with a P2P network device requesting a list of potential forwarding peer candidates. In one embodiment, the P2P network device is a peer. In another embodiment, the P2P network device is a server that maintains the list of potential forwarding peer candidates, but does not act as a peer. In one embodiment, the server also acts as a data source outside of the P2P network.
  • P2P connection module 110 receives the list of potential forwarding peer candidates, P2P connection module 110 facilitates an information exchange with at least one of the candidates to determine which candidate to select. For instance, the candidate or candidates are selected based in part on available bandwidth, geographic proximity, network connection characteristics, as well as other information or combinations thereof. Upon selecting at least one forwarding peer, a connection is established with the selected forwarding peer or peer.
  • each of the operations in establishing a connection between peer 100 and a P2P network may introduce delay. Moreover, since some of the peers may behind network address translation (NAT) and firewalls, connecting to them using certain types of protocols may increase this delay. Furthermore, the connection process may be unsuccessful and may have to be repeated, for instance, when throughput on the P2P network is limited.
  • NAT network address translation
  • P2P disruption detection module 120 in combination with a data source is operable to reduce the latency inherent in connecting to a P2P network.
  • P2P disruption detection module 120 detects that P2P network connection module 110 has initiated a connection to a P2P network, but has not yet established such a connection.
  • the connection is initiated when peer 100 is first connecting to a P2P network.
  • the connection is initiated if a connection to the P2P network has been lost, and P2P network connection module 110 is attempting to reestablish a connection to the P2P network.
  • P2P disruption detection module 120 reduces or precludes startup delay by providing an assisted P2P network connection.
  • Peer 100 connects to a data source, e.g. a server or servers, which has access to the stream which is being forwarded to the peers.
  • peer 100 contacts the data source to request portions of the media content.
  • peer 100 establishes its connection to the P2P network, a connection is established to the data source by data source connection module 130, such that the media stream is received over the connection to the data source while the connection to the P2P network is being established.
  • the connection to the data source is a unicast connection, e.g., by way of an HTTP request.
  • the connection to the data source is shutdown by data source connection module 130.
  • the data source is a server.
  • the data source is comprised of a plurality of servers.
  • each of the servers may have access to any portion of the media stream.
  • all servers can include the entire stream, each server can include a unique portion of the stream, servers can include varying and duplicated portions of the media stream, or any other configuration.
  • servers can be collocated, distributed across different nodes of a network, or any combination thereof.
  • the data source is comprised within a CDN.
  • discontinuity e.g., missing packets
  • P2P disruption detection module 120 provides enhanced error resilience by providing an assisted P2P network error resilience where peer 100 connects to a data source, e.g. a server or servers, which has access to the stream which is being forwarded to the peers.
  • a data source e.g. a server or servers
  • the connection to the data source is a unicast connection, e.g., by way of an HTTP request.
  • P2P disruption detection module 120 directs data source connection module 130 to connect to a data source, e.g., a reliable retransmission server, to guarantee the delivery of missing portions of the media stream to peers which notice missing packets or which have been disconnected or partially disconnected from the P2P multicast.
  • peer 100 contacts the data source to request missing portions of the media content.
  • P2P disruption detection module 120 detects that peer 100 has been disconnected from the P2P network
  • P2P disruption detection module 120 directs data source connection module 130 to establish a connection to the data source and to request the missing portions of the media stream.
  • P2P disruption detection module 120 directs P2P network connection module 110 rebuild a connection to the P2P network.
  • peer 100 when peer 100 has reestablished this connection and enough packets have been received to avoid any discontinuity in the media playout, the connection to the data source is shutdown or paused. In another embodiment, in the case of a random packet loss, due, for example, to a transmission error, peer 100 may request the missing packet directly from the data source, and connection to the P2P network does not need to be re-established.
  • peer 100 predicts what may be missing in the future and preemptively requests that information from the data source.
  • the detected disruption is predicted future packet loss. It should be appreciated that in the present embodiment, peer 100 predictively requests content from the data source, as opposed to only reactively requesting content when packets are deemed lost.
  • resource allocation can be performed, where the amount of content requested from the P2P network and from the data source is varied based on the available throughput from the peers of the P2P network 505.
  • FIG. 2 is a flowchart illustrating a process 200 for assisted P2P network connection, in accordance with one embodiment of the present invention.
  • process 200 is carried out by processors and electrical components under the control of computer readable and computer executable instructions.
  • the computer readable and computer executable instructions reside, for example, in data storage features such as computer usable volatile and non-volatile memory. However, the computer readable and computer executable instructions may reside in any type of computer readable medium.
  • process 200 is performed by peer 100 of Figure 1 .
  • FIG. 3A and 3B illustrate an example connection using assisted P2P network connection, in accordance with one embodiment of the present invention.
  • a first connection is initiated to at least one peer of a P2P network for receiving media content from the P2P network.
  • new peer 310 initiates connection 315 with a peer of P2P network 320. It should be appreciated that new peer 310 may initiate multiple connections with multiple peers of P2P network 320 and for purposes of brevity and clarity only connection 315 is described herein.
  • new peer 310 makes initial contact with a P2P network device requesting a list of potential forwarding peer candidates.
  • the P2P network device is a peer.
  • the P2P network device is a server that maintains the list of potential forwarding peer candidates, but does not act as a peer.
  • the server also acts as a data source outside of the P2P network, e.g., data source 330.
  • new peer 310 receives the list of potential forwarding peer candidates, new peer 310 exchanges information with at least one of the candidates to determine which candidate to select.
  • the first connection is not established until a forwarding peer is selected. It should be appreciated that this process of initiating and establishing a first connection to a P2P network can introduce latency and a delay in startup of the media content playout.
  • connection 325 is established with data source 330.
  • data source 330 is a server.
  • data source 330 includes a plurality of servers.
  • connection 325 to data source 330 is a unicast connection, e.g., by way of an HTTP request. It should be appreciated that, in one embodiment, the second connection with the data source is used at least while the new peer is initiating and up until the connection with the P2P network is established.
  • connection 315 is initiated prior to establishing connection 325.
  • connection 325 is established prior to the initiation of connection 315.
  • data source 330 may include the list of potential forwarding peer candidates. It should be appreciated that establishing connection 325 and initiating connection 315 may be executed in any order. It should also be appreciated that connection 325 is of the sort that is more quickly established than connection 315.
  • the media content is received over the second connection from the data source.
  • new peer 310 receives the media content over connection 325 from data source 330.
  • the media content is received over connection 325 at least until connection 315 is established.
  • the first connection is established.
  • a connection is established with the selected forwarding peer or peer.
  • the media content is received over the first connection from the P2P network.
  • connection 315 As shown in Figure 3A , once connection 315 is established, new peer 310 is connected to P2P network 320. Accordingly, the media content is received from P2P network 320 over connection 315.
  • the second connection to the data source is disconnected.
  • new peer 310 is connected to P2P network 320 over connection 315 and that no connection to a data source, e.g., data source 330 of Figure 3A , remains.
  • the second connection is paused rather than disconnected. This might allow for faster resumption of the connection to the data source in the event of a P2P network disruption.
  • discontinuity e.g., missing packets
  • FIG. 4 is a flowchart illustrating a process 400 for assisted P2P network error resilience, in accordance with one embodiment of the present invention.
  • process 400 is carried out by processors and electrical components under the control of computer readable and computer executable instructions.
  • the computer readable and computer executable instructions reside, for example, in data storage features such as computer usable volatile and non-volatile memory. However, the computer readable and computer executable instructions may reside in any type of computer readable medium.
  • process 400 is performed by peer 100 of Figure 1 .
  • FIG. 5A through 5C illustrate an example error resilience process for P2P streaming using assisted P2P network error resilience, in accordance with one embodiment of the present invention.
  • a first connection is initiated to at least one peer of a P2P network for receiving media content from the P2P network. While process 400 is described primarily in accordance with assisted P2P network error resilience, process 400 can be generalized to include other embodiments described herein, such as assisted P2P network connection.
  • the first connection is established.
  • the first connection is monitored by repeating 410 and 412 until a disruption is detected or until all media content is received and the first connection to the P2P network is disconnected.
  • peer 510 receives media content from forwarding peer 520 of P2P network 505 over connection 515.
  • connection 525 is established with data source 530.
  • data source 530 is a server.
  • data source 530 includes a plurality of servers.
  • connection 525 to data source 530 is a unicast connection, e.g., by way of an HTTP request.
  • the media content is received over the second connection from the data source.
  • peer 510 receives the media content over connection 525 from data source 530.
  • peer 510 can receive the media content without interruption caused by the disruption.
  • the disruption includes a forwarding peer to which the peer is connected disconnecting from the P2P network.
  • forwarding peer 520 disconnects from P2P network 505.
  • the peer attempts to reestablish the first connection to the P2P network.
  • the first connection need not be to a particular peer of the P2P network, but rather refers to the connection to the P2P network.
  • the peer initiates a first connection to the P2P network for the purpose of reestablishing the connection to the P2P network. This process is similar to that described in 210 above, and is not repeated here for purposes of brevity.
  • 415 is performed at least concurrently with 425. In one embodiment, 415 is performed concurrently with 420 and 425.
  • the disruption is packet loss. It should be appreciated that this packet loss may or may not be associated with a forwarding peer disconnecting from the P2P network, but rather may be associated with the characteristics of the network transmission to the peer. In the present embodiment, since the first connection is not disconnected, 415 is not performed.
  • the peer predicts what may be missing in the future and preemptively requests that information from the data source.
  • the detected disruption is predicted future packet loss. For example, if the received media content from connection 515 is slowing down, peer 510 may interpret such slowing down as an indication that congestion is occurring. Peer 510 may then request some of the future required content from data source 530. It should be appreciated that in the present embodiment, peer 510 predictively requests content from data source 530, as opposed to only reactively requesting content when packets are deemed lost.
  • resource allocation can be performed, where the amount of content requested from P2P network 505 and from data source 530 is varied based on the available throughput from the peers of P2P network 505. For example, two-thirds of the packets can be requested from P2P network 505 and one-third of the packets can be requested from data source 530.
  • the disruption includes the startup delay inherent in establishing a connection to a P2P network.
  • the peer initiates a first connection to the P2P network for the purpose of reestablishing the connection to the P2P network. This process is similar to that described in 210 above, and is not repeated here for purposes of brevity.
  • the disruption ends when the first connection to the P2P network is reestablished. In another embodiment, the disruption ends when the dropped packet or packets are received. If the disruption has not ended, process 400 returns to 425. The status of the disruption is monitored by repeating 425 and 430 until the disruption ends or until all media content is received and the second connection to the data source is disconnected.
  • the media content is received over the first connection from the P2P network, as shown at 435.
  • peer 510 is connected to P2P network 505. Accordingly, the media content is received from P2P network 505 over connection 515.
  • peer 510 can be connected to any forwarding peer or to any set of forwarding peers of P2P network 505. For example, where the disruption was packet loss, peer 510 might still be connected to the same forwarding peer or set of forwarding peers. In another example, where the disruption was a forwarding peer or a set of forwarding peers disconnecting from P2P network 505, connection 515 is established between peer 510 and a different forwarding peer or a different set of forwarding peers.
  • the second connection to the data source is disconnected.
  • peer 510 is connected to P2P network 505 over connection 515 and that no connection to a data source, e.g., data source 530 of Figure 5B , remains.
  • a data source e.g., data source 530 of Figure 5B
  • the second connection is paused rather than disconnected. This might allow for faster resumption of the connection to the data source in the event of a P2P network disruption.
  • discontinuity e.g., missing packets
  • embodiments of the present invention may also implement a retransmission server in combination with other error resiliency methods.
  • a peer could request retransmissions from other connected peers before making use of the server.
  • the embodiments of the P2P network depicted in Figures 3A , 3B , 5A , 5B and 5C indicate that peers are connected by an application layer multicast tree. It should be appreciated that this implementation is not required, and that other types of P2P streaming network can be implemented.
  • the P2P network relies on multiple multicast trees to relay the media stream to its members. In such a system, complementary portions of the stream are sent on different trees. In such a system, a data source would be used to forward the substream associated with each of the multicast trees to which connections have not yet been established by the joining peer. Likewise, if the peer is disconnected from any of the multicast trees, the missing portion of the stream will be requested from the retransmission data source while the peer rebuilds its faulty connection(s).
  • packets are exchanged between peers, without having to build explicit multicast trees, and packet maps are exchanged between connected peers to locate missing portions of the media stream.
  • the media stream is sent directly from a data source to a connecting peer until the latter has connected to at least N other peers, where N is any given positive number. Packets that have not been located after M packet map exchanges are requested directly from a data source, where M is any given positive number.
  • Embodiments of the present invention enable a P2P streaming system to achieve similar performance CDN while reducing the bandwidth cost.
  • a limited number of data sources e.g., servers, can be used to improve the performance of a P2P system. For instance, in one embodiment, connection to a data source assists in achieving fast connection times. In another embodiment, connection to a data source assists in error resilience.
  • embodiments of the present invention provide for data source assisted peer-to-peer media streaming.
  • the present invention provides an assisted P2P network connection for reducing startup delay associated with connecting to a P2P network.
  • the present invention provides assisted P2P network error resilience.
  • assisted peer-to-peer media streaming are thus described. While the present invention has been described in particular embodiments, it should be appreciated that the present invention should not be construed as limited by such embodiments, but rather construed according to the following claims.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Claims (9)

  1. Procédé pour une transmission multimédia en continu homologue assistée, ledit procédé (400) comprenant les étapes suivantes :
    recevoir une liste d'homologues candidats potentiels à partir d'un dispositif d'homologue ;
    initier (405) une première connexion (515) avec au moins un homologue (520) d'un réseau d'homologues (505) pour recevoir un contenu multimédia à partir dudit réseau d'homologues (505), dans lequel ledit homologue est un candidat parmi ladite liste d'homologues candidats potentiels, dans lequel l'initiation (405) de la première connexion (515) comprend l'établissement de la première connexion ; et
    en réponse à une perturbation de distribution dudit contenu multimédia sur ladite première connexion (515) à partir dudit homologue (520) en raison d'une perturbation dans la première connexion (515),
    établir (420) une deuxième connexion avec une source de données en dehors dudit réseau d'homologues (505), ladite source de données n'agissant pas comme un homologue et ladite source de données étant un serveur de retransmission fiable qui garantit la distribution de parties manquantes du flux multimédia vers ledit homologue, et
    recevoir (425) ledit contenu multimédia sur ladite deuxième connexion (525) avec ladite source de données (530), ladite source de données (530) comprenant ledit contenu multimédia ;
    en réponse à une fin de la perturbation, rétablir (415) ladite première connexion (515) vers au moins un homologue dudit réseau d'homologues (505) ; et
    en réponse au rétablissement de ladite première connexion (515), déconnecter (440) ladite deuxième connexion (525).
  2. Procédé selon la revendication 1 comprenant en outre l'étape suivante :
    en réponse à une fin de ladite perturbation, de sorte que ledit contenu multimédia soit reçu sur ladite première connexion (515), déconnecter (440) ladite deuxième connexion (525).
  3. Procédé selon la revendication 1 dans lequel ladite perturbation comprend en outre un retard de démarrage dans l'établissement de ladite première connexion (515) avec ledit réseau d'homologues (505), ledit procédé (400) comprenant en outre l'étape suivante :
    en réponse à l'établissement de ladite première connexion (515), déconnecter (440) ladite deuxième connexion.
  4. Procédé selon la revendication 1 dans lequel ladite perturbation comprend en outre une perte de paquets sur ladite première connexion (515), dans lequel ladite réception (425) dudit contenu multimédia sur une deuxième connexion (525) comprend en outre l'étape suivante :
    recevoir au moins un paquet manquant sur ladite deuxième connexion (525).
  5. Procédé selon la revendication 1 dans lequel ladite source de données (530) comprend au moins un serveur.
  6. Procédé selon la revendication 5 dans lequel ladite source de données (530) comprend une pluralité de serveurs, chaque serveur parmi ladite pluralité de serveurs comprenant au moins une partie dudit contenu multimédia.
  7. Procédé selon la revendication 1 comprenant en outre l'étape suivante :
    en réponse à ladite perturbation, demander des parties de contenu multimédia à ladite source de données (530).
  8. Procédé selon la revendication 1 comprenant en outre les étapes suivantes :
    prévoir une perte de paquets future ; et
    demander de manière préventive un contenu multimédia comprenant ladite perte de paquets future à ladite source de données (530).
  9. Procédé selon la revendication 3, comprenant en outre l'étape suivante :
    simultanément à ladite initiation (210) de ladite premiè re connexion (315), établir (220) une deuxième connexion (325) avec ladite source de données (330).
EP08794531.7A 2007-07-20 2008-07-16 Transmission multimédia en continu poste-à-poste assistée Not-in-force EP2171600B1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/880,317 US8307024B2 (en) 2007-07-20 2007-07-20 Assisted peer-to-peer media streaming
PCT/US2008/008717 WO2009014629A2 (fr) 2007-07-20 2008-07-16 Transmission multimédia en continu poste-à-poste assistée

Publications (3)

Publication Number Publication Date
EP2171600A2 EP2171600A2 (fr) 2010-04-07
EP2171600A4 EP2171600A4 (fr) 2010-11-17
EP2171600B1 true EP2171600B1 (fr) 2016-05-25

Family

ID=40265758

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08794531.7A Not-in-force EP2171600B1 (fr) 2007-07-20 2008-07-16 Transmission multimédia en continu poste-à-poste assistée

Country Status (5)

Country Link
US (1) US8307024B2 (fr)
EP (1) EP2171600B1 (fr)
KR (1) KR20100043190A (fr)
CN (1) CN101755261B (fr)
WO (1) WO2009014629A2 (fr)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090049184A1 (en) * 2007-08-15 2009-02-19 International Business Machines Corporation System and method of streaming data over a distributed infrastructure
US8386629B2 (en) 2007-12-27 2013-02-26 At&T Intellectual Property I, L.P. Network optimized content delivery for high demand non-live contents
US20090172082A1 (en) * 2007-12-31 2009-07-02 Joaquin Sufuentes Software as a service in a peer-to-peer environment
BRPI0822211A2 (pt) * 2008-02-27 2015-06-23 Thomson Licensing Sistema de transmissão ao vivo ponto a ponto clusterizado hierarquicamente decenentralizado
US20090248793A1 (en) * 2008-03-25 2009-10-01 Contribio Ab Providing Content In a Network
US7822869B2 (en) * 2008-10-15 2010-10-26 Patentvc Ltd. Adaptation of data centers' bandwidth contribution to distributed streaming operations
US7822855B2 (en) * 2008-10-15 2010-10-26 Patentvc Ltd. Methods and systems combining push and pull protocols
US8289365B2 (en) * 2009-03-30 2012-10-16 Alcatel Lucent Method and apparatus for the efficient transmission of multimedia streams for teleconferencing
US9912568B2 (en) * 2009-06-24 2018-03-06 Provenance Asset Group Llc Method and apparatus for handling broken path in peer-to-peer network
CN105722015B (zh) * 2010-02-11 2019-05-28 华为技术有限公司 机器对机器业务的承载建立方法及网络传输设备
CN101795297B (zh) * 2010-03-19 2012-10-31 北京天天宽广网络科技有限公司 基于p2p技术的直播时移系统及其方法
US9444876B2 (en) 2010-11-08 2016-09-13 Microsoft Technology Licensing, Llc Content distribution system
US8885498B2 (en) 2010-12-23 2014-11-11 Deutsche Telekom Ag Network traffic aggregation method and device for in-vehicle telematics systems using tethering and peer-to-peer networking of mobile devices
WO2012153173A2 (fr) * 2011-01-29 2012-11-15 Redthorne Media, Llc Réseau privé superposé orienté vers le retour d'informations pour la distribution de contenus
US10855734B2 (en) * 2011-06-29 2020-12-01 Interdigital Ce Patent Holdings Remote management of devices
US10051051B2 (en) * 2012-06-29 2018-08-14 Verizon Patent And Licensing Inc. Online community based peer-to-peer media streaming systems and methods
US9420026B2 (en) * 2012-10-31 2016-08-16 At&T Intellectual Property I, L.P. Distributing communication of a data stream among multiple devices
US10491458B2 (en) * 2013-01-31 2019-11-26 Dell Products L.P. System and method for reporting peer-to-peer transfer events
CN103885426B (zh) * 2014-03-28 2018-07-10 百度在线网络技术（北京）有限公司 设备的控制方法、客户端、服务器、中间设备和被控设备
US9961373B2 (en) * 2014-06-27 2018-05-01 Panasonic Avionics Corporation Vehicle entertainment system
US10097603B2 (en) * 2014-06-27 2018-10-09 Panasonic Avionics Corporation Vehicle entertainment system
EP3269105B1 (fr) * 2015-03-09 2019-06-05 Telefonaktiebolaget LM Ericsson (publ) Encryption de transmission dans un proxy
CN106453588B (zh) * 2016-11-01 2019-08-09 东软集团股份有限公司 释放连接的方法、装置及系统
CN107426828B (zh) * 2017-07-03 2021-01-08 Oppo广东移动通信有限公司 数据传输方法、装置及移动终端
CN109996126B (zh) * 2017-12-29 2021-06-22 浙江宇视科技有限公司 一种混合网络架构下的设备连接动态调度方法及系统
US10924770B2 (en) 2018-06-08 2021-02-16 Panasonic Avionics Corporation Methods and systems for selective media distribution for a vehicle entertainment system
US10728587B2 (en) 2018-06-08 2020-07-28 Panasonic Avionics Corporation Vehicle entertainment system
US11136123B2 (en) 2018-06-08 2021-10-05 Panasonic Avionics Corporation Methods and systems for storing content for a vehicle entertainment system
CN111726658A (zh) * 2020-06-12 2020-09-29 腾讯科技（深圳）有限公司 一种多媒体数据传输方法及装置
US11652876B2 (en) * 2021-07-22 2023-05-16 Rovi Guides, Inc. Assisted delivery service for networks

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2341047B (en) * 1998-08-19 2003-09-10 Motorola Ltd Method and apparatus for streamlining in a communication system
US6732180B1 (en) * 2000-08-08 2004-05-04 The University Of Tulsa Method to inhibit the identification and retrieval of proprietary media via automated search engines utilized in association with computer compatible communications network
US7594030B2 (en) * 2000-11-22 2009-09-22 Microsoft Corporation Locator and tracking service for peer to peer resources
WO2002076003A2 (fr) * 2001-03-19 2002-09-26 Imesh Ltd. Systeme et procede pour mecanisme d'echange de fichier de poste a poste a partir de multiples sources
KR20030056701A (ko) 2001-12-28 2003-07-04 한국전자통신연구원 Ｐ２ｐ 방식을 이용한 멀티미디어 스트리밍 장치 및 방법
US7849140B2 (en) * 2002-08-29 2010-12-07 Oracle America, Inc. Peer-to-peer email messaging
US20050015511A1 (en) * 2003-07-02 2005-01-20 Nec Laboratories America, Inc. Accelerated large data distribution in overlay networks
KR20040096807A (ko) 2004-08-04 2004-11-17 (주)엠엔에스텍 인터넷에서 피투피/서버경유 혼용 네트웍 분산방법을이용한 원격회화 시스템에서의 강의 시스템
US7174385B2 (en) * 2004-09-03 2007-02-06 Microsoft Corporation System and method for receiver-driven streaming in a peer-to-peer network
KR20070024747A (ko) 2005-08-23 2007-03-07 삼성전자주식회사 네트워크 스위칭을 이용한 스트리밍 서비스 장치 및 방법
US8775655B2 (en) 2005-10-21 2014-07-08 Roxbeam Media Network Corporation System and method for presenting streaming media content
US20070174429A1 (en) * 2006-01-24 2007-07-26 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine hosting a requested computing environment
US8194681B2 (en) * 2006-05-23 2012-06-05 Core Wireless Licensing S. á.r. l. Bridging between AD HOC local networks and internet-based peer-to-peer networks
US20080098123A1 (en) 2006-10-24 2008-04-24 Microsoft Corporation Hybrid Peer-to-Peer Streaming with Server Assistance

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
KR20100043190A (ko) 2010-04-28
WO2009014629A3 (fr) 2009-03-26
EP2171600A4 (fr) 2010-11-17
CN101755261A (zh) 2010-06-23
CN101755261B (zh) 2013-03-27
US8307024B2 (en) 2012-11-06
WO2009014629A2 (fr) 2009-01-29
US20090024754A1 (en) 2009-01-22
EP2171600A2 (fr) 2010-04-07

Similar Documents

Publication Publication Date Title
EP2171600B1 (fr) Transmission multimédia en continu poste-à-poste assistée
US10034058B2 (en) Method and apparatus for distributing video
US9083585B2 (en) Retransmission-based stream repair and stream join
US8762535B2 (en) Managing TCP anycast requests
CN102804727B (zh) 用于处理对等网络中的损坏路径的方法和装置
US11277456B2 (en) System and method for delivering an audio-visual con tent to a client device
US10200747B2 (en) Computer network providing redundant data traffic control features and related methods
KR20030056701A (ko) Ｐ２ｐ 방식을 이용한 멀티미디어 스트리밍 장치 및 방법
WO2012074777A1 (fr) Procédé et appareil de distribution de vidéos
JP2009520409A (ja) マルチキャストデータの高速処理
US20070160048A1 (en) Method for providing data and data transmission system
Baccichet et al. Content-aware P2P video streaming with low latency
US9425975B2 (en) Multicast transmission using a unicast protocol
CN109842567B (zh) 数据分发方法以及分发服务器
US10425458B2 (en) Adaptive bit rate streaming with multi-interface reception
CN115865878A (zh) 一种媒体流的传输控制方法、装置、存储介质和电子设备
Bouten et al. An autonomic delivery framework for HTTP adaptive streaming in multicast-enabled multimedia access networks
WO2010075742A1 (fr) Procédé, dispositif et système pour acquérir des contenus multimédia dans un réseau p2p
Halder et al. FybrrStream: A WebRTC based efficient and scalable P2P live streaming platform
Kurutepe et al. Multi-view video streaming over P2P networks with low start-up delay
Noh et al. Time-shifted streaming in a tree-based peer-to-peer system.
Guo et al. P cast: P2p patching scheme for vod service
Noh et al. Time-shifted streaming in a peer-to-peer video multicast system
Stainov Swarm Peer Ports
Chakareski et al. Adaptive p2p video streaming via packet labeling

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20091214

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIN1 Information on inventor provided before grant (corrected)

Inventor name: APOSTOLOPOULOS, JOHN

Inventor name: SETTON, ERIC

A4 Supplementary search report drawn up and despatched

Effective date: 20101019

RIC1 Information provided on ipc code assigned before grant

Ipc: H04L 29/06 20060101ALI20101013BHEP

Ipc: G06F 17/00 20060101ALI20101013BHEP

Ipc: G06F 15/16 20060101AFI20090211BHEP

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20131212

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20160204

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Ref country code: AT

Ref legal event code: REF

Ref document number: 802842

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160615

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 9

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008044433

Country of ref document: DE

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160825

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 802842

Country of ref document: AT

Kind code of ref document: T

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160926

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160826

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160731

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008044433

Country of ref document: DE

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160731

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160731

26N No opposition filed

Effective date: 20170228

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 10

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160716

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 11

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20080716

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20160731

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20160525

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20210623

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20210623

Year of fee payment: 14

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20210622

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602008044433

Country of ref document: DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220716

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230201