EP3028418A1 - System, vorrichtung und verfahren zur leistungsverbesserung von aggregierten/gebundenen netzwerkverbindungen zwischen entfernten standorten - Google Patents

System, vorrichtung und verfahren zur leistungsverbesserung von aggregierten/gebundenen netzwerkverbindungen zwischen entfernten standorten

Info

Publication number
EP3028418A1
EP3028418A1 EP14832123.5A EP14832123A EP3028418A1 EP 3028418 A1 EP3028418 A1 EP 3028418A1 EP 14832123 A EP14832123 A EP 14832123A EP 3028418 A1 EP3028418 A1 EP 3028418A1
Authority
EP
European Patent Office
Prior art keywords
network
client site
aggregated
component
connection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14832123.5A
Other languages
English (en)
French (fr)
Other versions
EP3028418A4 (de
Inventor
Patricio Humberto Saavedra
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Adaptive Networks Inc
Original Assignee
TeloIP Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/958,009 external-priority patent/US9264307B2/en
Application filed by TeloIP Inc filed Critical TeloIP Inc
Publication of EP3028418A1 publication Critical patent/EP3028418A1/de
Publication of EP3028418A4 publication Critical patent/EP3028418A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/64Hybrid switching systems
    • H04L12/6418Hybrid transport
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2854Wide area networks, e.g. public data networks
    • H04L12/2856Access arrangements, e.g. Internet access
    • H04L12/2863Arrangements for combining access network resources elements, e.g. channel bonding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2854Wide area networks, e.g. public data networks
    • H04L12/2856Access arrangements, e.g. Internet access
    • H04L12/2863Arrangements for combining access network resources elements, e.g. channel bonding
    • H04L12/2865Logical combinations
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/50Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate

Definitions

  • the present invention relates generally to network communications and, in particular, to aggregating or bonding communications links so as to improve network performance such as Cable, DSL, T1 , or Metro Ethernet, so as to improve network performance or quality of services in regards to a variety of different networks including wired and wireless networks, and including Wide Area Networks ("WAN").
  • network performance such as Cable, DSL, T1 , or Metro Ethernet
  • WAN Wide Area Networks
  • Examples of such technologies include load balancing, WAN optimization, or
  • ANATM technology of TELolPTM as well as WAN aggregation technologies.
  • Many of such technologies for improving network performance are used to increase network performance between two or more locations (for example Location A, Location B, Location N or the "Locations"), where bonding/aggregation of links is provided at one or more of such locations. While the bonded/aggregated links provide significant network performance improvement over the connections available to carry network traffic for example from Location A to an access point to the backbone of a network (whether an Internet access point, or access point to another data network such as a private data network or high performance wireless network) ("network backbone”), the bonded/aggregated links are generally slower than the network backbone.
  • a networking system for improving network communication performance between at least a first client site and a second client site, wherein the first client site and the second client site are at a distance from one another that would usually require long haul network communication, the system comprising: (A) at least one network bonding/aggregation computer system that includes: (i) at least one client site network component that is implemented at least at a first client site, the client site network component bonding or aggregating one or more diverse network connections so as to configure a bonded/aggregated connection that has increased throughput; and (ii) at least one network server component, configured to interoperate with the client site network component, the network server component including a server/concentrator that is implemented at an access point to a high performing network; wherein the client site network component and the network server component are configured to interoperate so as to create and maintain a network overlay for managing network communications between the at least first client site and the access point, wherein between the client site network component
  • the distance between the first client site and the second client site is such that data traffic over a bonded/aggregated connection between the first client site and the second client site is subject to long haul effects.
  • the managed network path is maintained between at least a first client site and a second client site without routing of network communications through a central server that increases long haul effects.
  • the plurality of network server components are implemented in a geographic area so as to provide a Point-of-Presence (PoP), which are made available to proximate client site network components.
  • PoP Point-of-Presence
  • one or more client site network components and one or more associated network server components include peer-to-peer programming and based on such peer-to-peer programming operate on a peer to peer basis.
  • the network server component is disposed at a distance from an access point that does not result in long haul effects between the network server component and the access point.
  • the two or more Points-of-Presence may be accessible to the at least one client site network component, and the client site network component: collects network performance information; and initiates the configuration of the network overlay to include one or more network server components so as to improve network communication performance.
  • each network server component may be accessible to a plurality of client site network components, each client site network component being associated with a client site.
  • the system may include a network of Points-of-Presence, distributed geographically so as to serve a plurality of client locations each associated with at least one client site network component.
  • the system may further include: a client site network component at each of the first client site, and at the second client site; a network server component proximal to each of the first client site and proximal to the second client site; wherein communications between the first client site's client site network component and associated network server component are bonded or aggregated, then terminated by the network server component associated with the first client site's client site network component, and passed to the high performing network; data traffic is received by the network server component associated with the second client site and transferred on a bonded or aggregated connection between the network server component associated with the second client site and the client site network component associated with the second client site.
  • the bonding/aggregation computer system includes a network aggregation device that: (A) configures a plurality of dissimilar network connections or network connections provided by a plurality of diverse network carriers ("diverse network connections") as one or more aggregated groups, each aggregated group creating an aggregated network connection that is a logical connection of the plurality of diverse connections; and (B) routes and handles bi-directional transmissions over the aggregated network connection; wherein two or more of the diverse network connections have dissimilar network characteristics including variable path bidirectional transfer rates and latencies; wherein the logical connection is utilized for a transfer of communication traffic bidirectionally on any of the diverse network connections without any configuration for the dissimilar network connections or by the diverse network carriers; and wherein the network aggregation engine includes or is linked to a network aggregation policy database that includes one or more network aggregation policies for configuring the aggregated groups within accepted tolerances so as to configure and maintain the aggregated network connection so that the logical connection has a total communication traffic throughput that
  • a computer implemented method for improving network communication performance between at least two sites comprising: (A) using a client site network component associated with a first client site to connect to a proximal network server component, the network server component being connected to an access point to a high performing network, forming thereby a network overlay that provides a bonded or aggregated connections for carrying data packets; (B) the network server component terminating the bonded or aggregated connection; and (C) the network server component transferring the data packets to the high performing network, for delivery to a second client site, while maintaining management of data traffic so as to provide a managed network path that incorporates at least the bonded/aggregated connection and at least one network path carried over the high performing network, thereby reducing long haul effects.
  • the method may include receiving the data traffic at the second client site.
  • the method may include maintaining management of data traffic so as to provide a managed network path that includes the bonded or aggregated connection and one or more network paths of the high performing network.
  • the method may include receiving the data traffic at a network server component associated with the second client site, the network server component initiating a bonded or aggregated connection to a client site network component associated with the second client site.
  • a plurality of network server components form a Point- of-Presence
  • the client site network component selects one or more of the network server components of the Point-of-Presence for establishing a network overlay so as to improve network performance.
  • FIG. 1a illustrates a prior art network configuration that includes a bonded/aggregated network connection.
  • FIG. 1a illustrates the problem of long haul aggregation/bonding.
  • FIG. 1 b also illustrates a prior art network configuration that includes central management of bonded/aggregated network connections.
  • FIG. 2a shows a network solution in accordance with the present invention, with bonding/aggregation implemented at both Site A and Site B, while minimizing long haul effects based on the technology of the present invention.
  • FIG. 2b shows another network solution in accordance with the present invention, in which bonded/aggregated network service exists at Site A but not at Site B.
  • FIG. 2c shows a still other network solution in accordance with the present invention, in which bonding/aggregation is implemented as between Site A, Site B, and Site C.
  • FIG. 2d shows a further implementation of the network architecture of the present invention, in which a plurality of servers/concentrators are implemented as part of a Point-of-Presence.
  • FIG. 3 is a block diagram of a communication device incorporating a particular embodiment of the invention, demonstrating the device as an aggregation means on the client/CPE side of a network connection.
  • FIG. 4 is a block diagram of a communication device incorporating a particular embodiment of the invention, demonstrating the device as an aggregation means on the server/concentrator side of a network connection.
  • FIG. 5 is a block diagram of a communication network incorporating a particular embodiment of the invention, demonstrating the device as an aggregation means on both the client/CPE side and server/concentrator side of a network connection.
  • FIG. 6 is a flow diagram of a method of providing redundancy and increased throughput through a plurality of network connections in an aggregated network connection.
  • FIG. 7a illustrates a prior art network architecture where long haul effects apply, and presents network performance based on download speed.
  • FIG. 7b illustrates, in similar network conditions as in FIG. 7a but implementing the present invention in order to reduce long haul bonding/aggregation, improved network performance based on faster download speed.
  • a network solution for improving network communication performance between at least two sites, where the two sites are at a distance from one another that would usually require long haul network communication.
  • the network solutions includes at least one network bonding/aggregation system that includes (A) at least one first network component that is implemented at a first service site, the first network component being configured to bond or aggregate one or more diverse network connections so as to configure a bonded/aggregated connection that has increased throughput; and (B) a second network component, configured to interoperate with the first network component, the second network component including a server/concentrator (also referred to as network server component) that is implemented at an access point to a high performing network backbone.
  • a server/concentrator also referred to as network server component
  • the first network component may be implemented using what is called in this disclosure a "CPE" or customer premises equipment (also referred to as client site network component).
  • CPE customer premises equipment
  • server/concentrator component (more fully described below) interoperate to configure the bonded/aggregated connections in order to provide improve network connections at a site associated with the CPE.
  • the server/concentrator is implemented at an access point, with access to the network backbone so as to avoid long- haul bonded/aggregated network communications.
  • network architectures that involve long-haul bonded/aggregated network communication result in less than optimal performance, thereby minimizing the advantages of the bonding/aggregation technology.
  • the bonding/aggregation technology may improve service to Site A associated with for example a CPE (or equivalent), based on bonding/aggregation between the CPE and an associated server/concentrator (or equivalent), overall performance may be less than desired and in fact may be less than what would be available without bonding/aggregation because of the long haul effects of carrying the bonded/aggregated from Site A, to at least Site B. These long haul effects will present wherever Site A and at least Site B are at a substantial distance from one another.
  • FIG. 1a illustrates the problem of long haul aggregation/bonding generally.
  • packets are carried over the Internet through an extension of the bonded/aggregated connection across the Internet (102), rather than the high performing Internet.
  • the bonded/aggregated connection, across a distance that is subject to long haul effects, will not perform as well as the Internet, thereby providing less than ideal performance.
  • the Example in Operation reflects another problem with prior art bonding/aggregation solutions, namely that they generally require control or management by a central server. Depending on the location of the central server, this can result in multiplying of the long haul effects because traffic between a Site A and Site B may need to also be transferred to a Site C that is associated with the central server.
  • Central server (104) manages network communications, and in fact routes network communications between Site A and Site C. To the extent that the distance between central server (104) is substantial from either of Site A or Site C, long haul effects will present.
  • central server (104) is at a substantial distance from each of Site A and Site C, then there will be a multiplying of the long haul effects, as network traffic will pass from Site A to the central server (104) to Site C, and from Site C to the central server (104) to Site A.
  • the server/concentrator side of a bonding/aggregation network solution for Site A (120a) is implemented such that (A) the location of the server/concentrator is implemented with access to the network backbone of Internet (112), and (B) the server/concentrator (110a) includes functionality for (i) receiving packets by means of the bonded/aggregated connection (116a), (ii) interrupting the bonded/aggregated connection (116a) using an interruptor (118), and (iii) directing the packets (114) to the Internet (112) for delivery to a Site B (120b).
  • Site B also has bonded/aggregated network service
  • the packets are delivered to a Site B side server/concentrator (110b).
  • Server/concentrator (110b) established a further bonded/aggregated connection (116b) and directs the packets (114) via the bonded/aggregated connection (116b) to a CPE(B) (124b) at Site B.
  • FIG. 2b illustrates a configuration where bonded/aggregated network service exists at Site A but not at Site B.
  • FIG. 2c bonded/aggregated service is present for each of Site A, Site B and Site C.
  • FIG. 2c illustrates one possible implementation of the invention, where the network system is based on a distributed network architecture where server/concentrators (110a) (110b) (110c) and corresponding CPEs (124a) (124b) (124c) are configured to provide improved network communications, including interruption of network communications at the network backbone so as to reduce long haul effects, dynamically and on a peer to peer basis without the need for a persistent central manager.
  • server/concentrators 110a) (110b) (110c) and corresponding CPEs (124a) (124b) (124c) are configured to provide improved network communications, including interruption of network communications at the network backbone so as to reduce long haul effects, dynamically and on a peer to peer basis without the need for a persistent central manager.
  • each of the network components of the network system included functionality to operate on a peer to peer basis.
  • a CPE (124) initiates network communications on a bonded/aggregated basis, cooperating with a server/concentrator (110), with packets destined for a remote location.
  • Each server/concentrator (110) receives dynamic updates including a location and identifier associated with other server/concentrators (110). Packets are dynamically sent to a server/concentrator (110) at the remote location, if available, and from the server/concentrator (110) at the remote location to its CPE (124).
  • the CPEs (124) and their server/concentrators (110) use bi-directional control of network communications to establish a network overlay to provide improved network performance.
  • the network overlay for example provides desirable quality of service despite underlying network conditions that may otherwise resulted in a decrease in network performance.
  • the network system of the present invention establishes and manages two or more network overlays.
  • a first network overlay (126) is established between the CPE(A) (124a) and server/concentrator (110a); then, communications are transferred over the Internet (112) without a network overlay; then, a second network overlay (129) is established between server/concentrator (110b) and CPE(B) (124b).
  • IP transport is provided between Site A and Site B where this will provide better performance than the aggregated/bonded network connections. Bonding/aggregation in effect is distributed across the locations, rather than attempting to span the distance between the locations with end to end bonding/aggregation.
  • the present invention therefore provided distributed bonding/aggregation.
  • the present invention also provides a network system that automatically provides distributed bonding/aggregation in a way that bonding/aggregation is proximal, and beyond proximal connections IP transport is used, with proximal bonded/aggregated connections and fast Internet being used as part of end-to-end improved service.
  • one or more server/concentrators can be implemented at a physical location, as part of a Point-of Presence (PoP) (130).
  • a PoP can define a relatively high concentration of servers/concentrators within an area.
  • a plurality of PoPs (130) may be available in a geographic location.
  • a plurality of PoPs (130) may be established based on network topology or service requirements in a given area.
  • each PoP (130) has one or more network backbone connections (132), because in some locations different network backbones may be available.
  • the PoP (130) may be implemented so that it dynamically interoperates with surrounding networks.
  • the PoP (130) is a collection of network components, established at the periphery of the network backbone (112), associated with a plurality of networks, and cumulatively providing network communication service to a one or more clients in a defined geographic area.
  • the server/concentrators (110) located within the PoP (130) functions as a network access server for connecting to the Internet (112).
  • the network access server (110) acts as the access point to the Internet (112) for a plurality of CPE devices (124) that are connected to the PoP (130).
  • the servers/concentrators (110) may be configured to communicate with one another to share information regarding network conditions. Servers/concentrators (110) provide connectivity to CPEs (124) and may also run a networking protocol such as BGP to route servers and other network backbone connections (112).
  • servers/concentrators (110) are configured to detect changes in their network environment.
  • the CPE (124) may be configured to collect information from network components in its vicinity including from one or more available PoPs (130) and their servers/concentrators (110).
  • the CPE (124) for example connects to a closest available server/concentrator (124), implemented as part of a PoP (130), and thereby having access to a connection to the network backbone (112). Whether the connection to the network backbone (112) is direct or indirect, the network connections are established so as to minimize long haul effects.
  • each CPE (124) wanting to establish a connection dynamically advertises its IP address, and receives replies from associated servers/concentrators (110) along with their current network performance information.
  • the CPE (124) initiates a bonded/aggregated connection with a server/concentrator (110) that is both proximal (to minimize long haul effects between the CPE (124) to the network backbone (112)), and also that based on network conditions relevant to the particular server/concentrator, is performing well.
  • a network device is deployed that bonds or aggregate multiple, diverse links.
  • the network device may be WAN aggregator or a link aggregator.
  • QOS quality of services
  • One or more CPEs and one or more concentrators can create various different network configurations that improve network performance in relation to network communications between them.
  • the CPEs and concentrators are designed to be self- configuring, and to intemperate with one another to manage traffic in a more effective way.
  • Proximal means a distance such that based on relevant network conditions, long haul network communication and associated effects are avoided. The distance between the CPE and the server/concentrator is proximal, thereby enabling good network service. [0062] A skilled reader will also understand that in order to take advantage of the network architecture of the present invention, the server/concentrator (110) should be located at an access point to the network backbone (112) or in some other way to minimize the long haul effect, for example, by the server/concentrator being located proximal to an access point so as to further avoid long haul network communication.
  • the bonded/aggregated connection at Site A and the bonded/aggregated connection at Site B may be different, in the sense that each may include different types of network connections and that may be associated with different carriers.
  • the network overlay provided operates notwithstanding such diversity.
  • the network backbone (112) could be any high performance network including for example a private WAN, the Internet, or an MPLS network.
  • one or more network overlays are established in accordance with the present invention, thereby in one aspect providing a multi-POP network that exploits multiple points of presence so as to provide a persistent, configurable/reconfigurable network configuration that provides substantial network performance improvements over prior art methods.
  • the CPEs/concentrators may monitor network performance, including in the areas proximate to their position, and may reconfigure the network overlay dynamically, across multiple locations (including multiple PoPs) based on changes in network performance while providing continuity of service.
  • the network components of the present invention are intelligent, and iteratively collect network performance information.
  • each CPE is able to direct associated concentrator(s) and any CPE to in aggregate re-configure the network overlay.
  • management of the network may be centralized or decentralized, depending on the configuration that provides the best overall performance. This is in contrast to prior art solutions that generally require central management for example of termination of connection which results in traffic being carrier over bonded/aggregated connection that involve long haul transmission that fail to take advantage of network paths that may provide inherently better performance than the bonded/aggregated connection paths.
  • decentralized managed is made possible by peer-to-peer functionality implemented to the network components of the present invention.
  • a plurality of servers/concentrators may be established in multiple locations covering a plurality of different access points.
  • Each server/concentrator may be used for multiple clients associated with different CPEs to improve network performance for such multiple clients by providing termination of their bonded/aggregated connection and transfer of communications to the network backbone.
  • the network solution of the present invention therefore may include multiple Points-of- Presence, distributed geographically including for example in areas requiring network service, and through the network architecture of the present invention bridging geographically disparate areas with improved network communication therebetween.
  • the present invention may be implemented in connection with any technology for bonding or aggregating links, and thereby reduce long haul effects.
  • link aggregation is one form of bonding/aggregation that may be used as part of the overall network solution and network architecture disclosed in this invention.
  • the system, method and network architecture may be implemented such that the aggregated/bonded network connections described are implemented using the link aggregation technology described in Patent No. 8,155,158.
  • the CPE and the server/concentrator (or concentrator) components previously described emphasizing their creation and management of the bonded/aggregated connections between them, which in the network configuration of the present invention form a part of the overall network overlay that incorporates the one or more portions that are carried over the network backbone.
  • Metro Ethernet 10Mbps (E10) link and a T1 (DS1) link are aggregated in accordance with the invention as described below, in order to provide higher fault tolerance and improved access speeds.
  • the aggregation of diverse carriers in accordance may extend to any broadband network connection including Digital Subscriber Line (DSL) communications links, Data over Cable Service Interface Specification (DOCSIS), Integrated Services Digital Network, Multi protocol Label Switching, Asynchronous Transfer Mode (ATM), and Ethernet, etc..
  • the network connections may also include a WAN.
  • an apparatus is provided for managing transfer of communication traffic over diverse network connections aggregated into a single autonomous connection, independent of the various underlying network connections.
  • the apparatus may include a network aggregation device and an aggregation engine.
  • the network aggregation device may be adapted to configure a plurality of network connections, which transfers communication traffic between a further network connection and the plurality of network connections, as an aggregated group for providing a transfer rate on the further communication link, and to allocate to the aggregate group a rate of transfer equal to the total available transfer rate of the underlying networks.
  • the aggregation engine may be adapted to manage the distribution of communication traffic received both to and from a plurality of network connections, establishing newly formed aggregated network connections.
  • the aggregation engine may be implemented in software for execution by a processor, or in hardware, in a manner that is known to those skilled in the art.
  • a plurality of diverse network connections may be aggregated to create an aggregated network connection.
  • the diversity of the network connections may be a result of diversity in provider networks due to the usage of different equipment vendors, network architectures/topologies, internal routing protocols, transmission media and even routing policies. These diversities may lead to different network connections with different latencies and/or jitter on the network connection. Also, variation within transmission paths in a single provider network may lead to latency and/or jitter variations within a network connection.
  • Latency and jitter typically affect all data communication across the network connection. Latency, as is known to those skilled in the art, is the round-trip time for a transmission occurring end-to-end on a network connection. Jitter, as is known to those skilled in the art, is the variance in latency on a network connection for the same data flow. High latency and jitter typically have a direct and significant impact on application performance and bandwidth. Applications such as VOIP, and video delivery are typically highly sensitive to jitter and latency increases and can degrade as they increase. [0080] Transparent aggregation of a plurality of network connections in an aggregated network connection requires the management of data transmitted over the aggregated connection by the aggregation engine and received from the aggregation traffic termination engine.
  • transparent aggregation does not require any configuration by a network provider.
  • the aggregation engine and the aggregation traffic termination engine may manage data transmission such that the variable path speeds and latencies on the plurality of network connections do not affect the application data transmitted over the aggregated network connection.
  • the network aggregation engine and the aggregation traffic termination engine may handle sequencing and segmentation of the data transmitted through the aggregated connection to transparently deliver application data through the aggregated connection with minimal possible delay while ensuring the ordered delivery of application data.
  • the network aggregation engine provides a newly aggregated network connection with a capacity equal to the sum of the configured maximum throughput of the network connections.
  • the aggregation engine and an aggregation traffic termination engine (further explained below) handle the segmentation of packets as required in confirmation with architectural specifications such as Maximum Segment Size (MSS) and Maximum Transmission Unit of the underlying network connections.
  • the network aggregation device is operable to handle assignment of sequence identifiers to packets transmitted through the aggregated network connection for the purpose of maintaining the ordering of transmitted data units over the aggregated network connection.
  • the network connection device includes or is linked to a connection termination device, and a plurality of fixed or hot swappable transceivers for transmitting communication traffic on respective sets of network connections, for the purpose of configuring a plurality of network connections as an aggregated connection or the management of multiple aggregated network connections and providing access to the aggregated network connection for any network communications traversing the device.
  • routing protocols or route selection mechanisms described are intended only to provide an example but not to limit the scope of the invention in any manner.
  • FIG. 3 is a block diagram of a communication device incorporating a particular embodiment of the invention, demonstrating the device acting as a client.
  • the network element/network aggregation device (also referred to in this disclosure simply as the "device” or the “network aggregation device”) 23 includes (in this particular embodiment shown for illustration) a network connection termination module 25 that includes representative transceiver interfaces 14, 15 and 16. Each transceiver interface 14, 15 and 16 represents an interface to a physical communication medium through which communications may be established to network connections.
  • a possible implementation of the network aggregation device may use a single or multiple chassis with slots for multiple network connection termination modules and multiple network aggregation engine modules. The multiple network connection termination modules may be grouped by protocol specific or medium specific transceiver/interfaces.
  • the network aggregation engine 11 may handle the configuration of the network aggregation device and all related interactions with external inputs.
  • a device configuration store 24 may provide persistent data storage for device configuration information such as a network aggregation policy.
  • the network aggregation engine 11 may handle queries from external sources, such as configuration parameters a network management protocol such as Simple Network Management Protocol, for example.
  • the interface 10 may be a protocol agent and may provide for communication with a Network Management System (NMS) or operator system for configuration of the aggregation engine by the definition of an aggregation policy.
  • NMS Network Management System
  • Control and management information may be transferred between the network aggregation device 23 and the NMS or operator system through the interface 10 via any available or specifically designated network connection 19, 20, 21 and 17 through any transceiver interface 14, 15 and 16.
  • multiple network connections may be combined to form an aggregated network connection 22, as disclosed in further detail herein.
  • Each individual network connection may be configured with a maximum communication traffic rate, which could be expressed as a bit rate in bits per second.
  • the network aggregation engine 11 may be implemented in software for execution by a processor in the network aggregation device 23, or in hardware such as by means of a Field Programmable Gate Array (FPGA) or other integrated circuit, or some combination thereof.
  • the network aggregation engine 11 may be implemented in a distributed manner by distributing aggregation engine intelligence to the network connection termination module 25, in a manner that is known.
  • the network aggregation engine 11 may receive traffic from client network connection device 18 through a network connection 17 provided through a transceiver interface 16.
  • the client network connection device 18 may be any device including, without limitation, a router, switch, or media converter that is capable of providing termination for a single or multiple client nodes, where nodes are any devices capable of connecting to a network irrespective of protocol or interface specificity.
  • traffic may be received over multiple network connections through a single or multiple transceiver interfaces.
  • the network aggregation engine 11 may accept all traffic from the client network connection, may provide encapsulation and segmentation services for the traffic for transmission through the aggregated network connection 22, and may transmit it over any of the network connections 19, 20 and 21 through any of the transceiver interfaces 14, 15 and 16.
  • the network aggregation engine 11 may handle segmentation in a manner that avoids the fragmentation of aggregated communication traffic received through the client network connection device 18, when transmission occurs over the aggregated network connection 22 through any of the network connections 19, 20 and 21 , by ensuring that the length of a packet/frame transmitted over any of the network connections 19, 20 and 21 is less than or equal to the configured or detected frame length for the respective connections in the aggregated network connection 22.
  • the network aggregation engine 11 may poll the state of network connections
  • the network aggregation engine 11 may remove the network connection 19, 20, and 21 from within the aggregated network connection 22 without removing it from the polled network connections list. By leaving the removed network connection 19, 20, and 21 in the polled network connection list, the network aggregation engine 11 may aggregate the network connection into the aggregated network connection 22 once it has come back within acceptable tolerance values. This may ensure that a network connection may change states between residing in an aggregated network connection 22 or not, without the intervention of an external system or input.
  • the network aggregation engine 11 may handle notifications to all end points configured within the device configuration store 24 with internal events such as changes in network connection state, threshold violations on configured thresholds for any number of configurable variables for any object within or connected to the network aggregation device 23.
  • the network aggregation engine 12 may also handle events such as changes in the state of a network connection 19, 20, and 21 included in the aggregated connection, changes in latency of a network connection included in the aggregated network connection 22, scheduling changes, event logging, and other events.
  • FIG. 4 is a block diagram of a communication device incorporating a particular embodiment of the invention, demonstrating the device acting as a server/concentrator.
  • the network aggregation engine 11 may provide access to a network aggregation policy database 36 which stores configuration information related to the various aggregated network connections that terminate on the aggregated network connection device 28.
  • the network aggregation termination device 28 may be implemented in such a manner that each aggregated network connection defined in the network aggregation policy database 36 is handled by its own virtual instance, the use of which enables termination of each aggregated network connection from multiple customer premises equipment (CPE).
  • CPE customer premises equipment
  • FIG. 5 is a block diagram of a communication network incorporating a particular embodiment of the invention, demonstrating the function of the device acting as a client/CPE and server/concentrator.
  • aggregated network connections 70, 71 and 72 may be built by network aggregation devices 63, 64 and 65, which terminate to a single aggregated network connection termination device 61 through network connections 66 and 68 as their endpoint.
  • the aggregated network connection termination device 61 may access external communications networks through network connections 66 and 68 to access external/remote network resource 69.
  • Access to external communications networks may be provided by the aggregated network connection termination device 61 by using either network connection 66 or 68 through the use of a routing protocol, such as Border Gateway Protocol (BGP), Open Shortest Path (OSPF), or through the use of simpler mechanisms such as load sharing over multiple static routes within the communication network 74 that acts as the valid next-hop for the aggregated network connection termination device 61.
  • Border Gateway Protocol BGP
  • OSPF Open Shortest Path
  • Aggregated network connections 70, 71 and 72 may provide access to client network nodes 67 connected to the network aggregation devices 63, 64 and 65 through the aggregated network connections 70, 71 and 72 to communications networks 74 accessible by the aggregated network connection termination device 61.
  • a client network node 67 may request data provided by an external/remote network resource 69 accessible through a communication network 74.
  • This request for the external/remote network resource may be routed over the network connection 73 providing access from the client network node 67 over the aggregated network connection 70 to its end point which is the aggregated network connection termination device 61. This may be done through the communication network 74 through the network connection 66 into the aggregated network connection termination device 61. Any data sent by the external/remote network resource 69 may be routed back through the aggregated network connection termination device.
  • a particular embodiment of this invention may use the Internet as the communication network 74 referenced in FIG 5.
  • the communication network 74 may alternatively be built by multiple sub-networks created through the use of multiple network aggregation devices 63, 64 and 65 with aggregated network connection termination device 61 end points through multiple network connections 66 and 68.
  • FIG 6 illustrates a method of providing redundancy and increased throughput through a plurality of network connections in an aggregated network connection.
  • the method 90 may begin with a step of configuring a plurality of network connections 91 through the creation of a network aggregation policy to form 92 the aggregated network connection.
  • the aggregated network connection may be initialized as per the network aggregation policy.
  • Control connections may be created 93 for the plurality of network connections configured as part of the aggregated connection to allow the aggregation engine 11 to manage the membership of a network connection within the aggregated connection.
  • the network aggregation engine 11 may accept packets for transmission 94 over the aggregated network connection 22.
  • the network aggregation engine 11 may choose a network connection 95 among the group of network connections configured 91 in the aggregate in the stored aggregation policy for transmission of the current packet being transmitted.
  • the choice of network connection for transmission of the current packet may be specified within the aggregation policy and may take into account data provided by the control connection built at 94.
  • a non-responsive network connection may be easily detected when using latency and packet loss as a measure.
  • the mechanism for detecting 96 and adapting to 97 the network connection change within an aggregated network connection may be implemented within the data transmission routine in the aggregation engine 11 or as a separate process in parallel to the transmission routine in the aggregation engine 11 to allow for further flexibility in provisioning redundancy within the aggregated network connection.
  • a single non-responsive network connection may not affect the aggregated network connection and may allow data transmission to continue regardless of the individual states of network connections so long as a single network connection within the aggregated network connection is available for data transmission.
  • FIGS. 7a and 7b illustrate network performance as discussed herein.
  • FIG. 7a illustrates performance with long haul effects.
  • FIG. 7b illustrates performance with reduction of long haul effects, based on the present invention in network conditions otherwise similar to those on which FIG. 7a is based.
  • FIG. 7b shows an improvement in performance over FIG. 7a, based on reduction of long haul effects in relatively long distance network communications are implemented using the network architecture.
  • the present invention therefore provides improved network performance relative to speed.
  • a skilled reader will appreciate that the improvement in performance shown in significant.
  • Other aspects of network performance are also improved, based on the present invention, for example latency.
  • the present invention significantly improves network performance between disparate locations by leveraging network bonding/aggregation technology, but by implementing a system, method and network configuration that provides intervening network components disposed adjacent to access points so as to manage traffic between two or more sites such that bonded/aggregated connections are terminated and traffic is directed to a network backbone, and optionally passed to one or more further bonded/aggregated connections associated with a remote additional site.
  • the network solutions of the present invention is flexible, responsive, scalable and easy to implement. New sites, optionally having their own CPE/concentrator can be easily added, and the network solution supports various types of multi-point network communications, and various network performance improvement strategies including various QoS techniques.
  • the network solution is easily updated with new programming or logic that is automatically distributed on a peer to peer basis based on the interoperation of network components that is inherent to their design, as previously described.
EP14832123.5A 2013-08-02 2014-07-31 System, vorrichtung und verfahren zur leistungsverbesserung von aggregierten/gebundenen netzwerkverbindungen zwischen entfernten standorten Withdrawn EP3028418A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13/958,009 US9264307B2 (en) 2008-11-12 2013-08-02 System, apparatus and method for providing improved performance of aggregated/bonded network connections between remote sites
PCT/CA2014/000595 WO2015013805A1 (en) 2013-08-02 2014-07-31 System, apparatus and method for providing improved performance of aggregated/bonded network connections between remote sites

Publications (2)

Publication Number Publication Date
EP3028418A1 true EP3028418A1 (de) 2016-06-08
EP3028418A4 EP3028418A4 (de) 2017-05-17

Family

ID=52430782

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14832123.5A Withdrawn EP3028418A4 (de) 2013-08-02 2014-07-31 System, vorrichtung und verfahren zur leistungsverbesserung von aggregierten/gebundenen netzwerkverbindungen zwischen entfernten standorten

Country Status (6)

Country Link
EP (1) EP3028418A4 (de)
CN (1) CN105453499B (de)
AU (1) AU2014295861B2 (de)
CA (1) CA2893548C (de)
HK (1) HK1223208A1 (de)
WO (1) WO2015013805A1 (de)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016009250A1 (en) * 2014-07-14 2016-01-21 Pismo Labs Technology Limited Methods and systems for transmitting data packets
GB2579759B (en) * 2014-07-14 2022-07-13 Pismo Labs Technology Ltd Methods and systems for evaluating network performance of an aggregated connection
CN105429885A (zh) * 2015-10-29 2016-03-23 中铁工程装备集团有限公司 一种自适应路由器的选择方法
CN105791462A (zh) * 2016-04-28 2016-07-20 锐捷网络股份有限公司 实现网络设备负载均衡的方法、系统和dhcp服务器
CN113115319A (zh) * 2021-04-13 2021-07-13 展讯通信(上海)有限公司 动态带宽扩容方法、装置及系统
CN117061405A (zh) * 2022-05-07 2023-11-14 中国移动通信有限公司研究院 报文处理方法、装置、客户终端设备、入网点及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6912592B2 (en) * 2001-01-05 2005-06-28 Extreme Networks, Inc. Method and system of aggregate multiple VLANs in a metropolitan area network
US7630412B2 (en) * 2003-08-07 2009-12-08 At&T Intellectual Property I, L.P. Methods and systems for aggregating Ethernet communications
US20060098573A1 (en) * 2004-11-08 2006-05-11 Beer John C System and method for the virtual aggregation of network links
US7903638B2 (en) * 2005-02-09 2011-03-08 Alcatel Lucent Communication link bonding apparatus and methods
US8155158B2 (en) * 2008-11-12 2012-04-10 Patricio Humberto Saavedra System, apparatus and method for providing aggregated network connections

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2015013805A1 *

Also Published As

Publication number Publication date
WO2015013805A1 (en) 2015-02-05
EP3028418A4 (de) 2017-05-17
AU2014295861B2 (en) 2015-10-22
CN105453499A (zh) 2016-03-30
CA2893548A1 (en) 2015-02-05
AU2014295861A1 (en) 2015-06-25
HK1223208A1 (zh) 2017-07-21
CA2893548C (en) 2016-09-13
CN105453499B (zh) 2017-06-30

Similar Documents

Publication Publication Date Title
US9264307B2 (en) System, apparatus and method for providing improved performance of aggregated/bonded network connections between remote sites
CA2743548C (en) System, apparatus and method for providing aggregated network connections
US11646964B2 (en) System, apparatus and method for providing a virtual network edge and overlay with virtual control plane
US20230224246A1 (en) System, apparatus and method for providing a virtual network edge and overlay with virtual control plane
US10523593B2 (en) System, apparatus and method for providing a virtual network edge and overlay
US9929964B2 (en) System, apparatus and method for providing aggregation of connections with a secure and trusted virtual network overlay
US9264350B2 (en) System, apparatus and method for providing improved performance of aggregated/bonded network connections with multiprotocol label switching
CA2893548C (en) System, apparatus and method for providing improved performance of aggregated/bonded network connections between remote sites
US20180013556A1 (en) System, apparatus and method for encrypting overlay networks using quantum key distribution
US10333832B2 (en) System, apparatus and method for providing improved performance of aggregated/bonded network connections with multiprotocol label switching
CA2912643A1 (en) System, apparatus and method for providing a virtual network edge and overlay with virtual control plane
CA2990045C (en) System, apparatus and method for providing a virtual network edge and overlay
AU2015258288B2 (en) System, apparatus and method for providing aggregated network connections
CA2863901C (en) System, apparatus and method for providing improved performance of aggregated/bonded network connections with multiprotocol label switching

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160129

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20170420

RIC1 Information provided on ipc code assigned before grant

Ipc: H04L 12/28 20060101ALI20170412BHEP

Ipc: H04L 12/803 20130101AFI20170412BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RIC1 Information provided on ipc code assigned before grant

Ipc: H04L 12/28 20060101ALI20180213BHEP

Ipc: H04L 12/64 20060101AFI20180213BHEP

INTG Intention to grant announced

Effective date: 20180309

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20180720