US10785117B2 - Methods and apparatus for configuring a standby WAN link in an adaptive private network - Google Patents
Methods and apparatus for configuring a standby WAN link in an adaptive private network Download PDFInfo
- Publication number
- US10785117B2 US10785117B2 US15/409,001 US201715409001A US10785117B2 US 10785117 B2 US10785117 B2 US 10785117B2 US 201715409001 A US201715409001 A US 201715409001A US 10785117 B2 US10785117 B2 US 10785117B2
- Authority
- US
- United States
- Prior art keywords
- path
- network
- paths
- apn
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 86
- 230000003044 adaptive effect Effects 0.000 title claims abstract description 42
- 238000012544 monitoring process Methods 0.000 claims abstract description 19
- 230000005540 biological transmission Effects 0.000 claims description 26
- 230000007704 transition Effects 0.000 claims description 9
- 238000013442 quality metrics Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 description 53
- 238000007726 management method Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 16
- 230000008859 change Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 11
- 230000003068 static effect Effects 0.000 description 8
- 238000013459 approach Methods 0.000 description 7
- 230000008901 benefit Effects 0.000 description 7
- 230000006399 behavior Effects 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 230000003466 anti-cipated effect Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000001413 cellular effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000011144 upstream manufacturing Methods 0.000 description 3
- 101100048435 Caenorhabditis elegans unc-18 gene Proteins 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 238000012550 audit Methods 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 2
- 230000000875 corresponding effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 230000002085 persistent effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004931 aggregating effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000013070 change management Methods 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000012854 evaluation process Methods 0.000 description 1
- 230000008713 feedback mechanism Effects 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000010200 validation analysis Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L1/00—Arrangements for detecting or preventing errors in the information received
- H04L1/0001—Systems modifying transmission characteristics according to link quality, e.g. power backoff
- H04L1/0002—Systems modifying transmission characteristics according to link quality, e.g. power backoff by adapting the transmission rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0823—Errors, e.g. transmission errors
- H04L43/0829—Packet loss
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0894—Packet rate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H04L61/6022—
-
- H04M1/72519—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2101/00—Indexing scheme associated with group H04L61/00
- H04L2101/60—Types of network addresses
- H04L2101/618—Details of network addresses
- H04L2101/622—Layer-2 addresses, e.g. medium access control [MAC] addresses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0813—Configuration setting characterised by the conditions triggering a change of settings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0823—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability
- H04L41/083—Configuration setting characterised by the purposes of a change of settings, e.g. optimising configuration for enhancing reliability for increasing network speed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0896—Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/12—Discovery or management of network topologies
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0888—Throughput
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/02—Topology update or discovery
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/02—Topology update or discovery
- H04L45/026—Details of "hello" or keep-alive messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/22—Alternate routing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/48—Routing tree calculation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/54—Organization of routing tables
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L45/00—Routing or path finding of packets in data switching networks
- H04L45/74—Address processing for routing
- H04L45/745—Address table lookup; Address filtering
- H04L45/7453—Address table lookup; Address filtering using hashing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/12—Avoiding congestion; Recovering from congestion
- H04L47/125—Avoiding congestion; Recovering from congestion by balancing the load, e.g. traffic engineering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/34—Flow control; Congestion control ensuring sequence integrity, e.g. using sequence numbers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
- H04L49/3063—Pipelined operation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
Definitions
- 2016-0179850 A1 entitled “Methods and Apparatus for Providing Adaptive Private Network Database Schema Migration and Management Processes”; U.S. patent application Ser. No. 14/973,193 filed on Dec. 17, 2015 and published as U.S. Patent Application No. 2016-0182327 A1 entitled “Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Data Visualization Processes”; U.S. patent application Ser. No. 14/973,343 filed on Dec. 17, 2015 and published as U.S. Patent Application No. 2016-0197802 A1 entitled “Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Time Correlated Playback of Network Traffic”;
- the present invention relates generally to improved management of networks having wide area network (WAN) links. More specifically, the present invention relates to improved techniques for configuring and operating a standby WAN link in the context of an adaptive private network (APN).
- WAN wide area network
- APN adaptive private network
- Wide area network (WAN) standards include, for example, digital subscriber line (DSL), asymmetric digital subscriber line (ADSL), and multiprotocol label switching (MPLS), to mention a few.
- WANs are used to connect local area networks (LANs) allowing devices in one location to communicate with devices and their users in other locations.
- LANs local area networks
- connections between the sites are many times statically configured.
- the dynamics of the network system may also change over time making repeated static configurations of the network inefficient and costly to implement.
- static connections involve reservations of network resources. As data flow patterns change in the network, the reserved resources create non-optimal static connections which cause the network to reserve bandwidth that could be better used elsewhere in the network.
- a site A is anticipated to have high bandwidth requirements for data transfer with site B and site C is anticipated to also have high bandwidth requirements for data transfer with site B. Since at the time the network is configured there may be little anticipated requirement for communication between site A and site C and since sites A and C can communicate to each other by going through site B, a communication path between sites A and C is not statically configured. With the network system operating over time, the original assumptions on communication paths will likely change. For example, sites A and C may require communication at a much higher bandwidth at this later time than is easily achieved by communicating through the intermediate site B thereby causing congestion on the paths between sites A and B and between sites B and C. A reconfiguration of the network is not usually feasible due to configuration overhead and lost time in operating the network.
- the present invention recognizes what is needed is a backup link that not only continues to maintain APN quality monitoring functions, but also is more cost effective than an active WAN link that does not carry user traffic.
- This backup preferrably provides adequate bandwidth in complex high performance networks to carry user traffic generally when all other WAN links are down and keeps bandwidth usage on these standby backup links as low as possible when they are standing by.
- the present invention addresses systems and techniques which configure a WAN link as a backup WAN link.
- An embodiment of the invention applies a method to monitor a standby WAN link for connectivity for paths between two or more locations.
- Another embodiment of the invention applies a method to monitor the health, for example, latency, jitter or the like, of a standby WAN link for paths between two or more locations.
- Another embodiment of the invention applies a method to monitor multiple standby WAN links allowing only one to be active between any two endpoints based on the connectivity and health of standby WAN link paths.
- Another embodiment applies a method for providing a backup network path using a standby WAN link with reduced monitoring.
- Packet loss and latency metrics are monitored for a plurality of network paths connecting a first user and a second user according to control traffic operating at a first control bandwidth for each network path of the plurality of network paths.
- a determination is made that a first network path selected from the plurality of network paths uses a user configured standby WAN link, has packet loss and latency metrics indicative of a good quality state, and has at least one characteristic that identifies the first network path as a candidate backup network path, wherein the first network path is marked as a backup network path and user data traffic is balanced among remaining network paths connecting the first user and the second user.
- Said control traffic is reduced for the backup network path to a second control bandwidth substantially less than the first control bandwidth that is used for each of the remaining network paths.
- the backup network path is selected as an active operating network path in response to determining the number of remaining network paths that are active has been reduced to less than or equal to a user configured minimum number.
- An adaptive private network is configured with a plurality of network paths including a plurality of regular WAN links and a plurality of standby WAN links connecting a first user and a second user.
- Network paths utilizing regular WAN links are assigned to a first group as regular network paths and network paths utilizing one standby WAN link to a second group as backup network paths.
- bandwidth and packet loss and latency metrics are determined for the plurality of network paths including the plurality of standby WAN links according to control traffic.
- a network path with the highest bandwidth among the one or more good quality state network paths is marked active, wherein one standby WAN link is selected from a plurality of standby WAN links.
- a further embodiment addresses a computer readable non-transitory medium storing a computer program which causes a computer system to perform a method for providing a backup network path using a standby WAN link with reduced monitoring. Packet loss and latency metrics are monitored for a plurality of network paths connecting a first user and a second user according to control traffic operating at a first control bandwidth for each network path of the plurality of network paths.
- the backup network path is selected as an active operating network path in response to determining the number of remaining network paths that are active has been reduced to less than or equal to a user configured minimum number.
- FIG. 1A illustrates an adaptive private network (APN) with APN network service paths in accordance with an embodiment of the present invention
- FIG. 1B illustrates an adaptive private network (APN) conduit two-ended service system between a client site A and a client site B in accordance with an embodiment of the present invention
- FIG. 1C illustrates exemplary factors used to determine the total end-to-end path delay in accordance with an embodiment of the present invention
- FIG. 2 illustrates an APN having an APN network control node (NCN) and sixteen APN conduits coupled to sixteen APN client sites in accordance with an embodiment of the present invention
- NPN network control node
- FIG. 3 A 1 illustrates an exemplary APN having a conduit between an APNA 1 at site 1 with two WAN links and an APNA 2 at site 2 with one WAN link in accordance with an embodiment of the present invention
- FIG. 3 A 2 illustrates an exemplary APN having a conduit between an APNA 1 at site 1 and an APNA 2 at site 2 that have eight unidirectional paths in accordance with an embodiment of the present invention
- FIG. 3B illustrates an exemplary path assignment process for the paths generated in FIG. 3 A 2 in accordance with an embodiment of the present invention
- FIG. 4 illustrates a path state machine in accordance with an embodiment of the present invention.
- FIG. 5 illustrates a conduit path state change process in accordance with an embodiment of the present invention.
- FIG. 1A illustrates an exemplary adaptive private network (APN) 100 having local sites 124 A1 , 124 A2 , . . . 124 AN , local sites 125 B1 , 125 B2 , . . . 125 BN , on local area networks, LAN 1 101 and LAN 2 103 , respectively, coupled to a wide area network (WAN) 102 under control of the APN showing service paths in accordance with an embodiment of the present invention.
- APN adaptive private network
- the APN 100 includes one or more wide area networks (WANs), such as WAN 102 , APN appliances (APNAs) 104 - 106 , WAN routers 110 1 - 110 3 , and network application services as well as APN conduits between the APNAs, as described in more detail below.
- WANs wide area networks
- APNAs APN appliances
- APNAs APN appliances
- WAN routers 110 1 - 110 3 WAN routers
- network application services as well as APN conduits between the APNAs, as described in more detail below.
- the APN is configured from a single APNA acting as a network control node (NCN) that provides a single point of control for the APN.
- NCN network control node
- An APN path also referred to as a regular path, is a logical connection established between two WAN links located at different geographic sites across a WAN where one WAN link sends traffic to the other WAN link. Since Paths are unidirectional entities having one sender and one receiver, two WAN links that are connected to each other will have two paths between them. Each WAN link sees one path as being its transmit path and the other as the receive path. A regular path is used to send user traffic under normal circumstances.
- An APN conduit is a virtual connection between two APN nodes, also referred to as client sites, and formed by aggregating one or more APN paths and their allocated WAN link resources.
- a conduit service is a logical combination of one or more paths.
- a conduit service is typically used for enterprise site-to-site intranet traffic, utilizing the full value of the APN. With a conduit service, depending on configuration, traffic is managed across multiple WAN links to create an end-to-end tunnel. The conduits overlay a virtual network on top of the underlying network.
- a conduit maximum transmission unit is defined as a minimum link MTU of the one or more APN paths in the conduit between a source site and a destination site.
- An APN appliance is a device that contains APN client site functionality including software modules which governs its participation in an APN.
- a high availability (HA) site contains two APNAs, one that is active and one that is in a standby mode of operation and available to become active in place of the other APNA if required.
- a WAN link represents a physical access point to the wide area network (WAN), such as a digital subscriber line (DSL) connection or a cable modem.
- WAN wide area network
- DSL digital subscriber line
- the distinctive characteristic of a WAN link is the bandwidth, or in other words, the amount of data capacity available for transmission and reception.
- WAN links can be shared among APN conduits, and intranet and Internet network services.
- the APN appliances do not directly attach to WAN links.
- APN appliances communicate with WAN links through logical connections, such as the WAN routers 110 1 - 110 3 of FIG. 1A .
- a regular WAN link is a WAN link configured in an active mode, which is the default mode for the WAN link.
- a private WAN link provides a physical access point to non-public WAN destinations.
- Examples of such private WAN links include an asynchronous transfer mode (ATM) link with an ATM virtual circuit, a frame relay link with a frame relay circuit, a multiprotocol label switching (MPLS) tunnel, a virtual private network (VPN) tunnel, or a leased point-to-point line.
- ATM asynchronous transfer mode
- MPLS multiprotocol label switching
- VPN virtual private network
- Connectivity on a network having a private WAN link is made to a private list of destinations on the other end of the network.
- a public WAN link represents a physical access point to the Internet. It can be assumed that any public WAN link can establish a connection to any other public WAN link.
- a local WAN link is an APN client site's access point to a WAN.
- a site A's LWL is coupled to a corresponding remote WAN link for a site B.
- site A's local WAN links are site B's remote WAN links.
- An Internet service is used for traffic between an enterprise site and sites on the public Internet. Internet traffic is not encapsulated.
- the APN manages bandwidth in the network by rate-limiting Internet traffic relative to traffic on a conduit taking into account the network configuration established by an administrator.
- An intranet service is used for any portion of enterprise intranet traffic that has not been defined for transmission across a conduit.
- the intranet traffic remains un-encapsulated, and the APN manages bandwidth in the network by rate-limiting the intranet traffic relative to other service types during times of congestion.
- traffic that ordinarily travels via a conduit may instead be treated as intranet traffic in order to maintain network reliability.
- conduit traffic is site-to-site, customers generally have a way to deliver this site-to-site traffic without the conduit.
- This un-encapsulated service called an intranet service, does not receive the benefits of the conduit. If the conduit tunnel cannot be brought up, then routes which use that conduit are ignored and this means that traffic that would have used the conduit are redirected to use an un-encapsulated site-to-site transport method.
- a routing domain represents a segmentation of a network. Traffic can only flow within one routing domain, not across routing domains. Separate routing domains may be set up based on segmentation of traffic within an enterprise for security reasons, as when a guest network should be fully segmented from an employee network. In another example, separate routing domains may be set up based on segmentation of traffic within an enterprise for manageability reasons, as when a large corporation organizes its network into distinct routing domains. Also, traffic within a very small aperture terminal (VSAT) satellite network may be segmented into separate routing domains to support multiple tenants at a client site. In a further example, traffic may be segmented within a managed service provider network to separately support multiple customer networks.
- VSAT very small aperture terminal
- a static conduit is a conduit configured in a configuration file and created at startup time of an APNA.
- a static conduit is not removed without changing the configuration file.
- a software application is an abstraction to allow flows to be grouped together.
- a criterion that is used to group flows together may vary depending on the intended use. Some organizations may want to group all flows that interact with a company's web domain, such as a sales domain by use of a software sales application, while other organizations may want to view the software sales application as an Internet web browsing application that also includes access to other domains.
- email is usually used extensively and is also generally considered very important, so it would be reasonable to view a product such as an email software manager as an application.
- the software sales application would include flows from an email software manager client as well as the email software manager web application web-page.
- a WAN application (WANapp) virtual machine is an optimization device, such as a device that provides one or a plurality of selectable compression algorithms that are applied to communication traffic.
- WCP web cache communication protocol
- An APN service is a set of processing steps performed on packets that are transmitted through the APN. As illustrated in FIG. 1A , data traffic that moves through the APN 100 and APN appliance 106 may require different types of services depending on where the sending and receiving stations are located.
- An APN service instance is a particular configured contextual instance of an APN service held in an APN appliance memory 107 internal to the APN appliance 106 , for example.
- An APN service instance's memory contains, but is not limited to, context specific configuration data, statistical data, and tracking states data.
- an APN client site may have multiple APN conduits that connect to remote APN client sites. For each APN conduit there exists a separate APN service instance for the APN conduit service type.
- An APN conduit service associated with path 112 manages network traffic packets that are transmitted through the APN 100 from the APN appliance 105 through router 110 1 , through the WAN 102 , through another router 110 3 to APN appliance (APNA) 104 .
- the APN conduit service for path 112 operates on both APN appliances 104 and 105 .
- the APN conduit service sends and receives data between a first geographic location that has the APNA 105 and a different geographic location that has the APNA 104 utilizing the full benefits provided by the APN conduit service for WAN resource allocation and network adaptation.
- an APN intranet service such as the one associated with path 112
- An APN Internet service associated with path 118 is used to send and receive data between a first geographic location that has the APNA 105 and a different geographic location that has the APNA 104 .
- traffic using the APN Internet service may be associated with a network user accessing a public Internet web server 122 .
- the path 118 has a first point in one of the local sites 125 B1 , 125 B2 , . . .
- the service path 118 begins at 125 B2 proceeds over LAN 2 103 to APNA 104 to a router 110 5 that connects to a high cost link 128 , such as a wireless satellite link, and then connects to WAN 102 to router 110 1 to APNA 105 to LAN 1 101 and to local site 124 A1 .
- the cost of using the high cost link between router 110 1 and 110 5 is much greater than that of using a lower cost link, such as path 112 connected between router 110 1 and 110 3 .
- a conduit comprises multiple paths.
- a path is formed between 2 WAN links associated with the conduit.
- Each path in each conduit in the APN is monitored for quality of communication by collecting quality metrics such as packet loss and latency. This monitoring is done by way of control messages and is done on each path whether the path is used to transmit user traffic or not. Accordingly, no path is completely free of traffic unless it is not operational. Since all paths within a conduit are being measured whether there is user traffic through the path or not, the conduit maintains up to date per-path metrics that are used by the APN to select the best network path to transmit user data.
- WAN links with high cost such as 4G cellular links, have been used as backup links. These high cost backup links are meant to be used only when all other links fail.
- the APN can be configured to avoid using these high cost backup links for user traffic
- the control traffic necessary to monitor the quality of paths using these high cost links is still necessary.
- the cost of operating these types of links even in standby is excessive.
- the control traffic consumes about ten gigabytes of usage per month per site.
- high cost links such as 4G cellular links
- a large network incurs a lot of expense.
- Replacing these high cost standby links with a standby WAN link as described herein significantly reduces the amount of data consumption for control traffic. In one case, this reduction amounted to a factor of twenty reduction in costs.
- Dynamic conduits address changes in statically configured networks that are not just slow, gradual changes in network usage, but are happening in real time throughout a day across a network which may be global. In real time, dynamic conduits dynamically optimize network performance adapting to changing communication patterns between nodes in the network. Dynamic conduits can also be used to offload traffic from intermediate nodes that may be experiencing congestion.
- An adaptive private network (APN) software product runs as a centralized management system within a virtual machine to create APN configurations and to monitor system resources, analyze system resources, and manage a configured APN in operation as addressed further herein.
- the centralized management system also includes capabilities that provide discovery, timestamp correlation, and database schema migration processes of the present invention.
- the APN software of the invention also referred to as APN virtual machine (VM) software, provides analysis and monitoring capabilities that are timely with respect to events to be tracked and monitored while the APN is in operation and provides storage for historical data as taught further herein.
- the APN system also referred to as an APN VM system, reduces the time to configure APN appliances and the number of errors that can occur in configuring a system, as well as, to provide detailed performance data correlated across the WAN.
- the APN system further allows a centralized virtual single point of control by a network control node (NCN) for a physical network in which the NCN provides system wide timing synchronization.
- NCN network control node
- the centralized single point of control is not limited to a central location within a network of nodes, may be at any point within the network, and may be coupled at a point that would be considered outside the boundary of a network. Centralized indicates the single point of control aspects of the APN as described further herein.
- An onboard configuration facility is a software component designed to plugin to the APN system of the invention and provide an APN configuration compiler, APN configuration editing capabilities, and to provide an ability to create and edit network maps that show nodes of the APN and conduits between the nodes.
- Each version of the APNA software produces a version of the onboard configuration facility that understands an object model and configuration options for that version of APNA software.
- the APN system supports installation of multiple concurrent onboard configuration facility plugins so that a single APN software version can manage a variety of APNA software configuration versions.
- Each version of APNA software, the appliance code is provided with a default version of the configuration facility, which is also referred to as a configuration plugin. Multiple configuration plugins may be installed. So, the term “onboard” is in reference to the configuration facility or “plugin” when it is running on the APN VM system or on an NCN.
- An onboard configuration editor is a component of the onboard configuration facility that represents an APN configuration as a hypertext markup language (HTML) tree and accepts changes to the APN configuration from a user.
- the onboard configuration editor is closely coupled with a configuration compiler to make changes to the configuration HTML tree.
- the onboard configuration editor also integrates with a network map facility to display site nodes in a visual map representation of the APN.
- An APN configuration file is a text file which describes a configuration of the APN. This configuration file serves as an input to the configuration compiler which generates registries for each APNA in the network.
- the configuration compiler is a software program, such as a JavaTM program, that can run on an APN system and converts an APN configuration file into either registries for use by APNAs or into an extensible markup language (XML) representation of the object model for use by the onboard configuration facility.
- JavaTM program such as a JavaTM program
- a configuration package is a software data file which contains the APN configuration file along with metadata.
- metadata includes the network maps that are derived from a specific APN configuration.
- An onboard configuration facility package comprises the onboard configuration facility in a format which can be installed onto the APN system.
- Adaptive private network appliance (APNA) settings are management settings that can be set directly on an APNA. These APNA settings include time parameters, such as for a time zone or time zones and for network time protocol (NTP) including an NTP server address, settings for a Netflow server, user authentication, simple network management protocol (SNMP), event handling, and periodic status reports. These APNA settings are generally not configurable through the APN configuration file. Rather, the APNA settings are managed on a network-wide basis through the APN controls and software of the invention.
- NTP network time protocol
- NTP network time protocol
- SNMP simple network management protocol
- a dashboard in the context of the APN system, is a user configurable display screen which may be customized to display a subset of items from the rest of the APN system. Multiple dashboards may be created with one being chosen as a default home screen for a particular user.
- Workspaces are a construct which allow a user to organize a set of objects, allowing the user to save and recreate a state of a management session. Workspaces are used in a similar manner to use of a “project” in a software integrated development environment (IDE) which collects a set of source code files and associated build scripts and resources such as help text and images to create a complex graphical application.
- IDE software integrated development environment
- WAN virtualization enables multiple WAN connections to replace individual private WAN connections, such as Internet WAN links, and perform bandwidth aggregation with improved performance while minimizing impact of WAN links with different or changing latency, jitter, and packet loss metrics.
- WAN optimization generally utilizes compression, caching, and other techniques to improve data transfers across a network.
- a flow is defined by an n-tuple comprising ⁇ IP source address, IP destination address, IP protocol number, transmission control protocol (TCP)/ user datagram protocol (UDP) source port, if the IP protocol is TCP or UDP, TCP/UDP destination port, if the IP protocol is TCP or UDP>.
- TCP transmission control protocol
- UDP user datagram protocol
- other items could be added to the tuple including: a differentiated services code port (DSCP) tag, a routing domain, and a service identifier, and the like.
- a flow is unidirectional. For example, if nodes A and B are communicating, there is a flow that represents traffic from A to B and a flow representing traffic from B to A.
- FIG. 1B illustrates an adaptive private network (APN) conduit two-ended service system 150 between an APN client site A 152 and an APN client site B 154 in accordance with an embodiment of the present invention.
- Each APN client site is also considered a node in the APN and contains a collection of software modules which govern its participation within the APN.
- the software modules for the APN client site A 152 and the APN client site B 154 include control plane modules 156 and 158 , WAN ingress processor modules 160 and 162 , WAN egress processor modules 164 and 166 , and node administrative and interface software program modules 168 and 170 , respectively. As illustrated in FIG.
- the WAN ingress processor modules 160 and 162 include conduit services 172 and 174
- WAN egress processor modules 164 and 166 include duplicate conduit services 176 and 178 .
- Intranet service, Internet service, and pass through service are also provided at each APN client site.
- Each APN service type, including conduit, intranet, Internet, and pass through service types, implements processes for each type of data traffic that is communicated to and from the WAN respectively.
- APN conduit traffic flows through the two APN client sites 152 and 154 as the traffic traverses the APN.
- WAN ingress processing module 162 of APN client site B 154 performs the WAN ingress conduit service processing 174 prior to transmitting the traffic 180 via the WAN 184 to the APN client site A 152 .
- WAN egress processor module 164 of the APN client site A 152 performs the WAN egress conduit service processing 176 prior to transmitting the traffic 180 to the node or nodes located on LAN 186 .
- the binding of one APN client site's WAN ingress conduit processing 174 to the peer APN client site's WAN egress conduit service processing 176 constitutes an APN conduit 188 in which traffic is actively monitored and managed across multiple WAN resources.
- the t 2 _apps 187 and 189 are control programs that run on each APNA communicating with other APNAs in the APN while forwarding user data.
- the APN is capable of using disparate asymmetric WAN links which frequently vary in behavior with respect to bandwidth, latency, jitter, packet loss and congestion over time.
- the APN can use an asymmetric DSL WAN link that transmits data at 512 kbps upstream to the WAN and 6 Mbps from the WAN through the public network combined with a private symmetric leased circuit T 1 WAN link that transmits data at 1544 kbps upstream and downstream and a cable broadband connection that transmits data at 312 kbps upstream to the WAN and 3 Mbps from the WAN to a peer having adequate aggregation bandwidth of these rates for a single transmission control protocol (TCP) file transfer session at a theoretical transmit rate of 2368 kbps and receive at 10544kbps or 10.544 Mbps.
- TCP transmission control protocol
- the actual rate would approach 90% of these rates. If the behavior of the connection was to change, for example the paths to the DSL link were to have dramatic levels of loss, the APN would, using its high frequency performance feedback mechanism, adapt the network to avoid or mitigate the issues by using alternative resources or attempting to recover from the loss.
- conduit paths are evaluated and the best available path is selected. Any paths currently in a path quality good state are eligible to be chosen first. If multiple paths are in a path quality good state, then an estimated end to end time is evaluated and compared for each path, and the path with the lowest end to end time is chosen. If no path is in path quality good state, then a path with the highest bandwidth path quality bad state is chosen.
- a “one way time” refers to the amount of time it takes for a packet to traverse a network from source to receiver. In the context of this invention, the one way time is measured by subtracting a receive time stamp from a WAN egress module 166 from the send time stamp from a WAN ingress module 160 , FIG. 1B .
- FIG. 1C illustrates exemplary factors 190 used to determine the total end-to-end path delay 191 in accordance with an embodiment of the present invention.
- the term “best one way time” refers to the lowest measured OWT for a particular packet on a particular path over a period of time.
- the evaluation process chooses one best path based on path latency which is calculated using a best one way time (BOWT) 192 , mean WAN jitter 193 , latency penalty for short term instability 194 and WAN link schedulers' queue delay times 195 and 196 , with additional preferential treatment referred to as impedance 197 applied to any prior primary path for the APN traffic flow, if a primary path exists.
- BOWT best one way time
- an exemplary formula for estimating total end-to-end path delay is the BOWT 192 +(mean WAN jitter 193 )+3*( ⁇ mean WAN jitter 193 ))+latency penalty 194 +local WAN link (LWL) scheduler queue delay 195 +remote WAN link (RWL) scheduler queue delay 196 +impedance 197 .
- the BOWT 192 , mean WAN jitter 193 , and latency penalty 194 are provided by a remote APN conduit state resulting from control messaging from the egress processor module 166 of FIG. 1B .
- the local WAN link scheduler queue delay 195 , remote WAN link scheduler queue delay 196 and impedance 197 are provided by the WAN ingress processor module 160 of FIG. 1B .
- U.S. Pat. No. 8,125,907 filed on Jun. 11, 2009 entitled “Flow-Based Adaptive Private Network with Multiple WAN-Paths” and incorporated by reference herein in its entirety provides further exemplary details of a presently preferred approach to timing and network control in an adaptive private network (APN) at col. 6, line 1-col. 19, line 27, for example.
- API adaptive private network
- APN path processing services are responsible for providing a means of communicating user data and control information from one APN node to another APN node across the network.
- user data and control information may be transmitted from the WAN ingress processor module 160 of one APN node across the WAN and received at the WAN egress processor module 166 , as shown for example in FIG. 1B .
- Exemplary APN path services which may suitably be provided are listed below:
- the APN client node uses timing data to adjust or calibrate a network time by using a linear algebraic calculation based on the slope-intercept form.
- y is the time at an APN control node, also referred to as a network control node (NCN)
- x is the client node local time
- b is the base offset between the two
- m is the rate of change of y versus x which is the slope.
- the slope is calculated by taking two samples over a pre-specified period and averaging the samples together.
- the base offset is calculated by taking the difference of the value between the network control point time and the client time, adjusted for one half round trip time (RTT).
- a path state represents the most current condition of the network path as determined by feedback received by the WAN egress APN node's path state monitoring process. As packets are received, the sequence numbers of the packets are tracked to see if any packets were lost in transit between the WAN ingress APN node and the WAN egress APN node.
- a method is used to trigger path state transitions that are biased toward more tolerance for loss in the short periods of packets received with substantially less tolerance of loss over longer periods.
- a unique aspect of this approach is the ability to track the path's packet loss thresholds over numerous durations nearly simultaneously and continually while still maintaining low processor overhead.
- This aspect is obtained through the universal path tagging of conduit traffic sent across the WAN with high resolution and highly synchronized APN time stamps to enable the highly predictive estimation of transmission latency and statistical variation of latency.
- a control plane module's path state monitoring service is used to detect packet loss and optimal paths for traffic to use across the APN. The result is an ability to detect a difference between occasional incidental short term network loss and long term persistent problems.
- the APN node's software modules at a client site are stored and operate in the same physical APN appliance; however, the modules may also exist in separate physical APN appliances in alternative embodiments.
- the methods described in connection with the embodiments disclosed herein may be embodied directly in one or more software modules executed by a processor and memory complex such as utilized in an adaptive private network (APN) appliance (APNA), a rack mounted processing device, a personal computer, a server, or the like, having one or more central processing unit devices.
- API adaptive private network
- the processor and memory complex may be configured to execute instructions that access data and operate on data under control of a software module program stored on a computer readable non-transitory storage medium either directly associated locally with the processor and memory complex, such as may be available through an instruction cache, or accessible through an I/O device.
- a software module may reside in a computer readable non-transitory storage medium which may include random access memory (RAM), flash memory, dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), read only memory (ROM), programmable read only memory (PROM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), hard disk, a removable disk, a CD-ROM, digital video disk (DVD), other types of removable disks, or any other suitable non-transitory storage medium.
- RAM random access memory
- DRAM dynamic random access memory
- SDRAM synchronous dynamic random access memory
- ROM read only memory
- PROM programmable read only memory
- EPROM erasable programmable read only memory
- EEPROM electrically erasable programmable read only memory
- hard disk a removable disk
- CD-ROM compact disc-read only memory
- DVD digital video disk
- DVD digital video disk
- An adaptive private network node contains software modules supporting participation in an adaptive private network.
- An APN node may exist in one or more APN appliances at a location.
- An APN node contains a collection of software modules executed by a processor and memory complex located in the APN node which govern the APN node's participation within an APN such as control plane modules 156 and 158 , WAN ingress processor modules 160 and 162 , and WAN egress processor modules 164 and 166 in FIG. 1B .
- the control plane module is responsible for controlling and participating in the control of the APN node in tandem with other APN nodes in the network.
- the WAN ingress processor module 160 may suitably be embodied as software and hardware components responsible for processing network traffic for transmission from a local area network (LAN) to a WAN.
- the WAN egress processor module 164 may suitably be embodied as software operating on hardware components, such as a processor and memory complex that is responsible for processing network traffic for transmission from a WAN to a LAN.
- WAN ingress and WAN egress processor modules are discussed in further detail below.
- the APN client site's control plane module 156 may suitably be embodied as software operating on hardware components, such as a processor and memory complex that utilizes the APN client site's WAN ingress processor module 160 and WAN egress processor module 164 as the means for transmitting and receiving APN node to APN node control data across the WAN.
- TAP Tapplication protocol
- the TAP is a protocol for messages that are sent through the WAN to allow processes outside of t 2 _app on different appliances to communicate with each other.
- TAP can be considered to operate as a point-to-point or Ethernet like device which, instead of receiving packets from physical media, receives the packets from a user program and instead of sending packets via the physical media, writes the packets to the user program.
- control programs that run on each APNA communicating with other APNAs in the APN while forwarding user data.
- the APN services on the APN client sites 152 and 154 are then restarted thus bringing the APN software node configuration into synchronization.
- FIG. 2 illustrates an APN 200 having an APN network control node (NCN) 202 coupled to conduit section 220 and sixteen APN conduit sections 221 - 236 coupled to sixteen APN client sites 204 - 219 , respectively, in accordance with an embodiment of the present invention.
- APN 200 is centrally configured.
- a network administrator configures the entire APN 200 through an APN configuration file that is processed by the NCN 202 .
- the NCN 202 then distributes the configuration settings to all client sites in the APN 200 .
- This method of configuring the APN 200 is intended to provide benefits to the administrator by providing a single point of configuration to the network.
- the central configuration also provides for additional configuration bandwidth optimization for the network, by doing a mapping of the APN resources and their initial allocations. Furthermore, the centralized configuration can provide information and warnings to the administrator as to the behavior of the configuration that may not be obvious or intended from the configuration, before loading the configuration onto a production network.
- Each of the sites 204 - 219 and primary NCN site 202 contains an APN appliance to provide APN functionality.
- the configuration of the APN 200 generally provides for connectivity between a site A, such as site 205 , and a site B, such as site 208 , where the connectivity from the site A's perspective is site A ⁇ LWL ⁇ “WAN” ⁇ RWL ⁇ site B.
- the connectivity from the site B's perspective is site B ⁇ LWL ⁇ “WAN” ⁇ RWL ⁇ site A.
- the WAN 201 represents allocated WAN link resources and APN selected paths.
- a conduit between a site A and a site B is formed by use of the conduit sections 222 and 225 and is a virtual connection between the corresponding site A and site B.
- the conduit includes a collection of paths and encompasses a path from a local WAN link (LWL) at site A ⁇ “WAN” ⁇ RWL at site B.
- LWL local WAN link
- APN conduits exist between the NCN and, for example, sixteen APN client sites as shown in FIG. 2 . It will be recognized that while sixteen APN sites are shown for purposes of illustration, a larger or smaller number of potential APN client sites may be suitably employed.
- Each APN conduit may have the unique configuration parameters tailored by an administrator for the particular needs of each geographic location associated with a particular APN.
- Any paths currently in a path quality good state are eligible to be chosen first. If multiple paths are in a path quality good state, then an estimated end to end time is evaluated and compared for each path, and the path with the lowest end to end time is chosen. If no path is in a path quality good state, then a path in a path quality bad state with the highest bandwidth is chosen. Bandwidth is re-balanced among paths in the group upon every path state change if the regular path group is active. However if a backup path group is active, only the path that is in the highest quality state and has the highest bandwidth is chosen.
- the sixteen client sites 204 - 219 of the exemplary APN 200 are generally located remotely from each other and may include geographically diverse client sites.
- a site would be defined as remote if the devices are physically in different locations such as different buildings, cities, states, time zones or countries.
- the primary NCN 202 may be located in a company's headquarters location in a first country with client sites 204 - 209 and client sites 217 - 219 also located in the first country.
- the other client sites 210 - 216 may be located in a second country.
- an APN appliance is a device that contains APN node functionality according to software modules, such as the control plane modules 156 and 158 , the WAN ingress processor modules 160 and 162 , and the WAN egress processor modules 164 and 166 , as described in more detail above with reference to FIG. 1B .
- the sixteen client sites 204 - 219 are coupled by conduit sections 221 - 236 , respectively, and the conduit sections may be connected together to provide a configurable virtual connection between two connected APN appliances at the client sites. It is noted that while sixteen client sites 204 - 219 are illustrated, an APN may support as many client sites as are required.
- a network control point (NCN) 202 of FIG. 2 is an administration point for the APN 200 .
- the NCN 202 resides within an APN node.
- An APN control node refers to an APN node that also performs as the network control point of the APN.
- an NCN resides in an appliance that is separate from an APN node and administers and controls the APN nodes within the APN.
- the NCN provides administrative and control functions to the APN, including but not limited to, distribution of configuration objects to APN client nodes and time synchronization to the APN.
- a dynamic conduit is a conduit created between APN clients when needed and can be removed when no longer needed, based on a configured first threshold and a configured second threshold.
- client site 205 can be configured with two local WAN links, one from a first network provider and one from a second network provider. Multiple conduits may be connected to site 205 which may be configured to use one or both of the local WAN links. In an exemplary scenario where all of the conduits that are connected to site 205 use both local WAN links, then when usage for either local WAN link passes the configured second threshold, creation of a dynamic conduit can be triggered.
- the first and second thresholds refer to bandwidth levels passing through an intermediate site.
- t 2 _app Software code referenced as t 2 _app provides processes that forward data traffic and control protocols related to conduits.
- the t 2 _app code currently comprises five directories control, forward, manage, platform_api, and common, though not limited to this number of directories.
- the control directory holds the code related to the control protocols used by t 2 _app for conduits.
- the forward directory contains the code that is responsible for moving packets through the system.
- the manage directory has code that deals with the management plane.
- the platform_api code is responsible for interfacing with the hardware and the common directory has code which is not specific to any of the other directories.
- An APN traffic flow is the administrator designation for network session traffic that is identified to a particular APN flow record.
- APN traffic flow requirements are administrator-configured requirements that govern an intended behavior of an APN as it pertains to an APN traffic flow.
- APN traffic flow requirements may comprise a persistent path flow requirement, a duplication flow requirement, and a reliable flow requirement.
- An APN flow record is held in the memory of an APN appliance.
- An APN flow record tracks a defined APN traffic flow, ensuring that the APN traffic flow's prior-configured requirements are followed.
- the APN flow record contains both the APN traffic flow requirements and the APN traffic flow's state. The requirements of a particular APN flow record are derived from the routes and service rules that the APN traffic flow matches.
- the state of APN flow record includes, but is not limited to, APN service type, APN service instance, information pertaining to the last APN path selected, current APN flow sequence number, time of last packet received, time of last packet transmitted, counts of number of packets and number of bytes processed, sets of pending packets for sequence reordering, sets of pending packets for fragmentation, and sets of historical records for packets previously processed.
- the control directory includes an APN memory subsystem, which is a distributed shared memory system that allows a data structure on one appliance to be pushed over a conduit to an appliance on another site.
- a conduit path manager deals with sending and receiving transmission quality reports (TQRs) between sites.
- TQRs are sent using the APN memory subsystem.
- a geographically diverse process handles a state machine controlling primary and secondary standby NCNs in geographically diverse regions.
- the t 2 _app also handles management of flows in the system. The flows are stored in a hash table and references are counted so that it is known when it is safe to free a flow data structure.
- the t 2 _app provides a time synchronization protocol that is implemented in each node of the APN system.
- the t 2 _app also provides a process for tracking of traffic usage on a WAN link. In particular, this tracking process includes a task that wakes up every 100 ms, for example, and examines the current allocation of bandwidth on a WAN link and compares it to the actual usage. The data provided by this tracking process allows the bandwidth to be adjusted regularly so that demand can be met.
- the t 2 _app also implements a versioning protocol that sites use to make sure they are compatible before bringing up a conduit. This protocol is leveraged to do a key exchange and to rotate encryption keys while the conduit is in operation.
- the t 2 _app also implements a high availability (HA) protocol between two appliances serving a site.
- HA high availability
- Various operations use customizable rules which are processed by the t 2 _app.
- the t 2 _app also processes routes by using a route_cache so that once a route has been looked up and determined, a hash based lookup can search for the route in a cache.
- route caches are local to a thread so that locking does not need to be done, resulting in fast route lookups.
- a version number is kept on the main route database and incremented anytime a change is made to the route table. This approach allows threads to detect when their route cache has data that is out of date.
- the manage directory provides for processes in the APNA supporting sending of commands to the t 2 _app to perform actions or retrieve information. These actions can include things like enabling or disabling paths or conduits, pinging an address, or notifications about changes to the system made by the management tools.
- a rich debug interface to t 2 _app is also provided.
- the t 2 _app also provides a way for applications external to the t 2 _app to send commands to a remote site through the conduit, which is used, for example by change management processes.
- the t 2 _app provides support for the NCN to distribute learned public IP addresses to other sites to enable client to client conduit communications when both clients are behind a network address translation (NAT) and the public IP address is not known in advance.
- NAT network address translation
- This mechanism uses the APN memory subsystem to distribute the messages.
- the t 2 _app further supports client operations to inform the NCN of their management IP address.
- a user interface on the NCN can be utilized to provide links to navigate to a client appliance.
- This approach also allows an APN VM system to discover the management IP addresses of all appliances in the network when it communicates with the NCN.
- the t 2 _app is configured according to a multi-threaded pipeline model, wherein each stage of processing is accomplished in a separate thread. The threads hand off packets to each other through queues.
- the multi-threaded architecture of t 2 _app allows platforms with multiple CPUs to spread the processing of a packet across the multiple CPUs, which allows performance of the t 2 _app to scale as more CPUs are made available.
- FIG. 3 A 1 illustrates an exemplary APN 300 having a conduit between an APNA 1 at site 1 302 with two WAN links and an APNA 2 at site 2 312 with one WAN link in accordance with an embodiment of the present invention.
- a conduit is a logical container of paths between two adaptive private network (APN) sites.
- a path is a unidirectional logical pathway along which packets flow from one WAN link to another.
- a path originates from one WAN link, goes through multiple routers in the WAN, which is, for example, a private multiprotocol label switching (MPLS) network or the public Internet, and terminates on another WAN link, generally at a remote location from the originating point.
- MPLS private multiprotocol label switching
- FIG. 3 A 1 four paths can be formed in the APN between site 1 and site 2 using three WAN links WL 1 305 , WL 2 307 , and WL 3 309 . These paths may be automatically generated by a configuration editor in the APN or manually created by a user of the APN.
- Four unidirectional paths in FIG. 3 A 1 are WL 1 to WL 3 , WL 2 to WL 3 , WL 3 to WL 1 , and WL 3 to WL 2 .
- an exemplary APN 350 is illustrated having a conduit between an APNA 1 at sitel 352 and an APNA 2 at site 2 362 that have eight unidirectional paths, WL 1 to WL 3 , WL 1 to WL 4 , WL 2 to WL 3 , WL 2 to WL 4 , WL 3 to WL 1 , WL 3 to WL 2 , WL 4 to WL 1 , and WL 4 to WL 2 , in accordance with an embodiment of the present invention.
- a WAN link that is configured for operation is by default active.
- a WAN link that is marked as standby within the APN configuration editor, by the user for example, is a standby WAN link.
- a backup path is a path that is formed using one or two standby WAN links. User communication traffic is controlled to not flow on a backup path or paths when the backup path or paths are not designated as active. When there is more than one backup path in a group of backup paths and the backup path group is active, only one backup path is designated as active and used to transmit the user communication traffic. The other backup paths in the group remain in a standby state. For example, in FIG. 3 A 2 , if WL 2 and WL 4 are configured as standby, the paths in the APN 350 form into three groups. A path from WL 1 to WL 3 becomes part of path group 0 and is considered a regular path.
- a path from WL 1 to WL 4 and a path from WL 2 to WL 3 become part of path group 1 and are considered backup paths.
- a path from WL 2 to WL 4 becomes part of path group 2 and is considered a backup path.
- a path from WL 3 to WL 1 becomes part of path group 0 and is considered a regular path.
- a path from WL 3 to WL 2 and a path from WL 4 to WL 1 become part of the path group 1 and are considered backup paths.
- a path from WL 4 to WL 2 is part of path group 2 and is considered a backup path.
- FIG. 3B illustrates an exemplary path assignment process 320 for the paths generated in FIG. 3 A 2 in accordance with an embodiment of the present invention.
- a network configuration may have, for example, the WAN link configuration of FIG. 3 A 2 having two WAN links, such as WL 2 357 and WL 4 363 configured as standby.
- network paths in conduits identified by the configuration are generated.
- the generated paths are monitored at the same control messaging rate before instantiating any of the configured standby WAN links.
- an assignment process is started to select a generated path, which may include zero, one, or more instantiated standby WAN links, and assign the selected path to a group.
- a determination is made whether the WAN links in the selected network path are configured as active. In the four WAN link example of FIG. 3 A 2 , two WAN links are used per unidirectional path, such as the path from WL 1 to WL 3 in path group 0, the path from WL 2 to WL 3 in path group 1, the path from WL 1 to WL 4 also in path group 1, and the path from WL 2 to WL 4 in path group 2, as described above. For this example, a determination is made at step 330 whether both WAN links are configured as active.
- step 332 the path is assigned to group 0. The process 320 then proceeds to step 340 .
- step 334 a determination is made whether one or more of the WAN links in the selected path are configured as standby. If the WAN links in the generated path are both configured as standby, such as standby WL 2 357 and standby WL 4 363 in the path WL 2 357 to WL 4 363 per the example of FIG. 3 A 2 , the process 320 proceeds to step 336 . At step 336 , the generated path is assigned to group 2.
- step 340 The process 320 then proceeds to step 340 .
- step 334 if the WAN links in the generated path are not both configured as standby, such as the path from active WL 1 355 to standby WL 4 363 per the example of FIG. 3 A 2 , the process 320 proceeds to step 338 .
- step 338 the path is assigned to group 1.
- the process 320 then proceeds to step 340 .
- step 340 a determination is made whether all generated paths have been assigned. If all paths have not been assigned, the process 320 proceeds to step 342 .
- step 342 a next generated path is selected and the process 320 proceeds to step 330 to continue the path group assignment process.
- FIG. 4 illustrates a path state machine 400 in accordance with an embodiment of the present invention.
- Paths when not disabled, are in a dead, a bad, or a good state.
- a path in a dead state cannot carry any user traffic.
- a path in either a good or bad state can carry user traffic.
- a path is in a bad state when packet loss on the path exceeds a certain threshold or when no packets have been received for a period of time.
- the good state may also have sub-state levels of varying degrees of stability, packet loss and the like, however a path in a good state is considered a better quality path than a path in a bad state.
- the path transitions 410 to a dead state 402 .
- the path transitions 412 from the dead state 402 to a bad state 404 .
- the path transitions 416 from the bad state 404 to a good state 406 .
- the path transition 414 from the bad state 404 back to the dead state 402 .
- Paths in the good state 406 are monitored and if no packets are received for a pre-specified quiet threshold period (t q ), a no packet received for t q event, the path state machine transitions 418 from the good state 406 to the bad state 404 . For paths that exceed a packet loss threshold, a packet loss exceeds a threshold event, the path state machine also transitions 418 from the good state 406 to the bad state 404 .
- every path in the APN is sent heartbeat messages at fifty msec. intervals when a path is in the good state, at twenty five msec. intervals when a path is in the bad state, and at two hundred and fifty five msec. intervals when a path is considered in the dead state.
- heartbeat messages are considered exemplary and not limiting. Other time period intervals may be selected.
- other types of control traffic may also be transmitted on the paths in the APN. Such control traffic incurs an operational cost above the cost of transmitting user traffic. Such operational cost is reduced, and many times systems exhibit a significant cost reduction, by use of the standby WAN links according to embodiments as described herein.
- a path with a standby WAN link and at least one active WAN link that is up, backup paths are inactive and do not carry user traffic.
- the only type of control traffic that is allowed on inactive backup paths are the heartbeat messages.
- the heartbeat interval on backup paths is pre-specified as one second, as a default setting, and can be changed by a user. A maximum interval is considered one minute.
- a regular path group typically multiple paths are used to carry user traffic.
- a backup path group becomes active because, in one embodiment, all active WAN links in the conduit are down, only one backup path in the group becomes active, for example the backup path that has the highest state and highest bandwidth, becomes active and carries user traffic.
- This active backup path begins to use the same heartbeat message intervals as the regular paths and all control traffic is allowed on this path.
- Other backup paths remain in standby utilizing a heartbeat message interval at reduced backup interval settings, as noted in an example above.
- a selection criteria, used to choose which backup path to make active depends on quality metrics and bandwidth associated with the paths. These quality metrics are the attributes of all paths in APN.
- This approach advantageously reduces the bandwidth consumption on a backup path by a factor of 20 or more when a standby WAN link is inactive. Even when a standby WAN link is active, i.e. when a backup path is active, this approach keeps the bandwidth consumption at a minimum by only turning one backup path active and keeping other backup paths in standby.
- FIG. 5 illustrates a conduit path state change process 500 in accordance with an embodiment of the present invention.
- path states of the generated paths in a selected conduit of the APN are monitored for bandwidth and packet loss, latency, and other characteristics useful in determining a path quality state at a specified monitoring bandwidth associated with each of the generated paths to determine each path's current operating state.
- the current operating state of each path is examined in comparison with prior path operating state to determine that a path state change has occurred.
- a determination is made whether there is at least one path in group 0 that can carry traffic. If there is at least one path in group 0 that can carry traffic, the process 500 proceeds to step 508 .
- the regular path group 0 is marked as active.
- bandwidth is balanced among paths in the selected conduit.
- a path's bandwidth is a share of the bandwidth the WAN link's conduit is allowed to use. The share is configured in the APN configuration file.
- the conduit bandwidth is the sum of the bandwidths across the WAN links it uses.
- among the paths in the selected conduit paths that are in good state and have bandwidth exceeding a certain minimum value are marked preferred.
- Preferred paths are used by the forwarding plane to transmit user traffic. A path with less than the minimum required bandwidth is not considered in a GOOD state. Paths that are in a GOOD state and not marked preferred are used by user traffic, but they are not used for most control messages.
- the path that has the shortest latency is selected as the reference path for specific control traffic, such as time synchronization control messages.
- conduit state is processed and the process 500 returns to a calling program.
- the conduit state is a reflection of the state of paths making up the conduit.
- a BAD conduit means that all paths in the conduit are in a BAD or worse state.
- a GOOD conduit means that at least one path is in a GOOD state.
- Software processes determine the current conduit state based on the states of the paths that are active. This determination can lead to events being issued that reflect state changes if the conduit state changes.
- the amount of aggregate bandwidth that is available to the conduit is calculated across all active WAN links. After the aggregate bandwidth is calculated, associated schedulers are updated to reflect that bandwidth value. This calculation could also trigger transmission quality report (TQR) messages to the far end of the conduit to reflect the current path and conduit states.
- TQR transmission quality report
- a user specified minimum number may be used for determining when a backup path is activated which might be important in conduits having high data traffic. It is noted that the user specified minimum number is not limited to the numbers 0 or 1 as described herein.
- step 506 if there are no paths in group 0 that can carry traffic or in the further embodiment the #netpathsActiveInGroup0 ⁇ (user configured minimum number), the process 500 proceeds to step 520 .
- step 520 a determination is made whether there is at least one path in group 1 that can carry traffic. If there is at least one path in group 1 that can carry traffic, the process 500 proceeds to step 530 .
- step 530 having determined that at least one path in group 1 is active, then the path group 1 is marked as active. If there are no paths in group 1 that can carry traffic, the process 500 proceeds to step 522 .
- step 522 a determination is made whether there is at least one path in group 2 that can carry traffic.
- step 500 proceeds to step 524 .
- step 524 all paths in the selected conduit are marked as dead.
- step 526 the selected conduit is marked as dead and the user is alerted that the selected conduit is down.
- step 525 if there is at least one path in group 2 that can carry traffic, the process 500 proceeds to step 525 .
- the path group 2 is marked as active.
- step 534 a determination is made whether there is at least one good path in the active path group 1 or 2. If there is at least one good path in the active path group 1 or 2, the process 500 proceeds to step 536 .
- step 536 among all of the good paths in the active path group 1 or 2, the path with the highest bandwidth is marked as a reference path which is used for specific control traffic, such as time synchronization control messages. The process 500 then proceeds to step 540 .
- step 538 if there is not at least one good path in the active path group 1 or 2, the process 500 proceeds to step 538 .
- step 538 among the remaining bad paths in the selected conduit, the path with the highest bandwidth is marked as a reference path which is used for specific control traffic, such as time synchronization control messages.
- the process 500 then proceeds to step 540 .
- step 540 path bandwidth for remaining non-reference paths is adjusted to have minimum bandwidth. In this state with only BAD paths available, only user traffic is placed on the reference path. Setting the non-reference BAD paths to the minimum reservation means the process 500 is not reserving bandwidth that will not be used.
- step 540 the process 500 proceeds to step 516 .
- step 516 conduit state is processed and the process 500 returns to the calling program. All preferred paths in group 0, as determined at step 512 , are used to carry user traffic. Depending on conduit path state changes, only 1 active path in group 1 or in group 2 is used to carry user traffic.
- the backup path that is selected as the reference path becomes active and is specified with the same heartbeat interval as a regular path and all control traffic is allowed on this active backup path.
- the activity is switched from group 1 or 2 to group 0, all backup paths are inactive and have the reduced backup heartbeat interval. No other control traffic is allowed on inactive backup paths.
- Any activity switch between path groups triggers re-calculation of conduit maximum transmission unit (MTU). When calculating the conduit's MTU, only the MTU of active paths are considered.
- MTU conduit maximum transmission unit
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Quality & Reliability (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
Abstract
Description
-
- A dynamic conduit is a conduit created between APN clients when needed and which can be removed when no longer needed.
Claims (6)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/409,001 US10785117B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
US16/916,053 US11108677B2 (en) | 2016-01-19 | 2020-06-29 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
Applications Claiming Priority (21)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/482,766 US8125907B2 (en) | 2008-06-12 | 2009-06-11 | Flow-based adaptive private network with multiple WAN-paths |
US13/208,825 US8452846B2 (en) | 2010-08-12 | 2011-08-12 | Adaptive private network asynchronous distributed shared memory services |
US13/353,693 US8274891B2 (en) | 2008-06-12 | 2012-01-19 | Flow-based adaptive private network with multiple WAN-paths |
US13/592,460 US8644164B2 (en) | 2008-06-12 | 2012-08-23 | Flow-based adaptive private network with multiple WAN-paths |
US13/719,433 US9069727B2 (en) | 2011-08-12 | 2012-12-19 | Adaptive private network with geographically redundant network control nodes |
US13/850,411 US8775547B2 (en) | 2010-08-12 | 2013-03-26 | Adaptive private network asynchronous distributed shared memory services |
US14/019,723 US9584407B2 (en) | 2011-08-12 | 2013-09-06 | Adaptive private network with path maximum transmission unit (MTU) discovery process |
US14/146,786 US9100338B2 (en) | 2008-06-12 | 2014-01-03 | Flow-based adaptive private network with multiple WAN-paths |
US14/291,776 US9392061B2 (en) | 2009-06-11 | 2014-05-30 | Adaptive private network asynchronous distributed shared memory services |
US14/481,335 US10826839B2 (en) | 2011-08-12 | 2014-09-09 | Adaptive private network with dynamic conduit process |
US14/972,514 US10698923B2 (en) | 2009-06-11 | 2015-12-17 | Methods and apparatus for providing adaptive private network database schema migration and management processes |
US14/973,343 US9813315B2 (en) | 2009-06-11 | 2015-12-17 | Methods and apparatus for providing adaptive private network centralized management system time correlated playback of network traffic |
US14/972,270 US10476765B2 (en) | 2009-06-11 | 2015-12-17 | Methods and apparatus for providing adaptive private network centralized management system discovery processes |
US14/972,353 US10320635B2 (en) | 2009-06-11 | 2015-12-17 | Methods and apparatus for providing adaptive private network centralized management system timestamp correlation processes |
US14/973,193 US10333808B2 (en) | 2009-06-11 | 2015-12-17 | Methods and apparatus for providing adaptive private network centralized management system data visualization processes |
US201662280381P | 2016-01-19 | 2016-01-19 | |
US201662280448P | 2016-01-19 | 2016-01-19 | |
US201662280356P | 2016-01-19 | 2016-01-19 | |
US201662371998P | 2016-08-08 | 2016-08-08 | |
US201662372021P | 2016-08-08 | 2016-08-08 | |
US15/409,001 US10785117B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/916,053 Continuation US11108677B2 (en) | 2016-01-19 | 2020-06-29 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170207996A1 US20170207996A1 (en) | 2017-07-20 |
US10785117B2 true US10785117B2 (en) | 2020-09-22 |
Family
ID=68464350
Family Applications (7)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/409,006 Active 2037-07-18 US10200251B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for accessing selectable application processing of data packets in an adaptive private network |
US15/409,019 Active 2037-05-10 US10447543B2 (en) | 2009-06-11 | 2017-01-18 | Adaptive private network (APN) bandwith enhancements |
US15/409,016 Active 2037-01-29 US10348571B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for accessing dynamic routing information from networks coupled to a wide area network (WAN) to determine optimized end-to-end routing paths |
US15/409,001 Active US10785117B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
US16/523,997 Active US10924380B2 (en) | 2016-01-19 | 2019-07-26 | Adaptive private network (APN) bandwidth enhancements |
US16/916,053 Active US11108677B2 (en) | 2016-01-19 | 2020-06-29 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
US17/100,385 Active 2037-03-02 US11575605B2 (en) | 2016-01-19 | 2020-11-20 | Adaptive private network (APN) bandwidth enhancements |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/409,006 Active 2037-07-18 US10200251B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for accessing selectable application processing of data packets in an adaptive private network |
US15/409,019 Active 2037-05-10 US10447543B2 (en) | 2009-06-11 | 2017-01-18 | Adaptive private network (APN) bandwith enhancements |
US15/409,016 Active 2037-01-29 US10348571B2 (en) | 2009-06-11 | 2017-01-18 | Methods and apparatus for accessing dynamic routing information from networks coupled to a wide area network (WAN) to determine optimized end-to-end routing paths |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/523,997 Active US10924380B2 (en) | 2016-01-19 | 2019-07-26 | Adaptive private network (APN) bandwidth enhancements |
US16/916,053 Active US11108677B2 (en) | 2016-01-19 | 2020-06-29 | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
US17/100,385 Active 2037-03-02 US11575605B2 (en) | 2016-01-19 | 2020-11-20 | Adaptive private network (APN) bandwidth enhancements |
Country Status (1)
Country | Link |
---|---|
US (7) | US10200251B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10924380B2 (en) | 2016-01-19 | 2021-02-16 | Talari Networks Incorporated | Adaptive private network (APN) bandwidth enhancements |
US11483228B2 (en) | 2021-01-29 | 2022-10-25 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for network testing using an emulated data center environment |
US11799793B2 (en) | 2012-12-19 | 2023-10-24 | Talari Networks Incorporated | Adaptive private network with dynamic conduit process |
Families Citing this family (114)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8125907B2 (en) | 2008-06-12 | 2012-02-28 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US10749711B2 (en) | 2013-07-10 | 2020-08-18 | Nicira, Inc. | Network-link method useful for a last-mile connectivity in an edge-gateway multipath system |
US10454714B2 (en) | 2013-07-10 | 2019-10-22 | Nicira, Inc. | Method and system of overlay flow control |
US11044153B1 (en) * | 2018-03-07 | 2021-06-22 | Amdocs Development Limited | System, method, and computer program for damping a feedback load-change in a communication network managed by an automatic network management system |
US10135789B2 (en) | 2015-04-13 | 2018-11-20 | Nicira, Inc. | Method and system of establishing a virtual private network in a cloud service for branch networking |
US10425382B2 (en) | 2015-04-13 | 2019-09-24 | Nicira, Inc. | Method and system of a cloud-based multipath routing protocol |
US10498652B2 (en) | 2015-04-13 | 2019-12-03 | Nicira, Inc. | Method and system of application-aware routing with crowdsourcing |
US10038632B2 (en) * | 2015-07-23 | 2018-07-31 | Netscout Systems, Inc. | AIA enhancements to support L2 connected networks |
US10541900B2 (en) * | 2016-02-01 | 2020-01-21 | Arista Networks, Inc. | Hierarchical time stamping |
US9813299B2 (en) * | 2016-02-24 | 2017-11-07 | Ciena Corporation | Systems and methods for bandwidth management in software defined networking controlled multi-layer networks |
KR102568436B1 (en) * | 2016-07-28 | 2023-08-21 | 삼성전자 주식회사 | Method and apparatus for transmitting the data |
US10972437B2 (en) | 2016-08-08 | 2021-04-06 | Talari Networks Incorporated | Applications and integrated firewall design in an adaptive private network (APN) |
KR102532645B1 (en) * | 2016-09-20 | 2023-05-15 | 삼성전자 주식회사 | Method and apparatus for providing data to streaming application in adaptive streaming service |
US10681128B2 (en) * | 2016-10-12 | 2020-06-09 | Cisco Technology, Inc. | Deterministic stream synchronization |
CN106488518B (en) * | 2016-11-16 | 2020-01-21 | 广东新岸线计算机系统芯片有限公司 | Method for realizing user data continuous transmission under multi-cell switching |
US10992568B2 (en) | 2017-01-31 | 2021-04-27 | Vmware, Inc. | High performance software-defined core network |
US11252079B2 (en) | 2017-01-31 | 2022-02-15 | Vmware, Inc. | High performance software-defined core network |
US11121962B2 (en) | 2017-01-31 | 2021-09-14 | Vmware, Inc. | High performance software-defined core network |
US10992558B1 (en) | 2017-11-06 | 2021-04-27 | Vmware, Inc. | Method and apparatus for distributed data network traffic optimization |
US11706127B2 (en) | 2017-01-31 | 2023-07-18 | Vmware, Inc. | High performance software-defined core network |
US20200036624A1 (en) | 2017-01-31 | 2020-01-30 | The Mode Group | High performance software-defined core network |
US20180219765A1 (en) | 2017-01-31 | 2018-08-02 | Waltz Networks | Method and Apparatus for Network Traffic Control Optimization |
CN106878186B (en) | 2017-02-04 | 2019-11-29 | 华为技术有限公司 | The method of routing update, the network equipment and system in network |
US10574528B2 (en) | 2017-02-11 | 2020-02-25 | Nicira, Inc. | Network multi-source inbound quality of service methods and systems |
US10778528B2 (en) | 2017-02-11 | 2020-09-15 | Nicira, Inc. | Method and system of connecting to a multipath hub in a cluster |
FR3065853B1 (en) * | 2017-04-27 | 2019-06-07 | Peugeot Citroen Automobiles Sa | METHOD AND DEVICE FOR CONTROLLING THE TRANSMISSION OF DATA FROM A VEHICLE TO A COMMUNICATION EQUIPMENT |
US10326663B2 (en) * | 2017-06-02 | 2019-06-18 | Cisco Technology, Inc. | Fabric-wide bandth management |
US10523539B2 (en) | 2017-06-22 | 2019-12-31 | Nicira, Inc. | Method and system of resiliency in cloud-delivered SD-WAN |
CN109428742B (en) * | 2017-08-22 | 2020-12-15 | 华为技术有限公司 | Delay transmission path control method, network controller and system |
US10959098B2 (en) | 2017-10-02 | 2021-03-23 | Vmware, Inc. | Dynamically specifying multiple public cloud edge nodes to connect to an external multi-computer node |
US11115480B2 (en) | 2017-10-02 | 2021-09-07 | Vmware, Inc. | Layer four optimization for a virtual network defined over public cloud |
US10999165B2 (en) | 2017-10-02 | 2021-05-04 | Vmware, Inc. | Three tiers of SaaS providers for deploying compute and network infrastructure in the public cloud |
US11089111B2 (en) | 2017-10-02 | 2021-08-10 | Vmware, Inc. | Layer four optimization for a virtual network defined over public cloud |
US11005684B2 (en) | 2017-10-02 | 2021-05-11 | Vmware, Inc. | Creating virtual networks spanning multiple public clouds |
US10999100B2 (en) | 2017-10-02 | 2021-05-04 | Vmware, Inc. | Identifying multiple nodes in a virtual network defined over a set of public clouds to connect to an external SAAS provider |
US11032183B2 (en) * | 2017-10-06 | 2021-06-08 | Nicira, Inc. | Routing information validation in SDN environments |
US10986075B2 (en) * | 2017-11-02 | 2021-04-20 | Arista Networks, Inc. | Distributing packets across processing cores |
US11223514B2 (en) * | 2017-11-09 | 2022-01-11 | Nicira, Inc. | Method and system of a dynamic high-availability mode based on current wide area network connectivity |
JP7309738B2 (en) * | 2017-11-21 | 2023-07-18 | タラリ・ネットワークス・インコーポレイテッド | Intelligent Write Protection Cache (IWPC) in Adaptive Private Networks (APNs) |
WO2019111154A1 (en) * | 2017-12-04 | 2019-06-13 | Telefonaktiebolaget Lm Ericsson (Publ) | Network link verification |
US11509540B2 (en) * | 2017-12-14 | 2022-11-22 | Extreme Networks, Inc. | Systems and methods for zero-footprint large-scale user-entity behavior modeling |
US20190036772A1 (en) * | 2017-12-28 | 2019-01-31 | Intel Corporation | Intelligent wireless configuration for iot devices |
EP3745659A4 (en) * | 2018-02-13 | 2020-12-09 | Huawei Technologies Co., Ltd. | Routing method and apparatus |
US10942788B2 (en) | 2018-06-15 | 2021-03-09 | Vmware, Inc. | Policy constraint framework for an sddc |
US10812337B2 (en) | 2018-06-15 | 2020-10-20 | Vmware, Inc. | Hierarchical API for a SDDC |
US10972387B2 (en) * | 2018-06-16 | 2021-04-06 | Versa Networks, Inc. | Application performance based path-selection using dynamic metrics |
CN113285882B (en) * | 2018-08-30 | 2024-01-09 | 华为技术有限公司 | Message processing method, device and related equipment |
CN110278152B (en) * | 2018-08-31 | 2020-05-29 | 新华三信息安全技术有限公司 | Method and device for establishing fast forwarding table |
CN111106865B (en) | 2018-10-25 | 2021-12-14 | 华为技术有限公司 | Communication method, device and system based on satellite network |
CN109547244A (en) * | 2018-11-16 | 2019-03-29 | 郑州云海信息技术有限公司 | A kind of QoS read-write on client side band width configuration method and terminal based on NFS system |
US10951529B2 (en) * | 2018-12-13 | 2021-03-16 | Fortinet, Inc. | Dynamic service-based load balancing in a software-defined wide area network (SD-WAN) |
US11818412B2 (en) * | 2018-12-28 | 2023-11-14 | Dish Network L.L.C. | Methods and systems for supplementing set-top box processing with additional processor resources |
US11336482B2 (en) * | 2019-01-31 | 2022-05-17 | Juniper Networks, Inc. | Policy-driven on-demand tunnel creation/deletion based on traffic information in a wide area network (WAN) |
US11431829B2 (en) | 2019-03-06 | 2022-08-30 | Parsons Corporation | Multi-tiered packet processing |
US11438243B2 (en) * | 2019-04-12 | 2022-09-06 | EMC IP Holding Company LLC | Adaptive adjustment of links per channel based on network metrics |
US11563601B1 (en) * | 2019-08-22 | 2023-01-24 | Juniper Networks, Inc. | Proactive tunnel configuration computation for on-demand SD-WAN tunnels |
US11171885B2 (en) | 2019-08-27 | 2021-11-09 | Vmware, Inc. | Providing recommendations for implementing virtual networks |
CN110601888B (en) * | 2019-09-10 | 2020-11-06 | 清华大学 | Deterministic fault detection and positioning method and system in time-sensitive network |
CN110635968A (en) * | 2019-09-27 | 2019-12-31 | 深信服科技股份有限公司 | Monitoring method, device and equipment for stacked double-active detection channel and storage medium |
US11082304B2 (en) * | 2019-09-27 | 2021-08-03 | Oracle International Corporation | Methods, systems, and computer readable media for providing a multi-tenant software-defined wide area network (SD-WAN) node |
US11044190B2 (en) | 2019-10-28 | 2021-06-22 | Vmware, Inc. | Managing forwarding elements at edge nodes connected to a virtual network |
US11222164B2 (en) * | 2019-11-22 | 2022-01-11 | International Business Machines Corporation | Adding custom content to an existing documentation suite |
US11489783B2 (en) | 2019-12-12 | 2022-11-01 | Vmware, Inc. | Performing deep packet inspection in a software defined wide area network |
US11394640B2 (en) | 2019-12-12 | 2022-07-19 | Vmware, Inc. | Collecting and analyzing data regarding flows associated with DPI parameters |
US12041479B2 (en) | 2020-01-24 | 2024-07-16 | VMware LLC | Accurate traffic steering between links through sub-path path quality metrics |
US11323918B2 (en) * | 2020-01-24 | 2022-05-03 | Cisco Technology, Inc. | Switch and backhaul capacity-based radio resource management |
CN111314148B (en) * | 2020-02-26 | 2021-06-01 | 卡斯柯信号有限公司 | Redundant network IP intelligent switching method and system based on redundant computer |
US11190434B2 (en) * | 2020-03-16 | 2021-11-30 | Cisco Technology, Inc. | Systems and methods for protective proactive adaptive active bandwidth measurement in SD-WAN networks |
US11356369B1 (en) * | 2020-03-31 | 2022-06-07 | Juniper Networks, Inc. | Border gateway protocol update packing for a distributed routing information base |
EP4078901A4 (en) | 2020-04-01 | 2023-10-11 | VMWare, Inc. | Auto deploying network elements for heterogeneous compute elements |
US11561823B1 (en) | 2020-05-12 | 2023-01-24 | Juniper Networks, Inc. | Lockless management of immutable objects by multi-threaded processes using multiple counters |
US11329924B2 (en) * | 2020-06-03 | 2022-05-10 | Cisco Technology, Inc. | Systems and methods for adapting a WAN egress shaper rate |
US11303556B2 (en) * | 2020-06-05 | 2022-04-12 | Level 3 Communications, Llc | Systems and methods for providing a dynamic-hybrid forwarding information base (DHFIB) |
US11762710B2 (en) | 2020-06-23 | 2023-09-19 | Juniper Networks, Inc. | Multithreaded route processing for routing information display |
US11245641B2 (en) | 2020-07-02 | 2022-02-08 | Vmware, Inc. | Methods and apparatus for application aware hub clustering techniques for a hyper scale SD-WAN |
WO2022002411A1 (en) * | 2020-07-03 | 2022-01-06 | Nokia Solutions And Networks Oy | Managing quality of monitoring models for collection of performance and/or sensing data |
US11803408B2 (en) | 2020-07-29 | 2023-10-31 | Vmware, Inc. | Distributed network plugin agents for container networking |
US11709710B2 (en) | 2020-07-30 | 2023-07-25 | Vmware, Inc. | Memory allocator for I/O operations |
US11863352B2 (en) | 2020-07-30 | 2024-01-02 | Vmware, Inc. | Hierarchical networking for nested container clusters |
CN111817925B (en) * | 2020-09-02 | 2020-12-04 | 广东省新一代通信与网络创新研究院 | Test method and system for high transmission rate |
US11575591B2 (en) | 2020-11-17 | 2023-02-07 | Vmware, Inc. | Autonomous distributed forwarding plane traceability based anomaly detection in application traffic for hyper-scale SD-WAN |
US11575600B2 (en) | 2020-11-24 | 2023-02-07 | Vmware, Inc. | Tunnel-less SD-WAN |
US11588742B2 (en) | 2020-12-02 | 2023-02-21 | Tencent America LLC | Multipath traffic switch damping |
US11601356B2 (en) | 2020-12-29 | 2023-03-07 | Vmware, Inc. | Emulating packet flows to assess network links for SD-WAN |
US11792127B2 (en) | 2021-01-18 | 2023-10-17 | Vmware, Inc. | Network-aware load balancing |
US11979325B2 (en) | 2021-01-28 | 2024-05-07 | VMware LLC | Dynamic SD-WAN hub cluster scaling with machine learning |
US11483222B1 (en) * | 2021-02-17 | 2022-10-25 | CSC Holdings, LLC | Interrogating and remediating one or more remote devices |
US12009987B2 (en) | 2021-05-03 | 2024-06-11 | VMware LLC | Methods to support dynamic transit paths through hub clustering across branches in SD-WAN |
US11637768B2 (en) | 2021-05-03 | 2023-04-25 | Vmware, Inc. | On demand routing mesh for routing packets through SD-WAN edge forwarding nodes in an SD-WAN |
US11729065B2 (en) | 2021-05-06 | 2023-08-15 | Vmware, Inc. | Methods for application defined virtual network service among multiple transport in SD-WAN |
US11606254B2 (en) | 2021-06-11 | 2023-03-14 | Vmware, Inc. | Automatic configuring of VLAN and overlay logical switches for container secondary interfaces |
US11489720B1 (en) | 2021-06-18 | 2022-11-01 | Vmware, Inc. | Method and apparatus to evaluate resource elements and public clouds for deploying tenant deployable elements based on harvested performance metrics |
US12015536B2 (en) | 2021-06-18 | 2024-06-18 | VMware LLC | Method and apparatus for deploying tenant deployable elements across public clouds based on harvested performance metrics of types of resource elements in the public clouds |
US11799731B2 (en) | 2021-06-25 | 2023-10-24 | Microsoft Technology Licensing, Llc | Representation and orchestration for virtual wide area networks |
US20230006998A1 (en) * | 2021-07-02 | 2023-01-05 | Tailscale Inc. | Management of private networks over multiple local networks |
US11627075B2 (en) * | 2021-07-15 | 2023-04-11 | Microsoft Technology Licensing, Llc | Stitching multiple wide area networks together |
US12047282B2 (en) | 2021-07-22 | 2024-07-23 | VMware LLC | Methods for smart bandwidth aggregation based dynamic overlay selection among preferred exits in SD-WAN |
US11375005B1 (en) | 2021-07-24 | 2022-06-28 | Vmware, Inc. | High availability solutions for a secure access service edge application |
US12021748B2 (en) * | 2021-07-30 | 2024-06-25 | Cisco Technology, Inc. | Exit interface selection based on intermediate paths |
US11943146B2 (en) | 2021-10-01 | 2024-03-26 | VMware LLC | Traffic prioritization in SD-WAN |
US11627063B1 (en) * | 2021-12-02 | 2023-04-11 | Verizon Patent And Licensing Inc. | Systems and methods for measuring unidirectional latency of applications over asymmetric links |
US11985067B2 (en) * | 2021-12-10 | 2024-05-14 | Nokia Solutions And Networks Oy | Flowlet switching using memory instructions |
US11902245B2 (en) | 2022-01-14 | 2024-02-13 | VMware LLC | Per-namespace IP address management method for container networks |
US20230344732A1 (en) * | 2022-04-21 | 2023-10-26 | Inseego Corp. | Intelligent wan switching with a routing device |
US20230344764A1 (en) * | 2022-04-26 | 2023-10-26 | Hughes Network Systems Llc | Cost-effective control of multiple transports of an sd-wan gateway |
US20230353473A1 (en) * | 2022-04-28 | 2023-11-02 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for active testing and monitoring a radio access network and core network |
US11909815B2 (en) | 2022-06-06 | 2024-02-20 | VMware LLC | Routing based on geolocation costs |
US20240039838A1 (en) * | 2022-07-30 | 2024-02-01 | Cisco Technology, Inc. | Predictive application-aware routing for remote work |
US11848910B1 (en) | 2022-11-11 | 2023-12-19 | Vmware, Inc. | Assigning stateful pods fixed IP addresses depending on unique pod identity |
US11831511B1 (en) | 2023-01-17 | 2023-11-28 | Vmware, Inc. | Enforcing network policies in heterogeneous systems |
EP4407932A1 (en) * | 2023-01-26 | 2024-07-31 | Rohde & Schwarz GmbH & Co. KG | Method and system for ship-shore packet data transmission |
US12057993B1 (en) | 2023-03-27 | 2024-08-06 | VMware LLC | Identifying and remediating anomalies in a self-healing network |
US12034587B1 (en) | 2023-03-27 | 2024-07-09 | VMware LLC | Identifying and remediating anomalies in a self-healing network |
US12028241B1 (en) * | 2023-07-10 | 2024-07-02 | Cisco Technology, Inc. | Backup path determination for optical networks |
Citations (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020027885A1 (en) | 1997-03-13 | 2002-03-07 | Raphael Ben-Ami | Smart switches |
US20040064469A1 (en) * | 2002-07-22 | 2004-04-01 | Seiji Takahashi | Information processing apparatus and information processing method |
US6721290B1 (en) | 2000-04-03 | 2004-04-13 | Hrl Laboratories, Llc | Method and apparatus for multicasting real time traffic in wireless ad-hoc networks |
US20050102390A1 (en) | 2003-10-22 | 2005-05-12 | Peterson Eric M. | System and method of network usage analyzer |
US20060239271A1 (en) | 2005-04-25 | 2006-10-26 | Verizon Services Corp. | Methods and systems for maintaining quality of service (QOS) levels for data transmissions |
US7139268B1 (en) | 1999-01-29 | 2006-11-21 | Pravin Bhagwat | Performance of intermediate nodes with flow splicing |
US20070248077A1 (en) | 2006-04-20 | 2007-10-25 | Fusion Telecommunications International, Inc. | Distributed voice over internet protocol apparatus and systems |
US20070286090A1 (en) | 2006-06-08 | 2007-12-13 | Alcatel | Method and system for optimizing resources for establishing pseudo-wires in a multiprotocol label switching network |
US20070297332A1 (en) | 2006-06-22 | 2007-12-27 | James Andrew Broberg | Distributed resource allocation in stream processing systems |
US20080069133A1 (en) | 2006-09-15 | 2008-03-20 | Futurewei Technologies, Inc. | ASON/GMPLS Architecture Extension for Reservation Based and Time Based Automatic Bandwidth Service |
US7426181B1 (en) | 2004-03-26 | 2008-09-16 | Packeteer, Inc. | Slow-start adaptive mechanisms to improve efficiency of bandwidth allocation |
US7433943B1 (en) | 2001-12-20 | 2008-10-07 | Packeteer, Inc. | Volume-based network management scheme |
US20090147806A1 (en) | 2007-11-02 | 2009-06-11 | Nortel Networks Limited | Synchronization of network nodes |
US7664048B1 (en) | 2003-11-24 | 2010-02-16 | Packeteer, Inc. | Heuristic behavior pattern matching of data flows in enhanced network traffic classification |
US7801030B1 (en) | 2005-09-16 | 2010-09-21 | Cisco Technology, Inc. | Technique for using OER with an ECT solution for multi-homed spoke-to-spoke sites |
US20110007631A1 (en) | 2008-02-29 | 2011-01-13 | Gaurav Raina | Network Communication |
US8125907B2 (en) | 2008-06-12 | 2012-02-28 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US20130077701A1 (en) | 2011-09-23 | 2013-03-28 | Advanced Micro Devices, Inc. | Method and integrated circuit for adjusting the width of an input/output link |
US8452846B2 (en) | 2010-08-12 | 2013-05-28 | Talari Networks Incorporated | Adaptive private network asynchronous distributed shared memory services |
US20130339101A1 (en) | 2012-06-15 | 2013-12-19 | The One Page Company Inc. | Request for proposal authoring |
US20140173331A1 (en) * | 2011-08-12 | 2014-06-19 | Talari Networks Incorporated | Adaptive Private Network with Geographically Redundant Network Control Nodes |
US20160182305A1 (en) | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Discovery Processes |
US20160179850A1 (en) | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Database Schema Migration and Management Processes |
US20160345341A1 (en) | 2015-05-22 | 2016-11-24 | Ford Global Technologies, Llc | Context-Based Wireless Network Link Access Prioritization System |
US20170026280A1 (en) | 2014-05-06 | 2017-01-26 | Huawei Technologies Co., Ltd. | Packet Transmission Method and Apparatus, and Interconnect Interface |
US20170055133A1 (en) | 2015-08-17 | 2017-02-23 | Adtran, Inc. | Multicast connection admission control |
US20170207976A1 (en) | 2009-06-11 | 2017-07-20 | Talari Networks Incorporated | Adaptive private network (apn) bandwith enhancements |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2237208A1 (en) | 1998-05-08 | 1999-11-08 | Northern Telecom Limited | Congestion notification from router |
US7215637B1 (en) * | 2000-04-17 | 2007-05-08 | Juniper Networks, Inc. | Systems and methods for processing packets |
US20040136379A1 (en) * | 2001-03-13 | 2004-07-15 | Liao Raymond R | Method and apparatus for allocation of resources |
US20040006615A1 (en) | 2002-07-02 | 2004-01-08 | Sun Microsystems, Inc., A Delaware Corporation | Method and apparatus for cerating proxy auto-configuration file |
US7305464B2 (en) * | 2002-09-03 | 2007-12-04 | End Ii End Communications, Inc. | Systems and methods for broadband network optimization |
JP3769752B2 (en) * | 2002-12-24 | 2006-04-26 | ソニー株式会社 | Information processing apparatus and information processing method, data communication system, and program |
US7568047B1 (en) * | 2004-04-30 | 2009-07-28 | Nortel Networks Limited | Method and apparatus for adaptive service label management |
US7944880B2 (en) | 2005-12-12 | 2011-05-17 | Telefonaktiebolaget L M Ericsson (Publ) | Method and arrangement for establishing a communication session for multimedia |
US8014400B2 (en) * | 2007-08-10 | 2011-09-06 | Sharp Laboratories Of America, Inc. | Method for allocating data packet transmission among multiple links of a network, and network device and computer program product implementing the method |
US8971335B2 (en) | 2009-07-02 | 2015-03-03 | Exafer Ltd | System and method for creating a transitive optimized flow path |
CN102118371B (en) | 2009-12-30 | 2013-10-09 | 华为技术有限公司 | Method, device and system for controlling network traffic switch |
US9716659B2 (en) | 2011-03-23 | 2017-07-25 | Hughes Network Systems, Llc | System and method for providing improved quality of service over broadband networks |
US20130343181A1 (en) * | 2012-06-21 | 2013-12-26 | Jonathan Stroud | Systems and methods of data processing using an fpga-implemented hash function |
US8891528B2 (en) * | 2012-06-21 | 2014-11-18 | Breakingpoint Systems, Inc. | Managing the capture of packets in a computing system |
GB201313760D0 (en) | 2013-07-31 | 2013-09-18 | British Telecomm | Fast friendly start for a data flow |
JP6234236B2 (en) * | 2014-01-15 | 2017-11-22 | 株式会社日立製作所 | Communication device |
US9246828B1 (en) | 2014-06-18 | 2016-01-26 | Juniper Networks, Inc. | Traffic-aware sampling rate adjustment within a network device |
US9356857B1 (en) * | 2014-06-30 | 2016-05-31 | Juniper Networks, Inc. | Double experimental (EXP) quality of service (QoS) markings for MPLS packets |
CN104158761B (en) * | 2014-08-05 | 2018-02-13 | 华为技术有限公司 | A kind of method and apparatus of bypass flow |
US10516892B2 (en) * | 2015-09-28 | 2019-12-24 | Cybrook Inc. | Initial bandwidth estimation for real-time video transmission |
JP2017073636A (en) * | 2015-10-06 | 2017-04-13 | 富士通株式会社 | Relay device and relay method |
US11082304B2 (en) | 2019-09-27 | 2021-08-03 | Oracle International Corporation | Methods, systems, and computer readable media for providing a multi-tenant software-defined wide area network (SD-WAN) node |
-
2017
- 2017-01-18 US US15/409,006 patent/US10200251B2/en active Active
- 2017-01-18 US US15/409,019 patent/US10447543B2/en active Active
- 2017-01-18 US US15/409,016 patent/US10348571B2/en active Active
- 2017-01-18 US US15/409,001 patent/US10785117B2/en active Active
-
2019
- 2019-07-26 US US16/523,997 patent/US10924380B2/en active Active
-
2020
- 2020-06-29 US US16/916,053 patent/US11108677B2/en active Active
- 2020-11-20 US US17/100,385 patent/US11575605B2/en active Active
Patent Citations (43)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020027885A1 (en) | 1997-03-13 | 2002-03-07 | Raphael Ben-Ami | Smart switches |
US7139268B1 (en) | 1999-01-29 | 2006-11-21 | Pravin Bhagwat | Performance of intermediate nodes with flow splicing |
US6721290B1 (en) | 2000-04-03 | 2004-04-13 | Hrl Laboratories, Llc | Method and apparatus for multicasting real time traffic in wireless ad-hoc networks |
US7433943B1 (en) | 2001-12-20 | 2008-10-07 | Packeteer, Inc. | Volume-based network management scheme |
US20040064469A1 (en) * | 2002-07-22 | 2004-04-01 | Seiji Takahashi | Information processing apparatus and information processing method |
US20050102390A1 (en) | 2003-10-22 | 2005-05-12 | Peterson Eric M. | System and method of network usage analyzer |
US7664048B1 (en) | 2003-11-24 | 2010-02-16 | Packeteer, Inc. | Heuristic behavior pattern matching of data flows in enhanced network traffic classification |
US7426181B1 (en) | 2004-03-26 | 2008-09-16 | Packeteer, Inc. | Slow-start adaptive mechanisms to improve efficiency of bandwidth allocation |
US20060239271A1 (en) | 2005-04-25 | 2006-10-26 | Verizon Services Corp. | Methods and systems for maintaining quality of service (QOS) levels for data transmissions |
US7801030B1 (en) | 2005-09-16 | 2010-09-21 | Cisco Technology, Inc. | Technique for using OER with an ECT solution for multi-homed spoke-to-spoke sites |
US20070248077A1 (en) | 2006-04-20 | 2007-10-25 | Fusion Telecommunications International, Inc. | Distributed voice over internet protocol apparatus and systems |
US20070286090A1 (en) | 2006-06-08 | 2007-12-13 | Alcatel | Method and system for optimizing resources for establishing pseudo-wires in a multiprotocol label switching network |
US20070297332A1 (en) | 2006-06-22 | 2007-12-27 | James Andrew Broberg | Distributed resource allocation in stream processing systems |
US20080069133A1 (en) | 2006-09-15 | 2008-03-20 | Futurewei Technologies, Inc. | ASON/GMPLS Architecture Extension for Reservation Based and Time Based Automatic Bandwidth Service |
US20090147806A1 (en) | 2007-11-02 | 2009-06-11 | Nortel Networks Limited | Synchronization of network nodes |
US20110007631A1 (en) | 2008-02-29 | 2011-01-13 | Gaurav Raina | Network Communication |
US9100338B2 (en) | 2008-06-12 | 2015-08-04 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US8125907B2 (en) | 2008-06-12 | 2012-02-28 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US8274891B2 (en) | 2008-06-12 | 2012-09-25 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US20120314578A1 (en) | 2008-06-12 | 2012-12-13 | Talari Networks Incorporated | Flow-Based Adaptive Private Network With Multiple WAN-Paths |
US10341237B2 (en) | 2008-06-12 | 2019-07-02 | Talari Networks, Inc. | Flow-based adaptive private network with multiple WAN-paths |
US20160006658A1 (en) | 2008-06-12 | 2016-01-07 | Talari Networks Incorporated | Flow-Based Adaptive Private Network with Multiple WAN-Paths |
US8644164B2 (en) | 2008-06-12 | 2014-02-04 | Talari Networks Incorporated | Flow-based adaptive private network with multiple WAN-paths |
US20160182305A1 (en) | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Discovery Processes |
US20160179850A1 (en) | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Database Schema Migration and Management Processes |
US10447543B2 (en) | 2009-06-11 | 2019-10-15 | Talari Networks Incorporated | Adaptive private network (APN) bandwith enhancements |
US9392061B2 (en) | 2009-06-11 | 2016-07-12 | Talari Networks Incorporated | Adaptive private network asynchronous distributed shared memory services |
US20160197802A1 (en) | 2009-06-11 | 2016-07-07 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Time Correlated Playback of Network Traffic |
US20160182327A1 (en) * | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Data Visualization Processes |
US20160182319A1 (en) | 2009-06-11 | 2016-06-23 | Talari Networks Incorporated | Methods and Apparatus for Providing Adaptive Private Network Centralized Management System Timestamp Correlation Processes |
US20170207976A1 (en) | 2009-06-11 | 2017-07-20 | Talari Networks Incorporated | Adaptive private network (apn) bandwith enhancements |
US8452846B2 (en) | 2010-08-12 | 2013-05-28 | Talari Networks Incorporated | Adaptive private network asynchronous distributed shared memory services |
US8775547B2 (en) | 2010-08-12 | 2014-07-08 | Talari Networks Incorporated | Adaptive private network asynchronous distributed shared memory services |
US20160072706A1 (en) | 2011-08-12 | 2016-03-10 | Talari Networks Incorporated | Adaptive Private Network with Dynamic Conduit Process |
US20140173331A1 (en) * | 2011-08-12 | 2014-06-19 | Talari Networks Incorporated | Adaptive Private Network with Geographically Redundant Network Control Nodes |
US9069727B2 (en) | 2011-08-12 | 2015-06-30 | Talari Networks Incorporated | Adaptive private network with geographically redundant network control nodes |
US20150071067A1 (en) | 2011-08-12 | 2015-03-12 | Talari Networks Incorporated | Adaptive Private Network with Path Maximum Transmission Unit (MTU) Discovery Process |
US20130077701A1 (en) | 2011-09-23 | 2013-03-28 | Advanced Micro Devices, Inc. | Method and integrated circuit for adjusting the width of an input/output link |
US20130339101A1 (en) | 2012-06-15 | 2013-12-19 | The One Page Company Inc. | Request for proposal authoring |
US20170026280A1 (en) | 2014-05-06 | 2017-01-26 | Huawei Technologies Co., Ltd. | Packet Transmission Method and Apparatus, and Interconnect Interface |
US20160345341A1 (en) | 2015-05-22 | 2016-11-24 | Ford Global Technologies, Llc | Context-Based Wireless Network Link Access Prioritization System |
US20170055133A1 (en) | 2015-08-17 | 2017-02-23 | Adtran, Inc. | Multicast connection admission control |
US20190349259A1 (en) | 2016-01-19 | 2019-11-14 | Talari Networks Incorporated | Adaptive private network (apn) bandwith enhancements |
Non-Patent Citations (12)
Title |
---|
Advisory Action for U.S. Appl. No. 14/481,335 (dated Nov. 8, 2019). |
Applicant-Initiated Interview Summary for U.S. Appl. No. 14/481,335 (dated Mar. 22, 2019). |
Applicant-Initiated Interview Summary for U.S. Appl. No. 14/481,335 (dated Oct. 23, 2019). |
Applicant-Initiated Interview Summary for U.S. Appl. No. 15/409,019 (dated Mar. 15, 2019). |
Final Office Action for U.S. Appl. No. 14/481,335 (dated Aug. 8, 2019). |
Non-Final Office Action for U.S. Appl. No. 13/592,460 (dated May 24, 2013). |
Non-Final Office Action for U.S. Appl. No. 14/481,335 (dated Apr. 1, 2019). |
Non-Final Office Action for U.S. Appl. No. 14/481,335 (dated Jan. 24, 2020). |
Non-Final Office Action for U.S. Appl. No. 15/409,019 (dated Dec. 6, 2018). |
Notice of Allowance and Fee(s) Due and Examiner-Initiated Interview Summary for U.S. Appl. No. 15/409,019 (dated Jun. 4, 2019). |
Notice of Allowance and Fee(s) Due for U.S. Appl. No. 13/592,460 (dated Oct. 2, 2013). |
Notice of Allowance and Fee(s) Due for U.S. Appl. No. 15/647,924 (dated Feb. 19, 2019). |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11799793B2 (en) | 2012-12-19 | 2023-10-24 | Talari Networks Incorporated | Adaptive private network with dynamic conduit process |
US10924380B2 (en) | 2016-01-19 | 2021-02-16 | Talari Networks Incorporated | Adaptive private network (APN) bandwidth enhancements |
US11108677B2 (en) | 2016-01-19 | 2021-08-31 | Talari Networks Incorporated | Methods and apparatus for configuring a standby WAN link in an adaptive private network |
US11575605B2 (en) | 2016-01-19 | 2023-02-07 | Talari Networks Incorporated | Adaptive private network (APN) bandwidth enhancements |
US11483228B2 (en) | 2021-01-29 | 2022-10-25 | Keysight Technologies, Inc. | Methods, systems, and computer readable media for network testing using an emulated data center environment |
Also Published As
Publication number | Publication date |
---|---|
US10348571B2 (en) | 2019-07-09 |
US11108677B2 (en) | 2021-08-31 |
US20170207976A1 (en) | 2017-07-20 |
US10924380B2 (en) | 2021-02-16 |
US20200336383A1 (en) | 2020-10-22 |
US11575605B2 (en) | 2023-02-07 |
US20170207963A1 (en) | 2017-07-20 |
US20170207996A1 (en) | 2017-07-20 |
US20210099375A1 (en) | 2021-04-01 |
US20190349259A1 (en) | 2019-11-14 |
US10200251B2 (en) | 2019-02-05 |
US10447543B2 (en) | 2019-10-15 |
US20170207997A1 (en) | 2017-07-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11108677B2 (en) | Methods and apparatus for configuring a standby WAN link in an adaptive private network | |
US11799793B2 (en) | Adaptive private network with dynamic conduit process | |
JP7456057B2 (en) | Enhanced SD-WAN path quality measurement and selection | |
US10148756B2 (en) | Latency virtualization in a transport network using a storage area network | |
US9813315B2 (en) | Methods and apparatus for providing adaptive private network centralized management system time correlated playback of network traffic | |
Miller et al. | Collecting network status information for network-aware applications | |
JP5944537B2 (en) | Communication path management method | |
US8780716B2 (en) | System and method for service assurance in IP networks | |
JP2022532731A (en) | Avoiding congestion in slice-based networks | |
US11546290B1 (en) | Adjusting DNS resolution based on predicted application experience metrics | |
Raad et al. | PACAO: A protocol architecture for cloud access optimization in distributed data center fabrics | |
KR20190048324A (en) | Method for providing service based on multi network and apparatus therefor | |
WO2019104098A1 (en) | Intelligent write protection cache (iwpc) in an adaptive private network (apn) | |
US11863432B1 (en) | Opportunistic user feedback gathering for application-aware routing | |
US12081445B2 (en) | Network interface selection based on application profiles | |
Wang et al. | A flexible awareness measurement and management architecture for adaptive applications | |
Al-Oqily et al. | Automating overlay networks management | |
Chen et al. | WAN-INT: Cost-Effective In-Band Network Telemetry in WAN With A Performance-aware Path Planner | |
CA3193638A1 (en) | Distributed content distribution network | |
AU2021347375A9 (en) | Distributed content distribution network | |
CN118118441A (en) | Power communication network system supporting deterministic control and scheduling method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TALARI NETWORKS INCORPORATED, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUI, WAI YEE;HUANG, WEI;SIGNING DATES FROM 20170620 TO 20170709;REEL/FRAME:043077/0833 |
|
AS | Assignment |
Owner name: PACIFIC WESTERN BANK (AS SUCCESSOR IN INTEREST BY MERGER TO SQUARE 1 BANK), NORTH CAROLINA Free format text: SECURITY INTEREST;ASSIGNOR:TALARI NETWORKS, INC.;REEL/FRAME:046259/0037 Effective date: 20140331 Owner name: PACIFIC WESTERN BANK (AS SUCCESSOR IN INTEREST BY Free format text: SECURITY INTEREST;ASSIGNOR:TALARI NETWORKS, INC.;REEL/FRAME:046259/0037 Effective date: 20140331 |
|
AS | Assignment |
Owner name: TALARI NETWORKS, INC., CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:PACIFIC WESTERN BANK (AS SUCCESSOR IN INTEREST BY MERGER TO SQUARE 1 BANK);REEL/FRAME:047633/0286 Effective date: 20181130 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |