EP1350363B1 - Method and apparatus for the assessment and optimization of network traffic - Google Patents

Method and apparatus for the assessment and optimization of network traffic Download PDF

Info

Publication number
EP1350363B1
EP1350363B1 EP01979856A EP01979856A EP1350363B1 EP 1350363 B1 EP1350363 B1 EP 1350363B1 EP 01979856 A EP01979856 A EP 01979856A EP 01979856 A EP01979856 A EP 01979856A EP 1350363 B1 EP1350363 B1 EP 1350363B1
Authority
EP
European Patent Office
Prior art keywords
flows
internetwork
packets
subset
measuring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
EP01979856A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP1350363A2 (en
Inventor
Michael A. Lloyd
Sean P. Finn
Mansour J. Karam
Omar C. Baldonado
Herbert S. Madan
James G. Mcguire
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Avaya Technology LLC
Original Assignee
Avaya Technology LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US09/903,423 external-priority patent/US7363367B2/en
Priority claimed from US09/903,441 external-priority patent/US7080161B2/en
Priority claimed from US09/923,924 external-priority patent/US7406539B2/en
Application filed by Avaya Technology LLC filed Critical Avaya Technology LLC
Priority to EP07002502A priority Critical patent/EP1826947A3/en
Publication of EP1350363A2 publication Critical patent/EP1350363A2/en
Application granted granted Critical
Publication of EP1350363B1 publication Critical patent/EP1350363B1/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/22—Alternate routing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/02—Topology update or discovery
    • H04L45/04—Interdomain routing, e.g. hierarchical routing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/12—Shortest path evaluation
    • H04L45/123—Evaluation of link metrics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/12—Shortest path evaluation
    • H04L45/124—Shortest path evaluation using a combination of metrics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/50—Routing or path finding of packets in data switching networks using label swapping, e.g. multi-protocol label switch [MPLS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/11—Identifying congestion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/20—Traffic policing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/28—Flow control; Congestion control in relation to timing considerations
    • H04L47/283—Flow control; Congestion control in relation to timing considerations in response to processing delays, e.g. caused by jitter or round trip time [RTT]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/508—Network service management, e.g. ensuring proper service fulfilment according to agreements based on type of value added network service under agreement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50—Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/508—Network service management, e.g. ensuring proper service fulfilment according to agreements based on type of value added network service under agreement
    • H04L41/5096—Network service management, e.g. ensuring proper service fulfilment according to agreements based on type of value added network service under agreement wherein the managed service relates to distributed or central networked applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/02—Capturing of monitoring data
    • H04L43/026—Capturing of monitoring data using flow identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • H04L43/0811—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking connectivity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823—Errors, e.g. transmission errors
    • H04L43/0829—Packet loss
    • H04L43/0835—One way packet loss
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823—Errors, e.g. transmission errors
    • H04L43/0829—Packet loss
    • H04L43/0841—Round trip packet loss
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/0858—One way delays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/0864—Round trip delays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays
    • H04L43/087—Jitter
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876—Network utilisation, e.g. volume of load or congestion level
    • H04L43/0882—Utilisation of link capacity
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/16—Threshold monitoring

Definitions

  • This invention relates to the field of networking.
  • this invention relates to the optimization of network traffic.
  • packet-based networks such as the Internet
  • the performance of packet-based networks is typically constrained by the various path-selection processes in place.
  • Dynamic Routing Protocols are used to control the vast majority of forwarding decisions on large packet-based networks. These protocols are fairly adaptable to routing failures, but do not effectively compensate for variations in network performance.
  • network address ranges are typically not directly representative of the underlying network topology.
  • the set of actively used address ranges is a relatively small percentage of the total address ranges available.
  • This set of "active" routes is dynamic, and while technology does exist that can identify the set of active flows, in general these systems are constrained by both significant delays in reporting activity, as well as lack of integration into path selection systems.
  • Network performance metrics can include a wide variety of units and scales, which typically do not conveniently map to appropriate routing metrics.
  • US-A-467,345 presents an arrangement for optimising the routing tables of a network by updating said tables upon changes of the network loading.
  • a method and an apparatus for the optimization of internetwork traffic including the selection of flows for optimization, quantifying appropriate network performance characteristics of these flows, calculating a performance metric from these characteristics, and updating routing or forwarding tables based on this performance metric.
  • a method and an apparatus for the optimization of internetwork traffic including the selection of flows for optimization, quantifying appropriate network performance characteristics of these flows, calculating a performance metric from these characteristics, and updating a name resolution system based on this performance metric.
  • a method and an apparatus for the optimization of internetwork traffic including the selection of flows for optimization, quantifying appropriate network performance characteristics of these flows, calculating a performance metric from these characteristics, and redirecting traffic flows based on this performance metric.
  • a method of classifying network addresses into appropriate Groups based on evaluation of a selection of performance, policy, topology, and related criteria. Having defined said Groups, instantiate them in a server or other networking device, such that performance scores for observed traffic can be consolidated within the Group definition.
  • the flows may be between points within a single administrative domain, or at least one of the end points may be in some other domain.
  • the mechanisms described here assume that it is desirable to observe the performance characteristics of the various paths over which it is possible to route the flows. This can occur in the case of organizations making use of network fabric they do not directly control; this includes the exchange of information with a remote end point across the Internet, or the exchange of information between end points belonging to a single organization over fabric owned and operated by a different organization (a Service Provider, or SP).
  • SP Service Provider
  • This invention includes mechanisms that implement some combination of the following parts:
  • These mechanisms can be implemented in many ways; examples include a single device that implements all of the required functionality. Other examples include a number of different devices, each being responsible for one or more functions. These devices can be located in the network of the domain that generates the traffic which we intend to measure (in this document, we call this domain the Content Provider - CP). Typically, such devices will be located in the CP's DMZ; alternatively, these mechanisms can be implemented in a Colocation Facility (CoLo). Each location is characterized by a different set of requirements. For example, in a CoLo, direct connections can be made between the collection devices and the border routers to which connect the organization whose traffic we measure. We describe implementation examples that correspond to both these environments.
  • CoLo Colocation Facility
  • a Surfer merely denotes any IP endpoint that we do not control, and to which we need to develop routes on demand.
  • a passive monitoring and reporting device is needed, either in the enterprise DMZ or in a collocation facility (CoLo) rack; let's call this device the Collector.
  • the job of the collector is to maintain simple state on selected flows emerging from the CP, and report statistics on them.
  • there is an Ethernet link to instrument in which case packet splitters can be used; to such a device a computer that runs the Collector software can be attached.
  • the software needs to receive signals about addresses (and possibly ports) for which to monitor flows.
  • the Collector will track sequence numbers (looking for repeats, which can indicate packet loss) and SYNACK to ACK time (as an estimate of edge-to-end RTT). It is then able to report these numbers, or track thresholds and report violations.
  • a flow-based data collector (such as RMON II or NetFlow) can be used to identify the flows to be monitored; such a device can also be used to get performance characteristics of the flows.
  • the device can select flows on the basis of input other than performance, such as user input, or the cost of the link. That is, the user can specify the flows that need special treatement.
  • interface statistics can be obtained from network; using this input, quantities such as available bandwidth, cost of usasge of the links, or link bandwidth can be computed.
  • Flows can be diverted when a given threshold in such metrics (such as cost or available bandwidth) is detected.
  • some of all of the techniques above can be combined to yield a metric that determines whether a flow should receive special treatement.
  • the set of flows can be provided by an external agent.
  • this external agent can be human; in other embodiments, these flows can be provided by the external agent according to some criteria.
  • the criteria for flow selection can be based on the monitoring of a routing table.
  • the device will select flows whose destination network addresses correspond to some selected ranges of network addresses in the table.
  • the selected ranges of network addresses can correspond to those flows that are of highest importance to the customer.
  • the criteria for flow importance can be the rate of incoming requests.
  • the criteria for flow importance can be the revenue that is generated as a result of the activity of the flow.
  • flows are identified by matching criteria defined on any portion of an HTTP request.
  • the well-known technique of identifying individuals or groups using cookies can be used.
  • all flows can be monitored and/or diverted. That is, there is no requirement that some part of the flow remains non-monitored and/or non-diverted.
  • the Collector communicates with another processes, referred to below as the Bender, that is responsible to divert traffic for which optimized routing is needed.
  • the precise placement of the Collector depends on whether it is implemented in the CP's DMZ, or next to the CP's border routers in a CoLo.
  • the Collector can include passive, fail-safe monitoring hardware, and it may be placed in the flow for all the outbound traffic (such as within a DMZ). In other embodiments,it may be required that all traffic that needs to be monitored will be diverted towards the Collector. (See below.)
  • the second device is referred to as the Bender, which can (a) receive input from the CP and the Collector, (b) collect stats on various routes to and through the different available service provider links, (c) make decisions about which flows require diversion, (d) obtain those flows from the CP, and/or (e) re-route them depending on the input received from the Collector.
  • the Bender may, but need not be physically distinct from the Collector described above.
  • stage (d) for example, (which gives rise to the name Bender) is optional in some implementations.
  • step (d) can be present or omitted.
  • all flows monitored by the collector can be sent to the bender. In other embodiments, only a sub-set of these flows can be monitored. All techniques used above for the determination of which flows to monitor can be used to determine which flows need to be rerouted.
  • this mechanism includes a network device (for example, some kind of a router), under control from some processing unit (a computer) that runs the appropriate software.
  • the computer is responsible for (a) through (c), and then communicates with the router to make (d) and (e) happen appropriately.
  • a human can intervene on the router to effect stages (d) and (e), on the basis of reports or signals generated by the computer performing steps (a) through (c).
  • the CP When the CP wants to signal that traffic towards a particular IP address needs to be optimized (see below), it should communicate directly with the Bender.
  • the Bender can communicate about qualified flows with the border routers that connect to the different available service provider links. It may be necessary for the external fabric to notify the Bender of a flow, depending on the CP's particular choice of signaling method (e.g., an API, through, for instance, HTTP requests.)
  • the Bender will inform the Collector that a particular flow is qualified, and the Collector will begin to monitor the flow.
  • the Collector returns statistics to the Bender. In some embodiments of this invention, these statistics may encompass more flows than are strictly qualified; indeed, it is possible to infer performance problems in non-qualified flows, and use these proactively.
  • the Bender will then implement logic that determines whether the qualified flow needs to be diverted. In a simplified embodiment of this invention, all qualified flows can be diverted to the Bender. This would significantly simplify the function of the Collector.
  • a number of possible methods can be used by the Content Provider to inform the collector that a flow is qualified for optimization.
  • Various embodiments have one or more options for the Content Provider, including:
  • Option 7 A simple web interface is offered as part of the Bender. Additional logic will take care of performing post operations on the web transactions.
  • a secure web form interface can also be offered as part of other Options for flow qualification; this allows the Content Provider to either experiment with the service, or intervene to control it once it is running.
  • the HTML post interface supports one operation, namely to deem one IP address a qualified address for a specified period of time. This period of time is specified by the Content Provider, which enters for this purpose a TTL (Time To Live) for the qualification; it may be desirable to keep the TTL value small; it may also be desirable to provide a default, possibly at around 5 minutes.
  • TTL Time To Live
  • a more complex interface can be built, that includes the ability to withdraw qualification, and/or to specify additional parameters such as port numbers, relative priority versus other qualified flows, and/oror a general statement of QoS requirements.
  • the Collector sits in the flow of packets, but is strictly passive, and can be built in such a way that even power failure does not compromise the monitored network fabric. (Line splitters and Switch span ports are two examples.)
  • the Bender sits out of the normal flow direction, and so must attract any qualified flows.
  • forcing a qualified flow to cross the Bender requires a routing protocol between the Bender and the nearest Content Provider routers.
  • An implementation involves the injection of /32 routes (or an aggregation thereof) for all qualified flows that need to be bent.
  • precaution can be taken to withdraw or age out individual advertisements, to avoid the excessive growth of routing tables in the Content Provider routers.
  • One implementation is to have the processing unit cause the router to advertise the qualified destination; one way of implementing this effect is to have the processing unit reconfigure the router (e.g., via telnet) to add a static route. The router may be previously configured to redistribute such statics into the agreed routing protocol running between the Content Provider's edge routers.
  • routing protocols can be used in this context. It may be preferable not to be in the normal IGP of the Content Provider, so as to minimize the distance the potentially rapidly changing routes propagate. In some embodiments of this invention, a common protocol with rapid convergence properties (e.g., OSPF) is ideal.
  • OSPF rapid convergence properties
  • IP address is used to determine qualified traffic, and if this IP address is shared between qualified and non-qualified traffic, unqualified traffic may also be included (e.g., because of Port Address Translation - PAT). In other embodiments of this invention, qualified and unqualified flows within a single IP address can be separated.
  • the router component of the Bender has connectivity to edge routers which are in turn connected to various service provider links, to which qualified traffic will be sent.
  • edge routers which are in turn connected to various service provider links, to which qualified traffic will be sent.
  • service provider links we will refer to this set of routers and links at the edge of the domain as a point of presence - PoP.
  • static routes used to divert traffic can point directly into one (or more than one) of these GRE tunnels, based on a decision process in the processing unit of the Bender.
  • another layer of indirection can be added; one such implementation involves the use of statics to remote IP next hops. The idea is to decouple the static that bends the traffic towards specialized devices from the details of how it is to be forwarded. Such recursive statics provide a useful simplification for minor performance cost.
  • some embodiments of this invention involve having a process that adds static routes to the router (in addition to those static routes advertised to divert the flows to the Bender, described above). These processes may involve the addition of several specific statics, with next hops that spread across the GRE tunnels leading to various PoPs. In some embodiments of the invention, this indirection is outside the GRE tunnels themselves, hence preserving the property that a single flow will all go to the same next PoP, even if load sharing across tunnels per flow is in use.
  • the process for selecting nearby PoPs is, in some embodiments of this invention, unnecessary, and the initial statistics used to attract flows can simply point to the core-facing router in the PoP.
  • the core-facing router will already have selected a high-performance route to the Surfer, as described below.
  • the problem can be decomposed into three pieces:
  • Choices 1 and 2 are not orthogonal decisions, since the egress can depend on the cross-core performance.
  • methods for steps 3 can include automatic changes to an IGP, to BGP, or manual changes to either.
  • these changes are in the form of router configurations that statically alter the routing of flows (methods including use of route maps and/or use of static route statements).
  • changes are in the form of router configurations that adjust the processing of dynamic routing updates.
  • changes to routing are determined within the forwarding device, and are applied directly to its routing table.
  • the implementation is constrained to be designed for scale.
  • many neighboring hosts can be routed in the same way.
  • load sharing may be used, so it will not be the case that any two flows to the same subnet will follow the same actual path across the core.
  • Equivalence Classes also known as “Groups”.
  • An "EC”, or “Group” is a set of network addresses which are to be treated equally by the system for the purposes of performance reporting, and/or performance optimization.
  • the set of network addresses within a group may include any combination of individual network addresses, and ranges of contiguous network addresses.
  • the network addresses in question will be Internet Protocol (IP) addresses.
  • IP Internet Protocol
  • the traditional "a.b.c.d/m” notation for Internet routes can be used, facilitating communication with conventional Internet routers.
  • the assessment of a set of network addresses to identify appropriate Group membership requires the identification of appropriate criteria of each network address to evaluate.
  • address classification criteria falls in four (4) distinct classes of attributes:
  • Performance-related criteria include those parameters which may be observed of traffic to and/or from an address or address range. Examples of such parameters include: delay, jitter, loss, retransmission, and network load. These parameters may be observed as a result of active measurement (transmission of test traffic); or passive measurement (observation of existing flows).
  • Administrative Policy criteria encompasses a range of considerations that may, or may not be directly observable within the network fabric itself. Examples include:
  • Address Aggregation Policy In some cases, scalability consderations of individual networking devices, and the system as a whole, result in desires to limit the number of address ranges to be managed. It order to keep the number of address ranges reasonable, definiting "minumum set criteria" for address ranges is sometimes required. Examples of this case include “minimum set size of 255 addresses”; which is to say, addresses, and address ranges involving less than 255 addresses, will be aggregated into a single set. In some cases, Address Aggregation policy varies across the range of managed addresses. For convenience in identifying sets, Address Aggregation policy often is limited to ranges of contiguous addresses.
  • Administritative Policy may also encompass user-definable criteria.
  • Topological Proximity criteria allows network addresses which are either topologically contiguous/adjacent, or topologically dependant, to be considered in the definition of Groups. Topological Proximity can be empirically observed through active testing of the network fabric, or inspection of appropriate network documentation. In addition, Topological Proximity can in some cases be inferred from the relative contiguousnous of addresses.
  • Pre-Existing Address Range definitions may be usefull in the Group definition process: the use of such definitions, if available, may increase the efficiency of bootstrapping the system, and may also allow the system to integrated more effectively with internal or external routing or forwarding devices.
  • Pre-Existing Address Range Definitions may map directly (1:1) to Groups; in other cases, a Group may include more than one of the existing Address Definitions.
  • a source of routing table information may be identified as the reference source of Group Definition information.
  • Group Definitions are kept synchronized with a dynamic Reference Routing Table.
  • candidate Reference Routing Table entries may be desirable to restrict candidate Reference Routing Table entries to be considered for Group membership to contiguous address blocks.
  • some or all of the attributes above can be combined into a composite metric to be used for group membership evaluation.
  • the definition of groups may at least partially computed with the help of a "clustering" algorithm, which includes one or more of the classification criteria described above.
  • Assignment of network addresses, and network address ranges, into appropriate Groups may need to be reviewed and repeated based on changing network conditions including advertised address ranges, network performance characteristics, and user-defined policies. This process manually initiated, or it may be triggered by the detection of changes in network conditions; or may be scheduled to occur on a regular basis.
  • One implementation involves allowing the centralized Group manager to determine which PoP advertises a new Group Definition first, based on its complete information base. This implementation will allow PoPs to coordinate, and will hence prevent them going out of sync.
  • Group Management and definitions can be independent in different POPs. That is, the actions of creation, modification, and deletion of the groups are performed at sites distributed across the different PoPs.
  • One simple implementation of such an embodiment can involve a PoP advertising to all other peers in the network whenever it makes changes to the EC list (that is, upon the creation, modification, and deletion of a group or a set of groups).
  • the Reference Routing Table may be obtained from within the local Autonomous System.
  • the Reference Routing Table may be obtained from outside the local Autonomous System.
  • Groups may be desirable to allow Groups to refer to one or of the entries in the Reference Routing Table, in addition to one or more individual addresses, each of which may, or may not, be explicitly included in the Reference Routing Table.
  • PoPs measure their distances to an EC via various external routes; that is, if PoP A had packets heading to EC B, and it chose to drop those packets out to the Internet, how well would they perform?
  • the implementation described in this document includes a PoP assessing its "distance" to a given EC autonomously along every Egress connection it has to the Internet, and to summarize the result as a simple metric for communication to other PoPs. That is, in this particular implementation, other PoPs are not fed individual data points or estimates of network quantities such as delay. In some embodiments, this detailed data for each individual Surfer address is fed to the centralized EC Manager, since it is the basis under which EC's can be separated or joined. However, this exchange is distinct from PoP to PoP communication, since routing does not need the fine details; a simple summary of a PoP's "goodness" for a given EC is all that is required.
  • measurements can be boiled down into a single statistic. In some cases, it may be important to rank the measurements by their expected quality. In one example implementation, the quality order is:
  • a metric can be constructed, that can be propagated in existing protocols by "concatenating" the measurements; that is, separate measurements can occupy different bits counting from the MSB in an integral metric value.
  • This particular example implementation does not require that the concatenation be strict; overlap of values is allowed, since there is no need to reconstruct precise and separate estimates when these measures are received.
  • the goal is to find those PoPs that are better than others, which are preferred. Some embodiments can consider this property to hold even if the measurements are heterogeneous in method or time.
  • low resolution in the metric may be considered acceptable, since this tends to diminish the likelihood of reacting to small changes in performance.
  • the goal of some embodiments is to find several routes, none of which are appreciably sub-optimal, and any one of which can be pulled out of service rapidly (with the others taking over) when sudden performance degradations such as packet drop storms are observed.
  • paths whose measurements vary by insignificant amounts are treated as equal; in some implementations, this can be achieved with a composite metric of low granularity.
  • weighted sampling can be implemented; in one such implementation, EC's would be ranked by their priority for testing, and tests would concentrate on the top few at any given moment.
  • initial weighting can be derived from BGP: observation of a flow crossing the PoP causes a large increase in priority (and a record is made of the individual address within the EC).
  • the weighting can either be cumulative (so that repeat flows from a given EC increase the testing focus applied) or old observations eventually time out.
  • more sophisticated feedback can also be added to the EC weighting scheme, using, for example, the data a PoP receives from other PoPs.
  • a PoP that has at least one measurement for a given EC compares that measurement to those coming from other PoPs; if its own measurement appears to be close, then it intensifies monitoring; if it is far from optimal by a large margin, then the EC drops far down the priority list.
  • the EC Manager can suggest EC's for a PoP to monitor, based on the warehoused performance data it is analyzing.
  • an overlay network can constitute the network infrastructure that links these PoPs to each other.
  • this overlay network can be set up as a single Autonomous System. In this implementation, the overlay network is set up to be single BGP Autonomous system.
  • different quantities of interest along all direct paths between all PoPs can be directly monitored. Possible measurements cover, and are not restricted to one or more of the following:
  • one-way measurements can include, but are not restricted to delay and packet drop.
  • one-way measurements require clock synchronization between end-points; in some embodiments, GPS feeds can be used in the various PoPs. In other embodiments, an NTP clock feed of sufficient quality can be obtained into each PoP.
  • the routing fabric is split with different types of traffic (e.g., jitter sensitive and drop-sensitive types of traffic) utilizing separately optimized routes.
  • traffic e.g., jitter sensitive and drop-sensitive types of traffic
  • One implementation signals which method of handling is best for a given application through the ToS bits in the IP header.
  • the CP, or a process at the CP's site could mark a special ToS value indicating the optimization required for the flow.
  • the ToS bits can be set flow by flow, using, for example specific knowledge of how the CP can separate application traffic (by port number, IP address, egress point, farm location, etc).
  • a CP will only have one class of traffic to put into the routing fabric, so in some embodiments, a constant marking rule can be applied.
  • the traffic can be placed into the right routing system based on the CP-marked sensitivity type, using for this purpose a relatively straightforward use of Policy Based Routing (PBR) at the first PoP.
  • PBR Policy Based Routing
  • the measures of different network parameters are mixed.
  • the mixture of different measures could hunt for physically short paths that are under-utilized (due to inefficiencies in conventional routing); a relatively under-used route shows improvements for both drop-sensitive and jitter-sensitive traffic.
  • This architecture is viable since experience has shown that high jitter and high loss can be highly correlated phenomena. (That is, the various network degradations are frequently correlated. Real observations show that the correlation is not ironclad, but appears to be present.) For example, voice flows are known not to be particularly sensitive to drops, yet they are sensitive to many of the network conditions which induce drops.)
  • Jitter and Delay can be merged.
  • each remote PoP generates only a single metric value from the measurements, even though several direct paths are measured. In some embodiments, a numbers across paths could be combined. In this document, we described an implementation for which the metric from the single best path will be used.
  • cross-core routing and choice of Egress PoP can be done independently.
  • PoPs are based on their proximity to the Surfer, not on their optimality when the flow is at another given point in the network.
  • cross-core routing and choice of Egress PoP can be combined within the same routing infrastructure.
  • BGP is a communications protocol that is known to be capable of carrying the size of load such an infrastructure would generate; it also provides a number of useful features into one package (publicly available specs, modifiable source code for Unix implementations, and support for "third party" next hops).
  • each PoP will be equipped with an implementation of BGP. These BGP sessions should communicate with each other; in some implementations, all PoPs can peer in a full mesh of IBGP peerings. In other implementations where the number of PoPs is large so that a full mesh becomes impractical, BGP Route Reflection can be implemented. In such an infrastructure, each PoP can advertise routes to all EC's that it has monitored, giving an address within that PoP as the next hop. Most attributes in that BGP message can be left at default values; in some implementations, only the32-bit Local Preference field is modified as to communicate the measurements described above for the closeness of the PoP to the EC.
  • the BGP process will also receive routes from all other PoPs describing their performance as an Egress for some EC's.
  • the receiving process can modify an incoming route, adding to the Local Preference a value measuring the cross-core distance from the sending PoP.
  • Egress PoPs can be chosen purely for their good performance towards a Surfer, regardless of cross-core performance.
  • the computer can learn over time about possible Egress PoPs for each EC, and conventional BGP cost comparison can efficiently sort through for one or several winners.
  • ties will force tie breaking.
  • multiple PoPs deemed “optimal" simultaneously could share load, which will have the advantage of adding redundancy, useful in the event of sudden degradations.
  • throttles can be added.
  • One specific implementation could avoid unnecessary advertisements of minor changes in route metrics.
  • One such method is to fail to report changes where an underlying measurement has changed by less than a given percentage of the original measurement (e.g., 5, 10, or 20 %).
  • the BGP updates can be sent directly across the core fabric.
  • this data can be moved out of the way of real user traffic (since it may be bursty, and will certainly increase congestion in the most active PoPs).
  • a relatively low-bandwidth communication infrastructure can be used to allow all PoPs to communicate.
  • Such implementations can use a full meshing across peers.
  • Other implementations can use a hub and spoke pattern into the EC Management site. In case high resilience is needed, backup routes over the Internet can be designed. That is, for periods when the EC Management site is unreachable, routing traffic can be mixed with user flows.
  • the BGP Local Preference Metric must contain information about Egress PoP selection. In some implementations, it does not deal with specifics of any given path towards the Egress PoP, or any exit interface from that PoP. As previously described, the metric needs to factor in one or more of the following metrics: Packet Drops, Delay + Jitter and Bandwidth. In some embodiments, the metric needs to support an addition operation, so that a summary cost can be made to combine the Egress PoP cost to get to the EC with one or more PoP-to-PoP paths. Also, the use of BGP Local Pref forces semantics where high numbers are better- that is, a route gets a "goodness" score, and as the path gets longer or less good, the score must decrease.
  • bandwidth is not explicitly signaled between PoPs. (Given the details of tunnel selection (discussed later), it is non-trivial to interpret a Bandwidth measure directly. Also, the quantity may vary widely even when the network is behaving well, since we can only measure Bandwidth remaining on the links in and out of our PoPs, not along the tunnels themselves, and loading on these links will fluctuate, while Packet Drops, Delay and Jitter may prove relatively stable much of the time.)
  • bandwidth consumption can be used as an early warning sign, indicating the onset of link saturation and packet drops.
  • a PoP has a number of options at or near link saturation. Choices include, but are not restricted to:
  • the performance-based, application-specific metric derived above could be modified using other variables such as overall network usage, individual network link usage (absolute or relative) or link usage cost.
  • interface stats of network devices e.g., netflow on routers
  • the performance-based metric can then be penalized to take into account cost factors.
  • these cost parameters can be manually entered/tuned by the user.
  • the user can explicitely penalize or favor given routes.
  • BGP is used for this purpose: that is, the computer feeds in the routes via IBGP (implying that the router is a Route Reflector Client of the computer), preserving the next hop address that comes from the remote Egress PoP.
  • the router now has to forward a packet to a remote IP next hop; in this situation, it will perform route recursion, allowing load sharing and resilience.
  • the BGP communication allows PoPs to decide which other PoPs to use.
  • a more local process can be inserted to offer the best path towards the selected PoP.
  • Recursion inherits the load sharing behavior of routers, where flows can be split over multiple routes, but always with 1/n of the flows going to each route. In some cases, a 1/n scheme is a viable initial offering.
  • differential weighting can be required, in which case it is possible to duplicate the router mechanisms to allow moderate diversion from 1/n. In one specific implementation of this idea, multiple similar routes can be inserted to point to the same tunnel. Those skilled in the art can identify other ways of implementing differential weighting.
  • the process of injecting specific static routes towards remote PoPs derives its decisions from the same PoP-to-PoP measurement previously described. Since all paths were probed to generate the simple cross-core metric, these detailed measurements can inform the choice of tunnel after BGP. has selected the egress PoP.
  • the BGP process that monitors inter-PoP tunnels can keep track of which tunnels are optimal, and whenever changes occur, can reconfigure static routes on the router in the packet flow to reflect the new information. These static routes have destinations to match the BGP next hop fields (the addresses provided originally by the remote PoPs in their advertisements). The statics' own next hops point directly to GRE tunnels, which offer transit to the far PoP.
  • the reconfiguration of the statics can be done by a human on the basis of reports generated by a monitoring process at the PoPs.
  • routing towards the Surfer using this class of implementations of two-tier routing includes one or more of:
  • Some embodiments of this invention, described in this section, have the ability to route between PoPs without restriction to direct tunnels. In some embodiments, this is achieved within the lower level static routes, which determine the actual forwarding decision to Bag's chosen Egress PoP. In some implementations of such embodiments, the system that is monitoring the direct paths to other PoPs is extended to generate a moderate amount of test traffic down alternate paths.
  • testing can be limited to a fixed ration of samples per minute, weighted heavily to the historically best performing alternate routes, but occasionally sampling poor or unknown performers in search of significant changes.
  • statics will be added that appear to route to an Egress PoP, but in fact follow a tunnel to an intermediary; in such embodiments, the intermediary PoP can follow its own local routing decision to forward the packets. If no additional loop suppression mechanism is used, such an implementation could conceivably develop loops; indeed, since the various PoPs are deliberately set up to make autonomous decisions, it is possible for the sender and the intermediary to disagree about the correct Egress PoP. In most cases, this is not a problem, but in rare cases a routing loop might develop. In environments where the desire to keep the probability of generating loops as low as possible, some embodiments of this invention can use loop suppression algorithms.
  • An implementation of such a loop suppression technique includes the following: the technique is to disallow dogleg paths of more than three PoPs in the core.
  • the intermediary PoP must know that the packet has already been sent off the direct path once, and it must limit its choices to direct paths to the Egress.
  • the Egress PoP must know that the packet has followed a dogleg, and it must therefore release the packet to the Internet (or deliver it directly without visiting another core PoP).
  • the necessary communication can be achieved by creating "floating" GRE tunnels in addition to the existing direct PoP-to-PoP tunnels.
  • static when probing shows that a candidate way to a remote PoP goes via an intermediary, static should be inserted to temporarily force the floating GRE tunnel between the sender PoP and the remote PoP into a direct path to the intermediary.
  • the choice should be specific; the next hop used for the BGP routes cannot be used, because this can reintroduce loops.
  • Each PoP can be pre-configured with routes that direct anything from the special subnet for a PoP to the direct links to that PoP. In this way, the sender PoP can establish a tunnel to the remote PoP that is coerced to cross precisely one other selected Intermediary PoP.
  • the selection of the direct paths between sender and intermediary, and between intermediary and remote can be simplified to statics that load share across all tunnels.
  • the router removes any statics to paths that have no connectivity; in other embodiments, they can make use of the dynamic performance information we are already collecting for optimal choice of these statics.
  • diverting the forward flow is an application-specific problem.
  • Web traffic is relatively amenable to forward diversion.
  • forward diversion involves, in some embodiments, a special case analysis.
  • specific non-Web applications will be identified and optimized separately.
  • the applications of interest can be altered as to make forward flow diversion easier.
  • the general model proposed involves a specialized device that proxies for the application in question. In some embodiments, this proxy can be established on the fly. In other embodiments, this proxy will need manual configuration.
  • this method involves altering the DNS name embedded in the URL the Surfer is accessing. In some embodiments, this alteration can be made computationally or statically by the Content Provider, based on the logged in identity of the Surfer.
  • the DNS name should be modified on the left (e.g., from www.foo.com to optimized.www.foo.com .)
  • the Content Provider will normally own the authoritative DNS server for foo.com.
  • the Content Provider will insert a referral record for the subdomain "optimized" that has been added.
  • the referral will point to a specialized DNS server, which, in some embodiments, resides in the Bender, and, in other embodiments, resides in a CoLo.
  • the flexibility to return the normal answer for www.foo.com can be exercised; this could be appropriate in case a usage-based SLA has been signed with the CP, and they have reached their limit on how much traffic they can optimize.
  • the forward flow can be bended, so as to simplify the selection of return traffic to accept into the optimized routing fabric.
  • the Bender may no longer need to advertise a /32 to the Content Provider for flows of interest; instead, all to-be-optimized flows can be forced back to the Bender, and no extra flows will be delivered (a potential occurrence with /32 advertisement).
  • the volume of forward flows is substantially less than the returns (most anecdotal measurements imply a 1:6 to 1:8 ratio in volume); hence, in such embodiments, all forward top-be-optimized flows could be accepted without undue threat to the capacity of the core infrastructure.
  • the commitment to send the forward traffic across the optimized routing fabric does not carry a reverse requirement; in some implementations, so long as the Bender or CoLo rack can immediately arrange a packet which the Internet can return to the Surfer, and the Surfer can accept as valid, then the freedom can be kept to only take those return flows where a route with better performance exists.
  • the Web-based approach can involve advertising a DNS response to qualified surfers (potentially selected by the Content Provider); this response is a special address, so that the Surfer sends its forward packets in via one of the PoPs.
  • this address can route all the way through to the Bender location across the optimized routing fabric (using the optimized PoP to PoP routes described earlier).
  • NAT as commonly implemented in load balancing products
  • source NAT as commonly implemented in firewall products, as well as IOS
  • the Content Provider will add a secondary address to their Server (or Server farm, represented by a Load Balancer's VIP address), and a method to route packets from the Bender to that isolated special address. In this case, no NAT is required. In some embodiments, a return to the original Bender formulation with /32 advertisements will be needed.
  • the advantage of such an implementation includes the enhanced ability of the Bender to identify properly qualified traffic; anything incorrectly passing through the Bender will not have the right source address from the Server.
  • this URL/DNS-based technique techniques can be added to protect from such occurrences.
  • such techniques involve the Content Provider to notify that a Surfer is qualified (using the forward bending technique described above). Those skilled in the art will identify other such techniques.
  • the Content Provider could explicitly identify the qualified addresses and, in some embodiments, their "Time To Live” (TTL) value.
  • TTL Time To Live
  • this technique can be combined with DNS redirection, in such a way that flows can be checked as they arrives at the Bender.
  • a flow in case bottleneck avoidance needs to be enhanced, a flow can be permitted by default, but asynchronously looked up in the currently qualified list. In such an implementation, a flow that proves to be unqualified can be simply redirect. In some embodiments, in case the abuse can be proven to be intentional, a TCP RST can be forced into the stream to punish the Surfer. In some embodiments, given the asymmetry of Web traffic, disqualified forward traffic can be simply tolerated, and a negative rule can be added to the Bender's decision process on which flow to take over the optimized routing fabric. (In such an implementation, the unauthorized user can get no benefit on return traffic.) In other embodiments, the forward traffic can be pushed off the optimized routing fabric. The technique could require, in some implementations, the intervention from the Content Provider, who could flag the address to those surfers, and potentially ask them to use HTML redirection to guide the Surfer back to the usual non-optimized Internet.
  • Figure 3a shows an internetwork1 with a network device can decide to redirect flows directly bound for internetwork 4 to another internetwork with a network device, like internetwork 2, or to an internetwork without a network device, like internetwork 3.
  • Figure 3b shows an internetwork1 can have both flow endpoints inside of it, and can have multiple network devices deployed to obtain measurements, calculate metrics, select paths, and alter routing in the internetwork.
  • a measurement packet is a packet sent by a sender over an internetwork that includes information necessary for the receiver of the packet to compute measurements of the performance characteristics of the path the packet has traversed over that internetwork.
  • the information includes information for a receiver of the measurement packet to compute measurements of performance characteristics of at least a portion of the path of the measurement packet; and data including one or more of measurement statistics, a generic communication channel, network information, and control data directing a receiver of the measurement packet to change one or more configuration parameters of the receiver.
  • the information included in the measurement packet to compute measurements includes at least one of a timestamp of a sending time of the packet and a number to identify the packet by itself and/ to identify the relative position of the measurement packet in a sequence of measurement packets,
  • the measurement packet is implemented using the following data structure:
  • the mGeneration field is used to detect when a sending process has started a new session. This field is used by the receiver to determine that a discontinuity in the stream's sequence numbers is the result of a sender restart, rather than due to large network latencies, duplicate packets or dropped packets.
  • sequence number mSequence field is incremented by one each time a packet is sent. This approach allows the receiver to deduce lost and duplicate packets by identifying missing and duplicate sequence numbers.
  • the mSendTime field contains the time at which the packet was sent, represented as microseconds since January 1, 1970 UTC. This field is compared to the time the packet arrived at the receiver to determine the delay between the sender and the receiver.
  • a plurality of one or more packets are sent over a path continuously.
  • the continuous stream of packet is denoted as a measurement stream.
  • Each measurement stream is uniquely identified by the source and destination IP addresses.
  • the sender maintains one socket descriptor for each source IP address it sends from and writes the destination IP address into the mDstAddr field.
  • the source IP address is returned by the recv() system call and the destination address is retrieved from the measurement packet.
  • data will be included, including one or more of measurement statistics, a generic communication channel, network information, and control data directing a receiver of the measurement packet to change one or more configuration parameters of the receiver.
  • Some embodiments of the invention will add a single type of data to each packet. Some embodiments of the invention will use a complex data, including subpackets.
  • Some embodiments of the invention use subpackets that include a single byte subpacket type identifier, followed by a 2-byte length field (including the length of the type and length fields) and finally including the data that is to be sent.
  • One embodiment will store all values in network byte order. Other byte orders will be apparent to those skilled in the art.
  • the following data structure definition describes some embodiments.
  • One embodiment of this invention will include data describing a momentary snapshot of the measurement statistics for a given path between a sender and a receiver.
  • this data will include one or more of the following information: the source and destination IP addresses that define the path, a measurement packet size for which the statistics have been calculated as well as computed measurement statistics that are at least partly responsive to delay; computed measurement statistics that are at least partly responsive to jitter and computed measurement statistics that are at least partly responsive to packet loss.
  • these statistics will be in units of microseconds expressed as 64-bit floating-point quantities and transmitted in a standard network byte order.
  • the following data structure will store the computed statistics:
  • Some embodiments of this invention include the time at which the statistics were computed such that those statistics are sent over multiple paths for improved reliability and to take advantage of one path having less delay than another.
  • One embodiment at the receiving end is able to compare the computation times of received statistics to place them in their original temporal order, regardless of their relative arrival times over the paths.
  • Some embodiments of this invention will send computed statistics specific to the paths that are part of the plurality of one or more paths that are between the specific sender and receiver. Other embodiments will send additional computed statistics for paths that are not one of the plurality of one or more paths that are between the specific sender and receiver.
  • Some embodiments of this invention will include network information concerning network topology including but not limited to information retrieved from routers such as in-bound or out-bound link utilization, inbound or out-bound link bandwidth and/or CPU utilization. Other network information determined from routers and other network devices will be apparent to someone skilled in the art.
  • Some embodiments of this invention will also include control data directing a receiver of the measurement packet to change one or more configuration parameters of the receiver.
  • control data will instruct a receiver to alter its configuration, including but not limited to zero or more of the following examples: instructing a receiver to initiate sending a plurality of one or more measurement packets, change one or more of the measurement packet sizes, inter-measurement packet transmission times and mix of packet sizes, and stop sending one or more of the plurality of measurement packets.
  • this control information will include notification of measurement devices that have joined or left the network.
  • the measurement packets will be encrypted by the sender and decrypted by the receiver. Some of these embodiments will use IPSec.
  • the encryption and decryption will be done by an external device using IPSec.
  • the measurement packets will be digitally signed.
  • a generic communication channel will be used by a sender and a receiver to communicate data between them.
  • Measurements are used to compute performance characteristics of the paths traversed by the measurement packets.
  • the measurements can either be computed from the measurement packets themselves, or extracted from the arbitrary data carried by the measurement packets.
  • the measurements off performance characteristics include at least one or more of one-way measurements and round-trip measurements.
  • the performance characteristics include at least one or more reachability, delay, jitter, loss, available bandwidth, and total bandwidth. Other performance characteristics will be apparent to those skilled in the art.
  • delay measurements are computed as the interval of time from the moment the measurement packet is sent by the sender to the moment of time the measurement packet is received by the receiver.
  • the sending time is carried by the packet, and it is measured by the clock the sender refers to.
  • the receiving time is measured by a clock that the receiver refers to, which may or may not be synchronized with the sender's clock.
  • the clock of the sender and the clock of the receiver are synchronized.
  • a plurality of one or more precise clock inputs such as GPS, NTP, IRIG and NIST will be used.
  • Some embodiments of this invention will use the same clock as an input to more than one of the plurality of one or more senders and receivers.
  • the clock of the sender and the clock of the receiver are the same.
  • the clock of the sender and the clock of the receiver are not synchronized, and mechanisms based on the measurement data are used to correct the clock skew and clock drift, the mechanisms including using minimum delay across multiple measurement samples, and using a mechanism to track the minimum delay over time.
  • Some embodiments of the invention will use the minimum round-trip delay between the devices to place a lower bound on clock skew.
  • Some embodiments of the invention will use the lower bound of multiple paths between the sender and receiver to further reduce the lower bound.
  • Some embodiments of the invention will correct for clock drift by tracking the relative clock skew between the sender and receiver over time and adjusting for the slope of the drift.
  • jitter measurements also known as inter-measurement packet delay variations
  • inter-measurement packet delay variations are computed as the difference in delay on consecutive, successfully received packets.
  • jitter can also be computed as the difference between the instantaneous delay of a packet, and the average delay of all the measurement packets previously received.
  • loss measurements are computed by assigning a timeout value to each measurement packet that indicates the instant of time after which the measurement packet will be declared lost, if the packet has not arrived by that time.
  • the timeout value of a measurement packet can be computed with the transmission time of a previously received packet, an estimation of the inter-transmission time between measurement packet, and an estimation of the transmission delay of the measurement packet.
  • the inter-transmission time can be estimated if the receiver knows about the scheduling pattern of transmission of measurement packets.
  • the transmission delay of packet can be estimated based on delay and jitter performance characteristics.
  • Performance characteristics of a path could be the measurement themselves, or statistics on those measurements.
  • a dynamic algorithm is used to updates the statistics associated with a path with every new measurement obtained with the arrival of every new packet over the path.
  • the algorithm computes statistics over the performance characteristics of the path.
  • the statistics include averages, deviations, and variances. Other statistics will be apparent to those skilled in the art.
  • averages can be computed using a plurality of one or more techniques including a moving average, an average based on the Robbins-Moro estimator, a window-based average or a bucket-based average. Other techniques to compute averages will be apparent to those skilled in the art.
  • the moving average is an exponentially moving average computed using a Robbins-Moro estimator.
  • ⁇ is constant.
  • v is the exponentially moving average of jitter
  • is the last sample of jitter
  • m is the last delay sample
  • m ' is the previous delay sample
  • ⁇ is the weight of the average.
  • d is the average delay
  • v is the average jitter
  • M is a constant.
  • ⁇ is determined based on the notion of forgiveness against a single packet loss.
  • the forgiveness period is the interval of time between the time the packet loss occurs and the time the average loss is forgiven.
  • the forgiveness period can be either defined in units of time, or in number of packets if the rate of the monitoring flow is known. That is, the forgiveness period will end after n consecutive packets have been received after the loss, when these packets have been transmitted at a certain rate.
  • the value of the exponentially moving average after receiving the n packets is needed before ⁇ can be determined, and this value is known as the forgiveness threshold.
  • the forgiveness threshold is chosen arbitrarily.
  • the forgiveness threshold takes the value: 1 ⁇ 2 1 - ⁇
  • This value is half of the value of the estimator after the singe loss occurs, and thus we call it the half-life threshold. Similarly, we also call the forgiveness period under this threshold the half-life period.
  • the advantage of using a forgiveness treshold greats than zero is that issues related to host-dependent floating-point representations reaching that value are avoided.
  • ⁇ exp ln 1 ⁇ 2 / n
  • two thresholds are defined, an upper threshold and a lower threshold.
  • an upper threshold When the value of p-hat exceeds the upper threshold, the loss is not forgiven until enough measurement packets are received consecutively so that the value of p-hat gets below the lower threshold.
  • the path traversed by the measurement packets from the sender to the receiver is such that the path is at least partly implemented with at least one of a GRE tunnel, an IPSEC tunnel and IPonIP tunnel.
  • Other path implementations using tunnel will be apparent for those skilled in the art.
  • the path traversed by the measurement packets from the sender to the receiver is implemented with a virtual circuit, including a frame relay PVC, an ATM PVC or MPLS.
  • a virtual circuit including a frame relay PVC, an ATM PVC or MPLS.
  • Other path implementations using virtual circuits will be apparent for those skilled in the art.
  • the internetwork is implemented by a plurality of one or more subnetworks, including a plurality of one or more
  • VPNs a plurality of one or more BGP autonomous systems, a plurality of one or more local area networks, a plurality of one or metropolitan area networks, and a plurality of one or morewide area networks.
  • the internetwork is implemented by an overlay network.
  • the measurement packets are of varying sizes, including 64, 256, 512, 1024, 1500 bytes.
  • the size of the measurement packets is specified with an external API.
  • the measurement packets are of a fixed size.
  • the measurement packet sizes and times between measurement packets simulate the traffic pattern of a plurality of one or more applications
  • traffic patterns correspond to voice applications, where the packets re of small size, e.g., 30 bytes, and the inter-transmission time between consecutive packets is constant, e.g., 10 ms. These examples do not limit the possible size values and inter-transmission time values.
  • traffic patterns correspond to video applications, where the packets size is the largest permitted to be transmitted by an internetwork without being fragmented, and the inter-transmission time between consecutive packets varies depending on the spatial and temporal complexity of the video content being transmitted, the compression scheme, the encoding control scheme.
  • traffic patterns correspond to the plurality of applications observed in an internetwork, including at least one or more of HTTP transactions, FTP downloads, IRG communications, NNTP exchanges, streaming video sessions, VoIP sessions, videoconferencing sessions and e-commerce transactions.
  • HTTP transactions including at least one or more of HTTP transactions, FTP downloads, IRG communications, NNTP exchanges, streaming video sessions, VoIP sessions, videoconferencing sessions and e-commerce transactions.
  • IRG communications including at least one or more of HTTP transactions, FTP downloads, IRG communications, NNTP exchanges, streaming video sessions, VoIP sessions, videoconferencing sessions and e-commerce transactions.
  • the inter-measurement packet transmission times are of varying length.
  • the inter-measurement packet transmission times are of fixed length.
  • the inter-measurement packet transmission times specified with an external API specified with an external API.
  • the length of the inter-measurement packet transmission times is randomized according to a distribution. In some embodiments of the invention, this distribution is based at least in part on a uniform distribution. In some embodiments of the invention, this distribution is based at least in part on an exponential distribution. In some embodiments of the invention, this distribution is based at least in part on a geometric distribution. Other distributions will be apparent to those skilled in the art.
  • the length of the inter-measurement packet transmission times is provided by a table.
  • the length of the inter-measurement packet transmission times is controlled by a scheduler.
  • the scheduler uses a priority queue, keyed on desired send time.
  • the subset of the plurality of paths is selected based at least in part on at least one of: one or more of the measurement statistics from the measurement packet and one or more of the computed statistics.
  • the selection of the subset of the plurality of paths is based at least partly on the position of paths in a ranking.
  • the ranking is at least partly based on one or more of the measurement statistics included as data in the measurement packet.
  • the ranking is at least partly based on the computed statistics of the path.
  • the ranking is implemented by using a comparison function to compare the paths, and by ordering the paths in a decreasing order.
  • the ranking is implemented by using a comparison function to compare the paths, and by ordering the paths in an increasing order. Other ranking techniques will be apparent to those skilled in the art.
  • the ranking is based on a single score associated to each path.
  • ML the Magic Latency, a component of the MS obtained using delay and jitter respectively calculated with statistics
  • MF the Magic scaling Factor that multiplies the value of ML, and is computed based on loss statistics.
  • M is a constant that takes several values, including 4, for example.
  • MS can be seen as a scaled-up version of ML, and the scaling factor MF is a function of p-hat and delta, a constant.
  • p-hat As p-hat not only reflects loss but also detects large delay spikes before they happen, p-hat can be seen as an indicator of the departure of the path from a "normal mode" operation, and thus the scaling factor is only applied when there are loss or spikes.
  • the goal of MF is to differentiate between paths that have very similar delay characteristics, but with one having losses and the other not having them.
  • ML is used as a delay indicator, given that jitter is accounted as an increase in delay.
  • the selection of a subset of paths is based on applying at least one or more thresholds to at least one of more of the statistics.
  • a single threshold is used, and computed as a certain percentage of the highest score of the paths. In some embodiments of the invention, the threshold is determined by subtracting a fixed quantity to the highest score of the paths.
  • the number of paths in the subset of paths is fixed. In some embodiments of the invention, this fixed number of paths N out of M paths is determined such that the probability of having loss in (M - N) paths simultaneously is less than a certain threshold. In some embodiments of the invention, this probability is a binomial, with the assumption that all paths have the same probability of loss.
  • the selection of the subset of the plurality of paths is based at least partly on a probability associated with each path.
  • the probability of each path is at least partly based on one or more of the measurement statistics included as data in the measurement packet.
  • the probabilities of each path are equal.
  • the selection of the subset of the plurality of paths is based at least partly on the cost of the path.
  • the selection of the subset of the plurality of paths is based at least partly on the amount of bandwidth consumed over a period of time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Traffic Control Systems (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Train Traffic Observation, Control, And Security (AREA)
  • Devices For Checking Fares Or Tickets At Control Points (AREA)
  • Circuits Of Receivers In General (AREA)
  • Communication Control (AREA)
EP01979856A 2000-10-17 2001-10-17 Method and apparatus for the assessment and optimization of network traffic Expired - Lifetime EP1350363B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP07002502A EP1826947A3 (en) 2000-10-17 2001-10-17 Method and apparatus for the assessment and optimization of network traffic

Applications Claiming Priority (13)

Application Number Priority Date Filing Date Title
US923924 1986-10-28
US24145000P 2000-10-17 2000-10-17
US241450P 2000-10-17
US27520601P 2001-03-12 2001-03-12
US275206P 2001-03-12
US09/903,423 US7363367B2 (en) 2000-10-17 2001-07-10 Systems and methods for robust, real-time measurement of network performance
US09/903,441 US7080161B2 (en) 2000-10-17 2001-07-10 Routing information exchange
US903423 2001-07-10
US903441 2001-07-10
US09/923,924 US7406539B2 (en) 2000-10-17 2001-08-06 Method and apparatus for performance and cost optimization in an internetwork
US960623 2001-09-20
US09/960,623 US7349994B2 (en) 2000-10-17 2001-09-20 Method and apparatus for coordinating routing parameters via a back-channel communication medium
PCT/US2001/032319 WO2002033895A2 (en) 2000-10-17 2001-10-17 Method and apparatus for the assesssment and optimization of network traffic

Related Child Applications (2)

Application Number Title Priority Date Filing Date
EP07002502A Division EP1826947A3 (en) 2000-10-17 2001-10-17 Method and apparatus for the assessment and optimization of network traffic
EP07002502.8 Division-Into 2007-02-06

Publications (2)

Publication Number Publication Date
EP1350363A2 EP1350363A2 (en) 2003-10-08
EP1350363B1 true EP1350363B1 (en) 2011-08-24

Family

ID=27559305

Family Applications (1)

Application Number Title Priority Date Filing Date
EP01979856A Expired - Lifetime EP1350363B1 (en) 2000-10-17 2001-10-17 Method and apparatus for the assessment and optimization of network traffic

Country Status (7)

Country Link
US (2) US7349994B2 (xx)
EP (1) EP1350363B1 (xx)
AT (1) ATE522041T1 (xx)
AU (4) AU2001294993A1 (xx)
CA (2) CA2424680C (xx)
IL (3) IL155356A0 (xx)
WO (3) WO2002033915A1 (xx)

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7720959B2 (en) 2000-10-17 2010-05-18 Avaya Inc. Method and apparatus for characterizing the quality of a network path
ATE459154T1 (de) 2000-10-17 2010-03-15 Avaya Technology Corp Verfahren und vorrichtung zur optimierung der leistung und des kosten in einem internetzwerk
US7756032B2 (en) 2000-10-17 2010-07-13 Avaya Inc. Method and apparatus for communicating data within measurement traffic
US7487237B2 (en) * 2000-10-17 2009-02-03 Avaya Technology Corp. Load optimization
US8023421B2 (en) * 2002-07-25 2011-09-20 Avaya Inc. Method and apparatus for the assessment and optimization of network traffic
US7269157B2 (en) 2001-04-10 2007-09-11 Internap Network Services Corporation System and method to assure network service levels with intelligent routing
US7668966B2 (en) * 2001-11-02 2010-02-23 Internap Network Services Corporation Data network controller
US7561517B2 (en) 2001-11-02 2009-07-14 Internap Network Services Corporation Passive route control of data networks
US7133365B2 (en) * 2001-11-02 2006-11-07 Internap Network Services Corporation System and method to provide routing control of information over networks
US7222190B2 (en) * 2001-11-02 2007-05-22 Internap Network Services Corporation System and method to provide routing control of information over data networks
JP4080765B2 (ja) * 2002-03-01 2008-04-23 株式会社日立製作所 ネットワークシステム
WO2004036825A1 (en) * 2002-10-15 2004-04-29 Telefonaktiebolaget Lm Ericsson (Publ) System for providing flexible charging in a network
US7359930B2 (en) * 2002-11-21 2008-04-15 Arbor Networks System and method for managing computer networks
AU2003300900A1 (en) * 2002-12-13 2004-07-09 Internap Network Services Corporation Topology aware route control
US7983239B1 (en) 2003-01-07 2011-07-19 Raytheon Bbn Technologies Corp. Systems and methods for constructing a virtual model of a multi-hop, multi-access network
US8161152B2 (en) * 2003-03-18 2012-04-17 Renesys Corporation Methods and systems for monitoring network routing
US9137033B2 (en) 2003-03-18 2015-09-15 Dynamic Network Services, Inc. Methods and systems for monitoring network routing
US7881229B2 (en) * 2003-08-08 2011-02-01 Raytheon Bbn Technologies Corp. Systems and methods for forming an adjacency graph for exchanging network routing data
US7606927B2 (en) * 2003-08-27 2009-10-20 Bbn Technologies Corp Systems and methods for forwarding data units in a communications network
US8166204B2 (en) * 2003-08-29 2012-04-24 Raytheon Bbn Technologies Corp. Systems and methods for automatically placing nodes in an ad hoc network
US20050071469A1 (en) * 2003-09-26 2005-03-31 Mccollom William G. Method and system for controlling egress traffic load balancing between multiple service providers
US8295175B2 (en) * 2003-09-30 2012-10-23 Ciena Corporation Service metrics for managing services transported over circuit-oriented and connectionless networks
US8139475B2 (en) * 2004-07-29 2012-03-20 Telecom Italia S.P.A. Method and system for fault and performance recovery in communication networks, related network and computer program product therefor
CA2549577A1 (en) 2004-09-09 2006-03-16 Avaya Technology Corp. Methods of and systems for network traffic security
US7630392B2 (en) * 2005-05-31 2009-12-08 Cisco Technology, Inc. Multi-homing using controlled route leakage at a backup service provider
WO2006133622A1 (fr) * 2005-06-13 2006-12-21 Huawei Technologies Co., Ltd. Système de commande de passerelle de paquets/périphérie et procédé de commande par la passerelle de paquets/périphérie
US7675912B1 (en) * 2005-07-05 2010-03-09 Cisco Technology, Inc. Method and apparatus for border gateway protocol (BGP) auto discovery
EP1910938A2 (en) * 2005-07-08 2008-04-16 At&T Corp. Method and system for gateway selection in inter-region communication on ip networks
US7706280B2 (en) * 2005-08-01 2010-04-27 Limelight Networks, Inc. Heavy load packet-switched routing
US7961625B2 (en) 2005-08-01 2011-06-14 Limelight Networks, Inc. Routing under heavy loading
US7647426B2 (en) * 2006-01-12 2010-01-12 Cisco Technology, Inc. Method and apparatus for achieving Border Gateway Protocol convergence using alternate route information
US7688819B2 (en) * 2006-03-06 2010-03-30 Cisco Technology, Inc. Faster routing protocol convergence using efficient message markup
JP4981924B2 (ja) * 2006-12-27 2012-07-25 インテル・コーポレーション ルートメトリックを決定する方法および装置
US8289845B1 (en) 2007-05-15 2012-10-16 Avaya Inc. Assured path optimization
US8233905B2 (en) * 2007-06-15 2012-07-31 Silver Spring Networks, Inc. Load management in wireless mesh communications networks
US8645568B2 (en) * 2007-11-16 2014-02-04 Equinix, Inc. Various methods and apparatuses for a route server
US8169921B2 (en) 2008-09-30 2012-05-01 At&T Intellectual Property I, Lp Methods and apparatus to monitor border gateway protocol sessions
US7894461B2 (en) * 2008-11-20 2011-02-22 At&T Intellectual Property I, L.P. Methods and apparatus to infer the status of border gateway protocol sessions
US8488490B2 (en) * 2009-10-14 2013-07-16 At&T Intellectual Property I, L.P. Methods and apparatus to determine a capacity for a network layer topology
US9503375B1 (en) * 2010-06-30 2016-11-22 F5 Networks, Inc. Methods for managing traffic in a multi-service environment and devices thereof
US8719926B2 (en) * 2011-02-11 2014-05-06 Verizon Patent And Licensing Inc. Denial of service detection and prevention using dialog level filtering
US11178244B2 (en) * 2011-08-09 2021-11-16 Comcast Cable Communications, Llc Content delivery network routing using border gateway protocol
US8976710B2 (en) * 2011-12-27 2015-03-10 Infosys Limited Methods for discovering and analyzing network topologies and devices thereof
US9137142B2 (en) * 2012-03-31 2015-09-15 Juniper Networks, Inc. Reduced traffic loss for border gateway protocol sessions in multi-homed network connections
US8743893B2 (en) 2012-05-18 2014-06-03 Renesys Path reconstruction and interconnection modeling (PRIM)
US8989046B1 (en) 2012-11-12 2015-03-24 The Aerospace Corporation Inter-domain routing message distribution through wide area broadcast channel
US10003536B2 (en) 2013-07-25 2018-06-19 Grigore Raileanu System and method for managing bandwidth usage rates in a packet-switched network
US9525638B2 (en) 2013-10-15 2016-12-20 Internap Corporation Routing system for internet traffic
US10924408B2 (en) 2014-11-07 2021-02-16 Noction, Inc. System and method for optimizing traffic in packet-switched networks with internet exchanges
US9769070B2 (en) 2015-01-28 2017-09-19 Maxim Basunov System and method of providing a platform for optimizing traffic through a computer network with distributed routing domains interconnected through data center interconnect links
US10505818B1 (en) 2015-05-05 2019-12-10 F5 Networks. Inc. Methods for analyzing and load balancing based on server health and devices thereof
US10091330B2 (en) * 2016-03-23 2018-10-02 Cisco Technology, Inc. Interest scheduling by an information and data framework in a content centric network
EP3677003A4 (en) * 2017-08-31 2021-05-26 Pensando Systems Inc. METHODS AND SYSTEMS FOR OVERLOAD MANAGEMENT IN A NETWORK
US11212227B2 (en) 2019-05-17 2021-12-28 Pensando Systems, Inc. Rate-optimized congestion management
US11595308B2 (en) * 2019-06-13 2023-02-28 At&T Intellectual Property I, L.P. Closed loop prefix management and controller for whiteboxes
US11394700B2 (en) 2020-01-31 2022-07-19 Pensando Systems Inc. Proxy service through hardware acceleration using an IO device
US11431681B2 (en) 2020-04-07 2022-08-30 Pensando Systems Inc. Application aware TCP performance tuning on hardware accelerated TCP proxy services

Family Cites Families (261)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA1118084A (en) 1979-06-22 1982-02-09 Edmund Szybicki Alternate routing for a telephone system
US4345116A (en) 1980-12-31 1982-08-17 Bell Telephone Laboratories, Incorporated Dynamic, non-hierarchical arrangement for routing traffic
US4495570A (en) * 1981-01-14 1985-01-22 Hitachi, Ltd. Processing request allocator for assignment of loads in a distributed processing system
FR2555388B1 (fr) * 1983-11-23 1986-02-21 Cit Alcatel Dispositif de secours d'un terminal d'abonne dans un concentrateur numerique
JPS61114363A (ja) * 1984-11-07 1986-06-02 Hitachi Ltd 計算機システム間ジヨブ転送方式
US4901244A (en) * 1985-01-25 1990-02-13 Szeto Lai Wan M Apparatus for, and method of, analyzing signals
US4669113A (en) * 1985-04-26 1987-05-26 At&T Company Integrated network controller for a dynamic nonhierarchical routing switching network
US4726017A (en) * 1985-05-21 1988-02-16 Fla. Multidrop data concentrator communication network
US5287537A (en) * 1985-11-15 1994-02-15 Data General Corporation Distributed processing system having plural computers each using identical retaining information to identify another computer for executing a received command
US4704724A (en) 1985-12-05 1987-11-03 Bell Communications Research, Inc. Routing of network traffic
US4748658A (en) * 1986-07-16 1988-05-31 Bell Communications Research, Inc. Architecture for allocating resources in a telecommunications network
US4788721A (en) 1987-12-09 1988-11-29 Bell Communications Research, Inc. Routing of network traffic
US4920432A (en) * 1988-01-12 1990-04-24 Eggers Derek C System for random access to an audio video data library with independent selection and display at each of a plurality of remote locations
US4949248A (en) 1988-07-15 1990-08-14 Caro Marshall A System for shared remote access of multiple application programs executing in one or more computers
US4931941A (en) * 1988-07-25 1990-06-05 Bell Communications Research, Inc. Adaptive routing of network traffic
US4949187A (en) 1988-12-16 1990-08-14 Cohen Jason M Video communications system having a remotely controlled central source of video and audio data
US5341477A (en) 1989-02-24 1994-08-23 Digital Equipment Corporation Broker for computer network server selection
US5072371A (en) * 1989-03-01 1991-12-10 The United States Of America As Represented By The United States Department Of Energy Method for simultaneous overlapped communications between neighboring processors in a multiple
US4939726A (en) * 1989-07-18 1990-07-03 Metricom, Inc. Method for routing packets in a packet communication network
US5471622A (en) 1989-10-04 1995-11-28 Paralogic, Inc. Run-time system having nodes for identifying parallel tasks in a logic program and searching for available nodes to execute the parallel tasks
US5652841A (en) * 1990-02-06 1997-07-29 Nemirovsky; Paul Method and apparatus for aggregating terminals into clusters to assist in the construction of a distributed data communication network
JPH05505709A (ja) * 1990-03-05 1993-08-19 マサチユセツツ・インスチチユート・オブ・テクノロジー メツセージ経路指定のための拡大及び／又は分散論理クラスターを有する交換網
US5142570A (en) 1990-06-15 1992-08-25 Bell Communications Research, Inc. Routing of network traffic using discrete traffic measurement data
US5172413A (en) 1990-12-20 1992-12-15 Sasktel Secure hierarchial video delivery system and method
US5471623A (en) * 1991-02-26 1995-11-28 Napolitano, Jr.; Leonard M. Lambda network having 2m-1 nodes in each of m stages with each node coupled to four other nodes for bidirectional routing of data packets between nodes
US5253341A (en) 1991-03-04 1993-10-12 Rozmanith Anthony I Remote query communication system
EP0504537A1 (en) * 1991-03-22 1992-09-23 International Business Machines Corporation Method and apparatus for the testing and evaluation of geographically distributed telecommunication networks
EP0528075A1 (en) 1991-08-19 1993-02-24 ALCATEL BELL Naamloze Vennootschap Performance measurement device for a telecommunication path and method used therein
DE69232164T2 (de) 1991-08-22 2002-07-18 Sun Microsystems, Inc. Netzwerkvideoanbietergerät und-verfahren
US5528281A (en) * 1991-09-27 1996-06-18 Bell Atlantic Network Services Method and system for accessing multimedia data over public switched telephone network
US5247347A (en) * 1991-09-27 1993-09-21 Bell Atlantic Network Services, Inc. Pstn architecture for video-on-demand services
US5481738A (en) * 1992-02-20 1996-01-02 International Business Machines Corporation Apparatus and method for communicating a quiesce and unquiesce state between elements of a data processing complex
US5371532A (en) 1992-05-15 1994-12-06 Bell Communications Research, Inc. Communications architecture and method for distributing information services
US5291554A (en) * 1992-05-28 1994-03-01 Tv Answer, Inc. Shared-price custom video rentals via interactive TV
EP0598969B1 (en) 1992-11-27 1999-02-10 International Business Machines Corporation Inter-domain multicast routing
US5442389A (en) 1992-12-28 1995-08-15 At&T Corp. Program server for interactive television system
EP0608653A1 (en) 1993-01-26 1994-08-03 International Business Machines Corporation Method and system for routing information between nodes in a communication network
US5375070A (en) 1993-03-01 1994-12-20 International Business Machines Corporation Information collection architecture and method for a data communications network
US5508732A (en) * 1993-03-22 1996-04-16 International Business Machines Corporation Data server, control server and gateway architecture system and method for broadcasting digital video on demand
US5406502A (en) * 1993-06-29 1995-04-11 Elbit Ltd. System and method for measuring the operation of a device
US5414455A (en) * 1993-07-07 1995-05-09 Digital Equipment Corporation Segmented video on demand system
US5442390A (en) 1993-07-07 1995-08-15 Digital Equipment Corporation Video on demand with memory accessing and or like functions
US5631897A (en) * 1993-10-01 1997-05-20 Nec America, Inc. Apparatus and method for incorporating a large number of destinations over circuit-switched wide area network connections
BE1007682A3 (nl) 1993-10-29 1995-09-12 Philips Electronics Nv Schakelinrichting.
US6197065B1 (en) * 1993-11-01 2001-03-06 Biomet, Inc. Method and apparatus for segmental bone replacement
JP3420621B2 (ja) * 1993-11-04 2003-06-30 富士通株式会社 通信網の分散型経路選択制御装置
JP3361865B2 (ja) * 1993-12-13 2003-01-07 富士通株式会社 スタティックなルーティング情報の自動設定方法およびルーティング情報の自動設定を行うコンピュータ
US5974457A (en) 1993-12-23 1999-10-26 International Business Machines Corporation Intelligent realtime monitoring of data traffic
US5475615A (en) 1993-12-23 1995-12-12 U S West Advanced Technologies, Inc. Method and system for sizing interactive video delivery systems
US5636216A (en) * 1994-04-08 1997-06-03 Metricom, Inc. Method for translating internet protocol addresses to other distributed network addressing schemes
US5668800A (en) 1994-05-02 1997-09-16 International Business Machines Corporation Path testing in communications networks
US5535195A (en) * 1994-05-06 1996-07-09 Motorola, Inc. Method for efficient aggregation of link metrics
US5467345A (en) 1994-05-31 1995-11-14 Motorola, Inc. Packet routing system and method therefor
US5694546A (en) * 1994-05-31 1997-12-02 Reisman; Richard R. System for automatic unattended electronic information transport between a server and a client by a vendor provided transport software with a manifest list
US5515511A (en) * 1994-06-06 1996-05-07 International Business Machines Corporation Hybrid digital/analog multimedia hub with dynamically allocated/released channels for video processing and distribution
US5452294A (en) 1994-07-05 1995-09-19 Motorola, Inc. Method and apparatus for adaptive route selection in communication networks
JP3224963B2 (ja) 1994-08-31 2001-11-05 株式会社東芝 ネットワーク接続装置及びパケット転送方法
US5519435A (en) * 1994-09-01 1996-05-21 Micropolis Corporation Multi-user, on-demand video storage and retrieval system including video signature computation for preventing excessive instantaneous server data rate
EP0701349A1 (fr) * 1994-09-07 1996-03-13 T.R.T. Telecommunications Radioelectriques Et Telephoniques Système et noeud de transmission de données avec surveillance de l'engorgement
US5675741A (en) 1994-10-25 1997-10-07 Cabletron Systems, Inc. Method and apparatus for determining a communications path between two nodes in an Internet Protocol (IP) network
US6751562B1 (en) * 2000-11-28 2004-06-15 Power Measurement Ltd. Communications architecture for intelligent electronic devices
NL9500512A (nl) * 1995-03-15 1996-10-01 Nederland Ptt Inrichting voor het bepalen van de kwaliteit van een door een signaalbewerkingscircuit te genereren uitgangssignaal, alsmede werkwijze voor het bepalen van de kwaliteit van een door een signaalbewerkingscircuit te genereren uitgangssignaal.
US5659796A (en) * 1995-04-13 1997-08-19 Cray Research, Inc. System for randomly modifying virtual channel allocation and accepting the random modification based on the cost function
JP2666769B2 (ja) * 1995-05-16 1997-10-22 日本電気株式会社 インタネットプロトコルルーティング方法及び装置
US5654958A (en) 1995-06-05 1997-08-05 Motorola, Inc. System and method for learning and dynamic routing of data in a mobile communication network
US6393486B1 (en) * 1995-06-23 2002-05-21 Cisco Technology, Inc. System and method using level three protocol information for network centric problem analysis and topology construction of actual or planned routed network
US5563875A (en) 1995-07-10 1996-10-08 International Business Machines Corporation Wrap-around route testing in packet communications networks
US5826253A (en) 1995-07-26 1998-10-20 Borland International, Inc. Database system with methodology for notifying clients of any additions, deletions, or modifications occurring at the database server which affect validity of a range of data records cached in local memory buffers of clients
US5590126A (en) 1995-09-27 1996-12-31 Lucent Technologies Inc. Method for call establishment and rerouting in mobile computing networks
US5629930A (en) * 1995-10-31 1997-05-13 Northern Telecom Limited Call routing in an ATM switching network
US5754639A (en) * 1995-11-03 1998-05-19 Lucent Technologies Method and apparatus for queuing a call to the best split
JPH09135032A (ja) 1995-11-08 1997-05-20 Mitsubishi Electric Corp 加速度検出用混成集積回路装置
US5812528A (en) 1995-11-17 1998-09-22 Telecommunications Techniques Corporation Measuring round trip time in ATM network virtual connections
US5822520A (en) 1995-12-26 1998-10-13 Sun Microsystems, Inc. Method and apparatus for building network test packets
US5845091A (en) 1996-02-15 1998-12-01 Bay Networks, Inc. Forwarding of internetwork packets to a destination network via a selected one of a plurality of paths
US5793976A (en) 1996-04-01 1998-08-11 Gte Laboratories Incorporated Method and apparatus for performance monitoring in electronic communications networks
US6085238A (en) * 1996-04-23 2000-07-04 Matsushita Electric Works, Ltd. Virtual LAN system
US5787253A (en) * 1996-05-28 1998-07-28 The Ag Group Apparatus and method of analyzing internet activity
US5940478A (en) 1996-05-31 1999-08-17 Octel Communications Corporation Method and system for extended addressing plans
US5892754A (en) * 1996-06-07 1999-04-06 International Business Machines Corporation User controlled adaptive flow control for packet networks
US5944779A (en) * 1996-07-02 1999-08-31 Compbionics, Inc. Cluster of workstations for solving compute-intensive applications by exchanging interim computation results using a two phase communication protocol
US5841775A (en) 1996-07-16 1998-11-24 Huang; Alan Scalable switching network
US6185601B1 (en) * 1996-08-02 2001-02-06 Hewlett-Packard Company Dynamic load balancing of a network of client and server computers
US5805594A (en) 1996-08-23 1998-09-08 International Business Machines Corporation Activation sequence for a network router
US6148000A (en) * 1996-10-02 2000-11-14 International Business Machines Corporation Merging of data cells at network nodes
DE19655360B4 (de) 1996-11-04 2010-12-09 Valeo Schalter Und Sensoren Gmbh Verfahren und Abstandsmesseinrichtung zur von den Fahrzeugdaten abhängigen Abstandsmessung von Hindernissen
US5802106A (en) 1996-12-06 1998-09-01 Packeteer, Inc. Method for rapid data rate detection in a packet communication environment without data rate supervision
US6012088A (en) * 1996-12-10 2000-01-04 International Business Machines Corporation Automatic configuration for internet access device
CA2273239C (en) * 1996-12-13 2003-06-10 John Gerard Beerends Device and method for signal quality determination
US6226266B1 (en) 1996-12-13 2001-05-01 Cisco Technology, Inc. End-to-end delay estimation in high speed communication networks
US6052718A (en) * 1997-01-07 2000-04-18 Sightpath, Inc Replica routing
US6549954B1 (en) * 1997-01-16 2003-04-15 Advanced Micro Devices, Inc. Object oriented on-chip messaging
US6034946A (en) 1997-04-15 2000-03-07 International Business Machines Corporation Selection of routing paths in data communications networks to satisfy multiple requirements
US6286045B1 (en) 1997-05-19 2001-09-04 Matchlogic, Inc. Information storage and delivery over a computer network using centralized intelligence to monitor and control the information being delivered
US6341309B1 (en) * 1997-05-27 2002-01-22 Novell, Inc. Firewall system for quality of service management
US6119235A (en) 1997-05-27 2000-09-12 Ukiah Software, Inc. Method and apparatus for quality of service management
US6134589A (en) 1997-06-16 2000-10-17 Telefonaktiebolaget Lm Ericsson Dynamic quality control network routing
US6178448B1 (en) 1997-06-18 2001-01-23 International Business Machines Corporation Optimal link scheduling for multiple links by obtaining and utilizing link quality information
US6904110B2 (en) 1997-07-31 2005-06-07 Francois Trans Channel equalization system and method
US6006264A (en) 1997-08-01 1999-12-21 Arrowpoint Communications, Inc. Method and system for directing a flow between a client and a server
US6009081A (en) * 1997-09-03 1999-12-28 Internap Network Services Private network access point router for interconnecting among internet route providers
US6912222B1 (en) * 1997-09-03 2005-06-28 Internap Network Services Corporation Private network access point router for interconnecting among internet route providers
IL135131A0 (en) * 1997-09-16 2001-05-20 Transnexus Llc Internet telephony call routing engine
US6434606B1 (en) 1997-10-01 2002-08-13 3Com Corporation System for real time communication buffer management
US6026411A (en) * 1997-11-06 2000-02-15 International Business Machines Corporation Method, apparatus, and computer program product for generating an image index and for internet searching and querying by image colors
JP3937533B2 (ja) 1997-11-07 2007-06-27 セイコーエプソン株式会社 遠隔座標入力装置および遠隔座標入力方法
US6026441A (en) 1997-12-16 2000-02-15 At&T Corporation Method for establishing communication on the internet with a client having a dynamically assigned IP address
US6339595B1 (en) * 1997-12-23 2002-01-15 Cisco Technology, Inc. Peer-model support for virtual private networks with potentially overlapping addresses
US6111881A (en) 1997-12-29 2000-08-29 Nortel Networks Corporation Signaling protocol for rerouting ATM connections in PNNI environments
US6078953A (en) 1997-12-29 2000-06-20 Ukiah Software, Inc. System and method for monitoring quality of service over network
US6078963A (en) * 1998-01-16 2000-06-20 At&T Corp. Router with de-centralized processing using intelligent ports
US6185598B1 (en) * 1998-02-10 2001-02-06 Digital Island, Inc. Optimized network resource location
US6438592B1 (en) 1998-02-25 2002-08-20 Michael G. Killian Systems for monitoring and improving performance on the world wide web
US6370163B1 (en) 1998-03-11 2002-04-09 Siemens Information And Communications Network, Inc. Apparatus and method for speech transport with adaptive packet size
WO1999046884A1 (en) * 1998-03-12 1999-09-16 British Telecommunications Public Limited Company Method and apparatus for signal degradation measurement
US6665271B1 (en) 1998-03-17 2003-12-16 Transnexus, Llc System for real-time prediction of quality for internet-based multimedia communications
US6453356B1 (en) * 1998-04-15 2002-09-17 Adc Telecommunications, Inc. Data exchange system and method
US6167052A (en) 1998-04-27 2000-12-26 Vpnx.Com, Inc. Establishing connectivity in networks
US7046653B2 (en) * 1998-05-01 2006-05-16 Jan Nigrin Diversity communication system and method of operation thereof
US6493353B2 (en) * 1998-05-07 2002-12-10 Mci Communications Corporation Communications signaling gateway and system for an advanced service node
US6560204B1 (en) * 1998-05-13 2003-05-06 Telcordia Technologies, Inc. Method of estimating call level traffic intensity based on channel link measurements
US6311144B1 (en) 1998-05-13 2001-10-30 Nabil A. Abu El Ata Method and apparatus for designing and analyzing information systems using multi-layer mathematical models
US6707824B1 (en) * 1998-05-20 2004-03-16 Nortel Networks Limited Method and apparatus for flexible egress traffic queuing
US6260070B1 (en) 1998-06-30 2001-07-10 Dhaval N. Shah System and method for determining a preferred mirrored service in a network by evaluating a border gateway protocol
US6385198B1 (en) * 1998-06-11 2002-05-07 Synchrodyne Networks, Inc. Signaling for timely forwarding in packet switching network with a common time reference
US6711152B1 (en) * 1998-07-06 2004-03-23 At&T Corp. Routing over large clouds
US6108703A (en) 1998-07-14 2000-08-22 Massachusetts Institute Of Technology Global hosting system
US6173324B1 (en) * 1998-07-15 2001-01-09 At&T Corp Method and apparatus for fault detection and isolation in data
JP2000049825A (ja) 1998-07-27 2000-02-18 Nec Corp 多重化システム及びその制御方法
JP3602972B2 (ja) * 1998-07-28 2004-12-15 富士通株式会社 通信性能測定装置及びその測定方法
US6487172B1 (en) 1998-08-21 2002-11-26 Nortel Networks Limited Packet network route selection method and apparatus using a bidding algorithm
US6584093B1 (en) * 1998-08-25 2003-06-24 Cisco Technology, Inc. Method and apparatus for automatic inter-domain routing of calls
US6963914B1 (en) * 1998-09-01 2005-11-08 Lucent Technologies Inc. Method and apparatus for retrieving a network file using a logical reference
US6130890A (en) 1998-09-11 2000-10-10 Digital Island, Inc. Method and system for optimizing routing of data packets
US6529499B1 (en) 1998-09-22 2003-03-04 Lucent Technologies Inc. Method for providing quality of service for delay sensitive traffic over IP networks
US6189044B1 (en) * 1998-10-14 2001-02-13 Hughes Electronics Corporation Dynamic routing method for packet switched satellite communications
US20010010059A1 (en) * 1998-10-28 2001-07-26 Steven Wesley Burman Method and apparatus for determining travel time for data sent between devices connected to a computer network
US6385643B1 (en) * 1998-11-05 2002-05-07 Bea Systems, Inc. Clustered enterprise Java™ having a message passing kernel in a distributed processing system
US6687229B1 (en) * 1998-11-06 2004-02-03 Lucent Technologies Inc Quality of service based path selection for connection-oriented networks
US6522627B1 (en) * 1998-11-12 2003-02-18 Nortel Networks Limited Managing internet protocol connection oriented services
JP2000151708A (ja) * 1998-11-18 2000-05-30 Nec Corp 同報通信方法および同報通信装置
US6317778B1 (en) * 1998-11-23 2001-11-13 International Business Machines Corporation System and method for replacement and duplication of objects in a cache
US6795399B1 (en) 1998-11-24 2004-09-21 Lucent Technologies Inc. Link capacity computation methods and apparatus for designing IP networks with performance guarantees
US6909700B1 (en) 1998-11-24 2005-06-21 Lucent Technologies Inc. Network topology optimization methods and apparatus for designing IP networks with performance guarantees
US6446028B1 (en) 1998-11-25 2002-09-03 Keynote Systems, Inc. Method and apparatus for measuring the performance of a network based application program
US6317792B1 (en) 1998-12-11 2001-11-13 Webtv Networks, Inc. Generation and execution of scripts for enabling cost-effective access to network resources
US6363332B1 (en) * 1998-12-22 2002-03-26 Caterpillar Inc. Method and apparatus for predicting a fault condition using non-linear curve fitting techniques
US6714549B1 (en) * 1998-12-23 2004-03-30 Worldcom, Inc. High resiliency network infrastructure
US7085230B2 (en) 1998-12-24 2006-08-01 Mci, Llc Method and system for evaluating the quality of packet-switched voice signals
US7099282B1 (en) * 1998-12-24 2006-08-29 Mci, Inc. Determining the effects of new types of impairments on perceived quality of a voice service
US6611872B1 (en) * 1999-01-11 2003-08-26 Fastforward Networks, Inc. Performing multicast communication in computer networks by using overlay routing
US6282562B1 (en) 1999-01-14 2001-08-28 Net Reality Method for economically sub-optimizing interactions in data-communications network environments, and a device according to the method
US6452950B1 (en) 1999-01-14 2002-09-17 Telefonaktiebolaget Lm Ericsson (Publ) Adaptive jitter buffering
US6631134B1 (en) * 1999-01-15 2003-10-07 Cisco Technology, Inc. Method for allocating bandwidth in an optical network
US6856627B2 (en) 1999-01-15 2005-02-15 Cisco Technology, Inc. Method for routing information over a network
US6598145B1 (en) * 1999-02-12 2003-07-22 Avici Systems Irregular network
JP2000312226A (ja) 1999-02-25 2000-11-07 Hitachi Ltd 通信品質を保証する方法
US6760775B1 (en) * 1999-03-05 2004-07-06 At&T Corp. System, method and apparatus for network service load and reliability management
US6538416B1 (en) * 1999-03-09 2003-03-25 Lucent Technologies Inc. Border gateway reservation protocol for tree-based aggregation of inter-domain reservations
US6594268B1 (en) 1999-03-11 2003-07-15 Lucent Technologies Inc. Adaptive routing system and method for QOS packet networks
US6711137B1 (en) 1999-03-12 2004-03-23 International Business Machines Corporation System and method for analyzing and tuning a communications network
US6795860B1 (en) 1999-04-05 2004-09-21 Cisco Technology, Inc. System and method for selecting a service with dynamically changing information
US6505254B1 (en) * 1999-04-19 2003-01-07 Cisco Technology, Inc. Methods and apparatus for routing requests in a network
US6819662B1 (en) * 1999-04-29 2004-11-16 Telecommunications Research Laboratories Method for protecting a telecommunications network
US6801502B1 (en) 1999-05-07 2004-10-05 At&T Corp. Method and apparatus for load-sensitive routing of long-lived packet flows
US20020124100A1 (en) 1999-05-20 2002-09-05 Jeffrey B Adams Method and apparatus for access to, and delivery of, multimedia information
US6553423B1 (en) * 1999-05-27 2003-04-22 Cisco Technology, Inc. Method and apparatus for dynamic exchange of capabilities between adjacent/neighboring networks nodes
US6728777B1 (en) * 1999-06-02 2004-04-27 Nortel Networks Limited Method for engineering paths for multicast traffic
US6601098B1 (en) * 1999-06-07 2003-07-29 International Business Machines Corporation Technique for measuring round-trip latency to computing devices requiring no client-side proxy presence
US6463454B1 (en) 1999-06-17 2002-10-08 International Business Machines Corporation System and method for integrated load distribution and resource management on internet environment
US6275470B1 (en) 1999-06-18 2001-08-14 Digital Island, Inc. On-demand overlay routing for computer-based communication networks
US6973490B1 (en) 1999-06-23 2005-12-06 Savvis Communications Corp. Method and system for object-level web performance and analysis
DE60045552D1 (de) 1999-06-30 2011-03-03 Apptitude Inc Verfahren und gerät um den netzwerkverkehr zu überwachen
US6771646B1 (en) 1999-06-30 2004-08-03 Hi/Fn, Inc. Associative cache structure for lookups and updates of flow records in a network monitor
US6839751B1 (en) * 1999-06-30 2005-01-04 Hi/Fn, Inc. Re-using information from data transactions for maintaining statistics in network monitoring
US6539425B1 (en) * 1999-07-07 2003-03-25 Avaya Technology Corp. Policy-enabled communications networks
US6633878B1 (en) 1999-07-30 2003-10-14 Accenture Llp Initializing an ecommerce database framework
US6766381B1 (en) 1999-08-27 2004-07-20 International Business Machines Corporation VLSI network processor and methods
US6785704B1 (en) * 1999-12-20 2004-08-31 Fastforward Networks Content distribution system for operation over an internetwork including content peering arrangements
US6415323B1 (en) * 1999-09-03 2002-07-02 Fastforward Networks Proximity-based redirection system for robust and scalable service-node location in an internetwork
US6728484B1 (en) * 1999-09-07 2004-04-27 Nokia Corporation Method and apparatus for providing channel provisioning in optical WDM networks
US6631419B1 (en) 1999-09-22 2003-10-07 Juniper Networks, Inc. Method and apparatus for high-speed longest prefix and masked prefix table search
US6704795B1 (en) * 1999-10-12 2004-03-09 Cisco Technology, Inc. Technique for reducing consumption of router resources after BGP restart
US6836463B2 (en) 1999-10-15 2004-12-28 Nokia Corporation System for communicating labeled routing trees to establish preferred paths and source routes with local identifiers in wireless computer networks
US6728779B1 (en) * 1999-12-01 2004-04-27 Lucent Technologies Inc. Method and apparatus for exchanging routing information in a packet-based data network
EP1111532A1 (en) * 1999-12-20 2001-06-27 TELEFONAKTIEBOLAGET LM ERICSSON (publ) Method for transporting physical objects, transportation system and transportation means
US6829221B1 (en) * 1999-12-27 2004-12-07 Nortel Networks Limited Border gateway protocol manager and method of managing the selection of communication links
US6614789B1 (en) 1999-12-29 2003-09-02 Nasser Yazdani Method of and apparatus for matching strings of different lengths
US6608841B1 (en) 1999-12-30 2003-08-19 Nokia Networks Oy System and method for achieving robust IP/UDP/RTP header compression in the presence of unreliable networks
US6625648B1 (en) 2000-01-07 2003-09-23 Netiq Corporation Methods, systems and computer program products for network performance testing through active endpoint pair based testing and passive application monitoring
US7003571B1 (en) * 2000-01-31 2006-02-21 Telecommunication Systems Corporation Of Maryland System and method for re-directing requests from browsers for communication over non-IP based networks
US6633640B1 (en) 2000-02-01 2003-10-14 Avaya Technology Corp. Methods and apparatus for analysis of load-balanced multi-site call processing systems
US6873600B1 (en) * 2000-02-04 2005-03-29 At&T Corp. Consistent sampling for network traffic measurement
US6820133B1 (en) 2000-02-07 2004-11-16 Netli, Inc. System and method for high-performance delivery of web content using high-performance communications protocol between the first and second specialized intermediate nodes to optimize a measure of communications performance between the source and the destination
US20010037311A1 (en) 2000-02-18 2001-11-01 Mccoy James Efficient internet service cost recovery system and method
US20010026537A1 (en) * 2000-02-24 2001-10-04 Michael Massey Satellite internet backbone network system using virtual onboard switching
US6661797B1 (en) 2000-02-28 2003-12-09 Lucent Technologies Inc. Quality of service based path selection for connection-oriented networks
US6430160B1 (en) 2000-02-29 2002-08-06 Verizon Laboratories Inc. Estimating data delays from poisson probe delays
US6826613B1 (en) * 2000-03-15 2004-11-30 3Com Corporation Virtually addressing storage devices through a switch
US6601101B1 (en) * 2000-03-15 2003-07-29 3Com Corporation Transparent access to network attached devices
US7162539B2 (en) * 2000-03-16 2007-01-09 Adara Networks, Inc. System and method for discovering information objects and information object repositories in computer networks
FR2806862B1 (fr) 2000-03-24 2002-09-27 Phonatis Procede et systeme pour reduire la facture telephonique des entreprises
US6768969B1 (en) * 2000-04-03 2004-07-27 Flint Hills Scientific, L.L.C. Method, computer program, and system for automated real-time signal analysis for detection, quantification, and prediction of signal changes
US6741569B1 (en) * 2000-04-18 2004-05-25 Telchemy, Incorporated Quality of service monitor for multimedia communications system
US20020103631A1 (en) * 2000-04-21 2002-08-01 Anja Feldmann Traffic engineering system and method
US7024475B1 (en) * 2000-04-24 2006-04-04 Nortel Networks Limited Performance modeling of a communications system
US7123620B1 (en) 2000-04-25 2006-10-17 Cisco Technology, Inc. Apparatus and method for scalable and dynamic traffic engineering in a data communication network
US7065584B1 (en) 2000-04-28 2006-06-20 Lucent Technologies Inc. Method and apparatus for network mapping using end-to-end delay measurements
US7343422B2 (en) * 2000-04-28 2008-03-11 Adara Networks, Inc. System and method for using uniform resource locators to map application layer content names to network layer anycast addresses
GB0028113D0 (en) * 2000-05-15 2001-01-03 Band X Ltd Communication system and method
US6556582B1 (en) * 2000-05-15 2003-04-29 Bbnt Solutions Llc Systems and methods for collision avoidance in mobile multi-hop packet radio networks
US7111073B1 (en) 2000-05-30 2006-09-19 Cisco Technology, Inc. Apparatus for estimating delay and jitter between network routers
US6658000B1 (en) * 2000-06-01 2003-12-02 Aerocast.Com, Inc. Selective routing
US6963575B1 (en) 2000-06-07 2005-11-08 Yipes Enterprise Services, Inc. Enhanced data switching/routing for multi-regional IP over fiber network
AU2001268411A1 (en) 2000-06-14 2002-01-02 Core Express, Inc. Route selection within a network with peering connections
US6748426B1 (en) * 2000-06-15 2004-06-08 Murex Securities, Ltd. System and method for linking information in a global computer network
US6751661B1 (en) 2000-06-22 2004-06-15 Applied Systems Intelligence, Inc. Method and system for providing intelligent network management
US6829654B1 (en) * 2000-06-23 2004-12-07 Cloudshield Technologies, Inc. Apparatus and method for virtual edge placement of web sites
US6956858B2 (en) 2000-06-30 2005-10-18 Mayan Networks Corporation Network routing table and packet routing method
US7020086B2 (en) * 2000-07-03 2006-03-28 Telefonaktiebolaget Lm Ericsson (Publ) Lagrange quality of service routing
US6751664B1 (en) 2000-07-05 2004-06-15 At&T Corp. Method for monitoring and meeting customer bandwidth demand in operational IP data networks
US6999432B2 (en) * 2000-07-13 2006-02-14 Microsoft Corporation Channel and quality of service adaptation for multimedia over wireless networks
US6839745B1 (en) * 2000-07-19 2005-01-04 Verizon Corporate Services Group Inc. System and method for generating reports in a telecommunication system
US7219158B2 (en) * 2000-07-21 2007-05-15 Hughes Network Systems Llc Method and system for improving network performance using a performance enhancing proxy
US6973038B1 (en) 2000-07-28 2005-12-06 Tactical Networks A.S. System and method for real-time buying and selling of internet protocol (IP) transit
US6912203B1 (en) 2000-07-31 2005-06-28 Cisco Technology, Inc. Method and apparatus for estimating delay and jitter between many network routers using measurements between a preferred set of routers
US6981055B1 (en) * 2000-08-22 2005-12-27 Internap Network Services Corporation Method and system for optimizing routing through multiple available internet route providers
US7050963B2 (en) 2000-09-12 2006-05-23 Progress Software Corporation Method and apparatus for flash load balancing
US7698463B2 (en) 2000-09-12 2010-04-13 Sri International System and method for disseminating topology and link-state information to routing nodes in a mobile ad hoc network
US6760777B1 (en) * 2000-09-15 2004-07-06 Pluris, Inc. Method and apparatus for distributing and providing fault tolerance to path-vector routing protocols within a multi-processor router
US7222268B2 (en) * 2000-09-18 2007-05-22 Enterasys Networks, Inc. System resource availability manager
US7043541B1 (en) * 2000-09-21 2006-05-09 Cisco Technology, Inc. Method and system for providing operations, administration, and maintenance capabilities in packet over optics networks
US7107326B1 (en) 2000-10-13 2006-09-12 3Com Corporation Method and system for integrating IP address reservations with policy provisioning
US7080161B2 (en) * 2000-10-17 2006-07-18 Avaya Technology Corp. Routing information exchange
ATE459154T1 (de) 2000-10-17 2010-03-15 Avaya Technology Corp Verfahren und vorrichtung zur optimierung der leistung und des kosten in einem internetzwerk
US7406539B2 (en) 2000-10-17 2008-07-29 Avaya Technology Corp. Method and apparatus for performance and cost optimization in an internetwork
US7756032B2 (en) 2000-10-17 2010-07-13 Avaya Inc. Method and apparatus for communicating data within measurement traffic
US7487237B2 (en) 2000-10-17 2009-02-03 Avaya Technology Corp. Load optimization
US8023421B2 (en) 2002-07-25 2011-09-20 Avaya Inc. Method and apparatus for the assessment and optimization of network traffic
US7720959B2 (en) 2000-10-17 2010-05-18 Avaya Inc. Method and apparatus for characterizing the quality of a network path
US7363367B2 (en) * 2000-10-17 2008-04-22 Avaya Technology Corp. Systems and methods for robust, real-time measurement of network performance
US7336613B2 (en) * 2000-10-17 2008-02-26 Avaya Technology Corp. Method and apparatus for the assessment and optimization of network traffic
US6894991B2 (en) 2000-11-30 2005-05-17 Verizon Laboratories Inc. Integrated method for performing scheduling, routing and access control in a computer network
US7155436B2 (en) * 2001-01-12 2006-12-26 Vendaria, Inc Method and system for generating and providing rich media presentations optimized for a device over a network
TWI223942B (en) 2001-02-20 2004-11-11 Li Jian Min Contents transmission network system and creating method thereof
US7110393B1 (en) * 2001-02-28 2006-09-19 3Com Corporation System and method for providing user mobility handling in a network telephony system
US6973229B1 (en) 2001-02-28 2005-12-06 Lambda Opticalsystems Corporation Node architecture for modularized and reconfigurable optical networks, and methods and apparatus therefor
EP1374080A2 (en) * 2001-03-02 2004-01-02 Kasenna, Inc. Metadata enabled push-pull model for efficient low-latency video-content distribution over a network
US7139242B2 (en) * 2001-03-28 2006-11-21 Proficient Networks, Inc. Methods, apparatuses and systems facilitating deployment, support and configuration of network routing policies
US7269157B2 (en) * 2001-04-10 2007-09-11 Internap Network Services Corporation System and method to assure network service levels with intelligent routing
US7730528B2 (en) * 2001-06-01 2010-06-01 Symantec Corporation Intelligent secure data manipulation apparatus and method
US7085264B2 (en) * 2001-12-18 2006-08-01 Nortel Networks Limited System and method for controlling media gateways that interconnect disparate networks
US7535913B2 (en) * 2002-03-06 2009-05-19 Nvidia Corporation Gigabit ethernet adapter supporting the iSCSI and IPSEC protocols
JP3667700B2 (ja) 2002-03-06 2005-07-06 エルピーダメモリ株式会社 入力バッファ回路及び半導体記憶装置
US6983323B2 (en) 2002-08-12 2006-01-03 Tippingpoint Technologies, Inc. Multi-level packet screening with dynamically selected filtering criteria
WO2004038979A2 (en) * 2002-10-24 2004-05-06 Optical Solutions, Inc. Passive optical network address association recovery
US7830861B2 (en) * 2003-10-16 2010-11-09 At&T Intellectual Property Ii, L.P. Method and apparatus for functional architecture of voice-over-IP SIP network border element
US20050132060A1 (en) 2003-12-15 2005-06-16 Richard Mo Systems and methods for preventing spam and denial of service attacks in messaging, packet multimedia, and other networks
US6984991B2 (en) * 2004-05-11 2006-01-10 International Business Machines Corporation Initialization of a bidirectional, self-timed parallel interface with automatic testing of AC differential wire pairs
WO2006031302A2 (en) * 2004-07-29 2006-03-23 Intelli7, Inc. System and method of characterizing and managing electronic traffic
US20060291446A1 (en) * 2005-06-24 2006-12-28 Donald Caldwell Systems, methods, and devices for managing routing

Also Published As

Publication number Publication date
AU2002213353A1 (en) 2002-04-29
AU2002211775A1 (en) 2002-04-29
CA2637743A1 (en) 2002-04-25
US7675868B2 (en) 2010-03-09
WO2002033896A3 (en) 2002-11-21
IL190568A0 (en) 2008-11-03
AU2002211777A1 (en) 2002-04-29
ATE522041T1 (de) 2011-09-15
CA2424680A1 (en) 2002-04-25
CA2424680C (en) 2010-01-05
US7349994B2 (en) 2008-03-25
WO2002033915A1 (en) 2002-04-25
WO2002033895A2 (en) 2002-04-25
IL155356A (en) 2008-07-08
EP1350363A2 (en) 2003-10-08
IL155356A0 (en) 2003-11-23
AU2001294993A1 (en) 2002-04-29
CA2637743C (en) 2012-08-21
US20080186877A1 (en) 2008-08-07
WO2002033896A2 (en) 2002-04-25
US20020075813A1 (en) 2002-06-20
WO2002033895A3 (en) 2003-08-07

Similar Documents

Publication Publication Date Title
EP1350363B1 (en) Method and apparatus for the assessment and optimization of network traffic
US7336613B2 (en) Method and apparatus for the assessment and optimization of network traffic
US7773536B2 (en) Method and apparatus for the assessment and optimization of network traffic
US7269157B2 (en) System and method to assure network service levels with intelligent routing
US7561517B2 (en) Passive route control of data networks
US7222190B2 (en) System and method to provide routing control of information over data networks
US8072901B1 (en) Technique for efficient probing to verify policy conformance
US7756032B2 (en) Method and apparatus for communicating data within measurement traffic
US7584298B2 (en) Topology aware route control
US7606160B2 (en) System and method to provide routing control of information over networks
Andersen et al. Resilient overlay networks
EP1826947A2 (en) Method and apparatus for the assessment and optimization of network traffic
WO2002033893A2 (en) Method and apparatus for communicating data within measurement traffic
Wang Routing and congestion control in datagram networks
Li Inter-domain routing: Problems and solutions
Zhan et al. Improving TCP performance with periodic disconnections over wireless links
Magalhães A* transport layer approach to host mobility
Zhang Understanding internet routing anomalies and building robust transport layer protocols
Arianfar et al. Marooned magic numbers-An adaptive congestion control architecture
Sohail et al. Parallelized FTP
Overlays et al. Sigcomm 2002 Student Posters

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20030410

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: AVAYA TECHNOLOGY CORP.

17Q First examination report despatched

Effective date: 20061010

17Q First examination report despatched

Effective date: 20061010

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

RTI1 Title (correction)

Free format text: METHOD AND APPARATUS FOR THE ASSESSMENT AND OPTIMIZATION OF NETWORK TRAFFIC

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 60145223

Country of ref document: DE

Effective date: 20111117

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20110824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111226

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 522041

Country of ref document: AT

Kind code of ref document: T

Effective date: 20110824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111125

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20120629

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20120628 AND 20120704

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111031

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20120501

26N No opposition filed

Effective date: 20120525

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20120705 AND 20120711

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 60145223

Country of ref document: DE

Effective date: 20120501

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111102

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111017

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20111205

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20111017

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20121017

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20121017

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20110824