ZA200205508B - Method and system for communication of data via an optimum data path in a network. - Google Patents

Description

EP-83507/PCT

METHOD AND SYSTEM FOR COMMUNICATION OF DATA VIA AN OPTIMUM DATA

. PATH IN A NETWORK . DESCRIPTION Field of the invention

The present invention relates to a method and a system for communication of data in a network. In particular, the present invention relates to a method and a system for com- } munication of data via an optimum data path from a sending node to a receiving node in a network having a plurality of nodes being connected via data links, wherein the opti- mum data paths used for data communication in the network are defined as the data paths which lead to the smallest average link utilization and/or the smallest maximum link utilization for the data links in the network .

Background of the invention

For data communication in a network, the data to be communicated is routed through the network, i.e. the data or data packets thereof are directed via data links of the network from a data sending node to a data receiving node. in order to route data correctly via data links of a network and over nodes of the network connected by the data links rout- ing strategies or so-called routing protocols representing routing strategies are employed.

The most popular routing protocols are the Routing Information Protocol (RIP), the En- hanced Internet Gateway Routing Protocol (EIGRP) and the Open Shortest Path First (OSPF) protocol. These protocols are used as so-called interior gateway protocols for routing of data in networks which are under a common network administration. Data net- works (e.g. the INTERNET) do not have predefined data paths/connections between a sending node and a receiving node, in contrast to networks having fixed communication connections (e.g. telephone networks). Interior routing protocols are in general based on an approach wherein data communication from a sending node to a receiving node is not performed via predefined data links and nodes of the network. instead, data or data packages are communicated from one node to another, wherein each routing decision which data link to the next node has to be chosen is "made up" by each node separately.

Therefore, a node also referred to as router transmitting data to other nodes/routers does not "know" the complete data path or the data links forming the data path, respectively, for the communication of data from the sending node to the receiving node. Each node/router for itself make its own routing decision depending on its routing information to which next node/router the data or data packages thereof can be transmitted. As a consequence, the routing decision, i.e. the determination of the next node/router to which data is transmitted is made locally by the node/router communicating the respec- tive data.

If the operation condition of each node/router within the network is known, it is 40 possible to determine a data path and the data links forming the data path over which

EP-83507/PCT data or data packages thereof are communicated through the network. The operation : condition of each node/router and, in particular, the routing decision of each node/router is determined via a cost function which determines the cost of the links. The cost function : is protocol specific and can depend on the capacity of the links, the type and/or amount of data to be communicated, the utilization of data links to nodes to which data have to be transmitted, the (physical) delay and the data communication situation of the whole network. In practice the cost functions depend only on static and/or predefine variables like the capacity of the finks and a delay value for the links which are once defined in the router database. Therefore if no errors in the network occur, the operating conditions of nodes/routers of a network do not vary during data communication, which makes it pos- sible to determine the data path over which data will be communicated from the sending : node to the receiving node.

A further fundamental principle of the interior routing protocols mentioned above is to always choose the shortest data path between a sending node and a receiving node. The routing protocols define a metric according to which the length of a data path is determined and information for the determination of the shortest data path are distrib- uted over the network. For example, the Open Shortest Path First (OSPF) protocol com- monly uses an additive metric based on time independent parameters such as the data communication capacity of data links (e.g. CISCO routers) or/and the delay for data communication over data links . In the OSPF-metric, the costs for each data link from a node/router to other nodes/routers connected thereto are inputted. Data communication parameters of a data link between a node/router to the next node/router can depend on the direction of data communication over the data link. Thus, the costs for data links may vary in relation to the data communication direction. The overall costs of a data path is obtained by a summation of all costs of the data links included by the data path.

The metric of the Enhanced Internet Gateway Routing Protocol (EIGRP) is more complicated than the metric of the OSPF-protocol but is mostly used in a form reduced to an additive metric.

The approach always to select the shortest data path implies a single-path rout- ing, i.e. the routing between two nodes/routers is identical for all data flows. It is possible to define a multipath routing but for stability (e.g. loop protection) and protocol depended reasons (e.g. TCP performance degeneration in the case of reordered packets) it is rarely used. As a result of the fixed cost metric and the single path routing, congestions of data paths or single data links included of a data path may occur. This occurs for ex- ample if the amount of data is larger than the data communication capacity of single data links. Similar problems can occur if the data communication capacity of a node/router is not sufficient to communicate the desired amount of data, e.g. if the node/router is in- cluded by data paths of different sending nodes and/or different receiving nodes.

Furthermore, specific data paths and/or data links may be utilized very often, 40 while other may be used only sometimes. This unequal distribution of data communica-

EP-83507/PCT tion over the data links results in an unequal link utilization of the network data links. This : unequal link utilization may also lead to congestions for different data links. Even in the case of high utilized links the network is not applicable for real time applications like IP : telephony because of the nonlinear dependency between the load and the waiting time.

Furthermore, such a routing of data in a network leads to an uneconomic operation of the network since data links, which are provided within the network requiring expensive hardware and software means, are not used. ) The conventional approach to optimize routing of data in a network was to im- prove/enhance existing routing protocols or to develop new routing protocols. Since al- _10 tered or new routing protocols must be established throughout the whole network, usu- ally, altered or new hardware and software components are required. Therefore, this op- timization is mainly limited due to organizational problems.

Object of the invention

The object of the present invention is to solve the above described problems of the state of the art. In particular, the present invention is directed towards an optimization of rout- ing of data in a network using existing routing protocols, namely without modifying or re- placing routing protocols already used in a network and the respective hardware and software components of the network. Moreover, the present invention provides a method and a system for routing data in a network to achieve a homogeneous distribution of communicated/routed data or data traffic, respectively, throughout the network. The method is also applicable for traffic engendering in MPLS and routing in further (e.g. with optical/digital wrappers) optical networks.

Description of the invention

To solve the above problem, the present invention provides a method for determining an optimum data path for communication of data in a network as defined in claim 1.

The method according to the invention is based on the approach to optimize the routing of data in a network on the basis of a linear optimization problem. The linear op- timization problem according to the invention has to be defined such that data routed/communicated in a network also referred to as data traffic is uni- formly/homogeneously distributed over the network. In terms of the invention, the ex- pression "uniform/homogeneous distribution” of data traffic should not be understood as "equal distribution” of data traffic. An equal distribution of data traffic throughout the net- work would result in identical/equal data traffic for each data link connecting nodes of the network.

Although an "equal distribution" of data traffic can represent an optimum solution of the linear optimization problem according to the invention, the method according to the invention is not specifically applied to obtain an "equal distribution” of data traffic but is

EP-83507/PCT directed to an optimization of routing of data in a network wherein link utilizations of data : links in the network may be different.

The method according to the invention is used to communicate data via an optimum data : path from a sending node to a receiving node in a network having a plurality of nodes connected by data links. In the following, the term "data path" is used for data paths be- tween the sending node and the receiving node, wherein data paths are formed by re- spective ones of the data links. . For the determination of an optimum data path from a sending node to a receiv- ing node, all loop-free data paths from the sending node to the receiving node over re- spective data links and nodes are determined and data paths are selected such that all data communicated between two nodes are communicated via the same data path.

Following, maximum link utilizations, or average link utilizations, or values indicative of combinations of the maximum link utilizations and the average link utilizations of the se- lected data paths are determined and the data path having the minimal maximum link utilization, or the minimal average link utilization, or the minimal value indicative of com- binations of the maximum link utilizations and the average link utilizations is defined as the optimum data path. Then, the data are communicated from the sending node to the receiving node via the optimum data path.

Further, the selection of data paths can comprise determination of data commu- nication capacities of the data paths and selecting data paths having data communica- tion capacities sufficient to communicate the data from the sending node to the receiving node, and/or determination of physical delays of the data paths and selecting data paths having physical delays equal or smaller than a predetermined maximum physical delay.

The determination of the optimum data path from the sending node to the re- ceiving node can be based on the definition of an equation system for a linear optimiza- tion problem and the solution of the equation system to define the optimum data path.

Here, the objective function can be defined to determine maximum link utiliza- tions, or average link utilizations, or values indicative of combinations of the maximum link utilizations and the average link uviilizations of selected data paths.

Beside the objective function, a linear optimization problem requires the definition of constraints. According to the invention, transport constraints can be defined for deter- mination of loop-free data paths.

Further, routing constraints can be defined such that all data, which are to be communicated from the sending node to the receiving node, are communicated via the same data path. Such a definition of routing constraints allows to utilize existing routing protocols which select the shortest data path between nodes/routers and employ a sin- gle-path routing.

Additionally, capacity constraints can be defined for the determination of data paths having sufficient data communication capacities, preferable maximum data com- 40 munication capacities being equal or larger than the amount of data to be communicated

EP-83507/PCT and/or data communication capacities being equal or smaller than a predefined maxi- : mum link utilization.

A further definition of physical delay constraints allows the determination of data : paths having physical delays being equal or smaller as a predefined maximum physical delay. In terms of the invention, the physical delay represents the time required to com- municate data between nodes of the network connected by respective data links.

In order to obtain an optimum data path, the equation system for the linear optimization } problem is solved by a minimization of the object function regarding the constraints.

Solving the equation system, all possible data paths from the sending node to the re- ceiving node are determined and the data path having the minimal maximum link utiliza- tion, or the minimal average link utilization, or the minimal value indicative of combina- tions of the maximum link utilizations and the average link utilizations is defined as opti- mum data path. Especially for complex networks including many nodes and connecting data links, it can be advantageous to perform the minimization of the objective function iteratively.

With respect to the value indicative of combinations of the average link utilization and the maximum link utilization, a function can be used which represents the average link utilization and the maximum link utilization weighted in relation to each other.

More particularly, the component of the objective function having a higher influ- ence/importance for the determination of the optimum data path is weighted by a higher value compared to the weighing value for the other component of the objective function.

With respect to the complexity for solving of the equation system, which can be very time consuming, it is possible to use the last solution of the equation system which has been determined within a predefined time interval. For example, this approach is preferred if, within the predefined time interval, the objective function is not feasible, no minimum can be determined for the objective function, or the objective function does not converge.

Depending on the network for which the method according to the invention is used, the number of variables for the definition of the equation system can be extremely high. In particular, the number of variables for the objective function is in the magnitude of N°M?, wherein N represents the number of nodes/routers and M represents the num- ber of data links. Determined by the routing constraints, the number of variables for the constraints according to the invention is in the magnitude of N3M?. In order to reduce the number of variables and/or to reduce the number of data links to be considered for the solution of the equation system, preferable in the case of large networks, the method comprises a determination of the time for data communication from the sending node to the receiving node for all loop-free data paths. Further, data paths are identified as data paths to be considered for the solution of the equation system for which the smallest data communication time and/or a data communication time being smaller than a prede- 40 fined maximum data communication time have been determined. Preferable, the maxi-

EP-83507/PCT mum data communication time is predefined in relation to the smallest determined data communication time.

With respect to the identification of data paths being considered for the solution : of the equation system, only data links included in possible data paths are used. Moreo- ver, itis possible not to consider data links for the solution of the equation system which are not included in all possible data paths.

For some networks, predefined communication time limits representing the maxi- mum time for data communication between nodes are employed. In order to consider such predefined communication time limits, it is possible to define the physical delay . 10 constraints on the basis of predefined communication time limits. Here, the physical de- lay constraints are not determined by the actual time required for the communication of data between nodes but by the predefined communication time limits for respective data links.

Likewise, characteristics of a network resulting from the band widths of the data links are considered by defining the physical delay constraints on the basis of the band- widths of the data links. Instead of using the actual time for the communication of data over a specific data link, the bandwidths of the data links are transformed into respective physical delays.

Due to the fact that the amount of data to be communicated between a sending node and a receiving node may vary over the time and due to the fact that several sending and/or receiving nodes are communicating over the network, it is preferred to perform the determination of the optimum data path according to the invention continu- ously, at predefined times, or in predefined time intervals. Here, it is possible to deter- mine the amount of the data to be communicated continuously, at predefined times, or in predefined time intervals, wherein different predefined times and/or different predefined time intervals can be used for the determination of the optimum data path and the de- termination of the amount of data to be communicated.

As an alternative, it is possible to determine the optimum data path for a prede- fined (e.g. maximal) amount of data to be communicated. Preferable, the predefined amount of data to be communicated is sensed or approximated.

As described above, known routing protocols are based on the selection of the shortest data path for data communication from a sending node to a receiving node. In order to prove whether the optimum data path determined according to the invention also is the shortest data path, the data communication costs for all possible data paths via data links forming the respective data path are determined. In case the optimum data path has the minimum data communication costs, the optimum data path is identified as the shortest data path.

Especially in the case of very large/complex networks, there is often a possibility to divide the network into at least two parts or partial networks for each of which the de- 40 terminations of the optimum data paths are performed separately. Due to the shortest

EP-83507/PCT path principle the concatenated solution of the smaller networks is equal to the solution

A obtained by the optimization of one large network.

Moreover, it is possible to group at least a part of a network to a virtual node.

Here, the determination of the optimum data path in the remaining portion of the network including the virtual node and the determination of the optimum data path in the grouped part of the network representing the virtual node are performed separately.

The present invention also provides a system for communication of data in a net- i work via an optimum data path. The system comprises a network having nodes/routers connected by data links, wherein at least one of the nodes is a sending node and at least . 10 one of the nodes is a receiving node, and control means being connected to the network for controlling data communication in the network. In particular, the control means are adapted to carry out one of the methods according to the invention for communicating data via an optimum data path.

The control means can be a central control system or a component of a central control system (e.g. an INTERNET-server) controlling data communication of at least one node/router, preferable of all nodes/routers.

Further, the control means can comprise at least one control unit associated with one or several nodes/routers for controlling data communication thereof. In order to con- trol data communication in an optimal manner and/or to control data communication of further nodes/routers, such a control unit should be in communication with the further nodes/routers, preferable with all nodes/routers to obtain information of data communi- cation within the network.

Especially for large networks and/or network exhibiting a high amount of data communication, a combination of a central control system and at least one control unit can improve the identification of optimum data paths, because data communication con- trol functions for single nodes and da.a communication control functions related to the entire network can be accordingly distributed to different components of the control means.

Short description of the figures

Fig. 1 illustrates the effects of a single-path routing on data paths in a network.

Fig. 2 illustrates the effects of the transport constraints on data paths in a net- work.

Fig. 3 illustrates the effects of the routing constraints according to the invention on data paths in a network.

Fig. 4 shows example networks with 6, 8 and 14 nodes/routers.

Fig. 5 illustrates the data routing according to the invention for the 6 node net- work for minimized average link utilization.

Fig. 6 illustrates the data routing according to the invention for the 6 node net- work for minimized ma:.tmum link utilization.

EP-83507/PCT

Fig. 7 illustrates the link costs for the 6 node network with minimized average link i utilization according to the invention.

Fig. 8 illustrates the link costs for a 6 node network with minimized maximum link ) utifization according to the invention.

Fig. 9 shows a diagram for the changes of link utilizations according to the in- vention for the 8 node network.

Fig. 10 shows a diagram for the changes of link utilizations according to the in- - vention for the 14 node network.

Fig. 11 shows a diagram for the link utilizations according to the invention for se- - 10 jected data links of the 14 node network.

Description of preferred embodiments of the invention

In general, nodes of a network are computer based systems/units (server) which can re- ceive and transmit data via data links which are connected with respective nodes. The nodes can be operated as sending nodes from which data send into a network are origi- nating. Further, the nodes can be operated as receiving nodes serving as a destination for receiving data communicated from a respective sending node. Moreover, the nodes can be operated as so-called routers which receive data from the sending node or from another node/router and transmit the received data to a further node/router or the re- ceiving node.

Data links between nodes of the network are often referred to as interfaces since the data links do not only comprise lines for the physical transmission of electrical/optical signals representing data to be transmitted but also hardware and software components required for the transmission of data in a data network. Such hardware and software components include conventional electrical lines, data busses, buffer/memory units, processor based units, software programs for data conversions and implementation of data communication protocols (i.e. routing protocols), and the like.

In order to achieve the objective of the present invention, namely to minimize all link utilizations (average link utilizations), to minimize the maximum link utilization, and to keep the physical delays of the data links between nodes of a network in a certain range, it is necessary to describe formerly the network and the data traffic thereof, i.e. the amount and flow of data communicated in the network. For this formal description, three matrixes are used:

First, a network with N nodes is defined by a capacity matrix C having the size NxN, wherein each entry of the capacity matrix C represents the link capacity c; for each pair of nodes i and |. In case no data link is existing between two nodes, the respective entry in the capacity matrix C is set to 0.

The second matrix is a traffic matrix F which comprises an entry f; for each pair of nodes i and j. Each entry f; represents the data traffic/data flow between two nodes i and 40 |. If no datais exchanged between two nodes, the respective entry in the traffic matrix F

EP-83507/PCT is set to 0. Depending on the implementation of the method according to the invention, ’ the entries f; of the traffic matrix F cai represent static data flows or, e.g. if the method according to the invention is carried out continuously during the operation of a network, the entries f; can represent the actual data flows between nodes of the network.

Third, a matrix D is introduced which describes the physical delays of the data links. The physical delay of a data link identifies the time necessary to communicate data between two nodes over the respective data link. The entries d; of the matrix D represent : the physical or approximated delay of a data link connecting two nodes i and j.

Based on these matrixes, the routing optimization according to the invention can -10 be defined as a linear optimization problem. As known, a linear optimization problem is described by an equation system consisting of two parts, the objective function and the constraints. The constraints define a multi-dimensional solution space wherein an optimal solution of the objective function has to be determined. The optimal solution of the ob- jective function is the solution within the solution space producing, in case of the inven- tion, the minimal value for the objeciiv'e function. To achieve an optimization of data routing in a network, different constraints limiting possible solutions of the objective func- tion have to be fulfilled.

First, for data communicated from a sending node to a receiving node, data paths have to be determined over which data can be transmitted/routed. In case the sending node and the receiving node are not directly connected by a data link, possible data paths include not only the sending and receiving nodes but also further nodes and re- spective data links connecting the same. In order to avoid that different data transmitted from a sending node to a receiving node are routed/transmitted over different data paths or data links, respectively, possible routings/data paths were restricted to a so-called sin- gle path routing. The single-path routing constraints ensures that exactly one data path between two nodes/routers is defined for a possible solution of the objective function.

The effect of such a single-path routing is illustrated in fig. 1. The shortest data path, in- dependent of the used routing protoc.! metric, between nodes/routers C and F is either over node/router D or over node/router E. As a result of the single-path routing, both data flows A-F and B-F are routed first over node/router C and then either over node/router D or over node/router E, but not one flow over node/router D, while the other is routed over node/router E.

Second, capacity constraints have to be fulfilled according to which the amount of data communicated over a specific data link does not exceed the capacity of the respec- tive data link, i.e. the maximal amount of data which can be communicated over the re- spective data link. The capacity of a data link in a network is not limited to the physical transmission capacity of the different transmission components of the data link (i.e. elec- trical wires, busses, processors), since data to be transmitted or data packages thereof can be stored for example in intermediate memories of data links and/or of nodes/routers 40 before transmission. Two approaches can be used to define capacity constraints in terms

EP-83507/PCT of a linear optimization problem. One of the approaches is path-oriented, while the other i is flow-oriented with respect to data links. Here, the flow-oriented approach was chosen to present in detail because it includes a smaller number of variables compared to the

B path-oriented approach. After the description of the flow oriented approach the changes in the notation of the method for the path oriented approach are described.

In order to apply the method for an routing optimization according to the invention in combination with existing routing protocols, the routing algorithms specified by the . used routing protocols has to be considered. As mentioned above, routing protocols cur- rently in use, i.e. the OSPF-protocol and the EIGRP, are based on routing algorithms for - 10 the determination of the shortest data path for data to be routed from a sending node to a receiving node. These algorithms for the shortest data path routing imply that all data communicated between two nodes/routers are routed over the same data links.

Objective function

The objective is to achieve a distribution of transmitted data or a data traffic distribution as homogeneous/uniform as possible throughout the entire network. In other words, all data links of the network should be utilized as equal as possible at a data communication level as low as possible. Since the flow-oriented approach is utilized, for each data flow between nodes/routers i and j having a data traffic entry f; > 0 in the data traffic matrix F and for each data link having a capacity entry ¢; > 0 in the capacity matrix C, a Boolean variable x; is introduced. This variable is set to 1 if a data flow uv from a sending node u to a receiving node v is routed over the data link ij between nodes i and j, otherwise this variable is set to 0. Further, a vanable t is introduced defining an upper threshold for the link utilization of all data links.

Both the maximum link utilization and the average link utilization have to be mini- mized. Therefore, the objective function includes two additive parts both of which have to be minimized: a*t+y > , with ¢;>0 (1) gy wv Cy

The left additive part of the objective function (1) represents the maximum link utilization, while the right additive part of the objective function (1) represents the average link utili- zation. The parameter a, of the maximum link utilization part of the objective function (1) is used as a weighing factor for weighing the maximum link utilization part with respect to the average link utilization part of the objective function (1). The parameter a is chosen in regard to the influence/importance sf a small/minimized maximum link utilization for the selection of an optimum data versus the influence/importance of a small/minimized average link utilization. For example, if the minimization of the maximum link utilization has a higher priority compared to the minimization of the average link utilization, the pa- 40 rameter a, should be chosen to have a large value resulting in a reduction of the maxi-

EP-83507/PCT mum link utilization by directing data traffic to less utilized data links. Comparable, the parameter a, should be chosen to have a small value if the influence of the minimization of the average link utilization onto the selection of an optimum data path should be higher than the influence of the minimization of the maximum link utilization.

Transport constraints

The transport constraints ensure that for each data flow, for example a data flow from a . sending node u to a receiving node v, exactly one loop-free data path from the sending node u to the receiving node v is specified by the values of the variables x" resulting - 10 from the solution of the objective function (1). Here, the transport constraints comprise four sub-constraints for each data flow: 1. The data flow uv from the sending node u to the receiving node v being transmitted over node/router i is routed over only one data link leading out of node/router i: > x, <1, for all flows uv and all nodes/routers i (2)

J=hey»0 2. The data flow uv from the sending node u to the receiving node v is routed via exactly one link ui from the sending node u to another node/router i: > x, — 2.x, 21 forall flows uv (3) i=l. »0 i=l.ey, ~0 3. For all data flows uv from the sending node u to the receiving node v and for each router i except the sending and receiving nodes u and v, the number of data links leading into router i and the number of data links leading out of the router i used by data flows uv are equal: > x, — > x, = 0, for all flows uv and all nodes/routers i ¢ {u,v} (4)

J=hey>0 J=ley »0 4. The data flow uv from the sending node u to the receiving node is routed over exactly one data link leading into the receiving node v: > x, — 2.x, 21, forall flows uv (5) i=l.¢;,>0 i=1.6,>0

The effect of the transport constraints defines exactly one loop-free data path from the sending node u to the receiving node v is illustrated in fig. 2. According to equation (3), only data link ua connecting the node u and the node a carries the data flow uv. One data link is leading into each of the nodes/routers a, b and c. In line with equation (4), 40 one data link is leading out of each of the nodes/routers a, b and c for the data flow uv.

EP-83507/PCT

Conditioned by equation (5), the data path for the data flow uv is directed over the data link cv between node/router c and the receiving node v and terminates in the receiving node v.

Nevertheless, it is still possible that a looped data path exists beside the chosen data path for the data flow uv since such loops are not avoided by the transport con- straints. However, such loops are avoided by the minimization of the average link utiliza- tion in the objective function (1).

Capacity constraints © 10 The capacity constraints ensure that the amount of data or the data traffic over data links do not exceed the capacity of the respective data links. The capacity constraints com- prise two sub-constraints for each da.a link ij between nodes i and j.

The first sub-constraints force the link utilization to be below a fixed level defined by a parameter a,: > x, f,. <ac, forall data links ij with ¢;>0 (6)

As set out above, data links within a data network are able to handle for a short time in- terval data traffic being larger than the physical transmission capacity of the respective data link. Therefore, the parameter a. is not restricted to values between 0 and 1. To set the parameter larger than 1 is also useful to identify links which are the first bottlenecks in case of congestion. For the method according to the invention, the parameter a. is set to 1 as a default value.

The second sub-constraints given by equation (7) defines an upper threshold for the link utilizations. The variable t used in the objective function (1) defines an upper bound for the utilization of all links. While the parameter a. is a fixed value, the variable t is to be minimized. The second sub-constraints force all link utilizations to have a value being lower than the value of the parameter t:

D> x, fi < 0S for all data links ij with ¢;>0 7)

Routing constraints

The routing constraints are the most important constraints since the routing constraints define only such combinations of data links or data paths, respectively, sufficiently to cal- culate the costs for data communication/routings obtained by a solution of the equation system for the linear optimization problem. Using the above-mentioned routing protocols, data are always communicated/routed over the shortest data path which is defined by a certain routing protocol metric for eac data link. As a consequence, all data flows from node/router i to node/router j have to be communicated/routed over the same data link(s) 40 between nodes/routersi and j.

EP-83507/PCT ) These constraints are achieved by a recursive system of sub-constraints: x + x — x" <1, for all data flows uv, nodes/routers / ¢ {u,v}, and data links st (8) xv +x ~ xy <1, forall data flows uv, nodes/routers ; ¢ {u,v}, : and data links st (9) “10 Conceiving an iterated or recursive application of equations (8) and (9), the routing be- tween nodes/routers i and j is identical for all data flows through these nodes/routers.

Therefore, the found solutions based on the routing constraints are corresponding with the implementation of the routing protocols.

Fig. 3 illustrates the effect of the routing constraints. Assuming that data flow ub is routed over nodes u, a and b, data flow ac is routed over nodes a, b and c and data flow cv is routed over nodes ¢, d and v, due to equations (8) and (9), data flow uv from the sending node u to the receiving node v has to be routed over nodes u, a, b, c, d and

V.

For data flow uc, two further data paths exist either over node a” or node b’. The data path including node a’ not be used for the data flow uc, since this data path does not include node a which would be contradictionary to equation (9). Moreover, the data path including node b’ can not be used for the data flow uc, since this data path does not include node b which would be contradictionary to equation (8). In other words, the data path including node a“ and the data path including node b" can not be used for the data flow uc, because these data paths do not fulfill the routing constraints to route all data flows, i.e. the data flows uc, ac and bv, over the same data links.

Physical delay constraints

On the basis of the objective function (1) in combination with the transport constraints, the capacity constraints and the routing constraints, a data routing can be achieved having the shortest path routing with an homogeneously, uniformly distributed data traf- fic. In order to obtain the goal to keep the physical delays for data communication in a network in a certain range, the physical delay constraints being described below have to be applied.

The range of possible physical delays is defined over a parameter a, while the lowest physical delay for a data flow is represented by a variable d,;". If P is a set of all loop-free data paths from node u to node v and if d, is the sum of all physical delays of the data links of a path p, the minimum physical delay J," is the delay of the path p from node u to node v with the smallest physical delay d,:

EP-83507/PCT dn" =min ,., (d,) (10)

The value of the minimum physical delay is obtained by computing all physical delays of all possible loop-free data paths from node u to node v. Introducing a parameter a,, an upper threshold adm" can be defined representing the maximum physical delay for each data flow: - > x,d, <add, forall data flows uv (11) 1.60 © 10 Reduction of the complexity of the equation system for the linear optimization problem

For the solution of the objective function (1), the number of variables to be considered is in the magnitude of N2M?, wherein N represents the number of nodes/routers and M rep- resents the number of data links. Determined by the routing constraints, the number of constraints is in the magnitude of N°M2. Especially for large networks including many nodes/routers and data links, the solution of the equation system for the linear optimiza- tion problem according to the invention can be very time consuming, complex, or even impossible. Therefore, a so-called pre-solver is used which reduces the number of vari- ables and constraints by considering only relevant data paths for the solution of the equation system.

Relevant data paths are identified on the basis of the respective physical delay.

For each data flow between two nodes/routers, all data paths being loop-free paths are determined. For each of these loop-free data paths, the physical delay is calculated, i.e. the sum of the physical delay of the data links forming the respective data path. Data paths having the smallest physical delay and having a delay lower than the upper physi- cal delay threshold a,d]." are identified as relevant data paths. Further, all data links of the relevant data paths are checked to be included in all relevant data paths or in none of the relevant data paths. Data links included in all relevant data paths will be used for routing the respective data flow over such data links. Data links included in none of the relevant data paths are not considered by the solution of the equation system of the lin- ear optimization problem such that the respective data flow is not routed via such data links. Data links included only by some of the relevant data paths are considered for the solution of the equation system and the utilization of such data links is determined by the solution of the equation system. Sub-optimal routing

In some cases, for example for very complex networks, it might be advantageous not to calculate an routing using the entire equation system but to utilize an approach de- scribed below resulting in a sub-optimal (sub-optimal: get a solution which is near the op- timum in a practicable time)routing. In contrast to the above described procedure, the 40 maximum link utilization is not directly minimized. Here, the minimization of the maximum

EP-83507/PCT link utilization is achieved by an iterative solution of a linear optimization problem having ) a different, reduced objective function and different, reduced capacity constraints. } The component a, *t of the objective function (1) for the minimization of the maximum link utilization is omitted. As a consequence, the sub-constraints for the capac- ity constraints represented by equation (7) forcing the utilization of different data links below the upper threshold for link utilizations is not necessary anymore. On the other hand, the other sub-constraints for the capacity constraints represented by equation (6) . is defined more strictly. Instead of using the default value of 1 for the parameter a, the parameter a. is iteratively minimized.

C10 Starting from a value of 1 for the parameter a., the equation system including the reduced objective function is solved. The link utilizations of single data links are de- temined on the basis on the found solution of the reduced equation system. In the next step the parameter a, is set to a value slightly smaller than the smallest determined link utilization. This procedure is repeated until the solution of the reduced equation system is converging. In case the equation system is not converging within a predetermined time interval or no solution of the equation system is existing, the routing determined by the last solution of the equation system is considered as sub-optimal soiution of the linear optimization problem.

Specification of the link costs

In order to specify the data link costs for the routing determined by the equation system or the reduced equation system, the data link costs have to be determined such that the found routing and the optimized data path, respectively, corresponds with the shortest path routing. This can be achieved by a equation system for a linear optimization prob- lem. In this case, the objective function is rather unimportant since the desired solution for the data link costs is obtained by computing an inequality system. A linear optimiza- tion problem is represented by an inequality system in combination with an objective function. Therefore, the determination of the interface costs can be calculated using an equation system for a linear optimization problem. As a result, a standard solver for lin- ear optimization problems can be used for the determination of the data link costs.

Using the above-mentioned pre-solver, all relevant/possible loop-free data paths for data flows have been determined. For each data path except for the desired/optimum data path, the sum of the data link costs for data links forming the respective data paths must be larger than the sum of the data link costs for the desired/optimum data path. An inequality system defining this constraints can be very complex. Therefore, a reduction of the number of inequality equations is desired. This can be achieved since all data flows from a sending node to a receiving node must be routed over the same data path. Con- sidering all data paths for a data flow, an inequality system must be defined only for those data paths which include only nodes/routers not comprised by the desired/optimum 40 data path.

EP-83507/PCT

If the solution of such an inequality system shows that for ali data paths except ’ the desired/optimum data path the sum of the data link costs of the data paths is larger } than the sum of the link costs of the clesired/optimum data path, the desired/optimum data path is corresponding with the shortest data path.

Path-oriented approach

As mention before it is possible to formulate the problem as a path-oriented approach. : The method is equal to the flow oriented approach with the following changes:

Variable © 10 The Boolean variable x! is introduced. This variable is set to 1 if the data flow uv from the sending node u to a receiving node v is routed over the data path k, otherwise the variable is set to 0. k is a index which is equal to u,b,...,v where u,b,...,v are notes which are building the path.

Objective function

Similar to the flow oriented approach the objective function of the path oriented approach includes two additive parts both of which have to be minimized: a*t+ > > dx, .withc>0

IL] 5, Ge

Transport constraints

The transport constraints ensure that one loop-free data path form the sending note u to a receiving node v exists. > x, =1 , for all paths uv k

Capacity constraints

The sum over the flows on each link must be smaller then the capacity of the link > > xd, sac, forall data links jj with ¢;>0 uv k. jek

Routing constraints

If x, define a path from u to v and x, define a path for k to v and both paths are routing over i, both paths are identical for the path i to v, thus

Pu ~ Pi <1

This routing constraints can be written as a recursive iteration over the index parameter k. E.g. a path from u to v is routed over a, b and c. Thus, k is defined as k=u,a,b,c,v thus the flow from a to v must use the path a,b,c,v and also the flow from b to v must use the path b,c,v and so on. This recursive iteration is also true in the opposite direction of the index parameter k.

Examples

To demonstrate the effect of the method according to the invention, the results of an op- 40 timized routing for example networks is described in the following. The used networks

EP-83507/PCT are shown in fig. 4. The network on the right of fig. 4 with only 6 nodes/routers was cho- ’ sen because its size allows to illustrate the resulting paths. The networks having 8 and } 14 nodes/routers were selected because of their complex structure which makes many different data paths possible. As example, the link capacity matrix C and the data fiow matrix F for the network having 6 nodes/routers is shown in tables 1 and 2.

I TY EO FR EN foo hee Jo fio fo Jo i mo Jo dso JoJo Jo © 2 Jo feo Jo fo Jo Jo 3 Jwo Jo Jeo Jo Jeo Jo 4 JoJo fo fro Jo Jo 5 Jo Jo Js fo fies fo

Table 1: Capacity matrix C for the network having 6 nodes/routers

I FY ER FR ER VE o Jo Is le lz fa Jz 2 le o fa le fa 3 8 Jo fa fos le

ENE FE

ER CR ER A TE, o

Table 2: Flow matrix F for the network having 6 nodes/routers

The physical delays of the different data links were set to 1, while the parameter a, was set to 3 in every optimization. Using the above described pre-solver, for example, the number of variables for the network having 14 nodes/routers was reduced from a value of 8800 to a value of 4714. Moreover, the number of constraints could be reduced to less than the half.

For all networks, optimizations with several parameter settings were performed.

First the optimization was performed without an effective upper threshold for the maxi- mum link utilization. This was achieved by omitting the constraints keeping the maximum link utilization below the value of the parameter t (as described in section "Sub-optimal optimization") and by setting the parameter a. to a value of 10. The resulting routing for the network having 6 nodes/routers is illustrated in fig. 5. The data link having the highest utilization of 42,9% is the data link 4-3. The value for the minimized average link utiliza- tion was calculated to 22,4%.

Then, the parameter a, was set to a value of 0,4 (= 40%) being slightly smaller than the calculated maximum link utilization of 42,9%. Iteratively reducing the parameter

EP-83507/PCT a., namely to values of 0,375 (= 37,5%) and 0,36 (= 36%), the optimum routing was : found for the parameter a, having the value of 0,36 which corresponds with the result of the default optimization.

In the default optimization, using the objective function (1), the parameter a, was set to a value of 1000. The result of this optimization for the network having 6 nodes/routers is illustrated in fig. 6. Again, the most utilized data link is the data link 4-3, however, its utilization was decreased to a value of 35,7%. As a compensation, the av- : erage link utilization was increased to a value of 22,7%.

As shown in figs. 5 and 6, the data flow 5-0 was taken away from data link 4-3 © 10 and routed over nodes/routers 2 and 1. Therefore, the data path for the data flow 2-0 was also routed over node/router 1. Further, data flow 2-4 was routed over node/router 5 instead over node/router 3, in order to reduce the link utilization of data link 3-4 from a value of 40% to a value of 35,7%.

On the basis of the above described determination of data link costs, the data link costs as small as possible were specified such that the shortest path routing is equiva- lent to the routing defined by the above optimization. Figs. 7 and 8 illustrate the calcu- lated data link costs wherein the respective data link costs and the respective physical delays are drawn in the gray boxes. As shown in fig. 7, the overall data link costs for data flow 5-0 is 3. Other possible data paths for data flow 5-0 include nodes/routers 2 and 1 or nodes/routers 2 and 3. The overall physical delay for these paths are 5 and 4, respec- tively. The shortest path is the same as the desired path having a minimized average link utilization.

In fig. 8, based on an optimization with respect to a minimized maximum link utili- zation, the physical delay for the data path of data flow 5-0 is 3, also. The physical de- lays of the other possible data paths over nodes/routers 4 and 3 or over nodes/routers 2 and 3 are 4 and 6, respectively. Again, the shortest data path is corresponding with the desired/optimum data path.

The optimizations of data routings for the networks having 8 and 14 nodes/routers was performed similarly. First, the average link utilization was minimized without restriction for the maximum link utilization. Then, the maximum link utilization was decreased iteratively. At the end, the optimization was performed to obtain the minimal possible maximum link utilization. However, the network having 14 nodes/routers proves to be complex to obtain an optimal solution. The maximum link utilization was reduced to 38,8%, while the minimal value for the maximum link utilization is not known. However, the minimal link utilization has to be greater than a value of 32%, since for this value the equation system for the linear optimization problem proved to be infeasible. in figs. 9 and 10, the results for the routing optimizations with selected upper thresholds for the maximum link utilizations for the networks having 8 and 14 nodes/routers are shown. The maximum link utilization could be decreased, while the 40 average link utilization almost remains unchanged. As represented by the bars identify-

EP-83507/PCT ing the difference between link utilizations of the most and the least utilized data links, ) the data traffic distribution becomes more homogeneous with a stricter upper threshold of the maximum link utilizations. In particular, the difference could be reduced to almost a quarter of the network having 8 nodes/routers (see fig. 9). For the network having 14 nodes/routers, the optimization effect is less clear since in this network links are existing with an utilization of only about 1% independent of the selected upper threshold for the maximum link utilization (see fig. 10).

Since the optimization results in a reauction of the highest value for the maximum link utilization, link utilization of specific links have to be increased as a compensation. As il- - 10 lustrated in fig. 11, the link utilization of selected data links is shown for different upper thresholds for the maximum link utilization. The link utilization of data links initially highly utilized is decreased for a reduction of the upper threshold for the maximum link utiliza- tion. This applies for example for data links 9-4, 4-9 and 4-2. In consequence, the link utilization of data links 8-5, 5-8 and 3-1 is increased.

Measure the End-to-End matrix (e.g. SNMP, Accounting/Billing Software) and collect the data on a central system (INTERNET-server)

Build from the collected data the capacity, flow, delay matrix

Use the method to calculate the optimal routing parameter.

Configure the router with the optimal parameter over the router configure software.

For smaller networks it’s possible to collect the needed information to build the matrixes with the routing protocol (e.g. change the routing protocol or use a extra protocol) and calculate the optimal routing parameters in every router. In this case no central unit is needed.

Claims (20)

EP-83507/PCT ] CLAIMS

1. Method for communicating data via an optimum data path in a network having a . plurality of nodes (u, v, a, b, c, d) connected via data links, the method comprising: - determination of an optimum data path from a sending node (u) to a receiving node (v) by -- determination of all loop-free data paths from the sending node (u) to the receiving node (v) via respective data links and nodes (u, v, a, b, c, d), -- selection of data paths such that all data to be communicated between two nodes are communicated via the same data path, ) -- determination of maximum link utilizations, or average link utilizations, or values indica- tive of combinations of the maximum link utilizations and the average link utilizations of the selected data paths, and -- defining the data path having the minimal maximum link utilization, or the minimal av- erage link utilization, or the minimal value indicative of combinations of the maximum link utilizations and the average link utilizations as the optimum data path, and - communicating data from the sending node (u) to the receiving node (v) via the opti- mum data path.

2. Method according to claim 1, wherein the selection of data paths comprises: - determination of data communication capacities of the data paths and selecting data paths having data communication capacities sufficient to communicate the data from the sending node (u) to the receiving node (v).

3. Method according to claim 1 or 2, wherein the selection of data paths comprises: - determination of physical delays of the data paths and selecting data paths having physical delays equal or smaller than a predetermined maximum physical delay.

4. Method according to one of the claims 1-3, wherein the determination of the op- timum data path comprises: - definition of an equation system for a linear optimization problem for identifying the op- timum data path, and - solution the equation system to define the optimum data path.

5. Method according to claim 4, wherein the definition of the equation system com- prises: - definition of an objective function for determination of maximum link utilizations, or av- erage link utilizations, or values indicative of combinations of the maximum link utiliza- tions and the average link utilizations.

EP-83507/PCT

6. Method according to claim 4 or 5, wherein the definition of the equation system ’ comprises: - definition of transport constraints for determination of the loop-free data paths.

7. Method according to one of the claims 4-6, wherein the definition of the equation system comprises: - definition of routing constraints ensuring that all data to be communicated between two : nodes are communicated via the same data path. "10

8. Method according to one of the claims 4-7, wherein the definition of the equation system comprises: - definition of capacity constraints for determination of the data paths having sufficient data communication capacities.

9. Method according to one of the claims 4-8, wherein the definition of the equation system comprises: - definition of physical delay constraints for determination of the data paths having physi- cal delays for respective data links being equal or smaller than a predetermined maxi- mum physical delay.

10. Method according to one of the claims 5-9, wherein the solving of the equation system comprises: - minimization of the objective function regarding the constraints for determining all pos- sible data paths and defining the data path having the minimal maximum link utilization, or the minimal average link utilization, or the minimal value indicative of combinations of the maximum link utilizations and the average link utilizations as the optimum data path.

11. Method according to one of the claims 1-10, wherein - the combinations of the average link utilization and the maximum link utilization are rep- resented by a function including the average link utilization and the maximum link utiliza- tion weighted with respect to each other.

12. Method according to one of the claims 4-11, wherein - the last solution of the equation system being determined within a predefined time in- terval identifies the optimum data path, -- if the current equation system cannot be solved, or -- if no minimum is determined for the objective function, or -- the objective function does not converge. 40 13. Method according to one of the claims 4-12, wherein

EP-83507/PCT - the number of variables of the equation system is reduced and/or data links are deter- mined to be considered for the solution of the equation system by , -- determining the time for data communication for all loop-free data paths from the sending node to the receiving node, and -- identifying the data paths as not to be considered for the solution of the equation sys- tem for which a minimum data communication time and/or a data communication time being smaller than a predefined maximum data communication time are determined.

14. Method of claim 13, wherein : © 10 - data links being included by all possible data paths are considered for the solution of the equation system, and/or SEE - data links not being included by any of the possible data paths are not considered for the solution of the equation system.

15, Method according to one of the claims 4-14, wherein - the physical delay constraints are defined by predefined data communication times for the data links between the nodes of the network, and/or - the physical delay constraints are defined by transforming band widths of data into re- spective physical delays.

16. Method according to one of the claims 1-15, wherein - the determination of the optimum data path is performed continuously, or at predefined times, or in predefined time intervals while the amount of data to be communicated is determined continuously, or at predefined times, or in predefined time intervals.

17. Method according to one of the claims 1-16, wherein : - the determination of the optimum data path is performed for a predefined or maximal amount of data to be communicated.

18. Method according to one of the claims 1-17, wherein - the optimum data path is proved to be the shortest data path by -- determining the costs for data communication via the data paths, whereby the optimum data path is identified as shortest data path if the optimum data path has the minimum costs.

19. Method according to claim 18, wherein - the data communication costs are determined only for data links including different nodes of the network, and/or - the identification of the optimum data path is performed separately for at least two parts 40 of the network, and/or

EP-83507/PCT - at least one part of the network is grouped to a virtual node and the optimum data path in the remaining portion of the network including the virtual node and the optimum data . path in the grouped part of the network are identified separately.

20. System for communication of data in a network via an optimum data path, the system comprising: - a network having nodes connected by data links, at least one of the nodes being a : sending node (u) and at least one of the nodes being a receiving node (v), and - control means being connected to the network for controlling data communication in the © 10 network, characterized in that - the control means are adapted to carry out a method according to one of the preceding claims.