AU750013B2

AU750013B2 - Explicit rate marking for flow control in ATM networks

Info

Publication number: AU750013B2
Application number: AU40814/99A
Authority: AU
Inventors: Ping Wang; Tao Yang; Wengang Zhai
Original assignee: Ascend Communications Inc
Current assignee: Ascend Communications Inc
Priority date: 1998-05-15
Filing date: 1999-05-17
Publication date: 2002-07-11
Anticipated expiration: 2019-05-17
Also published as: JP2002516525A; WO1999060758A1; EP1110353A1; AU4081499A; CA2332116A1; EP1110353A4

Description

-1- EXPLICIT RATE MARKING FOR FLOW CONTROL IN ATM NETWORKS Field of the Invention The invention relates generally to the field of digital communications systems and more particularly to digital networks for facilitating communication of digital data in, for example, digital image, audio and video distribution systems and among digital computer systems. The invention is more particularly directed to a digital network in which message transfer paths may be provided with various classes of transfer service, including an unregulated available bit rate service and provides a mechanism for allowing the network to control the rate at which devices transmit messages over the network based on congestion along the path between source devices and destination devices.

Background of the Invention Any discussion of the prior art throughout the specification should in no way be considered as an admission that such prior art is widely known or forms part of common general knowledge in the field.

Digital networks have been developed to facilitate the transfer of information, including data and programs, among digital computer systems and other digital devices. A i variety of types of networks have been developed and implemented using diverse information transfer methodologies. In networks in which information is transferred using the well-known "ATM" ("Asynchronous Transfer Mode") transfer methodology, communications are handled through a mesh of switching nodes. In an ATM network, the computer systems and other devices are connected to various ones of the switching nodes to, as information sources, provide information for transfer over the network and/or, as destinations, receive information from the network, with the information being transferred Sover paths, termed "virtual paths" and "virtual circuits," established through switching nodes comprising the network. The virtual circuits through an ATM network can be :assigned to various types of service classes, which serve to govern the rate at which *o information, in the form of"cells," is transferred thereover. In some service classes, virtual circuits are guaranteed maximum rates at which information can be transferred thereover. Other service classes, on the other hand, provide "available bit rate" ("ABR") services, for which virtual circuits are each guaranteed a minimum information transfer rate, referred to as a "minimum cell rate" and can also make use of the bandwidth which has not been assigned to the virtual circuits which have the guaranteed -2maximum rates. For virtual circuits for which guaranteed maximum rates are provided, the sources already know the rates at which they can transmit information.

However, for virtual circuits which are associated with ABR services classes, the rate at which the sources can transmit may vary based on a number of factors, including, but not limited to, congestion conditions at the destination as well as congestion conditions at each switching node along the respective path from the source to the destination. To facilitate notifying each source of a virtual circuit which makes use of the ABR service class of the maximum rate at which it can transfer over the virtual circuit, the source periodically transmits a "resource management" cell over the virtual circuit, the RM cell including the MCR assigned to the virtual circuit. When the destination receives the RM cell, it transmits the RM cell back to the source in the reverse direction along the virtual circuit. The destination can include an explicit rate value in the backward RM cell which indicates the maximum rate at which the source can transmit information. Each switching node along the path can also determine the maximum rate at which it can allow the source to transmit information and, if that rate is lower than the explicit rate contained in the backward RM cell, it can substitute its rate i as the explicit rate value in the backward RM cell. Thus, when the source receives the backward RM cell, the explicit rate contained therein will be the minimum value generated by the destination and all of the switching nodes along the path defined by the 20 virtual circuit.

Summary of the Invention eeo.oi The invention provides a new and improved system and method, referred to S"herein as a virtual bandwidth explicit rate marking system, for performing explicit rate marking of resource management (RM) cells in an ATM network.

According to a first aspect, the present invention provides an explicit rate coo marking system for use in connection with a switching node to generate an explicit rate value for use in a resource management cell associated with a virtual circuit in an ATM network, the explicit rate marking system comprising: A. a virtual bandwidth value generator module configured to generate a virtual bandwidth value reflecting an available bandwidth capacity value, an explicit rate value associated with each bottlenecked virtual circuit for which said switching Anode forms part of a path, and a minimum cell rate value associated with each 2a unbottlenecked virtual circuit for which said switching node forms part of a path, and B. an explicit rate value generator module configured to generate the explicit rate value in relation to the virtual bandwidth value and the minimum cell rate value associated with the virtual circuit and other virtual circuits for which said switching node forms part of a path.

According to a second aspect, the present invention provides an explicit rate marking method for use in connection with a switching node to generate an explicit rate value for use in a resource management cell associated with a virtual circuit in an ATM network, the explicit rate marking method comprising: A. a virtual bandwidth value generator step including the step of generating a virtual bandwidth value reflecting an available bandwidth capacity value, an explicit rate value associated with each bottlenecked virtual circuit for which said switching node forms part of a path, and a minimum cell rate value associated with each unbottlenecked virtual circuit for which said switching node forms part of a path, and S. B. an explicit rate value generating step including the step of generating the explicit rate value in relation to the virtual bandwidth value and the minimum cell rate value associated with the virtual circuit and other virtual circuits for which said 20 switching node forms part of a path.

Unless the context clearly requires otherwise, throughout the description and the .:oooi claims, the words 'comprise', 'comprising', and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of "including, but not limited to".

ooo go WO 99/60758 PCT/US99/10807 -3- BRIEF DESCRIPTION OF THE DRAWINGS This invention is pointed out with particularity in the appended claims. The above and further advantages of this invention may be better understood by referring to the following description taken in conjunction with the accompanying drawings, in which: FIG. 1 schematically depicts an ATM network including a system for performing explicit rate marking for flow control in ATM networks using a virtual bandwidth-based methodology, constructed in accordance with the invention; FIG. 2 schematically illustrates the structure of message packets and constituent message cells transferred over the network depicted in FIG. 1; FIG. 3 schematically depicts a switching node, constructed in accordance with the invention, which is used in the computer network depicted in FIG. 1; FIG. 4 is a flow chart depicting general operations performed by an explicit rate marking system constructed in accordance with the invention; and FIGS. 5 and 6 are flow charts depicting details of operations performed by the explicit rate marking system.

DETAILED DESCRIPTION OF AN ILLUSTRATIVE EMBODIMENT FIG. 1 schematically depicts an illustrative ATM network 10 including a system for performing explicit rate marking for flow control in ATM networks using a virtual bandwidth-based methodology, constructed in accordance with the invention. With reference to FIG. 1 network includes a plurality of switching nodes 11(1) through 11(5) (generally identified by reference numeral 1 for transferring signals representing data among a number of devices 12(1) through 12(10) (generally identified by reference numeral The devices 12(m) may comprise any of a number of types of devices, including, for example, digital computer systems, other networks, customer premises equipment, and the like. In their operations, certain devices 12(ms (subscript referencing "source") may, as a source device, need to transfer data to another, destination, device 1 2 (mD) (subscript referencing "destination"), which may need to use the transferred information in its operations. Each device 12(m) is connected over a communication link, generally identified by reference numeral 13(j), to a switching node 1 to facilitate transmission of data thereto or the reception of data therefrom. The switching nodes 11 are interconnected by communication links, also generally identified by reference numeral 13(j) to facilitate the transfer WO 99/60758 PCT/US99/10807 -4of data thereamong. The communication links 13(j) may utilize any convenient data transmission medium; in one embodiment, the transmission medium of each communication link 13(j) is selected to comprise one or more fiber optic links. Each communication link 13(j) is preferably bidirectional, allowing the switching nodes 11 to transmit and receive signals among each other and with devices 12(m) connected thereto over the same link; in the embodiment in which the communication links 130) are fiber optic links, two optical fibers will be provided for each communication link 13(j), each of which facilitates unidirectional transfer of optical signals.

In one embodiment, the network 10 transfers data using the well-known "ATM" ("Asynchronous Transfer Mode") transfer methodology. That methodology is described in detail in C. Partridge, Gigabit Networking, (Reading MA: Addison Wesley Publishing Company, 1994), primarily in chapters 3 and 4, and D. McDysan, et al., ATM Theory And Application (McGraw Hill, 1995) and will not be described in detail. Generally, with reference to FIG. 2, in the ATM methodology, the devices 12(m) and the switching nodes 1 1(n) transmit data in the form of fixedlength "cells." In the ATM data transfer methodology, for a packet 20 to be transmitted from a source device 12(ms) to a destination device 1 2 the source device 1 2 (ms) allocates the data packet 20 to a plurality of "cells," identified CELL(1) through CELL(I) (generally identified for transmission serially over the communication link 13(j) to initiate transfer thereof over the network 10. Each cell includes a header portion HEADER(i) and a data portion DATA(i), with the header portion HEADER(i) including circuit" information which controls the transfer of the cell through the network 10, and the data portion DATA(i) containing data from the packet 20. The data portion DATA(i) of each cell is of fixed, predetermined length (in one embodiment forty-eight bytes) and so the source device 12(ms) will pad the data in the last data portion DATA(i) if the amount of data in the packet 20 is not an integral multiple of the size of the data portion DATA(i) of each cell to ensure that the last data portion DATA(i) has the required length.

As noted above, the source device 1 2 (ms) transmits the series of cells CELL(1) through CELL(i) generated from a data packet 20 in order, and the network 10 is to deliver the cells to the destination device 1 2 (mD) in the order in which they are transmitted. The destination device 1 2 (mD) must receive all of the cells transmitted by the source device 12(ms) in order to reconstruct the packet In the aforementioned ATM transfer methodology, the cells do not contain ordering information; and so the destination device 1 2 (mD) determines the proper order to reconstitute the packet 20 from WO 99/60758 PCT/US99/10807 the order in which it receives the cells. The last cell CELL(i) includes a set end of packet flag, designated EOP in FIG. 2, to indicate that it is the last cell for the packet.

As further noted above, header portion HEADER(i) includes "virtual circuit" information which controls the transfer of the cell over the network 10. Each switching node 1 l(n) uses the virtual circuit information for a cell CELL(j) that it receives over an input communication link to identify an output communication link over which it is to transmit the cell to the next switching node or the destination device 1 2 The virtual circuit information in the headers HEADER(i) of the cells CELL(i) associated with a packet 20 will be the same, but it will differ for cells associated with different packets. Although a destination device 1 2 (mD) will be receiving cells generated for a specific packet 20 in the order of the data in the packet, it may be contemporaneously receiving cells from the network 10 which originated at several source devices 12(ms), which cells may be received in an interleaved manner. The virtual circuit information in each cell CELL(i) will enable the destination device 12(mD) to determine the packet 20 with which the cell is associated.

For virtual circuits over which cells are transferred using the ATM's ABR (available bit rate) service, in addition to cells, such as those described above in connection with FIG. 2, for transferring data, the network 10 also transfers resource management cells which carry flow control information used by the respective source devices 12(mS) to regulate the rate at which they transmit cells over each virtual circuit. Generally, for each virtual circuit for which a device 12(m) is the source device 12(mS), the device 12(mS) periodically transmits an RM cell thereover to the virtual circuit's destination device 12(mD). When the destination device 12(mD) receives the RM cell, it transmits it (that is, the RM cell) back to the source device 12(mS) over the virtual circuit in a reverse direction. The RM cell, when traversing the path from the source device 12(mS) to the destination device 12(mD), is referred to as a "forward" RM cell, and, when traversing the path from the destination device 12(mD) to the source device 12(mS), is referred to as a "backward" RM cell. The destination device 12(mD) and each switching node 1 along the path of the virtual circuit from the destination device 12(mD) to the source device 12(mS) can provide flow control information in the BRM cell. The flow control information provided by the destination device 12(mD) or a switching node 11 may, for example, be reflective of the degree of congestion at the respective destination device 12(mD) or switching node 11 or the like. The flow control information serves to limit the rate at which the source device 12(mS) will transmit cells, above a minimum cell rate which has been assigned to the virtual circuit, and which the source WO 99/60758 PCT/US99/! 0807 -6device 12(mS) includes in the FRM cell when it (that is, the source device 12(mS)) transmits the FRM cell.

Typically, when a switching node 11 receives an BRM cell for a virtual circuit, it can generate flow control information and determine whether the flow control information indicates a lower cell transmission rate than indicated in the received BRM cell. Ifnot, the switching node 1 (n) will transmit the BRM cell with the same flow control information as received. On the other hand, if the switching node 1 1(n) determines that the flow control information which it generates does indicate a lower cell transmission rate than indicated in the received BRM cell, it will substitute the flow control information which it generated for the received flow control information in the BRM cell before transmitting the BRM cell. Thus, when the source device 12(mS) receives the BRM cell, the flow control information will reflect the minimum of the flow control information as among the destination device 12(mD) and the switching nodes 11 which received the BRM cell, which, in turn, is the minimum for the virtual circuit. The invention provides an explicit rate marking system for generating an explicit rate marking system used by the switching nodes 1 to generate the flow control information for inclusion in the BRM cells.

The switching nodes l(n) comprising network 10 all have generally the same structure, which will be described in connection with FIG. 3. With reference to FIG. 3, each switching node 1 l(n) includes an input interface 30, a buffer 32, and an output interface 34, all under control of a control element 35. To facilitate bi-directional communications, the input interface 30 and output interface 34 will be connected to all of the communication links 13(p) to which the switching node 1 l(n) is connected to facilitate reception of signals from, and transmission of signals to, others of the switching nodes in the network 10 or ones of the devices 12(m) to which the switching node 11 (n) is connected. In the case of the above-described embodiment in which the communication links 13(p) are in the form of optical fibers, the input interface 30 is connected to particular ones of the communication links, namely, input communication links over which the switching node l receives the optical signals, and the output interface 34 is connected to others of the communication links, namely, output communication links over which the switching node transmits the optical signals. It will be appreciated that each input communication link 13(p)(i) will constitute an output communication link over which a device 12(m) or another switching node in the network 11 transmits signals, and each output communication link 13(p)(o) will constitute an input WO 99/60758 PCT/US99/10807 -7communication link over which a device 12(m) or another switching node in the network 11 receives signals.

As noted above, the invention provides an explicit rate marking system 36, which is included in and forms part of the control element 35 of the respective switching node 1 for generating flow control information for inclusion in the BRM cells received thereby. The explicit rate marking system 36 will be described in connection with the illustrative network 10, in which five illustrative virtual circuits are established between respective source and destination devices as follows: virtual circuit between source device 12(1) and destination device 12(6) through switching nodes 11(1) through 11(4) and over communication links 13(1) through 13(4), 13(5) and 13(1), with an MCR of 10 (in arbitrary units), (ii) virtual circuit between source device 12(2) and destination device 12(7) through switching nodes 11(1) and 11(2) and over communication links 13(1), 13(6) and 13(11), with an MCR of 2, (iii) virtual circuit between source device 12(3) and destination device 12(3) through switching nodes 11(1), 11(2) and 11(3) and over communication links 13(1), 13(2), 13(7) and 13(12), with an MCR of 3, (iv) virtual circuit between source device 12(4) and destination device 12(9) through switching nodes 11(2), 11(3) and 11(4) and over communication links 13(2), 13(3), 13(8) and 13(13), with an MCR of 10, and virtual circuit between source device 12(5) and destination device 12(10) through switching nodes 11(4) and 11(5) and over communication links 13(4), 13(9) and 13(14), with an MCR of In addition, each communication link 13(1) through 13(4) interconnecting the respective switching nodes 1 l(n) has a maximum bandwidth capacity Cj available for the ABR service; in the illustrative network 10, communication link 13(1) has a capacity C 1 =150 (in arbitrary units), communication links 13(2) and 13(3) have respective capacities C 2

=C

3 =100, and communication link 13(4) has a capacity C 4 =60. It will be appreciated that the explicit rate Ri for the "i-th" virtual circuit will be the minimum of the link explicit rates Rij over the communication links 13(j) which form the path for the virtual circuit, that is, R, min{Rjj e WO 99/60758 PCT/US99/10807 -8where corresponds to the set of communication links which form the path for the "i-th" virtual circuit.

As is clear, communication links 13(1) through 13(4) interconnecting the switching nodes 1 l(n) can form paths for multiple virtual circuits. Generally, in determining the link explicit rate Rj for each virtual circuit, it is desired to be "fair" to each virtual circuit and to maximize the utilization of the respective communication link 13(j). There are two general methodologies for determining fairness, namely, an equal share methodology and a proportional methodology. In the equal share methodology, the portion of the bandwidth for a communication link 13(j) above the MCR's for all of the virtual circuits for which the communication link 13(j) forms part of the path (which will be referred to as the "excess bandwidth"), is divided among the virtual circuits on an equal basis, and the link explicit rate Rj for the "i-th" virtual circuit will be the sum of that and the virtual circuit's MCR, that is

MCR,

il(j) (2) R,j MCR, (2) Ij) where "1I(j)1" represents the number of virtual circuits for which the communication link 13(j) forms part of the path. On the other hand, in the proportional share methodology, the entire bandwidth is divided among the virtual circuits on a basis in proportion to their MCR's, that is It will be appreciated that, under the equal share methodology, virtual circuits and will have link explicit rates Rj of 55, 47 and 48, respectively, and under the proportional share

MCR,

C3).

1, C MCR, iel(j) methodology, they will have link explicit rates Rj of 100, 20, and 30, respectively, A similar operation can be performed at every communication link 13(j) to determine the link explicit rate Rij for the respective link and virtual circuit, and, as noted above, the explicit rate R, for each virtual circuit will be the minimum of the link explicit rates Rj for the respective virtual circuit.

In that connection, since the sum of the MCR's for the virtual circuit's and for which WO 99/60758 PCT/US99/10807 -9communication link 13(4) forms part of their respective paths, equals the capacity C 4 =60, it is apparent that, even though virtual circuit could, over communication link 13(1) be allocated an explicit rate higher than 10, because the virtual circuit is bottlenecked by the communication link 13(4), it (that is, virtual circuit(l)) can only be allocated an explicit rate R, of 10 at communication link 13(1). Accordingly, since the explicit rate for virtual circuit at communication link 13(1) will be far below that that could be assigned to the virtual circuit for communication link 13(1) as described above, there will be additional bandwidth capacity over communication link 13(1) which can be assigned to virtual circuits and in which case they will be assigned link explicit rates of, for example, 56 and 84, respectively, using the proportional share methodology.

The explicit rate marking system 36 provided by the invention determines the explicit rate using a virtual bandwidth methodology, in which for a communication link 13(j), if a virtual circuit for which the communication link 13(j) forms part of the path is bottlenecked over another virtual circuit, the explicit rate marking system 36 determines the link explicit rate(s) of other virtual circuits which use it (that is, communication link 13(j)) as part of the path, by generating a virtual bandwidth value C'j available for the ABR service, and determining link explicit rates as described above in connection with equations and using the virtual bandwidth value C'j as well as the actual bandwidth capacity Cj available for the ABR service. For the virtual circuits which are not bottlenecked, the link explicit rate Ri, will be the link explicit rate so determined, whereas for the virtual circuits which are bottlenecked. The explicit rate marking system 36 determines the virtual bandwidth value C'j according to C' C MCR,- R, I MCR, iElu iE(j) for the equal share methodology, and

MCR,

C, Y, R, E I MCR, il(j) for the proportional share methodology, where corresponds to the set of virtual circuits which are bottlenecked elsewhere, Iu(j) corresponds to the set of virtual circuits which are not bottlenecked WO 99/60758 PCT/US99/10807 elsewhere, and Nj represents the number of virtual circuits for which the communication link 13(j) forms part of the path (which, in turn, corresponds to II0)1 in equation It will be appreciated that, for the proportional share methodology (reference equation the virtual bandwidth C'j for communication link 13(j) corresponds to the bandwidth capacity available for virtual circuits which are not bottlenecked, which corresponds to C I R, i'le(j) multiplied by the ratio of the MCR's for all virtual circuits for which the communication link 13(j) forms part of the path, to the MCR's for the unblocked virtual circuits for which the communication link 13(j) forms part of the path. It will be appreciated that, if the virtual bandwidth C'j is used

MCR,

instead of bandwidth capacity Cj in equation R,j C Z I R, that is, the i 2 MCR,i iel u

(J)

link explicit rate for an unbottlenecked virtual circuit corresponds to the bandwidth capacity available for virtual circuits which are not bottlenecked multiplied by the ratio of the MCR of the respective virtual circuit to the sum of the MCR's of the virtual circuits which are not bottlenecked.

The virtual bandwidth C'j for the equal share methodology is somewhat more complex. The factor C MCR, Y R, corresponds to the amount of bandwidth capacity for iEJ

U

iEle(j) communication link 13() which is available for distribution to unbottlenecked virtual circuits, that is, the total bandwidth capacity minus the bandwidth capacity taken up by the bottlenecked virtual circuits R, and minus the bandwidth capacity required to provide the MCR's for the iel (j) Nj unbottlenecked virtual circuits I MCR, The factor ,when the virtual bandwidth C', iU Iu(J) (equation is used to determine the link explicit rate for a virtual circuit (equation will 1 provide a factor of u effectively dividing the bandwidth capacity available for distribution I'u(i)| WO 99/60758 PCT/US99/10807 -11to unbottlenecked virtual circuits by the number of unbottlenecked virtual circuits. When the equal share methodology virtual bandwidth (equation is used in determining the link explicit rate R,j, the addend 1 MCR, in equation will cancel the same value in the quotient, so that the link iEl(j) explicit rate Rj in the equal share methodology will correspond to JMCR MCR, Z R Ul (A u(j) i e1() The general operations performed by the explicit rate marking systems 36 of the switching nodes 1 to determine the explicit rate R, for each virtual circuit will be described in connection with the flowchart depicted in FIG. 4. With reference to FIG. 4, each explicit rate marking system 36, for each virtual circuit and each connection, initially determines the link explicit rate Rj for each communication link 13(j) using equation or for the selected methodology using the actual bandwidth capacity Cj of the respective communication link 13(j) available for the ABR service (step 100). Thereafter, the explicit rate marking system 36 marks each bottlenecked virtual circuit and assigns it its explicit rate R, in accordance with equation (step 101). The explicit rate marking system 36 then determines if there are any virtual circuits which have not been marked (step 102).

If the explicit rate marking system 36 makes a positive determination in step 102, it has not determined the explicit rate R, for all of the virtual circuits, and in that case it will sequence to step 103 in which it identifies each communication link 13(j) which forms part of the path for at least one non-bottlenecked virtual circuit, and thereafter determine the virtual bandwidth value therefor in accordance with equation or (step 104). The explicit rate marking system 36 then determines the link explicit rate Rj for each of the unmarked virtual circuits using equation or using the virtual bandwidth values C'j instead of the actual bandwidth capacities Cj (step 105) and returns to step 101 to identify and mark virtual circuits which are determined to be bottlenecked using the new link explicit rates. The explicit rate marking system 36 repeats steps 101 through 105 until it determines in step 102 that all of the virtual circuits have been marked, at which point it will exit (step 106). It will be appreciated that, by the point at which the explicit rate marking system 36 determines that all virtual circuits have been marked, explicit rates R, will have been determined for all of the virtual circuits.

WO 99/60758 PCT/US99/10807 -12- In one embodiment, instead of updating the virtual bandwidth value C'j available to the ABR service explicitly as described above in connection with equations or the explicit rate marking system 36 maintained by each switching node 11 after generating the virtual bandwidth value once, can make use of a virtual bandwidth factor "vbf," which it periodically updates as ATM cells are received and transmitted. The virtual bandwidth factor relates the bandwidth capacity Ci available for the ABR service to the virtual bandwidth C' according to C'j=vbf*C (where is the multiplication operation). In that embodiment, operations performed by the explicit rate marking system 36 when an ATM cell arrives at a switching node 1l(n) over communication link 13(j) will be described in connection with the flow chart depicted in FIG. 5. With reference to FIG. 5, when the switching node 11 receives an ATM cell (step 120), initially the explicit rate marking system 36 updates several counters which are used for monitoring cell traffic load and capacity. In particular, the explicit rate marking system 36 will increment a total counter which identifies the total number of cells received since the beginning of an interval (step 121). The explicit rate marking system 36 will also determine whether the ATM cell is for a virtual circuit using the ABR service (step 122), and, if so, increment an interval ABR cell counter and a buffered ABR cell counter (step 123). The interval ABR cell counter identifies the number of ATM cells which have been received since the beginning of the same interval. The buffered ABR cell counter identifies the number of cells for virtual circuits which utilize the ABR service currently in the switching node's buffer 32.

Thereafter, the explicit rate marking system 36 determines whether the total counter's value corresponds to a predetermined update interval value (step 124). If the explicit rate marking system 36 makes a negative determination in step 124, it will return to step 120 to wait for the arrival of the next ATM cell.

On the other hand, if the explicit rate marking system 36 makes a positive determination in step 124, it will sequence to a series of steps to update the variable bandwidth factor vbf. Initially, the explicit rate marking system 36 determines an update time interval value corresponding to the actual time interval over which the number of cells corresponding to the update interval value was received (step 125). Using the update time interval value, the explicit rate marking system 36 will determine an ABR rate value and a non-ABR rate value (step 126), the ABR rate value corresponding to the value provided by the interval ABR cell counter divided by the update time interval value and the non-ABR rate value corresponding to the difference between the value provided by the total counter and the interval ABR cell counter divided by the update time interval WO 99/60758 PCT/US99/10807 -13value. Thereafter, the explicit rate marking system 36 can reset the total counter and the interval ABR cell counter (step 127) for use during the next cell reception interval.

After the counters have been reset in step 127, the explicit rate marking system 36 updates an ABR bandwidth capacity value (which corresponds to Cj above) and an ABR utilization value (step 128). The ABR bandwidth capacity value reflects the bandwidth that is currently available for the ABR service. The explicit rate marking system 36 updates the ABR bandwidth capacity value in relation to a smoothing value, the previously generated ABR bandwidth capacity value and the difference between the a target bandwidth utilization capacity for the respective communication link 13(j) and the non-ABR rate value as determined in step 126. It will be appreciated that the difference will generally correspond to the bandwidth capacity that is then available for the ABR service over the respective communication link. Generally, the smoothing value is selected to be between zero and one, and the explicit rate marking system 36 generates the updated ABR bandwidth capacity value as the smoothing value multiplied by the difference between the target bandwidth utilization capacity for the respective communication link 13(j) and the non-ABR rate value, plus one minus the smoothing value multiplied by the current ABR bandwidth capacity value. The smoothing value is used to smooth changes which may occur between vbfupdates, and in one embodiment is selected to be on the order of one-eighth.

The ABR utilization value updated in step 128 reflects the portion of ABR bandwidth capacity that is currently being utilized. The explicit rate marking system 36 updates the ABR utilization value in relation to the smoothing value, the ABR rate value generated in step 126, the just-generated ABR bandwidth capacity value and the current ABR utilization value. Generally, the ABR rate divided by the ABR bandwidth capacity value reflects the portion of the ABR bandwidth capacity that is currently being utilized. Accordingly, the explicit rate marking system 36 generates the updated ABR utilization value as the smoothing value multiplied by the ABR rate and divided by the ABR capacity value, plus one minus the smoothing value multiplied by the current ABR utilization value.

Following step 128, the explicit rate marking system 36 generates the value of a vbf utilization factor, in relation to the current ABR cell occupancy of the buffer 32 as determined by the buffered ABR cell counter and three predetermined utilization factor values, namely, an maximum utilization factor value, an intermediate utilization factor value and a minimum utilization factor value. In that operation, the explicit rate marking system 36 initially determines whether the WO 99/60758 PCT/US99/10807 -14current ABR cell occupancy is below a low threshold value (step 129). If the explicit rate marking system 36 makes a positive determination in step 129, the number of cells for virtual circuits utilizing the ABR service is relatively low. In that case, the explicit rate marking system 36 initially generates a proportionality value as the difference between the maximum and intermediate utilization factors divided by the low threshold value (step 130), and the vbf utilization factor value as the maximum utilization factor value minus a value corresponding to the proportionality value times the value provided by the buffered ABR cell counter (step 131).

If the explicit rate marking system 36 makes a negative determination in step 129, it sequences to step 132, in which it determines whether the current ABR cell occupancy is between the low threshold value and a high threshold value. If the explicit rate marking system 36 makes a positive determination in step 132, it will determine the proportionality value as the difference between the intermediate and low utilization factor values divided by the difference between the high and low threshold values (step 133) and the vbfutilization factor as the intermediate utilization factor minus a value corresponding to the proportionality value determined in step 133 multiplied by the difference between the value provided by the buffered ABR cell counter and the minimum threshold value (step 134).

Finally, if the explicit rate marking system 36 makes a negative determination in step 132, it will be appreciated that the current ABR cell occupancy is above the high threshold value. In that case, the explicit rate marking system 36 determines the vbf utilization factor as the low utilization factor (step 135).

Preferably, the high and low threshold values, and the values for the maximum, intermediate and minimum utilization factor will be selected so that, if the buffered ABR cell occupancy is zero, the vbfutilization factor value will correspond to the maximum utilization factor; (ii) as the buffered ABR cell occupancy increases and approaches the low threshold value, the vbf utilization factor value will decrease from the high utilization factor and approach the intermediate utilization factor; (iii) as the buffered ABR cell occupancy further increases an approaches the high threshold value, the vbf utilization factor value will continue decreasing from the intermediate utilization factor and approach the minimum utilization factor, and WO 99/60758 PCT/US99/10807 (iv) if the buffered ABR cell occupancy is above the high threshold value, the vbfutilization factor value will correspond to the minimum utilization factor.

In one embodiment, the maximum utilization factor is selected to have a value of on the order of 1.2, the intermediate utilization factor is selected to have a value of on the order of 0.9 and the minimum utilization factor is selected to have a value of on the order of 0.8.

After the explicit rate marking system 36 has determined the vbfutilization factor in step 131, 134 or 135, it proceeds to a series of steps in which it actually generates the value for the virtual bandwidth factor (vbf). Initially, the explicit rate marking system 36 will save the current vbf (step 136). Thereafter, the explicit rate marking system 36 determines whether the ABR utilization rate updated in step 128 is less than predetermined target utilization rate and the vbf utilization factor is greater than one, or (ii) the ABR utilization rate updated in step 128 is greater than predetermined target utilization rate and the vbf utilization factor is less than one (step 137), and, if so multiplies the current vbfby the vbfutilization factor to generate a new current vbf(step 138). Following step 138, the explicit rate marking system 36 generates a new vbfas the sum of the current vbfmultiplied by the smoothing factor, and the saved current vbf multiplied by one minus the smoothing factor (step 139). Thereafter, the explicit rate marking system 36 can determine whether the vbfis within a predetermined range and, if not, adjust the vbf to be within the range (step 140).

Operations performed by the explicit rate marking system 36 when an ATM cell is transmitted will be described in connection with FIG. 6. With reference to FIG. 6, when a cell is in condition to be transmitted (step 160), the explicit rate marking system 36 determines whether the cell is associated with a virtual circuit that makes use of the ABR service (step 161). If the explicit rate marking system 36 makes a negative determination in step 161, the control element will perform conventional operations to transmit the cell over the appropriate communication link 13(j) (step 162).

On the other hand, if the explicit rate marking system 36 makes a positive determination in step 161, it will initially decrement the buffered ABR cell counter (step 163). Thereafter, the explicit rate marking system 36 will determine whether the cell is a BRM (backward RM) cell (step 164). If the explicit rate marking system 36 makes a positive determination in step 164, it proceeds to generate a link explicit rate Rij for the virtual circuit associated with the cell (step 165). If the explicit rate marking system 36 makes use of the equal shares methodology it will make use of equation and if it makes use of the proportional share methodology it will make use of equation In both cases, the explicit rate marking system 36 uses the virtual bandwidth value C'j instead of the bandwidth WO 99/60758 PCT/US99/10807 -16value Cj available for the ABR service, and determines the virtual bandwidth value C' as the ABR capacity multiplied by the most recently determined vbfvalue. The explicit rate marking system 36 then determines whether the link explicit rate Rij determined in step 165 is less than the explicit rate value contained in the BRM cell (step 166) and, if so, substitutes the link explicit rate value determined in step 165 for the explicit rate value in the BRM cell (step 167). Following step 167, step 166 if a negative determination is made in that step, or step 164 if a negative determination is made in that step, the control element 35 will enable the cell to be transmitted over the communication link 13(j) (step 168).

The invention provides a number of advantages. In particular, the invention provides an explicit rate marking system 36 which can, for each switching node 11 generate explicit rates for virtual circuits which use the respective switching node, generally only in relation to their respective MCR's, the number ofbottlenecked and unbottlenecked virtual circuits, and the amount of bandwidth capacity available for the ABR service, which simplifies assignment of ABR bandwidth capacity to each virtual circuit even if one or more of the virtual circuits is bottlenecked.

It will be appreciated that a system in accordance with the invention can be constructed in whole or in part from special purpose hardware or a general purpose computer system, or any combination thereof, any portion of which may be controlled by a suitable program. Any program may in whole or in part comprise part of or be stored on the system in a conventional mariner, or it may in whole or in part be provided in to the system over a network or other mechanism for transferring information in a conventional manner. In addition, it will be appreciated that the system may be operated and/or otherwise controlled by means of information provided by an operator using operator input elements (not shown) which may be connected directly to the system or which may transfer the information to the system over a network or other mechanism for transferring information in a conventional manner.

The foregoing description has been limited to a specific embodiment of this invention. It will be apparent, however, that various variations and modifications may be made to the invention, with the attainment of some or all of the advantages of the invention. It is the object of the appended claims to cover these and such other variations and modifications as come within the true spirit and scope of the invention.

What is claimed as new and desired to be secured by Letters Patent of the United States is:

Claims

1. An explicit rate marking system for use in connection with a switching node to generate an explicit rate value for use in a resource management cell associated with a virtual circuit in an ATM network, the explicit rate marking system comprising: A. a virtual bandwidth value generator module configured to generate a virtual bandwidth value reflecting an available bandwidth capacity value, an explicit rate value associated with each bottlenecked virtual circuit for which said switching node forms part of a path, and a minimum cell rate value associated with each unbottlenecked virtual circuit for which said switching node forms part of a path, and B. an explicit rate value generator module configured to generate the explicit rate value in relation to the virtual bandwidth value and the minimum cell rate value associated with the virtual circuit and other virtual circuits for which said switching node forms part of a path.

2. An explicit rate marking system as defined in claim 1, the explicit rate marking system generating said explicit rate value in accordance with an equal share methodology, and in which said virtual bandwidth value generator module is configured to generate said virtual bandwidth value C'j in accordance with C MCR,- Z R, I MCR, Ielu iel s iEl(j) where Cj represents the available bandwidth capacity value, MCR, represents the minimum cell rate for the "i-th" virtual circuit, IB(j) corresponds to the set of virtual circuits which are bottlenecked, Iu(j) corresponds to the set of virtual circuits which are not bottlenecked, and Nj is related to the number of virtual circuits for which the switching node part of the path.

3. An explicit rate marking system as defined in claim 2 in which said explicit rate value generator module is configured to generate said explicit rate value Rj in accordance with C'j- I MCR, Rij MCR, iel(j) II( WO 99/60758 PCT/US99/10807 -18-

4. An explicit rate marking system as defined in claim 1, the explicit rate marking system generating said explicit rate value in accordance with a proportional share methodology, and in which said virtual bandwidth value generator module is configured to generate said virtual bandwidth value C'j in accordance with Z MCR, C' 1 C 1 ZR, ilB(j) MCR i Ell, (j) where Cj represents the available bandwidth capacity value, MCR represents the minimum cell rate for the "i-th" virtual circuit, IB(j) corresponds to the set of virtual circuits which are bottlenecked, Iu(j) corresponds to the set of virtual circuits which are not bottlenecked.

An explicit rate marking system as defined in claim 4 in which said explicit rate value generator module is configured to generate said explicit rate value Rij in accordance with MCR, R t IMCR, iEl(j)

6. An explicit rate marking method for use in connection with a switching node to generate an explicit rate value for use in a resource management cell associated with a virtual circuit in an ATM network, the explicit rate marking method comprising: A. a virtual bandwidth value generator step including the step of generating a virtual bandwidth value reflecting an available bandwidth capacity value, an explicit rate value associated with each bottlenecked virtual circuit for which said switching node forms part of a path, and a minimum cell rate value associated with each unbottlenecked virtual circuit for which said switching node forms part of a path, and B. an explicit rate value generating step including the step of generating the explicit rate value in relation to the virtual bandwidth value and the minimum cell rate value associated with the virtual circuit and other virtual circuits for which said switching node forms part of a path. WO 99/60758 PCT/US99/10807 -19-

7. An explicit rate marking method as defined in claim 6, the explicit rate marking method facilitating the generation of said explicit rate value in accordance with an equal share methodology, and said virtual bandwidth value generating step including the step of generating generate said virtual bandwidth value C'j in accordance with N C' 2 MCR,- R, Ij MCR, ilu iE' B (A el(j) where Cj represents the available bandwidth capacity value, MCR, represents the minimum cell rate for the "i-th" virtual circuit, IB(j) corresponds to the set of virtual circuits which are bottlenecked, Iu(j) corresponds to the set of virtual circuits which are not bottlenecked, and Nj is related to the number of virtual circuits for which the switching node part of the path.

8. An explicit rate marking method as defined in claim 7, said explicit rate value generating step including the step of generating said explicit rate value R, in accordance with I MCR, MCR, ilj) II( a)l

9. An explicit rate marking system as defined in claim 6, the explicit rate marking method facilitating generation of said explicit rate value in accordance with a proportional share methodology, and in which said virtual bandwidth value generating step including the step of generating said virtual bandwidth value C'j in accordance with SMCR, SEI(j) I M C C Rj (j u()CR where Cj represents the available bandwidth capacity value, MCR, represents the minimum cell rate for the "i-th" virtual circuit, corresponds to the set of virtual circuits which are bottlenecked, lu(j) corresponds to the set of virtual circuits which are not bottlenecked.

An explicit rate marking method as defined in claim 9 in which said explicit rate value generating step includes the step of generating said explicit rate value Rij in accordance with MCR, Rij C" Ci- SMCR, iel(j)

11. An explicit rate marking system substantially as herein described with reference to any one of the embodiments of the invention illustrated in the accompanying drawings.

12. An explicit rate marking method substantially as herein described with reference to any one of the embodiments of the invention illustrated in the accompanying drawings. DATED this 2 0 th Day of June, 2001 ASCEND COMMUNICATIONS, INC. Attorney: PETER R. HEATHCOTE Fellow Institute of Patent and Trade Mark Attorneys of Australia 15 of BALDWIN SHELSTON WATERS o o