US6760338B1

US6760338B1 - Apparatus and method for monitoring data frames by a shared switching logic during simultaneous accessing of multiple network switch buffers

Info

Publication number: US6760338B1
Application number: US09/562,004
Authority: US
Inventors: Shashank Merchant; Jinqlih Sang
Original assignee: Advanced Micro Devices Inc
Current assignee: Advanced Micro Devices Inc
Priority date: 2000-02-14
Filing date: 2000-05-02
Publication date: 2004-07-06
Anticipated expiration: 2020-05-02

Abstract

Multiple network switch modules have memory interfaces configured for transferring packet data to respective buffer memories. The memory interfaces are also configured for transfer among each other data units of data frames received from different network switch modules. A shared switching logic monitors (“snoops”) the data units as they are transferred between network switch modules, providing a centralized switching decision logic for multiple network switch modules. The memory interfaces transfer the data units according to a prescribed sequence, optimizing memory bandwidth by concurrently executing a prescribed number of successive memory writes or memory reads. A preferred embodiment includes a distributed memory interface in between the network switch modules and a shared memory system.

Description

RELATED APPLICATIONS

This application contains subject matter related to the subject matter disclosed in a U.S. patent application Ser. No. 60/183,208 filed on Feb. 14, 2000, now abandoned.

FIELD OF THE INVENTION

The present invention relates to computer network interfacing and switching, and more particularly, to an apparatus and method for cascading multiple multiport network switches to increase the number of ports in a network switching arrangement.

BACKGROUND ART

A multiport network switch in a packet switching network is coupled to stations on the network through its multiple ports. Data sent by one station on a network to one or more other stations on the network are sent through the network switch. The data is provided to the network switch over a shared access medium according to, for example, an Ethernet protocol. The network switch, which receives the data at one of its multiple ports, determines the destination of the data frame from the data frame header. The network switch then transmits the data from the appropriate port to which the destination network station is connected.

A single Ethernet network switch may have a number of 10/100 Mb/s ports, equaling, for example, 12 ports. The number of end stations connected to the single network switch is limited by the number of ports (i.e., port density) of the network switch. However, today's users of networking devices demand flexibility and scalability without such constraints. To address this need, manufacturers have developed modular architectures that enable cascading of identical networking devices or network switch modules. By cascading these equipment (or components) in a loop, port density can be readily increased without redesign or development of costly interfaces.

Unfortunately, as the number of cascaded switches increases, so does the system latency (i.e., the aggregate processing delay of the switches). This system latency is attributable in part by the manner in which the switches store and retrieve the data frames in memory. One traditional memory architecture employs individual, local memories for each cascaded switch, as shown in FIG. 1. In this example, three

multiport switches

2 a, 2 b, and 2 c are cascaded together to permit the exchange of data frames received by any one of the switches and subsequent forwarding of the data frames out of a different multiport switch. These

switches

2 a, 2 b, and 2 c have a memory interface, e.g., 4 a, 4 b, and 4 c, respectively. These

memory interfaces

4 a, 4 b, and 4 c enable

switches

2 a, 2 b, and 2 c to access their

respective memories

6 a, 6 b, and 6 b to write and read the data frames.

For purposes of explanation, it is assumed that a data frame is received at a port (i.e., receive port) on switch 2 a and that the data frame is destined for a node attached to a port on a different switch 2 c. Switch 2 a first stores the received data frame in memory 6 a, and then determines whether to forward the received data frame out of its own port or send it to the next switch in sequence. Because the data frame is not destined to any port of switch 2 a, the data frame is retrieved from memory 6 a and sent to the next switch 2 b via switch 2 a's cascade port (i.e., the port to which the neighboring switches is connected). Upon receiving the data frame, switch 2 b stores the data frame in memory 6 b. Next, switch 2 b examines the data frame and determines that it should be forwarded to switch 2 c. Switch 2 b forwards the data frame to switch 2 c by reading the stored received data frame from memory 6 b and sending it out its cascade port. When the data frame arrives at switch 2 c, switch 2 c writes the data frame into its memory 6 c, in similar fashion as the

other switches

2 a and 2 b. At this point, however, switch 2 c determines that the data frame should be forwarded out one of its ports, which is connected to the destination node. Accordingly, switch 2 c reads the stored data frame and forwards it out the appropriate port. As evident by this example, the data frame, as it is transferred from switch to switch is stored and read numerous times into the memories of the respective switches. The series of write and read operations impose cost delay in the switching system, and increases the cascade bandwidth requirement.

Hence, the delay in the switching system may cause the switch to be unable to process data packets fast enough relative to the network traffic, creating congestion conditions. In other words, the switch is no longer a non-blocking switch.

To address this latency problem, one proposed solution is to employ a common memory among the various switches. FIG. 2 illustrates such a system in which switches 2 a, 2 b, and 2 c share memory 7 via

memory interfaces

4 a, 4 b, and 4 c, respectively. Under this approach, each of the

interfaces

4 a, 4 b, and 4 c are required to have a wider data bus to maintain the speed of read and write accesses as compared to the individual memory arrangement of FIG. 8. For example, the bus width of the

memory interfaces

4 a, 4 b, and 4 c may need to be increased. The main drawback with this common memory implementation is that the increase in memory bandwidth also results in a proportionate increase in the number of pins of the switches. An increase in the number of pins disadvantageously require more area on the circuit board, resulting in greater package cost.

SUMMARY OF THE INVENTION

There is need for cascading a plurality of multiport switches to increase port density, while minimizing system latency. There is also a need to increase memory bandwidth of the cascaded switch arrangement without increasing the number of pin counts.

There is also a need to provide a more efficient integration of a plurality of multiport switch modules by centralizing core switching functions without sacrificing latency in the multiport switch system.

These and other needs are obtained by the present invention, where a plurality of switch modules transfer frame data of a corresponding received frame, and a switching logic monitors the frame data during the transfers for centralized switching decisions between the switch modules. The memory interface enables the transfer of data units between the multiport switch modules and a shared memory system, increasing the overall bandwidth between the memory system and the multiport switch module by the simultaneous access of multiple memories for transfer of multiple data units for respective packets. Moreover, the monitoring by the switching logic enables switching decisions to be made as the frame data is distributed throughout the switching system.

One aspect of the present invention provides a switching system. The switching system includes a plurality of multiport switch modules, each configured for outputting frame data for a corresponding received data frame, a plurality of buffer memories, each coupled to a corresponding one of the multiport switch modules and configured for storing selected frame data of the data frames from the multiport switch modules, a shared data interface configured for receiving the frame data and the corresponding frame data from each of the multiport switch modules, and switching logic configured for monitoring at least a portion of the frame data received by the shared data interface and configured for selecting at least one of the buffer memories for storage of the frame data of each of the received data frames.

Since each of the multiport switch modules supply the frame data of the corresponding received data frame to the plurality of buffer memories, each buffer memory may store frame data for different multiport switch modules. Moreover, the shared data interface enables frame data to be distributed for concurrent and simultaneous access of all the buffer memories, enabling a higher overall effective memory bandwidth between the multiport switch modules and the plurality of buffer memories. The switching logic monitors the frame data as it is transferred by the multiport switch modules, enabling frame forwarding decisions to be made for all the multiport switch modules during single memory storage operation for that data frame. Hence, switching decisions may be made for the multiport switch modules without the necessity of the successive cascading of a data packet from one multiport switch module to the next. In addition, the memory bandwidth efficiency is substantially increased without increasing the pin count of the switch modules.

Another aspect of the present invention provides a switching system. The switching system includes a plurality of multiport switch modules, each having a memory interface for outputting frame data for a corresponding received data frame and frame pointer data specifying characteristics of the received data frame, a plurality of buffer memories, each coupled to a corresponding one of the multiport switch modules and configured for storing selected frame data of the data frames from the multiport switch modules, and a shared data interface configured for receiving the frame data and the corresponding frame data from each of the multiport switch modules, the shared data interface having switching logic for selecting at least one of the buffer memories for storage of the frame data of each of the received data frames.

Still another aspect of the present invention provides a method of temporarily storing a data frame received from a network node. The method includes receiving the data frame by a first of a plurality of multiport switch modules, each of the multiport switch modules having a memory interface configured for transferring data between a corresponding buffer memory and between another memory interface, monitoring the data frame output by the corresponding memory interface by a shared switching logic, storing frame data for the received data frame in the buffer memories according to a prescribed protocol and based on control signals, and determining by the shared switching logic a selected group of the multiport switch modules to output the received data frame.

Additional advantages and novel features of the invention will be set forth in part in the description which follows and in part will become apparent to those skilled in the art upon examination of the following or may be learned by practice of the invention. The advantages of the present invention may be realized and attained by means of instrumentalities and combinations particularly pointed in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference is made to the attached drawings, wherein elements having the same reference numerals represent like elements throughout and wherein:

FIG. 1 is a block diagram illustrating a conventional switching arrangement that cascades multiple switch modules.

FIG. 2 is a diagram illustrating a alternative prior art arrangement using cascaded switching modules to store data frames in a common memory.

FIG. 3 is a diagram illustrating a switching system according to an embodiment of the present invention.

FIG. 4 is a block diagram in further detail the switching system of FIG. 3 including the memory interface.

FIG. 5 is a block diagram illustrating the switching system including a shared data interface according to an alternative embodiment of the present invention.

FIG. 6 is a diagram illustrating a prescribed memory access protocol used by the memory interfaces according to an embodiment of the present invention.

FIG. 7 is a diagram illustrating the storage of data segments in different buffers according to the protocol of FIG. 6.

BEST MODE FOR CARRYING OUT THE INVENTION Switch Architecture Overview

FIG. 3 is a block diagram of an exemplary system in which the present invention may be advantageously employed. The exemplary system 10 is a packet switched network, such as an Ethernet (IEEE 802.3) network. The packet switched network includes integrated multiport switches (IMS) 12 that enable communication of data packets between network stations. The network may include network stations having different configurations, for example twelve (12) 10 megabit per second (Mb/s) or 100 Mb/s network stations 14 (hereinafter 10/100 Mb/s) that send and receive data at a network data rate of 10 Mb/s or 100 Mb/s, and a 1000 Mb/s (i.e., 1 Gb/s) network node 22 that sends and receives data packets at a network speed of 1 Gb/s. The gigabit node 22 may be a server, or a gateway to a high-speed backbone network. Hence, the multiport switches 12 selectively forward data packets received from the

network nodes

14 or 22 to the appropriate destination based upon Ethernet protocol.

Each multiport switch 12 includes a media access control (MAC) module 20 that transmits and receives data packets to and from 10/100 Mb/s physical layer (PHY) transceivers 16 via respective reduced media independent interfaces (REI) 18 according to IEEE 802.3u protocol. Each multiport switch 12 also includes a gigabit MAC 24 for sending and receiving data packets to and from a gigabit PHY 26 for transmission to the gigabit node 22 via a high speed network medium 28.

Each 10/100 Mb/s network station 14 sends and receives data packets to and from the corresponding multiport switch 12 via a media 17 and according to either half-duplex or full duplex Ethernet protocol. The Ethernet protocol ISO/IEC 8802-3 (ANSI/IEEE Std. 802.3, 1993 Ed.) defines a half-duplex media access mechanism that permits all stations 14 to access the network channel with equality. Traffic in a half-duplex environment is not distinguished over the medium 17. Rather, each half-duplex station 14 includes an Ethernet interface device that uses carrier-sense multiple access with collision detection (CSMA/CD) to listen for traffic on the media. The absence of network traffic is detected by sensing deassertion of a receive carrier on the media. Any station 14 having data to send will attempt to access the channel by waiting a predetermined time, known as the interpacket gap interval (IPG), after deassertion of the receive carrier on the media. If a plurality of stations 14 have data to send on the network, each of the stations will attempt to transmit in response to the sensed deassertion of the receive carrier on the media and after the IPG interval, possibly resulting in a collision. Hence, the transmitting station will monitor the media to determine if there has been a collision due to another station sending data at the same time. If a collision is detected, both stations stop, wait a random amount of time, and retry transmission.

The 10/100 Mb/s network stations 14 that operate in full duplex mode send and receive data packets according to the Ethernet standard IEEE 802.3u. The full-duplex environment provides a two-way, point-to-point communication link enabling simultaneous transmission and reception of data packets between each link partner, i.e., the 10/100 Mb/s network station 14 and the corresponding multiport switch 12.

Each multiport switch 12 is coupled to 10/100 physical layer (PHY) transceivers 16 configured for sending and receiving data packets to and from the corresponding multiport switch 12 across a corresponding reduced media independent interface (RMII) 18. In particular, each 10/100 PHY transceiver 16 is configured for sending and receiving data packets between the multiport switch 12 and up to four (4) network stations 14 via the RM 18. A magnetic transformer 19 provides AC coupling between the PHY transceiver 16 and the corresponding network medium 17. Hence, the RMII 18 operates at a data rate sufficient to enable simultaneous transmission and reception of data packets by each of the network stations 14 to the corresponding PHY transceiver 16.

Each multiport switch 12 also includes an expansion port 30 for transferring data between other switches according to a prescribed protocol. Each expansion port 30 enables multiple multiport switches 12 to be cascaded together as a separate backbone network.

Distributed Memory Transfers and Centralized Switching Decisions

The present invention is directed to a network switch arrangement that has the capability to provide high port densities while minimizing system latency. Multiple network switches are cascaded together in a loop to support high port requirements; these switches utilize a distributed memory interface architecture to increase memory bandwidth efficiency. This architecture advantageously permits the sharing of memories across multiple switches without an increase in pin counts.

FIG. 4 is a block diagram of the switching system of FIG. 3 in further detail according to an embodiment of the present invention. As shown in FIG. 4, each multiport switch module 12 includes a memory interface 44 for outputting frame data of a corresponding received data frame as a data unit onto a data bus 45 having a prescribed bit width, for example 32 bits. As described below, each of the buffer memories 36 are configured for storing a data unit of data frames received from each of the multiport switch modules. For example, SSRAM 36 a is configured for receiving frame data as data units for data frames received by each of the

switch modules

12 a, 12 b, 12 c, and 12 d. Each memory interface 44 of FIG. 4 is configured for transferring each 32-bit data unit of frame data for a data packet either to the corresponding buffer memory 36, or to another one of the memory interfaces 44 via a memory interface link 47 for transfer to another buffer memory 36. For example, a first 32-bit data unit of a data packet may be transferred by the memory interface 44 a to the SRAM 36 a, although the next 32-bit data unit for the same data packet may be transferred by the memory interface 44 a to the memory interface 44 b; the memory interface 44 b, in response to receiving the data unit from the memory interface 44 a, may either transfer the received data unit to the buffer memory 36 b via the corresponding data bus 45 b, or further forward the received data unit to another memory interface 44 c via the memory interface link 47 according to a prescribed access protocol.

Each of the memory interfaces 44 includes a scheduler 60. The scheduler 60 controls the writing and reading of data units between the plurality of buffer memories according to the prescribed access protocol, described in detail below with respect to FIG. 6. In particular, each scheduler 60 determines whether a given data unit should be transferred to the corresponding memory 36, or should be transferred to another memory interface 44.

At least one of the multiport switch modules 12 of FIGS. 3 and 4 includes a switching logic 40, also referred to as a decision making engine, a rules checker, or a switching core, that performs frame forwarding decisions, described below, by monitoring (i.e., “snooping”) the transfer of frame data between the memory interfaces 44. Each switch module also includes a switching subsystem (not shown) for transferring frame data according to the frame forwarding decisions by the switching logic 40 in the module 12 a.

As described below, each data frame is stored in the data buffers 36 as data units. Hence, each memory access of the data buffers 36 at a given address will result in transfer of a group of data units for the same data packet.

FIG. 5 is a block diagram illustrating a switching system for storing data frames according to a preferred embodiment of the present invention. In contrast to FIG. 4, the memory interfaces 44 of FIG. 5 transfer all data units via respective 32-bit shared data interface links 47 to a shared data interface 70, which includes a switching logic (i.e., a forwarding logic or a rules checker) 72, and a multiplexer core 74.

The multiplexer core 74 transfers packet data for data frames each memory access cycle via the shared data interface links 47 according to a prescribed access protocol, described below, effectively increasing the overall memory bandwidth efficiency to 128 bits for a given data frame. As described below with respect to FIG. 6, the rules checker 72 monitors the frame data as it is received by the interface 70, and controls the switching by the multiplexer core 74 for storage of data units in the buffer memories 36 according to a prescribed access protocol. In particular, the segments (i.e., data units) for a given data frame are stored in the

buffer memories

36 a, 36 b, 36 c, and 36 d according to a prescribed protocol. Hence, the disclosed arrangement provides use of a single design for switching decisions, less system cost since only a single rules checker memory is needed, and more manageability, since only a single rules checker 72 needs to be controlled.

FIG. 6 is a diagram illustrating a prescribed access protocol for use by the schedulers 60 and the rules checker 72 for transfer of frame data on a data unit basis according to an embodiment of the present invention. Assume in FIG. 6 that

multiport switch modules

12 a, 12 b, 12 c, and 12 d receive data packets A, B, C and D beginning at

time intervals

1, 2, 3, 4, respectively. Each time interval of FIG. 6 corresponds to 32 bit-times (i.e., the amount of time necessary for a network switch module 12 to receive 32 bits of frame data from the network). As shown in FIG. 6, the switch module 12 a begins receiving packet A during time interval 1. Assuming no latency issues, the memory interface 44 a begins transfer of a 32-bit data unit A₁₁. In the case of FIG. 4 the scheduler 60 a controls the memory interface 44 a to transfer the data unit A₁₁to the SRAM 36 a. In the case of FIG. 5, the memory interface 44 a outputs all the frame data of data packet A to the shared data interface 70 via the shared data interface link 47 a. The rules checker 72 monitors (i.e., snoops) all frame data supplied on

paths

47 a, 47 b, 47 c, and 47 d. The multiplexer core 74, based on selection signals from the rules checker 72, forwards the frame data A₁₁back to switch 12 a for storage in SSRAM 36 a.

During the next time interval (2), the switch module 12 a is receiving the second data unit of packet A while switch module 12 b is receiving the first 32 bit data unit of data packet B. As shown in FIG. 6, the prescribed protocols of FIGS. 4 and 5 cause the second data unit of packet A (A₁₂) to be transferred to switch module 12 b stored in SRAM 36 b. At the same time, the first data unit B₁received by switch module 12 b is transferred by memory interface 44 b in FIG. 4, and by the multiplexer core 74 in FIG. 5, to switch module 12 a for transfer to the SRAM 36 a during that same clock cycle. Both

rules checkers

40 and 72 monitor the data units A₁₂and B₂₁, as they are transferred.

During time interval 3, the first 32-bit data unit of data packet C, received by switch module 12 c, (C₃₁) is stored in SRAM 36 a, the second data unit of data packet B (B₂₂) is stored in SRAM 36 b, and the third data unit of data packet A (A₁₃) is stored in SRAM 36 b by

memory interface controllers

44 a, 44 b, and 44 c, respectively, in FIG. 4, and by the multiplexer core 74 in FIG. 5. Note that data unit C₃₁is transferred from controller 44 c to controller 44 a, and data unit A₁₃is transferred from controller 44 a to controller 44 a. Hence, the schedulers 44 and rules checker 40 of FIG. 4, and the rules checker 72 of FIG. 5, control the transfer of data units between the memory interface controllers 44 according to a prescribed access protocol.

At time interval 4, referring to FIG. 4, switch module 12 d begins reception of the first data unit D₄₁of data packet D which is transferred by memory interface 44 d to memory interface 44 a for storage in SRAM 36 a. The second, third, and fourth data units of data packets C, B, and A (C₃₂, B₂₃, A₁₄) are also transferred to

memory interfaces

44 b, 44 c, and 44 d for storage in the

buffer memories

36 b, 30 c, and 36 d, respectively. The schedulers 60 of FIG. 4 provide multiple concurrent transfers of data units to the buffer memories 36, maximizing the memory bandwidth between the memory interfaces 44 and the respective buffer memories 36. Since the greatest disruption to memory bandwidth is the requirement of a turnaround cycle between reads and writes on a memory data bus, the schedulers 60 control the memory interfaces 44 to successively write to the buffer memories 36 data units for a prescribed successive number of memory access cycles before switching to reading of data from the memories for another successive prescribed number of access cycles. Hence, the number of delays due to turnaround cycles on the data buses 45 are minimized.

The same prescribed number of successive reads or writes occurs in FIG. 5 to optimize the bandwidth of the data buses 45. The shared data interface 70 uses the multiplexer core 74 to route the appropriate data units to the switch modules 12 according to the prescribed access protocol.

FIG. 7 illustrates the storage of the data segments after time interval 7 in the different buffers 36.

According to the disclosed embodiment, memory bandwidth is optimized by distributed storage of packet data across memory devices. The memory interfaces 44 also may share frame pointer data, etc. enabling the switching logic 40 of each of the different switch modules 12 or the rules checker 72 to identify the location of each of the data packets received by other switch modules. Hence, any one of the switch modules may obtain the frame data in an efficient manner, even if the frame data needs to be transferred to anther switch module that did not originally receive the data packet via a network port.

While this invention has been described with what is presently considered to be the most practical preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

What is claimed is:

1. A method of temporarily storing a data frame received from a network node, the method comprising:

receiving the data frame by a first of a plurality of multiport switch modules, each of the multiport switch modules having a memory interface configured for transferring data between a corresponding buffer memory and between another memory interface;

monitoring the data frame output by the corresponding memory interface by a shared switching logic; and

storing different respective portions for the received data frame in respective ones of the buffer memories according to a prescribed protocol and based on control signals; and

determining by the shared switching logic a selected group of the multiport switch modules to output the different respective portions of the received data frame.

2. The method of claim 1, wherein the storing step includes:

supplying to the multiport switch modules selected data units of the frame data by a multiplexer array based on a prescribed access protocol; and

concurrently storing by the multiport switch modules the selected data units into the respective buffer memories.

3. The method of claim 1, further comprising concurrently supplying selected data units of received data frames by the multiport switch modules into the respective buffer memories for a first prescribed number of clock cycles.

4. The method of claim 3, further comprising concurrently fetching selected data units of stored data frames by the multiport switch modules from the respective buffer memories for a second prescribed number of clock cycles.