WO2018121535A1

WO2018121535A1 - Load balance processing method and apparatus

Info

Publication number: WO2018121535A1
Application number: PCT/CN2017/118652
Authority: WO
Inventors: 韩冰
Original assignee: 华为技术有限公司
Priority date: 2016-12-30
Filing date: 2017-12-26
Publication date: 2018-07-05
Also published as: CN108270687A; CN108270687B

Abstract

A load balance processing method and apparatus. In the load balance processing method, a packet forwarding device receives a first packet sent by a packet sending device by using a transport control protocol (TCP), and determines an outbound interface according to characteristic information of the first packet and a hash algorithm, and forwards the first packet through the outbound interface. The packet forwarding device receives a second packet sent by the packet sending device by using the TCP, and creates a first Flowlet flow table entry according to a Flowlet start identifier comprised in the second packet, and forwards the second packet according to the established first Flowlet flow table entry. By means of the method, a flow-based path selection manner is converted into a Flowlet mechanism-based path selection manner in a case of no disorder.

Description

Load balancing processing method and device

Technical field

The present application relates to the field of communications technologies, and in particular, to a load balancing method and apparatus.

Background technique

With the development of technology, the mainstream bandwidth of network devices in modern data center networks has gradually increased. In order to make full use of network device bandwidth, load balancing technology has become a hot topic in current research.

At present, equal-cost multi-path routing (ECMP) is a commonly used load balancing processing method. ECMP technology includes a packet-based path selection method and a flow-based path selection method. Packet-based path selection can achieve load balancing. There is a difference in the delay of different paths in the multipath, which causes the packets received at the receiving end to be out of order. Requires Packet reordering. In the flow-based path selection mode, the outbound interface (the packet forwarding path) of the forwarded packet can be determined according to a hash algorithm. The receiver does not need to reorder the message. The rates of different flows may be different (for example, occupying a large bandwidth (Elephant Flow) and occupying a smaller bandwidth (Mice Flow)), and the flows transmitted in different paths are also different. When the rates of Flows transmitted in different paths are not equal, the load may be unbalanced.

In order to achieve better load balancing, a load balancing processing method based on Flowlet mechanism is proposed. In the load balancing processing method based on the flow mechanism, a plurality of packets continuously sent in a certain flow are used as one flowlet, and a flowlet mechanism is used to perform path selection, so that multiple packets included in the flowlet are forwarded based on the selected path. . The load balancing processing method based on the Flowlet mechanism combines the two path selection methods, that is, the packet-based path selection method and the flow-based path selection method, so that load balancing processing can be performed better.

In the process of applying the Flowlet mechanism for path selection, path selection needs to be performed based on the Flowlet mechanism flow table. However, the probability of a large stream is relatively large, making the number of Flowlets larger. Therefore, if you use the Flowlet mechanism to perform path selection, you need to create a flowlet flow table with a larger number of entries. When the number of Flowlet flow table entries to be created exceeds the maximum number of Flowlet flow table entries that can be created by the packet forwarding device, the load balancing process is converted from the path selection method based on the Flowlet mechanism to the Hash algorithm based determination algorithm. The path selection method of the text forwarding path.

In the prior art, the path selection method based on the hash algorithm is not switched to the path selection method based on the Flowlet mechanism. In addition, in the prior art, switching of the execution path selection mode easily leads to out-of-order.

Summary of the invention

The embodiment of the present application provides a load balancing processing method and apparatus, which can implement a path selection manner based on a hash algorithm to switch to a path selection method based on a Flowlet mechanism. In addition, in the above switching process, disorder can be avoided.

The first aspect provides a load balancing processing method, in which the packet sending device sends a first packet by using a TCP, where the first packet is sent by the packet sending device in the first TCP sending window. A message. The packet forwarding device receives the first packet sent by the packet sending device by using the TCP, and determines the outgoing interface according to the feature information of the first packet and the hash algorithm, and forwards the first packet by using the outbound interface. . The packet sending device sends a second packet by using TCP, and sets a Flowlet start tag for the second packet, where the Flowlet start tag is used to identify the first packet in the Flowlet. The packet forwarding device receives the second packet sent by the packet sending device by using the TCP, and the second packet is the first packet sent by the packet sending device in the second TCP sending window, and the second packet is sent by the packet sending device. The text includes a flowlet start tag, so the first flowlet flow table entry can be created based on the flowlet start tag included in the second message, and the second message is forwarded according to the created first flowlet flow table entry.

The second TCP transmission window is a TCP transmission window adjacent to the first TCP transmission window, and the packet sending device receives the ACK confirmation corresponding to the packet sent in the first TCP transmission window. Sending a message in the second TCP transmission window. The ACK acknowledgement corresponding to the packet sent in the first TCP transmission window refers to the ACK acknowledgement corresponding to the last packet (the first packet) sent in the first TCP transmission window.

The packet forwarding path used by the packet forwarding device to forward the second packet indicated by the first flowlet flow table entry according to the flowlet start tag included in the second packet may be used for determining the packet forwarding path based on the hash algorithm. The forwarding path of the first packet is the same or different. For example, the outbound interface for forwarding the second packet indicated by the first flowlet flow table entry is the same outbound interface as the outbound interface determined by the hash algorithm for forwarding the first packet, or is different. interface.

In the embodiment of the present application, the packet forwarding device may be switched to adopt a flowlet to perform path selection by using a hash algorithm to determine a packet forwarding path, and the packet forwarding device is a flowlet stream created based on a Flowlet start tag. The table entry, the Flowlet start tag is used to identify the first packet sent in the second TCP sending window, and the packet sending device needs to receive the ACK acknowledgement to continue sending after sending the message in the first TCP sending window. The packet is sent by the packet sending device, and the packet sending device has received the packet sent by the packet sending device. Therefore, the packet sending device sends the packet to the packet receiving device in the second TCP sending window. The text does not cause out-of-order when the packet arrives at the packet receiving device, which can avoid out-of-order.

In a possible design, after receiving the second packet sent by the packet sending device by using the TCP, the packet forwarding device continues to receive the packet sent by the sending device using TCP in the second TCP sending window, and according to the packet forwarding device, The created first flowlet flow table entry forwards the subsequently received packet sending device to send the packet sent by the TCP in the second TCP sending window.

In another possible design, if the packet forwarding device receives the third packet sent by the packet sending device in the second TCP sending window, and the third packet includes the Flowlet end tag, the packet forwarding device Deleting the first Flowlet flow table entry based on the Flowlet End Tag included in the third message to release the resource, the released resource may be used to create a Flowlet flow table entry followed by other Flowlets, so that more Flowlets are obtained. It can match the flow table flow table entries and perform load balancing processing.

In another possible design, after the packet forwarding device receives the third packet sent by the TCP sending device, the packet forwarding device can continue to receive the subsequent packet. The packet forwarding device receives the fourth packet sent by the packet sending device by using TCP. The fourth packet is a first packet sent by the packet sending device in the third TCP sending window, and the fourth packet includes a Flowlet start tag. The packet forwarding device creates a second Flowlet flow table entry based on the Flowlet start tag included in the fourth packet, and forwards the fourth packet according to the created second Flowlet flow table entry to implement the Flowlet mechanism. The path selection method is used for path selection.

The third TCP transmission window is a TCP transmission window adjacent to the second TCP transmission window, and the packet sending device receives the ACK confirmation corresponding to the packet sent in the second TCP transmission window, The third TCP transmission window sends a message. The ACK acknowledgement corresponding to the packet sent in the second TCP sending window refers to the ACK acknowledgement corresponding to the last packet (third packet) sent in the second TCP sending window.

The packet forwarding path that is used by the packet forwarding device to forward the fourth packet according to the flowlet start tag included in the fourth packet to create the second flowlet flow table entry may be based on the packet included in the second packet. The flow forwarding path of the Flowlet start tag is the same as that of the first flowlet table entry, and the packet forwarding path used to forward the second packet is the same or different. For example, the outbound interface for forwarding the fourth packet indicated by the second flowlet flow table entry is the same outbound interface as the outgoing interface for forwarding the second packet indicated by the first flowlet flow table entry, or Is a different outbound interface.

In yet another possible design, the Flowlet Start Tag and/or the Flowlet End Tag are carried by the idle bits in the message header. For example, the existing TCP can be augmented, and the Flowlet Start Tag and/or the Flowlet End Tag are carried by the Reserved Bit in the Message Header field. For example, the Flowlet start tag included in the second packet is carried by the idle bit in the packet header of the second packet, and the Flowlet end tag included in the third packet passes the packet of the third packet. The idle bit in the header is carried, and the Flowlet start tag included in the fourth packet is carried by the idle bit in the header of the fourth packet.

According to a second aspect, there is provided a load balancing processing apparatus including all of the functions of implementing the load balancing processing method described above. The functions may be implemented by hardware or by corresponding software implemented by hardware. The hardware or software includes one or more modules corresponding to the functions described above. The modules can be software and/or hardware.

In a possible design, the load balancing processing device includes a receiving unit, a processing unit, and a sending unit. The functions of the receiving unit, the processing unit, and the sending unit may correspond to the method steps, and details are not described herein.

A third aspect provides a message forwarding device, where the message forwarding device includes a processor, a memory, and a communication interface, and the processor, the memory, and the communication interface are connected by a bus. The memory is configured to store program code executed by the processor; the processor calls the program code stored in the memory, acquires and forwards a message through the communication interface, and when the processor executes the memory storage The instruction is used to complete any of the load balancing processing methods as involved in the first aspect.

In a fourth aspect, a computer storage medium is provided for storing instructions that, when executed, perform any of the load balancing processing methods described above.

In the embodiment of the present application, after receiving the last packet sent by the packet sending device in the first TCP sending window, the packet forwarding device determines the interface according to the feature information of the first packet and the hash algorithm, and The method of forwarding the first packet by the interface is a method for determining a packet forwarding path by using a hash algorithm. After the packet forwarding device receives the second packet sent by the TCP in the second TCP sending window, the packet forwarding device creates a first Flowlet flow table entry based on the Flowlet start tag included in the second packet, and creates the first Flowlet flow table entry. The first Flowlet flow table entry, forwarding the second packet, is a way for path selection based on the Flowlet mechanism. Therefore, the method for determining the packet forwarding path based on the hash algorithm is converted into the path selection method by using the flowlet to perform load balancing processing. Further, the packet forwarding device is a flowlet flow table entry created based on a Flowlet start tag included in the second packet, where the Flowlet start tag is used to identify the first packet sent in the second TCP sending window, because the packet After receiving the packet in the first TCP transmission window, the packet sending device needs to receive the ACK to continue to send the packet, and the packet sending device receives the ACK acknowledgement, indicating that the packet receiving device has received the packet sending device and sends the packet. The packet sending device sends a packet to the packet receiving device in the second TCP sending window, so that the packet does not need to be out of order when the packet arrives at the receiving device, and the packet receiving device does not need to receive the received packet. The text is reordered.

DRAWINGS

FIG. 1 is a system architecture applied to a load balancing processing method according to an embodiment of the present disclosure;

2 is a schematic diagram of a path selection manner based on a Flowlet mechanism;

FIG. 3 is a flowchart of a load balancing processing method according to an embodiment of the present application;

FIG. 4 is another flowchart of a load balancing processing method according to an embodiment of the present disclosure;

FIG. 5 is still another flowchart of a load balancing processing method according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a load balancing processing apparatus according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a packet forwarding device according to an embodiment of the present disclosure.

detailed description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

First, some of the terms in this application are explained to be understood by those skilled in the art.

1) A flowlet can be understood as a packet group consisting of multiple packets continuously sent in a flow, and each flow includes multiple flowlets. When the packet is forwarded based on the flowlet mechanism, the forwarding of multiple packets included in the flowlet can be implemented based on the flowlet flow table entry. Different Flowlets correspond to different Flowlet flow table entries. The flowlet flow table entry is used to indicate a packet forwarding path of multiple packets included in each flowlet. For the flowlet and the process of message forwarding based on the Flowlet mechanism, please refer to the following two documents. The full reference is made to the following two documents: "Dynamic Load Balancing Without Packet Reordering, Srikanth Kandula, Dina Katabi, Shantanu Sinha, Arthur Berger. ACM Computer Communications Review, 2007" and "Harnessing TCP's Burstiness with Flowlet Switching, Shan Sinha, Srikanth Kandula, Dina Katabi. ACM Hot Topics in Networks ~ (HotNets), 2004".

2) In TCP, the concepts of window, TCP send window, acknowledgement, segment, TCP sender, and TCP receiver are defined. For TCP windows, acknowledgement, segments, TCP senders, and TCP receivers, see RFC793, RFC813, RFC879, RFC1180, RFC5681, and RFC5690 published by the IETF.

The load balancing processing method and apparatus provided by the embodiments of the present application can be applied to a network that supports ECMP technology for load balancing processing, for example, applicable to the network architecture shown in FIG. 1. Referring to FIG. 1, the server uses a Transmission Control Protocol (TCP) to send packets to a packet forwarding device of a routing switching network, and a packet forwarding device (such as a switch, a router, etc.) in the routing switching network adopts ECMP. The technology forwards the packet and forwards the received packet to the terminal in the case of load balancing of the entire network. When the packet forwarding device uses the ECMP technology to forward packets, the Flowlet mechanism can be used for path selection. However, in the load balancing process using the Flowlet mechanism for path selection, there are technical problems such as those mentioned in the background section: When a flowlet needs to be created When the number of flow table entries exceeds the maximum number of Flowlet flow table entries that can be created by the packet forwarding device, the Flowlet mechanism cannot be used for path selection. The load balancing process is converted to a path based on the path selection method based on the Flowlet mechanism. The algorithm determines the path selection mode of the packet forwarding path, and applies load balancing processing based on the hash algorithm to determine the packet forwarding path.

The above technical problems will be described below in conjunction with practical applications.

The embodiment of the present application first describes an implementation process of path selection based on the Flowlet mechanism. FIG. 2 is a schematic diagram of a path selection manner based on a Flowlet mechanism according to an embodiment of the present application. When the path is selected based on the flowlet mechanism, the packet forwarding device needs to split the multiple packets included in the flow into multiple packet groups, and each packet group includes multiple packets. Each packet group can be understood as a flowlet. The following embodiments of the present application refer to "message group" and "Flowlet" frequently used interchangeably, but those skilled in the art can understand the meaning thereof. The different packet groups correspond to different flowlet flow table entries, and the flowlet flow table entry is used to indicate the packet forwarding path of the packet forwarding device to forward the packet, for example, to indicate that the packet forwarding device forwards the packet. Outbound interface. For different packet groups, the packet forwarding device can forward different flowlet table entries. The basis for obtaining multiple message groups in multiple packets in a specific split stream is: the time difference between the time taken by two adjacent packets in the flow to reach the packet receiving device (the device corresponding to the destination address of the packet) Gap) is greater than or equal to the absolute value of the time difference between the two different forwarding paths. The two adjacent packets to be forwarded are forwarded to the packet receiving device through two different forwarding paths. The device does not need to perform packet reordering. Therefore, each Gap that meets the condition can determine whether the packet is the first packet or the last packet in the packet group that can be forwarded by a flowlet flow table entry. Message message. After the packet to be forwarded included in the flow is split into multiple packet groups, the packet forwarding device can forward the packet in the packet group to be split based on the Flowlet mechanism flow table. Each flow entry in the flowlet flow table includes a source address and a destination address of the packet forwarding, and the source address and the destination address forwarded by the flow are the result of the routing of the Flowlet obtained by executing the flowlet routing policy. For example, in FIG. 2, the packet forwarding device receives the to-be-forwarded packets included in the flow as message 1, message 2, message 3, message 4, and message 5, and message 2 and message 3 arrive at the report. The time difference between the time used by the receiving device is Gap, the time taken by the packet 2 and the packet 3 through the forwarding path 1 is d1, and the time taken by the packet 2 and the packet 3 through the forwarding path 2 is d2, and if so, the packet 2 can be And the packet 1 is divided into a packet group and forwarded to the packet receiving device through the forwarding path 1, and the packet 3, the packet 4, and the packet 5 are divided into another packet group and forwarded to the packet through the forwarding path 2. Text receiving device.

According to the above description, if the first packet in each packet group that is forwarded based on the Flowlet flow table entry is determined, each packet group is forwarded based on the Flowlet flow table entry, and the packet arrives at the report. When the device is received, no out of order occurs. However, in the traditional technology, the packet forwarding device does not determine the first packet in the packet group that is forwarded based on the flowlet flow table entry. Therefore, if the packet forwarding device has insufficient specifications due to the flowlet flow table, After the route selection method based on the flowlet is converted to the path selection mode based on the hash algorithm to determine the packet forwarding path, even if there is an available flowlet flow table, it is determined whether the current to-be-forwarded packet is based on the flowlet flow table. The first packet of the packet forwarding group is forwarded. Therefore, in order to avoid packet out-of-order, the path of the packet forwarding path can be determined by using the hash algorithm. The method performs load balancing processing.

An embodiment of the present application provides a load balancing processing method, in which a Flowlet start flag is set for a first packet in a packet group forwarded by each Flowlet flow table entry obtained by the splitting, by using the The Flowlet Start tag identifies the first message in the packet group forwarded based on the Flowlet Flow Table entry. The packet in the two adjacent to-be-forwarded packets in the basis of splitting the multiple packets in the flow into the plurality of packets in the foregoing embodiment may be used as a basis. The first packet of the packet group forwarded by the flowlet flow entry. When the packet forwarding device forwards the packet, the packet is forwarded by the flowlet to determine that the packet forwarded by the flowlet table entry is the first packet in the packet group, and even if the packet forwarding device is currently applied. The path selection mode of the packet forwarding path is determined by the hash algorithm to perform load balancing processing. When the flow chart can be matched to the flowlet flow table, the method can be converted into a path using the flowlet by the application to determine the packet forwarding path based on the hash algorithm. The method of load balancing is performed, and the packet does not need to be out of order when the packet arrives at the packet receiving device. The packet receiving device does not need to reorder the received packet.

Since the packet sending device (such as the server in FIG. 1 or the packet forwarding device) can determine the sending time of the packet, the packet sending device can identify each packet group that is forwarded based on the flowlet flow table entry. The first packet and the last packet, in this embodiment, the packet sending device may set the Flowlet start tag for the first packet in each packet group forwarded by the Flowlet flow table entry. . The Flowlet start tag can be carried by the first message in the packet group forwarded by the Flowlet flow table entry in the Flowlet.

The use of the Transmission Control Protocol (TCP) to transmit packets is a mechanism for realizing reliable transmission of messages. In TCP, the concept of a window is defined, which is used to indicate the number of bytes that a sender is allowed to transmit before receiving a grant. In the embodiment of the present application, a device that uses TCP to send a packet is called a TCP (Transmission Control Protocol sender), and a device that uses TCP to receive a packet is called a TCP Receiver (Transmission Control Protocol receiver, TCP). Receiver). In a TCP network, a TCP sender sends a packet containing a segment to a TCP receiver in a TCP transmission window. The packet can be called a TCP packet. The packet transmitted by using TCP on the following refers to the above TCP packet. The TCP transmission window is capable of characterizing a sequence number of a message that the TCP receiver desires to receive, and the sequence number can indicate a data segment included in the message received by the TCP receiver through the TCP transmission window. After receiving the data packet sent by the TCP sender through the TCP transmission window, the TCP receiver sends an acknowledgement (ACK) to the TCP transmitter according to the received message. After receiving the ACK, the TCP sender continues to send a message to the TCP receiver in another TCP transmission window.

In the embodiment of the present application, if the packet sending device sends a packet by using the TCP, the packet sending device needs to receive the ACK to confirm the packet after the packet is sent in the first TCP sending window, and the packet sending device receives the packet. After the ACK is confirmed, the packet receiving device has received the packet sent by the packet sending device, so the packet sending device sends a packet to the packet receiving device in the second TCP sending window, where the second TCP is sent. The sending window is different from the first TCP sending window, the second TCP sending window is a TCP sending window adjacent to the first TCP sending window, and the message sending device receives the sending in the first TCP sending window. Sending a message in the second TCP transmission window after the ACK of the message is acknowledged, wherein the ACK confirmation corresponding to the message sent in the first TCP transmission window refers to the last one sent in the first TCP transmission window. The ACK is acknowledged in the packet (the first packet), so that the packet does not need to be out of order when the packet arrives at the receiving device, and the packet receiving device does not need to reorder the received packet. Examples that may be using packet transmission apparatus transmits TCP packets sent in each window is a TCP packet based on a plurality of packet group Flowlet flow table entry in the forwarding.

In a possible implementation, the message sending device that uses TCP to send a message in the embodiment of the present application may set a Flowlet start tag for the first message sent in each TCP sending window, and the Flowlet starts marking. The first packet in the flowlet is identified, in other words, if the packet includes a Flowlet start tag, the packet containing the Flowlet start tag may be considered as the first packet in the Flowlet. After the packet sending device that sends the packet with the TCP sends the packet containing the start flag of the Flowlet, if the packet forwarding device receives the packet including the Flowlet start tag sent by the packet sending device using the TCP, it may be based on the received message. The Flowlet included in the packet starts to create a Flowlet flow table entry, and forwards the packet according to the created Flowlet flow table entry, thereby implementing a path selection method based on the Flowlet mechanism.

In another possible implementation manner, the message sending device that uses TCP to send a message in the embodiment of the present application may set a Flowlet end tag for the last message sent in each TCP sending window. The Flowlet End Tag is used to identify the last packet in the packet group forwarded based on the Flowlet Flow Table entry. In other words, if the packet includes a Flowlet End Tag, the packet may be considered to include the Flowlet End Tag. The last packet in a packet group forwarded based on the Flowlet flow table entry. After the packet sending device that sends the packet is sent by the packet, the packet forwarding device can determine the packet if the packet sending device receives the packet including the Flowlet end tag sent by the packet sending device by using the TCP packet. After the packet containing the flow end tag is forwarded, the packet is sent to the last packet in the packet group, and the packet is forwarded. The Flowlet flow table entry on which the packet is based is deleted to release the resource. The released resource can be used to create a Flowlet flow table entry that is followed by other packet groups, so that more packet groups can be matched to the Flowlet flow table. Item, load balancing processing.

In the embodiment of the present application, the Flowlet Start Tag and/or the Flowlet End Tag are carried by idle bits in the message header. For example, the existing TCP can be extended and carried by the reserved bit in the message header field. For example, the Flowlet Start Tag and the Flowlet End Tag can be marked by two reserved bits in the message header field. In the embodiment of the present application, the Flowlet start tag and the Flowlet end tag may be represented by a bit position bit. For example, if the bit used to indicate the Flowlet start tag in the message is set to 1, the message includes the Flowlet. Start tag, which is the first packet in the packet group forwarded based on the Flowlet flow table entry. If the bit in the packet indicating the end of the Flowlet flag is set to 1, it indicates that the packet contains a Flowlet End Tag, which is the last packet in the packet group forwarded based on the Flowlet Flow Table entry. . If the bit in the message indicating the start of the Flowlet flag is set to 0, and the bit used to indicate the end of the Flowlet flag is also set to 0, it indicates that the message is a message forwarded based on the Flowlet flow table entry. A packet between the first packet and the last packet in the group.

Based on the above idea, the embodiment of the present application provides an implementation scheme for performing load balancing processing by converting a manner in which a packet forwarding path is determined based on a hash algorithm into a manner in which a path is selected by using a flowlet. The packet sending device uses TCP to send the packet sent by each TCP sending window as a packet group forwarded by the Flowlet flow table entry.

FIG. 3 is a flowchart of a load balancing processing method according to an embodiment of the present application. The execution body of the method shown in FIG. 3 may be a packet forwarding device, or may be a component in a packet forwarding device. The packet forwarding device may be a device with a packet forwarding function, such as a switch or a router, which is not limited in this embodiment. Referring to Figure 3, the method includes:

S101: The packet forwarding device receives the first packet sent by the packet sending device by using TCP.

In the embodiment of the present application, the first packet is the last packet sent by the packet sending device in the first TCP sending window. The last message sent by the message sending device in the first TCP sending window can be understood as the last message sent in the first TCP sending window in the time dimension, and if it is represented by the serial number, it can be understood as The message with the largest sequence number sent in the first TCP transmission window.

S102: The packet forwarding device determines an interface according to the feature information of the first packet and a hash algorithm, and forwards the first packet by using the outbound interface.

In the embodiment of the present application, after receiving the first packet sent by the packet sending device, the packet forwarding device determines the packet forwarding path based on the hash algorithm. The hash key input when the packet forwarding device executes the hash algorithm may be a feature such as a five-tuple of the first packet that characterizes the first message attribute. The hash value output by the packet forwarding device when the hash algorithm is executed may be used to represent the forwarding path information, and the forwarding path information may be, for example, information such as an outgoing interface of the forwarding packet.

S103: The packet forwarding device receives the second packet sent by the packet sending device by using the TCP.

In this embodiment, the second packet is a first packet sent by the packet sending device in the second TCP sending window, and the second packet includes a Flowlet start tag. The first message sent by the message sending device in the second TCP sending window can be understood as the first message sent in the second TCP sending window in the time dimension, and if it is represented by the serial number, It is understood to be the message with the smallest sequence number sent in the second TCP transmission window.

In the embodiment of the present application, the second TCP sending window is a TCP sending window adjacent to the first TCP sending window, and the packet sending device receives the ACK confirmation corresponding to the sending of the message in the first TCP sending window, The second TCP transmission window sends a message. The ACK corresponding to the packet sent in the first TCP sending window is used to indicate that all the packets sent in the first TCP sending window have reached the destination. For example, the ACK acknowledgment corresponding to the message sent in the first TCP transmission window refers to the ACK acknowledgment corresponding to the last message (the first message) sent in the first TCP transmission window. The sequence number carried in the ACK acknowledgement is equal to the sequence number carried in the first TCP packet.

The flow start tag included in the second packet may be carried by the idle bit in the header of the second packet.

In this embodiment, the second packet may have the same feature information as the first packet. In other words, the second packet and the first packet are packets belonging to the same stream.

S104: The packet forwarding device creates a first flowlet flow table entry based on the flowlet start tag included in the second packet, and forwards the second packet according to the created first flowlet flow table entry.

In the embodiment of the present application, the packet forwarding device may be based on the flowlet start flag included in the second packet, and the packet forwarding path for forwarding the second packet indicated by the first flowlet flow table entry may be based on a hash algorithm. The forwarding path used to forward the first packet is the same, but may be different. For example, the outbound interface for forwarding the second packet indicated by the first flowlet flow table entry is the same outbound interface as the outbound interface determined by the hash algorithm for forwarding the first packet, or is different. interface.

In the embodiment of the present application, after receiving the second packet sent by the packet sending device by using the TCP, the packet forwarding device continues to receive the packet sent by the sending device using the TCP in the second TCP sending window, and creates the packet according to the method. The first Flowlet flow table entry forwards the subsequently received message sending device to send the message sent by the TCP in the second TCP sending window.

In the embodiment of the present application, if the packet forwarding device receives the packet sending device using TCP, the last packet sent in the second TCP sending window, and the last packet sent in the second TCP sending window includes The flowlet end tag is based on the method flow shown in FIG. 3, and may also include the following implementation steps, as shown in FIG. 4:

S105: The packet forwarding device receives the third packet sent by the packet sending device by using the TCP.

In the embodiment of the present application, the last packet sent by the packet sending device received by the packet forwarding device in the second TCP sending window is referred to as a third packet, and the third packet includes a Flowlet end tag. The flow end tag included in the third packet may be carried by the idle bit in the header of the third packet.

S106: The packet forwarding device deletes the first Flowlet flow table entry based on the Flowlet End Tag included in the third packet.

In the embodiment of the present application, the packet forwarding device deletes the first flowlet flow table entry based on the flowlet end tag included in the third packet, and can release the resource, and the released resource can be used to create another packet group to follow. The Flowlet flow table entry enables more packet groups to match the Flowlet flow table entries for load balancing.

In the embodiment of the present application, after receiving the third packet sent by the TCP, the packet forwarding device can continue to receive subsequent packets, and performs path selection according to the path selection mode of the Flowlet mechanism. The implementation process is as shown in FIG. 5 . Show. The method flow shown in FIG. 5 may further include the following implementation steps on the basis of the method flow shown in FIG. 4:

S107: The packet forwarding device receives the fourth packet sent by the packet sending device by using the TCP.

In the embodiment of the present application, the fourth packet is the first packet sent by the packet sending device in the third TCP sending window, and the fourth packet and the first packet have the same feature information. In other words, the fourth message and the first message belong to the same stream.

The fourth message includes a Flowlet Start tag. The Flowlet start tag included in the fourth message may be carried by the idle bit in the header of the fourth message.

The Flowlet start tag included in the fourth packet in the embodiment of the present application may be the same as or different from the Flowlet start tag included in the second packet, but the Flowlet start tag function and the second packet included in the fourth packet are included. The Flowlet start tag included in the function has the same function and is used to identify the first message sent by the data sending device in the TCP send window.

In the embodiment of the present application, the third TCP sending window is a TCP sending window adjacent to the second TCP sending window, and after the packet sending device receives the ACK confirmation corresponding to the sending of the message in the second TCP sending window, The message is sent in the third TCP transmission window. The ACK corresponding to the packet sent in the second TCP sending window is used to indicate that all the packets sent in the second TCP sending window have reached the destination. For example, the ACK acknowledgment corresponding to the message sent in the second TCP transmission window refers to the ACK acknowledgment corresponding to the last message (third message) sent in the second TCP transmission window. The sequence number carried in the ACK acknowledgement is equal to the sequence number carried in the third TCP packet.

S108: The packet forwarding device creates a second Flowlet flow table entry based on the Flowlet start tag included in the fourth packet, and forwards the fourth packet according to the created second Flowlet flow table entry.

In the embodiment of the present application, the packet forwarding device may be based on the Flowlet start tag included in the fourth packet, and the packet forwarding path for forwarding the fourth packet indicated by the second Flowlet flow table entry may be based on the second report. The flow forwarding path included in the text is the same as the forwarding path of the packet for forwarding the second packet indicated by the first flowlet flow table entry, and may of course be different. For example, the outbound interface for forwarding the fourth packet indicated by the second flowlet flow table entry is the same outbound interface as the outgoing interface for forwarding the second packet indicated by the first flowlet flow table entry, or Is a different outbound interface.

The implementation process of the path selection method based on the flow path mechanism in the S107 and S108 in the embodiment of the present application is similar to the implementation process of S103 and S104, so the similarities can be referred to the descriptions of S103 and S104 in the above embodiment. This will not be repeated here.

In the embodiment of the present application, after receiving the fourth packet sent by the packet sending device, the packet forwarding device continues to receive the packet sent by the sending device using the TCP in the third TCP sending window, and creates the packet according to the method. The second Flowlet flow table entry forwards the subsequently received message sending device to send the message sent by the TCP in the third TCP sending window.

In the embodiment of the present application, the inactive flow entry in the created flowlet flow table that exceeds the set duration of the flow table resource is periodically detected, and the inactive flow entry is deleted, so that the resource can be released. The released resources can be used to create flowlet flow tables of other Flowlets, so that more Flowlets can be matched to the Flowlet flow table for load balancing processing. The inactive flow entry is a flow entry that is not executed within a set duration.

Based on the load balancing processing method of the foregoing embodiment, the embodiment of the present application further provides a load balancing processing apparatus. It can be understood that the load balancing processing device includes corresponding hardware structures and/or software modules for performing the respective functions in order to implement the above functions. The embodiments of the present application can be implemented in a combination of hardware or hardware and computer software in combination with the unit and algorithm steps of the examples described in the embodiments disclosed in the embodiments of the present application. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the technical solutions of the embodiments of the present application.

The embodiment of the present application may divide the functional unit into the load balancing processing device according to the foregoing method example. For example, each functional unit may be divided according to each function, or two or more functions may be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner.

FIG. 6 is a schematic structural diagram of a load balancing processing apparatus 100 according to an embodiment of the present application. In FIG. 6, the load balancing processing apparatus 100 includes a receiving unit 101, a processing unit 102, and a transmitting unit 103.

The receiving unit 101 is configured to receive a first packet that is sent by the packet sending device by using the TCP, where the first packet is the last packet sent by the packet sending device in the first TCP sending window; Receiving, by the packet sending device, a second packet sent by using a TCP, where the second packet is a first packet sent by the packet sending device in a second TCP sending window, where the second packet is sent Contains the Flowlet start tag. The second TCP transmission window is a TCP transmission window adjacent to the first TCP transmission window, and the message sending device receives the correct ACK confirmation of the message sent in the first TCP transmission window. Sending a message in the second TCP transmission window.

The processing unit 102 is configured to determine an interface according to the feature information of the first packet received by the receiving unit 101 and a hash algorithm, and create a first identifier based on the Flowlet start tag included in the second packet. Flowlet flow table entry.

The sending unit 103 is configured to forward the first packet by using the outbound interface determined by the processing unit 102, and forward the second according to the first Flowlet flow table entry created by the processing unit 102. The message has the same feature information between the second message and the first message.

The receiving unit 101 is further configured to: after the first flowlet flow table entry is created, receive the third packet sent by the packet sending device by using the TCP, where the third packet is sent by using the third packet. The last message sent by the device in the second TCP transmission window, the third message containing a Flowlet End Tag. The processing unit 102 is further configured to delete the first Flowlet flow table entry based on the Flowlet end tag included in the third packet received by the receiving unit 101.

The receiving unit 101 is further configured to: after the processing unit 102 determines that the third packet sent by the packet sending device by using the TCP includes the Flowlet End Tag, and receives the first sent by the packet sending device. And a fourth packet, where the fourth packet is a first packet sent by the packet sending device in a third TCP sending window, where the fourth packet includes a Flowlet start tag. The processing unit 102 is further configured to: create, according to the Flowlet start tag included in the fourth packet received by the receiving unit 101, a second Flowlet flow table entry; the sending unit 103 further uses The fourth packet is forwarded according to the second flowlet flow table entry created by the processing unit 102.

In the embodiment of the present application, the processing unit 102 may be a processor, and the receiving unit 101 and the sending unit 103 may be communication interfaces. The communication interface is a collective name and may include one or more interfaces.

When the processing unit 102 is a processor, and the receiving unit 101 and the transmitting unit 103 are communication interfaces, the load balancing processing apparatus 100 provided by the embodiment of the present application may have the structure as shown in FIG. 7. The load balancing processing device 100 shown in FIG. 7 may be a packet forwarding device, and the packet forwarding device may be a load balancing device, or may be a switch or a router.

FIG. 7 is a schematic structural diagram of a packet forwarding device 1000 according to an embodiment of the present application. Referring to FIG. 7, the message forwarding device 1000 adopts a general computer system structure, including a bus, a processor 1001, a memory 1002, and a communication interface 1003. The program code for executing the solution of the embodiment of the present application is stored in the memory 1002, and is processed by the processor. 1001 to control execution.

The program stored in the memory 1002 is used by the instruction processor 1001 to perform the load balancing processing method of the foregoing embodiment, including: receiving, by the communication interface 1003, a first packet sent by the packet sending device by using the TCP, where the first packet is The last message sent by the message sending device in the first TCP sending window. Determining an interface according to the feature information of the first packet and a hash algorithm, and forwarding the first packet by using the outbound interface. Receiving, by the communication interface 1003, the second packet sent by the packet sending device by using the TCP, where the second packet is the first packet sent by the packet sending device in the second TCP sending window, The second message includes a Flowlet start tag, the second TCP send window is a TCP send window adjacent to the first TCP send window, and the message sending device receives the message in the first TCP send window. After the corresponding ACK is confirmed, the message is sent in the second TCP transmission window. The data forwarding device creates a first flowlet flow table entry based on the flowlet start tag included in the second packet, and forwards the second packet according to the created first flowlet flow table entry. The second message has the same feature information as the first message.

In a possible implementation, the program stored in the memory 1002 is further used by the instruction processor 1001 to receive, by the communication interface 1003, the third report sent by the packet sending device by using the TCP after creating the first Flowlet flow table entry. The third packet is the last packet sent by the packet sending device in the second TCP sending window, where the third packet includes a Flowlet end tag, and is based on the third packet. The flowlet end tag included in the first flowlet flow table entry is deleted.

In another implementation manner, in a possible implementation, the program stored in the memory 1002 is further used by the instruction processor 1001 to determine that the third message sent by the message sending device includes a Flowlet end tag, and then communicates The interface 1003 receives the fourth packet sent by the packet sending device by using the TCP, and the fourth packet is the first packet sent by the packet sending device in the third TCP sending window, and the fourth packet The message includes a flow start tag, and based on the flowlet start tag included in the fourth packet, creating a second flowlet flow table entry, and forwarding the according to the created second flowlet flow table entry Fourth message.

It should be noted that the load balancing processing device 100 and the packet forwarding device 1000 provided by the embodiments of the present application have the functions of the packet forwarding device involved in the foregoing embodiment. For the related description of the embodiments, the embodiments of the present application are not described herein again.

It should be further noted that the bus involved above may include a path for transferring information between various components of the computer.

The processor may be a general purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the embodiments of the present application. One or more memories included in the computer system, which may be read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM) or Other types of dynamic storage devices that store information and instructions may also be disk storage. These memories are connected to the processor via a bus.

Communication interface, any device such as transceiver can be used to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.

A memory, such as a RAM, stores an operating system and a program for executing the aspects of the embodiments of the present application. The operating system is a program that controls the running of other programs and manages system resources.

The embodiment of the present application further provides a storage medium, configured to store computer software instructions used by the load balancing processing device and the packet forwarding device, and includes a method for performing the user read/write request scheduling method related to the first aspect. program.

It is apparent that those skilled in the art can make various modifications and variations to the embodiments of the present application without departing from the spirit and scope of the application. Thus, the present embodiments are intended to cover such modifications and variations as the modifications and variations of the embodiments of the present invention are intended to be included within the scope of the appended claims.

Claims

A load balancing processing method, comprising:

The packet forwarding device receives the first packet sent by the packet sending device by using the transmission control protocol TCP, and the first packet is the last packet sent by the packet sending device in the first TCP sending window;

The packet forwarding device determines an interface according to the feature information of the first packet and a hash algorithm, and forwards the first packet by using the outbound interface;

The packet forwarding device receives the second packet sent by the packet sending device by using the TCP, and the second packet is the first packet sent by the packet sending device in the second TCP sending window. The second message includes a Flowlet start tag, the second TCP send window is a TCP send window adjacent to the first TCP send window, and the message sending device receives the first TCP send window. After the ACK corresponding to the message sent within the packet is acknowledged, the packet is sent in the second TCP sending window;

The packet forwarding device creates a first flowlet flow table entry based on the flowlet start tag included in the second packet, and forwards the second report according to the created first flowlet flow table entry. The second message has the same feature information as the first message.
The method of claim 1, wherein after the first flowlet flow table entry is created, the method further comprises:

The packet forwarding device receives the third packet sent by the packet sending device by using the TCP, and the third packet is the last packet sent by the packet sending device in the second TCP sending window. The third message includes a flow end tag;

The packet forwarding device deletes the first Flowlet flow table entry based on the Flowlet end tag included in the third packet.
The method of claim 2, wherein after the packet forwarding device determines that the third packet sent by the packet sending device includes a Flowlet End Tag, the method further includes:

The packet forwarding device receives the fourth packet sent by the packet sending device by using the TCP, and the fourth packet is the first packet sent by the packet sending device in the third TCP sending window. The fourth message includes a Flowlet start tag;

The packet forwarding device creates a second Flowlet flow table entry based on the Flowlet start tag included in the fourth packet, and forwards the fourth according to the created second Flowlet flow table entry. Message.
The method according to any one of claims 1 to 3, wherein the Flowlet start tag included in the second message is carried by an idle bit in a header of the second message.
The method according to claim 1, wherein the outbound interface for forwarding the second packet indicated by the first flowlet flow table entry, and the outgoing interface for forwarding the first packet are The same outgoing interface or a different outgoing interface.
A load balancing processing device, comprising: a receiving unit, a processing unit, and a sending unit, wherein:

The receiving unit is configured to receive a first packet sent by the packet sending device by using a transmission control protocol (TCP), where the first packet is the last packet sent by the packet sending device in the first TCP sending window. And receiving the second packet sent by the packet sending device by using the TCP, where the second packet is the first packet sent by the packet sending device in the second TCP sending window, the second packet The message includes a Flowlet start tag, the second TCP send window is a TCP send window adjacent to the first TCP send window, and the message sending device receives the report sent in the first TCP send window Sending a message in the second TCP sending window after confirming the ACK corresponding to the text;

The processing unit is configured to determine an interface according to the feature information of the first packet and the hash algorithm received by the receiving unit, and create a first Flowlet stream based on the Flowlet start tag included in the second packet Table entry

The sending unit is configured to forward the first packet by using the outbound interface determined by the processing unit, and forward the second packet according to the first Flowlet flow table entry created by the processing unit, The second message and the first message have the same feature information.
The load balancing processing apparatus according to claim 6, wherein the receiving unit is further configured to:

After the first flowlet table entry is created, the third packet sent by the packet sending device is sent by the packet sending device, and the third packet is sent by the packet sending device in the second TCP sending window. The last message, the third message includes a flow end tag;

The processing unit is further configured to:

And deleting the first Flowlet flow table entry based on the Flowlet end tag included in the third packet received by the receiving unit.
The load balancing processing device according to claim 7, wherein the receiving unit is further configured to:

After the processing unit determines that the third packet sent by the packet sending device by using the TCP includes the Flowlet End Tag, the fourth packet sent by the packet sending device is received, where the fourth packet is the a first message sent by the message sending device in the third TCP sending window, where the fourth message includes a Flowlet start tag;

The processing unit is further configured to:

Creating a second Flowlet flow table entry based on the Flowlet start tag included in the fourth packet received by the receiving unit;

The sending unit is further configured to:

And forwarding, according to the second flowlet flow table entry created by the processing unit, the fourth packet.
The load balancing processing apparatus according to any one of claims 6 to 8, wherein the flowlet included in the second packet starts to mark a free bit in a header of the second packet. Carrying.
The load balancing processing device according to claim 6, wherein the outbound interface for forwarding the second packet and the forwarding of the first packet are indicated by the first flowlet flow table entry The outgoing interface is the same outgoing interface or a different outgoing interface.