WO2007147310A1

WO2007147310A1 - A method and an apparatus for realizing partaking of network traffic load

Info

Publication number: WO2007147310A1
Application number: PCT/CN2007/001110
Authority: WO
Inventors: Yikang Lei; Xueqin Liu
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2006-06-15
Filing date: 2007-04-05
Publication date: 2007-12-27
Also published as: CN101051939A; CN100561937C

Abstract

A method for realizing partaking of network traffic load and an apparatus and router for realizing the method are provided. The network traffic imported to a router is decomposed and filtered based on the access control list (ACL) rule; the decomposed and filtered network traffic is distributed by the HASH algorithm to the virtual HASH bucket for bearing the network traffic; the network traffic is allocated from the virtual HASH buckets to the actual port based on the distribution condition of the network traffic. Because the virtual HASH buckets are adopted and the number of the virtual HASH buckets may be flexibly configured based on the needs, so the decomposed and filtered network traffic may be hashed in more buckets. When the network traffic is distributed unevenly, the port that is not be used or whose network traffic is small is chosen when the network traffic is mapped from the virtual HASH bucket to the actual port, so it ensures that the network traffic is allocated evenly to the actual port.

Description

Method and device for realizing network traffic load sharing

The present invention relates to a network traffic distribution technique, and more particularly to a method and apparatus for implementing network traffic load sharing, and a router. Background of the invention

With the continuous development of various IP technologies and transmission technologies, the application of Internet technologies has become increasingly widespread, and the number of users and network traffic have continued to grow. Although the Internet can provide a variety of content that enriches people's daily lives, it can also be used by social unscrupulous elements. If the Internet cannot be effectively managed and monitored, it will bring various harms to the network security of the country, enterprises and individuals. Therefore, it is very important to protect information security.

For the monitoring of information, the current technology is mainly used for shunting and blocking. The traffic is introduced into the router through the optical splitter, and is decomposed and filtered by the Access Control List (ACL) rules for the back-end server system to perform correlation analysis and processing. The offloading may be one or more levels of offloading until the granularity that the host can handle. There may be multiple back-end server systems that handle different types of data, so port grouping is required on the offloading device. Each port group consists of multiple ports, and each port group corresponds to one server system. Because the traffic to be processed is large and the data is large, each server system adopts an array mode, and load balancing is performed among multiple hosts for common processing. This requires the router to load balance traffic between multiple output ports of the port group and distribute it evenly across multiple hosts.

In order to distribute traffic more evenly to each output port, it is critical that traffic is selected in the port group. The current HASH algorithm uses the HASH key value calculated according to the HASH element to obtain the output port by taking the number of ports. For example, the number of ports in the port group is 256. The HASH key value calculated by 16-bit XOR according to the IP source address 10.0.0.1 and the destination address 10.0.0.2 is 3, and the 256 is obtained after modulo.

3, that is, select the outbound port with serial number 3 in the port group.

The advantage of this method is that the single tube is easy to operate. When the key length of the HASH calculation is not too long, the number of ports is large enough to be evenly hashed. It is suitable for small systems where the IP address does not change much and the number of output ports is not much.

However, in the process of implementing the present invention, the inventors have found that this method also has the following disadvantages:

First, if the key length of the HASH calculation is not much different from the number of ports, the HASH result will not be hashed in each HASH bucket (that is, each port), which will inevitably result in uneven output. Secondly, if you need a larger IP address range, you need to increase the key length. In order to make the hash more uniform, you need to increase the number of HASH buckets, that is, increase the number of ports, which will cause frequent configuration changes and increase the calculation of HASH key values. Equipment cost such as memory required. Summary of the invention

In order to solve the problem that the length of the key value of the HASH calculation is not much different from the number of ports in the prior art, the problem of uneven output is caused, and the problem that the implementation cost increases when the IP address change is large, the embodiment of the present invention provides A method for implementing network traffic load sharing, an apparatus for implementing the method, and a router.

According to an embodiment of the present invention, a method for implementing network traffic load sharing includes: decomposing and filtering network traffic introduced to a router by using an access control list ACL rule; and distributing the decomposed and filtered network traffic to the HASH algorithm. A virtual HASH bucket that carries network traffic. According to the distribution of network traffic, network traffic is allocated from the virtual HASH bucket to the actual port.

According to an embodiment of the present invention, an apparatus for implementing network traffic load sharing includes introducing The network traffic splitter, the filter for decomposing and filtering the imported network traffic, further includes: a virtual HASH bucket, configured to carry network traffic decomposed and filtered by the filter, and the network traffic passes the number based on the virtual HASH bucket. The HASH algorithm is allocated to the virtual HASH bucket; the actual port is configured to receive network traffic allocated from the virtual HASH bucket, and deliver the network traffic to the server system.

According to an embodiment of the present invention, a router includes: a filtering unit, configured to decompose and filter network traffic entering the router by using an access control list ACL rule; and an allocation unit, configured to perform a hash algorithm according to a HASH algorithm and a mapping operation method Allocate the decomposed and filtered network traffic;

The actual port used to send network traffic from the distribution unit to the server system. The allocation unit includes: a HASH operation unit, configured to allocate the decomposed and filtered network traffic by using a HASH algorithm; a virtual HASH bucket for carrying network traffic allocated by the HASH operation unit; and a mapping operation unit, configured to The distribution of network traffic is distributed from the virtual HASH bucket to the actual port.

In the embodiment of the present invention, the virtual HASH bucket is used, and the number of virtual HASH buckets can be flexibly set according to requirements, so that the decomposed and filtered network traffic can be hashed in more buckets, if the traffic is offloaded. Uniformly, the network traffic in the virtual HASH bucket can be directly allocated to the actual port; when the network traffic is unevenly distributed, when the network traffic is allocated from the virtual HASH bucket to the actual port, try to select the unused port or traffic. The smallest port, when there are multiple ports with the smallest traffic, select the port with the highest port rate, that is, balance the network traffic of each port as much as possible to ensure that network traffic can be allocated to the actual port. BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of a method for implementing network traffic load sharing according to an embodiment of the present invention. FIG. 2 is a schematic structural diagram of an apparatus for implementing network traffic load sharing according to an embodiment of the present invention.

FIG. 3 is a flowchart of an implementation manner of a method for implementing network traffic load sharing according to an embodiment of the present invention.

FIG. 4 is a schematic structural diagram of a router according to an embodiment of the present invention. Mode for carrying out the invention

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The present invention is further described with reference to the accompanying drawings and embodiments, but is not intended to limit the invention.

FIG. 1 is a schematic block diagram of a method for implementing network traffic load sharing according to an embodiment of the present invention. As shown in FIG. 1 , in the embodiment of the present invention, the decomposed and filtered network traffic is allocated to the virtual HASH bucket through the HASH algorithm, and then the network traffic is allocated to the actual port through the mapping algorithm, thereby achieving uniform load sharing of the network traffic.

In order to implement the above method, it is necessary to establish a device for implementing network traffic load sharing. FIG. 2 is a schematic structural diagram of an apparatus for implementing network traffic load sharing according to an embodiment of the present invention. As shown in FIG. 2, the apparatus includes a splitter 201, a filter 202, a HASH operator 203, a virtual HASH bucket 204, a mapping operator 205, and an actual port 206 of the router. among them:

The splitter 201 introduces network traffic into the filter 202;

The filter 202 decomposes and filters the imported network traffic according to the ACL rule, and specifically: in the ACL rule, configure a rule for classifying the network traffic according to the source address, the destination address, the port number, or the protocol type of the network traffic, These rules are applied to the router interface, and the filter 202 determines, according to these rules, that the introduced network traffic is received, discarded, or redirected to a port or a port group, thereby realizing the decomposition and filtering of the network traffic; The HASH operator 203 allocates the network traffic filtered by the filter 202 to the virtual HASH bucket 204 through the HASH algorithm;

The virtual HASH bucket 204 carries the decomposed and filtered network traffic;

The mapping operator 205 allocates network traffic in the virtual HASH bucket 204 to the actual port 206 of the router;

The actual port 206 provided by the router receives the network traffic allocated from the virtual HASH bucket 204, and hands the network traffic to the host 207 of the server system for processing.

The process of implementing uniform load sharing of network traffic is described below in conjunction with the above apparatus.

First, the network traffic is introduced by the splitter 201, decomposed and filtered by the filter 202, and then the network traffic is distributed to the virtual HASH bucket 204 by the HASH algorithm.

When the network traffic splitting comparison is checked, the virtual HASH bucket 204 is mapped to the actual port, and the network traffic is sent to the actual port corresponding to the virtual HASH bucket 204. When the network traffic splitting is detected to be uneven, the following is taken. Distribution method. As shown in Figure 3, traverse the actual port of the router, look for the port that does not allocate network traffic, if found, assign network traffic to the port; if not found, look for the port with the lowest network traffic statistics, find the network traffic The port with the lowest network traffic statistics; if there are multiple ports with the lowest network traffic statistics, look for the port with the highest port rate from these ports, and then assign the network traffic to the port with the highest rate on the port; The port with the highest port rate searches for the port with the least number of allocated ports from the port with the highest port rate. After it is found, it allocates the traffic to the port with the least number of allocated times. If there are multiple ports with the least number of allocated times, Randomly select a port to assign traffic to that port. The ports looked for in the above process are all ports with the status UP.

Embodiments of the present invention also propose a router. FIG. 4 is a schematic structural diagram of a router according to an embodiment of the present invention. As shown in FIG. 4, the router includes a filtering unit 401, an allocating unit 400, and an actual port 406. The filtering unit 401 decomposes and filters the network traffic introduced to the router by using an access control list ACL rule.

The allocating unit 400 allocates the decomposed and filtered network traffic according to the HASH algorithm and the mapping operation.

The actual port 406 sends the network traffic allocated by the allocation unit 400 to the server system. There are multiple physical ports 406 in the router, and for convenience, only one actual port is drawn.

The allocation unit 400 includes: a HASH operation unit 402, a virtual HASH bucket 403, and a mapping operation unit 405. The HASH operation unit 402 allocates the decomposed and filtered network traffic through the HASH algorithm. The virtual HASH bucket 403 carries the network traffic allocated by the HASH operation unit 402. The mapping operation unit 405 allocates the network traffic from the virtual HASH bucket 403 to the actual port 406 according to the distribution of the network traffic.

The allocation unit 400 in the router may further include a virtual HASH bucket number determining unit 407. The virtual HASH bucket number determining unit 407 determines the number of virtual HASH buckets according to the actual number of ports or the number of the decomposed network traffic, and sends the number of virtual HASH buckets to the HASH operation unit; the HASH computing unit passes the decomposed and filtered network traffic. The allocation is performed based on the HASH algorithm of the number of virtual HASH buckets.

The allocation unit in the router may further include a network traffic distribution judging unit 404. The network is unchecked, and the judgment result is sent to the mapping operation unit 405.

The mapping operation unit 405 in the router includes: a mapping module 4051 and an operation module, wherein when the network traffic distribution is uniform from the judgment result received by the network traffic distribution determining unit 404, the mapping module 4051 maps the virtual HASH bucket 403 to the actual Port 406, and send network traffic to its corresponding actual port 406; when it is judged from network traffic distribution When the judgment result received by the breaking unit 404 is that the network traffic distribution is uneven, the operation module 4052 allocates network traffic to the actual port 406 by an algorithm.

In the embodiment of the present invention, the network traffic is introduced by the optical splitter, and is decomposed and filtered by the filter, and then allocated to the virtual HASH bucket. The number of virtual HASH buckets is 10000, and the number of actual ports is 100. The virtual HASH bucket with the serial number of 1 to 100 corresponds to the actual port 1, the virtual HASH bucket with the serial number of 101 to 200 corresponds to the actual port 2, and the virtual HASH bucket with the serial number of 201 to 300 corresponds to the actual port 3. Similarly, the virtual HASH bucket is associated with the actual port, and the network traffic allocated to a virtual HASH bucket is allocated to the corresponding actual port, thereby realizing the traffic distribution of the network traffic. Since the network traffic is relatively uniform during the offloading, the network traffic can be evenly distributed after being allocated to the actual port.

In another case, the number of actual ports of the router is 256, and the length of the HASH key is 16 bits, and the range of change is 0 65535. Therefore, if the actual port is used as the HASH bucket, it is bound to have multiple network traffic falling in the same On the port, the number of network traffic allocated by each port is not uniform; and the size of the data packet itself is not limited, so the traffic on each port is not uniform.

The virtual HASH bucket is set to 256 X 1000 = 256000, and the 65536 network traffic that is decomposed and filtered is hashed. There is at most one network traffic in each virtual HASH bucket. The traffic (65536) hashed into 256,000 virtual HASH buckets is allocated to the actual 256 ports.

After the virtual HASH bucket is set, you can use the statistics of the HASH bucket to determine whether the network traffic is decomposed and filtered. If the network traffic after the decomposition and filtering is uniform, you can pass the mapping between the virtual HASH bucket and the actual port. The relationship maps the network traffic in a virtual HASH bucket to the actual port corresponding to the virtual HASH bucket. If the network traffic after the decomposition and filtering is not uniform, the network traffic cannot be simply mapped to the real relationship according to the foregoing relationship. Instead, you need to select the actual port with the lowest traffic by traversing the traffic load of the actual port, and then assign the network traffic to the actual port. The following describes the load balancing scheme of network traffic in the case of uneven network traffic through a specific embodiment.

FIG. 3 is a flowchart of a method for implementing network traffic load sharing according to an embodiment of the present invention. In this embodiment, the number of the actual port is 256, the number of the virtual HASH bucket is 256000, and the network traffic is uneven. As shown in FIG. 3, the method for implementing network traffic load sharing mainly includes the following steps:

Step 301: The optical splitter introduces network traffic.

Step 302: Decompose and filter the imported network traffic according to the ACL rule. Step 303: Assign the decomposed and filtered network traffic to the virtual HASH bucket through the HASH algorithm.

Assume that the HASH result calculated by a virtual HASH bucket is m, and the number of network traffic allocated on each actual port is represented by an array Fn[i], where 0 i 255 , the actual network traffic on each actual port Represented by the array Fa[i], where 0 < 255; Step 304: traverse the actual port;

Step 305: Find whether there is an allocated network traffic Fn[i] = 0, and the port is in the state of UP, if yes, go to step 306, otherwise go to step 307;

Step 306: Select the port with the assigned network traffic Fn[i] = 0, and increase the number of network traffic Fn[i] allocated by the selected port by 1, then the actual network traffic Fa[i] of the port increases; Step 307: Find The port Fa[i]min with the smallest network traffic statistics and the status is UP; Step 308: Determine whether the port with the smallest network traffic statistics and the status is UP is unique, if yes, go to step 309, otherwise go to step 310;

Step 309: Select the port with the smallest network traffic statistics, and increase the number of network traffic Fn[i] allocated by the selected port by 1, and increase the actual network traffic Fa[i] of the port.

Step 310: Search for the port in the port with the smallest network traffic statistics and the status is UP. The port with the highest port rate;

Step 311: Determine whether the network traffic statistics are the smallest, the status is UP, and the port with the highest port rate is unique. If yes, go to step 312, otherwise go to step 313;

Step 312: Select the port with the smallest network traffic statistics, the status is UP, and the port rate is the largest. If the number of network traffic Fn[i] allocated by the selected port is increased by 1, the actual network traffic Fa[i] of the port increases.

Step 313: Find the port Fn[i]min with the smallest number of allocated ports in the port with the smallest network traffic statistics, the state of the UP, and the maximum port rate.

Step 314: Determine whether the network traffic statistics are the smallest, the state is UP, the port rate is the largest, and the port with the least number of times is the only ones. If yes, go to step 315, otherwise go to step 316;

Step 315: Select the port with the smallest network traffic statistics, the status is UP, the port rate is the largest, and the number of allocated times is the least. If the number of network traffic Fn[i] allocated by the selected port is increased by 1, the actual network traffic of the port is Fa [ i] increase;

Step 316: randomly select one port to allocate traffic from multiple ports with the smallest network traffic statistics, the state is UP, the port rate is the largest, and the least number of times is allocated. The number of network traffic Fn[i] allocated by the selected port is increased by 1, then The actual network traffic of the port Fa[i] is increased.

Repeat steps 304 ~ 316 to distribute the traffic in each virtual HASH bucket to the selected actual port, thus achieving uniform load sharing of network traffic.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. Within the scope.

Claims

Claim

A method for implementing network traffic load sharing, comprising: decomposing and filtering network traffic introduced to a router by using an access control list ACL rule;

And allocating the filtered and filtered network traffic to a virtual HASH bucket for carrying network traffic by using an HASH algorithm;

The network traffic is allocated from the virtual HASH bucket to the actual port according to the distribution of network traffic.

The method for implementing network traffic load balancing according to claim 1, wherein the splitting and filtering the network traffic to the virtual HASH bucket by using the HASH algorithm includes:

Determine the number of virtual HASH buckets;

Determining a virtual HASH bucket by using a HASH algorithm based on the determined number of virtual HASH buckets;

The decomposed and filtered network traffic is allocated to the determined virtual HASH bucket.

The method for implementing network traffic load sharing according to claim 2, wherein the number of the virtual HASH buckets is greater than the number of the decomposed network traffic.

The method for implementing network traffic load balancing according to claim 2, wherein the number of the virtual HASH buckets is determined to be a multiple of the actual port number.

The method for implementing network traffic load sharing according to any one of claims 1 to 4, wherein the distribution of the network traffic is determined by the following method: determining a network according to a statistical value of a virtual HASH bucket Whether the flow distribution is uniform.

The method for implementing network traffic load sharing according to claim 5, wherein the allocating the network traffic from the virtual HASH bucket to the actual port includes:

When the network traffic distribution is determined to be uniform, the virtual HASH bucket is mapped to the actual port. Send the network traffic on the virtual HASH bucket to the actual port corresponding to the virtual HASH bucket.

When it is determined that the network traffic is unevenly distributed, the actual port is traversed, and a port whose status is UP is not allocated, and if found, the network traffic is allocated to the port that has no network traffic and the state is UP; otherwise, Look for the port with the smallest network traffic statistics and the status is UP, and allocate the network traffic to the port with the smallest network traffic statistics and the status is UP.

The method for implementing network traffic load sharing according to claim 7, further comprising:

If two or more ports with the lowest traffic statistics and the status of UP are found, the traffic is allocated to the port with the highest port rate among the ports with the smallest network traffic statistics and the status of UP.

The method for implementing network traffic load sharing according to claim 8, further comprising:

If the port with the smallest network traffic statistics and the status of UP has multiple ports with the highest port rate, the network traffic is allocated to the port with the least number of allocated ports with the highest port rate.

The method for implementing network traffic load sharing according to claim 9, further comprising:

If the network traffic statistics are the smallest and the port with the highest status and the highest port rate has the least number of allocated ports, then one port is randomly selected to allocate traffic.

A device for implementing network traffic load sharing, comprising: a splitter that introduces network traffic, and a filter that decomposes and filters the incoming network traffic, wherein the device further includes: a virtual HASH bucket, configured to carry network traffic decomposed and filtered by the filter, where the network traffic is allocated to the virtual HASH bucket by using a HASH algorithm based on the number of virtual HASH buckets;

The actual port is used to receive network traffic allocated from the virtual HASH bucket, and hand the network traffic to the server.

12. The apparatus for implementing network traffic load sharing according to claim 11, wherein the method further comprises:

An HASH operation unit is disposed between the filter and the virtual HASH bucket, configured to determine a virtual HASH bucket by using a HASH algorithm based on the number of virtual HASH buckets, and allocate network traffic that is decomposed and filtered by the filter to the Determine the virtual HASH bucket.

The device for implementing network traffic load sharing according to claim 11 or 12, further comprising:

The mapping operation unit is disposed between the virtual HASH bucket and the actual port, and is configured to allocate network traffic in the virtual HASH bucket to the actual port.

14. A router, comprising:

a filtering unit, configured to decompose and filter network traffic introduced to the router by using an access control list ACL rule;

An allocating unit, configured to allocate network traffic decomposed and filtered by the filtering unit according to a HASH algorithm and a mapping operation method;

The actual port used to send network traffic from the distribution unit to the server system.

The router according to claim 14, wherein the allocating unit comprises:

a HASH operation unit, configured to allocate the decomposed and filtered network traffic by using a HASH algorithm;

a virtual HASH bucket for carrying network traffic allocated by the HASH operation unit; The mapping operation unit is configured to allocate the network traffic from the virtual HASH bucket to the actual port according to the distribution of the network traffic.

The router according to claim 15, wherein the allocating unit further comprises: a virtual HASH bucket number determining unit, configured to determine the number of virtual HASH buckets according to the actual number of ports or the number of decomposed network traffic, And sending the number of the virtual HASH buckets to the HASH operation unit; the HASH operation unit is configured to allocate the decomposed and filtered network traffic by using a HASH algorithm based on the number of the virtual HASH buckets.

The router according to claim 15 or 16, wherein the allocating unit further comprises:

The network traffic distribution determining unit is configured to determine whether the network traffic distribution is consistent according to the statistical value of the virtual HASH bucket, and send the determination result to the mapping operation unit.

The router according to claim 17, wherein the mapping operation unit comprises:

The mapping module is configured to map the virtual HASH bucket to the actual port and send the network traffic of the virtual HASH bucket to the corresponding actual port when the network traffic distribution determining unit sends the network traffic to the actual port.

The router according to claim 17, wherein the mapping operation unit comprises:

The operation module, 'When the judgment result sent by the network traffic distribution judgment unit is that the network traffic distribution is uneven, the network traffic is allocated to the actual port by the algorithm, so that the network traffic of the actual port is uniform.