WO2019127083A1

WO2019127083A1 - Network speed limiting method and apparatus, and server

Info

Publication number: WO2019127083A1
Application number: PCT/CN2017/118932
Authority: WO
Inventors: 李侠
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2017-12-27
Filing date: 2017-12-27
Publication date: 2019-07-04
Also published as: CN108235804B; CN108235804A

Abstract

The embodiments of the present application relate to the technical field of network communications, for example, a network speed limiting method and apparatus, and a server. Said method comprises: receiving a request packet sent by a client; acquiring communication path information of the request packet, a first speed limiting threshold and a second speed limiting threshold; establishing a connection with a next-hop server according to the communication path information, and setting a speed limiting threshold for the ingress server according to the first speed limiting threshold, so that the upload rate of data passing through the ingress server is less than the first speed limiting threshold; and adding the second speed limiting threshold into the request packet, and sending the request packet to the next-hop server. In the embodiments of the present application, the speed limiting threshold is set for the ingress server according to the first speed limiting threshold, so as to limit an upstream traffic bandwidth, and the speed limiting threshold is set for an egress server according to the second speed limiting threshold, so as to limit a downstream traffic bandwidth. Thus, the bandwidths occupied by the applications' access are balanced, improving the access quality.

Description

Network speed limiting method, device and server

Technical field

The embodiments of the present application relate to the field of network communication technologies, for example, to a network rate limiting method, apparatus, and server.

Background technique

When the user uses the network application, the application client that is installed on the user terminal sends a data access request message to the source server to obtain the corresponding content. For example, the video application can send a data access request report to the source server through the computer. To get the corresponding video content and play it. In the Application Delivery Network (ADN), there are various application accelerations, such as video acceleration, large file transfer acceleration, and web page acceleration.

In the process of studying the prior art, the inventor found that at least the following problems exist in the related art: the bandwidth of the video application easily fills the entire bandwidth, causing other application accesses (such as page loading) to slow down, affecting the acceleration effect, and in fact Video viewing does not require high bandwidth. If you can provide a solution that allows each application to use bandwidth equally, it will be a good solution to the above problem.

Summary of the invention

An object of the embodiments of the present application is to provide a network rate limiting method, apparatus, and server, which enable each application to access a balanced bandwidth and optimize access quality.

In a first aspect, the embodiment of the present application provides a network rate limiting method, where the method is applied to a server, and the server is in communication with another at least one server, and the server is used as an ingress server, and the method includes:

Receiving a request message sent by the client;

Obtaining communication path information of the request message, and a first rate limit threshold and a second rate limit threshold;

Establishing a connection with the next hop server according to the communication path information, and setting a rate limit threshold according to the first rate limit threshold, so that the data upload rate of the portal server is smaller than the first rate limit threshold. ;

Adding the second rate limit threshold to the request message, and sending the request message to the next hop server.

In a second aspect, the embodiment of the present application further provides a network speed limit method, where the speed limit method is applied to a server, and the server is in communication with another at least one server, and the server is used as an egress server, and the method includes:

Receiving request messages sent by other servers;

Parsing the request packet to obtain a second rate limit threshold;

Setting a rate limit threshold according to the second rate limit threshold to the egress server, so that a data download rate passing the egress server is smaller than the second rate limit threshold.

In a third aspect, the embodiment of the present application further provides a network speed limit device, where the device is applied to a server, and the server is in communication with another at least one server, the server serves as an ingress server, and the device includes:

a first receiving module, configured to receive a request message sent by the client;

An acquiring module, configured to acquire communication path information of the request packet, and a first rate limit threshold and a second rate limit threshold;

a first setting module, configured to establish a connection with the next hop server according to the communication path information, and set a rate limit threshold according to the first rate limit threshold, so that a data upload rate of the portal server is less than The first speed limit threshold;

And a sending module, configured to add the second rate limit threshold to the request message, and send the request message to a next hop server.

In a fourth aspect, the embodiment of the present application further provides a network speed limit device, where the speed limit device is applied to a server, and the server is in communication with another at least one server, and the server serves as an egress server, and the device includes:

a second receiving module, configured to receive a request message sent by another server;

a parsing module, configured to parse the request packet to obtain a second rate limit threshold;

And a second setting module, configured to set a rate limit threshold according to the second rate limit threshold, so that a data download rate of the egress server is smaller than the second rate limit threshold.

In a fifth aspect, the embodiment of the present application further provides a server, including:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method described above.

The rate limiting method, the device, and the server provided by the embodiment of the present application obtain the first rate limit threshold and the second rate limit threshold, and set a rate limit threshold according to the first rate limit threshold to limit the uplink traffic bandwidth. And sending the second rate limit threshold request message to the next hop server, so that the egress server can obtain the second rate limit threshold by parsing the request message, and setting a rate limit threshold according to the second rate limit threshold. To limit the downstream traffic bandwidth. Therefore, each application access can balance the occupied bandwidth and improve the access quality.

DRAWINGS

The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.

1 is a schematic diagram of an application scenario of a network rate limiting method and apparatus of the present application;

2 is a flow chart of an embodiment of an ingress server side rate limiting method of the present application;

3 is a schematic diagram of a communication structure between servers in the embodiment of the present application;

4 is a schematic diagram of a GRP format in an embodiment of the present application;

5 is a schematic diagram of a data portion of a GRP format in an embodiment of the present application;

6 is a schematic diagram of a format of each option unit of a GRP format data part in the embodiment of the present application;

7 is a flowchart of an embodiment of an egress server side rate limiting method of the present application;

8 is a schematic structural diagram of an embodiment of an entrance server side speed limiting device of the present application;

9 is a schematic structural diagram of an embodiment of an entrance server side speed limiting device of the present application;

10 is a schematic structural diagram of an embodiment of an egress server side speed limiting device of the present application;

11 is a schematic structural diagram of an embodiment of an egress server side speed limiting device of the present application;

FIG. 12 is a schematic structural diagram of a hardware of a server provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The network rate limiting method and apparatus provided in this application are applicable to the application scenario shown in FIG. 1, and include at least two servers 20, at least two servers 20 are communicatively connected to each other, and any one of the at least two servers 20 and the controller 20 10 communication connections. Among the at least two servers 20, an access server that is in communication with the client is called an ingress server, and a communication connection with the source station server is called an egress server. If there are more than three servers 20, the other servers 20 act as intermediate servers responsible for forwarding data messages between the ingress server and the egress server. Among them, for different data transmission tasks, each server 20 may function as any one of an ingress server, an intermediate server, and an egress server.

The controller 10 is configured to manage the transmission path of the data packets between the servers 20, and the controller 10 can obtain the communication path in advance and transmit the communication path to the corresponding portal server. The ingress server sends the data request message to the source station server through the intermediate server and the egress server according to the communication path. The controller 10 is further configured to send the first rate limit threshold and the second rate limit threshold to the ingress server, and the ingress server sets a rate limit threshold according to the first rate limit threshold to limit the data upload rate (ie, the uplink traffic bandwidth). The ingress server also encapsulates the second rate limit threshold into the request message, and sends the request message to the egress server through the intermediate server. The egress server parses the request packet to obtain a second rate limit threshold, and sets a rate limit threshold according to the second rate limit threshold to limit the data download rate (ie, the downlink traffic bandwidth). Therefore, each application access can balance the occupied bandwidth and improve the access quality.

The network rate limiting method provided by the embodiment of the present application may be performed by any of the servers 20 shown in FIG. 1, as shown in FIG. 2, which is a flowchart of an embodiment of the rate limiting method, where the server 20 acts as When the server is imported, the speed limit method includes:

101: Receive a request message sent by the client.

102: Acquire communication path information of the request message, and a first rate limit threshold and a second rate limit threshold.

In an actual application, the communication path information, the first speed limit threshold, and the second speed limit threshold may be sent by the controller 10 to the portal server, and the controller 10 may obtain the source server through the portal server in advance through, for example, a routing algorithm. The preferred path is then sent to the corresponding ingress server for the communication path information of the preferred path. According to the communication path information, for example, address information and port information of the next hop server, address information of the remaining hop server, port information, and the like can be obtained. The address information is, for example, an IP (Internet Protocol) protocol, and port information such as a port number.

103: Establish a connection with the next hop server according to the communication path information, and set a rate limit threshold according to the first rate limit threshold, so that a data upload rate of the portal server is smaller than the first limit. Speed threshold.

In practical applications, the communication architecture shown in Figure 3 can be used between the two servers (the intermediate server is omitted between the entry server and the egress server in the figure). In Figure 3, fe-sk represents the front-end socket, and be-sk represents A back-end socket in which the front-end socket of the ingress server is responsible for communicating with the client, the back-end socket is responsible for communicating with the next-hop server, and the front-end socket of the egress server is responsible for communicating with the last-hop server, the back end The socket is responsible for communicating with the source server.

The portal server is connected to the next hop server, and the backend socket is created according to the address information and the port information of the next hop server, and the backend socket is connected with the next hop server. Setting a rate limit threshold for the ingress server can be accomplished by setting a rate limit threshold for the backend socket of the ingress server, or for the front end socket and the back end socket. The Linux system is used as an example. The ingress server, each intermediate server, and the egress server are all enabled with a fair queue. After receiving the first rate limit threshold, the ingress server sets a rate limit threshold based on the first rate limit threshold. In practice, you can call the setsockopt() function to set the rate limit threshold for the backend socket.

When the data upload rate (upstream traffic bandwidth) of the client reaches the set first rate limit threshold, the backend socket of the ingress server (that is, the socket that communicates with the next hop server) will be based on the set rate limit. The threshold is used for rate shaping, that is, rate limiting the data transmission rate, thereby limiting the upload rate of the network connection of the client.

104: Add the second rate limit threshold to the request message, and send the request message to the next hop server.

Before adding the second rate limit threshold to the request packet, the second rate limit threshold may be first based on the global path protocol (Global Routing). Protocol, GRP) Encapsulation, GRP based on binary stream, GRP encapsulation of communication path information, can effectively shorten the length of the data segment and increase the utilization rate of the network bandwidth.

Figure 4 shows a form of the GRP format, the GRP format including the header + data portion, the header portion including the 8-byte version number (Version), the 2-byte information type (MsgType), and the 2-byte data stream length ( Datalen), the data part includes a byte-varying data stream (Data Stream). For the specific format of the data part, please refer to FIG. 5, which includes an option unit and a plurality of address units. Each address unit can be used to place address information of a server 20, and the second rate limit threshold can be placed in the option unit. The specific format of the option unit is shown in Figure 6, including a 4-byte path ID, a 4-byte timestamp, a 4-byte session ID, and a 4-byte threshold. The value of the second rate limit threshold is placed in a 4-byte threshold segment.

The embodiment of the present application obtains the first rate limit threshold and the second rate limit threshold, and sets a rate limit threshold according to the first rate limit threshold to limit the uplink traffic bandwidth. And sending the second rate limit threshold request message to the next hop server, so that the egress server can obtain the second rate limit threshold by parsing the request message, and setting a rate limit threshold according to the second rate limit threshold. To limit the downstream traffic bandwidth. Therefore, each application access can balance the occupied bandwidth and improve the access quality.

It should be noted that the serial numbers in the embodiments of the present application are only for ease of understanding, and do not limit the order of the steps.

The embodiment of the present application further provides a network rate limiting method, which can be performed by any of the servers 20 shown in FIG. 1, as shown in FIG. 7, is a flowchart of an embodiment of the rate limiting method, When the server is an export server, the method includes:

201: Receive the request message sent by another server.

202: Parse the request packet to obtain a second rate limit threshold.

The intermediate server does not process the second rate limit threshold in the request packet. When the egress server receives the request packet sent by the ingress server or the intermediate server, the egress server parses the request packet to obtain a second rate limit threshold.

203. Set a rate limit threshold according to the second rate limit threshold, so that a data download rate that passes through the egress server is smaller than the second rate limit threshold.

For the communication architecture between the two servers, refer to FIG. 3. Setting the rate limit threshold for the egress server can be implemented by setting a speed limit threshold for the front end socket of the egress server or the front end socket and the back end socket. . Take the Linux system as an example. After receiving the second rate limit threshold, the egress server sets a rate limit threshold based on the second rate limit threshold. In practice, you can call the setsockopt() function to set the rate limit threshold for the front-end socket.

When the data download rate of the client (that is, the downlink traffic bandwidth) reaches the set second rate limit threshold, the front-end socket of the egress server (that is, the socket that communicates with the last hop server) is based on the threshold that has been set. Transmit rate shaping, which is the rate limit for data transmission, limits the download rate of the client's network connection.

The embodiment of the present application receives the request packet sent by another server, and obtains a second rate limit threshold from the request packet, and sets a rate limit threshold according to the second rate limit threshold to limit the downlink traffic bandwidth. When the ingress server and the egress server respectively limit the upstream traffic bandwidth and the downstream traffic bandwidth, the multi-segment network connection bandwidth between the ingress server and the egress server is limited, and the traffic burst is not caused, thereby avoiding jitter and acceleration. Instability. It should be noted that the above setting of the speed limit threshold value may be performed once when the socket is created.

Correspondingly, the embodiment of the present application further provides a network speed limiting device, which is used in any server 20 shown in FIG. 1 , and the server serves as an ingress server, as shown in FIG. 8 . 300 includes:

The first receiving module 301 is configured to receive a request message sent by the client.

The obtaining module 302 is configured to obtain communication path information of the request message, and a first rate limit threshold and a second rate limit threshold.

The first setting module 303 is configured to establish a connection with the next hop server according to the communication path information, and set a rate limit threshold according to the first rate limit threshold to enable a data upload rate of the portal server. Less than the first speed limit threshold.

The sending module 304 is configured to add the second rate limit threshold to the request message, and send the request message to the next hop server.

Optionally, in other embodiments of the device, referring to FIG. 9, the device 300 further includes:

The first opening module 305 is configured to open a fair queue.

The first setting module 303 is specifically configured to:

Establishing a backend socket according to the address information and the port information of the next hop server, and establishing a connection between the backend socket and the next hop server, and the backend socket according to the first rate limit threshold The word sets the speed limit threshold.

Optionally, in other embodiments of the apparatus, the second rate limit threshold is placed in the request message in a GRP format, the GRP format is based on a binary stream, and the GRP format includes a header and data. In part, the data portion includes an option unit and an address unit, and the second rate limiting threshold is placed in the option unit.

It should be noted that the speed limit device may perform the speed limit method provided by the embodiment of the present application, and has a function module and a beneficial effect corresponding to the execution method. For the technical details that are not described in detail in the embodiment of the present invention, reference may be made to the speed limiting method provided by the embodiment of the present application.

Correspondingly, the embodiment of the present application further provides a network speed limiting device, where the speed limiting device is used in any server 20 shown in FIG. 1 , and when the server is used to export a server, as shown in FIG. 10 , The device 400 includes:

The second receiving module 401 is configured to receive a request message sent by another server;

The parsing module 402 is configured to parse the request packet to obtain a second rate limit threshold.

The second setting module 403 is configured to set a rate limit threshold according to the second rate limit threshold, so that the data download rate through the egress server is smaller than the second rate limit threshold.

The embodiment of the present application receives the request packet sent by another server, and obtains a second rate limit threshold from the request packet, and sets a rate limit threshold according to the second rate limit threshold to limit the downlink traffic bandwidth. When the ingress server and the egress server respectively limit the upstream traffic bandwidth and the downstream traffic bandwidth, the multi-segment network connection bandwidth between the ingress server and the egress server is limited, and the traffic burst is not caused, thereby avoiding jitter and acceleration. Instability.

Optionally, in other embodiments of the device, referring to FIG. 11, the device 400 further includes:

a second opening module 404, configured to enable a fair queue;

The second setting module 403 is specifically configured to:

And setting a rate limit threshold according to the second rate limit threshold of the front end socket of the egress server.

FIG. 12 is a schematic diagram showing the hardware structure of the server 20 according to the embodiment of the present application. As shown in FIG. 12, the server 20 includes:

One or more processors 21 and a memory 22 are exemplified by a processor 21 in FIG.

The processor 21 and the memory 22 can be connected by a bus or other means, and the connection by a bus is taken as an example in FIG.

The memory 22 is used as a non-volatile computer readable storage medium, and can be used for storing non-volatile software programs, non-volatile computer-executable programs, and modules, such as program instructions corresponding to the rate limiting method in the embodiment of the present application. / Module (for example, the second receiving module 401, the parsing module 402, and the second setting module 403 shown in FIG. 10). The processor 21 executes various functional applications and data processing of the server by executing non-volatile software programs, instructions, and modules stored in the memory 22, that is, implementing the speed limiting method of the above method embodiments.

The memory 22 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to use of the speed limiting device, and the like. Further, the memory 22 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 22 may optionally include memory remotely located relative to processor 21, which may be connected to the rate limiting device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The one or more modules are stored in the memory 22, and when executed by the one or more processors 21, perform a rate limiting method in any of the above method embodiments, for example, performing the above described FIG. Method steps 101-104, method steps 201 to 203 in FIG. 7; implementing modules 301-304 in FIG. 8, modules 301-305 in FIG. 9, modules 401-403 in FIG. 10, modules in FIG. The function of 401-404.

The above products can perform the methods provided by the embodiments of the present application, and have the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiments of the present application.

Embodiments of the present application provide a non-transitory computer readable storage medium storing computer-executable instructions that are executed by one or more processors, such as in FIG. a processor 21, which may cause the one or more processors to perform the rate limiting method in any of the above method embodiments, for example, to perform the method steps 101-104 of FIG. 2 described above, the method steps in FIG. 201 to 203; functions of the modules 301-304 in FIG. 8, the modules 301-305 in FIG. 9, the modules 401-403 in FIG. 10, and the modules 401-404 in FIG. 11 are implemented.

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a general hardware platform, and of course, by hardware. A person skilled in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (Random Access). Memory, RAM), etc.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto; in the idea of the present application, the technical features in the above embodiments or different embodiments may also be combined. The steps may be carried out in any order, and there are many other variations of the various aspects of the present application as described above, which are not provided in the details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, The skilled person should understand that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the embodiments of the present application. The scope of the technical solution.

Claims

A network rate limiting method, the method is applied to a server, and the server is in communication with another at least one server, wherein the server is used as an ingress server, and the method includes:

Receiving a request message sent by the client;

Obtaining communication path information of the request message, and a first rate limit threshold and a second rate limit threshold;

Establishing a connection with the next hop server according to the communication path information, and setting a rate limit threshold according to the first rate limit threshold, so that the data upload rate of the portal server is smaller than the first rate limit threshold. ;

Adding the second rate limit threshold to the request message, and sending the request message to the next hop server.
The method of claim 1 further comprising:

Open the fair queue;

The establishing a connection with the next hop server according to the communication path information, and setting a rate limit threshold according to the first rate limit threshold, so that the data upload rate of the portal server is smaller than the first limit. Speed threshold, including:

Establishing a backend socket according to the address information and the port information of the next hop server, and establishing a connection between the backend socket and the next hop server, and the backend socket according to the first rate limit threshold The word sets the speed limit threshold.
The method according to claim 1 or 2, wherein the second rate limit threshold is placed in the request message in a GRP format, the GRP format is based on a binary stream, and the GRP format includes a header and And a data portion, the data portion including an option unit and an address unit, the second rate limiting threshold being placed in the option unit.
A network rate limiting method, where the rate limiting method is applied to a server, wherein the server is in communication with another at least one server, and the server is an egress server, and the method includes:

Receiving request messages sent by other servers;

Parsing the request packet to obtain a second rate limit threshold;

Setting a rate limit threshold according to the second rate limit threshold to the egress server, so that a data download rate passing the egress server is smaller than the second rate limit threshold.
The method of claim 4, wherein the method further comprises:

Open the fair queue;

And setting a rate limit threshold according to the second rate limit threshold, so that the data download rate of the egress server is smaller than the second rate limit threshold, including:

And setting a rate limit threshold according to the second rate limit threshold of the front end socket of the egress server.
A network rate limiting device, the device is applied to a server, and the server is in communication with another at least one server, wherein the server is used as an ingress server, and the device includes:

a first receiving module, configured to receive a request message sent by the client;

An acquiring module, configured to acquire communication path information of the request packet, and a first rate limit threshold and a second rate limit threshold;

a first setting module, configured to establish a connection with the next hop server according to the communication path information, and set a rate limit threshold according to the first rate limit threshold, so that a data upload rate of the portal server is less than The first speed limit threshold;

And a sending module, configured to add the second rate limit threshold to the request message, and send the request message to a next hop server.
The device according to claim 6, wherein the device further comprises:

a first opening module, configured to enable a fair queue;

The first setting module is specifically configured to:

Establishing a backend socket according to the address information and the port information of the next hop server, and establishing a connection between the backend socket and the next hop server, and the backend socket according to the first rate limit threshold The word sets the speed limit threshold.
The apparatus according to claim 6 or 7, wherein the second rate limit threshold is placed in the request message in a GRP format, the GRP format is based on a binary stream, and the GRP format includes a header and And a data portion, the data portion including an option unit and an address unit, the second rate limiting threshold being placed in the option unit.
A network speed limiting device, the speed limiting device is applied to a server, wherein the server is in communication connection with another at least one server, and the server serves as an egress server, and the device includes:

a second receiving module, configured to receive a request message sent by another server;

a parsing module, configured to parse the request packet to obtain a second rate limit threshold;

And a second setting module, configured to set a rate limit threshold according to the second rate limit threshold, so that a data download rate of the egress server is smaller than the second rate limit threshold.
The device according to claim 9, wherein the device further comprises:

a second opening module, configured to enable a fair queue;

The second setting module is specifically configured to:

And setting a rate limit threshold according to the second rate limit threshold of the front end socket of the egress server.
A server, comprising:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the method of any of claims 1-5 method.
A non-transitory computer readable storage medium, wherein the computer readable storage medium stores computer executable instructions that, when executed by a server, cause the server to execute an enforcement claim The method of any of 1-5.
A computer program product, comprising: a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a server, Having the server perform the method of any of claims 1-5.