WO2021083281A1

WO2021083281A1 - Load balancing method and apparatus, and medium and device

Info

Publication number: WO2021083281A1
Application number: PCT/CN2020/124872
Authority: WO
Inventors: 李逸骏
Original assignee: 贵州白山云科技股份有限公司
Priority date: 2019-10-31
Filing date: 2020-10-29
Publication date: 2021-05-06
Also published as: CN112751897A; CN112751897B

Abstract

Disclosed are a load balancing method and apparatus, and a medium and a device. The load balancing method comprises: a second load balancer receiving a request message of a client that is forwarded by a first load balancer; establishing a connection with the client, and generating extended information; parsing the request message of the client, and determining a service server on the basis of a set load balancing rule; and sending the request message of the client and the extended information to the determined service server. By means of the method of the present application, a second load balancer can realize fine load scheduling by means of consuming fewer bandwidth resources, which is more convenient for the mixed deployment of a load balancer and a service server, thereby reducing the loss of a network card bandwidth caused by the mixed deployment.

Description

Load balancing method, device, medium and equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 201911050205.X, and the invention title is "load balancing method, device, medium and equipment" on October 31, 2019, the entire content of which is incorporated by reference In this application.

Technical field

This article relates to the field of network communication technology, in particular to load balancing methods, devices, media, and equipment.

Background technique

In related technologies, the existing 7-layer load balancing schemes all require the load balancer to provide a forwarding function, which causes the load balancer to have a higher load and consume more resources. At the same time, if the load balancer and business server are deployed in a mixed manner, it will cause additional bandwidth consumption for the network card.

Summary of the invention

In order to overcome the problems in related technologies, this article provides a load balancing method, device, medium and equipment.

According to the first aspect of this article, a load balancing method is provided, including:

Receiving the request message of the client forwarded by the first load balancer;

Establish a connection with the client and generate extended information;

Parse the request message of the client, and determine the service server based on the set load balancing rule;

Send the client's request message and extended information to the determined service server.

When the determined service server and the second load balancer are separately deployed on different servers, the load balancing method further includes:

After the request message and extended information of the client are sent to the determined service server, the related data information when connecting with the client is cleared.

If the determined service server is the local server, and when the request message of the client forwarded by the first load balancer is different request messages in the same connection, the request message is parsed based on the set Load balancing rules determine the business server.

The extended information includes:

The relevant information contained in the protocol used for the connection with the client, and the information required by the service server to parse and respond to the request message.

Load balancing methods are applied to business servers, including:

Obtain the client's request message and extended information;

Based on the extended information, process the request message, generate a response message, and send the response message to the client.

When the service server and the second load balancer are separately deployed on different servers, the load balancing method further includes:

Sending the migration notification information to the first load balancer;

Receive the client's request message sent by the first load balancer.

The load balancing method is applied to the first load balancer and includes:

Receive the client's request message;

Forward the request message to the second load balancer;

Receive the service migration notification sent by the service server;

Forward the request message of the client to the service server.

According to another aspect of this article, a load balancing device is provided, which is applied to a second load balancer and includes:

The second receiving module is configured to receive the request message of the client forwarded by the first load balancer;

The connection module is used to establish a connection with the client and generate extended information;

The balance module is used to parse the request message of the client, and determine the service server based on the set load balancing rule;

The second forwarding module is used to forward the request message and connection information of the terminal to the determined service server.

When the determined service server and the second load balancer are respectively deployed on different servers, the second sending module is further configured to:

After sending the client's request message and extended information to the determined service server, the related data information when connecting with the client is cleaned up.

The extended information includes:

The load balancing device is applied to the business server, including:

The third receiving module is used to obtain the client's request message and extended information;

The response module is configured to process the request message based on the connection information, and generate a response message; and send the response message to the client.

When the service server and the second load balancer are respectively deployed on different servers, the load balancing device further includes:

The sending module is used to send the migration notification information to the first load balancer.

The load balancing device is applied to the first load balancer and includes:

The first receiving module is used to receive a request message from the client;

The first forwarding module is configured to forward the request message to the second load balancer;

The migration notification receiving module is used to receive the business migration notification sent by the business server;

The migration module is used to forward the request message of the client to the service server.

According to another aspect of this document, there is provided a computer-readable storage medium with a computer program stored thereon, which implements the steps of the load balancing method when the computer program is executed.

According to another aspect of this document, a computer device is provided, including a processor, a memory, and a computer program stored on the memory, and the processor implements the steps of the load balancing method when the computer program is executed by the processor.

By setting the first load balancer and the second load balancer, this article can realize that the second load balancer consumes less bandwidth resources, and can achieve fine load scheduling, which is more convenient for the mixed deployment of load balancers and business servers, and reduces Hybrid deployment consumes the bandwidth of the network card, and at the same time, the service server sends the response message directly to the client, reducing the burden of the load balancer.

Description of the drawings

The drawings described here are used to provide a further understanding of the embodiments of the present invention and constitute a part of this application. The schematic embodiments of the embodiments of the present invention and their descriptions are used to explain the embodiments of the present invention, and do not constitute an example of the embodiments of the present invention. Improper qualification. In the attached picture:

Fig. 1 is a flow chart showing a load balancing method according to an exemplary embodiment.

Fig. 2 is a flow chart showing a load balancing method according to an exemplary embodiment.

Fig. 3 is a flow chart showing a load balancing method according to an exemplary embodiment.

Fig. 4 is a schematic diagram showing a load balancing according to an exemplary embodiment.

Fig. 5 is a block diagram showing a load balancing device according to an exemplary embodiment.

Fig. 6 is a block diagram showing a load balancing device according to an exemplary embodiment.

Fig. 7 is a block diagram showing a load balancing device according to an exemplary embodiment.

Fig. 8 is a block diagram showing a load balancing device according to an exemplary embodiment.

Fig. 9 is a block diagram showing a computer device according to an exemplary embodiment.

Detailed ways

The embodiments of the present invention will now be further described with reference to the drawings and specific implementations.

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments They are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention. It should be noted that the embodiments in this application and the features in the embodiments can be combined with each other arbitrarily if there is no conflict.

In the load balancing method in this article, the first load balancer is set to receive client requests, and according to certain load balancing rules, such as the address location of the second load balancer, the load level of the second load balancer, and the client request Forward to the second load balancer. In this article, the first load balancer can be a 4-layer load balancer, which can meet the usage requirements. You can also choose other types of load balancers, but do not balance the content. The specific type of load balancer is not limited in this article. The second load balancer parses the client's request, determines the result of load balancing according to the content of the business message or other factors, determines the specific business server, and implements fine load scheduling. The determined business server performs the client's request response.

Fig. 1 is a flow chart showing a load balancing method according to an exemplary embodiment. Referring to Figure 1, the load balancing method applied to the second load balancer includes:

Step S11, receiving the request message of the client forwarded by the first load balancer;

Step S12, establishing a connection with the client to generate extended information;

Step S13, parse the request message of the client, and determine the service server based on the set load balancing rule;

Step S14: Send the client's request message and extended information to the determined service server.

In this embodiment, after receiving the request message of the client forwarded by the first load balancer, the second load balancer first establishes a connection with the client, and generates extension information related to the connection. Analyze the client’s request message, integrate the client’s IP, service server load, the resource distribution and type of the service request, and the configuration of the load balancer to determine the service server used to respond to the client’s request message. The request message and extended information are sent to the determined service server. When the second load balancer sends the client's request message, it will also organize the message content, such as deleting duplicate messages, deleting useless messages in the handshake process with the client, and only parses the business server and responds to the client The requested message is sent to the service server to reduce resource consumption as much as possible.

In order to improve the load balancing effect, the business balancer can be deployed with the business server, that is, the business balancer and the business server are the same server. When the business balancer and the business server are deployed together, the business balancer uses ordinary HTTP proxy forwarding or TCP proxy Forwarding, shared memory, etc., forward the client request to the local business server for processing.

In an embodiment, if the service balancer and the service server are separately deployed, that is, when the service balancer and the service server are separately deployed on different servers, the load balancing method further includes: sending the client's request message and the extended information to a certain After the business server, clean up the relevant data information when connecting with the client. In this embodiment, the operating environment where the load balancer and the business server are located are not the same, for example, they run on different cores, or run in an isolated environment. Due to different operating environments, the data related to the client connection cannot be shared. Therefore, after sending the client's request message and extended information to the determined service server, the load balancer needs to clean up the related data information when connecting with the client. After the second load balancer sends the client's request message and extended information to the determined service server, the service server can parse and respond to the client request according to the extended information, and send the response message directly to the client, and the response message It is no longer forwarded by the second load balancer, and at the same time, the service server will send a service migration notification to the first load balancer, and subsequent request packets of the client will no longer be processed by the second load balancer. Therefore, in this embodiment, the second load balancer cleans up related data generated when connecting with the client in time, so as to improve the performance of the second load balancer.

In an embodiment, if the determined service server is the local server, and the request message from the client forwarded by the first load balancer is received as different request messages in the same connection, the request message is parsed based on the set Load balancing rules determine the business server. After the second load balancer establishes a connection with the client, there may be multiple request packets in the same connection at the same time. The second load balancer determines that the local server responds according to the client's request packet and receives the same When connecting subsequent messages, it does not directly forward all other request messages in the connection to the local server for processing. Instead, it re-determines the service server according to the content of each message, so that the same client is the same The request messages with different contents in the connection are sent to different service servers, and the suitable service server processes the different requests of the client to improve the quality of service.

In an embodiment, the extended information includes: relevant information included in the protocol used for the connection with the client, and the information required by the service server to parse and respond to the request message.

The relevant information contained in the protocol used for the connection with the client can be the parameters negotiated when the load balancer establishes a connection with the client, the configuration information of the load balancer, and the connection status between the load balancer and the client; when the client's request message is HTTPS The message also includes one or more of the status information of the TLS encrypted tunnel established between the load balancer and the client. Of course, in special circumstances, it may also include other information. The information required by the service server to parse and respond to the request message may be client address information and first load balancer address information in order to send a migration notification to the first load balancer and send a response message to the client. In the load balancing method of this article, the above information is some of the necessary information for the business server, but not all of them. In the load balancing method herein, the second load balancer establishes a connection with the client. In order to enable the service server to respond to the client's request, the second load balancer needs to send relevant information when establishing a connection with the client to the service server. The business server parses the client's request message according to the parameters negotiated when the second load balancer establishes a connection with the client, responds to the client's request, and sends the response message to the client according to the client's address information. If the client's request message is an HTTPS message, the load balancer establishes a TLS encrypted tunnel with the client. Therefore, the extended information will also include the state information of the encrypted tunnel, such as the encryption key. The business server uses the encryption key. You can parse the client's encrypted request. At the same time, the address information of the client and the address information of the first load balancer should also be sent to the service server, so that the service server can send a service migration notification to the first load balancer and send a response message to the client.

Fig. 2 is a flow chart showing a load balancing method according to an exemplary embodiment. Referring to Figure 2, the load balancing method is applied to the business server, including:

Step S21: Obtain the client's request message and extended information;

Step S22, processing the request message based on the extended information, and generating a response message;

Step S23: Send a response message to the client.

In this embodiment, the service server obtains the client's request message and extended information. The extended information is connection-related information generated when the second load balancer establishes a connection with the client, and is used to parse the client request. The service server processes the request message, and the generated corresponding message is no longer sent to the second load balancer, nor does it need to be sent to the first load balancer, but directly sent to the client to reduce the second load balancer and the first load The resource consumption of the equalizer.

In an embodiment, if the service server and the second load balancer are deployed on different servers, the load balancing method further includes:

Send the migration notification information to the first load balancer; receive the client's request message sent by the first load balancer. Notify the first load balancer that the service server has been determined according to the load balancing rules, and the client's request does not need to be sent to the second load balancer, but can be sent directly to the service server, and the service server responds to the client's request. Further reduce the resource consumption of the second load balancer.

After the service server completes a set of interactions, it can disconnect from the client and notify the first load balancer, or send the connection back to the first load balancer. When another client request message arrives for the connection, According to the above steps, the request message is sent to the second load balancer, and the second load balancer determines the specific service server to provide services according to the parsed content.

Fig. 3 is a flow chart showing a load balancing method according to an exemplary embodiment. Referring to FIG. 3, the load balancing method applied to the first load balancer includes:

Step S31, receiving a request message from the client;

Step S32, forward the request message to the second load balancer;

Step S33, receiving a service migration notification sent by the service server;

Step S34, forward the request message of the client to the service server.

In this embodiment, the first load balancer is responsible for receiving client requests, forwarding the client requests to the second load balancer, and does not parse the client requests, and is not responsible for further load balancing for content.

When the second load balancer determines the business server according to the balance result, if the business server and the second load balancer are deployed on different servers, the business server will send a business migration notification to the first load balancer, and the first load balancer will receive After the service migration notification, the client's request message will be directly forwarded to the service server instead of being sent to the second load balancer, reducing resource consumption in the system.

In order to better understand the load balancing method in this article, give an example:

Specific embodiments, Fig. 4 is a schematic diagram showing a load balancing according to an exemplary embodiment. As shown in Figure 4, the first load balancer is set up, and after receiving the client's request message, it is forwarded to the second load balancer, and the second load balancer establishes a connection with the client, and parses the content of the client's request message , And according to the message content and preset load balancing rules, determine the business server, and send the client's request message and connection-related extended information to the business server. After receiving the request message and extended information of the client, the service server sends a service migration notification to the first load balancer to notify the first load balancer to forward the client's subsequent request message to the service server. The business server responds to the client's request based on the extended information, and sends the response information directly to the client.

To sum up, through the load balancing method in this article, the response message is sent directly to the client by the business server, and the second load balancer consumes less bandwidth resources, which can achieve fine load scheduling, which is more convenient for the load balancer and The hybrid deployment of business servers reduces the loss of network card bandwidth caused by hybrid deployment.

Fig. 5 is a block diagram showing a load balancing device according to an exemplary embodiment. Referring to FIG. 5, the load balancing device is applied to the second load balancer, and includes a second receiving module 501, a connecting module 502, a balancing module 503, and a second forwarding module 504.

The second receiving module 501 is configured to receive the request message of the client forwarded by the first load balancer.

The connection module 502 is configured to establish a connection with the client and generate extended information.

The balancing module 503 is configured to parse the request message of the client, and determine the service server based on the set load balancing rule.

The second forwarding module 504 is configured to forward the request message and connection information of the terminal to a determined service server.

The second forwarding module 504 is also used to clean up related data information when connecting with the client after sending the client's request message and extended information to the determined service server.

For example, the determined business server is the local server, and when the client's request message forwarded by the first load balancer is received as a different request message in the same connection, the request message is parsed, and the business is determined based on the set load balancing rules. server.

The extended information includes:

Fig. 6 is a block diagram showing a load balancing device according to an exemplary embodiment. Referring to FIG. 6, the load balancing device is applied to a service server, and includes a third receiving module 601 and a response module 602.

The third receiving module 601 is configured to obtain the request message and extended information of the client.

The response module 602 is configured to process the request message based on the connection information, generate a response message, and send the response message to the client.

Fig. 7 is a block diagram showing a load balancing device according to an exemplary embodiment. Referring to FIG. 7, when the service server and the second load balancer are respectively deployed on different servers, the load balancing apparatus further includes a sending module 701.

The sending module 701 is configured to send migration notification information to the first load balancer.

Fig. 8 is a block diagram showing a load balancing device according to an exemplary embodiment. Referring to FIG. 8, the load balancing device is applied to the first load balancer, and includes a first receiving module 801, a first forwarding module 802, a migration notification receiving module 803, and a migration module 804.

The first receiving module 801 is configured to receive a request message from the client.

The first forwarding module 802 is configured to forward the request message to the second load balancer.

The migration notification receiving module 803 is configured to receive the service migration notification sent by the service server.

The migration module 804 is configured to forward the request message of the client to the service server.

Regarding the device in the foregoing embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and detailed description will not be given here.

Fig. 9 is a block diagram showing a computer device 900 according to an exemplary embodiment. For example, the computer device 900 may be provided as a server. 9, the computer device 900 includes a processor 901, and the number of processors can be set to one or more as required. The computer device 900 further includes a memory 902 for storing instructions executable by the processor 901, such as application programs. The number of memories can be set to one or more as required. The stored application program can be one or more. The processor 901 is configured to execute instructions to perform the load balancing method.

Those skilled in the art should understand that the embodiments herein can be provided as a method, an apparatus (equipment), or a computer program product. Therefore, this specification may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this document may take the form of a computer program product implemented on one or more computer-usable storage media containing computer-usable program codes. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data) , Including but not limited to RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or can be used for Any other medium that stores desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media usually contain computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery media. .

This document is described with reference to flowcharts and/or block diagrams of methods, apparatuses (equipment) and computer program products according to the embodiments of this document. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram

These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

In this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that an article or device that includes a series of elements includes not only those elements, but also other elements that are not explicitly listed. Elements, or also include elements inherent to such items or equipment. If there are no more restrictions, the element defined by the sentence "including..." does not exclude the existence of another same element in the article or equipment that includes the element.

Although the preferred embodiments herein have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of this document.

Obviously, those skilled in the art can make various changes and modifications to this article without departing from the spirit and scope of this article. In this way, if these modifications and variations of this article fall within the scope of the claims of this article and their equivalent technologies, the intent of this article also includes these modifications and variations.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention, but not to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or equivalently replace some of the technical features; and these Modification or replacement does not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Industrial applicability

The embodiment of the present invention provides a method and device for load balancing. The second load balancer receives the client's request message forwarded by the first load balancer; establishes a connection with the client and generates extended information; parses the client's request message, and determines the service based on the set load balancing rules Server; sending the client's request message and extended information to the determined service server. Consuming less bandwidth resources, you can achieve fine load scheduling, which is more convenient for the hybrid deployment of load balancers and business servers, and reduces the loss of network card bandwidth due to hybrid deployment.

Claims

A load balancing method applied to a second load balancer, characterized in that it includes:

Receiving the request message of the client forwarded by the first load balancer;

Establish a connection with the client and generate extended information;

Parse the request message of the client, and determine the service server based on the set load balancing rule;

Send the client's request message and extended information to the determined service server.
The load balancing method according to claim 1, wherein when the determined service server and the second load balancer are deployed on different servers, the load balancing method further comprises:

After sending the request message and extended information of the client to the determined service server, the related data information when connecting with the client is cleared.
The load balancing method of claim 1, wherein:

If the determined service server is the local server, and when the request message of the client forwarded by the first load balancer is different request messages in the same connection, the request message is parsed based on the set Load balancing rules determine the business server.
The load balancing method according to any one of claims 1-3, wherein the extended information includes: related information contained in the protocol used for the connection with the client, and the service server needs to analyze and respond to the request Information.
A load balancing method applied to a business server, which is characterized in that it includes:

Obtain the client's request message and extended information;

Based on the extended information, process the request message, generate a response message, and send the response message to the client.
5. The load balancing method of claim 5, wherein when the service server and the second load balancer are deployed on different servers, the load balancing method further comprises:

Sending the migration notification information to the first load balancer;

Receiving a client request message sent by the first load balancer.
A load balancing method applied to a first load balancer, characterized in that it includes:

Receive the client's request message;

Forward the request message to the second load balancer;

Receive the service migration notification sent by the service server;

Forward the request message of the client to the service server.
A load balancing device applied to a second load balancer, characterized in that it comprises:

The second receiving module is configured to receive the request message of the client forwarded by the first load balancer;

The connection module is used to establish a connection with the client and generate extended information;

The balance module is used to parse the request message of the client, and determine the service server based on the set load balancing rule;

The second forwarding module is used to forward the request message and connection information of the terminal to the determined service server.
8. The load balancing device according to claim 8, wherein when the determined service server and the second load balancer are respectively deployed on different servers, the second sending module is further configured to:

After sending the request message and extended information of the client to the determined service server, the related data information when connecting with the client is cleared.
The load balancing transposition according to claim 8, wherein, if the determined service server is a local server, the client request packets forwarded by the first load balancer are the same When different request messages in the connection are connected, the request message is parsed, and the service server is determined based on the set load balancing rule.
10. The load balancing device according to any one of claims 8-10, wherein the extended information comprises:

The relevant information contained in the protocol used for the connection with the client, and the information required by the service server to parse and respond to the request message.
A load balancing device applied to a business server, which is characterized in that it includes:

The third receiving module is used to obtain the client's request message and extended information;

The response module is configured to process the request message based on the connection information, and generate a response message; and send the response message to the client.
11. The load balancing device of claim 12, wherein when the service server and the second load balancer are deployed on different servers, the load balancing device further comprises:

The sending module is used to send the migration notification information to the first load balancer.
A load balancing device applied to a first load balancer, characterized in that it comprises:

The first receiving module is used to receive a request message from the client;

The first forwarding module is configured to forward the request message to the second load balancer;

The migration notification receiving module is used to receive the business migration notification sent by the business server;

The migration module is used to forward the request message of the client to the service server.
A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the method according to any one of claims 1-7 when the computer program is executed.
A computer device, comprising a processor, a memory, and a computer program stored on the memory, wherein the processor implements the method according to any one of claims 1-7 when the processor executes the computer program step.