CN116185755A - Data processing method and device for distributed load balancing system - Google Patents

Data processing method and device for distributed load balancing system Download PDF

Info

Publication number
CN116185755A
CN116185755A CN202211563498.3A CN202211563498A CN116185755A CN 116185755 A CN116185755 A CN 116185755A CN 202211563498 A CN202211563498 A CN 202211563498A CN 116185755 A CN116185755 A CN 116185755A
Authority
CN
China
Prior art keywords
health check
load balancing
health
server
sending
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211563498.3A
Other languages
Chinese (zh)
Inventor
吴纯波
谭杰丰
梁定根
陈文峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202211563498.3A priority Critical patent/CN116185755A/en
Publication of CN116185755A publication Critical patent/CN116185755A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3089Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Hardware Redundancy (AREA)

Abstract

The embodiment of the application provides a data processing method and device of a distributed load balancing system, which relate to the distributed field, and the method comprises the following steps: determining a health examination sending rate according to the load balancing server information and the background server information to be subjected to health examination; sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result; the method and the system can reduce the health check pressure of the distributed load balancing system on the back-end service system, provide a mode of automatic fusing degradation of the health check, and improve the overall operation stability and service processing capacity of the system.

Description

Data processing method and device for distributed load balancing system
Technical Field
The application relates to the field of distribution, in particular to a data processing method and device of a distributed load balancing system.
Background
The health check is classified into a deep health check and a non-deep health check. The non-deep health check only verifies the connectivity of the back-end server, so that the performance consumption is low, but the normal connectivity of the back-end server cannot ensure that the server can normally provide services. The deep health check can ensure that the back-end server with normal monitoring state can normally provide service, so that the application of the deep health check is wider and wider.
The current processing method for the distributed load balancing deep health examination is as follows: each load balancer in a load balancing cluster periodically performs health check on the back-end server cluster at fixed intervals, the health check generally adopts a mode of simulating a user request to confirm whether the back-end server can normally respond to the user request, and each health check time interval is in seconds. Since the health check policy configuration of all load balancing nodes under a cluster is statically consistent, all load balancing nodes will initiate health checks at the same point in time. If n load balancing nodes initiate health check at the same time, each server at the back end receives nQPS request pressure, so that a large number of health check requests cause considerable performance loss to the back end servers, and the capacity expansion of the load balancing clusters is limited.
Disclosure of Invention
Aiming at the problems in the prior art, the application provides a data processing method and device for a distributed load balancing system, which can transform deep health inspection into an asynchronous processing mode under the condition that the isolation effect and efficiency of load balancing health inspection are not affected, dynamically adjust the health inspection request of a load balancing node according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health inspection request and the like through a specific algorithm, reduce the health inspection pressure of the distributed load balancing system on a rear-end service system, provide a mode of automatic fusing degradation of the health inspection, and improve the overall operation stability and service processing capacity of the system.
In order to solve at least one of the above problems, the present application provides the following technical solutions:
in a first aspect, the present application provides a data processing method of a distributed load balancing system, including:
determining a health examination sending rate according to the load balancing server information and the background server information to be subjected to health examination;
and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
Further, the determining the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check includes:
determining a health check sending rate according to the number of background servers to be subjected to health check, a preset health check period and the average response time of the health check determined by historical data;
and determining the health check sending interval period of each load balancing server according to the health check sending rate and the number of the load balancing servers.
Further, the sending the health check signal to the corresponding background server according to the health check sending rate includes:
If the average response time of the health check does not exceed the interval period of the health check transmission, controlling each load balancing server to transmit a deep health check signal to all corresponding background servers according to the health check transmission rate;
and if the average response time of the health check exceeds the transmission interval period of the health check, judging that a fusing degradation mechanism is triggered, and controlling each load balancing server to transmit common health check signals to all corresponding background servers according to the transmission rate of the health check.
Further, the background server performs a health check according to the health check signal and returns a result of the health check, including:
asynchronously caching the health examination signals and sequentially executing corresponding health examination operations according to examination types corresponding to the health examination signals;
and asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.
Further, the determining the sending rate of the health check according to the number of the background servers to be subjected to the health check, the preset health check period and the average response time of the health check determined by the historical data includes:
And determining the sending rate of the health check according to the ratio of twice the number of the background servers to be subjected to the health check to the total time of the preset health check period and the average response time of the health check determined by the historical data.
Further, the determining a health check transmission interval period of each load balancing server according to the health check transmission rate and the number of load balancing servers includes:
and equally dividing the load balancing servers according to the set number of intervals, and determining the health check transmission interval period of each load balancing server after the equally dividing according to the health check transmission rate.
In a second aspect, the present application provides a distributed load balancing system data processing apparatus, including:
the checking rate determining module is used for determining the sending rate of the health check according to the information of the load balancing server and the information of the background server to be subjected to the health check;
and the server checking module is used for sending a health checking signal to a corresponding background server according to the health checking sending rate so that the background server executes health checking according to the health checking signal and returns a health checking result.
Further, the inspection rate determination module includes:
the rate determining unit is used for determining a health check sending rate according to the number of background servers to be subjected to health check, a preset health check period and the average response time of the health check determined by the historical data;
and the interval determining unit is used for determining the health check transmission interval period of each load balancing server according to the health check transmission rate and the number of the load balancing servers.
Further, the server inspection module includes:
the depth checking unit is used for controlling each load balancing server to send a depth health checking signal to all corresponding background servers according to the health checking sending rate if the average response time of the health checking does not exceed the health checking sending interval period;
and the common checking unit is used for judging to trigger a fusing degradation mechanism and controlling each load balancing server to send common health checking signals to all corresponding background servers according to the health checking sending rate if the average response time of the health checking exceeds the health checking sending interval period.
Further, the server inspection module further includes:
The request asynchronous caching unit is used for asynchronously caching the health examination signals and sequentially executing corresponding health examination operations according to examination types corresponding to the health examination signals;
and the result asynchronous caching unit is used for asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the distributed load balancing system data processing method when the program is executed.
In a fourth aspect, the present application provides a computer readable storage medium having stored thereon a computer program which when executed by a processor performs the steps of the distributed load balancing system data processing method.
In a fifth aspect, the present application provides a computer program product comprising computer programs/instructions which when executed by a processor implement the steps of the distributed load balancing system data processing method.
According to the technical scheme, the application provides a data processing method and device of a distributed load balancing system, and the sending rate of health examination is determined according to the information of a load balancing server and the information of a background server to be subjected to health examination; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, thereby being capable of modifying deep health check into an asynchronous processing mode and dynamically adjusting a health check request of a load balancing node according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check request and the like through a specific algorithm under the condition that the isolation effect and the efficiency of the load balancing health check are not affected, reducing the health check pressure of the distributed load balancing system on a rear-end service system, providing a mode of automatic fusing and degrading of the health check, and improving the overall operation stability and the service processing capability of the system.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a data processing method of a distributed load balancing system in an embodiment of the present application;
FIG. 2 is a second flow chart of a data processing method of the distributed load balancing system according to the embodiment of the present application;
FIG. 3 is a third flow chart of a data processing method of the distributed load balancing system according to the embodiment of the present application;
FIG. 4 is a flowchart of a data processing method of a distributed load balancing system according to an embodiment of the present application;
FIG. 5 is one of the block diagrams of a distributed load balancing system data processing apparatus in an embodiment of the present application;
FIG. 6 is a second block diagram of a distributed load balancing system data processing apparatus according to an embodiment of the present application;
FIG. 7 is a third block diagram of a distributed load balancing system data processing apparatus according to an embodiment of the present application;
FIG. 8 is a fourth block diagram of a distributed load balancing system data processing apparatus in an embodiment of the present application;
FIG. 9 is a block diagram of a distributed load balancing system data processing system in accordance with one embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device in an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.
In view of the problems existing in the prior art, the application provides a data processing method and device of a distributed load balancing system, which determine a health examination sending rate according to load balancing server information and background server information to be subjected to health examination; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
In order to reform deep health check into an asynchronous processing mode and dynamically adjust health check requests of load balancing nodes according to parameters such as the number of load balancing servers, the number of back-end servers, response time of health check requests and the like through a specific algorithm under the condition that the isolation effect and efficiency of the load balancing health check are not affected, health check pressure of the distributed load balancing system on a back-end service system is reduced, and a mode of automatic fusing degradation of the health check is provided, overall operation stability and service processing capacity of the system are improved, the embodiment of a distributed load balancing system data processing method is provided, and referring to fig. 1, the distributed load balancing system data processing method specifically comprises the following steps:
step S101: and determining the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check.
Optionally, in the present application, the health check sending frequency control module of the load balancing server dynamically calculates and controls the health check sending rate by configuring a health check period T and the number N of load balancing cluster servers in the module, dynamically obtaining the number M of background servers, and dynamically obtaining the average response time T of the health check in the response time processing module, where v=2m/(t+t) is determined by the number and average response time of the back-end servers, and at the same time, the sending interval period q= (t+t)/2M is equally divided according to the number N of load balancing servers, where each load balancing server configures a different integer number N (1 < = N), and the server initiates health check at the time of interval q×1-N/N.
In an embodiment of the present application, when T < T, it may be ensured that deep health inspection is initiated to all backend servers within a T period time, and health interval time is dynamically dispersed according to a rate, so that pressure of the backend servers at the same time is reduced.
In an embodiment of the present application, when T > =t, it cannot be guaranteed that deep health inspection is initiated to all backend servers within T cycle time, and then a fuse degradation mechanism is triggered to automatically degrade the deep health inspection mode to a normal port-based health inspection mode.
Step S102: and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
Optionally, in this application, the backend application server optimizes the health check processing module as an asynchronous processing mode, which initiates asynchronous health check independent of the health request trigger of the upstream load balancing server, but configures the health check mechanism initiation check according to the SV configuration module (refer specifically to the mechanism in the optimization of the load balancing server). And meanwhile, a new health check combination buffer module is added and used for storing health check results, and the health check results of the upstream load balancer are directly obtained from the buffer and returned. By means of the layered asynchronous decoupling health check model, the health check pressure of external dependent services is reduced as a whole. By analogy, the deep health examination pressure problem of multi-layer architecture nested calling under the distributed system can be solved.
As can be seen from the above description, the distributed load balancing system data processing method provided by the embodiments of the present application can determine the sending rate of health check according to the information of the load balancing server and the information of the background server to be subjected to health check; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
In an embodiment of the distributed load balancing system data processing method of the present application, referring to fig. 2, the following may be further specifically included:
step S201: and determining the sending rate of the health check according to the number of background servers to be subjected to the health check, a preset health check period and the average response time of the health check determined by the historical data.
Step S202: and determining the health check sending interval period of each load balancing server according to the health check sending rate and the number of the load balancing servers.
Optionally, in the present application, the health check sending frequency control module of the load balancing server dynamically calculates and controls the health check sending rate by configuring a health check period T and the number N of load balancing cluster servers in the module, dynamically obtaining the number M of background servers, and dynamically obtaining the average response time T of the health check in the response time processing module, where v=2m/(t+t) is determined by the number and average response time of the back-end servers, and at the same time, the sending interval period q= (t+t)/2M is equally divided according to the number N of load balancing servers, where each load balancing server configures a different integer number N (1 < = N), and the server initiates health check at the time of interval q×1-N/N.
In an embodiment of the distributed load balancing system data processing method of the present application, referring to fig. 3, the following may be further specifically included:
step S301: and if the average response time of the health check does not exceed the interval period of the health check transmission, controlling each load balancing server to transmit a deep health check signal to all corresponding background servers according to the health check transmission rate.
Step S302: and if the average response time of the health check exceeds the transmission interval period of the health check, judging that a fusing degradation mechanism is triggered, and controlling each load balancing server to transmit common health check signals to all corresponding background servers according to the transmission rate of the health check.
In an embodiment of the present application, when T < T, it may be ensured that deep health inspection is initiated to all backend servers within a T period time, and health interval time is dynamically dispersed according to a rate, so that pressure of the backend servers at the same time is reduced.
In an embodiment of the present application, when T > =t, it cannot be guaranteed that deep health inspection is initiated to all backend servers within T cycle time, and then a fuse degradation mechanism is triggered to automatically degrade the deep health inspection mode to a normal port-based health inspection mode.
In an embodiment of the distributed load balancing system data processing method of the present application, referring to fig. 4, the following may be further specifically included:
step S401: and asynchronously caching the health check signals and sequentially executing corresponding health check operations according to the check types corresponding to the health check signals.
Step S402: and asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.
Optionally, in this application, the backend application server optimizes the health check processing module as an asynchronous processing mode, which initiates asynchronous health check independent of the health request trigger of the upstream load balancing server, but configures the health check mechanism initiation check according to the SV configuration module (refer specifically to the mechanism in the optimization of the load balancing server). And meanwhile, a new health check combination buffer module is added and used for storing health check results, and the health check results of the upstream load balancer are directly obtained from the buffer and returned. By means of the layered asynchronous decoupling health check model, the health check pressure of external dependent services is reduced as a whole. By analogy, the deep health examination pressure problem of multi-layer architecture nested calling under the distributed system can be solved.
In order to reform deep health check into an asynchronous processing mode and dynamically adjust health check requests of load balancing nodes according to parameters such as the number of load balancing servers, the number of back-end servers, response time of health check requests and the like through a specific algorithm under the condition that the isolation effect and efficiency of the load balancing health check are not affected, reduce health check pressure of the health check of a distributed load balancing system on a back-end service system, provide a mode of automatic fusing degradation of the health check, improve overall operation stability and service processing capacity of the system, and provide an embodiment of a distributed load balancing system data processing device for realizing all or part of contents of a distributed load balancing system data processing method, referring to fig. 5, the distributed load balancing system data processing device specifically comprises the following contents:
The checking rate determining module 10 is configured to determine a sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check.
The server checking module 20 is configured to send a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes a health check according to the health check signal and returns a result of the health check.
As can be seen from the above description, the distributed load balancing system data processing apparatus provided in the embodiments of the present application can determine the health check transmission rate according to the load balancing server information and the background server information to be subjected to the health check; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
In one embodiment of the distributed load balancing system data processing apparatus of the present application, referring to fig. 6, the inspection rate determining module 10 includes:
the rate determining unit 11 is configured to determine a sending rate of the health check according to the number of background servers to be subjected to the health check, a preset health check period, and an average response time of the health check determined by the history data.
An interval determining unit 12, configured to determine a health check transmission interval period of each load balancing server according to the health check transmission rate and the number of load balancing servers.
In one embodiment of the distributed load balancing system data processing apparatus of the present application, referring to fig. 7, the server checking module 20 includes:
and the depth checking unit 21 is configured to control each load balancing server to send a depth health check signal to all corresponding background servers according to the health check sending rate if the average response time of the health check does not exceed the health check sending interval period.
And the common checking unit 22 is configured to determine to trigger a fusing degradation mechanism and control each load balancing server to send a common health check signal to all corresponding background servers according to the health check sending rate if the average response time of the health check exceeds the health check sending interval period.
In an embodiment of the distributed load balancing system data processing apparatus of the present application, referring to fig. 8, the server checking module 20 further includes:
the request asynchronous caching unit 23 is configured to asynchronously cache the health check signals and sequentially perform corresponding health check operations according to check types corresponding to the health check signals.
And the result asynchronous caching unit 24 is used for asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.
Referring to fig. 9, to further illustrate the present solution, the present application further provides a specific application example of implementing a data processing method of a distributed load balancing system by using the data processing device of a distributed load balancing system, which specifically includes the following contents:
(1) Load balancing server 100: the distributed load balancing server has inheritance composed of a plurality of servers and receives the load balancing routing capability of the back-end server.
LB configuring module 101: and the configuration function of the load balancing health checking strategy can configure a health checking period T, and the number N of the load balancing cluster servers can be automatically and dynamically updated according to the number of the load balancing clusters. While supporting configuration of the health check mode as deep health check or normal health check, and health check after automatic degradation as normal health check or no health check.
Health check transmission control module 102: the health check transmission rate may be controlled according to a specific algorithm based on the LB configuration module 101 and the response time processing module 105.
Health check request transmission module 103: according to the LB configuring module 101 and the sending rate controlling module 102, a health check for the backend server is sent.
Health check result processing module 104: and the method is responsible for receiving the health check processing result, carrying out matching processing, confirming whether the back-end service is normal or not, and isolating if the back-end service is abnormal.
Response time processing module 105: the latest M health examination request times are calculated to obtain a health examination platform response time t, and the parameters are transferred to the transmission control module 102.
(2) The backend server 200: the application server is responsible for processing application transaction requests and health check requests.
The health check receiving module 201: is responsible for receiving health check requests responsible for balancing servers.
Health check asynchronous processing module 202: according to the SV configuration module 205, health checks are initiated for the backend server itself and for external dependent services and the health check results are written to the check result cache module 203.
The inspection result caching module 203: the health check result for the back-end server is saved and provided to the health check return module call 204.
Health check return module 204: is responsible for returning the health check results to the load balancing server 100.
External dependency service 300: refers to external dependent services provided to the backend server 200, including third party services, database services, and the like.
(3) Third party dependent service 301: refers to a service that does not attribute back-end server functionality, but needs to be invoked by the back-end server.
Database service 302: refers to database services that need to be depended on and invoked in the running process of the back-end server.
The specific treatment process is as follows:
in step 301, the load balancing server is automatically and dynamically updated according to the number of load balancing servers through the health check period T and the number N of load balancing cluster servers in the LB configuration module 101.
Step 302 of the response time processing module 105 calculates the latest M health check request times to obtain the average response time t of the health check, and transmits the parameter to the transmission control module 102.
In step 303, the sending control module dynamically calculates and controls the sending rate of the health check through the configuration module 101, the number of the health check period T and the number of the load balancing cluster servers N, dynamically obtaining the number of the background servers M, and dynamically obtaining the average response time T of the health check in the response time processing module 105, wherein v=2m/(t+t) is determined by the number of the back-end servers and the average response time, and at the same time, the sending interval period q= (t+t)/2M is equally divided according to the number of the load balancing servers N, each load balancing server is configured with a different integer number N (1 < = N), and the server initiates the health check at the time of interval Q (1-N/N).
At this time, when T < T, it can be ensured that deep health check is initiated to all backend servers within T period time, and health interval time is dynamically dispersed according to the rate, so that the pressure of the backend servers at the same time is reduced. When T > =t, then a fuse degradation mechanism is triggered, automatically degrading the deep health check mode to a normal port-based health check mode.
Step 304 the health check request sending module 103 sends a health request to the backend server 200 according to the instruction of the sending control module 102.
In step 305, in the backend server, the health check asynchronous processing module 202 performs health check on the backend server itself already externally dependent on the service according to the health check configuration in the SV configuration module, and updates the health check result to the result buffer module 203 at regular time.
After the back-end server health check receiving module 201 receives the request, it proceeds to process through the health check returning module 204 in step 306.
Step 307 calls the checking result buffer module 203 to acquire the health checking result, and returns the health checking result to the health checking processing module 104 of the load balancing server 100.
Step 308, the health check processing module 104 processes the returned result, if abnormal, isolates the server, and if normal, continues to circulate to perform health check operation.
According to the method and the system, under the condition that the isolation effect and the efficiency of the load balancing health check are not affected, the deep health is modified into an asynchronous processing mode, the health check request of the load balancing node is dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers and the response time of the health check request through a specific algorithm, the health check pressure of the distributed load balancing system health check on the rear-end service system is reduced, the automatic fusing degradation mode of the health check is provided, and the overall operation stability and the service processing capacity of the system are improved.
In order to enable the deep health check to be modified into an asynchronous processing mode and the health check request of the load balancing node to be dynamically adjusted according to parameters such as the number of load balancing servers, the number of back-end servers, the response time of the health check request and the like through a specific algorithm under the condition that the isolation effect and the efficiency of the load balancing health check are not affected in terms of hardware level, the health check pressure of the health check of the distributed load balancing system on the back-end service system is reduced, the health check automatic fusing degradation mode is provided, the overall operation stability and the service processing capability of the system are improved, and the embodiment of the electronic equipment for realizing all or part of contents in the data processing method of the distributed load balancing system is provided, wherein the electronic equipment specifically comprises the following contents:
A processor (processor), a memory (memory), a communication interface (Communications Interface), and a bus; the processor, the memory and the communication interface complete communication with each other through the bus; the communication interface is used for realizing information transmission between the data processing device of the distributed load balancing system and related equipment such as a core service system, a user terminal, a related database and the like; the logic controller may be a desktop computer, a tablet computer, a mobile terminal, etc., and the embodiment is not limited thereto. In this embodiment, the logic controller may refer to an embodiment of the distributed load balancing system data processing method in the embodiment and an embodiment of the distributed load balancing system data processing apparatus, and the contents thereof are incorporated herein and are not repeated here.
It is understood that the user terminal may include a smart phone, a tablet electronic device, a network set top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. Wherein, intelligent wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..
In practical applications, part of the data processing method of the distributed load balancing system may be executed on the electronic device side as described above, or all operations may be completed in the client device. Specifically, the selection may be made according to the processing capability of the client device, and restrictions of the use scenario of the user. The present application is not limited in this regard. If all operations are performed in the client device, the client device may further include a processor.
The client device may have a communication module (i.e. a communication unit) and may be connected to a remote server in a communication manner, so as to implement data transmission with the server. The server may include a server on the side of the task scheduling center, and in other implementations may include a server of an intermediate platform, such as a server of a third party server platform having a communication link with the task scheduling center server. The server may include a single computer device, a server cluster formed by a plurality of servers, or a server structure of a distributed device.
Fig. 10 is a schematic block diagram of a system configuration of an electronic device 9600 of an embodiment of the present application. As shown in fig. 10, the electronic device 9600 may include a central processor 9100 and a memory 9140; the memory 9140 is coupled to the central processor 9100. Notably, this fig. 10 is exemplary; other types of structures may also be used in addition to or in place of the structures to implement telecommunications functions or other functions.
In one embodiment, the distributed load balancing system data processing method functions may be integrated into the central processor 9100. The central processor 9100 may be configured to perform the following control:
Step S101: and determining the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check.
Step S102: and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
As can be seen from the above description, the electronic device provided in the embodiments of the present application determines the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
In another embodiment, the distributed load balancing system data processing apparatus may be configured separately from the central processor 9100, for example, the distributed load balancing system data processing apparatus may be configured as a chip connected to the central processor 9100, and the distributed load balancing system data processing method function is implemented by control of the central processor.
As shown in fig. 10, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is noted that the electronic device 9600 need not include all of the components shown in fig. 10; in addition, the electronic device 9600 may further include components not shown in fig. 10, and reference may be made to the related art.
As shown in fig. 10, the central processor 9100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, which central processor 9100 receives inputs and controls the operation of the various components of the electronic device 9600.
The memory 9140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information about failure may be stored, and a program for executing the information may be stored. And the central processor 9100 can execute the program stored in the memory 9140 to realize information storage or processing, and the like.
The input unit 9120 provides input to the central processor 9100. The input unit 9120 is, for example, a key or a touch input device. The power supply 9170 is used to provide power to the electronic device 9600. The display 9160 is used for displaying display objects such as images and characters. The display may be, for example, but not limited to, an LCD display.
The memory 9140 may be a solid state memory such as Read Only Memory (ROM), random Access Memory (RAM), SIM card, etc. But also a memory which holds information even when powered down, can be selectively erased and provided with further data, an example of which is sometimes referred to as EPROM or the like. The memory 9140 may also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application/function storage portion 9142, the application/function storage portion 9142 storing application programs and function programs or a flow for executing operations of the electronic device 9600 by the central processor 9100.
The memory 9140 may also include a data store 9143, the data store 9143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by an electronic device. The driver storage portion 9144 of the memory 9140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging applications, address book applications, etc.).
The communication module 9110 is a transmitter/receiver 9110 that transmits and receives signals via an antenna 9111. A communication module (transmitter/receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, as in the case of conventional mobile communication terminals.
Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, etc., may be provided in the same electronic device. The communication module (transmitter/receiver) 9110 is also coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and to receive audio input from the microphone 9132 to implement usual telecommunications functions. The audio processor 9130 can include any suitable buffers, decoders, amplifiers and so forth. In addition, the audio processor 9130 is also coupled to the central processor 9100 so that sound can be recorded locally through the microphone 9132 and sound stored locally can be played through the speaker 9131.
The embodiments of the present application further provide a computer readable storage medium capable of implementing all the steps in the distributed load balancing system data processing method in which the execution subject in the above embodiment is a server or a client, where the computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements all the steps in the distributed load balancing system data processing method in which the execution subject in the above embodiment is a server or a client, for example, the processor implements the following steps when executing the computer program:
Step S101: and determining the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check.
Step S102: and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
As can be seen from the above description, the computer-readable storage medium provided in the embodiments of the present application determines a health check transmission rate by using load balancing server information and background server information to be subjected to health check; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
The embodiments of the present application further provide a computer program product capable of implementing all the steps in the distributed load balancing system data processing method in which the execution subject in the above embodiments is a server or a client, where the computer program/instructions implement the steps of the distributed load balancing system data processing method when executed by a processor, for example, the computer program/instructions implement the steps of:
step S101: and determining the sending rate of the health check according to the load balancing server information and the background server information to be subjected to the health check.
Step S102: and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
As can be seen from the above description, the computer program product provided in the embodiments of the present application determines a sending rate of health check by according to load balancing server information and background server information to be subjected to health check; and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result, and therefore, under the condition that the load balancing health check isolation effect and efficiency are not affected, deep health check can be modified into an asynchronous processing mode, health check requests of load balancing nodes are dynamically adjusted according to parameters such as the number of load balancing servers, the number of rear-end servers, the response time of the health check requests and the like through a specific algorithm, the health check pressure of a distributed load balancing system health check on a rear-end service system is reduced, and automatic fusing of the health check is provided.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The principles and embodiments of the present invention have been described in detail with reference to specific examples, which are provided to facilitate understanding of the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (10)

1. A method for processing data of a distributed load balancing system, the method comprising:
determining a health examination sending rate according to the load balancing server information and the background server information to be subjected to health examination;
and sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server executes health check according to the health check signal and returns a health check result.
2. The method for processing distributed load balancing system data according to claim 1, wherein determining the health check transmission rate according to the load balancing server information and the background server information to be subjected to the health check comprises:
determining a health check sending rate according to the number of background servers to be subjected to health check, a preset health check period and the average response time of the health check determined by historical data;
and determining the health check sending interval period of each load balancing server according to the health check sending rate and the number of the load balancing servers.
3. The method for processing data of a distributed load balancing system according to claim 1, wherein the sending a health check signal to a corresponding background server according to the health check sending rate includes:
If the average response time of the health check does not exceed the interval period of the health check transmission, controlling each load balancing server to transmit a deep health check signal to all corresponding background servers according to the health check transmission rate;
and if the average response time of the health check exceeds the transmission interval period of the health check, judging that a fusing degradation mechanism is triggered, and controlling each load balancing server to transmit common health check signals to all corresponding background servers according to the transmission rate of the health check.
4. The distributed load balancing system data processing method according to claim 1, wherein the background server performs a health check according to the health check signal and returns a result of the health check, comprising:
asynchronously caching the health examination signals and sequentially executing corresponding health examination operations according to examination types corresponding to the health examination signals;
and asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.
5. The method for processing distributed load balancing system data according to claim 2, wherein the determining the health check transmission rate according to the number of background servers to be health checked, a preset health check period, and the health check average response time determined by the history data comprises:
And determining the sending rate of the health check according to the ratio of twice the number of the background servers to be subjected to the health check to the total time of the preset health check period and the average response time of the health check determined by the historical data.
6. The method for processing distributed load balancing system data according to claim 2, wherein determining a health check transmission interval period of each load balancing server according to the health check transmission rate and the number of load balancing servers comprises:
and equally dividing the load balancing servers according to the set number of intervals, and determining the health check transmission interval period of each load balancing server after the equally dividing according to the health check transmission rate.
7. A distributed load balancing system data processing apparatus, comprising:
the checking rate determining module is used for determining the sending rate of the health check according to the information of the load balancing server and the information of the background server to be subjected to the health check;
and the server checking module is used for sending a health checking signal to a corresponding background server according to the health checking sending rate so that the background server executes health checking according to the health checking signal and returns a health checking result.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the distributed load balancing system data processing method of any one of claims 1 to 6 when the program is executed by the processor.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the distributed load balancing system data processing method of any one of claims 1 to 6.
10. A computer program product comprising computer programs/instructions which when executed by a processor implement the steps of the distributed load balancing system data processing method of any one of claims 1 to 6.
CN202211563498.3A 2022-12-07 2022-12-07 Data processing method and device for distributed load balancing system Pending CN116185755A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211563498.3A CN116185755A (en) 2022-12-07 2022-12-07 Data processing method and device for distributed load balancing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211563498.3A CN116185755A (en) 2022-12-07 2022-12-07 Data processing method and device for distributed load balancing system

Publications (1)

Publication Number Publication Date
CN116185755A true CN116185755A (en) 2023-05-30

Family

ID=86435357

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211563498.3A Pending CN116185755A (en) 2022-12-07 2022-12-07 Data processing method and device for distributed load balancing system

Country Status (1)

Country Link
CN (1) CN116185755A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116962247A (en) * 2023-08-01 2023-10-27 北京志凌海纳科技有限公司 Active health check method, device, equipment and medium in load balancing system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116962247A (en) * 2023-08-01 2023-10-27 北京志凌海纳科技有限公司 Active health check method, device, equipment and medium in load balancing system
CN116962247B (en) * 2023-08-01 2024-02-09 北京志凌海纳科技有限公司 Active health check method, device, equipment and medium in load balancing system

Similar Documents

Publication Publication Date Title
CN111031058A (en) Websocket-based distributed server cluster interaction method and device
CN113055479A (en) Self-adaptive processing method, device and system for distributed service cluster load
CN111767558B (en) Data access monitoring method, device and system
CN111953785B (en) Data transmission method, system and server
CN113055483A (en) Message middleware data processing method, device and system
CN111338905A (en) Application node data processing method and device
CN111371695B (en) Service flow limiting method and device
CN116185755A (en) Data processing method and device for distributed load balancing system
CN112689012A (en) Cross-network proxy communication method and device
CN114257532B (en) Method and device for detecting state of server
EP4262254A1 (en) Communication method and apparatus, terminal device, and storage medium
CN108513320B (en) Method and device for coding and decoding negotiation
CN111782366A (en) Distributed task scheduling method and device
CN115562898A (en) Distributed payment system exception handling method and device
CN111930624A (en) Test link message data processing method and device
CN114374614B (en) Network topology configuration method and device
CN114697339A (en) Load balancing method and device under centralized architecture
CN115834649A (en) Remote procedure calling method, device and system
CN115880067A (en) Transaction abnormal data processing method and device
CN113808376B (en) Self-service teller machine equipment safety monitoring method and device
CN115412610A (en) Flow scheduling method and device under fault scene
CN114710496A (en) Multi-node load balancing method and device
CN113052691A (en) Distributed account checking system service balancing method, node and cluster
CN113342501B (en) System fault processing method and device
CN111737299A (en) Cache data processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination