CN111953567A - A method, system, device and medium for configuring parameters of multi-cluster management software - Google Patents

Abstract

The invention discloses a method, system, device and storage medium for configuring parameters of multi-cluster management software. The method includes: in response to receiving a client request, collecting indicators corresponding to the request from middleware of multi-cluster management software; The time series database obtains the data of the indicators, and saves the data to the data table corresponding to the time series database; obtains the proportion of various requests in a cycle according to the data table, and obtains the proportion table of requested resources based on the proportion; The proportion table dynamically adjusts the usage priority of the requested resources, and adjusts the interval length of timed collection according to the usage priority. According to the analysis request resource ratio, the present invention dynamically adjusts the system resource use priority according to the ratio, thereby improving the system response efficiency.

Description

A method, system, device and medium for configuring parameters of multi-cluster management software

technical field

The present invention relates to the field of cluster management, and more particularly, to a method, system, computer equipment and readable medium for configuring parameters of multi-cluster management software.

Background technique

In the era of cloud computing, mass data is usually stored in cluster systems. In order to meet different needs, customers usually configure multiple cluster systems. Generally, each cluster system will provide corresponding management software. When multiple cluster systems are introduced , log in to multiple cluster management software to check the running status of the cluster system, which is inconvenient to manage the cluster system. Usually, customers will introduce multi-cluster management software on site for multi-cluster management.

The architectural process of multi-cluster management software is generally that users log in to the system, issue query requests, and after receiving requests in the background, traverse and retrieve relevant data tables from the middleware database, obtain data, and return to the user. The middleware can be understood as a data acquisition module. The data acquisition module creates multiple data acquisition timers according to functional scenarios. The data acquisition timers collect data from the cluster system regularly and store them in the time series database of the multi-cluster management software server. The time series database cyclically covers the storage. When a polling point is reached, the data to be covered is pushed to the middleware database. The polling time is positively related to the managed cluster size and the number of clusters. This architecture can directly retrieve stored data from the middleware database, can respond to customer requests extremely quickly, and improve user satisfaction. The background data is collected from the storage and pushed to the middleware database at regular intervals. Even if there is a delay, the impact can be ignored. However, this kind of framework regularly collects the interval, and the data polling interval is determined by the programmer after a lot of testing, and the scenarios designed by the programmer cannot take into account all scenarios. Timed data polling interval. The data polling interval does not necessarily meet the actual usage scenario.

SUMMARY OF THE INVENTION

In view of this, the purpose of the embodiments of the present invention is to propose a method, system, computer equipment and computer-readable storage medium for configuring parameters of multi-cluster management software, by obtaining the proportion of various requests in a cycle, and analyzing the requested resources proportion, so that the priority of system resource usage can be dynamically adjusted according to the proportion, which can adapt to different scenarios and improve the system response efficiency.

Based on the above purpose, one aspect of the embodiments of the present invention provides a method for configuring parameters of multi-cluster management software, including the following steps: in response to receiving a client request, collecting indicators corresponding to the request from the middleware of the multi-cluster management software ; Obtain the data of the indicator from the time series database based on the middleware, and save the data to the data table corresponding to the time series database; Obtain the proportion of various requests in a cycle according to the data table, Obtaining a requested resource ratio table based on the ratio; and dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table, and adjusting the interval length of timing collection according to the usage priority.

In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.

In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.

In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource.

In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection.

In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.

In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.

Another aspect of the embodiments of the present invention further provides a system for configuring parameters of multi-cluster management software, including: a first collection module, configured to collect the information from the middleware of the multi-cluster management software in response to receiving a client request. requesting a corresponding indicator; a second collection module, configured to obtain data of the indicator from a time series database based on the middleware, and save the data to a data table corresponding to the time series database; a proportion module, be configured to obtain the ratio of various requests in a cycle according to the data table, and obtain a request resource ratio table based on the ratio; and an adjustment module, configured to dynamically adjust the request according to the request resource ratio table The usage priority of the resource, and the interval length of the timing collection is adjusted according to the usage priority.

In yet another aspect of the embodiments of the present invention, there is also provided a computer device, comprising: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor. The processor implements the steps of the above method when executed.

In yet another aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, where the computer-readable storage medium stores a computer program that implements the above method steps when executed by a processor.

The invention has the following beneficial technical effects: by obtaining the proportions of various requests in a cycle, and analyzing the proportions of requested resources, the system resource usage priority can be dynamically adjusted according to the proportions, which can adapt to different scenarios and improve system response efficiency.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can also be obtained according to these drawings without creative efforts.

1 is a schematic diagram of an embodiment of a method for configuring multi-cluster management software parameters provided by the present invention;

2 is a schematic diagram of interaction between a user and multi-cluster management software provided by the present invention;

3 is a schematic diagram of the middleware of the multi-cluster management software provided by the present invention collecting and storing indicators of clusters to be monitored;

4 is a schematic diagram of the interaction between the monitoring module provided by the present invention and the multi-cluster management software;

FIG. 5 is a schematic diagram of a hardware structure of an embodiment of a computer device for configuring multi-cluster management software parameters provided by the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the specific embodiments and the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities with the same name but not the same or non-identical parameters. It can be seen that "first" and "second" It is only for the convenience of expression and should not be construed as a limitation to the embodiments of the present invention, and subsequent embodiments will not describe them one by one.

Based on the above objective, in the first aspect of the embodiments of the present invention, an embodiment of a method for configuring multi-cluster management software parameters is provided. FIG. 1 shows a schematic diagram of an embodiment of a method for configuring multi-cluster management software parameters provided by the present invention. As shown in Figure 1, the embodiment of the present invention includes the following steps:

S1. In response to receiving the client request, collect the indicators corresponding to the request from the middleware of the multi-cluster management software;

S2. Obtain the indicator data from the time series database based on the middleware, and save the data to the data table corresponding to the time series database;

S3. Obtain the proportion of various requests in a cycle according to the data table, and obtain the proportion of requested resources based on the proportion; and

S4. Dynamically adjust the use priority of the requested resource according to the request resource ratio table, and adjust the interval duration of the regular collection according to the use priority.

The embodiment of the present invention monitors and collects system performance parameters such as CPU, memory, cache ratio, disk IOPS (number of reads and writes per second), and read and write delays of multi-cluster management software, monitors the delivery time of each request, and monitors the delivery time of each request. The database obtains the single-cluster moment corresponding to the request, and calculates the delay between the presentation of data on the multi-cluster software interface and the actual presentation of the single-cluster. When the above indicators reach one collection period, the monitoring module of the present invention performs data analysis, and after analysis, obtains the proportion of each request of the user, the delay difference between the display time of each request and the actual value of the cluster, and the proportion of each request to the system performance resources, which will be as above. The data is stored in the request resource ratio table. For requests with a high ratio, shorten the timing collection time and increase the priority of performance resource usage. For requests with a low ratio, extend the timing collection time and lower the priority of performance resource usage.

In response to receiving the client request, the indicator corresponding to the request is collected from the middleware of the multi-cluster management software. Based on the middleware, the indicator data is obtained from the time series database, and the data is saved to the data table corresponding to the time series database. After monitoring the user request, save the user request URL and request time to the corresponding table in the database.

FIG. 2 shows a schematic diagram of interaction between a user and the multi-cluster management software provided by the present invention. As shown in FIG. 2 , the user 1 sends a query request a1 to the multi-cluster management software 2 , and then returns the corresponding data b1 queried from the middleware of the multi-cluster management software based on the query request from the multi-cluster management software 2 .

In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.

FIG. 3 is a schematic diagram of collecting and storing indicators of clusters under monitoring by the middleware of the multi-cluster management software provided by the present invention. As shown in Figure 3, the middleware 3 of the multi-cluster management software sends a request a21 to collect indicator data to the monitored cluster 4, the monitored cluster 4 returns the corresponding indicator data b21, and the middleware 3 of the multi-cluster management software sends a request to the time series database 5 Send a request a22 to query the data of the last cycle of the indicator, the time series database 5 returns the data b22 of the last cycle of the indicator, and the middleware 3 of the multi-cluster management software will send the indicator data a23 collected from the monitored cluster 4 to The time series database 5 is saved.

Obtain and record the time when the middleware of the multi-cluster management software collects the indicators, and go to the time series database to obtain the indicator data of the last cycle. If there is no indicator data in the last cycle, the null value is stored in the middleware database, and then the middleware sends the collection The Rest request or SSH connection request of the indicator, the timing request corresponding to the indicator is obtained from the monitoring cluster and saved to the time series database after the corresponding indicator is obtained.

According to the data table, the proportion of various requests in a cycle is obtained, and based on the proportion, the proportion of requested resources is obtained. Monitor and periodically collect performance parameters of multi-cluster management software to analyze the proportion of user requests within a collection cycle. For example, the number of requests for A is 100 times, the number of requests for B is 50 times, the number of requests for C is 30 times, and the number of requests for D is 20 times , then the proportion of request A is 50%. Then, a request resource ratio table is obtained according to the resource usage of each request.

Dynamically adjust the usage priority of requested resources according to the requested resource ratio table, and adjust the interval length of timed collection according to the usage priority. In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource. The higher the proportion of requested resources, the higher the priority. Therefore, when the proportion of requested resources increases, the use priority of the requested resources can be increased, and when the proportion of requested resources decreases, the use priority of the requested resources can be reduced.

In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection. The higher the usage priority, the shorter the collection interval. Therefore, when the usage priority is increased, the interval length of timed collection can be shortened, and when the priority is lowered, the interval length of timed collection can be increased.

In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database. In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.

In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.

FIG. 4 shows a schematic diagram of the interaction between the monitoring module provided by the present invention and the multi-cluster management software. As shown in Figure 4, the monitoring module 6 monitors the multi-cluster management software 2 all the time, and periodically sends a request a31 to collect performance parameters to the multi-cluster management software 2, and the multi-cluster management software 2 returns the corresponding data b31. The monitoring module 6 sends a request a32 for obtaining the collection time to the multi-cluster management software 2, the multi-cluster management software 2 returns the corresponding time b32, and the monitoring module 6 sends to the multi-cluster management software 2 the predetermined time for obtaining the requested data from the middleware database the request a33, the multi-cluster management software 2 returns the corresponding time b33, the monitoring module 6 obtains the delay difference based on the two times, and analyzes the proportion of user requests in a cycle, and obtains the request resource proportion table a34, according to the proportion of resource requests The table sends a dynamically adjusted command a35 to the multi-cluster management software 2 .

It should be particularly pointed out that each step in each embodiment of the above-mentioned method for configuring multi-cluster management software parameters can be crossed, replaced, added, and deleted. The parameter method should also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.

Based on the above purpose, in a second aspect of the embodiments of the present invention, a system for configuring parameters of multi-cluster management software is proposed, including: a first collection module, configured to respond to a client request, and send an intermediary of the multi-cluster management software to the multi-cluster management software. The second collection module is configured to obtain the data of the indicator from the time series database based on the middleware, and save the data to the data table corresponding to the time series database; A proportioning module, configured to obtain the proportions of various requests in a cycle according to the data table, and obtain a table of requested resource proportions based on the proportions; and an adjustment module, configured to obtain the proportions of the requested resources according to the proportions The table dynamically adjusts the usage priority of the requested resource, and adjusts the interval duration of the timing collection according to the usage priority.

In some implementations, the method further includes: a query module configured to query a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.

In some implementations, it further includes: a delay module, configured to acquire the time when the request is received, and calculate the difference between the time and the predetermined time to obtain a time delay difference.

In some embodiments, the adjustment module is configured to: in response to an increase in the proportion of the requested resources, increasing the priority of using the requested resources.

In some implementations, the adjustment module is configured to shorten the interval duration of the timing collection in response to the usage priority increasing.

In some embodiments, the adjustment module is configured to: adjust the interval duration to be equal to the delay difference.

In some embodiments, the second collection module is configured to: periodically acquire data corresponding to the indicator from the monitoring cluster, and save the data to the time series database.

Based on the above objective, in a third aspect of the embodiments of the present invention, a computer device is provided, including: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor to The following steps are implemented: S1. In response to receiving a customer request, collect the index corresponding to the request to the middleware of the multi-cluster management software; S2. Based on the middleware, obtain the data of the index from the time series database, and save the data to the time series database corresponding to S3. Obtain the proportion of various requests in a cycle according to the data table, and obtain the requested resource proportion table based on the proportion; and S4, dynamically adjust the use priority of the requested resources according to the requested resource proportion table, and Adjust the interval length of timed collection according to the usage priority.

In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.

In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.

In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource.

In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection.

In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.

In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.

As shown in FIG. 5 , it is a schematic diagram of a hardware structure of an embodiment of the above-mentioned computer device for configuring multi-cluster management software parameters provided by the present invention.

Taking the device shown in FIG. 5 as an example, the device includes a processor 301 and a memory 302 , and may also include an input device 303 and an output device 304 .

The processor 301 , the memory 302 , the input device 303 and the output device 304 may be connected by a bus or in other ways, and the connection by a bus is taken as an example in FIG. 5 .

As a non-volatile computer-readable storage medium, the memory 302 can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the configuration of multi-cluster management software parameters in the embodiments of the present application. The program instruction/module corresponding to the method. The processor 301 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions and modules stored in the memory 302, that is, implementing the method for configuring multi-cluster management software parameters in the above method embodiments.

The memory 302 may include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required by at least one function; data etc. Additionally, memory 302 may include high speed random access memory, and may also include nonvolatile memory, such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some embodiments, memory 302 may optionally include memory located remotely from processor 301, which may be connected to local modules via a network. Examples of such networks include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 303 can receive input information such as user name and password. The output device 304 may include a display device such as a display screen.

The program instructions/modules corresponding to one or more methods for configuring multi-cluster management software parameters are stored in the memory 302, and when executed by the processor 301, execute the method for configuring multi-cluster management software parameters in any of the above method embodiments.

Any embodiment of the computer device that executes the above method for configuring multi-cluster management software parameters can achieve the same or similar effects as any of the foregoing method embodiments corresponding to it.

The present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program that executes the above method when executed by a processor.

Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is only exemplary, and is not intended to imply that the scope (including the claims) disclosed by the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present invention should be included within the protection scope of the embodiments of the present invention.

Claims (10)

1. a method for configuring multi-cluster management software parameters, is characterized in that, comprises the following steps: In response to receiving the client request, collect the indicator corresponding to the request from the middleware of the multi-cluster management software; Obtain the data of the indicator from the time series database based on the middleware, and save the data to the data table corresponding to the time series database; Obtain the proportions of various requests in a cycle according to the data table, and obtain a request resource proportion table based on the proportions; and The usage priority of the requested resource is dynamically adjusted according to the requested resource ratio table, and the interval duration of the timing collection is adjusted according to the usage priority. 2. The method of claim 1, further comprising: The middleware database is queried to obtain a predetermined moment at which data of the indicator is obtained from the time series database. 3. The method of claim 2, further comprising: The time when the request is received is obtained, and the difference between the time and the predetermined time is calculated to obtain a delay difference. 4. The method according to claim 3, wherein the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table comprises: In response to the increase in the proportion of the requested resources, the priority of using the requested resources is increased. 5. The method according to claim 4, wherein adjusting the interval duration of timing collection according to the priority of use comprises: In response to the usage priority increasing, the interval duration of the timed collection is shortened. 6. The method according to claim 5, wherein adjusting the interval duration of timing collection according to the priority of use comprises: Adjust the interval duration to be equal to the delay difference. 7. The method according to claim 1, wherein the obtaining the data of the indicator from a time series database based on the middleware comprises: Acquire data corresponding to the indicator from the monitoring cluster at regular intervals, and save the data to the time series database. 8. A system for configuring multi-cluster management software parameters, comprising: a first collection module, configured to, in response to receiving a client request, collect an indicator corresponding to the request from the middleware of the multi-cluster management software; a second acquisition module, configured to acquire the data of the indicator from a time series database based on the middleware, and save the data to a data table corresponding to the time series database; A proportion module, configured to obtain the proportion of various requests in a cycle according to the data table, and obtain a request resource proportion table based on the proportion; and The adjustment module is configured to dynamically adjust the usage priority of the requested resource according to the requested resource ratio table, and adjust the interval duration of the timing collection according to the usage priority. 9. A computer equipment, characterized in that, comprising: at least one processor; and a memory storing computer instructions executable on the processor, the instructions implementing the steps of the method of any one of claims 1-7 when executed by the processor. 10. A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1-7 are implemented.

Images