CN111953567A - A method, system, device and medium for configuring parameters of multi-cluster management software - Google Patents
A method, system, device and medium for configuring parameters of multi-cluster management software Download PDFInfo
- Publication number
- CN111953567A CN111953567A CN202010818534.0A CN202010818534A CN111953567A CN 111953567 A CN111953567 A CN 111953567A CN 202010818534 A CN202010818534 A CN 202010818534A CN 111953567 A CN111953567 A CN 111953567A
- Authority
- CN
- China
- Prior art keywords
- data
- request
- management software
- proportion
- cluster management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000004044 response Effects 0.000 claims abstract description 21
- 238000012544 monitoring process Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 10
- 230000003993 interaction Effects 0.000 description 4
- 238000004904 shortening Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/10—Active monitoring, e.g. heartbeat, ping or trace-route
- H04L43/103—Active monitoring, e.g. heartbeat, ping or trace-route with adaptive polling, i.e. dynamically adapting the polling rate
Landscapes
- Health & Medical Sciences (AREA)
- Cardiology (AREA)
- General Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Stored Programmes (AREA)
Abstract
本发明公开了一种配置多集群管理软件参数的方法、系统、设备和存储介质,方法包括:响应于接收到客户请求,向多集群管理软件的中间件采集请求对应的指标;基于中间件从时间序列数据库获取指标的数据,并将数据保存到时间序列数据库对应的数据表;根据数据表得到一个周期内各种请求的占比,并基于占比得到请求资源占比表;以及根据请求资源占比表动态调整请求资源的使用优先级,并根据使用优先级调整定时采集的间隔时长。本发明根据分析请求资源占比,并根据占比动态调整系统资源使用优先级,进而提高系统响应效率。
The invention discloses a method, system, device and storage medium for configuring parameters of multi-cluster management software. The method includes: in response to receiving a client request, collecting indicators corresponding to the request from middleware of multi-cluster management software; The time series database obtains the data of the indicators, and saves the data to the data table corresponding to the time series database; obtains the proportion of various requests in a cycle according to the data table, and obtains the proportion table of requested resources based on the proportion; The proportion table dynamically adjusts the usage priority of the requested resources, and adjusts the interval length of timed collection according to the usage priority. According to the analysis request resource ratio, the present invention dynamically adjusts the system resource use priority according to the ratio, thereby improving the system response efficiency.
Description
技术领域technical field
本发明涉及集群管理领域,更具体地,特别是指一种配置多集群管理软件参数的方法、系统、计算机设备及可读介质。The present invention relates to the field of cluster management, and more particularly, to a method, system, computer equipment and readable medium for configuring parameters of multi-cluster management software.
背景技术Background technique
在云计算时代,海量数据通常使用集群系统进行存储,为了满足不同需求,通常客户会配置多种集群系统,一般情况下,每个集群系统都会提供对应的管理软件,当引入多个集群系统时,登录多个集群管理软件查看集群系统运行情况,不方便集群系统的管理。通常客户现场会引入多集群管理软件,进行多集群管理。In the era of cloud computing, mass data is usually stored in cluster systems. In order to meet different needs, customers usually configure multiple cluster systems. Generally, each cluster system will provide corresponding management software. When multiple cluster systems are introduced , log in to multiple cluster management software to check the running status of the cluster system, which is inconvenient to manage the cluster system. Usually, customers will introduce multi-cluster management software on site for multi-cluster management.
多集群管理软件的架构流程一般是用户登录系统,下发查询请求,后台接收请求后,从中间件数据库遍历检索相关数据表,获取数据并返回用户。中间件可以理解为数据采集模块,数据采集模块根据功能场景创建多个数据采集定时器,数据采集定时器定时从集群系统上采集数据,并将其存储在多集群管理软件服务器的时间序列数据库,时间序列数据库循环覆盖存储,当达到一个轮询点时,将待覆盖的数据推送到中间件数据库,轮询时间跟管理的集群规模,集群个数正相关。此种架构能够直接从中间件数据库取存储数据,能够极快的响应客户请求,提高用户满意度,且后台数据定时从存储采集,推送至中间件数据库,即使有延迟,影响也可以忽略不计。但是此种框架定时采集间隔,数据轮询间隔由程序员经过大量测试后确定,程序员设计的场景不能考虑到所有场景。定时数据轮询间隔,数据轮询间隔并不一定满足实际使用场景。The architectural process of multi-cluster management software is generally that users log in to the system, issue query requests, and after receiving requests in the background, traverse and retrieve relevant data tables from the middleware database, obtain data, and return to the user. The middleware can be understood as a data acquisition module. The data acquisition module creates multiple data acquisition timers according to functional scenarios. The data acquisition timers collect data from the cluster system regularly and store them in the time series database of the multi-cluster management software server. The time series database cyclically covers the storage. When a polling point is reached, the data to be covered is pushed to the middleware database. The polling time is positively related to the managed cluster size and the number of clusters. This architecture can directly retrieve stored data from the middleware database, can respond to customer requests extremely quickly, and improve user satisfaction. The background data is collected from the storage and pushed to the middleware database at regular intervals. Even if there is a delay, the impact can be ignored. However, this kind of framework regularly collects the interval, and the data polling interval is determined by the programmer after a lot of testing, and the scenarios designed by the programmer cannot take into account all scenarios. Timed data polling interval. The data polling interval does not necessarily meet the actual usage scenario.
发明内容SUMMARY OF THE INVENTION
有鉴于此,本发明实施例的目的在于提出一种配置多集群管理软件参数的方法、系统、计算机设备及计算机可读存储介质,通过得到一个周期内各种请求的占比,并分析请求资源占比,从而根据占比动态调整系统资源使用优先级,能够适应不同场景且提高系统响应效率。In view of this, the purpose of the embodiments of the present invention is to propose a method, system, computer equipment and computer-readable storage medium for configuring parameters of multi-cluster management software, by obtaining the proportion of various requests in a cycle, and analyzing the requested resources proportion, so that the priority of system resource usage can be dynamically adjusted according to the proportion, which can adapt to different scenarios and improve the system response efficiency.
基于上述目的,本发明实施例的一方面提供了一种配置多集群管理软件参数的方法,包括如下步骤:响应于接收到客户请求,向多集群管理软件的中间件采集所述请求对应的指标;基于所述中间件从时间序列数据库获取所述指标的数据,并将所述数据保存到所述时间序列数据库对应的数据表;根据所述数据表得到一个周期内各种请求的占比,并基于所述占比得到请求资源占比表;以及根据所述请求资源占比表动态调整请求资源的使用优先级,并根据所述使用优先级调整定时采集的间隔时长。Based on the above purpose, one aspect of the embodiments of the present invention provides a method for configuring parameters of multi-cluster management software, including the following steps: in response to receiving a client request, collecting indicators corresponding to the request from the middleware of the multi-cluster management software ; Obtain the data of the indicator from the time series database based on the middleware, and save the data to the data table corresponding to the time series database; Obtain the proportion of various requests in a cycle according to the data table, Obtaining a requested resource ratio table based on the ratio; and dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table, and adjusting the interval length of timing collection according to the usage priority.
在一些实施方式中,还包括:查询中间件数据库以获取从所述时间序列数据库获取所述指标的数据的预定时刻。In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.
在一些实施方式中,还包括:获取接收到所述请求的时刻,并计算所述时刻与所述预定时刻的差值以得到时延差。In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.
在一些实施方式中,所述根据所述请求资源占比表动态调整请求资源的使用优先级包括:响应于所述请求资源占比升高,提高所述请求资源的使用优先级。In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:响应于所述使用优先级提高,缩短所述定时采集的间隔时长。In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:调整所述间隔时长与所述时延差相等。In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.
在一些实施方式中,所述基于所述中间件从时间序列数据库获取所述指标的数据包括:定时从监控集群获取所述指标对应的数据,并将所述数据保存至所述时间序列数据库。In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.
本发明实施例的另一方面,还提供了一种配置多集群管理软件参数系统,包括:第一采集模块,配置用于响应于接收到客户请求,向多集群管理软件的中间件采集所述请求对应的指标;第二采集模块,配置用于基于所述中间件从时间序列数据库获取所述指标的数据,并将所述数据保存到所述时间序列数据库对应的数据表;占比模块,配置用于根据所述数据表得到一个周期内各种请求的占比,并基于所述占比得到请求资源占比表;以及调整模块,配置用于根据所述请求资源占比表动态调整请求资源的使用优先级,并根据所述使用优先级调整定时采集的间隔时长。Another aspect of the embodiments of the present invention further provides a system for configuring parameters of multi-cluster management software, including: a first collection module, configured to collect the information from the middleware of the multi-cluster management software in response to receiving a client request. requesting a corresponding indicator; a second collection module, configured to obtain data of the indicator from a time series database based on the middleware, and save the data to a data table corresponding to the time series database; a proportion module, be configured to obtain the ratio of various requests in a cycle according to the data table, and obtain a request resource ratio table based on the ratio; and an adjustment module, configured to dynamically adjust the request according to the request resource ratio table The usage priority of the resource, and the interval length of the timing collection is adjusted according to the usage priority.
本发明实施例的又一方面,还提供了一种计算机设备,包括:至少一个处理器;以及存储器,所述存储器存储有可在所述处理器上运行的计算机指令,所述指令由所述处理器执行时实现如上方法的步骤。In yet another aspect of the embodiments of the present invention, there is also provided a computer device, comprising: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor. The processor implements the steps of the above method when executed.
本发明实施例的再一方面,还提供了一种计算机可读存储介质,计算机可读存储介质存储有被处理器执行时实现如上方法步骤的计算机程序。In yet another aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, where the computer-readable storage medium stores a computer program that implements the above method steps when executed by a processor.
本发明具有以下有益技术效果:通过得到一个周期内各种请求的占比,并分析请求资源占比,从而根据占比动态调整系统资源使用优先级,能够适应不同场景且提高系统响应效率。The invention has the following beneficial technical effects: by obtaining the proportions of various requests in a cycle, and analyzing the proportions of requested resources, the system resource usage priority can be dynamically adjusted according to the proportions, which can adapt to different scenarios and improve system response efficiency.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的实施例。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can also be obtained according to these drawings without creative efforts.
图1为本发明提供的配置多集群管理软件参数的方法的实施例的示意图;1 is a schematic diagram of an embodiment of a method for configuring multi-cluster management software parameters provided by the present invention;
图2为本发明提供的用户与多集群管理软件交互示意图;2 is a schematic diagram of interaction between a user and multi-cluster management software provided by the present invention;
图3为本发明提供的多集群管理软件的中间件采集监控的集群的指标并存储的示意图;3 is a schematic diagram of the middleware of the multi-cluster management software provided by the present invention collecting and storing indicators of clusters to be monitored;
图4为本发明提供的监控模块与多集群管理软件交互示意图;4 is a schematic diagram of the interaction between the monitoring module provided by the present invention and the multi-cluster management software;
图5为本发明提供的配置多集群管理软件参数的计算机设备的实施例的硬件结构示意图。FIG. 5 is a schematic diagram of a hardware structure of an embodiment of a computer device for configuring multi-cluster management software parameters provided by the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案和优点更加清楚明白,以下结合具体实施例,并参照附图,对本发明实施例进一步详细说明。In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the specific embodiments and the accompanying drawings.
需要说明的是,本发明实施例中所有使用“第一”和“第二”的表述均是为了区分两个相同名称非相同的实体或者非相同的参量,可见“第一”“第二”仅为了表述的方便,不应理解为对本发明实施例的限定,后续实施例对此不再一一说明。It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities with the same name but not the same or non-identical parameters. It can be seen that "first" and "second" It is only for the convenience of expression and should not be construed as a limitation to the embodiments of the present invention, and subsequent embodiments will not describe them one by one.
基于上述目的,本发明实施例的第一个方面,提出了一种配置多集群管理软件参数的方法的实施例。图1示出的是本发明提供的配置多集群管理软件参数的方法的实施例的示意图。如图1所示,本发明实施例包括如下步骤:Based on the above objective, in the first aspect of the embodiments of the present invention, an embodiment of a method for configuring multi-cluster management software parameters is provided. FIG. 1 shows a schematic diagram of an embodiment of a method for configuring multi-cluster management software parameters provided by the present invention. As shown in Figure 1, the embodiment of the present invention includes the following steps:
S1、响应于接收到客户请求,向多集群管理软件的中间件采集请求对应的指标;S1. In response to receiving the client request, collect the indicators corresponding to the request from the middleware of the multi-cluster management software;
S2、基于中间件从时间序列数据库获取指标的数据,并将数据保存到时间序列数据库对应的数据表;S2. Obtain the indicator data from the time series database based on the middleware, and save the data to the data table corresponding to the time series database;
S3、根据数据表得到一个周期内各种请求的占比,并基于占比得到请求资源占比表;以及S3. Obtain the proportion of various requests in a cycle according to the data table, and obtain the proportion of requested resources based on the proportion; and
S4、根据请求资源占比表动态调整请求资源的使用优先级,并根据使用优先级调整定时采集的间隔时长。S4. Dynamically adjust the use priority of the requested resource according to the request resource ratio table, and adjust the interval duration of the regular collection according to the use priority.
本发明实施例监控并采集多集群管理软件的CPU、内存、缓存占比、磁盘IOPS(每秒读写次数)和读写时延等系统性能参数,监控每个请求下发时间,从中间件数据库获取该请求对应的单集群时刻,算出多集群软件界面呈现数据和单集群实际呈现之间的延迟。当如上指标达到一个采集周期后,本发明的监控模块进行数据分析,分析后获取用户各请求比例占比,各请求展示时间和集群实际值延迟差,各请求对系统性能资源占比,将如上数据保存至请求资源占比表,对于占比高的请求,缩短定时采集时间,将性能资源使用优先级提高,对于占比低的请求,延长定时采集时间,降低性能资源使用优先级。The embodiment of the present invention monitors and collects system performance parameters such as CPU, memory, cache ratio, disk IOPS (number of reads and writes per second), and read and write delays of multi-cluster management software, monitors the delivery time of each request, and monitors the delivery time of each request. The database obtains the single-cluster moment corresponding to the request, and calculates the delay between the presentation of data on the multi-cluster software interface and the actual presentation of the single-cluster. When the above indicators reach one collection period, the monitoring module of the present invention performs data analysis, and after analysis, obtains the proportion of each request of the user, the delay difference between the display time of each request and the actual value of the cluster, and the proportion of each request to the system performance resources, which will be as above. The data is stored in the request resource ratio table. For requests with a high ratio, shorten the timing collection time and increase the priority of performance resource usage. For requests with a low ratio, extend the timing collection time and lower the priority of performance resource usage.
响应于接收到客户请求,向多集群管理软件的中间件采集请求对应的指标。基于中间件从时间序列数据库获取指标的数据,并将数据保存到时间序列数据库对应的数据表。监控到用户请求后,将用户请求URL、请求时刻保存至数据库相应表中。In response to receiving the client request, the indicator corresponding to the request is collected from the middleware of the multi-cluster management software. Based on the middleware, the indicator data is obtained from the time series database, and the data is saved to the data table corresponding to the time series database. After monitoring the user request, save the user request URL and request time to the corresponding table in the database.
图2示出的是本发明提供的用户与多集群管理软件交互示意图。如图2所示,用户1向多集群管理软件2发送查询请求a1,然后从多集群管理软件2中返回基于查询请求从多集群管理软件的中间件中查询到的相应数据b1。FIG. 2 shows a schematic diagram of interaction between a user and the multi-cluster management software provided by the present invention. As shown in FIG. 2 , the
在一些实施方式中,所述基于所述中间件从时间序列数据库获取所述指标的数据包括:定时从监控集群获取所述指标对应的数据,并将所述数据保存至所述时间序列数据库。In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.
图3示出的是本发明提供的多集群管理软件的中间件采集监控的集群的指标并存储的示意图。如图3所示,多集群管理软件的中间件3向监控的集群4发送采集指标数据的请求a21,监控的集群4返回相应的指标数据b21,多集群管理软件的中间件3向时间序列数据库5发送查询该指标上个周期的数据的请求a22,时间序列数据库5返回该指标上个周期的数据b22,多集群管理软件的中间件3将从监控的集群4中采集的指标数据a23发送到时间序列数据库5保存。FIG. 3 is a schematic diagram of collecting and storing indicators of clusters under monitoring by the middleware of the multi-cluster management software provided by the present invention. As shown in Figure 3, the
获取并记录到多集群管理软件的中间件采集指标的时刻,到时间序列数据库获取上次周期的指标数据,上次周期无指标数据,则将空值存入中间件数据库,接着中间件发送采集指标的Rest请求或SSH连接请求,指标对应的定时请求从监控集群获取到对应指标后,保存至时间序列数据库。Obtain and record the time when the middleware of the multi-cluster management software collects the indicators, and go to the time series database to obtain the indicator data of the last cycle. If there is no indicator data in the last cycle, the null value is stored in the middleware database, and then the middleware sends the collection The Rest request or SSH connection request of the indicator, the timing request corresponding to the indicator is obtained from the monitoring cluster and saved to the time series database after the corresponding indicator is obtained.
根据数据表得到一个周期内各种请求的占比,并基于占比得到请求资源占比表。监控并定期采集多集群管理软件性能参数,达到一个采集周期分析用户请求占比,例如,请求A次数是100次,请求B次数是50次,请求C次数是30次,请求D次数是20次,那么请求A的占比是50%。再根据每个请求对资源的使用情况得到一个请求资源占比表。According to the data table, the proportion of various requests in a cycle is obtained, and based on the proportion, the proportion of requested resources is obtained. Monitor and periodically collect performance parameters of multi-cluster management software to analyze the proportion of user requests within a collection cycle. For example, the number of requests for A is 100 times, the number of requests for B is 50 times, the number of requests for C is 30 times, and the number of requests for D is 20 times , then the proportion of request A is 50%. Then, a request resource ratio table is obtained according to the resource usage of each request.
根据请求资源占比表动态调整请求资源的使用优先级,并根据使用优先级调整定时采集的间隔时长。在一些实施方式中,所述根据所述请求资源占比表动态调整请求资源的使用优先级包括:响应于所述请求资源占比升高,提高所述请求资源的使用优先级。请求资源占比越高优先级越高,因此,当请求资源占比升高时可以提高请求资源的使用优先级,当请求资源占比降低时可以降低请求资源的使用优先级。Dynamically adjust the usage priority of requested resources according to the requested resource ratio table, and adjust the interval length of timed collection according to the usage priority. In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource. The higher the proportion of requested resources, the higher the priority. Therefore, when the proportion of requested resources increases, the use priority of the requested resources can be increased, and when the proportion of requested resources decreases, the use priority of the requested resources can be reduced.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:响应于所述使用优先级提高,缩短所述定时采集的间隔时长。使用优先级越高采集的间隔越短,因此,当使用优先级提高时可以缩短定时采集的间隔时长,当优先级降低时可以增加定时采集的间隔时长。In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection. The higher the usage priority, the shorter the collection interval. Therefore, when the usage priority is increased, the interval length of timed collection can be shortened, and when the priority is lowered, the interval length of timed collection can be increased.
在一些实施方式中,还包括:查询中间件数据库以获取从所述时间序列数据库获取所述指标的数据的预定时刻。在一些实施方式中,还包括:获取接收到所述请求的时刻,并计算所述时刻与所述预定时刻的差值以得到时延差。In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database. In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:调整所述间隔时长与所述时延差相等。In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.
图4示出的是本发明提供的监控模块与多集群管理软件交互示意图。如图4所示,监控模块6一直监控多集群管理软件2,定时向多集群管理软件2发送采集性能参数的请求a31,多集群管理软件2返回相应的数据b31,当检测到用户输入请求,监控模块6向多集群管理软件2发送获取采集时刻的请求a32,多集群管理软件2返回相应的时刻b32,监控模块6向多集群管理软件2发送获取从中间件数据库获取该请求数据的预定时刻的请求a33,多集群管理软件2返回相应的时刻b33,监控模块6基于两个时刻得到时延差,并分析一个周期内用户请求占比,得到请求资源占比表a34,根据资源请求占比表向多集群管理软件2发送动态调整的命令a35。FIG. 4 shows a schematic diagram of the interaction between the monitoring module provided by the present invention and the multi-cluster management software. As shown in Figure 4, the
需要特别指出的是,上述配置多集群管理软件参数的方法的各个实施例中的各个步骤均可以相互交叉、替换、增加、删减,因此,这些合理的排列组合变换之于配置多集群管理软件参数的方法也应当属于本发明的保护范围,并且不应将本发明的保护范围局限在实施例之上。It should be particularly pointed out that each step in each embodiment of the above-mentioned method for configuring multi-cluster management software parameters can be crossed, replaced, added, and deleted. The parameter method should also belong to the protection scope of the present invention, and the protection scope of the present invention should not be limited to the embodiments.
基于上述目的,本发明实施例的第二个方面,提出了一种配置多集群管理软件参数系统,包括:第一采集模块,配置用于响应于接收到客户请求,向多集群管理软件的中间件采集所述请求对应的指标;第二采集模块,配置用于基于所述中间件从时间序列数据库获取所述指标的数据,并将所述数据保存到所述时间序列数据库对应的数据表;占比模块,配置用于根据所述数据表得到一个周期内各种请求的占比,并基于所述占比得到请求资源占比表;以及调整模块,配置用于根据所述请求资源占比表动态调整请求资源的使用优先级,并根据所述使用优先级调整定时采集的间隔时长。Based on the above purpose, in a second aspect of the embodiments of the present invention, a system for configuring parameters of multi-cluster management software is proposed, including: a first collection module, configured to respond to a client request, and send an intermediary of the multi-cluster management software to the multi-cluster management software. The second collection module is configured to obtain the data of the indicator from the time series database based on the middleware, and save the data to the data table corresponding to the time series database; A proportioning module, configured to obtain the proportions of various requests in a cycle according to the data table, and obtain a table of requested resource proportions based on the proportions; and an adjustment module, configured to obtain the proportions of the requested resources according to the proportions The table dynamically adjusts the usage priority of the requested resource, and adjusts the interval duration of the timing collection according to the usage priority.
在一些实施方式中,还包括:查询模块,配置用于查询中间件数据库以获取从所述时间序列数据库获取所述指标的数据的预定时刻。In some implementations, the method further includes: a query module configured to query a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.
在一些实施方式中,还包括:时延模块,配置用于获取接收到所述请求的时刻,并计算所述时刻与所述预定时刻的差值以得到时延差。In some implementations, it further includes: a delay module, configured to acquire the time when the request is received, and calculate the difference between the time and the predetermined time to obtain a time delay difference.
在一些实施方式中,所述调整模块配置用于:响应于所述请求资源占比升高,提高所述请求资源的使用优先级。In some embodiments, the adjustment module is configured to: in response to an increase in the proportion of the requested resources, increasing the priority of using the requested resources.
在一些实施方式中,所述调整模块配置用于:响应于所述使用优先级提高,缩短所述定时采集的间隔时长。In some implementations, the adjustment module is configured to shorten the interval duration of the timing collection in response to the usage priority increasing.
在一些实施方式中,所述调整模块配置用于:调整所述间隔时长与所述时延差相等。In some embodiments, the adjustment module is configured to: adjust the interval duration to be equal to the delay difference.
在一些实施方式中,所述第二采集模块配置用于:定时从监控集群获取所述指标对应的数据,并将所述数据保存至所述时间序列数据库。In some embodiments, the second collection module is configured to: periodically acquire data corresponding to the indicator from the monitoring cluster, and save the data to the time series database.
基于上述目的,本发明实施例的第三个方面,提出了一种计算机设备,包括:至少一个处理器;以及存储器,存储器存储有可在处理器上运行的计算机指令,指令由处理器执行以实现如下步骤:S1、响应于接收到客户请求,向多集群管理软件的中间件采集请求对应的指标;S2、基于中间件从时间序列数据库获取指标的数据,并将数据保存到时间序列数据库对应的数据表;S3、根据数据表得到一个周期内各种请求的占比,并基于占比得到请求资源占比表;以及S4、根据请求资源占比表动态调整请求资源的使用优先级,并根据使用优先级调整定时采集的间隔时长。Based on the above objective, in a third aspect of the embodiments of the present invention, a computer device is provided, including: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and the instructions are executed by the processor to The following steps are implemented: S1. In response to receiving a customer request, collect the index corresponding to the request to the middleware of the multi-cluster management software; S2. Based on the middleware, obtain the data of the index from the time series database, and save the data to the time series database corresponding to S3. Obtain the proportion of various requests in a cycle according to the data table, and obtain the requested resource proportion table based on the proportion; and S4, dynamically adjust the use priority of the requested resources according to the requested resource proportion table, and Adjust the interval length of timed collection according to the usage priority.
在一些实施方式中,还包括:查询中间件数据库以获取从所述时间序列数据库获取所述指标的数据的预定时刻。In some implementations, the method further includes: querying a middleware database to obtain a predetermined moment when the data of the indicator is obtained from the time series database.
在一些实施方式中,还包括:获取接收到所述请求的时刻,并计算所述时刻与所述预定时刻的差值以得到时延差。In some embodiments, the method further includes: acquiring the time when the request is received, and calculating the difference between the time and the predetermined time to obtain a delay difference.
在一些实施方式中,所述根据所述请求资源占比表动态调整请求资源的使用优先级包括:响应于所述请求资源占比升高,提高所述请求资源的使用优先级。In some embodiments, the dynamically adjusting the usage priority of the requested resource according to the requested resource ratio table includes: in response to an increase in the requested resource ratio, increasing the usage priority of the requested resource.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:响应于所述使用优先级提高,缩短所述定时采集的间隔时长。In some embodiments, adjusting the interval duration of timing collection according to the usage priority includes: in response to the usage priority being increased, shortening the interval duration of the timing collection.
在一些实施方式中,根据所述使用优先级调整定时采集的间隔时长包括:调整所述间隔时长与所述时延差相等。In some implementation manners, adjusting the interval duration of timing collection according to the usage priority includes: adjusting the interval duration to be equal to the delay difference.
在一些实施方式中,所述基于所述中间件从时间序列数据库获取所述指标的数据包括:定时从监控集群获取所述指标对应的数据,并将所述数据保存至所述时间序列数据库。In some embodiments, the acquiring the data of the indicator from the time series database based on the middleware includes: periodically acquiring data corresponding to the indicator from a monitoring cluster, and saving the data to the time series database.
如图5所示,为本发明提供的上述配置多集群管理软件参数的计算机设备的一个实施例的硬件结构示意图。As shown in FIG. 5 , it is a schematic diagram of a hardware structure of an embodiment of the above-mentioned computer device for configuring multi-cluster management software parameters provided by the present invention.
以如图5所示的装置为例,在该装置中包括一个处理器301以及一个存储器302,并还可以包括:输入装置303和输出装置304。Taking the device shown in FIG. 5 as an example, the device includes a
处理器301、存储器302、输入装置303和输出装置304可以通过总线或者其他方式连接,图5中以通过总线连接为例。The
存储器302作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本申请实施例中的配置多集群管理软件参数的方法对应的程序指令/模块。处理器301通过运行存储在存储器302中的非易失性软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现上述方法实施例的配置多集群管理软件参数的方法。As a non-volatile computer-readable storage medium, the
存储器302可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储根据配置多集群管理软件参数的方法的使用所创建的数据等。此外,存储器302可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器302可选包括相对于处理器301远程设置的存储器,这些远程存储器可以通过网络连接至本地模块。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The
输入装置303可接收输入的用户名和密码等信息。输出装置304可包括显示屏等显示设备。The
一个或者多个配置多集群管理软件参数的方法对应的程序指令/模块存储在存储器302中,当被处理器301执行时,执行上述任意方法实施例中的配置多集群管理软件参数的方法。The program instructions/modules corresponding to one or more methods for configuring multi-cluster management software parameters are stored in the
执行上述配置多集群管理软件参数的方法的计算机设备的任何一个实施例,可以达到与之对应的前述任意方法实施例相同或者相类似的效果。Any embodiment of the computer device that executes the above method for configuring multi-cluster management software parameters can achieve the same or similar effects as any of the foregoing method embodiments corresponding to it.
本发明还提供了一种计算机可读存储介质,计算机可读存储介质存储有被处理器执行时执行如上方法的计算机程序。The present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program that executes the above method when executed by a processor.
所属领域的普通技术人员应当理解:以上任何实施例的讨论仅为示例性的,并非旨在暗示本发明实施例公开的范围(包括权利要求)被限于这些例子;在本发明实施例的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,并存在如上的本发明实施例的不同方面的许多其它变化,为了简明它们没有在细节中提供。因此,凡在本发明实施例的精神和原则之内,所做的任何省略、修改、等同替换、改进等,均应包含在本发明实施例的保护范围之内。Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is only exemplary, and is not intended to imply that the scope (including the claims) disclosed by the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present invention should be included within the protection scope of the embodiments of the present invention.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010818534.0A CN111953567B (en) | 2020-08-14 | 2020-08-14 | A method, system, device and medium for configuring parameters of multi-cluster management software |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010818534.0A CN111953567B (en) | 2020-08-14 | 2020-08-14 | A method, system, device and medium for configuring parameters of multi-cluster management software |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111953567A true CN111953567A (en) | 2020-11-17 |
CN111953567B CN111953567B (en) | 2022-04-22 |
Family
ID=73342326
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010818534.0A Active CN111953567B (en) | 2020-08-14 | 2020-08-14 | A method, system, device and medium for configuring parameters of multi-cluster management software |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111953567B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112947867A (en) * | 2021-04-06 | 2021-06-11 | 苏州菲瑞斯信息技术有限公司 | Full flash memory array high-performance storage system and electronic equipment |
CN113901262A (en) * | 2021-09-24 | 2022-01-07 | 北京达佳互联信息技术有限公司 | Method, device, server and storage medium for acquiring data to be processed |
CN114238008A (en) * | 2021-11-09 | 2022-03-25 | 北京金山云网络技术有限公司 | Data acquisition method, device and system, electronic equipment and storage medium |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170213257A1 (en) * | 2016-01-27 | 2017-07-27 | Turn Inc. | Resource estimation for queries in large-scale distributed database system |
CN110221920A (en) * | 2019-06-04 | 2019-09-10 | 合肥讯飞数码科技有限公司 | Dispositions method, device, storage medium and system |
CN110830391A (en) * | 2018-08-10 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource allocation method and device and cluster system |
CN111124689A (en) * | 2019-12-31 | 2020-05-08 | 中国电子科技集团公司信息科学研究院 | Dynamic allocation method for container resources in cluster |
CN111367632A (en) * | 2020-02-14 | 2020-07-03 | 重庆邮电大学 | A Container Cloud Scheduling Method Based on Periodic Characteristics |
US20200244555A1 (en) * | 2019-01-24 | 2020-07-30 | Metaswitch Networks Ltd. | Serving a network resource usage file |
-
2020
- 2020-08-14 CN CN202010818534.0A patent/CN111953567B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170213257A1 (en) * | 2016-01-27 | 2017-07-27 | Turn Inc. | Resource estimation for queries in large-scale distributed database system |
CN110830391A (en) * | 2018-08-10 | 2020-02-21 | 阿里巴巴集团控股有限公司 | Resource allocation method and device and cluster system |
US20200244555A1 (en) * | 2019-01-24 | 2020-07-30 | Metaswitch Networks Ltd. | Serving a network resource usage file |
CN110221920A (en) * | 2019-06-04 | 2019-09-10 | 合肥讯飞数码科技有限公司 | Dispositions method, device, storage medium and system |
CN111124689A (en) * | 2019-12-31 | 2020-05-08 | 中国电子科技集团公司信息科学研究院 | Dynamic allocation method for container resources in cluster |
CN111367632A (en) * | 2020-02-14 | 2020-07-03 | 重庆邮电大学 | A Container Cloud Scheduling Method Based on Periodic Characteristics |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112947867A (en) * | 2021-04-06 | 2021-06-11 | 苏州菲瑞斯信息技术有限公司 | Full flash memory array high-performance storage system and electronic equipment |
CN113901262A (en) * | 2021-09-24 | 2022-01-07 | 北京达佳互联信息技术有限公司 | Method, device, server and storage medium for acquiring data to be processed |
CN114238008A (en) * | 2021-11-09 | 2022-03-25 | 北京金山云网络技术有限公司 | Data acquisition method, device and system, electronic equipment and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN111953567B (en) | 2022-04-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107846295B (en) | Microservice configuration device and method | |
CN111953567B (en) | A method, system, device and medium for configuring parameters of multi-cluster management software | |
CN103152393B (en) | A kind of charging method of cloud computing and charge system | |
US8447851B1 (en) | System for monitoring elastic cloud-based computing systems as a service | |
US20150222720A1 (en) | Real-Time Analytics of Web Performance Using Actual User Measurements | |
CN108628890B (en) | Data export method and system | |
JP2009543233A (en) | Application system load management | |
CN107404417A (en) | A kind of processing method of monitoring data, processing unit and processing system | |
JP2015191523A (en) | Configuration management apparatus, configuration management system, and configuration management program | |
CA2988805C (en) | Datastore for aggregated measurements for metrics | |
CN110262951A (en) | A kind of business second grade monitoring method and system, storage medium and client | |
CN112005207A (en) | Creating statistical analysis of data for transmission to a server | |
CN113760640A (en) | Monitoring log processing method, device, device and storage medium | |
Ravindra et al. | Latency aware elastic switching-based stream processing over compressed data streams | |
CN104135525B (en) | The resource expansion method and apparatus of cloud platform ELB components | |
CN107193749B (en) | Test methods, devices and equipment | |
CN108108289A (en) | A kind of cluster resource statistical method, system, device and readable storage system | |
CN107682222A (en) | A kind of information monitoring method, apparatus and system | |
CN117251373A (en) | Pressure testing methods, devices, equipment and storage media | |
CN111737083A (en) | VMware cluster resource monitoring method and device | |
CN119248516B (en) | Method for adjusting computing resources of data analysis engine | |
CN112202607B (en) | Statistical calculation method, server and storage medium for log messages | |
CN113225228B (en) | Data processing method and device | |
CN115834324B (en) | Switch data acquisition method and system based on high availability prometheus | |
US11765065B1 (en) | System and method for scalable telemetry |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |