CN111736991B - A method, apparatus, device and readable medium for resource scheduling of cloud platform - Google Patents

Abstract

The invention discloses a method for resource scheduling of a cloud platform, comprising the following steps: recording the resource usage rate once at each collection interval within a preset period; grading the resource usage rate, and counting the resource usage rate at each rating level the number of times, and calculate the time proportion of the resource usage rate corresponding to each rating level in the preset period according to the number of times; and further calculate the average resource usage rate according to the time proportion, and reallocate resources based on the average resource usage rate. . The invention also discloses a cloud platform resource scheduling device, computer equipment and readable storage medium. After the virtual machine is established, the present invention effectively improves the actual use efficiency of the resources in the openstack platform by evaluating the resource usage of the virtual machine and performing secondary balancing of the resources in the openstack platform, thereby improving the performance of the openstack platform.

Description

A method, apparatus, device and readable medium for resource scheduling of cloud platform

technical field

The present invention relates to the technical field of cloud computing data processing, and in particular, to a method, apparatus, device and readable medium for resource scheduling of a cloud platform.

Background technique

In the era of cloud computing, many applications are deployed on the virtual machines of the openstack platform. The openstack platform is currently the most popular open source cloud platform, and one of the key points of a cloud platform is resource scheduling. If the resource scheduling here is not special Description refers to virtual machine scheduling. The resource scheduling policy of the openstack platform directly affects the performance of applications in the virtual machine.

At present, various mature and effective resource scheduling strategies have been produced. Most of them are performed before the virtual machine is created, and there is little research on resource scheduling after resource allocation. Due to business uncertainty, resource scheduling before a virtual machine is created may cause a mismatch between business requirements and virtual machine resource configuration, resulting in that the virtual machine resource configuration cannot meet business requirements or the virtual machine occupies a large amount of idle resources.

SUMMARY OF THE INVENTION

In view of this, the purpose of the embodiments of the present invention is to propose a method, device, device and readable medium for resource scheduling of a cloud platform. The secondary balance of resources in the openstack platform effectively improves the actual use efficiency of the resources in the openstack platform, thereby improving the performance of the openstack platform.

Based on the above purpose, one aspect of the embodiments of the present invention provides a method for resource scheduling on a cloud platform, including the following steps: recording the resource usage rate once at each collection interval within a preset period; The number of times the resource usage rate is at each rating level, and calculate the time proportion of the resource usage rate corresponding to each rating level within the preset period according to the number of times; Average resource usage to reallocate resources.

In some embodiments, the method is for the openstack open source cloud platform.

In some embodiments, the resource usage includes: CPU usage, memory usage, and storage capacity ratio.

In some embodiments, rating the resource usage rate includes: comparing the resource usage rate with a first rating preset value and a second rating preset value; if it is higher than the first rating preset value, rating the resource usage rate If it is lower than the second rating preset value, the resource utilization rate is rated as low; if it is not higher than the first rating preset value and not lower than the second rating preset value, the resource utilization rate is rated as medium.

In some embodiments, calculating the time proportion of the resource usage rate corresponding to each rating level in the preset period according to the number of times includes: dividing the preset period and the collection interval to obtain the total resource usage rate in the preset period. times; divide the times of each rating level by the total number of times to get the time proportion corresponding to each rating level.

In some embodiments, further calculating the average resource usage rate according to the time percentage includes: multiplying and summing each time percentage by the corresponding rating preset value to obtain the average resource usage rate.

In some embodiments, reallocating resources based on the average resource usage includes: multiplying the initial resource allocation value by the average resource usage to obtain a new resource allocation value, and reallocating the resource according to the new resource allocation value .

Another aspect of the embodiments of the present invention further provides a cloud platform resource scheduling device, including: a performance monitoring module, configured to record the resource usage rate once at each collection interval within a preset period; a resource evaluation module, Rank the resource usage rate, count the number of times the resource usage rate is at each rating level, and calculate the proportion of time the resource usage rate is at each rating level in a preset period according to the number of times; and the resource scheduling module, according to the time The proportion is further calculated to obtain the average resource utilization rate, and resources are reallocated based on the average resource utilization rate.

In yet another aspect of the embodiments of the present invention, a computer device is also provided, including: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and when the instructions are executed by the processor, implement the above-mentioned method. step.

In yet another aspect of the embodiments of the present invention, a computer-readable storage medium is also provided, where the computer-readable storage medium stores a computer program that implements the above method steps when executed by a processor.

The invention has the following beneficial technical effects: after the virtual machine is established, by evaluating the resource usage of the virtual machine, and performing secondary balancing of the resources in the openstack platform, the actual use efficiency of the resources in the openstack platform is effectively improved, thereby improving the openstack platform. platform performance.

Description of drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other embodiments can also be obtained according to these drawings without creative efforts.

1 is a schematic diagram of an embodiment of a method for scheduling cloud platform resources provided by the present invention;

FIG. 2 is a schematic diagram of an embodiment of a cloud platform resource scheduling apparatus provided by the present invention.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the specific embodiments and the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities with the same name but not the same or non-identical parameters. It can be seen that "first" and "second" It is only for the convenience of expression and should not be construed as a limitation to the embodiments of the present invention, and subsequent embodiments will not describe them one by one.

Based on the above purpose, in the first aspect of the embodiments of the present invention, an embodiment of a method for resource scheduling of a cloud platform is proposed. FIG. 1 shows a schematic diagram of an embodiment of a method for scheduling cloud platform resources provided by the present invention. As shown in Figure 1, the embodiment of the present invention includes the following steps:

S1. Record the resource usage rate once at each collection interval within a preset period;

S2. Rank the resource usage rate, count the number of times the resource usage rate is at each rating level, and calculate the proportion of time that the resource usage rate is at each rating level in a preset period according to the number of times; and

S3. The average resource usage rate is further calculated according to the time ratio, and resources are reallocated based on the average resource usage rate.

In this embodiment, the performance evaluation is carried out in a period of 7 days, and the utilization rates of various resources are collected and recorded every 15 minutes; The rate is divided into three grades: low, medium and high. The number of times that the resource utilization rate is rated i is recorded as |A _i |, where i represents low, medium, and high. Calculate the 7-day resource utilization rate in each rating. The proportion of time, the formula is as follows:

The average resource utilization rate is further calculated according to the time proportion, and the formula is as follows:

其中I_i表示低级、中级、高级的资源最高使用率，分别为40％、80％、100％，基于平均资源使用率对资源进行重新分配，公式如下：

Among them, I _i represents the highest resource utilization rate of low-level, intermediate-level and high-level resources, which are 40%, 80%, and 100%, respectively. Redistribution of resources is based on the average resource utilization rate, and the formula is as follows:

其中T(A)为虚拟机中资源A的初始分配值，T’(A)为资源A新的分配值，将对应虚拟机的资源配置文件修改为新的分配值，以修改openstack平台中可使用资源的数量。

Among them, T(A) is the initial allocation value of resource A in the virtual machine, and T'(A) is the new allocation value of resource A. Modify the resource configuration file of the corresponding virtual machine to the new allocation value to modify the available values in the openstack platform. The number of resources used.

In some embodiments of the present invention, the method may be used on the openstack open source cloud platform. The openstack platform is currently the most popular open source cloud platform. By balancing the resources of the openstack platform twice, the resource allocation strategy can be adjusted according to the actual demand for resources by the business in the platform, which can effectively improve the actual use efficiency of the resources in the openstack platform. So as to improve the performance of the openstack platform to a certain extent.

In some embodiments of the present invention, the resource usage rate includes: CPU usage rate, memory usage rate, and storage capacity ratio. Obtain the usage of resources such as CPU, memory, and storage, respectively, and evaluate the CPU usage, memory usage, and storage capacity ratio, respectively, and perform secondary balancing of CPU, memory, and storage resources according to the evaluation results.

In some embodiments of the present invention, rating the resource usage rate includes: comparing the resource usage rate with a first rating preset value and a second rating preset value; if it is higher than the first rating preset value, classifying the resource usage rate The utilization rate is rated as high; if it is lower than the default value of the second rating, the resource utilization rate is rated as low; if it is not higher than the preset value of the first rating and not lower than the preset value of the second rating, the resource utilization rate is rated as low. for the intermediate level.

In some embodiments of the present invention, calculating, according to the number of times, the proportion of the time corresponding to each rating level of the resource usage rate in the preset period includes: dividing the preset period and the collection interval to obtain the resource usage rate within the preset period. The total number of cycles; divide the number of times for each rating level by the total number of times to get the proportion of time corresponding to each rating level. When the preset period is 7 days and the collection interval is 15 minutes, the formula is as follows:

其中A_i为资源使用率评级为i的次数。

where A _i is the number of times the resource utilization rate is rated i.

In some embodiments of the present invention, further calculating the average resource utilization rate according to the time ratio includes: multiplying and summing each time proportion by the corresponding rating preset value to obtain the average resource utilization rate, and the formula is as follows:

其中I_i表示低级、中级、高级的资源最高使用率，分别为40％、80％、100％。

Among them, I _i represents the highest resource utilization rate of low-level, intermediate-level and high-level resources, which are 40%, 80%, and 100% respectively.

In some embodiments of the present invention, the reallocation of resources based on the average resource usage includes: multiplying the initial resource allocation value by the average resource usage to obtain a new resource allocation value, and assigning the resources to the new resource allocation value according to the new resource allocation value. To redistribute, the formula is as follows:

其中T(A)为虚拟机中资源A的初始分配值，T’(A)为资源A新的分配值。

Among them, T(A) is the initial allocation value of resource A in the virtual machine, and T'(A) is the new allocation value of resource A.

It should be particularly pointed out that the steps in each embodiment of the above-mentioned cloud platform resource scheduling method can be intersected, replaced, added, and deleted. It should belong to the protection scope of the present invention, and should not limit the protection scope of the present invention to the embodiments.

Based on the above objective, in a second aspect of the embodiments of the present invention, an apparatus for resource scheduling of a cloud platform is provided. FIG. 2 shows a schematic diagram of an embodiment of a cloud platform resource scheduling apparatus provided by the present invention. As shown in FIG. 2 , an embodiment of the present invention includes the following modules: a performance monitoring module, configured to record the resource usage rate once at each collection interval within a preset period; a resource evaluation module, to rate the resource usage rate and count resources The number of times the utilization rate is at each rating level, and calculates the time proportion of the resource utilization rate corresponding to each rating level in the preset period according to the number of times; and the resource scheduling module further calculates the average resource utilization rate according to the time proportion. , and reallocates resources based on average resource usage.

Based on the above purpose, a third aspect of the embodiments of the present invention provides a computer device, comprising: at least one processor; and a memory, where the memory stores computer instructions that can be executed on the processor, and when the instructions are executed by the processor Implement the steps of the above method.

The present invention also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program that executes the above method when executed by a processor.

Finally, it should be noted that those of ordinary skill in the art can understand that all or part of the process in the method of the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program. The program of the cloud platform resource scheduling method can be stored in a computer. In reading the storage medium, when the program is executed, it may include the flow of the embodiments of the above-mentioned methods. Wherein, the storage medium of the program may be a magnetic disk, an optical disk, a read only memory (ROM) or a random access memory (RAM) or the like. The above computer program embodiments can achieve the same or similar effects as any of the foregoing method embodiments corresponding thereto.

In addition, the methods disclosed according to the embodiments of the present invention may also be implemented as a computer program executed by a processor, and the computer program may be stored in a computer-readable storage medium. When the computer program is executed by the processor, the above-mentioned functions defined in the methods disclosed in the embodiments of the present invention are executed.

In addition, the above-mentioned method steps and system units can also be implemented by a controller and a computer-readable storage medium for storing a computer program that enables the controller to implement the functions of the above-mentioned steps or units.

In addition, it should be understood that computer-readable storage media (eg, memory) herein can be volatile memory or non-volatile memory, or can include both volatile and non-volatile memory. By way of example and not limitation, nonvolatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory memory. Volatile memory may include random access memory (RAM), which may act as external cache memory. By way of example and not limitation, RAM is available in various forms such as synchronous RAM (DRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to include, but not be limited to, these and other suitable types of memory.

Those skilled in the art will also appreciate that the various exemplary logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends on the specific application and design constraints imposed on the overall system. Those skilled in the art may implement the functions in various ways for each specific application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.

The various exemplary logical blocks, modules, and circuits described in connection with the disclosure herein can be implemented or executed using the following components designed to perform the functions herein: general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in combination with a DSP, and/or any other such configuration.

The steps of a method or algorithm described in connection with the disclosures herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, such that the processor can read information from, and write information to, the storage medium. In an alternative, the storage medium may be integrated with the processor. The processor and storage medium may reside in an ASIC. The ASIC may reside in the user terminal. In an alternative, the processor and storage medium may reside in the user terminal as discrete components.

In one or more exemplary designs, functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage medium can be any available medium that can be accessed by a general purpose or special purpose computer. By way of example and not limitation, the computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage devices, magnetic disk storage devices or other magnetic storage devices, or may be used to carry or store instructions in the form of or data structures and any other medium that can be accessed by a general purpose or special purpose computer or a general purpose or special purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave are used to send software from a website, server, or other remote source, the above coaxial cable Cable, fiber optic cable, twisted pair, DSL or wireless technologies such as infrared, radio and microwave are all included in the definition of medium. As used herein, magnetic disks and optical disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks, blu-ray disks, where disks usually reproduce data magnetically, while optical disks reproduce data optically with lasers . Combinations of the above should also be included within the scope of computer-readable media.

The above are exemplary embodiments of the present disclosure, but it should be noted that various changes and modifications may be made without departing from the scope of the disclosure of the embodiments of the present invention as defined in the claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements disclosed in the embodiments of the present invention may be described or claimed in the singular, unless explicitly limited to the singular, the plural may also be construed.

It should be understood that, as used herein, the singular form "a" is intended to include the plural form as well, unless the context clearly supports an exception. It will also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The above-mentioned embodiments of the present invention disclose the serial numbers of the embodiments only for description, and do not represent the advantages and disadvantages of the embodiments.

Those of ordinary skill in the art can understand that all or part of the steps of implementing the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a magnetic disk or an optical disk, and the like.

Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is only exemplary, and is not intended to imply that the scope (including the claims) disclosed by the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in detail for the sake of brevity. Therefore, any omission, modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present invention should be included within the protection scope of the embodiments of the present invention.

Claims (10)

1. A method for cloud platform resource scheduling, comprising the following steps: Record resource usage once at each collection interval within a preset period; Rank the resource usage rate, count the number of times the resource usage rate is at each rating level, and calculate the corresponding number of times the resource usage rate is at each rating level within the preset period. percentage of time; and The average resource usage rate is further calculated according to the time ratio, and resources are reallocated based on the average resource usage rate, Among them, the average resource utilization rate is further calculated according to the time proportion, and the formula is as follows:

, where P(A _i ) represents the time proportion of each resource usage rate in each rating in 7 days, A _i represents the resource usage rate rating of resource A for i, and I(A _i ) represents the low, middle, and high grades The highest resource utilization rates are 40%, 80%, and 100%, respectively. Redistribution of resources is based on the average resource utilization rate. The formula is as follows:

, where T(A) is the initial allocation value of resource A in the virtual machine, T ^' (A) is the new allocation value of resource A, and the resource configuration file of the corresponding virtual machine is modified to the new allocation value to modify the openstack platform. The number of resources available. 2. The method for cloud platform resource scheduling according to claim 1, wherein the method is used for the openstack open source cloud platform. 3 . The method for scheduling resources of a cloud platform according to claim 1 , wherein the resource usage rate comprises: CPU usage rate, memory usage rate, and storage capacity ratio. 4 . 4. The method for cloud platform resource scheduling according to claim 1, wherein the rating of the resource utilization comprises: comparing the resource usage rate with a first rating preset value and a second rating preset value; If it is higher than the first rating preset value, the resource usage rate is rated as high; If it is lower than the second rating preset value, the resource usage rate is rated as low; If it is not higher than the first rating preset value and not lower than the second rating preset value, the resource usage rate is rated as medium. 5 . The method for cloud platform resource scheduling according to claim 1 , wherein calculating, according to the number of times, the proportion of time that the resource usage rate is at each of the rating levels in the preset period includes: 6 . : dividing the preset period by the collection interval to obtain the total number of times of the resource usage rate in the preset period; The number of times of each rating level is divided by the total number of times to obtain the time proportion corresponding to each of the rating levels. 6. The method for cloud platform resource scheduling according to claim 1, wherein further calculating the average resource utilization rate according to the time ratio comprises: Multiplying and summing each of said time proportions by the corresponding rating preset value to obtain an average resource usage rate. 7. The method for cloud platform resource scheduling according to claim 1, wherein reallocating resources based on the average resource usage rate comprises: The average resource usage rate is multiplied by the initial resource allocation value to obtain a new resource allocation value, and the resources are reallocated according to the new resource allocation value. 8. A device for cloud platform resource scheduling, comprising: A performance monitoring module, configured to record resource usage at each collection interval within a preset period; A resource evaluation module that rates the resource usage rate, counts the number of times the resource usage rate is at each rating level, and calculates the number of times the resource usage rate is at each level within the preset period. the percentage of time corresponding to the above rating level; and a resource scheduling module, further calculating an average resource usage rate according to the time ratio, and redistributing resources based on the average resource usage rate, Among them, the average resource utilization rate is further calculated according to the time proportion, and the formula is as follows:

, where P(A _i ) represents the time proportion of each resource usage rate in each rating in 7 days, A _i represents the resource usage rate rating of resource A for i, and I(A _i ) represents the low, middle, and high grades The highest resource utilization rates are 40%, 80%, and 100%, respectively. Redistribution of resources is based on the average resource utilization rate. The formula is as follows:

, where T(A) is the initial allocation value of resource A in the virtual machine, T ^' (A) is the new allocation value of resource A, and the resource configuration file of the corresponding virtual machine is modified to the new allocation value to modify the openstack platform. The number of resources available. 9. A computer equipment, characterized in that, comprising: at least one processor; and a memory, the memory storing computer instructions executable on the processor, the instructions implementing the steps of the method of any one of claims 1-7 when executed by the processor. 10. A computer-readable storage medium storing a computer program, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1-7 are implemented.

Images