WO2021136137A1 - Resource scheduling method and apparatus, and related device - Google Patents

Abstract

A resource scheduling method and apparatus, and a related device. The method comprises: obtaining performance data and attribute data of each virtual machine in a resource pool, wherein the performance data comprises physical resource information of each virtual machine, and the attribute data comprises port number information and address information of a data packet; clustering a plurality of virtual machines according to the performance data to obtain a plurality of virtual machine clusters; determining a service relationship between services in the plurality of virtual machines according to the attribute data; and upon determining, according to the performance data of the plurality of the virtual machine clusters, that the virtual machines in the resource pool need to be scheduled, scheduling the virtual machines in the resource pool according to the service relationship between the services in the plurality of virtual machines. According to the method, by determining a relationship between services operating in virtual machines, resources are scheduled on the basis of the relationship between the services, so that scheduled virtual machines are more suitable for service needs.

Description

Resource scheduling method, device and related equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on December 31, 2019. The application number is 201911419644.3, and the application name is "a resource scheduling method, device and related equipment". The entire content is incorporated herein by reference. Applying.

Technical field

This application relates to the field of computer technology, and in particular to a resource scheduling method, device and related equipment.

Background technique

Dynamic resource scheduling (DRS) refers to the use of load balancing scheduling algorithms to periodically check the load of each physical machine in the same resource pool, and to migrate virtual machines (VM) between different physical machines, thereby To achieve the purpose of load balancing between different physical machines in the same resource pool.

Virtual machine migration refers to the migration of virtual machines from one physical machine to another. The current migration of virtual machines is mainly based on the usage of physical resources (processors, memory, etc.) and virtual machines in the same resource pool. The physical resource requirements of the machine, the virtual machine is migrated between different physical machines, so as to achieve the purpose of load balancing between different physical machines in the same resource pool and improving resource utilization. However, the current virtual machine migration only considers the physical resource utilization of the physical machine in the resource pool and the physical resource demand of the virtual machine to migrate the virtual machine, and the distribution of the migrated virtual machine does not necessarily meet actual business requirements.

Summary of the invention

The embodiment of the application discloses a resource scheduling method, device and related equipment, which can dynamically schedule virtual machines according to the relationship between the services in the virtual machines in the resource pool, so that the scheduled virtual machines are more in line with actual business requirements .

In the first aspect, an embodiment of the present application provides a resource scheduling method, including:

Acquire performance data of each virtual machine and attribute data of each virtual machine in the multiple virtual machines in the resource pool, where the performance data includes physical resource information of each virtual machine, and the attribute data includes data packets Port number information and address information;

Clustering the multiple virtual machines according to the performance data to obtain multiple virtual machine clusters;

Determining the business relationship between the services in the multiple virtual machines according to the attribute data;

When it is determined to schedule the virtual machines in the resource pool according to the performance data of the virtual machines in each virtual machine cluster, according to the business relationship between the services in the multiple virtual machines, Resources for scheduling.

By implementing the above method, by acquiring the performance data of each virtual machine and the attribute data of the data packets received in each physical machine, and clustering the virtual machines in the resource pool according to the above performance data, according to the above attribute data The address information and port number information, etc., perceive the perception of the services carried by the virtual machine and the relationship between the services carried by the virtual machine. Then determine whether the resources in the resource pool need to be scheduled according to the performance data of the virtual machines of each category after clustering. When resources need to be scheduled, the resources in the resource pool are performed according to the connection between the services. Scheduling, so that when the resources in the resource pool are scheduled, the services in the virtual machine are perceived to determine the resources required by the obligation, and the resources are scheduled according to the resources required by the business and the relationship between the services, so that the resources in the resource pool are After resources are scheduled, it can better meet the needs of actual business.

In a possible embodiment, the determining, according to the performance data of the virtual machines in each virtual machine cluster, to schedule the virtual machines in the resource pool includes:

Acquire the resource usage data of each virtual machine in each virtual machine cluster, determine the resource usage index of each virtual machine cluster, and determine the resource usage index of the resource pool according to the resource usage index of each virtual machine cluster Resource usage indicators;

Acquiring the resource allocation data of each virtual machine in each virtual machine cluster, determining the resource performance index of each virtual machine cluster, and determining the resource performance index of the resource pool according to the resource performance index of each virtual machine cluster;

According to the resource usage index of the resource pool and the resource performance index of the resource pool, it is determined to schedule the resources in the resource pool.

In a possible embodiment, the determining to schedule the resources in the resource pool according to the resource usage index of the resource pool and the resource performance index of the resource pool includes:

In the case where the ratio of the resource usage index to the resource performance index of the resource pool is less than the first threshold, determine to schedule the resources in the resource pool; or,

In the case that the resource performance index of the resource pool is less than the second threshold, determine to schedule the resources in the resource pool; or,

In the case that the resource usage index of the resource pool is less than the third threshold, it is determined to schedule the resources in the resource pool.

In a possible embodiment, the scheduling the virtual machines in the resource pool according to the business relationship between the services in the multiple virtual machines includes:

The scheduling of the resources in the resource pool according to the business relationship between the services in the multiple virtual machines includes:

When it is determined that there is an association relationship between the first service in the first virtual machine and the second service in the second virtual machine, migrate the first virtual machine and the second virtual machine to the same physical machine , Or, migrating the first virtual machine to a first physical machine, and migrating the second virtual machine to a second physical machine, and the path overhead between the first physical machine and the second physical machine is less than The path overhead between the third physical machine and the fourth physical machine, where, before the virtual machine is migrated, the first virtual machine is located in the third physical machine, and the second virtual machine is located in the fourth physical machine , The association relationship includes a dependency relationship, a one-way relationship, a two-way relationship, and a family relationship.

In a second aspect, an embodiment of the present application provides a resource scheduling device, which includes:

The communication unit is configured to: obtain performance data of each virtual machine in the multiple virtual machines in the resource pool, where the performance data includes physical resource information of each virtual machine;

Acquiring attribute data of a data packet corresponding to each of the multiple virtual machines in the resource pool, where the attribute data includes port number information and address information of the data packet;

A processing unit, configured to: cluster the multiple virtual machines according to the performance data to obtain multiple virtual machine clusters;

Determining the business relationship between the services in the multiple virtual machines according to the attribute data;

When determining to schedule the virtual machines in the resource pool according to the performance data of the virtual machines in each virtual machine cluster, according to the business relationship between the services in the multiple virtual machines, Resources for scheduling.

In a possible embodiment, the processing unit is specifically configured to:

Acquire the resource usage data of each virtual machine in each virtual machine cluster, determine the resource usage index of each virtual machine cluster, and determine the resource usage index of the resource pool according to the resource usage index of each virtual machine cluster Resource usage indicators;

Acquiring the resource allocation data of each virtual machine in each virtual machine cluster, determining the resource performance index of each virtual machine cluster, and determining the resource performance index of the resource pool according to the resource performance index of each virtual machine cluster;

According to the resource usage index of the resource pool and the resource performance index of the resource pool, it is determined to schedule the resources in the resource pool.

In a possible embodiment, the processing unit is specifically configured to:

In the case where the ratio of the resource usage index to the resource performance index of the resource pool is less than the first threshold, determine to schedule the resources in the resource pool; or,

In the case that the resource performance index of the resource pool is less than the second threshold, determine to schedule the resources in the resource pool; or,

In the case that the resource usage index of the resource pool is less than the third threshold, it is determined to schedule the resources in the resource pool.

In a possible embodiment, the processing unit is specifically configured to: when it is determined that there is an association relationship between the first service in the first virtual machine and the second service in the second virtual machine, the The first virtual machine and the second virtual machine are migrated to the same physical machine, or the first virtual machine is migrated to the first physical machine, and the second virtual machine is migrated to the second physical machine, the The path cost between the first physical machine and the second physical machine is smaller than the path cost between the third physical machine and the fourth physical machine. Before the virtual machine is migrated, the first virtual machine is located in the first physical machine. Three physical machines, the second virtual machine is located in the fourth physical machine, and the association relationship includes a dependency relationship, a one-way relationship, a two-way relationship, and a family relationship.

In a third aspect, an embodiment of the present application provides a computing device, including a processor and a memory, the memory is used to store instructions, the processor is used to execute the instructions, and when the processor executes the instructions, all The server executes the method described in the foregoing first aspect or any possible embodiment of the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, the processor executes the above-mentioned first aspect or The method described in any possible embodiment of the first aspect.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can obtain other drawings based on these drawings without creative work.

FIG. 1 is a schematic diagram of a virtual machine migration provided by an embodiment of the present application;

Figure 2 is a schematic structural diagram of a resource pool provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of a resource scheduling method provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a resource scheduling device provided by an embodiment of the present application;

Fig. 5 is a schematic structural diagram of a computing device provided by an embodiment of the present application.

Detailed ways

First of all, some terms and related technologies involved in this application will be explained in conjunction with the accompanying drawings, so that those skilled in the art will understand the embodiments of this application.

Dynamic resource scheduler (DRS) refers to the use of load balancing scheduling algorithms to dynamically schedule the resources in the resource pool by periodically checking the load conditions of different hosts in the same resource pool, so as to achieve different physical machines in the same resource pool. The purpose of load balancing between. Wherein, the aforementioned resources refer to instances such as virtual machines or containers. In the embodiments of the present application, virtual machines are taken as examples for explanation. The dynamic scheduling of other resources such as containers is similar to that of virtual machines.

The foregoing dynamic scheduling of resources includes the migration of virtual machines. Migrating a virtual machine refers to migrating a virtual machine from one physical machine to another physical machine to run. For example, as shown in Figure 1, the resource pool includes three physical machines, physical machine 1, physical machine 2, and physical machine 3. VM1, VM2, and VM3 run in physical machine 1, and VM4 and VM5 run in physical machine 2. VM5, VM7, and VM8 run in physical machine 3. Now migrate this VM2 to physical machine 2, then VM2 will run on physical machine 2, and VM2 will not exist on physical machine 1.

According to different requirements, virtual machines exhibit different load characteristics. For example, virtual machines are generally divided into three categories, including computing virtual machines, storage virtual machines, and network virtual machines. Wherein, the computing virtual machine means that the virtual machine mainly needs processor (central processing unit, CPU) resources, the storage virtual machine means that the virtual machine mainly needs memory resources, and the network virtual machine means that the virtual machine mainly needs resources. Is the bandwidth resource. If the virtual machines hosted on the same physical machine are of the same type, for example, the same type of computing virtual machine, each virtual machine will compete for CPU resources, and the utilization of other resources (such as memory, bandwidth, etc.) will be low. As each virtual machine competes for the use of CPU resources, the quality of service will be reduced, and the overall resource utilization will not be high. Therefore, in order to avoid this situation, it is necessary to dynamically schedule the resources in the resource pool according to the physical resource usage of the physical machine and the physical resource demand of the virtual machine to improve the overall resource utilization of the physical machine in the resource pool.

The current dynamic scheduling of virtual machines mainly uses periodic acquisition of the physical resources (processor, memory, bandwidth, etc.) usage status of each physical machine in the same resource pool, and combines the physical machine's historical resource usage information, historical migration duration, and virtual The physical resource requirements of the machine and other information determine the dynamic scheduling strategy of the virtual machine. For example, when the occupancy rate of the processor and/or memory resources of the physical machine exceeds a preset threshold, the virtual machine in the physical machine is migrated. In Figure 1, the CPU and memory occupancy rates of physical machine 1 at the current moment are less than the preset threshold, but according to historical resource usage data, the CPU occupancy rate of physical machine 1 will exceed the preset threshold and exceed the preset threshold in the next 20 minutes The threshold lasts for a long time, and the occupancy rate of the CPU in physical machine 2 has been below the preset threshold and the processor resources meet the needs of any virtual machine in physical machine 1, then part of the virtual machine in physical machine 1 can be virtualized in advance. The machine is migrated to physical machine 2.

The scheduling of resources in the current resource pool is mainly based on the use of physical resources of each physical machine in the same virtual machine cluster and the physical resource requirements of the virtual machines, and the migration of virtual machines between different physical machines, so as to realize the difference in the same resource pool. The purpose of load balancing between physical machines and improving resource utilization. However, the current virtual machine migration only considers the physical resource utilization of the physical machine in the resource pool and the physical resource demand of the virtual machine, and does not perceive the business in the virtual machine. After the virtual machine is migrated from the original physical machine to the new physical machine, The new physical machine does not necessarily meet the needs of the business actually running in the virtual machine, and has a bad effect on the operation of the actual business.

In response to the above problems, embodiments of the present application provide a resource scheduling method. The method periodically obtains performance data and attribute data of virtual machines, clusters the virtual machines according to the performance data, and determines the virtual machines carried in the virtual machine according to the attribute data. Business and the relationship between different businesses. After determining the category to which the virtual machine belongs and the relationship between the services in the virtual machine, the resource scheduling strategy is determined according to the category to which the virtual machine belongs and the relationship between the services. Among them, the performance data is the data of different performance indicators of the virtual machine, including CPU occupancy, memory occupancy, storage space occupancy, bandwidth occupancy, etc., and attribute data includes the source port number and destination port of the data packet received by the physical machine Number, source Internet protocol (IP) address, destination IP address, etc. The relationship between services refers to the relationship between the services carried in different virtual machines, where the relationship between the services includes a dependency relationship, a two-way relationship, a one-way relationship, a family relationship, and a mutually exclusive relationship. Dependency relationship refers to the data provided by business B for the operation of business A; two-way relationship refers to data interaction between business A and business B; one-way relationship refers to business A collecting data and providing data to business B; family relationship refers to business A Both service B and service B need to access the same resource; mutually exclusive relationship means that service A and service B cannot run on the same virtual machine. For example, the business a in the virtual machine VM14 is to provide web services, the business b in the virtual machine VM21 is a database business, and the business b provides the data required by the web services for the business a, and the relationship between the business a and the business b is a dependency relationship; The service c in the virtual machine VM23 is a data collection service, and the collected data is provided to the database service d in the virtual machine VM42, then there is a one-way relationship between the service c and the service d.

As shown in Figure 2, Figure 2 is a schematic structural diagram of a resource pool provided by an embodiment of the present application. The system includes a management node 10 and multiple physical machines 20. Each physical machine includes multiple virtual machines running on the physical machine. A virtual machine, a virtual machine monitor (VMM) 210, and a data collection module 220. The data collection module 220 may be a module in the VMM210 or a module other than the VMM210. In the embodiment of the present application, the data collection module 220 is a module other than the VMM210 as an example for description. The data collection module 220 is configured to collect the above-mentioned performance data and attribute data, and send the performance data and attribute data to the management node 10. The management node 10 is used to analyze the performance data and attribute data fed back by each physical machine and generate corresponding resource scheduling strategies. The management node 10 includes a data analysis module 110 and a management module 120. The data analysis module 110 is used to perform a data acquisition module 220 The collected data is analyzed, and the analysis result is sent to the management module 120, and the management module 120 generates a resource scheduling strategy according to the analysis result. It should be noted that the structure of each of the above physical machines is similar, except that the number of virtual machines deployed in each physical machine and the various physical resources that each physical machine can provide are different.

Based on the foregoing description, an embodiment of the present application provides a resource scheduling method. Refer to FIG. 3. FIG. 3 is a schematic flowchart of a resource scheduling method provided by an embodiment of the present application. The method includes:

S301. The physical machine obtains performance data and attribute data of each virtual machine.

In the embodiment of the present application, each physical machine has its own physical machine identification PMi, for example, the identification of physical machine 1 is PM1, the identification of physical machine 2 is PM2, and the identification of physical machine m is PMm. The virtual machine in each physical machine has a virtual machine identifier VMij, where i represents the i-th physical machine, j represents the j-th virtual machine, and VMij represents the j-th virtual machine in the i-th physical machine. For example, the virtual machine VM23 represents the third virtual machine in the physical machine 2.

The data acquisition module 220 in each physical machine includes a performance data acquisition module 2201 and an attribute data acquisition module 2202. The performance data collection module 2201 obtains the performance data of each virtual machine in the physical machine, and the attribute data collection module 2202 collects the attribute data of the data packet received by each physical machine. Among them, the performance data includes the CPU occupancy rate, memory occupancy rate, storage space occupancy rate, and bandwidth occupancy rate of each virtual machine, and the attribute data includes the source port number, destination port number, source IP address, and destination IP address of the data packet. The destination IP address is used to determine the destination virtual machine corresponding to the data packet, the destination port number is used to determine the type of service carried in the destination virtual machine corresponding to the destination IP address, and the source IP address and destination IP address are used to determine the two data exchanges. virtual machine. Exemplarily, the destination port number in the data packet is 110, which means that the services provided by the virtual machine receiving the data packet include mail service services. If the destination port number in the data packet is 80, it means that the virtual machine receiving the data packet Services provided by the machine include web services.

S302: The physical machine sends the acquired performance data and attribute data to the management node.

In the embodiment of the present application, the data sent by the performance data collection module 2201 to the management node 10 includes the identification of each virtual machine and the performance data corresponding to each virtual machine. The data sent by the attribute data collection module 2202 to the aforementioned management node 10 includes the physical machine identification of each physical machine and the attribute data of the data packet received by the physical machine. In a possible embodiment, the attribute data collection module 2202 may also determine the destination virtual machine to which each data packet is to be reached according to the destination IP address in each data packet, thereby sending the attribute data corresponding to each virtual machine To the management node 10.

S303. The management node receives the performance data and attribute data of each virtual machine sent by the physical machine.

The data collection module 220 in each of the aforementioned physical machines sends the collected performance data and attribute data to the management node 10 in a preset period, and the management node 10 receives the aforementioned performance data and attribute data, and sends the aforementioned performance data and attribute data. To the data analysis module 110 in the management node 10.

S304. The management node performs analysis according to the received performance data and attribute data to obtain an analysis result.

In the embodiment of the present application, the foregoing analysis result includes the category of each virtual machine in the resource pool and the relationship between the services running in the virtual machine. The data analysis module 110 includes a clustering module 1101 and a business analysis module 1102. The clustering module 1101 clusters the virtual machines according to the performance data of each virtual machine in the resource pool, and divides the virtual machines in the resource pool into multiple category. For example, virtual machines are divided into computing virtual machines, storage virtual machines, network virtual machines, computing and network virtual machines, and storage and network virtual machines. The business analysis module 1102 analyzes and obtains the relationship between the businesses running in the virtual machine according to the attribute data. After determining the type of the virtual machine and the relationship between the services in the virtual machine, the resource scheduling strategy of the resource pool is determined according to the type of the virtual machine and the relationship between the services.

Specifically, after the clustering module 1101 obtains the virtual machine identifier of each virtual machine and the performance data corresponding to each virtual machine identifier, it performs a calculation on the virtual machines in the resource pool according to the clustering algorithm and the performance data of each virtual machine. Clustering to obtain multiple categories of virtual machines. Among them, the clustering algorithm may be a K-means clustering algorithm, a mean shift clustering algorithm, a fuzzy clustering algorithm, etc., which are not limited in the embodiment of the present application. Exemplarily, the clustering module 1101 may use a fuzzy c-means clustering algorithm (FCM) to cluster the virtual machines according to the performance data corresponding to each virtual machine. The method of clustering virtual machines using the FCM algorithm includes the following steps:

(1) Establish a sample matrix based on the performance data of each virtual machine, standardize the data in the sample matrix, and convert the performance data into data between [0, 1]. The sample matrix includes M rows and N columns, where M is the number of samples, that is, the resource pool includes M virtual machines, and N is the number of indicators included in the performance data of each virtual machine. Performance data indicators include CPU usage, memory usage, storage space usage, and bandwidth usage. Each row of data in the sample matrix represents N performance data corresponding to a virtual machine, and each column is data of the same indicator for different virtual machines;

(2) Randomly divide the above M virtual machines into 5 categories;

(3) Calculate the cluster centers of each category, and obtain the initial cluster centers Ci,i ∈ {1, 2, 3, 4, 5};

Repeat the following operations in (4) and (5) until the membership function value of each sample converges:

(4) Use the current cluster center to calculate the membership function of each virtual machine;

(5) Use the membership function in (4) to recalculate the center of each cluster and cluster the virtual machines according to the new cluster center.

When the value of the membership function in (4) above does not change or the change value is less than the preset threshold, it is determined that the clustering result meets the requirements, and the clustering at this time is taken as the final virtual machine clustering result. It can be understood that the type of virtual machine can indicate the type of services carried in the virtual machine. For example, if the virtual machine VM12 is a computing virtual machine, it means that the virtual machine mainly needs CPU resources, and the services carried in the virtual machine are also the same. What is needed is CPU resources.

The service analysis module 1102 includes a feature configuration library and the corresponding relationship between the IP address and the virtual machine identifier. The feature configuration library indicates the relationship between the port number and the service, and the service analysis module 1102 determines the destination port number in the data packet. The service to which the data packet belongs, and the virtual machine corresponding to the data packet is determined according to the destination IP address in the data packet, thereby determining the virtual machine corresponding to the service, and obtaining the service carried by the virtual machine. For example, if the destination port number in a data packet collected by the attribute data collection module 2202 in the physical machine 1 is 80, it means that there are virtual machines in the physical machine that provide web services. Then, according to the destination IP address in the data packet, it is determined that the virtual machine identifier of the virtual machine corresponding to the destination IP address is VM12, which means that the virtual machine VM12 provides a web service service. Through the above method, the services carried by each virtual machine can be obtained.

Further, the data received by the service analysis module 1102 includes the identification of each physical machine and the attribute data of the data packet received by each physical machine. The service analysis module 1102 determines according to the source IP address and the destination IP address in the attribute data. Two virtual machines having an interactive relationship are determined, and the physical machine to which the two virtual machines having an interactive relationship belong is determined according to the physical machine identifier corresponding to the data packet. The above attribute data also includes the source port number and the destination port number of the data packet. After the service analysis module 1102 determines the two virtual machines that have an interactive relationship, it can further determine the destination port number in the data packet sent by the two virtual machines. Determine the services carried in each virtual machine. Exemplarily, if the source IP address in the first data packet received by physical machine 1 is the address of VM24, the destination IP address is the address of VM13 in physical machine 1, the source port number in the first data packet is a, and the destination port The number is b. The source IP address in the second data packet received in physical machine 2 is the address of VM13, the destination IP address is the address of VM24 in physical machine 2, the source port number in the first data packet is b, and the destination port number is a , VM13 in physical machine 1 and VM24 in physical machine 2 have an interactive relationship, and business 1 in physical machine 1 is related to business 2 in physical machine 2. If the data volume of the first data packet is the same as that of the second data packet The difference between the data volume of is less than the preset difference threshold, it means that service 1 and service 2 are in a two-way relationship. If the difference between the data volume of the first data packet and the data volume of the second data packet is greater than or equal to the preset difference Threshold, for example, the data volume of the first data packet is greater than the data volume of the second data packet and the difference is greater than or equal to the preset difference threshold, it means that service 1 mainly provides data for service 2, that is, service 1 and service 2 are dependent relationship.

S305. The management node schedules the virtual machine according to the analysis result.

After the data analysis module 110 classifies the virtual machines in the resource pool to obtain multiple types of virtual machines, the management module 120 determines the resource usage index of the resource pool according to the resource allocation data and resource usage data of the multiple virtual machines in each category Pu and resource performance index Ru. Among them, resource allocation data refers to the amount of resources allocated to each virtual machine, including CPU resources, memory resources, bandwidth resources, and storage resources; resource usage data refers to the resources used by each virtual machine, including CPU usage and memory usage , Storage space occupation and bandwidth occupation, the above resource usage data can be calculated based on the performance data corresponding to each virtual machine and the above resource allocation data, or it can be collected by the above performance data collection module 2201 and used as part of the performance data Sent to the management node.

After determining the resource usage index Pu and the resource performance index Ru of the resource pool, it is determined whether to schedule the virtual machine according to a preset condition. If improving the comprehensive utilization of the resource pool as the goal of resource scheduling, the value of the comprehensive utilization of the resource pool is U=Pu/Ru, then when the value of U is greater than or equal to the preset comprehensive utilization threshold, the virtual machine is not Scheduling, when the value of U is less than the preset comprehensive utilization threshold, the virtual machine is scheduled. If the performance of the resource pool is prioritized as the resource scheduling target, when Ru is greater than or equal to the resource performance indicator threshold, the virtual machine is not scheduled, and when Ru is less than the resource performance indicator threshold, the virtual machine is scheduled. If the resource usage rate of the resource pool is prioritized as the resource scheduling target, when the value of Pu is greater than or equal to the resource usage index threshold, the virtual machine is not scheduled, and when the value of Pu is less than the resource usage index threshold, the virtual machine is Scheduling.

When it is determined according to the above method that virtual machines need to be scheduled, for example, to improve the comprehensive utilization of the resource pool as the goal of resource scheduling, when the value of U is less than the preset comprehensive utilization threshold, according to the relationship between the above-mentioned services, virtual The category to which the machine belongs and the demand for resources of the virtual machine determined according to the category of the virtual machine, determine the strategy for scheduling the virtual machine in the resource pool, and after the virtual machine is scheduled according to the scheduling strategy, perform the above S301~S305 again Step: Calculate the scheduled Pu and Ru until the value of U is greater than or equal to the preset comprehensive utilization threshold. The above strategies include migrating the virtual machines of two services with one-way relationship, two-way relationship or dependent relationship to the same physical machine, or transferring two virtual machines with one-way relationship, two-way relationship or dependent relationship to the same physical machine. Machines are migrated to two similar physical machines, where similarity means that the path overhead for data transmission from one physical machine to another physical machine is small. For example, business a runs in virtual machine VM11, business b runs in virtual machine VM54, and there is a two-way relationship between business a and business b, then virtual machine VM54 can be migrated from physical machine 5 to physical machine 1, so that the virtual The machine VM11 and the virtual machine VM54 are located in the same physical machine. If service b requires CPU resources, the CPU occupancy rate of physical machine 1 is relatively high, the path cost between physical machine 1 and physical machine 2 is less than the path cost between physical machine 1 and physical machine 5, and the cost of physical machine 2 If the CPU usage is low, VM54 is migrated to physical machine 2.

In a possible implementation manner, the management module 120 obtains resource occupancy data of each virtual machine in each type of virtual machine, calculates the resource usage index of each type of virtual machine, and then calculates the resource usage index of the resource pool. . Among them, the resource occupation data includes CPU occupation, memory occupation, storage space occupation, and bandwidth occupation. Exemplarily, after obtaining the resource occupation data of each virtual machine in the i-th category of virtual machines, the management module 120 calculates the average value of each type of data to obtain the resource occupation data P _{i corresponding to the i-th category of virtual machines.} ={p _icpu , p _imem , p _isto , p _bw }, where p _icpu represents the average CPU usage of virtual machines in _{the i-th category, p imem} represents the average memory usage of virtual machines in the i-th category, p _isto represents the average storage space occupied by virtual machines of the i-th category, r _ibw represents the average bandwidth occupied by virtual machines of the i-th category, and the resource usage index P _i of the virtual machines of the i-th category can be expressed as:

Among them, a, b, c, and d represent the coefficients of the corresponding physical resources. Then the resource usage index P _u of the resource pool is:

Among them, n is the number of categories of virtual machines.

The management module 120 obtains the resource allocation data of each virtual machine in each type of virtual machine, calculates the resource performance index of each type of virtual machine, and then calculates the resource performance index of the resource pool. After the management module 120 obtains the resource allocation data of each virtual machine in the i-th category of virtual machines, it calculates the average value of each type of data to obtain the resource allocation data corresponding to the i-th category of virtual machines, R _i ={r _icpu , r _imem , r _isto , r _ibw }, where r _icpu represents the average value of the CPU allocated by the virtual machine of the i-th category, _rimem represents the average memory allocated by the virtual machine of the i-th category, and r _isto Represents the average value of the storage space allocated by the virtual machines of the i-th category, r _ibw represents the average value of the bandwidth allocated by the virtual machines of the i-th category, then the resource performance index R _i of the virtual machines of the i-th category can be expressed as :

Among them, x, y, z, w are coefficients corresponding to physical resources. Then the resource performance index _Ru of the resource pool is:

By implementing the above-mentioned embodiments, each physical machine in the resource pool periodically obtains the performance data of each virtual machine and the attribute data of the data packets received in each physical machine, and combines the obtained performance data and attribute data Sent to the management node, the management node clusters the virtual machines in the resource pool according to the above-mentioned performance data, and perceives the perception of the services carried in the virtual machine according to the address information and port number information in the above-mentioned attribute data, and the virtual machine The relationship between the services carried. The management node determines whether the resources in the resource pool need to be scheduled based on the clustered performance data of each category of virtual machine. When resources need to be scheduled, the management node determines the virtual machine's status according to the category to which the virtual machine belongs. For the resources required by the business, the resources in the resource pool are scheduled according to the resources described in the business and the connections between the services, so that when the resources in the resource pool are scheduled, the services in the virtual machine can be sensed to determine the business needs The resource is scheduled according to the resource required by the obligation and the relationship between the services, so that the resources in the resource pool can be scheduled to better meet the actual business needs.

It is worth noting that for the above method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described sequence of actions. Secondly, Those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present invention.

Based on the content described above, those skilled in the art can think of other reasonable step combinations that also fall within the protection scope of the present invention. Secondly, those skilled in the art should also be familiar with that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present invention.

The resource scheduling method provided by the embodiment of the present application is described in detail above with reference to FIG. 1 to FIG. 3. The following describes related devices and equipment for implementing resource scheduling provided by the embodiment of the present application with reference to FIG. 4 and FIG. 5. FIG. 4 is a schematic structural diagram of a resource scheduling device provided by an embodiment of the present application. The resource scheduling device 400 is deployed in the above-mentioned management node 10 to realize the functions of the above-mentioned management node 10. The resource scheduling device 400 includes a communication unit 410 and a processing unit 420, where:

The communication unit 410 is configured to receive performance data and attribute data sent by each physical machine in the resource pool, where the performance data includes physical resource information of each virtual machine in the resource pool, and the attribute data includes the port of the received data packet Number and address information. Specifically, the communication unit 410 executes the receiving and sending actions of the management node 10, such as the receiving performance data and the attribute data described in S303 in FIG. 3, which will not be repeated here.

The processing unit 420 is configured to cluster multiple virtual machines in the resource pool according to the above-mentioned performance data to obtain multiple virtual machine clusters; and determine the business relationship between the services in the above-mentioned multiple virtual machines according to the above-mentioned attribute data. The method for the processing unit 420 to cluster the virtual machines in the above resource pool can refer to the method executed by the clustering module 1101 in the above S304, and the method for the processing unit 420 to determine the relationship between the services carried in the virtual machines according to the attribute data can refer to The method executed by the service analysis module 1102 in the foregoing S304 will not be repeated in this embodiment of the application.

The processing unit 420 is further configured to determine the scheduling of the resources in the resource pool according to the performance data of each virtual machine cluster in the multiple virtual machine clusters, and then, according to the business relationship between the services in the multiple virtual machine clusters, The resources in the resource pool are scheduled. The group member scheduling includes migration of some virtual machines, overproportional scheduling, NUMA aggregation, and so on. Specifically, the method for the processing unit 420 to determine whether to schedule the resources in the virtual machine may refer to the above S305. The management module 120 determines based on the resource usage index and the resource performance index to determine whether to schedule the resources. In the case that the processing unit 420 determines to schedule the resources in the resource pool, the strategy for the processing unit 420 to schedule the resources can refer to the strategy for scheduling resources generated by the management module 120 in S305 according to the relationship between the services. This will not be repeated here.

The communication unit 420 is also used for the processing unit 420 after determining to schedule the resources in the resource pool and generating a resource scheduling policy according to the relationship between services, the communication unit 420 is also used for sending the resource scheduling policy to the resource pool In order to make the physical machine receiving the resource scheduling policy perform resource scheduling according to the resource scheduling side rate.

Specifically, the operation of the resource scheduling apparatus 300 to implement resource scheduling may refer to the operations performed by the management node 10 in the foregoing method embodiment, and details are not described herein again.

FIG. 5 is a schematic structural diagram of a computing device provided by an embodiment of the application. The computing device 500 implements the function of the management node 10 in the foregoing embodiment and executes the resource scheduling method in the foregoing embodiment. The resource scheduling device 500 includes at least: a processor 510, a communication interface 520, and a memory 530. Optionally, the processor 510, the communication interface 520, and the memory 530 are connected to each other through a bus 540, where:

The processor 510 is configured to implement the operations performed by the above-mentioned data analysis module 110 and the management module 120. The specific implementation of the various operations performed by the processor 510 may refer to the specific operations performed by the management node 10 in the foregoing method embodiment. For example, the processor 510 is configured to perform operations of the management node 10 in S304 and S305 in FIG.

The processor 510 may have a variety of specific implementation forms. For example, the processor 510 may be a central processing unit (CPU) or a graphics processing unit (GPU), and the processor 510 may also be a single-core processor or Multi-core processor. The processor 510 may be a combination of a CPU and a hardware chip. The above-mentioned hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof. The processor 510 may also be implemented by a logic device with built-in processing logic alone, such as an FPGA or a digital signal processor (digital signal processor, DSP).

The communication interface 520 can be a wired interface or a wireless interface for communicating with other modules or devices. The wired interface can be an Ethernet interface, a local interconnect network (LIN), etc., and the wireless interface can be a cellular network interface or use Wireless LAN interface, etc.

In the embodiment of the present application, the communication interface 520 executes the receiving and sending operations of the management node 10, for example, can be used to execute the performance data and attribute data of the virtual machine sent by the user terminal in S303, which will not be repeated here.

The memory 530 may be a non-volatile memory, for example, read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), Electrically erasable programmable read-only memory (EPROM, EEPROM) or flash memory. The memory 530 may also be a volatile memory, and the volatile memory may be a random access memory (RAM), which is used as an external cache.

The memory 530 may also be used to store instructions and data, so that the processor 510 can call the instructions stored in the memory 530 to implement the operations performed by the data analysis module 110 and the management module 120, such as the clustering operation of virtual machines in the foregoing method embodiment. . In addition, the computing device 500 may include more or fewer components than those shown in FIG. 5, or may have different component configurations.

The bus 540 may be a peripheral component interconnect standard (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus 540 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used to represent in FIG. 5, but it does not mean that there is only one bus or one type of bus.

Optionally, the server 500 may further include an input/output interface 550, and the input/output interface 550 is connected to an input/output device for receiving input information and outputting operation results.

Specifically, for the specific implementation of various operations performed by the aforementioned coordination server 500, reference may be made to the specific operations performed by the management node in the foregoing method embodiments, and details are not described herein again.

The embodiments of the present application also provide a non-transitory computer-readable storage medium in which a computer program is stored. When the computer program runs on a processor, the management node in the above-mentioned method embodiment can be implemented. For the method steps to be executed, the processor of the computer storage medium may refer to the specific operations of the management node in the method embodiment for the specific implementation of the above method steps, which will not be repeated here.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For a part that is not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.

The above-mentioned embodiments may be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above-mentioned embodiments may be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded or executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more sets of available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium. The semiconductor medium may be a solid state drive (SSD).

The steps in the method in the embodiment of the present application may be sequentially scheduled, merged, or deleted according to actual needs; the modules in the device in the embodiment of the present application may be divided, merged, or deleted according to actual needs.

The embodiments of the application are described in detail above, and specific examples are used in this article to illustrate the principles and implementation of the application. The descriptions of the above embodiments are only used to help understand the methods and core ideas of the application; at the same time, for Those of ordinary skill in the art, based on the idea of the application, will have changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as a limitation to the application.

Claims (10)

1. A resource scheduling method, characterized in that it comprises:

   Acquire performance data of each virtual machine and attribute data of each virtual machine in the multiple virtual machines in the resource pool, where the performance data includes physical resource information of each virtual machine, and the attribute data includes data packets Port number information and address information;

   Clustering the multiple virtual machines according to the performance data to obtain multiple virtual machine clusters;

   Determining the business relationship between the services in the multiple virtual machines according to the attribute data;

   When it is determined to schedule the virtual machines in the resource pool according to the performance data of the virtual machines in each virtual machine cluster, the virtual machines in the resource pool are determined according to the business relationship between the services in the multiple virtual machines. Machine for scheduling.
2. The method according to claim 1, wherein the determining, according to the performance data of the virtual machines in each virtual machine cluster, to schedule the virtual machines in the resource pool comprises:

   Acquire the resource usage data of each virtual machine in each virtual machine cluster, determine the resource usage index of each virtual machine cluster, and determine the resource usage index of the resource pool according to the resource usage index of each virtual machine cluster Resource usage indicators;

   Acquiring the resource allocation data of each virtual machine in each virtual machine cluster, determining the resource performance index of each virtual machine cluster, and determining the resource performance index of the resource pool according to the resource performance index of each virtual machine cluster;

   According to the resource usage index of the resource pool and the resource performance index of the resource pool, it is determined to schedule the resources in the resource pool.
3. The method according to claim 2, wherein the determining to schedule the resources in the resource pool according to the resource usage index of the resource pool and the resource performance index of the resource pool comprises:

   In the case where the ratio of the resource usage index to the resource performance index of the resource pool is less than the first threshold, determine to schedule the resources in the resource pool; or,

   In the case that the resource performance index of the resource pool is less than the second threshold, determine to schedule the resources in the resource pool; or,

   In the case that the resource usage index of the resource pool is less than the third threshold, it is determined to schedule the resources in the resource pool.
4. The method according to any one of claims 1 to 3, wherein the scheduling of the resources in the resource pool according to the business relationship between the services in the multiple virtual machines comprises:

   When it is determined that there is an association relationship between the first service in the first virtual machine and the second service in the second virtual machine, migrate the first virtual machine and the second virtual machine to the same physical machine , Or, migrating the first virtual machine to a first physical machine, and migrating the second virtual machine to a second physical machine, and the path overhead between the first physical machine and the second physical machine is less than The path overhead between the third physical machine and the fourth physical machine, where, before the virtual machine is migrated, the first virtual machine is located in the third physical machine, and the second virtual machine is located in the fourth physical machine , The association relationship includes a dependency relationship, a one-way relationship, a two-way relationship, and a family relationship.
5. A resource scheduling device, characterized in that the device includes:

   The communication unit is configured to: obtain performance data of each virtual machine in the multiple virtual machines in the resource pool, where the performance data includes physical resource information of each virtual machine;

   Acquiring attribute data of a data packet corresponding to each of the multiple virtual machines in the resource pool, where the attribute data includes port number information and address information of the data packet;

   A processing unit, configured to: cluster the multiple virtual machines according to the performance data to obtain multiple virtual machine clusters;

   Determining the business relationship between the services in the multiple virtual machines according to the attribute data;

   When determining to schedule the virtual machines in the resource pool according to the performance data of the virtual machines in each virtual machine cluster, according to the business relationship between the services in the multiple virtual machines, Resources for scheduling.
6. The device according to claim 5, wherein the processing unit is specifically configured to:

   Acquire the resource usage data of each virtual machine in each virtual machine cluster, determine the resource usage index of each virtual machine cluster, and determine the resource usage index of the resource pool according to the resource usage index of each virtual machine cluster Resource usage indicators;

   Acquiring the resource allocation data of each virtual machine in each virtual machine cluster, determining the resource performance index of each virtual machine cluster, and determining the resource performance index of the resource pool according to the resource performance index of each virtual machine cluster;

   According to the resource usage index of the resource pool and the resource performance index of the resource pool, it is determined to schedule the resources in the resource pool.
7. The device according to claim 6, wherein the processing unit is specifically configured to:

   In the case where the ratio of the resource usage index to the resource performance index of the resource pool is less than the first threshold, determine to schedule the resources in the resource pool; or,

   In the case that the resource performance index of the resource pool is less than the second threshold, determine to schedule the resources in the resource pool; or,

   In the case that the resource usage index of the resource pool is less than the third threshold, it is determined to schedule the resources in the resource pool.
8. The device according to any one of claims 5 to 7, wherein the processing unit is specifically configured to:

   When it is determined that there is an association relationship between the first service in the first virtual machine and the second service in the second virtual machine, migrate the first virtual machine and the second virtual machine to the same physical machine , Or, migrating the first virtual machine to a first physical machine, and migrating the second virtual machine to a second physical machine, and the path overhead between the first physical machine and the second physical machine is less than The path overhead between the third physical machine and the fourth physical machine, where, before the virtual machine is migrated, the first virtual machine is located in the third physical machine, and the second virtual machine is located in the fourth physical machine , The association relationship includes a dependency relationship, a one-way relationship, a two-way relationship, and a family relationship.
9. A computing device, characterized by comprising a processor and a memory, the memory is used to store instructions, the processor is used to execute the instructions, and when the processor executes the instructions, the computing device executes The method of any one of claims 1 to 4.
10. A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes any one of claims 1 to 4 Methods.

Images