CN111880914A - Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium - Google Patents
Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium Download PDFInfo
- Publication number
- CN111880914A CN111880914A CN202010701825.1A CN202010701825A CN111880914A CN 111880914 A CN111880914 A CN 111880914A CN 202010701825 A CN202010701825 A CN 202010701825A CN 111880914 A CN111880914 A CN 111880914A
- Authority
- CN
- China
- Prior art keywords
- resource pool
- resource
- physical machine
- target
- utilization rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000015654 memory Effects 0.000 claims description 20
- 230000004048 modification Effects 0.000 claims description 6
- 238000012986 modification Methods 0.000 claims description 6
- 238000004364 calculation method Methods 0.000 claims description 4
- 239000000126 substance Substances 0.000 claims description 2
- 238000013467 fragmentation Methods 0.000 abstract description 8
- 238000006062 fragmentation reaction Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000013468 resource allocation Methods 0.000 description 2
- 238000004088 simulation Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a resource scheduling method, a resource scheduling device, electronic equipment and a storage medium, and relates to the technical field of cloud servers or cloud computing platforms. The resource scheduling method comprises the following steps: under the condition that the resource utilization rate of a target resource pool is greater than a first threshold value, selecting a target idle physical machine matched with the target resource pool from an idle physical machine set, wherein the target resource pool does not contain the target idle physical machine; and changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool. According to the method and the device, resources can be expanded for the resource pool without newly adding hardware resources, so that the resource pool can better meet the requirements of more users or more services, the problems of resource idling and low resource utilization rate caused by resource fragmentation can be solved, and the method and the device can be used for cloud services or cloud platforms.
Description
Technical Field
The present application relates to a resource scheduling technology, and in particular, to the technical field of a cloud server or a cloud computing platform, and in particular, to a resource scheduling method, a resource scheduling apparatus, an electronic device, and a storage medium.
Background
The cloud computing platform (or called cloud server platform) can provide convenient resource service for users, and with the increase of the number of users and the diversification of service types, the resources of the cloud computing platform become more and more fragmented, which may not meet the requirements of some users or some services. However, the problem of resource fragmentation cannot be solved in this way, which results in that the computing power of the cloud computing platform cannot be fully utilized, so that the cloud computing platform resources are idle, and the utilization rate of the cloud computing platform resources is low.
Disclosure of Invention
The application provides a resource scheduling method, a resource scheduling device, an electronic device and a storage medium.
According to a first aspect, the present application provides a resource scheduling method, including:
under the condition that the resource utilization rate of a target resource pool is greater than a first threshold value, selecting a target idle physical machine matched with the target resource pool from an idle physical machine set, wherein the target resource pool does not contain the target idle physical machine;
and changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
According to a second aspect, the present application provides a resource scheduling apparatus, comprising:
the selection module is used for selecting a target idle physical machine matched with a target resource pool from an idle physical machine set under the condition that the resource utilization rate of the target resource pool is greater than a first threshold, wherein the target resource pool does not contain the target idle physical machine;
and the changing module is used for changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
According to a third aspect, the present application provides an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any one of the methods of the first aspect.
According to a fourth aspect, the present application provides a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform any of the methods of the first aspect.
According to the technology of the application, when the resource utilization rate of the target resource pool exceeds a certain threshold value, the idle physical machine matched with the target resource pool is selected from other resource pools, and the idle physical machine is allocated to the target resource pool for use by changing the resource pool information of the idle physical machine, so that resources can be expanded for the target resource pool under the condition that no hardware resources are required to be added, the target resource pool can better meet the requirements of more users or more services, and the problems of resource idling and low resource utilization rate caused by resource fragmentation can be solved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a flowchart illustrating a resource scheduling method according to a first embodiment of the present application;
FIG. 2 is a schematic diagram of an overall architecture of resource scheduling according to a first embodiment of the present application;
fig. 3 is a schematic structural diagram of a resource scheduling apparatus according to a second embodiment of the present application;
fig. 4 is a block diagram of an electronic device for implementing a resource scheduling method according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
First embodiment
As shown in fig. 1, the present application provides a resource scheduling method, which includes the following steps:
step 101: under the condition that the resource utilization rate of a target resource pool is greater than a first threshold value, selecting a target idle physical machine matched with the target resource pool from an idle physical machine set, wherein the target resource pool does not contain the target idle physical machine;
step 102: and changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
The resource scheduling method in the embodiment of the application can be applied to application scenarios such as a distributed computing platform, a cloud server platform, a public cloud server platform (which may be referred to as a platform for short), and the like, wherein the platforms generally comprise a plurality of resource pools, each resource pool can be generally composed of one or more physical machines, and the physical machines can also be referred to as bottom-layer hardware resources.
In the resource scheduling method of the embodiment of the present application, the execution subject may be a resource scheduling device, or a control module in the resource scheduling device for executing the resource scheduling method. The resource scheduling device may be a stand-alone device, or may be a component, an integrated circuit, or a chip in an electronic apparatus. The resource scheduling device may be a mobile electronic device or a non-mobile electronic device. The resource scheduling device may be a device having an operating system, and the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which is not specifically limited in this application.
In order to make the resource pool of the platform available to the user, the resource pool generally needs to have enough available resources, and the more available resources of the resource pool, the higher the selectivity of the resource pool for the user is, and the higher the available performance of the resource pool is. Therefore, in order to ensure the availability performance of the resource pool, the resource usage rate of the resource pool may be controlled within a first threshold (e.g., 60%, 70%, etc.). Because the resources of the resource pool are limited, when the resource utilization rate of the resource pool exceeds the first threshold, the available resources are generally expanded for the resource pool by adopting a manner of adding new hardware resources in the prior art, but the cost required by adding new hardware resources is higher. In addition, due to the randomness of user requirements or business requirements, the resource utilization rates of different resource pools are greatly different, so that the available performance of the different resource pools is different, the fragmentation of the platform resource pool is serious, the platform resource is seriously idle, and the utilization rate of the platform resource is low.
The free physical machines, which may also be referred to as inventory physical machines or inventory resources, each resource pool typically has more or less free physical machines, each free physical machine corresponding to a respective resource pool attribute, i.e., each free physical machine belongs to a respective resource pool.
Considering that the idle physical machine is in an unused or unoccupied state, the embodiment of the present application dynamically implements resource allocation or resource scheduling of the resource pool by changing the resource pool attribute (or resource pool attribution) of the idle physical machine. In view of this, when the resource usage rate of the target resource pool is greater than the first threshold, a target idle physical machine matching the target resource pool may be selected from the idle physical machine set, and the resource pool information of the target idle physical machine may be changed to the resource pool information of the target resource pool. Before the resource pool information of the target idle physical machine is changed, the target idle physical machine does not belong to the resources of the target resource pool, but belongs to the resources of other resource pools, and after the resource pool information of the target idle physical machine is changed, the target idle physical machine belongs to the resources of the target resource pool.
The matching of the target idle physical machine and the target resource pool may indicate that the resource size of the target idle physical machine matches the target resource pool, may also indicate that the configuration parameter or the performance parameter of the target idle physical machine meets the requirement of the related service on the target resource pool, and so on.
The number of the target idle physical machines selected by the resource scheduling device can be one or more, and the resource scheduling device can flexibly select an appropriate number of idle physical machines according to the resource requirements of the target resource pool, the resource size of the idle physical machines and other factors.
In the embodiment of the present application, a resource scheduling management program may be deployed on the resource scheduling apparatus, and the resource scheduling management program may be used to manage the resource pool attributes of each physical machine (i.e., manage the resource pool information of the physical machine), for example, may be used to change the resource pool information of the physical machine.
In the embodiment of the application, the resource pool attribute of the idle physical machine is changed, and the dynamic expansion of the available resources of the target resource pool can be realized without newly adding hardware resources, so that the target resource pool can better meet the requirements of more users or more services, the availability of the target resource pool is improved, and the problems of resource idle and low resource utilization rate caused by resource fragmentation can be solved.
Optionally, after selecting a target idle physical machine matching the target resource pool from the idle physical machine set, the method further includes:
under the setting that the resource pool of the target idle physical machine is the target resource pool, simulating and calculating the resource utilization rate of each resource pool in the full-platform resource pool set;
and if the resource utilization rate of each resource pool in the full-platform resource pool set is smaller than or equal to the first threshold value, executing the step of setting the resource pool information of the target idle physical machine as the resource pool information of the target resource pool.
The full platform resource pool set may be understood as a set of all resource pools included in the platform, for example, if the platform includes N resource pools, the full platform resource pool set includes the N resource pools, where N is an integer greater than 1.
In this embodiment, after the target idle physical machine matching the target resource pool is selected, the resource usage rate of each resource pool in the full-platform resource pool set after the resource pool to which the target idle physical machine belongs is modified into the target resource pool may be calculated in a simulated manner, and if the resource usage rate of each resource pool in the full-platform resource pool set calculated in the simulated manner does not exceed the first threshold, the resource pool to which the target idle physical machine belongs may be adjusted. If the resource pool with the resource utilization rate exceeding the first threshold value exists in the full platform resource pool set of the simulation calculation, other idle physical machines matched with the target resource pool can be selected again, and the steps of the simulation calculation are repeatedly executed until the appropriate target idle physical machine is selected.
Therefore, the resource utilization rate of other resource pools is prevented from exceeding a first threshold value due to the adjustment of the resource pool to which the target idle physical machine belongs, the resource utilization rate of each resource pool in the full platform resource pool set can be kept in a better state, the overall availability of the full platform resource pool set is higher, the problems of full platform resource fragmentation and resource idling can be integrally and comprehensively solved, and the overall resource utilization rate of the full platform is improved.
Optionally, the method further includes:
acquiring the resource utilization rate of each physical machine in a full-platform physical machine set;
and calculating the resource utilization rate of each resource pool in the full-platform resource pool set according to the resource utilization rate of each physical machine in the full-platform physical machine set and the resource pool information of each physical machine so as to detect the target resource pool of which the resource utilization rate is greater than the first threshold value in the full-platform resource pool set.
The full-platform physical machine set may be understood as a set of all physical machines included in the platform, for example, if the platform includes M physical machines, the full-platform physical machine set includes the M physical machines, and M is an integer greater than 1. Generally, the number of physical machines included in the full platform physical machine set is greater than the number of resource pools included in the full platform resource pool set, i.e., M is greater than N.
Since each resource pool is composed of one or more physical machines, and the resource utilization rate of the resource pool is actually the resource utilization rate of the physical machine in the resource pool, in this embodiment, in order to accurately calculate the resource utilization rate of the resource pool, the resource utilization rate of each resource pool in the full-platform resource pool set may be calculated according to the resource utilization rates of the physical machines and the resource pool to which the physical machine belongs. By calculating the resource utilization rate of each resource pool in the full-platform resource pool set, the target resource pool with the resource utilization rate exceeding the first threshold can be found or detected in time.
In this embodiment, the resource scheduling device may obtain the resource utilization rate of each physical machine in the full-platform physical machine set according to a preset period, or may obtain the resource utilization rate of each physical machine in the full-platform physical machine set in real time.
In this embodiment, the resource view storage program may be deployed on the resource scheduling apparatus. Wherein, the resource view storage program can be used to acquire and store the resource usage of the full platform physical machine (i.e. the resource usage view of the full platform physical machine). The resource view storage program not only stores the resource use view of the full-platform physical machine, but also can generate the resource use view of the full-platform resource pool set according to the resource use view of the full-platform physical machine so as to obtain the resource use rate of each resource pool in the full-platform resource pool set.
In addition, instead of generating the resource usage view of the full-platform resource pool set by the resource view storage program, the resource usage view of the full-platform resource pool set may be generated by a resource scheduling manager deployed on the resource scheduling device. Specifically, the resource scheduling management program generates a resource usage view of the full-platform resource pool set based on the resource usage view of the full-platform physical machine stored by the resource view storage program and the resource pool information of each physical machine. Therefore, the resource scheduling management program can calculate the resource allocation scheme of the idle physical machine based on the resource use view of the full platform resource pool set, and realize the dynamic scheduling of the platform resources.
Optionally, the obtaining the resource utilization rate of each physical machine in the full-platform physical machine set includes:
and acquiring the reported resource utilization rate of each physical machine in the full-platform physical machine set.
In this embodiment, each physical machine in the full-platform physical machine set may report its resource usage rate to the resource scheduling device according to a preset period, or may report its resource usage rate to the resource scheduling device in real time.
In this embodiment, a resource view acquisition program may be deployed on the physical machine, and the resource view acquisition program may be used to dynamically calculate resource usage conditions of the physical machine, for example, parameters such as a total resource amount, a resource usage amount, and a resource margin of the physical machine, to generate a resource usage view of the physical machine, and may also be used to push the resource usage view of the physical machine, that is, to push the resource usage view of the physical machine to a resource view storage program deployed on the resource scheduling device.
In the embodiment, the resource utilization rate is reported to the resource scheduling device actively through the physical machine, so that the reliability and timeliness of the data of the resource utilization rate of the physical machine are ensured, and the resource scheduling effect is improved.
Optionally, the selecting, when it is detected that the resource usage rate of the target resource pool is greater than a first threshold, a target idle physical machine matched with the target resource pool from an idle physical machine set includes:
under the condition that the resource utilization rate of the target resource pool is detected to be larger than a first threshold value, acquiring information of each idle physical machine in the idle physical machine set;
and selecting a target idle physical machine matched with the target resource pool from the idle physical machine set according to the information of each idle physical machine in the idle physical machine set.
The information of the idle physical machine may include information of a total amount of resources of the physical machine, configuration parameters of the physical machine (e.g., CPU configuration parameters of the physical machine, etc.), performance parameters of the physical machine (e.g., operating speed of the physical machine, etc.), and the like.
In this embodiment, the resource scheduling apparatus may obtain the free physical machine list (i.e., the free physical machine set) according to the physical machine resource view reported by the resource view acquisition program, and then obtain the information of the free physical machine, and according to the information of the free physical machine, may find the target free physical machine matching the target resource pool.
In the embodiment, the target idle physical machine matched with the target resource pool is selected by acquiring the information of the idle physical machine, the implementation process is simple and reliable, and the resource scheduling effect is improved.
Optionally, the method further includes:
acquiring the resource utilization rate of each resource pool in a full-platform resource pool set in a first historical time period;
predicting the resource utilization rate of each resource pool in the full-platform resource pool set in a preset time period according to the resource utilization rate in the first historical time period;
and according to the resource utilization rate in the preset time period, performing resource pool information adjustment on a physical machine in a first type of resource pool in the full-platform resource pool set, wherein the resource utilization rate in the preset time period is less than or equal to a second threshold value, and the second threshold value is less than or equal to the first threshold value.
In this embodiment, as an example, the resource scheduling management program may periodically or aperiodically obtain resource usage history data of the full-platform physical machine within a period of time (i.e., a first history time period) from the resource view storage program, generate a resource usage trend view of the full-platform resource pool set in combination with the resource pool to which the physical machine belongs, predict resource usage changes of the resource pool within a future period of time (i.e., a preset time period) in combination with a machine learning algorithm, generate a resource usage prediction report according to the prediction result, and perform capacity reduction on the resource pool (i.e., a first type resource pool) where resources may be abundant (i.e., the resource usage in the preset time period is less than or equal to a second threshold). Accordingly, a resource pool (which may be referred to as a second type resource pool) in which resources may be in short supply (i.e., the resource usage rate in a preset time period is greater than a first threshold) is expanded.
In the embodiment, the resource utilization rate of the resource pool in a future period of time is predicted by the resource utilization rate of the resource pool in a historical period of time, and scheduling of platform resources can be deployed in advance, so that the problem that the platform cannot meet user or service requirements due to insufficient resources of the resource pool can be reduced to the maximum extent, cost pressure caused by idle resources can be reduced to the maximum extent, and the platform resource utilization rate can be improved to the maximum extent.
In addition, the resource scheduling device, specifically, the resource scheduling management program may further generate a resource adjustment report according to each resource adjustment, including an adjustment scheme, an adjustment result, an exception report, and the like, for reference, review, exception handling, and the like by the platform operation and maintenance staff.
For better understanding of the resource scheduling method provided in the embodiment of the present application, fig. 2 shows an overall architecture diagram of resource scheduling of the resource scheduling method, as an example. In fig. 2, the resource node corresponds to the platform physical machine, the management node corresponds to the resource scheduling device, and the upper layer service corresponds to a service that needs to use the platform resource. The relevant working principle of the overall architecture in fig. 2 can refer to the above contents, and is not described again to avoid repetition.
It should be noted that, the various optional embodiments in the resource scheduling method in the present application may be implemented in combination with each other, or may be implemented separately, and the present application is not limited thereto.
The above embodiments of the present application have at least the following advantages or benefits:
in the application, when the resource utilization rate of the target resource pool exceeds a certain threshold value, the idle physical machine matched with the target resource pool is selected from other resource pools, and the idle physical machine is allocated to the target resource pool for use by changing the resource pool information of the idle physical machine, so that resources can be expanded for the target resource pool under the condition that no new hardware resources are required, the target resource pool can better meet the requirements of more users or more services, and the problems of resource idleness and low resource utilization rate caused by resource fragmentation can be solved.
Second embodiment
As shown in fig. 3, the present application provides a resource scheduling apparatus 200, including:
a selecting module 201, configured to select, when a resource usage rate of a target resource pool is greater than a first threshold, a target idle physical machine that matches the target resource pool from an idle physical machine set, where the target resource pool does not include the target idle physical machine;
a changing module 202, configured to change the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
Optionally, the resource scheduling apparatus 200 further includes:
the first computing module is used for simulating and computing the resource utilization rate of each resource pool in the full-platform resource pool set under the condition that the resource pool to which the target idle physical machine belongs is set as the target resource pool;
the modification module 202 is specifically configured to:
and if the resource utilization rate of each resource pool in the full-platform resource pool set is less than or equal to the first threshold value, setting the resource pool information of the target idle physical machine as the resource pool information of the target resource pool.
Optionally, the resource scheduling apparatus 200 further includes:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring the resource utilization rate of each physical machine in a full-platform physical machine set;
and the second calculation module is used for calculating the resource utilization rate of each resource pool in the full-platform resource pool set according to the resource utilization rate of each physical machine in the full-platform physical machine set and the resource pool information of each physical machine so as to detect the target resource pool of which the resource utilization rate is greater than the first threshold value in the full-platform resource pool set.
Optionally, the first obtaining module is specifically configured to:
and acquiring the resource utilization rate reported by each physical machine in the full-platform physical machine set according to the preset period.
Optionally, the selecting module 201 includes:
the acquisition unit is used for acquiring the information of each idle physical machine in the idle physical machine set under the condition that the resource utilization rate of the target resource pool is detected to be greater than a first threshold value;
and the selecting unit is used for selecting a target idle physical machine matched with the target resource pool from the idle physical machine set according to the information of each idle physical machine in the idle physical machine set.
Optionally, the resource scheduling apparatus 200 further includes:
the second acquisition module is used for acquiring the resource utilization rate of each resource pool in the full-platform resource pool set in the first historical time period;
the prediction module is used for predicting the resource utilization rate of each resource pool in the full-platform resource pool set in a preset time period according to the resource utilization rate in the first historical time period;
and the adjusting module is used for adjusting resource pool information of physical machines in a first type resource pool in the full-platform resource pool set according to the resource utilization rate within the preset time period, wherein the first type resource pool is a resource pool of which the resource utilization rate within the preset time period is smaller than or equal to a second threshold value, and the second threshold value is smaller than or equal to the first threshold value.
The resource scheduling apparatus 200 provided in the present application can implement each process in the foregoing resource scheduling method embodiments, and can achieve the same beneficial effects, and for avoiding repetition, the details are not repeated here.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 4 is a block diagram of an electronic device according to the resource scheduling method of the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 4, the electronic apparatus includes: one or more processors 601, memory 602, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 4, one processor 601 is taken as an example.
The memory 602 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor, so that the at least one processor executes the resource scheduling method provided by the present application. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the resource scheduling method provided by the present application.
The memory 602, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules (e.g., the selection module 201 and the modification module 202 shown in fig. 3) corresponding to the resource scheduling method in the embodiments of the present application. The processor 601 executes various functional applications and data processing of the resource scheduling apparatus by running non-transitory software programs, instructions and modules stored in the memory 602, that is, implements the resource scheduling method in the above method embodiments.
The memory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the electronic device by the resource scheduling method, and the like. Further, the memory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 602 optionally includes memory located remotely from the processor 601, and these remote memories may be connected over a network to the electronic device of the resource scheduling method. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the resource scheduling method may further include: an input device 603 and an output device 604. The processor 601, the memory 602, the input device 603 and the output device 604 may be connected by a bus or other means, and fig. 4 illustrates the connection by a bus as an example.
The input device 603 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device of the resource scheduling method, such as an input device of a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer, one or more mouse buttons, a track ball, a joystick, etc. The output devices 604 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), the internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, when the resource utilization rate of the target resource pool exceeds a certain threshold value, the idle physical machine matched with the target resource pool is selected from other resource pools, and the idle physical machine is allocated to the target resource pool for use by changing the resource pool information of the idle physical machine, so that resources can be expanded for the target resource pool under the condition that no hardware resource needs to be newly added, the target resource pool can better meet the requirements of more users or more services, and the problems of resource idle and low resource utilization rate caused by resource fragmentation can be solved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (14)
1. A method for scheduling resources, comprising:
under the condition that the resource utilization rate of a target resource pool is greater than a first threshold value, selecting a target idle physical machine matched with the target resource pool from an idle physical machine set, wherein the target resource pool does not contain the target idle physical machine;
and changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
2. The method of claim 1, wherein after said selecting a target free physical machine from a set of free physical machines that matches the target resource pool, the method further comprises:
under the setting that the resource pool of the target idle physical machine is the target resource pool, simulating and calculating the resource utilization rate of each resource pool in the full-platform resource pool set;
and if the resource utilization rate of each resource pool in the full-platform resource pool set is smaller than or equal to the first threshold value, executing the step of setting the resource pool information of the target idle physical machine as the resource pool information of the target resource pool.
3. The method of claim 1, further comprising:
acquiring the resource utilization rate of each physical machine in a full-platform physical machine set;
and calculating the resource utilization rate of each resource pool in the full-platform resource pool set according to the resource utilization rate of each physical machine in the full-platform physical machine set and the resource pool information of each physical machine so as to detect the target resource pool of which the resource utilization rate is greater than the first threshold value in the full-platform resource pool set.
4. The method of claim 3, wherein the obtaining the resource usage rate of each physical machine in the full-platform set of physical machines comprises:
and acquiring the reported resource utilization rate of each physical machine in the full-platform physical machine set.
5. The method of claim 1, wherein selecting a target idle physical machine from the set of idle physical machines matching the target resource pool in the case that the resource usage of the target resource pool is detected to be greater than a first threshold value comprises:
under the condition that the resource utilization rate of the target resource pool is detected to be larger than a first threshold value, acquiring information of each idle physical machine in the idle physical machine set;
and selecting a target idle physical machine matched with the target resource pool from the idle physical machine set according to the information of each idle physical machine in the idle physical machine set.
6. The method of claim 1, further comprising:
acquiring the resource utilization rate of each resource pool in a full-platform resource pool set in a first historical time period;
predicting the resource utilization rate of each resource pool in the full-platform resource pool set in a preset time period according to the resource utilization rate in the first historical time period;
and according to the resource utilization rate in the preset time period, performing resource pool information adjustment on a physical machine in a first type of resource pool in the full-platform resource pool set, wherein the resource utilization rate in the preset time period is less than or equal to a second threshold value, and the second threshold value is less than or equal to the first threshold value.
7. A resource scheduling apparatus, comprising:
the selection module is used for selecting a target idle physical machine matched with a target resource pool from an idle physical machine set under the condition that the resource utilization rate of the target resource pool is greater than a first threshold, wherein the target resource pool does not contain the target idle physical machine;
and the changing module is used for changing the resource pool information of the target idle physical machine into the resource pool information of the target resource pool.
8. The apparatus of claim 7, further comprising:
the first computing module is used for simulating and computing the resource utilization rate of each resource pool in the full-platform resource pool set under the condition that the resource pool to which the target idle physical machine belongs is set as the target resource pool;
the modification module is specifically configured to:
and if the resource utilization rate of each resource pool in the full-platform resource pool set is less than or equal to the first threshold value, setting the resource pool information of the target idle physical machine as the resource pool information of the target resource pool.
9. The apparatus of claim 7, further comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring the resource utilization rate of each physical machine in a full-platform physical machine set;
and the second calculation module is used for calculating the resource utilization rate of each resource pool in the full-platform resource pool set according to the resource utilization rate of each physical machine in the full-platform physical machine set and the resource pool information of each physical machine so as to detect the target resource pool of which the resource utilization rate is greater than the first threshold value in the full-platform resource pool set.
10. The apparatus of claim 9, wherein the first obtaining module is specifically configured to:
and acquiring the reported resource utilization rate of each physical machine in the full-platform physical machine set.
11. The apparatus of claim 7, wherein the selection module comprises:
the acquisition unit is used for acquiring the information of each idle physical machine in the idle physical machine set under the condition that the resource utilization rate of the target resource pool is detected to be greater than a first threshold value;
and the selecting unit is used for selecting a target idle physical machine matched with the target resource pool from the idle physical machine set according to the information of each idle physical machine in the idle physical machine set.
12. The apparatus of claim 7, further comprising:
the second acquisition module is used for acquiring the resource utilization rate of each resource pool in the full-platform resource pool set in the first historical time period;
the prediction module is used for predicting the resource utilization rate of each resource pool in the full-platform resource pool set in a preset time period according to the resource utilization rate in the first historical time period;
and the adjusting module is used for adjusting resource pool information of physical machines in a first type resource pool in the full-platform resource pool set according to the resource utilization rate within the preset time period, wherein the first type resource pool is a resource pool of which the resource utilization rate within the preset time period is smaller than or equal to a second threshold value, and the second threshold value is smaller than or equal to the first threshold value.
13. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 6.
14. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010701825.1A CN111880914A (en) | 2020-07-20 | 2020-07-20 | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010701825.1A CN111880914A (en) | 2020-07-20 | 2020-07-20 | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111880914A true CN111880914A (en) | 2020-11-03 |
Family
ID=73154646
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010701825.1A Pending CN111880914A (en) | 2020-07-20 | 2020-07-20 | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111880914A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113282419A (en) * | 2021-06-07 | 2021-08-20 | 国家超级计算天津中心 | Resource scheduling method, electronic device, and computer-readable storage medium |
| CN113360288A (en) * | 2021-06-23 | 2021-09-07 | 深圳前海微众银行股份有限公司 | Resource pool resource filling method, device, equipment and readable storage medium |
| CN113835733A (en) * | 2021-09-29 | 2021-12-24 | 百度在线网络技术（北京）有限公司 | Cloud application updating method and device, electronic equipment and storage medium |
| CN115794337A (en) * | 2022-11-14 | 2023-03-14 | 北京百度网讯科技有限公司 | Resource scheduling method and device, cloud platform, equipment and storage medium |
| CN116132992A (en) * | 2022-12-16 | 2023-05-16 | 深圳中云通信技术有限公司 | 5G acceleration card communication module, acceleration card and communication transmission method |
| CN116560818A (en) * | 2023-06-29 | 2023-08-08 | 深圳市易图资讯股份有限公司 | Method and system for distributing and scheduling space data service |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533086A (en) * | 2013-10-31 | 2014-01-22 | 中国科学院计算机网络信息中心 | Uniform resource scheduling method in cloud computing system |
| CN103970587A (en) * | 2014-04-21 | 2014-08-06 | 华为技术有限公司 | Resource scheduling method, device and system |
| CN105208093A (en) * | 2015-08-20 | 2015-12-30 | 浪潮(北京)电子信息产业有限公司 | Construction method and system of calculation resource pool in cloud operation system |
| CN105912397A (en) * | 2016-03-31 | 2016-08-31 | 乐视控股（北京）有限公司 | Resources management method and device |
| CN111274033A (en) * | 2020-01-19 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Resource deployment method, device, server and storage medium |
-
2020
- 2020-07-20 CN CN202010701825.1A patent/CN111880914A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103533086A (en) * | 2013-10-31 | 2014-01-22 | 中国科学院计算机网络信息中心 | Uniform resource scheduling method in cloud computing system |
| CN103970587A (en) * | 2014-04-21 | 2014-08-06 | 华为技术有限公司 | Resource scheduling method, device and system |
| CN105208093A (en) * | 2015-08-20 | 2015-12-30 | 浪潮(北京)电子信息产业有限公司 | Construction method and system of calculation resource pool in cloud operation system |
| CN105912397A (en) * | 2016-03-31 | 2016-08-31 | 乐视控股（北京）有限公司 | Resources management method and device |
| CN111274033A (en) * | 2020-01-19 | 2020-06-12 | 北京达佳互联信息技术有限公司 | Resource deployment method, device, server and storage medium |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113282419A (en) * | 2021-06-07 | 2021-08-20 | 国家超级计算天津中心 | Resource scheduling method, electronic device, and computer-readable storage medium |
| CN113360288A (en) * | 2021-06-23 | 2021-09-07 | 深圳前海微众银行股份有限公司 | Resource pool resource filling method, device, equipment and readable storage medium |
| WO2022267344A1 (en) * | 2021-06-23 | 2022-12-29 | 深圳前海微众银行股份有限公司 | Resource filling method, apparatus, and device for resource pools, and readable storage medium |
| CN113835733A (en) * | 2021-09-29 | 2021-12-24 | 百度在线网络技术（北京）有限公司 | Cloud application updating method and device, electronic equipment and storage medium |
| CN113835733B (en) * | 2021-09-29 | 2023-06-16 | 百度在线网络技术（北京）有限公司 | Cloud application updating method and device, electronic equipment and storage medium |
| CN115794337A (en) * | 2022-11-14 | 2023-03-14 | 北京百度网讯科技有限公司 | Resource scheduling method and device, cloud platform, equipment and storage medium |
| CN115794337B (en) * | 2022-11-14 | 2023-09-26 | 北京百度网讯科技有限公司 | Resource scheduling method, device, cloud platform, equipment and storage medium |
| CN116132992A (en) * | 2022-12-16 | 2023-05-16 | 深圳中云通信技术有限公司 | 5G acceleration card communication module, acceleration card and communication transmission method |
| CN116132992B (en) * | 2022-12-16 | 2024-02-23 | 深圳中云通信技术有限公司 | 5G acceleration card communication module, acceleration card and communication transmission method |
| CN116560818A (en) * | 2023-06-29 | 2023-08-08 | 深圳市易图资讯股份有限公司 | Method and system for distributing and scheduling space data service |
| CN116560818B (en) * | 2023-06-29 | 2023-09-12 | 深圳市易图资讯股份有限公司 | Method and system for distributing and scheduling space data service |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111880914A (en) | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium | |
| CN111694646B (en) | Resource scheduling method, device, electronic equipment and computer readable storage medium | |
| WO2021036936A1 (en) | Method and apparatus for allocating resources and tasks in distributed system, and system | |
| CN111738446A (en) | Scheduling method, device, equipment and medium of deep learning inference engine | |
| CN112000450A (en) | Neural network architecture searching method and device | |
| CN114356547B (en) | Low-priority blocking method and device based on processor virtualization environment | |
| CN111506401A (en) | Automatic driving simulation task scheduling method and device, electronic equipment and storage medium | |
| CN112667403A (en) | Server scheduling method and device and electronic equipment | |
| CN112561332A (en) | Model management method, model management apparatus, electronic device, storage medium, and program product | |
| CN111782147A (en) | Method and apparatus for cluster scale-up | |
| WO2022199204A1 (en) | Method and apparatus for determining resources | |
| CN111625949A (en) | Simulation engine system, simulation processing method, device and medium | |
| CN111796940B (en) | Resource allocation method and device and electronic equipment | |
| CN113590329A (en) | Resource processing method and device | |
| CN112527509A (en) | Resource allocation method and device, electronic equipment and storage medium | |
| CN113760527A (en) | Resource control method and device | |
| CN111858030A (en) | Job resource processing method and device, electronic equipment and readable storage medium | |
| CN112532483A (en) | Test method, test device, electronic equipment and storage medium | |
| CN111176838A (en) | Method and device for distributing embedded vectors for nodes in bipartite graph | |
| EP3866399A1 (en) | Method and apparatus for adjusting network flow | |
| CN111901254B (en) | Bandwidth allocation method and device for all nodes, electronic equipment and storage medium | |
| CN112734454B (en) | User information determining method and device, electronic equipment and storage medium | |
| CN113778973A (en) | Data storage method and device | |
| CN111723318A (en) | Page data processing method, device, equipment and storage medium | |
| CN111581049A (en) | Method, device, equipment and storage medium for monitoring running state of distributed system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |