CN112698952A - Unified management method and device for computing resources, computer equipment and storage medium - Google Patents
Unified management method and device for computing resources, computer equipment and storage medium Download PDFInfo
- Publication number
- CN112698952A CN112698952A CN202110012199.XA CN202110012199A CN112698952A CN 112698952 A CN112698952 A CN 112698952A CN 202110012199 A CN202110012199 A CN 202110012199A CN 112698952 A CN112698952 A CN 112698952A
- Authority
- CN
- China
- Prior art keywords
- computing resources
- resource
- preset
- computing
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007726 management method Methods 0.000 title claims description 31
- 238000012545 processing Methods 0.000 claims abstract description 44
- 238000000034 method Methods 0.000 claims abstract description 36
- 238000004458 analytical method Methods 0.000 claims abstract description 27
- 238000013468 resource allocation Methods 0.000 claims abstract description 24
- 238000004590 computer program Methods 0.000 claims description 24
- 230000008569 process Effects 0.000 claims description 11
- 238000012216 screening Methods 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000010276 construction Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5011—Pool
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/508—Monitor
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a device for uniformly managing computing resources, computer equipment and a storage medium, wherein the method comprises the following steps: analyzing a received service request, determining a target service corresponding to the service request according to an analysis result, determining a plurality of alternative computing resources from computing resources in a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format, acquiring a current index value of a preset index of each alternative computing resource, analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource, and determining the target computing resource for processing the service request from the plurality of alternative computing resources according to the state information and a preset resource allocation strategy. According to the invention, the computing resources of the big data assembly are uniformly scheduled and managed in a cloud mode, the utilization rate of the resources is improved, and the maintenance cost is reduced.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for unified management of computing resources, a computer device, and a storage medium.
Background
Cloud computing is a new innovation in the information era after a computer, cloud computing is a great leap in the information era, the future era can be the cloud computing era, although the definition of cloud computing is many at present, generally, cloud computing has many meanings, but in summary, the basic meanings of cloud computing are consistent, namely, cloud computing has strong expansibility and desirability, a brand-new experience can be provided for users, and the core of cloud computing is that many computer resources can be coordinated together, so that users can obtain infinite resources through a network, and meanwhile, the obtained resources are not limited by time and space.
In the practical application process, for example, in an e-commerce shopping scenario, the demand of a big data real-time system for system capacity is greatly reduced and greatly lowered in normal times, and currently, computing engines such as Spark, Presto, Flink, Storm and the like are relatively independent, and unified coordination and management of computing resources are lacked, so that the problems of low utilization rate of machines, reliable and stable operation of core services, low disaster tolerance support degree and the like are caused.
Therefore, it is desirable to provide a new computing resource management method to solve the above problems.
Disclosure of Invention
In order to solve the problems in the prior art, embodiments of the present invention provide a method and an apparatus for unified management of computing resources, a computer device, and a storage medium, so as to overcome the problems in the prior art, such as low utilization rate of computing resources, high maintenance cost, and the like.
In order to solve one or more technical problems, the invention adopts the technical scheme that:
in a first aspect, a method for unified management of computing resources is provided, where the method includes the following steps:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
Further, the determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service includes:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
Further, the method further includes a resource pool generation process, including:
and standardizing the computing resources of the computing engines of different types, and generating a resource pool according to the standardized computing resources.
Further, the obtaining a current index value of a preset index of each candidate computing resource, and performing analysis and calculation on the current index value according to a preset rule to obtain current state information of each candidate computing resource includes:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
determining, from the multiple candidate computing resources, a target computing resource for processing the service request according to the state information and a preset resource allocation policy includes:
and determining the alternative computing resources corresponding to the load information meeting the preset load threshold value as target computing resources for processing the service request.
Further, the determining, according to the state information and a preset resource allocation policy, a target computing resource for processing the service request from the multiple candidate computing resources includes:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
Further, the method further comprises:
and when the current state information of the alternative computing resources exceeds a preset alarm threshold value, sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resources needs to be optimized.
Further, the computing resources include physical machines.
In a second aspect, an apparatus for unified management of computing resources is provided, the apparatus comprising:
the service determining module is used for analyzing the received service request and determining a target service corresponding to the service request according to an analysis result;
the first screening module is used for determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
the index analysis module is used for acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and the second screening module is used for determining target computing resources for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
In a third aspect, a computer device is provided, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the computer program, the following steps are implemented:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
In a fourth aspect, there is provided a computer readable storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
the method, the device, the computer equipment and the storage medium for unified management of computing resources provided by the embodiments of the present invention implement unified scheduling and management of computing resources of a big data component in a cloud manner by parsing a received service request, determining a target service corresponding to the service request according to a parsing result, determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format, obtaining a current index value of a preset index of each candidate computing resource, performing analysis and calculation on the current index value according to a preset rule to obtain current state information of each candidate computing resource, determining the target computing resource for processing the service request from the plurality of candidate computing resources according to the state information and a preset resource allocation policy, the utilization rate of resources is improved, and the maintenance cost is reduced.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a flow diagram illustrating a method for unified management of computing resources in accordance with an exemplary embodiment;
FIG. 2 is a block diagram illustrating an apparatus for unified management of computing resources in accordance with an exemplary embodiment;
FIG. 3 is a schematic diagram illustrating an internal architecture of a computer device, according to an example embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As described in the background art, currently, computing engines such as Spark, Presto, Flink, and Storm are relatively independent, and lack of unified coordination and management of computing resources, which results in low utilization of machines, reliable and stable operation of core services, and low disaster recovery support.
In order to solve the above problems, the embodiment of the present invention creatively provides a method for uniformly managing computing resources, which puts computing resources with a preset standardized format into a resource pool, and performs uniform scheduling and management on the computing resources in a cloud manner, thereby improving the utilization rate of the computing resources, reducing the maintenance cost, and better ensuring the effect of continuous operation of services.
Fig. 1 is a flowchart illustrating a method for unified management of computing resources according to an exemplary embodiment, and referring to fig. 1, the method includes the following steps:
s1: analyzing the received service request, and determining the target service corresponding to the service request according to the analysis result.
Specifically, in the real-time embodiment of the present invention, a manner of uniformly scheduling and managing computing resources is adopted, so that when a certain service of a user is in need, a service request may be sent through a device such as a client, where the service request carries information related to the service that the user wants to request, such as a service identifier. After receiving the service request, the service request is firstly analyzed to obtain an analysis result, and then the target service corresponding to the service request is determined according to the analysis result.
S2: and determining a plurality of alternative computing resources from the computing resources in a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format.
Specifically, in the embodiment of the present invention, in order to maximally share the computing resources, a manner of uniformly scheduling all the computing resources in a pre-constructed resource pool is adopted. A resource pool is a combination of hardware and software that can provide the same service capabilities to the outside. That is, the resource shape inside the resource pool is shielded from the user, and these resources can be dynamically provided to the user in the form of service as needed, and the user sees the service rather than the real physical resource. These resources can be used for both a and B users. The resource pool comprises a computing resource pool, a storage resource pool and a network resource pool.
In the embodiment of the present invention, the computing resources include computing resources of different computing engines, the computing engines include, but are not limited to, Spark, Presto, Flink, Storm, and the like, and the computing resources include, but are not limited to, physical machines and the like, which is not limited herein. Because the construction specification, the resource composition and the construction process of the resource pool are generally developed around the service, when the resource pool is constructed, the computing resources can be divided according to actual requirements, and different computing resources provide different services. The construction process of the resource pool comprises the steps of physical resource selection, placement, shelving and shelving, automatic installation and the like. Due to different organizational structures and management concepts of different enterprises, the construction process needs to be determined according to actual conditions of the enterprises, but resources can be automatically completed as much as possible.
For example, to provide X86 virtual machine service, an X86 virtual machine resource pool is constructed, which may be composed of X86 servers, GPU servers, network switches, distributed storage (HDFS or object storage). In specific implementation, the resource pool can be divided into different areas according to different networks and regions, so that the X86 virtual machine service of different networks and different regions is provided for users.
S3: and acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain the current state information of each alternative computing resource.
Specifically, in the embodiment of the present invention, the real-time monitoring of each performance index of the computing resource in the resource pool is set. After a plurality of candidate computing resources are preliminarily determined from a resource pool according to a target service corresponding to a service request, a current index value of a preset index of each candidate computing resource is obtained in real time, analysis and calculation are carried out according to the monitored current index value of the preset index according to a preset rule, and current state information of each candidate computing resource is obtained, and the state information can comprehensively reflect current performance indexes of each candidate computing resource, wherein the preset index includes but is not limited to CPU utilization rate, GPU utilization rate, memory utilization rate, disk utilization rate, network I/O and the like, and the preset rule can define specific dimensionality of analysis and the like. In specific implementation, an index analysis model may be pre-constructed, and then the current index value of the monitored preset index is analyzed and calculated by using the index analysis model to obtain the current state information of each candidate computing resource.
S4: and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
Specifically, in the embodiment of the present invention, a resource allocation policy needs to be preset, and the resource allocation policy defines the threshold of each index. In specific implementation, the current state information of each alternative computing resource is obtained, the analysis result of each index in the state information is compared with the corresponding threshold value in the preset resource allocation strategy, and the alternative computing resources meeting the requirement are screened out to serve as the target computing resources so as to process the service request. It should be noted that, in the embodiment of the present invention, the resource allocation policy may be automatically given by the system, or may be customized by the user.
If a plurality of candidate computing resources meeting the requirement are screened out, the computing resource in the optimal state can be selected from the candidate computing resources meeting the requirement as the target computing resource, for example, the load is the lowest. And if no alternative computing resource meets the requirement, feeding back prompt information that the current service is unavailable or needs to wait to the user.
As a preferred implementation manner, in the embodiment of the present invention, the determining, according to the target service, a plurality of candidate computing resources from a pre-configured resource pool includes:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
Specifically, as described above, since the building specification, resource composition, and building process of the resource pool are generally spread around the service, the configuration requirements of the computing resources for different types of services are different. Therefore, services can be divided according to service types in advance, and then computing resources configured to meet the service corresponding to the service type are used for providing the service. In order to facilitate the subsequent quick search of the computing resources corresponding to each service type pair, a service type and computing resource correspondence table may be maintained in advance, and the relationship table records which service types are available for providing by each computing resource. Specifically, during application, after a target service corresponding to a service request sent by a user is determined, a service type corresponding to the target service is determined, then a service type is inquired, a preset service type and computing resource corresponding relation table is inquired, computing resources meeting requirements are obtained, whether the computing resources are available at present is inquired, and the computing resources in an available state are determined as alternative computing resources.
As a preferred implementation manner, in an embodiment of the present invention, the method further includes a resource pool generating process, including:
and carrying out preset standardization processing on the computing resources of the computing engines of different types, and generating a resource pool according to the computing resources subjected to the standardization processing.
Specifically, when a resource pool is constructed, in order to facilitate management, it is necessary to standardize the computing resources placed in the resource pool so that the computing resources have a uniform format. The normalization process includes, but is not limited to, setting the CPU to Memory ratio of the computing resource to 1: 4, such as starting with a basic configuration of 1C4G (1 CPU core with 4G Memory), and so on. In addition, the method also comprises the setting of an interactive interface between the user and the computing service, the setting of cross-computing platform deployment supporting the upper-layer application of the user, and the like.
Specifically, as a preferred implementation manner, in the embodiment of the present invention, the resource pool may be further divided into two layers, i.e., a physical resource pool and a logical resource pool, where the physical resource pool is mainly classified and pooled according to the electrical characteristics and configuration characteristics of the physical device, and the logical resource pool is pooled according to the difference of the network and the usage (provided service). When a user applies for a service, resources can be allocated in the logical resource pool, and when the logical resource pool is expanded, resources can be allocated in the physical resource pool. By the arrangement, the operation and maintenance of the service, the operation and maintenance of the resources (software and hardware) and the operation and maintenance of the physical hardware (loading and unloading, power-on wiring) can be decoupled.
As a preferred implementation manner, in the embodiment of the present invention, the obtaining a current index value of a preset index of each candidate computing resource, and performing analysis and calculation on the current index value according to a preset rule to obtain current state information of each candidate computing resource includes:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
determining, from the multiple candidate computing resources, a target computing resource for processing the service request according to the state information and a preset resource allocation policy includes:
and determining the alternative computing resources corresponding to the load information meeting the preset load threshold value as target computing resources for processing the service request.
Specifically, in the embodiment of the present invention, the preset index includes, but is not limited to, a load index. In specific implementation, a current index value of a load index of each candidate computing resource is obtained, the current index value is analyzed and calculated according to a preset rule to obtain current load information of each candidate computing resource, when a target computing resource is determined, the current load information of each candidate computing resource is compared with a preset load threshold value in a resource allocation strategy, and the candidate computing resource corresponding to the load information meeting the preset load threshold value is determined as the target computing resource for processing the service request.
As a preferred implementation manner, in an embodiment of the present invention, the determining, according to the state information and a preset resource allocation policy, a target computing resource for processing the service request from the multiple candidate computing resources includes:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
Specifically, when determining a target computing resource for processing a service request, the job requirement corresponding to the service request may also be taken into consideration. In specific implementation, a service request sent by a user can carry a corresponding operation requirement, the system receives the service request of the user and then analyzes the service request to obtain the operation requirement corresponding to the service request, then the state information is compared with the operation requirement, and candidate computing resources meeting the operation requirement are determined as target computing resources for processing the service request. It should be noted that, the content user included in the job request may perform setting according to actual needs, and is not limited herein.
As a preferred implementation manner, in an embodiment of the present invention, the method further includes:
and when the current state information of the alternative computing resources exceeds a preset alarm threshold value, sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resources needs to be optimized.
Specifically, in order to ensure that the performance of the computing resource can be kept optimal, in the embodiment of the present invention, an alarm threshold based on the current state information of the alternative computing resource is further set, and when the performance index of the alternative computing resource is greatly reduced and the current state information exceeds the preset alarm threshold, a computing resource performance alarm is automatically sent out to prompt the user to optimize the configuration of the alternative computing resource, so that the performance state of the computing resource is kept optimal.
As a preferred implementation manner, in the embodiment of the present invention, the computing resource includes a physical machine
Specifically, in addition to the above-mentioned physical devices, the computing resources in the embodiment of the present invention may also be virtual machines, etc., which are not limited herein, and a user may set the computing resources according to actual needs.
Fig. 2 is a schematic structural diagram illustrating a unified computing resource management apparatus according to an exemplary embodiment, where the apparatus includes:
the service determining module is used for analyzing the received service request and determining a target service corresponding to the service request according to an analysis result;
the first screening module is used for determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
the index analysis module is used for acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and the second screening module is used for determining target computing resources for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
As a preferred implementation manner, in an embodiment of the present invention, the first screening module is specifically configured to:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
As a preferred implementation manner, in an embodiment of the present invention, the apparatus further includes:
and the resource pool generating module is used for carrying out preset standardization processing on the computing resources of the computing engines of different types and generating a resource pool according to the computing resources after the standardization processing.
As a preferred implementation manner, in an embodiment of the present invention, the index analysis module is specifically configured to:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
the second screening module specifically determines the candidate computing resource corresponding to the load information meeting a preset load threshold as a target computing resource for processing the service request.
As a preferred implementation manner, in an embodiment of the present invention, the second screening module is further configured to:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
As a preferred implementation manner, in an embodiment of the present invention, the apparatus further includes:
and the state alarm module is used for sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resource needs to be optimized when the current state information of the alternative computing resource exceeds a preset alarm threshold value.
In an embodiment of the present invention, the computing resource includes a physical machine.
Fig. 3 is a schematic diagram illustrating an internal structure of a computer device according to an exemplary embodiment, and referring to fig. 3, the computer device includes a processor (e.g., CPU/GPU), a memory, and a network interface, which are connected through a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of optimization of an execution plan.
Those skilled in the art will appreciate that the configuration shown in fig. 3 is a block diagram of only a portion of the configuration associated with aspects of the present invention and is not intended to limit the computing devices to which aspects of the present invention may be applied, and that a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
As a preferred implementation manner, in an embodiment of the present invention, the computer device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the following steps when executing the computer program:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from computing resources in a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
As a preferred implementation manner, in the embodiment of the present invention, when the processor executes the computer program, the following steps are further implemented:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
As a preferred implementation manner, in the embodiment of the present invention, when the processor executes the computer program, the following steps are further implemented:
and carrying out preset standardization processing on the computing resources of the computing engines of different types, and generating a resource pool according to the computing resources subjected to the standardization processing.
As a preferred implementation manner, in the embodiment of the present invention, when the processor executes the computer program, the following steps are further implemented:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
and determining the alternative computing resources corresponding to the load information meeting the preset load threshold value as target computing resources for processing the service request.
As a preferred implementation manner, in the embodiment of the present invention, when the processor executes the computer program, the following steps are further implemented:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
As a preferred implementation manner, in the embodiment of the present invention, when the processor executes the computer program, the following steps are further implemented:
and when the current state information of the alternative computing resources exceeds a preset alarm threshold value, sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resources needs to be optimized.
In an embodiment of the present invention, the computing resource includes a physical machine.
In an embodiment of the present invention, a computer-readable storage medium is further provided, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from computing resources in a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
As a preferred implementation manner, in the embodiment of the present invention, when executed by the processor, the computer program further implements the following steps:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
As a preferred implementation manner, in the embodiment of the present invention, when executed by the processor, the computer program further implements the following steps:
and carrying out preset standardization processing on the computing resources of the computing engines of different types, and generating a resource pool according to the computing resources subjected to the standardization processing.
As a preferred implementation manner, in the embodiment of the present invention, when executed by the processor, the computer program further implements the following steps:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
and determining the alternative computing resources corresponding to the load information meeting the preset load threshold value as target computing resources for processing the service request.
As a preferred implementation manner, in the embodiment of the present invention, when executed by the processor, the computer program further implements the following steps:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
As a preferred implementation manner, in the embodiment of the present invention, when executed by the processor, the computer program further implements the following steps:
and when the current state information of the alternative computing resources exceeds a preset alarm threshold value, sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resources needs to be optimized.
In an embodiment of the present invention, the computing resource includes a physical machine.
In summary, the technical solution provided by the embodiment of the present invention has the following beneficial effects:
the method, the device, the computer equipment and the storage medium for unified management of computing resources provided by the embodiments of the present invention implement unified scheduling and management of computing resources of a big data component in a cloud manner by parsing a received service request, determining a target service corresponding to the service request according to a parsing result, determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format, obtaining a current index value of a preset index of each candidate computing resource, performing analysis and calculation on the current index value according to a preset rule to obtain current state information of each candidate computing resource, determining the target computing resource for processing the service request from the plurality of candidate computing resources according to the state information and a preset resource allocation policy, the utilization rate of resources is improved, and the maintenance cost is reduced.
It should be noted that: the unified computing resource management device provided in the foregoing embodiment is only illustrated by the division of the functional modules when triggering the management service, and in practical applications, the function allocation may be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the unified computing resource management device and the embodiment of the unified computing resource management method provided in the above embodiments belong to the same concept, that is, the device is based on the unified computing resource management method, and the specific implementation process thereof is described in detail in the method embodiments, and will not be described herein again.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (10)
1. A unified management method for computing resources is characterized by comprising the following steps:
analyzing the received service request, and determining a target service corresponding to the service request according to an analysis result;
determining a plurality of alternative computing resources from computing resources in a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and determining a target computing resource for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
2. The method for unified management of computing resources according to claim 1, wherein the determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service comprises:
determining a service type corresponding to the target service;
and inquiring a preset service type and computing resource corresponding relation table according to the service type, and determining a plurality of computing resources in an available state in a preset resource pool as alternative computing resources.
3. The unified management method for computing resources according to claim 1 or 2, characterized in that the method further comprises a resource pool generation process, comprising:
and carrying out preset standardization processing on the computing resources of the computing engines of different types, and generating a resource pool according to the computing resources subjected to the standardization processing.
4. The method according to claim 1 or 2, wherein the obtaining a current index value of a preset index of each candidate computing resource, and performing analysis and calculation on the current index value according to a preset rule to obtain current state information of each candidate computing resource comprises:
acquiring a current index value of a load index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current load information of each alternative computing resource;
determining, from the multiple candidate computing resources, a target computing resource for processing the service request according to the state information and a preset resource allocation policy includes:
and determining the alternative computing resources corresponding to the load information meeting the preset load threshold value as target computing resources for processing the service request.
5. The method according to claim 1 or 2, wherein the determining, according to the state information and a preset resource allocation policy, a target computing resource for processing the service request from the multiple candidate computing resources comprises:
analyzing the service request to acquire an operation requirement corresponding to the service request;
and determining the alternative computing resources of which the state information meets the job requirements as target computing resources for processing the service request.
6. A unified management method of computing resources according to claim 1 or 2, characterized in that it further comprises:
and when the current state information of the alternative computing resources exceeds a preset alarm threshold value, sending out a computing resource performance alarm to prompt that the configuration of the alternative computing resources needs to be optimized.
7. The unified management method for computing resources according to claim 1 or 2, wherein the computing resources comprise physical machines.
8. An apparatus for unified management of computing resources, the apparatus comprising:
the service determining module is used for analyzing the received service request and determining a target service corresponding to the service request according to an analysis result;
the first screening module is used for determining a plurality of candidate computing resources from a pre-configured resource pool according to the target service, wherein the computing resources in the resource pool have a preset standardized format;
the index analysis module is used for acquiring a current index value of a preset index of each alternative computing resource, and analyzing and calculating the current index value according to a preset rule to obtain current state information of each alternative computing resource;
and the second screening module is used for determining target computing resources for processing the service request from the multiple candidate computing resources according to the state information and a preset resource allocation strategy.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 7 are implemented when the computer program is executed by the processor.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110012199.XA CN112698952A (en) | 2021-01-05 | 2021-01-05 | Unified management method and device for computing resources, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110012199.XA CN112698952A (en) | 2021-01-05 | 2021-01-05 | Unified management method and device for computing resources, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112698952A true CN112698952A (en) | 2021-04-23 |
Family
ID=75514853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110012199.XA Pending CN112698952A (en) | 2021-01-05 | 2021-01-05 | Unified management method and device for computing resources, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112698952A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656162A (en) * | 2021-08-18 | 2021-11-16 | 恒生电子股份有限公司 | Resource application method and device, electronic equipment and storage medium |
| CN113709241A (en) * | 2021-08-26 | 2021-11-26 | 上海德拓信息技术股份有限公司 | Scheduling distribution combination method and system of physical resources in cloud scene |
| CN114064251A (en) * | 2022-01-19 | 2022-02-18 | 浪潮云信息技术股份公司 | Function starting acceleration method, device, equipment and readable storage medium |
| CN116360990A (en) * | 2023-03-27 | 2023-06-30 | 合芯科技有限公司 | Distributed computing task rationality pre-judging method, system, equipment and storage medium |
| WO2024051012A1 (en) * | 2022-09-09 | 2024-03-14 | 苏州大学 | Service deployment and resource allocation method for partially-decoupled data center |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095853A (en) * | 2013-02-27 | 2013-05-08 | 北京航空航天大学 | Cloud data center calculation capacity management system |
| CN104065745A (en) * | 2014-07-07 | 2014-09-24 | 电子科技大学 | Cloud computing dynamic resource scheduling system and method |
| CN104281496A (en) * | 2014-10-27 | 2015-01-14 | 深圳中兴网信科技有限公司 | Virtual resource distribution method and virtual resource distribution device |
-
2021
- 2021-01-05 CN CN202110012199.XA patent/CN112698952A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103095853A (en) * | 2013-02-27 | 2013-05-08 | 北京航空航天大学 | Cloud data center calculation capacity management system |
| CN104065745A (en) * | 2014-07-07 | 2014-09-24 | 电子科技大学 | Cloud computing dynamic resource scheduling system and method |
| CN104281496A (en) * | 2014-10-27 | 2015-01-14 | 深圳中兴网信科技有限公司 | Virtual resource distribution method and virtual resource distribution device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113656162A (en) * | 2021-08-18 | 2021-11-16 | 恒生电子股份有限公司 | Resource application method and device, electronic equipment and storage medium |
| CN113709241A (en) * | 2021-08-26 | 2021-11-26 | 上海德拓信息技术股份有限公司 | Scheduling distribution combination method and system of physical resources in cloud scene |
| CN113709241B (en) * | 2021-08-26 | 2024-01-23 | 上海德拓信息技术股份有限公司 | Scheduling and distributing combination method and system for physical resources in cloud scene |
| CN114064251A (en) * | 2022-01-19 | 2022-02-18 | 浪潮云信息技术股份公司 | Function starting acceleration method, device, equipment and readable storage medium |
| WO2024051012A1 (en) * | 2022-09-09 | 2024-03-14 | 苏州大学 | Service deployment and resource allocation method for partially-decoupled data center |
| CN116360990A (en) * | 2023-03-27 | 2023-06-30 | 合芯科技有限公司 | Distributed computing task rationality pre-judging method, system, equipment and storage medium |
| CN116360990B (en) * | 2023-03-27 | 2024-01-09 | 合芯科技有限公司 | Distributed computing task rationality pre-judging method, system, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112698952A (en) | Unified management method and device for computing resources, computer equipment and storage medium | |
| WO2020253347A1 (en) | Container cluster management method, device and system | |
| CN106302565B (en) | Scheduling method and system of service server | |
| US9026655B2 (en) | Method and system for load balancing | |
| CN109995859A (en) | A kind of dispatching method, dispatch server and computer readable storage medium | |
| JP5000456B2 (en) | Resource management system, resource management apparatus and method | |
| CN111880936B (en) | Resource scheduling method, device, container cluster, computer equipment and storage medium | |
| CN111522636A (en) | Application container adjusting method, application container adjusting system, computer readable medium and terminal device | |
| CN111026602A (en) | Health inspection scheduling management method and device of cloud platform and electronic equipment | |
| CN104978172A (en) | Integrated management and control method, system and equipment of SDN (Software Defined Networking) applications | |
| CN113645262A (en) | Cloud computing service system and method | |
| CN103607424A (en) | Server connection method and server system | |
| CN112202829A (en) | Social robot scheduling system and scheduling method based on micro-service | |
| CN109902028A (en) | Automated testing method, device, equipment and the storage medium of ACL characteristic | |
| CN113867600A (en) | Development method and device for processing streaming data and computer equipment | |
| CN113037891A (en) | Access method and device for stateful application in edge computing system and electronic equipment | |
| US11144359B1 (en) | Managing sandbox reuse in an on-demand code execution system | |
| CN213876703U (en) | Resource pool management system | |
| US20240118935A1 (en) | Pod deployment method and apparatus | |
| CN114546587A (en) | Capacity expansion and reduction method of online image recognition service and related device | |
| CN114666335A (en) | DDS-based distributed system load balancing device | |
| US20210286647A1 (en) | Embedded persistent queue | |
| CN111475251A (en) | Cluster container scheduling method, system, terminal and storage medium | |
| CN109257256A (en) | Apparatus monitoring method, device, computer equipment and storage medium | |
| CN114443293A (en) | Deployment system and method for big data platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |