CN114138492A - Resource management platform, method and electronic equipment - Google Patents

Resource management platform, method and electronic equipment Download PDF

Info

Publication number
CN114138492A
CN114138492A CN202111474197.9A CN202111474197A CN114138492A CN 114138492 A CN114138492 A CN 114138492A CN 202111474197 A CN202111474197 A CN 202111474197A CN 114138492 A CN114138492 A CN 114138492A
Authority
CN
China
Prior art keywords
resource
application
component
groups
platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111474197.9A
Other languages
Chinese (zh)
Inventor
王幼芝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Construction Bank Corp
Original Assignee
China Construction Bank Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Construction Bank Corp filed Critical China Construction Bank Corp
Priority to CN202111474197.9A priority Critical patent/CN114138492A/en
Publication of CN114138492A publication Critical patent/CN114138492A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching

Abstract

The utility model provides a resource management platform, a method and an electronic device, which relate to the big data platform technology, wherein the resource management platform is provided with a plurality of component services, and comprises: the device comprises a component resource management module and an application resource management module; the component resource management module is used for allocating a dedicated resource group in the basic resource pool for the component service, and the dedicated resource group is used for running the component service; and the application resource management module is used for allocating application resource groups for the applications running in the platform in the application resource pool, and the application resource groups are used for running the applications. According to the scheme provided by the disclosure, the resource management platform is provided with the component resource management module and the application resource management module, and the infrastructure resources and the upper-layer application and component services are coordinated through the two modules, so that resource groups for running the application and the component services are independent from each other, and the application and the component services cannot contend for the resources.

Description

Resource management platform, method and electronic equipment
Technical Field
The present disclosure relates to big data platform technologies, and in particular, to a resource management platform, a resource management method, and an electronic device.
Background
Many large data Platform products exist as PaaS (Platform as a Service) services. When designing a big data platform, it is common to design a big data platform based on existing infrastructure resources.
The large data platforms do not have resource management capability, so that when the large data platforms are deployed to a machine room local to a user or other unknown clouds, the platforms and infrastructure resources may not be matched, and further, the operation of the platforms is unstable. In addition, because the platform does not have the resource management capability, the situation that resources are contended among applications when the applications run on the platform also exists.
Disclosure of Invention
The disclosure provides a resource management platform, a resource management method and electronic equipment, and aims to solve the technical problem that a large data platform in the prior art does not have resource management capability.
A first aspect of the present disclosure is to provide a resource management platform, which is connected with a resource pool, wherein the resource pool comprises at least one cluster; the resource management platform logically divides the resource pool into a basic resource pool and an application resource pool;
the resource management platform is provided with a plurality of component services, and comprises: the device comprises a component resource management module and an application resource management module;
the component resource management module is used for allocating a dedicated resource group in the basic resource pool for the component service, wherein the dedicated resource group is used for operating the component service;
the application resource management module is configured to allocate an application resource group to the application resource pool for the application running in the platform, where the application resource group is used to run the application.
A second aspect of the present disclosure is to provide a resource management method, which is applied to a resource management platform, where the resource management platform is connected to a resource pool, and the resource pool includes at least one cluster;
the method comprises the following steps:
dividing the resource pool into a basic resource pool and an application resource pool;
allocating a dedicated resource group in a basic resource pool for the component service in the platform, wherein the dedicated resource group is used for running the component service;
and allocating an application resource group for the application operated in the platform in the application resource pool, wherein the application resource group is used for operating the application.
A third aspect of the present disclosure is to provide a resource management device, including:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement the resource management method according to the second aspect.
Yet another aspect of the present disclosure is to provide a computer-readable storage medium having stored thereon a computer program to be executed by a processor to implement the resource management method according to the second aspect.
Yet another aspect of the present disclosure is to provide a computer program product comprising a computer program which, when executed by a processor, implements the resource management method as described in the second aspect above.
In the resource management platform, the resource management method and the electronic device provided by the disclosure, the resource management platform is connected with a resource pool, and the resource pool comprises at least one cluster; the resource management platform logically divides the resource pool into a basic resource pool and an application resource pool; be provided with a plurality of subassembly services in the resource management platform, the resource management platform includes: the device comprises a component resource management module and an application resource management module; the component resource management module is used for allocating a dedicated resource group in the basic resource pool for the component service, and the dedicated resource group is used for running the component service; and the application resource management module is used for allocating application resource groups for the applications running in the platform in the application resource pool, and the application resource groups are used for running the applications. According to the scheme provided by the disclosure, the resource management platform is provided with the component resource management module and the application resource management module, and the infrastructure resources and the upper-layer application and component services are coordinated through the two modules, so that resource groups for running the application and the component services are independent from each other, and the application and the component services cannot contend for the resources.
Drawings
FIG. 1 is a system block diagram illustrating an exemplary embodiment;
FIG. 2 is a block diagram of a big data system, shown in an exemplary embodiment of the present disclosure;
FIG. 3 is a diagram of a system architecture provided with a resource management platform according to an exemplary embodiment of the present disclosure;
FIG. 4 is a block diagram of a system configured with a resource management platform according to another exemplary embodiment of the present disclosure;
FIG. 5 is a flow chart illustrating a method of resource management according to an exemplary embodiment of the present disclosure;
FIG. 6 is a flow chart illustrating a method of resource management according to another exemplary embodiment of the present disclosure;
fig. 7 is a block diagram of a resource management device according to an exemplary embodiment of the present application.
Detailed Description
FIG. 1 is a system block diagram illustrating an exemplary embodiment.
As shown in fig. 1, there are infrastructure resources 11 in the system, including a big data platform 12 and applications 13. A big data platform 12 is deployed in the infrastructure resources 11, running applications 13 on the big data platform 12.
Task scheduling service 121 and resource scheduling service 122 are typically provided in large data platform 12.
The task scheduling service 121 is mainly responsible for the dependency relationship between when a task runs and when the task ends and the correct processing task, and the correctness of the process is the core of the task scheduling service 121; the resource scheduling service 122 focuses more on the allocation of system physical resources, such as the use of CPU, memory, etc., and it is the core that the maximum utilization of system resources is.
Users of the big data platform 12 have a job in-platform or out-platform and configure scheduling information for the job (including job run dependencies, execution cycles, resource requirements, etc.).
The big data platform 12 submits the configured job and job flow (combination of a plurality of jobs) to the task scheduling service 121; the task scheduling service 121 starts and submits the individual jobs to the underlying resource scheduling service 122 to run at appropriate timing according to the configuration information.
The underlying resource scheduling service 122 will schedule appropriate resources to run the job program according to the resource requirement information given to it by the task scheduling service.
However, when a big data platform is deployed to a machine room local to a user, or to other unknown clouds, the platform may not match infrastructure resources, thereby causing the platform to operate unstably. When the applications are deployed in the big data platform, resources occupied by the applications cannot be restricted, and components resident in the big data platform also need to occupy infrastructure resources, so that the applications and the components have resource contention.
In order to solve the technical problem, the solution provided by the present disclosure sets a component resource management module and an application resource management module in a big data platform, allocates resource groups for component services in an application and platform by taking resource groups as units, and manages resources occupied by the application and the component services. Therefore, the relationship among the upper-layer application, the service component and the lower-layer infrastructure resource is coordinated through the component resource management module and the application resource management module.
FIG. 2 is a block diagram of a big data system, according to an exemplary embodiment of the present disclosure.
As shown in fig. 2, the big data system is provided with a resource management platform 21 and a resource pool 22. The resource pool refers to an infrastructure resource, and specifically includes at least one cluster 221. These clusters 221 are used to provide computing resources, storage resources, and the like.
The resource management platform 21 is provided with a service component 211, and based on the resource management platform 21 running an application 23, the resource management platform 21 is connected with the resource pool 22 and can call the resource of the resource pool 22 to run the service component 211 and the application 23.
A plurality of service components 211 may be integrated in resource management platform 21, and each service component 211 is used to provide the functions of resource management platform 21.
The resource management platform 21 logically divides the resource pool 22 into a base resource pool 222 (shaded portion) and an application resource pool 223, where the base resource pool 222 includes a part of the cluster resources 221, and the application resource pool 223 also includes a part of the cluster resources 221.
The base resource pool 222 and the application resource pool 223 may include the same cluster, or include the same hosts in a cluster.
Fig. 3 is a system structure diagram provided with a resource management platform according to an exemplary embodiment of the present disclosure.
The resource management platform 31 shown in fig. 3 may be applied to the system shown in fig. 1 or fig. 2, and may specifically be the big data platform in fig. 1, or the resource management platform in fig. 2.
As shown in fig. 3, a plurality of component services 311 are provided in the resource management platform 31, and the resource management platform 31 includes: a component resource management module 312, and an application resource management module 313.
The component resource management module 312 and the application resource management module 313 may be provided in the form of components in the resource management platform 31.
The component resource management module 312 is configured to allocate a dedicated resource group in the basic resource pool for the component service, where the dedicated resource group is used for running the component service.
As shown in fig. 3, the resource pool 32 is connected to the resource management platform 31, and the resource management platform 31 can divide the resource pool 32 into a base resource pool 321 and an application resource pool 322.
When the component service 311 in the resource management platform 31 runs, the component resource management module 312 in the resource management platform 31 divides the dedicated resource group 3211 in the basic resource pool 321, and allocates it to the component service 311, so that the component service 311 runs in the allocated dedicated resource group 3211.
Specifically, a resource group includes a certain number of resources. For example, in the k8S cluster, one resource group refers to resources of 1 cpu and 4g of memory. In the Hadoop cluster, one resource group refers to resources of 1 cpu and 4g of memory. In the virtual machine cluster, one resource group refers to resources of 8 cpus and 16g of memory.
Through the way of dividing the resource group, the resource condition in the resource pool can be reflected to the user more intuitively. And the user does not need to remove the resources consumed by the self-capability of the cluster and then determine the available resources in the cluster. Therefore, the situation that the user can know the available resources of the cluster only by looking up the configuration information is avoided, and the situation of the available resources of the whole resource pool is determined.
In this embodiment, the resources in the basic resource pool 321 are used for running the component services 311 of the platform, and the resources in the dedicated resource group 3211 are used for running the component services 311, and each resource group is independent from each other, so that the component services do not contend for the resources.
The application resource management module 313 is configured to allocate an application resource group 3221 to the application resource pool 322 for the application running in the platform 31, where the application resource group is used to run the application.
Wherein, when the application 33 runs based on the resource management platform 31, the application resource management module 313 in the resource management platform 31 divides the application resource group 3221 in the application resource pool 322 and allocates it to the application 32, so that the application 32 runs in the allocated dedicated resource group 3221.
In this embodiment, the resources of the application resource pool 322 are used for running the application 33 on the platform, and the resource groups for running the application 33 are independent of each other, so that the applications 33 do not contend for the resources.
According to the resource management platform provided by the disclosure, the resource management platform is connected with a resource pool, and the resource pool comprises at least one cluster; the resource management platform logically divides the resource pool into a basic resource pool and an application resource pool; be provided with a plurality of subassembly services in the resource management platform, the resource management platform includes: the device comprises a component resource management module and an application resource management module; the component resource management module is used for allocating a dedicated resource group in the basic resource pool for the component service, and the dedicated resource group is used for running the component service; and the application resource management module is used for allocating application resource groups for the applications running in the platform in the application resource pool, and the application resource groups are used for running the applications. The resource management platform provided by the disclosure is provided with the component resource management module and the application resource management module, and the infrastructure resources and the application and component services on the upper layer are coordinated through the two modules, so that resource groups for running the application and the component services are mutually independent, and the resources cannot be contended among the application and the component services.
Fig. 4 is a system structure diagram provided with a resource management platform according to another exemplary embodiment of the present disclosure.
As shown in fig. 4, in an alternative embodiment, the application resource management module 313 is specifically configured to: and receiving a resource creating instruction corresponding to the application, wherein the resource creating instruction comprises the resource group number N.
The user can directly deploy the application 33 to the platform 31, and can also access the platform 31 by using the terminal device, and deploy the application 33 to be run to the platform 31.
The user may directly operate the platform 31 to apply for the resource for the running application 33, may also operate the terminal device to apply for the resource for the deployed application 33, and specifically, may send the resource creation instruction to the platform 31 by the terminal device.
After the platform 31 receives the resource creation instruction corresponding to the application 33, the application resource management module 313 may process the instruction, and specifically, may allocate a resource group to the application according to the instruction.
The resource creating instruction includes the number N of resource groups, the application resource management module 313 may determine N resource groups 3221 in the application resource pool 322, and bind the application 33 with the resource group 3221, where the resource group 3221 is used to run the application 33. For example, the application resource management module 313 can partition a resource group 3221 in the application resource pool 322 for application a, and then bind the resource group 3221 with application a.
When the application 33 is executed, the application resource management module 313 may acquire information of a resource group bound to the application, thereby calling the resource group to execute the application program.
In this embodiment, the application resource management module may allocate resource groups for applications running on the platform, and the resource groups are used to run the applications, so that each application runs based on an independent resource group and does not contend for resources.
Specifically, when the application 33 is executed based on the created N resource groups, if the resource groups are not sufficient to execute the application 33, the application 33 further sends a resource application instruction to the application resource management module 313.
The application resource management module 313 can determine M resource groups 3222 in the application resource pool 322 according to the received resource application instruction, and bind the application 33 with the resource groups 3222, where the resource groups 3222 are used to run the application 33. For example, the application resource management module 313 can partition a resource group 3222 in the application resource pool 322 for application a, and then bind the resource group 3222 with application a.
Further, the resource application instruction may include resource group information for characterizing the number of resource groups that the application 33 needs to apply for, for example, may include M.
In actual application, if N resource groups are created for the application 33 and M resource groups are applied, the application 33 can be run based on the (M + N) resource groups.
In the embodiment, the application can flexibly apply for resources in the resource pool, and further flexibly adjust the resources for running the application.
In an alternative embodiment, the application resource management module 313 may monitor the running status of each application 33 running on the platform 31, and if the application 33 stops running, the binding relationship between the application 33 and the resource group may be released, or the resource group bound to the application 33 may be deleted, so as to release the resource of the resource group.
For example, if the application 33 is bound to the resource group 3221 and bound to the resource group 3222, the application 33 can be unbound to the resource group 3221 and unbound to the application 33 to the resource group 3222 when the application 33 stops running, thereby freeing up the resource.
After the unbinding relationship is released, the application resource management module 313 may bind the released resource group with other applications, and may further run other applications using the part of resources.
For another example, if the application 33 is bound to a resource group 3221 and bound to a resource group 3222, when the application 33 stops running, the resource group 3221 and the resource group 3222 may be deleted, thereby releasing the infrastructure resources corresponding to the resource group.
Through the implementation mode, the resources in the resource pool can be released flexibly, and the utilization rate of the resources in the resource pool is improved.
In this alternative embodiment, the application resource management module 313 may further obtain resource group information actually used by the application 33 during the runtime, for example, the application 33 is allocated with (M + N) resource groups, and the application 33 actually uses K actual resource groups during the runtime.
The application resource management module 313 may determine a ratio between K and (M + N), and if the ratio is smaller than a preset value, the application resource management module 313 may determine an idle resource group of the application 33, for example, the idle resource group of the application may be (M + N-K) resource groups.
When the ratio between K and (M + N) is smaller than the preset value, the application resource management module 313 may release the binding relationship between the application 33 and the idle resource group, or delete the idle resource group, thereby releasing the resources of the idle resource group.
Through the implementation mode, the resources in the resource pool can be released flexibly, and the utilization rate of the resources in the resource pool is improved.
Further, the dedicated resource group 3211 in the base resource pool 321 may also have a scene tag. When the component resource management module 312 allocates a resource group for the component service 311, the component resource management module 312 may further obtain context information of the component service 311, where the context information may be set for the component service 311 in advance.
In actual application, the component resource management module 312 may allocate the dedicated resource group 3211 to the component service 311 according to the scene tags of the component service 311 and the dedicated resource group 3211.
For example, the component resource management module 312 may divide a plurality of dedicated resource groups 3211 in the base resource pool 32, a portion of the dedicated resource groups 3211 may have a scene tag, and a portion of the dedicated resource groups 3211 may not have a scene tag.
When allocating dedicated resource groups to the component service 311, if the component service 311 has scene information, the dedicated resource groups corresponding to the scene information may be allocated to the component service 311. For example, if the scene information of the component service is mined, and a scene tag having one dedicated resource group 3211 is mined, the component service may be allocated with the tag as the mined dedicated resource group 3211. For example, while data mining is being conducted, it may not be desirable to be interfered with by other service components, and thus, the data-mining service components may be deployed in a particular set of mining-specific resources.
In an optional implementation manner, the platform 31 may further include a resource information obtaining module 314 and a component information obtaining module 315. The resource information acquisition module 314 and the component information acquisition module 315 may be provided in the platform 31 in the form of component services.
The resource information obtaining module 314 is configured to obtain resource information of each cluster in the resource pool 32, where the resource information is used for displaying in a user terminal accessing the resource management platform 31.
The resource information obtaining module 314 may obtain resource information of each cluster in the resource pool 32, for example, the total number of resource groups of the cluster, the number of resource groups used by the cluster, the number of idle resource groups of the cluster, and the like.
When the user terminal accesses the platform 31, the resource information obtaining module 314 in the platform 31 may feed back the cluster resource information to the user terminal, so that the user terminal can display the cluster resource information of each cluster. When the user applies for the resource for the application, the user can master the whole resource condition in the resource pool according to the cluster resource information and then apply for the resource based on the resource condition.
Specifically, in an optional implementation manner, the user may further operate the user terminal to obtain detailed resource information of the cluster authority, so that the user terminal can send an instruction for displaying the detailed resource information of the cluster to the platform 31. In this case, the resource information obtaining module 314 may further obtain resource information of each host in the cluster, and feed the resource information of the host back to the user terminal, so that the user terminal can display the resource information of each host in the cluster.
The host resource information may include any one of the following: the number of host total resource groups, the number of host used resource groups and the number of host idle resource groups.
The component information obtaining module 315 is further configured to obtain component resource information of each component service set in the resource management platform 31, and when the user terminal accesses the platform 31, the component information obtaining module 315 in the platform 31 may feed back the component resource information to the user terminal, so that the user terminal can display the component resource information.
The component resource information includes any one of the following information of the component: the total number of resource groups allocated for the component, and the number of resource group usage of the component. In this way, the user can intuitively know the resource condition of the component service.
Fig. 5 is a flowchart illustrating a resource management method according to an exemplary embodiment of the disclosure.
As shown in fig. 5, the resource management method provided by the present disclosure is applied to a resource management platform, where the resource management platform is connected to a resource pool, the resource pool includes at least one cluster, and the method includes:
step 501, dividing a resource pool into a basic resource pool and an application resource pool;
step 502, allocating dedicated resource groups in a basic resource pool for the component services in the platform, wherein the dedicated resource groups are used for running the component services;
step 503, allocating an application resource group for the application running in the platform in the application resource pool, where the application resource group is used for running the application.
The method provided by the present disclosure can be applied in the resource management platform as shown in fig. 3.
Fig. 6 is a flowchart illustrating a resource management method according to another exemplary embodiment of the present disclosure.
As shown in fig. 6, the resource management method provided by the present disclosure is applied to a resource management platform, where the resource management platform is connected to a resource pool, the resource pool includes at least one cluster, and the method includes:
step 601, dividing the resource pool into a basic resource pool and an application resource pool.
Step 602, obtaining scenario information of the component service.
Step 603, according to the scene information and the scene label of the dedicated resource group, allocating a corresponding dedicated resource group for the component service, wherein the dedicated resource group is used for operating the component service.
Step 604, receiving a resource creating instruction corresponding to the application, where the resource creating instruction includes a resource group number N.
Step 605, determining N resource groups in the application resource pool according to the resource creation instruction, and binding the N resource groups and the application, where the N resource groups are used for running the application.
And 606, receiving a resource application instruction of the application when the N resource groups are not enough to run the application.
Step 607, determining M resource groups in the application resource pool according to the resource application instruction, and binding the M resource groups and the application, wherein the M resource groups are used for running the application.
And step 608, when the application stops running, removing the binding relationship between the application and the resource group, or deleting the resource group bound with the application, so as to release the resource of the resource group.
And step 609, when the proportion between the actually occupied resource group and the bound resource group is smaller than a preset value during the application operation, removing the binding relation between the application and the idle resource group in the bound resource group, or deleting the idle resource group, so as to release the resource of the idle resource group.
And step 610, acquiring resource information of each cluster in the resource pool, wherein the resource information is used for displaying in a user terminal accessing the resource management platform.
Step 611, responding to the instruction for displaying the detailed resource information of the cluster, acquiring the resource information of each host in the cluster, where the resource information of the host is used for displaying in the user terminal accessing the resource management platform.
Step 612, acquiring resource information of each component set in the resource management platform, where the component resource information is used for displaying in a user terminal accessing the resource management platform.
The cluster resource information comprises any one of the following information of the cluster:
the number of the cluster total resource groups, the number of the cluster used resource groups and the number of the cluster idle resource groups;
and/or the host resource information comprises any one of the following information of the cluster:
the number of host total resource groups, the number of host used resource groups and the number of host idle resource groups;
and/or the component resource information comprises any one of the following information of the component:
the total number of resource groups allocated for the component, and the number of resource group usage of the component.
Fig. 7 is a block diagram of a resource management device according to an exemplary embodiment of the present application.
As shown in fig. 7, the resource management device provided in this embodiment includes:
a memory 71;
a processor 72; and
a computer program;
wherein the computer program is stored in the memory 71 and configured to be executed by the processor 72 to implement any of the resource management methods as described above.
The present embodiments also provide a computer-readable storage medium, having stored thereon a computer program,
the computer program is executed by a processor to implement any of the resource management methods described above.
The present embodiment also provides a computer program comprising a computer program which, when executed by a processor, implements the resource management method as described in any one of the above.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (20)

1. A resource management platform is characterized in that the resource management platform is connected with a resource pool, and the resource pool comprises at least one cluster; the resource management platform logically divides the resource pool into a basic resource pool and an application resource pool;
the resource management platform is provided with a plurality of component services, and comprises: the device comprises a component resource management module and an application resource management module;
the component resource management module is used for allocating a dedicated resource group in the basic resource pool for the component service, wherein the dedicated resource group is used for operating the component service;
the application resource management module is configured to allocate an application resource group to the application resource pool for the application running in the platform, where the application resource group is used to run the application.
2. The platform of claim 1, wherein the application resource management module is specifically configured to:
receiving a resource creating instruction corresponding to the application, wherein the resource creating instruction comprises the number N of resource groups;
and determining N resource groups in the application resource pool according to the resource creating instruction, and binding the N resource groups and the application, wherein the N resource groups are used for running the application.
3. The platform of claim 2, wherein the application resource management module is further configured to:
receiving a resource application instruction of the application when the N resource groups are not enough to run the application;
and determining M resource groups in the application resource pool according to the resource application instruction, and binding the M resource groups and the application, wherein the M resource groups are used for running the application.
4. The platform of claim 2 or 3, wherein the application resource management module is further configured to:
and when the application stops running, removing the binding relationship between the application and the resource group, or deleting the resource group bound with the application to release the resources of the resource group.
5. The platform of claim 2 or 3, wherein the application resource management module is further configured to:
and when the proportion between the actually occupied resource group and the bound resource group is smaller than a preset value during the running of the application, removing the binding relationship between the application and an idle resource group in the bound resource group, or deleting the idle resource group so as to release the resources of the idle resource group.
6. The platform of any one of claims 1-3, wherein the set of proprietary resources has a scene tag;
the component resource management module is further configured to acquire scene information of a component service, and allocate a corresponding dedicated resource group to the component service according to the scene information and the scene label of the dedicated resource group.
7. The platform according to any one of claims 1 to 3, further comprising a resource information acquisition module, a component information acquisition module;
the resource information acquisition module is used for acquiring cluster resource information of each cluster in the resource pool, and the resource information is used for being displayed in a user terminal accessing the resource management platform;
the component information acquisition module is used for acquiring component resource information of each component service set in the resource management platform, and the component resource information is used for displaying in a user terminal accessing the resource management platform.
8. The platform of claim 7, wherein the resource information acquisition module is further configured to:
and responding to an instruction for displaying the detailed resource information of the cluster, and acquiring the resource information of each host in the cluster, wherein the resource information of the host is used for displaying in a user terminal accessing the resource management platform.
9. The platform of claim 8,
the cluster resource information includes any one of the following information of the cluster:
the number of the cluster total resource groups, the number of the cluster used resource groups and the number of the cluster idle resource groups;
and/or the host resource information comprises any one of the following information of the host:
the number of host total resource groups, the number of host used resource groups and the number of host idle resource groups;
and/or the component resource information comprises any one of the following information of the component:
the total number of resource groups allocated to the component and the number of resource group usage of the component.
10. A resource management method is applied to a resource management platform, wherein the resource management platform is connected with a resource pool, and the resource pool comprises at least one cluster;
the method comprises the following steps:
dividing the resource pool into a basic resource pool and an application resource pool;
allocating a dedicated resource group in a basic resource pool for the component service in the platform, wherein the dedicated resource group is used for running the component service;
and allocating an application resource group for the application operated in the platform in the application resource pool, wherein the application resource group is used for operating the application.
11. The method of claim 10, wherein the allocating a set of application resources for the application running in the platform in the application resource pool comprises:
receiving a resource creating instruction corresponding to the application, wherein the resource creating instruction comprises the number N of resource groups;
and determining N resource groups in the application resource pool according to the resource creating instruction, and binding the N resource groups and the application, wherein the N resource groups are used for running the application.
12. The method of claim 11, wherein after binding the N resource groups with the application, further comprising:
receiving a resource application instruction of the application when the N resource groups are not enough to run the application;
and determining M resource groups in the application resource pool according to the resource application instruction, and binding the M resource groups and the application, wherein the M resource groups are used for running the application.
13. The method of claim 11 or 12, further comprising:
when the application stops running, removing the binding relationship between the application and the resource group, or deleting the resource group bound with the application to release the resources of the resource group;
and/or when the proportion between the actually occupied resource group and the bound resource group during the application operation is smaller than a preset value, removing the binding relationship between the application and an idle resource group in the bound resource group, or deleting the idle resource group, so as to release the resource of the idle resource group.
14. The method according to any of claims 10-12, wherein the set of proprietary resources has a scene tag;
the allocating dedicated resource groups in a basic resource pool for the component services in the platform comprises:
acquiring scene information of component service;
and allocating corresponding exclusive resource groups for the component services according to the scene information and the scene labels of the exclusive resource groups.
15. The method of any one of claims 10-12, further comprising:
acquiring cluster resource information of each cluster in the resource pool, wherein the resource information is used for displaying in a user terminal accessing the resource management platform;
and/or acquiring component resource information of each component set in the resource management platform, wherein the component resource information is used for displaying in a user terminal accessing the resource management platform.
16. The method of claim 15, further comprising:
and responding to an instruction for displaying the detailed resource information of the cluster, and acquiring the resource information of each host in the cluster, wherein the resource information of the host is used for displaying in a user terminal accessing the resource management platform.
17. The method of claim 16,
the cluster resource information includes any one of the following information of the cluster:
the number of the cluster total resource groups, the number of the cluster used resource groups and the number of the cluster idle resource groups;
and/or the host resource information comprises any one of the following information of the cluster:
the number of host total resource groups, the number of host used resource groups and the number of host idle resource groups;
and/or the component resource information comprises any one of the following information of the component:
the total number of resource groups allocated to the component and the number of resource group usage of the component.
18. A resource management device, comprising:
a memory;
a processor; and
a computer program;
wherein the computer program is stored in the memory and configured to be executed by the processor to implement the method of any of claims 10-17.
19. A computer-readable storage medium, having stored thereon a computer program,
the computer program is executed by a processor to implement the method of any one of claims 10-17.
20. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 10-17.
CN202111474197.9A 2021-12-03 2021-12-03 Resource management platform, method and electronic equipment Pending CN114138492A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111474197.9A CN114138492A (en) 2021-12-03 2021-12-03 Resource management platform, method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111474197.9A CN114138492A (en) 2021-12-03 2021-12-03 Resource management platform, method and electronic equipment

Publications (1)

Publication Number Publication Date
CN114138492A true CN114138492A (en) 2022-03-04

Family

ID=80383806

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111474197.9A Pending CN114138492A (en) 2021-12-03 2021-12-03 Resource management platform, method and electronic equipment

Country Status (1)

Country Link
CN (1) CN114138492A (en)

Similar Documents

Publication Publication Date Title
EP3073374B1 (en) Thread creation method, service request processing method and related device
CN107515786B (en) Resource allocation method, master device, slave device and distributed computing system
CN110098946B (en) Method and device for deploying virtualized network element equipment
CN105988874B (en) Resource processing method and device
CN100495346C (en) Performing thread distribution method for multi-nucleus multi-central processing unit
JP2013513174A (en) Method and system for managing virtual machine storage space and physical hosts
CN106293893B (en) Job scheduling method and device and distributed system
CN112000463B (en) GPU resource allocation method, system, terminal and storage medium based on CUDA
CN114416352A (en) Computing resource allocation method and device, electronic equipment and storage medium
CN112463375A (en) Data processing method and device
CN109960569B (en) Virtualization processing method and device
CN112905342A (en) Resource scheduling method, device, equipment and computer readable storage medium
CN111104219A (en) Binding method, device, equipment and storage medium of virtual core and physical core
CN111694658A (en) CPU resource allocation method, device, electronic equipment and storage medium
CN111488206A (en) Deep learning task scheduling method, system, terminal and storage medium
CN115543615A (en) Resource allocation method and device, electronic equipment and storage medium
CN113835887A (en) Video memory allocation method and device, electronic equipment and readable storage medium
CN114546587A (en) Capacity expansion and reduction method of online image recognition service and related device
CN105677481A (en) Method and system for processing data and electronic equipment
CN112114958A (en) Resource isolation method, distributed platform, computer device, and storage medium
CN114138492A (en) Resource management platform, method and electronic equipment
CN112269658B (en) Composite resource application method and system, electronic equipment and storage medium
CN114942846A (en) GPU resource scheduling method, device, equipment and storage medium
WO2017133421A1 (en) Method and device for sharing resources among multiple tenants
CN114327862A (en) Memory allocation method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination