CN213876703U - Resource pool management system - Google Patents

Resource pool management system Download PDF

Info

Publication number
CN213876703U
CN213876703U CN202120112639.4U CN202120112639U CN213876703U CN 213876703 U CN213876703 U CN 213876703U CN 202120112639 U CN202120112639 U CN 202120112639U CN 213876703 U CN213876703 U CN 213876703U
Authority
CN
China
Prior art keywords
resource pool
resource
information
idle
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN202120112639.4U
Other languages
Chinese (zh)
Inventor
苏允腾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Huirui Technology Co ltd
Original Assignee
Guangdong Huirui Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Huirui Technology Co ltd filed Critical Guangdong Huirui Technology Co ltd
Priority to CN202120112639.4U priority Critical patent/CN213876703U/en
Application granted granted Critical
Publication of CN213876703U publication Critical patent/CN213876703U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The utility model belongs to the technical field of cloud computing, in particular to a resource pool management system, which obtains first information transmitted by a user terminal through an obtaining module, then utilizes an intelligent scheduling module to distribute tasks according to the principle that the number of servers in the resource pool management module is the lowest and the resource utilization rate of each server is the highest, ensures that instructions sent by a plurality of user terminals are matched into the servers conforming to the operation of the user terminals one by one and ensures that the resource utilization rate of the servers is the highest, simultaneously, the intelligent scheduling module monitors idle resources in the resource pool in real time to generate a corresponding idle resource identifier catalog, is convenient for completing the calling of the idle resources through the index relationship between the idle resources of the plurality of servers and the identifiers, does not go to the resource pool directly to search the idle resources conforming to the conditions one by one, and greatly reduces the computing time of the resource pool management system, the calling speed of the server is increased, and the resource calling efficiency of the resource pool is improved.

Description

Resource pool management system
Technical Field
The utility model belongs to the technical field of the cloud calculates, concretely relates to resource pool management system.
Background
With the development of the computer field, the hardware structure of the computer is more and more abundant, various functions are provided, and meanwhile, more and more resources are available, and the following problems are that the management of the resources is easy to cause problems due to excessive functions, and the important problems that the resources can be called when the resources are idle, the resources cannot be called when the resources are occupied, and how to efficiently process the information become the current cloud computing needs to be solved.
In order to solve the problem, a management method of a resource pool is introduced in the prior art, and a management method for the resource pool in the prior art may include: when receiving a service required to be operated, determining resources required by the operation of the service; determining whether the idle resources of each server in the starting state can meet the required resources one by one according to the required resources, and if so, allocating the service to the server of which the idle resources meet the required resources to run the service; and if the idle resources of the server in the starting state can not meet the required resources, restarting one server, and distributing the service to the restarted server to operate the service.
However, there are multiple resources of the same type in the resource pool, and when the user needs to call the resources, the computer will go to the resource pool to query the available resources, but this query process will occupy a large amount of resources of the central processing unit, and the resources cannot be effectively managed, thereby improving the resource management efficiency. Therefore, how to accelerate the query time of the idle resources and improve the resource management efficiency becomes a problem to be solved.
SUMMERY OF THE UTILITY MODEL
The utility model aims to provide a: aiming at the defects of the prior art, the resource pool management system is provided, and flexible configuration of the resource pool can be realized.
In order to achieve the above purpose, the utility model adopts the following technical scheme:
a resource pool management system, comprising: the system comprises an acquisition module, a resource pool management module and an intelligent scheduling module;
the acquisition module is used for monitoring a plurality of user terminals, acquiring first information transmitted by the user terminals and sending the first information to the intelligent scheduling module;
the intelligent scheduling module is used for monitoring idle resources in the resource pool in real time, generating a corresponding idle resource identifier directory, searching a first identifier matched with the first information in the idle resource identifier directory, and then sending second information to the resource pool management module;
the resource pool management module is used for receiving second information sent by the intelligent scheduling module, scheduling a server which is not less than the resource occupation amount of the first information or starting a new server which is not less than the resource occupation amount of the first information according to the second information, and operating a client instruction corresponding to the first information.
Further, the intelligent scheduling module includes an automatic deleting module, and when the intelligent scheduling module finds the first identifier matching with the first information in the free resource identifier directory, the intelligent scheduling module automatically deletes the first identifier while sending the second information.
Further, the intelligent scheduling module includes an automatic storage module, and when the intelligent scheduling module monitors that the amount of idle resources exists in the server in the resource pool, the intelligent scheduling module automatically generates an idle resource identifier of the server, and stores the idle resource identifier of the server in the idle resource identifier directory.
Further, the intelligent scheduling module monitors the modified first information in the server, and when the amount of idle resources of the server is smaller than the amount of occupied resources of the modified first information, the intelligent scheduling module re-determines the amount of occupied resources of the modified first information, and sends second information to the resource pool management module, where the second information is used for scheduling the modified first information.
Further, the occupied resource amount comprises a CPU occupied amount, a memory occupied amount and a disk occupied amount, and the free resource amount comprises a CPU idle amount, a memory idle amount and a disk idle amount.
Further, the resource pool management module comprises a computing resource, a storage resource, a network resource and a software resource, and the computing resource, the storage resource, the network resource and the software resource are connected into a logic whole.
Furthermore, the intelligent scheduling module allocates the server resources according to the conditions that the number of the servers in the resource pool is the lowest and the resource utilization rate of each server is the highest, so that the instructions sent by the plurality of clients are matched with the servers which are in accordance with the operation of the clients one by one, and the resource utilization rate of the servers is the highest.
Further, the intelligent scheduling module comprises a resource pool detection unit, a resource pool allocation unit and an idle resource identifier directory creation unit, wherein the resource pool detection unit is used for detecting the total number of servers in the resource pool and the idle amount of each server, and the resource pool allocation unit is used for sending an instruction to control the resource pool management module to start or close the servers; the free resource identifier catalog creating unit is used for generating a corresponding free resource identifier catalog according to the resource pool detecting unit.
Further, the intelligent scheduling module is a low-load scheduling mode, and the low-load scheduling mode includes: and monitoring the load conditions of a plurality of servers in the resource pool in real time, and directly triggering the resource scheduling task when the load of the server is detected and judged to be lower than a set threshold value.
Further, when the server in the resource pool is in a completely idle state, the resource pool management module performs a shutdown operation on the server.
The beneficial effects of the utility model reside in that: the utility model provides a resource pool management system, monitor a plurality of user sides through the acquisition module, acquire the first information that the user side carried, then utilize intelligent scheduling module to carry out task allocation, allocate according to the principle that the number of server starts in the resource pool management module is minimum and the resource utilization rate of each server is the highest, guarantee that the instruction that a plurality of user sides sent matches in the server that accords with its operation one by one and guarantee that the resource utilization rate of server is the highest, simultaneously, the intelligent scheduling module monitors the idle resource in the resource pool in real time, generate the corresponding idle resource identifier catalog, be convenient for accomplish the call of idle resource through the index relation between the idle resource of a plurality of servers and the identifier, no longer go to directly in the resource pool to look up the idle resource that accords with the condition one by one, greatly reduce the computing time of the resource pool management system, the calling speed of the server is increased, and the resource calling efficiency of the resource pool is improved.
Drawings
Fig. 1 is a schematic structural diagram of a resource pool management system in an embodiment of the present invention;
fig. 2 is a schematic diagram of the resource pool management system implementing scheduling in the embodiment of the present invention;
fig. 3 is a schematic diagram of the resource pool management system implementing the open server in the embodiment of the present invention;
fig. 4 is a schematic diagram of the resource pool management system implementing closing the server in the embodiment of the present invention.
Wherein, 1-obtaining module;
2-resource pool management module;
3-an intelligent scheduling module; 31-a resource pool detection unit; 32-resource pool allocation unit; 33-free resource identifier directory creation unit.
Detailed Description
In the description of the present application, unless explicitly stated or limited otherwise, the terms "first", "second", "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance; the term "plurality" means two or more; the terms "connected," "secured," and the like are to be construed broadly and unless otherwise stated or indicated, and for example, "connected" may be a fixed connection, a removable connection, an integral connection, or an electrical connection; "connected" may be directly connected or indirectly connected through an intermediate. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
In the description of the present application, it should be understood that the term "and/or" used in the present application is only one kind of association relationship describing the associated object, and means that there may be three kinds of relationships, for example, a and/or B, and may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
In the description of the application, unless otherwise expressly stated or limited, the terms "mounted," "connected," "secured," and the like are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood according to specific situations by those skilled in the art.
The present invention will be described in further detail with reference to the following drawings and specific examples, which should not be construed as limiting the present invention.
As shown in fig. 1 to 4, a resource pool management system includes:
the system comprises an acquisition module 1, an intelligent scheduling module 3 and a control module, wherein the acquisition module 1 is used for monitoring a plurality of user sides, acquiring first information transmitted by the user sides and sending the first information to the intelligent scheduling module 3;
the intelligent scheduling module 3 is used for monitoring the idle resources of the servers in the resource pool in real time, generating an idle resource identifier directory corresponding to the servers, searching a first identifier matched with the idle resource identifier directory in the idle resource identifier directory according to the first information, and then sending second information to the resource pool management module 2;
and the resource pool management module 2 is used for receiving the second information sent by the intelligent scheduling module 3, scheduling the server not less than the resource occupied by the first information or starting the server not less than the resource occupied by the first information according to the second information, and operating the client instruction corresponding to the first information.
It can be understood that the obtaining module 1 is an API interface server, the resource pool management system adopts libvirt resource virtual interface, and the method of providing virDomainGetInfo in ibvirt technology can encapsulate the use of computing resources and memory resources of a domain in a structure, and calculate the actual use of resources in the resource management pool through CPUTIME.
For example, referring to fig. 2, a resource pool management system works by monitoring a plurality of clients through an acquisition module 1, acquiring first information transmitted by the clients, searching a first identifier matching the first information in a free resource identifier directory of an intelligent scheduling module 3, feeding a query result back to a resource pool management module 2, after the resource pool management module 2 responds, the intelligent scheduling module 3 performs task allocation, performing allocation according to the principle that the number of servers in a resource pool is the lowest and the resource utilization rate of each server is the highest, ensuring that instructions sent by the plurality of clients are matched one by one to the servers in accordance with the operation of the clients and ensuring that the resource utilization rate of the servers is the highest, and meanwhile, the intelligent scheduling module 3 monitors free resources of each server in the resource pool in real time to generate a corresponding free resource identifier directory, the method and the system have the advantages that the idle resources can be conveniently called through the index relation between the idle resources of the servers and the identifiers, the servers do not directly go to the resource pool to search the idle resources meeting the conditions in a one-to-one traversal mode, the computing time of the resource pool management system is greatly shortened, the calling speed of the servers is increased, and the resource calling efficiency of the resource pool is improved.
Preferably, the intelligent scheduling module 3 has an automatic deleting function, and when the intelligent scheduling module 3 finds the first identifier matching the first information in the free resource identifier directory, the intelligent scheduling module 3 automatically deletes the first identifier while sending the second information.
It can be understood that, in order to avoid the server from running in an overload mode, when the identifier corresponding to the idle resource of the server is called, the identifier is automatically removed from the idle resource identifier directory immediately, so that the identifier is ensured not to be called repeatedly, and allocation errors are avoided.
Wherein, the free resource identifier directory is FIFO (First Input First Output, First in First out queue);
preferably, the intelligent scheduling module 3 has an automatic storage function, and when the intelligent scheduling module 3 monitors that a server in the resource pool has a free resource, an identifier of the free resource of the server is automatically generated, and the generated identifier is stored in the free resource identifier directory.
It will be appreciated that the identifier stored in the free resource identifier directory is a symbol that uniquely corresponds to the amount of free resources for each server in the resource pool. In this case, the array subscript uniquely corresponding to the free resource of each server may be determined as the identifier corresponding to the free resource amount of each server. In this embodiment, the bit width of the identifier may be consistent with the system bit width, and for example, in the bit operating system, the bit width corresponding to the identifier corresponding to the free resource amount of each server may be set as a bit.
Preferably, the intelligent scheduling module 3 determines the first information or the occupied resource amount of the modified first information when the first information is received or the modified first information is monitored in the server and the idle resource amount of the server cannot meet the occupied resource amount of the modified first information, and sends the second information to the resource pool management module 2.
The first information corresponds to the resource amount occupied by the operation of the first information, and the resource amount occupied by the first information comprises: CPU occupancy (how many GHz the CPU is occupied), memory occupancy (how many GB the memory is occupied), and disk occupancy (how many GB the disk is occupied).
Preferably, the resource pool management module 2 includes computing resources, storage resources, network resources and software resources, which are connected into a logical whole.
The utility model provides a pair of resource pool management system, it is all abstracted into the resource with all things on every server, then corresponds a unique resource identification URI for every resource, just so can increase, delete, change, the operation of looking into the resource through HTTP agreement (HTTPPOST, HTTPDELETE, HTTPPUT, HTTPGET) as the connector, does not change resource identification URI to any operation of resource simultaneously. Through the interface, a user can easily and intuitively access required resources such as computing resources, storage resources, network equipment and the like through the URI, scheduling management is carried out by abstracting a grid object by using a grid-based model, and integrated computing resources, information and application services are provided for the user. All basic information and real-time index data of all resources are stored in the grid, the frequency of grid data access selects whether the data are stored in a memory mode or a disk mode, and real-time ultrahigh frequency data are accessed in a full memory mode. The grid query speed of the resource pool management system is more than 10 times faster than that of a common database.
Preferably, the intelligent scheduling module 3 allocates the requests according to the conditions that the number of the servers in the resource pool management module 2 is the lowest and the resource utilization rate of each server is the highest, so as to ensure that the instructions sent by the plurality of clients are matched with the servers which are in accordance with the operation of the clients one by one and ensure that the resource utilization rate of the servers is the highest.
Preferably, the intelligent scheduling module 3 includes a resource pool detecting unit 31, a resource pool allocating unit 32, and an idle resource identifier catalog creating unit 33, where the resource pool detecting unit 31 is configured to detect the total number of servers in the resource pool and the idle amount of the idle servers, and the resource pool allocating unit 32 is configured to send an instruction to control the resource pool management module 2 to start a new server or close a server; the free resource identifier directory creating unit 33 is configured to generate a corresponding free resource identifier directory according to the resource pool detecting unit 31.
The free resource identifier directory creating unit 33 may be various media that can store program codes, such as ROM, RAM, a magnetic disk, or an optical disk, and is used to store free resource identifiers of the respective servers.
Preferably, the intelligent scheduling module 3 is a low load scheduling mode, and the low load scheduling mode includes: and monitoring the load conditions of a plurality of servers in the resource pool management module 2 in real time, and directly starting a resource scheduling task when the load of the servers is detected and judged to be lower than a set threshold value.
Preferably, the intelligent scheduling module 3 monitors whether the server in the resource pool is in a completely idle state, and sends the second information to the resource pool management module 2, and the resource pool management module 2 performs a shutdown operation on the server that needs to be shutdown.
It can be understood that the resource pool management module 2 is a controller, and when a plurality of servers in the resource pool are in an idle state, it may perform a shutdown operation on the plurality of idle servers, and when the amount of idle resources of the servers in the resource pool is not enough to run a new service (first information), the resource pool management module 2 may start the new server according to the occupied resource amount information carried by the new service, so as to run the new service. The functions of the system are realized based on the current general-purpose switch controller, such as an ONOS controller or an OpenDaylight controller, and only corresponding function expansion is needed to be carried out according to the management requirements of the resource pool.
Variations and modifications to the above-described embodiments may become apparent to those skilled in the art from the disclosure and teachings of the above description. Therefore, the present invention is not limited to the above-mentioned embodiments, and any obvious modifications, replacements or variations made by those skilled in the art on the basis of the present invention belong to the protection scope of the present invention. Furthermore, although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims (10)

1. A resource pool management system, comprising: the system comprises an acquisition module (1), a resource pool management module (2) and an intelligent scheduling module (3);
the acquisition module (1) is used for monitoring a plurality of user sides, acquiring first information transmitted by the user sides and sending the first information to the intelligent scheduling module (3);
the intelligent scheduling module (3) is used for monitoring idle resources in the resource pool in real time, generating a corresponding idle resource identifier directory, searching a first identifier matched with the first information in the idle resource identifier directory, and then sending second information to the resource pool management module (2);
the resource pool management module (2) is configured to receive the second information sent by the intelligent scheduling module (3), and the resource pool management module (2) schedules a server not less than the amount of resources occupied by the first information or starts a new server not less than the amount of resources occupied by the first information according to the second information, and is configured to run a client instruction corresponding to the first information.
2. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) comprises an automatic deleting module, and when the intelligent scheduling module (3) finds the first identifier matched with the first information in the free resource identifier directory, the intelligent scheduling module (3) automatically deletes the first identifier while sending the second information.
3. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) comprises an automatic storage module, when the intelligent scheduling module (3) monitors that the amount of idle resources exists in the server in the resource pool, the intelligent scheduling module automatically generates an idle resource identifier of the server, and stores the idle resource identifier of the server in the idle resource identifier directory.
4. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) monitors the modified first information in the server, and when the amount of idle resources of the server is smaller than the amount of occupied resources of the modified first information, the intelligent scheduling module (3) re-determines the amount of occupied resources of the modified first information, and sends the second information to the resource pool management module (2), wherein the second information is used for scheduling the modified first information.
5. The resource pool management system according to claim 4, wherein:
the occupied resource amount comprises CPU occupied amount, memory occupied amount and disk occupied amount, and the free resource amount comprises CPU idle amount, memory idle amount and disk idle amount.
6. The resource pool management system according to claim 1, wherein:
the resource pool management module (2) comprises computing resources, storage resources, network resources and software resources, and the computing resources, the storage resources, the network resources and the software resources are connected into a logic whole.
7. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) distributes the instructions according to the conditions that the number of the servers in the resource pool is the lowest and the resource utilization rate of each server is the highest, so that the instructions sent by the plurality of clients are matched with the servers which are in accordance with the operation of the clients one by one, and the resource utilization rate of the servers is the highest.
8. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) comprises a resource pool detection unit (31), a resource pool allocation unit (32) and an idle resource identifier directory creation unit (33), wherein the resource pool detection unit (31) is used for detecting the total number of servers of a resource pool and the idle amount of each server, and the resource pool allocation unit (32) is used for sending an instruction and controlling the resource pool management module (2) to start or close the servers; the free resource identifier list creating unit (33) is used for generating a corresponding free resource identifier list according to the resource pool detecting unit (31).
9. The resource pool management system according to claim 1, wherein:
the intelligent scheduling module (3) is in a low-load scheduling mode, and the low-load scheduling mode comprises the following steps: and monitoring the load conditions of a plurality of servers in the resource pool in real time, and directly triggering the resource scheduling task when the load of the server is detected and judged to be lower than a set threshold value.
10. The resource pool management system according to claim 1, wherein:
when the server in the resource pool is in a completely idle state, the resource pool management module (2) carries out shutdown operation on the server.
CN202120112639.4U 2021-01-15 2021-01-15 Resource pool management system Expired - Fee Related CN213876703U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202120112639.4U CN213876703U (en) 2021-01-15 2021-01-15 Resource pool management system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202120112639.4U CN213876703U (en) 2021-01-15 2021-01-15 Resource pool management system

Publications (1)

Publication Number Publication Date
CN213876703U true CN213876703U (en) 2021-08-03

Family

ID=77046305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202120112639.4U Expired - Fee Related CN213876703U (en) 2021-01-15 2021-01-15 Resource pool management system

Country Status (1)

Country Link
CN (1) CN213876703U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114785806A (en) * 2022-02-09 2022-07-22 紫光云(南京)数字技术有限公司 Automatic setting method for resource scheduling label
CN115220910A (en) * 2022-06-17 2022-10-21 中科驭数(北京)科技有限公司 Resource scheduling method, device and equipment

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114785806A (en) * 2022-02-09 2022-07-22 紫光云(南京)数字技术有限公司 Automatic setting method for resource scheduling label
CN115220910A (en) * 2022-06-17 2022-10-21 中科驭数(北京)科技有限公司 Resource scheduling method, device and equipment
CN115220910B (en) * 2022-06-17 2024-04-19 中科驭数(北京)科技有限公司 Resource scheduling method, device and equipment

Similar Documents

Publication Publication Date Title
CN109714192B (en) Monitoring method and system for monitoring cloud platform
CN107832126B (en) Thread adjusting method and terminal thereof
CN105049268A (en) Distributed computing resource allocation system and task processing method
CN213876703U (en) Resource pool management system
CN112685148B (en) Asynchronous communication method and device for mass terminals, computer equipment and storage medium
CN111562889B (en) Data processing method, device, system and storage medium
CN112231108A (en) Task processing method and device, computer readable storage medium and server
CN102081554A (en) Cloud computing operating system as well as kernel control system and method thereof
CN112698952A (en) Unified management method and device for computing resources, computer equipment and storage medium
CN111447102A (en) SDN network device access method and device, computer device and storage medium
JP2015191523A (en) Configuration management apparatus, configuration management system, and configuration management program
CN110647392A (en) Intelligent elastic expansion method based on container cluster
CN113014608B (en) Flow distribution control method and device, electronic equipment and storage medium
CN107479974A (en) A kind of dispatching method of virtual machine and device
CN117950850A (en) Data transmission method, device, electronic equipment and computer readable medium
CN105760215A (en) Map-reduce model based job running method for distributed file system
CN115114316A (en) Processing method, device, cluster and storage medium for high-concurrency data
CN114090201A (en) Resource scheduling method, device, equipment and storage medium
CN112667465A (en) Multi-cluster operation monitoring method, device and system and readable storage medium
CN113391927A (en) Method, device and system for processing business event and storage medium
CN112115123A (en) Method and apparatus for performance optimization of distributed databases
CN110995464A (en) Centralized distributed low-voltage distribution area monitoring deployment method and system
CN113064714B (en) Method and device for processing task by utilizing idle resources in research and development environment
CN117651075B (en) Task message transmission method, device, computer equipment and computer readable storage medium
CN114546979B (en) Distributed storage system, and management method, device and equipment thereof

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210803

CF01 Termination of patent right due to non-payment of annual fee