CN111338792A

CN111338792A - Cluster resource release method, device and medium

Info

Publication number: CN111338792A
Application number: CN202010094662.5A
Authority: CN
Inventors: 王金喜; 王连伟
Original assignee: Suzhou Inspur Intelligent Technology Co Ltd
Current assignee: Suzhou Inspur Intelligent Technology Co Ltd
Priority date: 2020-02-16
Filing date: 2020-02-16
Publication date: 2020-06-26
Anticipated expiration: 2040-02-16
Also published as: CN111338792B

Abstract

The invention discloses a cluster resource release method, which comprises the following steps: acquiring the utilization rate of hardware resources of a cluster; notifying a corresponding user in response to the usage rate being greater than a threshold; judging whether a request for continuously using the hardware resource sent by the user is received within a preset time period; and responding to the request received in the preset time period, adding the hardware resource corresponding to the user into a resource list, and returning to the step of obtaining the utilization rate. The invention also discloses a computer device and a readable storage medium. The scheme provided by the invention can avoid waste and abuse of a large amount of computing resources, and further effectively strengthen the use of the cluster calling job software, thereby ensuring that the computing capability of a cluster system is fully utilized and an operation result is obtained as fast as possible.

Description

Cluster resource release method, device and medium

Technical Field

The present invention relates to the field of cluster management, and in particular, to a method, device, and storage medium for releasing resources of a cluster.

Background

High Performance Computing (HPC) generally refers to computing systems and environments that use many processors (as part of a single machine) or a portion of the computers in a cluster (operating as a single computing resource). Has the characteristics that each node is a complete computer, the nodes are connected with each other through a high-performance network, a network interface and an I/O bus are loosely coupled, each node has a complete operating system, and the like

By the clustered system appearing as a unitary server system from the user's perspective, many users can use the system at the same time. But when too many users use the cluster system, unordered use of system resources may instead result in poor system performance.

Therefore, the job scheduling system is developed at the same time, and the job scheduling system reasonably distributes resources to each job so as to ensure that the computing capacity of the cluster system is fully utilized and the computing result is obtained as fast as possible. Meanwhile, the method can manage the software and hardware resource monitoring and the jobs submitted by the users in the cluster system, and reasonably schedule the jobs submitted by the users according to the resource use conditions in the cluster, thereby achieving the effects of improving the resource utilization rate and the job execution efficiency.

Although the job scheduling system integrates various resources well for users to use, many users skip the scheduling job system to execute processes, which results in various abuses on cluster resources, and thus the scheduling job system does not achieve the expected effect.

Disclosure of Invention

In view of the above, in order to overcome at least one aspect of the above problem, an embodiment of the present invention provides a method for releasing resources of a cluster, including the following steps:

acquiring the utilization rate of hardware resources of a cluster;

notifying a corresponding user in response to the usage rate being greater than a threshold;

judging whether a request for continuously using the hardware resource sent by the user is received within a preset time period;

and responding to the request received in the preset time period, adding the hardware resource corresponding to the user into a resource list, and returning to the step of obtaining the utilization rate.

In some embodiments, adding the hardware resource corresponding to the user to a resource list further includes:

and setting a service life for the hardware resource corresponding to the user in the resource list.

In some embodiments, in response to the usage rate being greater than a threshold, notifying the respective user, further comprising:

obtaining a priority ranking of a number of said users using said hardware resources;

and informing the corresponding users according to the priority sequence of the users.

In some embodiments, further comprising:

and in response to not receiving the request within the preset time period, directly releasing the hardware resources used by the user.

In some embodiments, determining whether a request sent by the user to continue using the hardware resource is received within a preset time period further includes:

judging whether the user releases the hardware resource by himself;

responding to the self release of the hardware resource by the user, and directly returning to the step of obtaining the utilization rate;

and responding to the situation that the user does not release the hardware resources by self, and judging whether the request is received in a preset time period.

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer apparatus, including:

at least one processor; and

a memory storing a computer program operable on the processor, wherein the processor executes the program to perform the steps of:

acquiring the utilization rate of hardware resources of a cluster;

In some embodiments, further comprising:

Based on the same inventive concept, according to another aspect of the present invention, an embodiment of the present invention further provides a computer-readable storage medium storing a computer program which, when executed by a processor, performs the steps of any one of the above-mentioned cluster resource release methods.

The invention has one of the following beneficial technical effects: the scheme provided by the invention can avoid waste and abuse of a large amount of computing resources, and further effectively strengthen the use of the cluster calling job software, thereby ensuring that the computing capability of a cluster system is fully utilized and an operation result is obtained as fast as possible.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other embodiments can be obtained by using the drawings without creative efforts.

Fig. 1 is a schematic flowchart of a resource releasing method for a cluster according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a computer device provided in an embodiment of the present invention;

fig. 3 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the following embodiments of the present invention are described in further detail with reference to the accompanying drawings.

It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are used for distinguishing two entities with the same name but different names or different parameters, and it should be noted that "first" and "second" are merely for convenience of description and should not be construed as limitations of the embodiments of the present invention, and they are not described in any more detail in the following embodiments.

According to an aspect of the present invention, an embodiment of the present invention provides a method for releasing resources of a cluster, as shown in fig. 1, which may include the steps of: s1, acquiring the utilization rate of the hardware resources of the cluster; s2, responding to the utilization rate being larger than the threshold value, notifying the corresponding user; s3, judging whether a request for continuously using the hardware resource sent by the user is received in a preset time period; s4, responding to the request received in the preset time period, adding the hardware resource corresponding to the user into a resource list, and returning to the step of obtaining the utilization rate.

The scheme provided by the invention can avoid waste and abuse of a large amount of computing resources, and further effectively strengthen the use of the cluster calling job software, thereby ensuring that the computing capability of a cluster system is fully utilized and an operation result is obtained as fast as possible.

According to the scheme provided by the invention, in some embodiments, a threshold value of the utilization rate of the hardware resource can be preset, and the hardware resource is monitored according to the threshold value.

Specifically, the threshold may be dynamically adjusted according to the actual situation of the cluster, and the hardware resource may be, for example, a resource of the CPU or a resource of the GPU. In some embodiments, the threshold values of the utilization rates of different hardware may be the same or different, and may be adjusted according to actual situations. In some embodiments, resource utilization may be reflected by the process.

It should be noted that the threshold values of different hardware resources may be preset in a configuration file, and when monitoring is performed, the corresponding threshold values are obtained through the configuration file, or before monitoring is performed, monitoring is performed according to the received threshold parameter input by the user.

Then, after the threshold is set, the usage of the corresponding hardware resource is monitored, that is, the step S1 is performed to obtain the usage of the hardware resource of the cluster. And then judging whether the utilization rate of the hardware resources of the cluster exceeds a threshold value according to the acquired utilization rate and the preset threshold value.

In some embodiments, if the threshold is exceeded, then step S2 is performed to notify the corresponding user in response to the usage rate being greater than the threshold.

Specifically, when the utilization rate of the hardware resources of the cluster exceeds a threshold, the corresponding resources may be released according to the priority ranking of the user. For example, when three users a, B, and C are using the hardware resources of the cluster and the usage rate of the hardware resources at this time exceeds a threshold, first determining the priority ranking of the three users, for example, when the priority a is smaller than B and the priority B is smaller than C, preferentially notifying the user a of resource release, if the user a cannot release the resources and the usage rate of the hardware resources still exceeds the threshold (which indicates that no other user releases the resources within a time period in which the user a is notified of the requirement for resource release), notifying the user B, and so on.

In some embodiments, all users may also be notified at the same time or the user of the next priority may be notified at preset time intervals, so that it is not necessary to wait for the previous user to perform processing, and resource release is accelerated. For example, when three users a, B, and C are using the hardware resource of the cluster and the usage rate of the hardware resource at this time exceeds the threshold, when the priority a is smaller than B and B is smaller than C, notification may be sent to A, B and C at the same time, or notification may be sent to a first, then to B, and finally to C, and if the hardware usage rate is smaller than the threshold again, then no notification may be sent continuously, for example, when the hardware usage rate is smaller than the threshold before notification is sent to C, notification does not need to be sent to C, but as long as the hardware usage rate is larger than the threshold, notification is sent to the next user.

judging whether the user releases the hardware resource by himself;

Specifically, after sending a notification to the corresponding user, it may be determined whether the user releases the resource by himself or herself, and if the user releases the resource by himself or herself, the step of obtaining the usage rate is directly returned. And if the user does not release the resources by self, judging whether the user reports the request of continuously using the hardware resources within a preset time period.

In some embodiments, if the user reports the request, step S4 is performed, and in response to receiving the request within the preset time period, the hardware resource corresponding to the user is added to the resource list, and the step of obtaining the usage rate is returned.

Specifically, when the hardware resources used by the user are detected to occupy too much resources, the user can report to a resource auditor, the resource auditor organizes a resource audit conference according to the use condition of the hardware resources, determines whether the hardware resources of the user can be added into a resource list, and if yes, the hardware resources of the user can be continuously used, otherwise, the hardware resources are deleted. The resource auditing conference comprises at least 3 persons such as users, auditors and managers, and the conference determines whether hardware resources (namely used processes) occupied by the users continue to use system resources and the use period, and the hardware resources can be added into a resource list after determination. The resource list comprises a process for running and using the system resource and a corresponding service life, and once the corresponding life is exceeded, the audit needs to be reported again, and if the application for continuous use is not reported again after the corresponding life is exceeded, the hardware resource used by the user is directly released.

In some embodiments, the method further comprises:

Specifically, if no request is reported, the hardware resource used by the user is directly released.

In some embodiments, since the resource utilization can be reflected by the process, a command process allowing frequent use can be set, and once the other processes of the user exceed a threshold, the other processes of the user can receive a notification, and the user is informed that processes occupying too much hardware resources exist under the user, please delete the processes within a specified time, and once the time is exceeded, the processes can be deleted by the system; and reporting within a specified time limit, if the process which continues to use the hardware resources is agreed not to be killed, otherwise, closing the process. And log information is output in the whole process.

Therefore, according to the scheme provided by the invention, the hardware resource monitoring of the high-performance cluster is realized by setting a threshold closed loop, once the threshold is exceeded (the threshold is adjustable), a notice (a file or an email) is sent to the user, the user is notified that the additionally used CPU resource exceeds the threshold, and the user is requested to process and close the corresponding process as soon as possible to release the CPU resource; setting the time for exceeding limit, if the user receives the notice and does not release the CPU resource within the specified time limit, the system will delete the process automatically to release the resource; if the process occupying excessive CPU resources is particularly important for the user, whether the display of the process is cancelled can be determined through the resource auditing conference. Therefore, the invalid redundant processes of the cluster users can be automatically closed, the automatic release of the hardware resources is realized, the notice can be sent to the users, the hardware resources are released according to the selection of the users and the resource auditing conference, and the intelligent and humanized functions are realized. The method not only avoids the waste and abuse of a large amount of computing resources, but also effectively strengthens the use of the cluster calling job software, thereby ensuring that the computing capability of the cluster system is fully utilized and the operation result is obtained as fast as possible.

Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 2, an embodiment of the present invention further provides a computer apparatus 501, comprising:

at least one processor 520; and

a memory 510, the memory 510 storing a computer program 511 executable on the processor, the processor 520 executing the program to perform the steps of any of the above cluster resource release methods.

Based on the same inventive concept, according to another aspect of the present invention, as shown in fig. 3, an embodiment of the present invention further provides a computer-readable storage medium 601, where the computer-readable storage medium 601 stores computer program instructions 610, and the computer program instructions 610, when executed by a processor, perform the steps of the resource release method of any one of the above clusters.

Finally, it should be noted that, as will be understood by those skilled in the art, all or part of the processes of the methods of the above embodiments may be implemented by a computer program to instruct related hardware to implement the methods. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a Random Access Memory (RAM), or the like. The embodiments of the computer program may achieve the same or similar effects as any of the above-described method embodiments.

In addition, the apparatuses, devices, and the like disclosed in the embodiments of the present invention may be various electronic terminal devices, such as a mobile phone, a Personal Digital Assistant (PDA), a tablet computer (PAD), a smart television, and the like, or may be a large terminal device, such as a server, and the like, and therefore the scope of protection disclosed in the embodiments of the present invention should not be limited to a specific type of apparatus, device. The client disclosed by the embodiment of the invention can be applied to any one of the electronic terminal devices in the form of electronic hardware, computer software or a combination of the electronic hardware and the computer software.

Furthermore, the method disclosed according to an embodiment of the present invention may also be implemented as a computer program executed by a CPU, and the computer program may be stored in a computer-readable storage medium. The computer program, when executed by the CPU, performs the above-described functions defined in the method disclosed in the embodiments of the present invention.

Further, the above method steps and system elements may also be implemented using a controller and a computer readable storage medium for storing a computer program for causing the controller to implement the functions of the above steps or elements.

Further, it should be appreciated that the computer-readable storage media (e.g., memory) herein can be either volatile memory or nonvolatile memory, or can include both volatile and nonvolatile memory. By way of example, and not limitation, nonvolatile memory can include Read Only Memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in a variety of forms such as synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The storage devices of the disclosed aspects are intended to comprise, without being limited to, these and other suitable types of memory.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as software or hardware depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments of the present invention.

The various illustrative logical blocks, modules, and circuits described in connection with the disclosure herein may be implemented or performed with the following components designed to perform the functions herein: a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.

The steps of a method or algorithm described in connection with the disclosure herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.

In one or more exemplary designs, the functions may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk, blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

The foregoing is an exemplary embodiment of the present disclosure, but it should be noted that various changes and modifications could be made herein without departing from the scope of the present disclosure as defined by the appended claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. Furthermore, although elements of the disclosed embodiments of the invention may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

It should be understood that, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly supports the exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

The numbers of the embodiments disclosed in the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

Those of ordinary skill in the art will understand that: the discussion of any embodiment above is meant to be exemplary only, and is not intended to intimate that the scope of the disclosure, including the claims, of embodiments of the invention is limited to these examples; within the idea of an embodiment of the invention, also technical features in the above embodiment or in different embodiments may be combined and there are many other variations of the different aspects of the embodiments of the invention as described above, which are not provided in detail for the sake of brevity. Therefore, any omissions, modifications, substitutions, improvements, and the like that may be made without departing from the spirit and principles of the embodiments of the present invention are intended to be included within the scope of the embodiments of the present invention.

Claims

1. A method for releasing cluster resources is characterized by comprising the following steps:

acquiring the utilization rate of hardware resources of a cluster;

2. The method of claim 1, wherein adding the hardware resource corresponding to the user to a resource list further comprises:

3. The method of claim 1, wherein in response to the usage rate being greater than a threshold, notifying a corresponding user, further comprising:

4. The method of claim 1, further comprising:

5. The method of claim 1, wherein determining whether a request sent by the user to continue using the hardware resource is received within a preset time period further comprises:

judging whether the user releases the hardware resource by himself;

6. A computer device, comprising:

at least one processor; and

acquiring the utilization rate of hardware resources of a cluster;

7. The apparatus of claim 6, wherein adding the hardware resource corresponding to the user to a resource list further comprises:

8. The device of claim 6, wherein in response to the usage rate being greater than a threshold, notifying a corresponding user, further comprising:

9. The apparatus of claim 6, further comprising:

10. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the steps of the method according to any one of claims 1-5.