CN111858030B - Resource processing method and device for job, electronic equipment and readable storage medium - Google Patents
Resource processing method and device for job, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN111858030B CN111858030B CN202010552506.9A CN202010552506A CN111858030B CN 111858030 B CN111858030 B CN 111858030B CN 202010552506 A CN202010552506 A CN 202010552506A CN 111858030 B CN111858030 B CN 111858030B
- Authority
- CN
- China
- Prior art keywords
- job
- resource
- server
- type
- jobs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 15
- 238000013468 resource allocation Methods 0.000 claims abstract description 33
- 238000000034 method Methods 0.000 claims description 105
- 230000008569 process Effects 0.000 claims description 82
- 230000015654 memory Effects 0.000 claims description 28
- 230000008014 freezing Effects 0.000 claims description 15
- 238000007710 freezing Methods 0.000 claims description 15
- 238000012544 monitoring process Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 14
- 238000004886 process control Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000010257 thawing Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Hardware Redundancy (AREA)
Abstract
The application discloses a resource processing method and device for a job, electronic equipment and a readable storage medium, and relates to the technical field of cloud computing. The specific implementation scheme is as follows: acquiring the resource usage of a job executed on a server, wherein the job comprises a first type job; according to the resource usage of the jobs and the maximum resource quota which can be provided to the jobs by the server, adjusting the maximum resource quota of one first type job or a plurality of first type jobs so as to execute the one first type job or the plurality of first type jobs by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; the maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server; the maximum resource quota of a first type job or jobs of the first type is greater than or equal to the minimum resource quota of the first type job.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for processing resources of a job, an electronic device, and a readable storage medium.
Background
In the field of cloud computing technology, one or more data processing processes may be referred to as a job. The jobs can be classified into online jobs and offline jobs according to the nature of the jobs. Typically, a user may specify a resource quota for his job, e.g., 20 CPU cores, 10G memory, etc. Once the resource usage of a job exceeds this resource quota, the progress of the job may be compressed or ended. In general, the resource quota of the online job is set according to the resources required by the peak time of the online job, so that the online job does not fully use the resource quota of the online job in most of the time, thereby wasting resources.
In order to improve the resource utilization rate, when the resource is idle, the job can use the resource except the resource quota of the job, so as to obtain the super-sending resource which is larger than the resource quota of the job. When resources are tensed, the job returns the obtained superluminescent resources.
However, in some cases, for example, the amount of superluminescent resources used by the job is far greater than the resource quota of the job, so that the whole machine resources of the server are greatly consumed, even exhausted, and the like, and the execution quality of some jobs may be affected, even failed, thereby reducing the efficiency and reliability of job execution.
Disclosure of Invention
Aspects of the present application provide a method, an apparatus, an electronic device, and a readable storage medium for processing a job resource, so as to improve efficiency and reliability of job execution.
According to a first aspect, there is provided a resource processing method of a job, including:
acquiring the resource usage of a job executed on a server, wherein the job comprises a first type job;
according to the resource usage amount of the job and the maximum resource quota which can be provided to the job by the server, adjusting the maximum resource quota of one first type job or a plurality of first type jobs so as to execute the one first type job or a plurality of first type jobs by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; wherein,
the maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
According to a second aspect, there is provided a resource processing apparatus of a job, comprising:
The monitoring unit is used for acquiring the resource usage of the job executed on the server, wherein the job comprises a first type job;
an adjusting unit, configured to adjust a maximum resource quota of one first type job or a plurality of first type jobs according to a resource usage amount of the job and a maximum resource quota that the server can provide to the job, so as to execute the one first type job or the plurality of first type jobs by using the maximum resource quota of the one first type job or the plurality of first type jobs; wherein,
the maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
According to a third aspect, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the aspects and methods of any one of the possible implementations described above.
According to a fourth aspect, there is provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of the aspects and any possible implementation described above.
According to a fifth aspect, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of the aspects and any possible implementation described above.
As can be seen from the foregoing technical solutions, in the embodiments of the present application, by acquiring the resource usage amount of a job including a first type job executed on a server, and further, according to the resource usage amount of the job and the maximum resource quota that the server may provide to the job, adjusting the maximum resource quota of one first type job or multiple first type jobs, so as to use the maximum resource quota of one first type job or multiple first type jobs to execute the one first type job or multiple first type jobs, by monitoring the resource usage situation of the job on the server in real time, dynamically adjusting the maximum resource quota of the first type job, for example, the online job, for which the resource usage amount exceeds the minimum resource quota of the first type job, so as to implement dynamic control of the resource usage amount of the first type job, thereby effectively avoiding the problem that performance between the first type jobs affects each other due to unrestricted use of resources, and improving the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the maximum resource quota limit provided by the server to the job is smaller than the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server, so that a buffer zone (buffer) is always kept between the maximum resource quota provided by the server to the job and the whole machine available resource, the problem of the whole machine available resource exhaustion caused by unlimited use of the resource can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
In addition, by adopting the technical scheme provided by the application, the experience of the user can be effectively improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present application, and other drawings can be obtained according to these drawings without inventive effort to a person skilled in the art. The drawings are only for better understanding of the present solution and are not to be construed as limiting the present application. Wherein:
FIG. 1A is a schematic diagram according to a first embodiment of the present application;
FIG. 1B is a schematic diagram of resources on a server in a first embodiment of the present application;
FIG. 2 is a schematic diagram according to a second embodiment of the present application;
FIG. 3 is a schematic diagram according to a third embodiment of the present application;
FIG. 4 is a schematic diagram according to a fourth embodiment of the present application;
fig. 5 is a schematic diagram of an electronic device for implementing a resource processing method of a job according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It will be apparent that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that, the terminal device in the embodiment of the present application may include, but is not limited to, smart devices such as a mobile phone, a personal digital assistant (Personal Digital Assistant, PDA), a wireless handheld device, and a Tablet Computer (Tablet Computer); the display device may include, but is not limited to, a personal computer, a television, or the like having a display function.
In addition, the term "and/or" herein is merely an association relationship describing an association object, and means that three relationships may exist, for example, a and/or B may mean: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
Fig. 1A is a schematic diagram according to a first embodiment of the present application, as shown in fig. 1A.
101. Resource usage of jobs executing on a server is obtained, the jobs including jobs of a first type.
The first type of job may be an online job with high real-time performance.
102. And adjusting the maximum resource quota of one first-type job or a plurality of first-type jobs according to the resource usage amount of the jobs and the maximum resource quota which can be provided to the jobs by the server so as to execute the one first-type job or the plurality of first-type jobs by utilizing the maximum resource quota of the one first-type job or the plurality of first-type jobs.
The maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server.
Wherein the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
The resources may include, but are not limited to, at least one of a memory resource, a CPU resource, and a hard disk resource, which is not particularly limited in this embodiment.
The minimum resource quota of the first type job refers to a resource quota that a user applies in advance for the first type job and must ensure that the first type job can be used, for example, the user is willing to pay a certain monetary value, and the resource quota applied in advance for the first type job, etc., so that the server needs to ensure the resource usage within the minimum resource quota of the first type job.
The maximum resource quota of the first type job refers to the maximum upper limit of resources that can be used by the first type job.
The execution bodies 101 to 102 may be part or all of applications located in the local terminal, or may be functional units such as plug-ins or software development kits (Software Development Kit, SDKs) provided in the applications located in the local terminal, or may be processing engines located in a server on the network side, or may be distributed systems located on the network side, for example, processing engines or distributed systems in a resource platform on the network side, which is not particularly limited in this embodiment.
It will be appreciated that the application may be a native program (native app) installed on the native terminal, or may also be a web page program (webApp) of a browser on the native terminal, which is not limited in this embodiment.
In this embodiment, the sum of the available resources for all jobs is constrained by the maximum resource quota that the server can provide to the jobs, and therefore a reasonable value needs to be set for the maximum resource quota that the server can provide to the jobs. If the maximum resource quota is set too large, e.g., greater than the complete machine resource, then the maximum resource quota has lost meaning because the complete machine resource has been consumed when the maximum resource quota has not been used to restrict the usage of the job resource; if the maximum resource quota is set too small, then machine resources, e.g., 128G of machine memory, will be wasted greatly, and if the memory resources in the maximum resource quota are set to 60G, then 68G of memory will be wasted by each machine.
Alternatively, in one possible implementation manner of this embodiment, the maximum resource quota that can be provided by the server to the job may be defined as all remaining resources of the server, that is, the maximum resource quota that can be provided by the server to the job may be equal to a difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server.
At this time, by limiting the maximum resource quota that the server can provide to the job to the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, all the remaining resources of the server can be used as the maximum resource quota that the server can provide to the job, so that the resources of the server are fully utilized, and the resource utilization rate can be effectively improved.
Alternatively, in one possible implementation manner of this embodiment, the maximum resource quota that the server may provide to the job may not be simply limited to all the remaining resources of the server, but a portion of the remaining resources N of the server is reserved for buffering use by the operating system, that is, the maximum resource quota that the server may provide to the job may be smaller than the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, and the maximum resource quota that the server may provide to the job=the resource allocation amount of the server-the resource usage amount of the operating system of the server-the remaining resources N of a portion of the server.
For example, assuming host. Quota represents the complete machine resource and system. Used represents the resource usage of the operating system of the server, then N may be set to 5% of the complete machine resource of the server, and accordingly, the following equal relationship may be obtained:
The server may provide the job with a maximum resource quota = host.
It can be seen that host. Quata 95% -system. Used is a dynamically changing process, the value of which will dynamically adjust as the amount of resource usage of the operating system of the server changes. The formula ensures that the residual resources of the whole machine are always much more than 5% of the resources of the whole machine under normal conditions.
At this time, by limiting the maximum resource quota that the server can provide to the job to be smaller than the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, a buffer is always maintained between the maximum resource quota that the server can provide to the job and the whole machine available resource, so that the problem of exhaustion of the whole machine available resource caused by unlimited use of the resource can be effectively avoided, and the efficiency and reliability of job execution are further improved.
It will be appreciated that since each first type of job on a server corresponds to a respective minimum resource quota, which means that it must be ensured that the resources of the server reserved for it meet the minimum resource quota of the job, the minimum value of the maximum resource quota that the server can provide to a job cannot be less than the sum of the minimum resource quotas of all first type jobs on the server.
If the maximum resource quota obtained by adopting the limiting scheme is smaller than the sum of the minimum resource quota of all the first-type jobs on the server, the maximum resource quota which can be provided to the jobs by the server can be adjusted so as to limit the maximum resource quota which can be provided to the jobs by the server to be the sum of the minimum resource quota of all the first-type jobs on the server.
In general, many jobs are already being executed on a server, if a process of each job needs to be executed by using the maximum resource quota that the server can provide to the job as defined in the application, then a resource frame needs to be set further according to the maximum resource quota that the server can provide to the job, and further, each process of the job executed on the server can be moved into the resource frame. At this time, the process of each job may be run in the resource frame by using the maximum resource quota, which is a resource in the resource frame, to execute the corresponding job.
A schematic diagram of resources on a server in this embodiment may be shown in fig. 1B.
During the course of the process movement, the state of the process is not fixed but is transient, so that the following situations may occur: when the process X of the job a is moved, after the process X of the job a is picked up, the process X ends before being placed in the resource frame, and at this time, the job C just multiplexes the process number X of the process X, so that the process of the process number X of the job C is moved to the a job in the resource frame as a result of the movement.
If all of the processes of the job a are to be ended (kill) after the lifecycle of the job a ends at this time, since the process of the process number X has been erroneously moved into the a job in the resource box, the process of the process number X is also to be ended together, so that the process of the process number X of the job C is erroneously ended, resulting in an execution error of the job C.
The technical scheme provided by the application can be suitable for the system which is arranged in an offline mixing mode. In order to avoid the above problems, the present embodiment provides solutions for different job types, respectively:
for the first method, for the second type of operation, for example, offline operation with low real-time performance, the following technical scheme can be adopted to move the progress of the operation:
because the real-time performance of the second type of job is not high, each process of the job to be moved can be frozen (freeze) before the job is moved, and then each process after the freezing process can be moved into the resource frame. After each process of the job is moved, the thawing process is further performed on each process.
At this time, since the real-time performance of the second job type is not high, before the process of the moving job, the second job type can be suspended to provide the service to the outside through the freezing (freeze) process, and the process of each job is successfully moved into the resource frame, so that the process of each job can be executed by utilizing the resource in the resource frame, namely the maximum resource quota, in the resource frame, and the corresponding job is executed. Then, after the movement of each process of the job is completed, the thawing process is further performed on each process.
In the second method, for the first type of operation, for example, online operation with high real-time performance, the following technical scheme can be adopted to move the progress of the operation:
since the real-time performance of the first type of job is high, the freezing process cannot be performed on all the processes of the job, alternatively, after each process of the job to be moved is moved into the resource frame, a double check mechanism may be performed to determine whether the process is moved successfully according to a Control group (cgroups) of each resource dimension corresponding to each process.
The resource dimension may include, but is not limited to, at least one resource dimension of a memory resource dimension, a CPU resource dimension, and a hard disk resource dimension, which is not particularly limited in this embodiment.
If the process control groups of the resource dimension corresponding to the process of the job belong to the job, the process is indicated to be successfully moved; if the process control groups of the resource dimensions corresponding to the processes of the job do not belong to the job, the process movement is unsuccessful, and the processes of other jobs are moved by mistake. For a process that is not successful in the movement, a further restore operation of the movement is required for the process.
For example, after the process X of the job a is moved, that is, after the process X of the CPU resource of the job a and the process X of the memory resource of the job a are moved, an interface provided by a per proc file system provided by a Linux system may be used to query the cgroup of each resource dimension corresponding to the process, and if the cgroup of the CPU resource dimension of the process X is per cgroup/CPU/a, and the cgroup of the memory resource dimension of the process X is per cgroup/memory/B, it is indicated that the process X is moved unsuccessfully, and the processes of other jobs B are moved incorrectly.
At this time, since the real-time performance of the first job type is high, after the process of the moving job, the process of each job can be successfully moved into the resource frame by a confirmation (double check) mechanism under the premise of not suspending the external service, so that the process of each job can be executed in the resource frame by utilizing the resource in the resource frame, namely the maximum resource quota, and the corresponding job can be executed.
It will be appreciated that if for a new server, then the resource box may be set directly based on the maximum resource quota that the server can provide to the job. At this time, the process of each job may be run in the resource frame by using the maximum resource quota, which is a resource in the resource frame, to execute the corresponding job.
Optionally, in one possible implementation manner of this embodiment, in 102, the resource usage of the job on the server may be specifically monitored in real time, and the maximum resource quota thereof may be dynamically adjusted for the first type of job, for example, an online job, whose resource usage exceeds its minimum resource quota.
In a specific implementation process, if the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is greater than or equal to a first resource threshold, for example, 70%, or the like, the maximum resource quota of the job or jobs of the first type may be set, so that the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is less than or equal to the first resource threshold.
At this time, by monitoring the resource usage of the jobs on the server in real time, when the resource usage of the jobs is too large, the resource usage of one or more jobs of the first type needs to be limited, so as to control the resource usage of the jobs of the first type without affecting the resource usage of the jobs of other first types, and thus, the problem of performance interaction between jobs of the first type due to unrestricted use of the resources can be effectively avoided, and the efficiency and reliability of job execution are improved.
In another specific implementation, if the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is less than a second resource threshold, e.g., 70%, etc., the maximum resource quota of the first type job or jobs may be canceled. Wherein the second resource threshold may be less than or equal to the first resource threshold.
At this time, by monitoring the resource usage of the jobs on the server in real time, when the resource usage of the jobs is not so large, it is unnecessary to limit the resource usage of one or more jobs of the first type, because the resource usage of the jobs of the first type does not affect the resource usage of the jobs of other first types, thereby improving the flexibility of executing the jobs.
In this embodiment, the resource usage amount of the job including the first type job executed on the server is obtained, and then, according to the resource usage amount of the job and the maximum resource quota that the server can provide to the job, the maximum resource quota of one first type job or multiple first type jobs is adjusted so as to be used for executing the one first type job or multiple first type jobs by using the maximum resource quota of the one first type job or multiple first type jobs, and the maximum resource quota of the first type job with the resource usage amount exceeding the minimum resource quota of the first type job is dynamically adjusted by monitoring the resource usage condition of the job on the server in real time, for example, the online job, so that the resource usage amount of the first type job is dynamically controlled, and the problem of performance interaction between the first type jobs due to unrestricted use of resources can be effectively avoided, thereby improving the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the maximum resource quota limit provided by the server to the job is smaller than the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server, so that a buffer zone (buffer) is always kept between the maximum resource quota provided by the server to the job and the whole machine available resource, the problem of the whole machine available resource exhaustion caused by unlimited use of the resource can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
In addition, by adopting the technical scheme provided by the application, the experience of the user can be effectively improved.
Fig. 2 is a schematic diagram according to a second embodiment of the present application, which may further perform the following steps compared to the first embodiment.
201. And acquiring the resource allocation quantity of the server and the resource usage quantity of an operating system of the server.
202. And adjusting the maximum resource quota which can be provided by the server to the job according to the resource allocation quantity of the server and the resource usage quantity of an operating system of the server.
Alternatively, in one possible implementation manner of this embodiment, the maximum resource quota that can be provided by the server to the job may be defined as all remaining resources of the server, that is, the maximum resource quota that can be provided by the server to the job may be equal to a difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server.
Then, according to the resource allocation amount of the server and the resource usage amount of the operating system of the server, the maximum resource quota provided by the server to the job can be adjusted to be all the remaining resources of the server, that is, the maximum resource quota provided by the server to the job can be equal to the difference value between the resource allocation amount of the server and the resource usage amount of the operating system of the server.
At this time, by adjusting the maximum resource quota that can be provided by the server to the job to be defined as the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, all the remaining resources of the server can be used as the maximum resource quota that can be provided by the server to the job, so that the resources of the server are fully utilized, and the resource utilization rate can be effectively improved.
Alternatively, in one possible implementation manner of this embodiment, the maximum resource quota that the server may provide to the job may not be simply limited to all the remaining resources of the server, but a portion of the remaining resources N of the server is reserved for buffering use by the operating system, that is, the maximum resource quota that the server may provide to the job may be smaller than the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, and the maximum resource quota that the server may provide to the job=the resource allocation amount of the server-the resource usage amount of the operating system of the server-the remaining resources N of a portion of the server.
Then, according to the resource allocation amount of the server and the resource usage amount of the operating system of the server, the maximum resource quota that the server can provide to the job may be adjusted to be smaller than the total remaining resources of the server, i.e. the maximum resource quota that the server can provide to the job may be equal to = the resource allocation amount of the server-the resource usage amount of the operating system of the server-the remaining resources N of a part of the server.
At this time, by adjusting that the maximum resource quota that the server can provide to the job is limited to be smaller than the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, a buffer area (buffer) is always kept between the maximum resource quota that the server can provide to the job and the whole machine available resource, so that the problem of the whole machine available resource exhaustion caused by unlimited use of the resource can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
It will be appreciated that since each first type of job on a server corresponds to a respective minimum resource quota, which means that it must be ensured that the resources of the server reserved for it meet the minimum resource quota of the job, the minimum value of the maximum resource quota that the server can provide to a job cannot be less than the sum of the minimum resource quotas of all first type jobs on the server.
If the maximum resource quota obtained by adopting the limiting scheme is smaller than the sum of the minimum resource quota of all the first-type jobs on the server, the maximum resource quota which can be provided to the jobs by the server can be further adjusted so as to limit the maximum resource quota which can be provided to the jobs by the server to be the sum of the minimum resource quota of all the first-type jobs on the server.
In this embodiment, the resource usage condition of the operating system on the server is monitored in real time to dynamically adjust the maximum resource quota provided by the server to the job, so that a buffer is always maintained between the maximum resource quota provided by the server to the job and the complete machine available resource, and further the job is controlled not to consume the complete machine available resource due to unlimited use of the resource, thereby avoiding the problem of kernel collapse (crash) caused by the complete machine available resource consumption of the server.
Fig. 3 is a schematic diagram of a third embodiment of the present application, where the job in the present embodiment may further include a second type of job, and the present embodiment may further perform the following steps, compared to the first embodiment or the second embodiment.
301. And acquiring the resource usage of all the first type jobs executed on the server.
302. And adjusting the resource usage of all or part of the second type of jobs executed on the server according to the resource usage of all the first type of jobs and the maximum resource quota which can be provided to the jobs by the server.
The second type of operation may be an offline operation with low real-time performance. The technical scheme provided by the application is suitable for the system of off-line mixed layout.
Alternatively, in one possible implementation manner of the present embodiment, the second type of job may be divided into a first part of job and a second part of job, where the first part of job may be a second type of job with a low priority, and the second part of job may be a second type of job with a high priority.
Then, in 302, the resource usage of the online job on the server may be monitored in real time, and according to the resource usage of all the first type jobs and the maximum resource quota that the server may provide to the jobs, it is found that the resource usage of all the first type jobs is gradually increasing, and then, the limitation of the resource usage of the first part of jobs may be reduced and adjusted accordingly, or the first part of jobs may be directly paused, so as to ensure that the resource requirement of the first type jobs, for example, the online jobs with high real-time performance, can be satisfied in time.
If the adjustment operation on the first part of the job still cannot ensure that the resource requirement of the first type of job, for example, the online job with high real-time performance, can be timely satisfied, the adjustment operation can be further performed on the second part of the job, that is, the limitation of the resource usage amount of the second part of the job is reduced and adjusted, or the second part of the job is directly paused, so that the resource requirement of the first type of job, for example, the online job with high real-time performance, can be timely satisfied.
In this embodiment, the resource usage of the first type of job, for example, the online job with high real-time performance, on the server is monitored in real time to dynamically control the resource usage of the second type of job, for example, the offline job with low real-time performance, so that the resource requirement of the first type of job can be timely satisfied, and the second type of job is not affected by the second type of job, so that the second type of job can quickly and flexibly perform unconditional deferral, thereby improving the efficiency and reliability of the first type of job.
It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
Fig. 4 is a schematic view according to a fourth embodiment of the present application, as shown in fig. 4. The resource processing apparatus 400 of the job of the present embodiment may include a monitoring unit 401 and an adjusting unit 402. Wherein, the monitoring unit 401 is configured to obtain a resource usage amount of a job executed on the server, where the job includes a first type job; an adjusting unit 402, configured to adjust a maximum resource quota of a first type job or a plurality of first type jobs according to a resource usage amount of the job and a maximum resource quota that the server can provide to the job, so as to execute the first type job or the plurality of first type jobs by using the maximum resource quota of the first type job or the plurality of first type jobs; the maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of an operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
The resource processing device of the job of the present embodiment may be an application located in a local terminal, or may be a functional unit such as a plug-in unit or a software development kit (Software Development Kit, SDK) provided in an application located in a local terminal, or may be a processing engine located in a server on a network side, or may be a distributed system located on a network side, for example, a processing engine or a distributed system in a resource platform on a network side, which is not particularly limited in this embodiment.
It will be appreciated that the application may be a native program (native app) installed on the native terminal, or may also be a web page program (webApp) of a browser on the native terminal, which is not limited in this embodiment.
Optionally, in a possible implementation manner of this embodiment, the adjusting unit 402 may be further configured to set a resource frame according to a maximum resource quota that the server may provide to a job; and moving each process of the job executed on the server into the resource frame.
In a specific implementation process, the adjusting unit 402 may be specifically configured to perform freezing treatment on each process of the job to be moved; moving each process after the freezing treatment into the resource frame; and freezing each process after the freezing.
In another specific implementation process, the adjusting unit 402 may be specifically configured to move each process of the job to be moved into the resource box; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
Optionally, in a possible implementation manner of this embodiment, the monitoring unit 401 may be further configured to obtain a resource allocation amount of the server and a resource usage amount of an operating system of the server; accordingly, the adjusting unit 402 may be further configured to adjust a maximum resource quota that the server may provide to the job according to the resource allocation amount of the server and the resource usage amount of the operating system of the server.
Optionally, in one possible implementation manner of this embodiment, the adjusting unit 402 may be specifically configured to set a maximum resource quota of the first type job or the plurality of types of jobs if a ratio of a resource usage amount of the job to a maximum resource quota that the server can provide to the job is greater than or equal to a first resource threshold.
Further, if the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is less than a second resource threshold, canceling the maximum resource quota of the first type job or jobs of the first type; wherein the second resource threshold is less than or equal to the first resource threshold.
Optionally, in a possible implementation of this embodiment, the job may further include a second type of job; accordingly, the monitoring unit 401 may be further configured to obtain the resource usage amount of all the first type jobs executed on the server; the adjusting unit 402 may be further configured to adjust the resource usage of all or part of the second type job executed on the server according to the resource usage of all the first type job and the maximum resource quota that the server can provide to the job.
Note that, the method in the embodiments corresponding to fig. 1A, fig. 2, and fig. 3 may be implemented by the resource processing device of the job provided in this embodiment. For detailed description, reference may be made to the relevant content in the embodiments corresponding to fig. 1A, fig. 2 and fig. 3, which are not repeated here.
In this embodiment, the monitoring unit obtains the resource usage amount of the job including the first type job executed on the server, and then, the adjusting unit adjusts the maximum resource quota of one first type job or multiple first type jobs according to the resource usage amount of the job and the maximum resource quota that the server can provide to the job, so as to use the maximum resource quota of one first type job or multiple first type jobs to execute the one first type job or multiple first type jobs, and by monitoring the resource usage condition of the job on the server in real time, dynamically adjusts the maximum resource quota of the first type job, for example, the online job, aiming at the first type job, the resource usage amount of which exceeds the minimum resource quota of the server, thereby realizing dynamic control of the resource usage amount of the first type job, and effectively avoiding the problem that performances among the first type jobs are affected mutually due to unlimited use of resources, so as to improve the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the maximum resource quota limit provided by the server to the job is smaller than the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server, so that a buffer zone (buffer) is always kept between the maximum resource quota provided by the server to the job and the whole machine available resource, the problem of the whole machine available resource exhaustion caused by unlimited use of the resource can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
In addition, by adopting the technical scheme provided by the application, the experience of the user can be effectively improved.
According to embodiments of the present application, there is also provided an electronic device and a non-transitory computer-readable storage medium storing computer instructions.
As shown in fig. 5, an electronic device for implementing the resource processing method of the job according to the embodiment of the present application is shown. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the application described and/or claimed herein.
As shown in fig. 5, the electronic device includes: one or more processors 501, memory 502, and interfaces for connecting components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions executing within the electronic device, including instructions stored in or on memory to display graphical information of a GUI (graphical user interface) on an external input/output device, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, if desired, along with multiple memories and multiple memories. Also, multiple electronic devices may be connected, each providing a portion of the necessary operations (e.g., as a server array, a set of blade servers, or a multiprocessor system). One processor 501 is illustrated in fig. 5.
Memory 502 is a non-transitory computer readable storage medium provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the resource processing method of the job provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to execute the resource processing method of the job provided by the present application.
The memory 502 is used as a non-transitory computer readable storage medium, and may be used to store non-transitory software programs, non-transitory computer executable programs, and units, such as program instructions/units (e.g., the monitoring unit 401 and the adjusting unit 402 shown in fig. 4) corresponding to the resource processing method of the job in the embodiment of the present application. The processor 501 executes various functional applications of the server and data processing, i.e., a resource processing method implementing the jobs in the above-described method embodiments, by running non-transitory software programs, instructions, and units stored in the memory 502.
Memory 502 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data or the like created according to the use of the electronic device implementing the resource processing method of the job provided by the embodiment of the present application. In addition, memory 502 may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid-state storage device. In some embodiments, memory 502 may optionally include memory located remotely from processor 501, which may be connected via a network to an electronic device implementing the resource processing methods of the jobs provided by embodiments of the present application. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the resource processing method of the job may further include: an input device 503 and an output device 504. The processor 501, memory 502, input devices 503 and output devices 504 may be connected by a bus or otherwise, for example in fig. 5.
The input device 503 may receive input numeric or character information, and generate key signal inputs related to user settings and function controls of an electronic device implementing the resource processing method of a job provided by embodiments of the present application, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick, and the like. The output devices 504 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibration motors), among others. The display device may include, but is not limited to, an LCD (liquid crystal display), an LED (light emitting diode) display, and a plasma display. In some implementations, the display device may be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, ASIC (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
These computing programs (also referred to as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, PLDs (programmable logic devices)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (local area network), WAN (wide area network), internet and blockchain networks.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the maximum resource quota of the first type of job, for example, the online job, is dynamically adjusted according to the resource use condition of the job on the server, wherein the resource use condition of the job exceeds the minimum resource quota of the first type of job, so that the resource use amount of the first type of job is dynamically controlled, the problem that performances of the first type of job are mutually influenced due to unlimited use of resources can be effectively avoided, and therefore the efficiency and the reliability of job execution are improved.
In addition, by adopting the technical scheme provided by the application, the maximum resource quota limit provided by the server to the job is smaller than the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server, so that a buffer zone (buffer) is always kept between the maximum resource quota provided by the server to the job and the whole machine available resource, the problem of the whole machine available resource exhaustion caused by unlimited use of the resource can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
In addition, by adopting the technical scheme provided by the application, the experience of the user can be effectively improved.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present application may be performed in parallel, sequentially, or in a different order, provided that the desired results of the technical solutions disclosed in the present application can be achieved, and are not limited herein.
The above embodiments do not limit the scope of the application. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application are intended to be included within the scope of the present application.
Claims (12)
1. A resource processing method of a job, comprising:
acquiring the resource usage of a job executed on a server, wherein the job comprises a first type job;
according to the resource usage amount of the job and the maximum resource quota which can be provided to the job by the server, adjusting the maximum resource quota of one first type job or a plurality of first type jobs so as to execute the one first type job or a plurality of first type jobs by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; wherein,
the maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job; wherein,
the adjusting the maximum resource quota of the first type job or the plurality of first type jobs according to the resource usage amount of the job and the maximum resource quota provided by the server to the job comprises the following steps:
if the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is greater than or equal to a first resource threshold, setting the maximum resource quota of the first type job or jobs;
If the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is less than a second resource threshold, canceling the maximum resource quota of the first-type job or jobs of the first type; wherein the second resource threshold is less than or equal to the first resource threshold.
2. The method of claim 1, wherein the method further comprises:
setting a resource frame according to the maximum resource quota which can be provided to the job by the server;
and moving each process of the operation executed on the server into the resource frame.
3. The method of claim 2, wherein the moving the processes of the job performed on the server into the resource box comprises:
freezing each process of the operation to be moved; moving each process after the freezing treatment into the resource frame; and freezing each process after the freezing treatment; or alternatively
Moving each process of the job to be moved into the resource frame; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
4. The method of claim 1, wherein the method further comprises:
acquiring the resource allocation quantity of the server and the resource usage quantity of an operating system of the server;
and adjusting the maximum resource quota which can be provided by the server to the job according to the resource allocation quantity of the server and the resource usage quantity of an operating system of the server.
5. The method of any of claims 1-4, wherein the job further comprises a second type of job; the method further comprises the steps of:
acquiring the resource usage of all first type jobs executed on the server;
and adjusting the resource usage of all or part of the second type of jobs executed on the server according to the resource usage of all the first type of jobs and the maximum resource quota which can be provided to the jobs by the server.
6. A resource processing apparatus of a job, comprising:
the monitoring unit is used for acquiring the resource usage of the job executed on the server, wherein the job comprises a first type job;
an adjusting unit, configured to adjust a maximum resource quota of one first type job or a plurality of first type jobs according to a resource usage amount of the job and a maximum resource quota that the server can provide to the job, so as to execute the one first type job or the plurality of first type jobs by using the maximum resource quota of the one first type job or the plurality of first type jobs; wherein,
The maximum resource quota is smaller than or equal to the difference value between the resource allocation quantity of the server and the resource usage quantity of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job; wherein,
the adjusting unit is particularly used for
If the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is greater than or equal to a first resource threshold, setting the maximum resource quota of the first type job or jobs;
if the ratio of the resource usage of the job to the maximum resource quota that the server can provide to the job is less than a second resource threshold, canceling the maximum resource quota of the first-type job or jobs of the first type; wherein the second resource threshold is less than or equal to the first resource threshold.
7. The apparatus of claim 6, wherein the adjustment unit is further configured to
Setting a resource frame according to the maximum resource quota which can be provided to the job by the server; and
and moving each process of the operation executed on the server into the resource frame.
8. The device according to claim 7, wherein the adjusting unit is in particular adapted to
Freezing each process of the operation to be moved; moving each process after the freezing treatment into the resource frame; and freezing each process after the freezing treatment; or alternatively
Moving each process of the job to be moved into the resource frame; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
9. The apparatus of claim 6, wherein,
the monitoring unit is further used for acquiring the resource allocation quantity of the server and the resource usage quantity of an operating system of the server;
the adjusting unit is further configured to adjust a maximum resource quota that the server can provide to the job according to the resource allocation amount of the server and the resource usage amount of the operating system of the server.
10. The apparatus of any of claims 6-9, wherein the job further comprises a second type of job;
the monitoring unit is further used for acquiring the resource usage of all the first type jobs executed on the server;
The adjusting unit is further configured to adjust, according to the resource usage amount of all the first type jobs and the maximum resource quota that the server can provide to the jobs, resource usage amounts of all or part of the second type jobs executed on the server.
11. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5.
12. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010552506.9A CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010552506.9A CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111858030A CN111858030A (en) | 2020-10-30 |
| CN111858030B true CN111858030B (en) | 2024-03-22 |
Family
ID=72987585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010552506.9A Active CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111858030B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590317B (en) * | 2021-07-27 | 2024-07-19 | 杭州网易数之帆科技有限公司 | Offline service scheduling method, device, medium and computing equipment |
| CN118349313A (en) * | 2023-01-16 | 2024-07-16 | 华为技术有限公司 | Container resource adjustment method and electronic equipment |
| CN117290075B (en) * | 2023-11-23 | 2024-02-27 | 苏州元脑智能科技有限公司 | Process migration method, system, device, communication equipment and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104468521A (en) * | 2014-11-13 | 2015-03-25 | 华为技术有限公司 | Online migration method, device and system |
| US9262217B1 (en) * | 2013-06-26 | 2016-02-16 | Emc Corporation | Computation resource cyclic utilization |
| CN105849715A (en) * | 2014-01-31 | 2016-08-10 | 谷歌公司 | Efficient resource utilization in a data center |
| WO2017206749A1 (en) * | 2016-06-01 | 2017-12-07 | 阿里巴巴集团控股有限公司 | Adaptive resource allocation method and apparatus |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| CN110147915A (en) * | 2018-02-11 | 2019-08-20 | 陕西爱尚物联科技有限公司 | A kind of method and its system of resource distribution |
| CN110389842A (en) * | 2019-07-26 | 2019-10-29 | 中国工商银行股份有限公司 | A kind of dynamic resource allocation method, device, storage medium and equipment |
| CN110609743A (en) * | 2018-06-15 | 2019-12-24 | 伊姆西Ip控股有限责任公司 | Method, electronic device and computer program product for configuring resources |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10990440B2 (en) * | 2018-02-06 | 2021-04-27 | Rubrik, Inc. | Real-time distributed job scheduler with job self-scheduling |
-
2020
- 2020-06-17 CN CN202010552506.9A patent/CN111858030B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9262217B1 (en) * | 2013-06-26 | 2016-02-16 | Emc Corporation | Computation resource cyclic utilization |
| CN105849715A (en) * | 2014-01-31 | 2016-08-10 | 谷歌公司 | Efficient resource utilization in a data center |
| CN104468521A (en) * | 2014-11-13 | 2015-03-25 | 华为技术有限公司 | Online migration method, device and system |
| WO2017206749A1 (en) * | 2016-06-01 | 2017-12-07 | 阿里巴巴集团控股有限公司 | Adaptive resource allocation method and apparatus |
| CN110147915A (en) * | 2018-02-11 | 2019-08-20 | 陕西爱尚物联科技有限公司 | A kind of method and its system of resource distribution |
| CN110609743A (en) * | 2018-06-15 | 2019-12-24 | 伊姆西Ip控股有限责任公司 | Method, electronic device and computer program product for configuring resources |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| CN110389842A (en) * | 2019-07-26 | 2019-10-29 | 中国工商银行股份有限公司 | A kind of dynamic resource allocation method, device, storage medium and equipment |
Non-Patent Citations (1)
| Title |
|---|
| 企业私有云环境下面向高性能计算的资源弹性分配算法;刘晓东;赵晓芳;金岩;罗刚;陈雅静;赵曙光;;高技术通讯(第08期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111858030A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111858030B (en) | Resource processing method and device for job, electronic equipment and readable storage medium | |
| CN110806923B (en) | Parallel processing method and device for block chain tasks, electronic equipment and medium | |
| EP3862894A1 (en) | Data processing methods, data processing apparatuses, electronic devices, and storage media | |
| CN111738446B (en) | Scheduling method, device, equipment and medium of deep learning reasoning engine | |
| EP3869336A1 (en) | Method and apparatus for processing development machine operation task, device and storage medium | |
| CN111586128B (en) | Method, device, equipment and storage medium for acquiring applet data | |
| EP3961395A1 (en) | Method and apparatus for scheduling memory access request, device and storage medium | |
| CN111562969B (en) | Intelligent contract implementation method, device, equipment and medium for block chain | |
| CN111625195B (en) | Method and device for server capacity expansion | |
| CN111880914A (en) | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium | |
| CN111459645B (en) | Task scheduling method and device and electronic equipment | |
| CN112527474B (en) | Task processing method and device, equipment, readable medium and computer program product | |
| CN110659246A (en) | Container-based file mounting method and device and electronic equipment | |
| US11775309B2 (en) | Exception stack handling method, system, electronic device and storage medium | |
| WO2023103516A1 (en) | Low-priority blocking method and apparatus based on processor virtualization environment | |
| CN111782147A (en) | Method and apparatus for cluster scale-up | |
| CN112565356A (en) | Data storage method and device and electronic equipment | |
| CN112446574B (en) | Product evaluation method, device, electronic equipment and storage medium | |
| US20210209471A1 (en) | Processor memory optimization method and apparatus for deep learning training tasks | |
| CN112965806A (en) | Method and apparatus for determining resources | |
| CN111598571A (en) | Transaction processing method, device, equipment and storage medium of block chain | |
| CN111857825A (en) | Instruction execution method and device, electronic equipment and computer-readable storage medium | |
| CN111506399B (en) | Task migration method and device, electronic equipment and storage medium | |
| CN114386577A (en) | Method, apparatus, and storage medium for executing deep learning model | |
| CN112527368A (en) | Cluster kernel version updating method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |