CN111858030A - Job resource processing method and device, electronic equipment and readable storage medium - Google Patents
Job resource processing method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN111858030A CN111858030A CN202010552506.9A CN202010552506A CN111858030A CN 111858030 A CN111858030 A CN 111858030A CN 202010552506 A CN202010552506 A CN 202010552506A CN 111858030 A CN111858030 A CN 111858030A
- Authority
- CN
- China
- Prior art keywords
- resource
- job
- server
- type
- jobs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title abstract description 14
- 238000000034 method Methods 0.000 claims description 110
- 230000008569 process Effects 0.000 claims description 85
- 230000015654 memory Effects 0.000 claims description 29
- 238000012545 processing Methods 0.000 claims description 22
- 238000012544 monitoring process Methods 0.000 claims description 17
- 230000008014 freezing Effects 0.000 claims description 13
- 238000007710 freezing Methods 0.000 claims description 13
- 238000013468 resource allocation Methods 0.000 claims description 8
- 238000004886 process control Methods 0.000 claims description 6
- 239000000126 substance Substances 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000010257 thawing Methods 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Hardware Redundancy (AREA)
Abstract
The application discloses a resource processing method and device for operation, electronic equipment and a readable storage medium, and relates to the technical field of cloud computing. The specific implementation scheme is as follows: acquiring resource usage of jobs executed on a server, wherein the jobs comprise first type jobs; adjusting the maximum resource quota of one first type job or a plurality of first type jobs according to the resource usage of the jobs and the maximum resource quota which can be provided by the server for the jobs, so that the one first type job or the plurality of first type jobs can be executed by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; the maximum resource quota is less than or equal to the difference value between the resource configuration amount of the server and the resource usage amount of an operating system of the server; the maximum resource quota of a job or jobs of the first type is greater than or equal to the minimum resource quota of the job of the first type.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a resource processing method and apparatus for jobs, an electronic device, and a readable storage medium.
Background
In the field of cloud computing technology, one or more data processing processes may be referred to as a job. According to the nature of the job, the job can be classified into an online job and an offline job. Typically, a user may specify a resource quota for his job, e.g., 20 CPU cores, 10G memory, etc. Once a job's resource usage exceeds this resource quota, the job's progress may be compressed or otherwise ended. Generally, the resource quota of the online job is set according to the resources required by the online job during the peak period, so that the online job does not fully use the resource quota of the online job in most of the time, thereby causing the waste of resources.
In order to improve the resource utilization rate, when the resources are idle, the job can use the resources except the resource quota of the job, so that the over-sent resources larger than the resource quota of the job are obtained. And when the resources are in shortage, the operation returns the obtained excess resources.
However, in some cases, for example, the amount of the over-issued resource used by the job is far greater than its resource quota, which causes a large amount of consumption and even exhaustion of the resources of the server, and may cause the execution quality of some jobs to be affected and even fail, thereby causing the efficiency and reliability of job execution to be reduced.
Disclosure of Invention
Aspects of the present disclosure provide a method, an apparatus, an electronic device, and a readable storage medium for processing a resource of a job, so as to improve efficiency and reliability of job execution.
According to a first aspect, there is provided a method for processing a resource of a job, comprising:
acquiring resource usage of a job executed on a server, wherein the job comprises a first type job;
according to the resource usage amount of the job and the maximum resource quota which can be provided by the server to the job, adjusting the maximum resource quota of one first type job or a plurality of first type jobs, so that the one first type job or the plurality of first type jobs can be executed by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; wherein the content of the first and second substances,
the maximum resource quota is less than or equal to the difference value between the resource configuration amount of the server and the resource usage amount of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
According to a second aspect, there is provided a resource processing apparatus of a job, comprising:
The system comprises a monitoring unit, a processing unit and a processing unit, wherein the monitoring unit is used for acquiring the resource usage amount of jobs executed on a server, and the jobs comprise first type jobs;
an adjusting unit, configured to adjust a maximum resource quota of one first type job or multiple first type jobs according to a resource usage amount of the job and a maximum resource quota that can be provided by the server for the job or the multiple first type jobs, so that the job or the multiple first type jobs are executed by using the maximum resource quota of the job or the multiple first type jobs; wherein the maximum resource quota is less than or equal to a difference between a resource configuration amount of the server and a resource usage amount of an operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
According to a third aspect, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method of the aspects and any possible implementation described above.
According to a fourth aspect, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of the aspects and any possible implementation as described above.
As can be seen from the foregoing technical solutions, in the embodiments of the present application, resource usage of a job including a first type job executed on a server is obtained, and then, according to the resource usage of the job and a maximum resource quota that can be provided by the server to the job, a maximum resource quota of one first type job or multiple first type jobs is adjusted, so that the one first type job or multiple first type jobs are executed by using the maximum resource quota of the one first type job or multiple first type jobs, and by monitoring resource usage of the job on the server in real time, the maximum resource quota of the first type job is dynamically adjusted for a first type job whose resource usage exceeds a minimum resource quota of the job, for example, an online job, so as to implement dynamic control on resource usage of the first type job, and unlimited mutual influence on performance between the first type jobs due to resource usage can be effectively avoided Thereby improving the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the limitation of the maximum resource quota which can be provided by the server for the operation is smaller than the difference value between the resource allocation amount of the server and the resource usage amount of the operating system of the server, so that a buffer area (buffer) can be always kept between the maximum resource quota which can be provided by the server for the operation and the available resources of the whole machine, the problem of the exhaustion of the available resources of the whole machine caused by the unlimited use of the resources can be effectively avoided, and the efficiency and the reliability of the operation execution are further improved.
In addition, by adopting the technical scheme provided by the application, the user experience can be effectively improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to the drawings without inventive labor. The drawings are only for the purpose of illustrating the present invention and are not to be construed as limiting the present application. Wherein:
FIG. 1A is a schematic illustration according to a first embodiment of the present application;
FIG. 1B is a schematic diagram of resources on a server in a first embodiment of the present application;
FIG. 2 is a schematic diagram according to a second embodiment of the present application;
FIG. 3 is a schematic illustration according to a third embodiment of the present application;
FIG. 4 is a schematic illustration according to a fourth embodiment of the present application;
fig. 5 is a schematic diagram of an electronic device for implementing a resource processing method of a job according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terminal device referred in the embodiments of the present application may include, but is not limited to, a mobile phone, a Personal Digital Assistant (PDA), a wireless handheld device, a tablet computer (tablet computer), and other smart devices; the display device may include, but is not limited to, a personal computer, a television, and the like having a display function.
In addition, the term "and/or" herein is only one kind of association relationship describing an associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
FIG. 1A is a schematic diagram according to a first embodiment of the present application, as shown in FIG. 1A.
101. Resource usage of jobs executed on a server is obtained, the jobs including a first type of job.
Among them, the first type job may be an online job with high real-time performance.
102. And adjusting the maximum resource quota of one first type job or a plurality of first type jobs according to the resource usage of the job and the maximum resource quota which can be provided by the server for the job, so that the one first type job or the plurality of first type jobs can be executed by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs.
Wherein the maximum resource quota is less than or equal to a difference between a resource configuration amount of the server and a resource usage amount of an operating system of the server.
Wherein the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
The resource may include, but is not limited to, at least one resource of a memory resource, a CPU resource, and a hard disk resource, which is not particularly limited in this embodiment.
The minimum resource quota of the first type of job refers to a resource quota that the user has previously applied for the first type of job and that the first type of job must be guaranteed to be usable, for example, the user is willing to pay a certain monetary value, a resource quota that has previously applied for the first type of job, and the like, and therefore, the server needs to guarantee the use of resources within the minimum resource quota of the first type of job.
The maximum resource quota for the first type of job is an upper limit of the maximum resources that can be used by the first type of job.
It should be noted that part or all of the execution subjects of 101 to 102 may be an application located at the local terminal, or may also be a functional unit such as a plug-in or Software Development Kit (SDK) set in the application located at the local terminal, or may also be a processing engine located in a server on the network side, or may also be a distributed system located on the network side, for example, a processing engine or a distributed system in a resource platform on the network side, which is not particularly limited in this embodiment.
It is to be understood that the application may be a native application (native app) installed on the local terminal, or may also be a web page program (webApp) of a browser on the local terminal, which is not limited in this embodiment.
In this embodiment, the sum of the resources that can be used by all the jobs is constrained by the maximum resource quota that can be provided by the server for the jobs, and therefore, a reasonable value needs to be set for the maximum resource quota that can be provided by the server for the jobs. If the maximum resource quota is set too large, for example, greater than the resources of the whole machine, the maximum resource quota has lost meaning because the resources of the whole machine are consumed and used up when the maximum resource quota has not acted as a constraint on the use condition of the resources of the job; if the maximum resource quota is set too small, the resources of the whole machine, for example, 128G memory of the whole machine, are greatly wasted, and if the memory resources in the maximum resource quota are set to 60G, 68G memory is wasted by each machine.
Optionally, in a possible implementation manner of this embodiment, the maximum resource quota that the server can provide to the job may be defined as all remaining resources of the server, that is, the maximum resource quota that the server can provide to the job may be equal to a difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server.
At this time, by limiting the maximum resource quota which can be provided by the server to the job to the difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server, all the remaining resources of the server can be used as the maximum resource quota which can be provided by the server to the job, so that the resources of the server are fully utilized, and the resource utilization rate can be effectively improved.
Optionally, in a possible implementation manner of this embodiment, the maximum resource quota that the server can provide to the job may not be simply limited to the total remaining resources of the server, but a part of the remaining resources N of the server is reserved as a buffer usage of the operating system, that is, the maximum resource quota that the server can provide to the job may be smaller than a difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server, and the maximum resource quota that the server can provide to the job is the resource configuration amount of the server-the resource usage amount of the operating system of the server-the remaining resources N of the part of the server.
For example, if host represents the whole resource and system represents the resource usage of the operating system of the server, then N may be set to 5% of the whole resource of the server, and accordingly, the following equivalent relationship may be obtained:
The server may provide a maximum resource quota to the job, host.quote-system.used-host.quote 5% — host.quote 95% -system.
As can be seen, host. quote x 95% -system. used is a dynamically changing process whose values will dynamically adjust as the resource usage of the operating system of the server changes. The formula ensures that the residual resources of the whole machine are always more than 5% of the resources of the whole machine under the normal condition.
At this time, the maximum resource quota limit provided by the server for the job is smaller than the difference between the resource allocation amount of the server and the resource usage amount of the operating system of the server, so that the server can always maintain a buffer (buffer) between the maximum resource quota provided by the job and the available resources of the whole machine, the problem of the exhaustion of the available resources of the whole machine caused by the unlimited use of the resources can be effectively avoided, and the efficiency and the reliability of job execution are further improved.
It can be understood that, since each first-type job on the server corresponds to its respective minimum resource quota, it is necessary to ensure that the resources of the server reserved for the first-type job meet the minimum resource quota of the job, and therefore, the minimum value of the maximum resource quota that the server can provide to the job cannot be smaller than the sum of the minimum resource quotas of all the first-type jobs on the server.
If the maximum resource quota obtained by adopting the limiting scheme is smaller than the sum of the minimum resource quotas of all the first-type jobs on the server, the maximum resource quota which can be provided by the server to the jobs can be adjusted, so that the maximum resource quota which can be provided by the server to the jobs is limited to the sum of the minimum resource quotas of all the first-type jobs on the server.
Generally, many jobs are already executed on a server, and if it is necessary to execute a corresponding job by running a process of each job according to the maximum resource quota that the server can provide for the job, as defined in the present application, a resource frame needs to be further set according to the maximum resource quota that the server can provide for the job, and furthermore, each process of the job executed on the server can be moved into the resource frame. In this case, the process of each job may be executed in the resource frame by running the process of each job using the maximum resource quota, which is the resource in the resource frame, to execute the corresponding job.
A schematic diagram of resources on the server in this embodiment can be seen in fig. 1B.
In the process of moving, the state of the process is not fixed but is changed instantaneously, so that the following situations may occur: when moving process X of job a, after picking up process X of job a and before putting it into the resource frame, process X is finished, at this time, job C just multiplexes process number X of this process X, and therefore, the result of the movement is that the process of process number X of job C is moved to a job in the resource frame.
If all the processes of job a are terminated (kill) after the lifecycle of job a is finished, the process of process number X is already erroneously moved to the job a in the resource frame, and therefore the process of process number X is also terminated, so that the process of process number X of job C is erroneously terminated, resulting in an error in execution of job C.
The technical scheme provided by the application can be suitable for a system which is arranged in an off-line mixed mode. In order to avoid the above problem, the present embodiment provides solutions for different job types, respectively:
in the first method, for the second type of job, for example, offline job with low real-time performance, the following technical scheme may be adopted to move the process of the job:
since the second type of job has low real-time performance, before the job is moved, freezing (freeze) processing may be performed on each process of the job to be moved, and then each process after the freezing processing may be moved into the resource box. After the completion of the movement of each process of the job, the process is subjected to thawing processing.
At this time, because the real-time performance of the second job type is not high, before the process of the job is moved, the second type job may suspend to provide services to the outside through a freeze (freeze) process, and the process of each job successfully moves into the resource frame, so that in the resource frame, the process of each job is run by using the resource in the resource frame, i.e. the maximum resource quota, to execute the corresponding job. Then, after the completion of the movement of each process of the job, the defrosting process is further performed for each process.
In the second method, for the first type of job, for example, the online job with high real-time performance, the following technical scheme may be adopted to move the progress of the job:
because the real-time performance of the first type of job is high, all processes of the job cannot be frozen, and alternatively, after each process of the job to be moved is moved into the resource frame, a confirmation (double check) mechanism may be executed to determine whether the process is successfully moved according to the process Control Groups (cgroups) of each resource dimension corresponding to each process.
The resource dimension may include, but is not limited to, at least one resource dimension of a memory resource dimension, a CPU resource dimension, and a hard disk resource dimension, which is not particularly limited in this embodiment.
If the process control groups of the resource dimension corresponding to the processes of the operation belong to the operation, the process is successfully moved; if the process control groups of the resource dimension corresponding to the processes of the jobs do not belong to the jobs, the process is not successfully moved, and the processes of other jobs are mistakenly moved. For a process whose movement is not successful, a restore operation of the movement needs to be further performed on the process.
For example, after the process X of the job a is moved, that is, after the process X of the CPU dimension resource and the process X of the memory dimension resource of the job a are moved, the interface provided by the Linux system/proc file system may be used to query the cgroup of each resource dimension corresponding to the process, and if the cgroup of the CPU resource dimension of the process X is/cgroups/CPU/a and the cgroup of the memory resource dimension of the process X is/cgroups/memory/B, it is described that the process X is not moved successfully, and the process of the other job B is moved by mistake.
At this time, because the real-time property of the first job type is high, after the process of the job is moved, the process of each job can be successfully moved into the resource frame through a confirmation (double check) mechanism on the premise that the first type job does not suspend to provide services to the outside, so that in the resource frame, the process of each job is operated by using the resource, namely the maximum resource quota, in the resource frame to execute the corresponding job.
It will be appreciated that if a new server is involved, the resource box may be set directly according to the maximum resource quota that the server can provide to the job. In this case, the process of each job may be executed in the resource frame by running the process of each job using the maximum resource quota, which is the resource in the resource frame, to execute the corresponding job.
Optionally, in a possible implementation manner of this embodiment, in 102, the resource usage of the job on the server may be monitored in real time, and the maximum resource quota of the first type of job whose resource usage exceeds the minimum resource quota of the first type of job is dynamically adjusted, for example, an online job.
In a specific implementation process, if a ratio of the resource usage amount of the job to the maximum resource quota that can be provided by the server to the job is greater than or equal to a first resource threshold, for example, 70%, or the like, the maximum resource quota of the first type job or the plurality of types of jobs may be set, so that the ratio of the resource usage amount of the job to the maximum resource quota that can be provided by the server to the job is less than or equal to the first resource threshold.
At this time, by monitoring the resource usage of the jobs on the server in real time, when the resource usage of the jobs is too large, the resource usage of one or more first-type jobs needs to be limited to control the resource usage of the first-type jobs not to affect the resource usage of other first-type jobs, so that the problem of mutual influence of performance between the first-type jobs due to unlimited resource usage can be effectively avoided, and thus, the efficiency and reliability of job execution are improved.
In another specific implementation process, if a ratio of the resource usage amount of the job to the maximum resource quota that the server can provide to the job is smaller than a second resource threshold, for example, 70%, or the like, the maximum resource quota of the first-type job or the plurality of first-type jobs may be cancelled. Wherein the second resource threshold may be less than or equal to the first resource threshold.
At this time, by monitoring the resource usage of the jobs on the server in real time, when the resource usage of the jobs is not so large, there is no need to limit the resource usage of one or more first-type jobs, because the resource usage of these first-type jobs does not affect the resource usage of other first-type jobs, thereby improving the flexibility of job execution.
In this embodiment, by obtaining the resource usage amount of the job including the first type job executed on the server, and further adjusting the maximum resource quota of one first type job or multiple first type jobs according to the resource usage amount of the job and the maximum resource quota that the server can provide to the job, so as to execute the one first type job or multiple first type jobs by using the maximum resource quota of the one first type job or multiple first type jobs, the resource usage condition of the job on the server is monitored in real time, the maximum resource quota is dynamically adjusted for the first type job whose resource usage amount exceeds the minimum resource quota of itself, for example, the online job, so as to implement dynamic control over the resource usage amount of the first type job, and the problem of mutual influence of performance between the first type jobs due to unlimited use of resources can be effectively avoided, thereby improving the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the limitation of the maximum resource quota which can be provided by the server for the operation is smaller than the difference value between the resource allocation amount of the server and the resource usage amount of the operating system of the server, so that a buffer area (buffer) can be always kept between the maximum resource quota which can be provided by the server for the operation and the available resources of the whole machine, the problem of the exhaustion of the available resources of the whole machine caused by the unlimited use of the resources can be effectively avoided, and the efficiency and the reliability of the operation execution are further improved.
In addition, by adopting the technical scheme provided by the application, the user experience can be effectively improved.
Fig. 2 is a schematic diagram of a second embodiment according to the present application, and compared with the first embodiment, the present embodiment may further perform the following steps.
201. And acquiring the resource configuration amount of the server and the resource usage amount of the operating system of the server.
202. And adjusting the maximum resource quota which can be provided by the server for the operation according to the resource configuration amount of the server and the resource usage amount of the operating system of the server.
Optionally, in a possible implementation manner of this embodiment, the maximum resource quota that the server can provide to the job may be defined as all remaining resources of the server, that is, the maximum resource quota that the server can provide to the job may be equal to a difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server.
Then, the maximum resource quota that can be provided by the server to the job may be adjusted to all remaining resources of the server according to the resource configuration amount of the server and the resource usage amount of the operating system of the server, that is, the maximum resource quota that can be provided by the server to the job may be equal to a difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server.
At this time, by adjusting the maximum resource quota which can be provided by the server to the job to be the difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server, all the remaining resources of the server can be used as the maximum resource quota which can be provided by the server to the job, so that the resources of the server are fully utilized, and the resource utilization rate can be effectively improved.
Optionally, in a possible implementation manner of this embodiment, the maximum resource quota that the server can provide to the job may not be simply limited to the total remaining resources of the server, but a part of the remaining resources N of the server is reserved as a buffer usage of the operating system, that is, the maximum resource quota that the server can provide to the job may be smaller than a difference between the resource configuration amount of the server and the resource usage amount of the operating system of the server, and the maximum resource quota that the server can provide to the job is the resource configuration amount of the server-the resource usage amount of the operating system of the server-the remaining resources N of the part of the server.
Then, the maximum resource quota that can be provided by the server to the job may be adjusted to be less than all of the remaining resources of the server according to the resource configuration amount of the server and the resource usage amount of the operating system of the server, that is, the maximum resource quota that can be provided by the server to the job may be equal to the resource configuration amount of the server, the resource usage amount of the operating system of the server, and the remaining resources N of a part of the server.
At this time, by adjusting the difference value that the maximum resource quota limit that the server can provide for the job is smaller than the resource allocation amount of the server and the resource usage amount of the operating system of the server, the server can always maintain a buffer (buffer) between the maximum resource quota provided for the job and the available resources of the whole machine, and the problem of the exhaustion of the available resources of the whole machine due to the unlimited use of the resources can be effectively avoided, thereby further improving the efficiency and reliability of job execution.
It can be understood that, since each first-type job on the server corresponds to its respective minimum resource quota, it is necessary to ensure that the resources of the server reserved for the first-type job meet the minimum resource quota of the job, and therefore, the minimum value of the maximum resource quota that the server can provide to the job cannot be smaller than the sum of the minimum resource quotas of all the first-type jobs on the server.
If the maximum resource quota obtained by adopting the above limiting scheme is smaller than the sum of the minimum resource quotas of all the first-type jobs on the server, the maximum resource quota which can be provided by the server for the jobs can be further adjusted, so that the maximum resource quota which can be provided by the server for the jobs is limited to the sum of the minimum resource quotas of all the first-type jobs on the server.
In this embodiment, the maximum resource quota that the server can provide for the job is dynamically adjusted by monitoring the resource usage of the operating system on the server in real time, so that a buffer (buffer) can be always maintained between the maximum resource quota that the server can provide for the job and the available resources of the whole machine, and further the job is controlled not to exhaust the available resources of the whole machine due to unlimited resource usage, thereby avoiding a problem of kernel crash (crash) caused by the exhaustion of the available resources of the whole machine of the server.
Fig. 3 is a schematic diagram according to a third embodiment of the present application, and compared with the first embodiment or the second embodiment, the job in this embodiment may further include a second type job, and this embodiment may further perform the following steps.
301. And acquiring the resource usage amount of all the first type jobs executed on the server.
302. And adjusting the resource usage amount of all or part of the second type of jobs executed on the server according to the resource usage amount of all the first type of jobs and the maximum resource quota which can be provided by the server to the jobs.
The second type of job may be an offline job with low real-time performance. The technical scheme provided by the application is suitable for a system which is in off-line mixed layout.
Optionally, in one possible implementation manner of this embodiment, the second type job may be divided into a first part job and a second part job, where the first part job may be the second type job with a low priority, and the second part job may be the second type job with a high priority.
Then, in 302, the resource usage of the online job on the server may be monitored in real time, and according to the resource usage of all the first type jobs and the maximum resource quota that the server can provide to the jobs, it is found that the resource usage of all the first type jobs is gradually increased, then, the limitation of the resource usage of the first part of jobs may be reduced and adjusted correspondingly, or the first part of jobs may be directly suspended, so as to ensure that the resource demand of the first type jobs, for example, the online jobs with high real-time performance, can be met in time.
If the adjustment operation on the first part of the jobs still cannot ensure that the resource requirements of the first type of jobs, for example, the online jobs with high real-time performance, can be met in time, then the adjustment operation can be further performed on the second part of the jobs, that is, the limitation on the resource usage of the second part of the jobs is reduced and adjusted, or the second part of the jobs is directly suspended to ensure that the resource requirements of the first type of jobs, for example, the online jobs with high real-time performance, can be met in time.
In this embodiment, the resource usage of the second type job, for example, the offline job with low real-time performance, is dynamically controlled by monitoring the resource usage of the first type job, for example, the online job with high real-time performance, in real time, so that the resource requirement of the first type job can be satisfied in time, and is not affected by the second type job, and the second type job can perform unconditional deferral rapidly and flexibly, thereby improving the efficiency and reliability of the first type job.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
Fig. 4 is a schematic view of a fourth embodiment according to the present application, as shown in fig. 4. The resource processing apparatus 400 of the job of the present embodiment may include a monitoring unit 401 and an adjusting unit 402. The monitoring unit 401 is configured to obtain resource usage of a job executed on a server, where the job includes a first type of job; an adjusting unit 402, configured to adjust a maximum resource quota of one first type job or multiple first type jobs according to a resource usage amount of the job and a maximum resource quota that can be provided by the server to the job, so that the one first type job or multiple first type jobs are executed by using the maximum resource quota of the one first type job or multiple first type jobs; wherein the maximum resource quota is less than or equal to a difference between a resource configuration amount of the server and a resource usage amount of an operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
It should be noted that, part or all of the resource processing apparatus of the job in this embodiment may be an application located at the local terminal, or may also be a functional unit such as a plug-in or Software Development Kit (SDK) set in the application located at the local terminal, or may also be a processing engine located in a server on the network side, or may also be a distributed system located on the network side, for example, a processing engine or a distributed system in a resource platform on the network side, and this embodiment is not particularly limited thereto.
It is to be understood that the application may be a native application (native app) installed on the local terminal, or may also be a web page program (webApp) of a browser on the local terminal, which is not limited in this embodiment.
Optionally, in a possible implementation manner of this embodiment, the adjusting unit 402 may be further configured to set a resource frame according to a maximum resource quota that the server can provide to the job; and moving each process of the operation executed on the server into the resource frame.
In a specific implementation process, the adjusting unit 402 may be specifically configured to freeze processes of a to-be-moved job; moving each process after the freezing treatment to the resource frame; and freezing each process after the freezing treatment.
In another specific implementation process, the adjusting unit 402 may be specifically configured to move each process of the job to be moved into the resource frame; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
Optionally, in a possible implementation manner of this embodiment, the monitoring unit 401 may further be configured to obtain a resource configuration amount of the server and a resource usage amount of an operating system of the server; correspondingly, the adjusting unit 402 may be further configured to adjust the maximum resource quota that the server can provide to the job according to the resource configuration amount of the server and the resource usage amount of the operating system of the server.
Optionally, in a possible implementation manner of this embodiment, the adjusting unit 402 may be specifically configured to set the maximum resource quota of the first type job or the multiple types of jobs if a ratio of the resource usage amount of the job to the maximum resource quota that can be provided by the server to the job is greater than or equal to a first resource threshold.
Further, if the ratio of the resource usage amount of the job to the maximum resource quota that the server can provide to the job is smaller than a second resource threshold, canceling the maximum resource quota of the first type job or the plurality of first type jobs; wherein the second resource threshold is less than or equal to the first resource threshold.
Optionally, in a possible implementation manner of this embodiment, the job may further include a second type job; correspondingly, the monitoring unit 401 may further be configured to obtain resource usage amounts of all the first type jobs executed on the server; the adjusting unit 402 may be further configured to adjust the resource usage amount of all or part of the second type job executed on the server according to the resource usage amount of all the first type jobs and the maximum resource quota that can be provided by the server to the job.
It should be noted that the method in the embodiments corresponding to fig. 1A, fig. 2, and fig. 3 may be implemented by the resource processing apparatus of the job provided in this embodiment. For a detailed description, reference may be made to relevant contents in the embodiments corresponding to fig. 1A, fig. 2, and fig. 3, and details are not repeated here.
In this embodiment, the resource usage amount of the job including the first type job executed on the server is obtained by the monitoring unit, and then the adjustment unit adjusts the maximum resource quota of one first type job or multiple first type jobs according to the resource usage amount of the job and the maximum resource quota that the server can provide to the job, so as to execute the one first type job or multiple first type jobs by using the maximum resource quota of the one first type job or multiple first type jobs Thereby improving the efficiency and reliability of job execution.
In addition, by adopting the technical scheme provided by the application, the limitation of the maximum resource quota which can be provided by the server for the operation is smaller than the difference value between the resource allocation amount of the server and the resource usage amount of the operating system of the server, so that a buffer area (buffer) can be always kept between the maximum resource quota which can be provided by the server for the operation and the available resources of the whole machine, the problem of the exhaustion of the available resources of the whole machine caused by the unlimited use of the resources can be effectively avoided, and the efficiency and the reliability of the operation execution are further improved.
In addition, by adopting the technical scheme provided by the application, the user experience can be effectively improved.
The present application also provides an electronic device and a non-transitory computer readable storage medium having computer instructions stored thereon, according to embodiments of the present application.
Fig. 5 is a schematic diagram of an electronic device for implementing the resource processing method of a job according to the embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 5, the electronic apparatus includes: one or more processors 501, memory 502, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI (graphical user interface) on an external input/output apparatus, such as a display device coupled to the interface. In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 5, one processor 501 is taken as an example.
The memory 502, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and units, such as program instructions/units (e.g., the monitoring unit 401 and the adjusting unit 402 shown in fig. 4) corresponding to the resource processing method of the job in the embodiment of the present application. The processor 501 executes various functional applications of the server and data processing, i.e., a resource processing method of a job in the above-described method embodiment, by executing the non-transitory software programs, instructions, and units stored in the memory 502.
The memory 502 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data and the like created according to use of an electronic device that implements the resource processing method of a job provided by the embodiment of the present application. Further, the memory 502 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 502 may optionally include a memory remotely located from the processor 501, and these remote memories may be connected via a network to an electronic device that implements the resource processing method of jobs provided by the embodiments of the present application. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the resource processing method of a job may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected by a bus or other means, and fig. 5 illustrates the connection by a bus as an example.
The input device 503 may receive input numeric or character information and generate key signal inputs related to user settings and function control of an electronic apparatus implementing the resource processing method of a job provided by the embodiment of the present application, such as an input device of a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or the like. The output devices 504 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, an LCD (liquid crystal display), an LED (light emitting diode) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, PLDs (programmable logic devices)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (local area network), WAN (wide area network), internet, and blockchain networks.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the resource use condition of the operation on the server is monitored in real time, the maximum resource quota of the first-type operation is dynamically adjusted aiming at the first-type operation with the resource use amount exceeding the minimum resource quota of the operation, such as online operation, the resource use amount of the first-type operation is dynamically controlled, the problem that the performance of the first-type operation is influenced by the fact that the resource is used without limit can be effectively solved, and therefore the efficiency and the reliability of operation execution are improved.
In addition, by adopting the technical scheme provided by the application, the limitation of the maximum resource quota which can be provided by the server for the operation is smaller than the difference value between the resource allocation amount of the server and the resource usage amount of the operating system of the server, so that a buffer area (buffer) can be always kept between the maximum resource quota which can be provided by the server for the operation and the available resources of the whole machine, the problem of the exhaustion of the available resources of the whole machine caused by the unlimited use of the resources can be effectively avoided, and the efficiency and the reliability of the operation execution are further improved.
In addition, by adopting the technical scheme provided by the application, the user experience can be effectively improved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (16)
1. A method of resource processing for a job, comprising:
acquiring resource usage of a job executed on a server, wherein the job comprises a first type job;
according to the resource usage amount of the job and the maximum resource quota which can be provided by the server to the job, adjusting the maximum resource quota of one first type job or a plurality of first type jobs, so that the one first type job or the plurality of first type jobs can be executed by utilizing the maximum resource quota of the one first type job or the plurality of first type jobs; wherein the content of the first and second substances,
the maximum resource quota is less than or equal to the difference value between the resource configuration amount of the server and the resource usage amount of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
2. The method of claim 1, wherein the method further comprises:
setting a resource frame according to the maximum resource quota which can be provided by the server for the operation;
and moving each process of the operation executed on the server into the resource frame.
3. The method of claim 2, wherein said moving processes of jobs executed on the server into the resource box comprises:
Freezing each process of the operation to be moved; moving each process after the freezing treatment to the resource frame; freezing each process after the freezing treatment; or
Moving each process of the operation to be moved into the resource frame; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
4. The method of claim 1, wherein the method further comprises:
acquiring the resource allocation amount of the server and the resource usage amount of an operating system of the server;
and adjusting the maximum resource quota which can be provided by the server for the operation according to the resource configuration amount of the server and the resource usage amount of the operating system of the server.
5. The method of claim 1, wherein said adjusting the maximum resource quota for the one or more first-type jobs based on the resource usage of the job and the maximum resource quota that the server can provide to the job comprises:
and if the ratio of the resource usage amount of the operation to the maximum resource quota which can be provided by the server to the operation is larger than or equal to a first resource threshold value, setting the maximum resource quota of the first type of operation or the plurality of types of operations.
6. The method of claim 5, wherein the adjusting the maximum resource quota for the one or more first-type jobs based on the resource usage of the job and the maximum resource quota that the server can provide to the job, further comprises:
if the ratio of the resource usage amount of the job to the maximum resource quota which can be provided by the server to the job is smaller than a second resource threshold, canceling the maximum resource quota of the first type job or the plurality of first type jobs; wherein the second resource threshold is less than or equal to the first resource threshold.
7. The method of any of claims 1-6, wherein the job further comprises a second type of job; the method further comprises the following steps:
acquiring resource usage of all first type jobs executed on the server;
and adjusting the resource usage amount of all or part of the second type of jobs executed on the server according to the resource usage amount of all the first type of jobs and the maximum resource quota which can be provided by the server to the jobs.
8. A resource processing apparatus of a job, comprising:
the system comprises a monitoring unit, a processing unit and a processing unit, wherein the monitoring unit is used for acquiring the resource usage amount of jobs executed on a server, and the jobs comprise first type jobs;
An adjusting unit, configured to adjust a maximum resource quota of one first type job or multiple first type jobs according to a resource usage amount of the job and a maximum resource quota that can be provided by the server for the job or the multiple first type jobs, so that the job or the multiple first type jobs are executed by using the maximum resource quota of the job or the multiple first type jobs; wherein the content of the first and second substances,
the maximum resource quota is less than or equal to the difference value between the resource configuration amount of the server and the resource usage amount of the operating system of the server;
the maximum resource quota of the first type job or jobs is greater than or equal to the minimum resource quota of the first type job.
9. The apparatus of claim 8, wherein the adjusting unit is further configured to adjust the current value of the current signal
Setting a resource frame according to the maximum resource quota which can be provided by the server for the operation; and
and moving each process of the operation executed on the server into the resource frame.
10. The device according to claim 9, wherein the adjustment unit is, in particular, for
Freezing each process of the operation to be moved; moving each process after the freezing treatment to the resource frame; freezing each process after the freezing treatment; or
Moving each process of the operation to be moved into the resource frame; and determining whether the process is successfully moved according to the process control group of each resource dimension corresponding to each process.
11. The apparatus of claim 8, wherein,
the monitoring unit is further configured to obtain a resource allocation amount of the server and a resource usage amount of an operating system of the server;
the adjusting unit is further configured to adjust a maximum resource quota that can be provided by the server for the job according to the resource configuration amount of the server and the resource usage amount of the operating system of the server.
12. The device according to claim 8, wherein the adjustment unit is specifically configured to
And if the ratio of the resource usage amount of the operation to the maximum resource quota which can be provided by the server to the operation is larger than or equal to a first resource threshold value, setting the maximum resource quota of the first type of operation or the plurality of types of operations.
13. The apparatus of claim 12, wherein the adjusting unit is further configured to adjust the current value of the current signal
If the ratio of the resource usage amount of the job to the maximum resource quota which can be provided by the server to the job is smaller than a second resource threshold, canceling the maximum resource quota of the first type job or the plurality of first type jobs; wherein the second resource threshold is less than or equal to the first resource threshold.
14. The apparatus of any of claims 8-13, wherein the jobs further comprise a second type of job;
the monitoring unit is further configured to obtain resource usage amounts of all the first type jobs executed on the server;
the adjusting unit is further configured to adjust the resource usage amount of all or part of the second type of job executed on the server according to the resource usage amount of all the first type of job and the maximum resource quota that the server can provide for the job.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010552506.9A CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010552506.9A CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111858030A true CN111858030A (en) | 2020-10-30 |
| CN111858030B CN111858030B (en) | 2024-03-22 |
Family
ID=72987585
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010552506.9A Active CN111858030B (en) | 2020-06-17 | 2020-06-17 | Resource processing method and device for job, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111858030B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590317A (en) * | 2021-07-27 | 2021-11-02 | 杭州朗和科技有限公司 | Scheduling method, device, medium and computing equipment of offline service |
| CN117290075A (en) * | 2023-11-23 | 2023-12-26 | 苏州元脑智能科技有限公司 | Process migration method, system, device, communication equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104468521A (en) * | 2014-11-13 | 2015-03-25 | 华为技术有限公司 | Online migration method, device and system |
| US9262217B1 (en) * | 2013-06-26 | 2016-02-16 | Emc Corporation | Computation resource cyclic utilization |
| CN105849715A (en) * | 2014-01-31 | 2016-08-10 | 谷歌公司 | Efficient resource utilization in data centers |
| WO2017206749A1 (en) * | 2016-06-01 | 2017-12-07 | 阿里巴巴集团控股有限公司 | Adaptive resource allocation method and apparatus |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| US20190243682A1 (en) * | 2018-02-06 | 2019-08-08 | Rubrik, Inc. | Real-time distributed job scheduler with job self-scheduling |
| CN110147915A (en) * | 2018-02-11 | 2019-08-20 | 陕西爱尚物联科技有限公司 | A kind of method and its system of resource distribution |
| CN110389842A (en) * | 2019-07-26 | 2019-10-29 | 中国工商银行股份有限公司 | A kind of dynamic resource allocation method, device, storage medium and equipment |
| CN110609743A (en) * | 2018-06-15 | 2019-12-24 | 伊姆西Ip控股有限责任公司 | Method, electronic device and computer program product for configuring resources |
-
2020
- 2020-06-17 CN CN202010552506.9A patent/CN111858030B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9262217B1 (en) * | 2013-06-26 | 2016-02-16 | Emc Corporation | Computation resource cyclic utilization |
| CN105849715A (en) * | 2014-01-31 | 2016-08-10 | 谷歌公司 | Efficient resource utilization in data centers |
| CN104468521A (en) * | 2014-11-13 | 2015-03-25 | 华为技术有限公司 | Online migration method, device and system |
| WO2017206749A1 (en) * | 2016-06-01 | 2017-12-07 | 阿里巴巴集团控股有限公司 | Adaptive resource allocation method and apparatus |
| US20190243682A1 (en) * | 2018-02-06 | 2019-08-08 | Rubrik, Inc. | Real-time distributed job scheduler with job self-scheduling |
| CN110147915A (en) * | 2018-02-11 | 2019-08-20 | 陕西爱尚物联科技有限公司 | A kind of method and its system of resource distribution |
| CN110609743A (en) * | 2018-06-15 | 2019-12-24 | 伊姆西Ip控股有限责任公司 | Method, electronic device and computer program product for configuring resources |
| CN110032447A (en) * | 2019-04-11 | 2019-07-19 | 北京百度网讯科技有限公司 | Method and apparatus for distributing resource |
| CN110389842A (en) * | 2019-07-26 | 2019-10-29 | 中国工商银行股份有限公司 | A kind of dynamic resource allocation method, device, storage medium and equipment |
Non-Patent Citations (1)
| Title |
|---|
| 刘晓东;赵晓芳;金岩;罗刚;陈雅静;赵曙光;: "企业私有云环境下面向高性能计算的资源弹性分配算法", 高技术通讯, no. 08 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590317A (en) * | 2021-07-27 | 2021-11-02 | 杭州朗和科技有限公司 | Scheduling method, device, medium and computing equipment of offline service |
| CN117290075A (en) * | 2023-11-23 | 2023-12-26 | 苏州元脑智能科技有限公司 | Process migration method, system, device, communication equipment and storage medium |
| CN117290075B (en) * | 2023-11-23 | 2024-02-27 | 苏州元脑智能科技有限公司 | Process migration method, system, device, communication equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111858030B (en) | 2024-03-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111738446A (en) | Scheduling method, device, equipment and medium of deep learning inference engine | |
| CN110806923A (en) | Parallel processing method and device for block chain tasks, electronic equipment and medium | |
| CN110659246B (en) | Container-based file mounting method and device and electronic equipment | |
| CN111240836A (en) | Computing resource management method and device, electronic equipment and storage medium | |
| CN111459645B (en) | Task scheduling method and device and electronic equipment | |
| CN111880914A (en) | Resource scheduling method, resource scheduling apparatus, electronic device, and storage medium | |
| CN111586128A (en) | Method, device and equipment for acquiring applet data and storage medium | |
| CN112565356B (en) | Data storage method and device and electronic equipment | |
| CN111858030B (en) | Resource processing method and device for job, electronic equipment and readable storage medium | |
| CN110706147A (en) | Image processing environment determination method and device, electronic equipment and storage medium | |
| CN111782147A (en) | Method and apparatus for cluster scale-up | |
| CN112446574B (en) | Product evaluation method, device, electronic equipment and storage medium | |
| CN111625195A (en) | Method and device for server capacity expansion | |
| CN111178937A (en) | User reward method and device of application, electronic equipment and readable storage medium | |
| CN110796191A (en) | Trajectory classification method and device | |
| CN110688229A (en) | Task processing method and device | |
| CN114356547A (en) | Low-priority blocking method and device based on processor virtualization environment | |
| CN112965806A (en) | Method and apparatus for determining resources | |
| CN111782357A (en) | Label control method and device, electronic equipment and readable storage medium | |
| CN111598571A (en) | Transaction processing method, device, equipment and storage medium of block chain | |
| CN112817965B (en) | Data splicing method and device, electronic equipment and storage medium | |
| CN112527527A (en) | Consumption speed control method and device of message queue, electronic equipment and medium | |
| CN112346512A (en) | Time synchronization method and device | |
| CN111292223A (en) | Graph calculation processing method and device, electronic equipment and storage medium | |
| CN113765979A (en) | Information transmission method, system and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |