CN110058941A - Task scheduling and managing method, device, equipment and storage medium - Google Patents
Task scheduling and managing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110058941A CN110058941A CN201910205701.1A CN201910205701A CN110058941A CN 110058941 A CN110058941 A CN 110058941A CN 201910205701 A CN201910205701 A CN 201910205701A CN 110058941 A CN110058941 A CN 110058941A
- Authority
- CN
- China
- Prior art keywords
- task
- scheduling
- public library
- history
- token
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000033764 rhythmic process Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 235000013399 edible fruits Nutrition 0.000 description 4
- VYZAMTAEIAYCRO-UHFFFAOYSA-N Chromium Chemical compound [Cr] VYZAMTAEIAYCRO-UHFFFAOYSA-N 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
Abstract
The present invention relates to big data fields, and the invention discloses a kind of task scheduling and managing method, device, equipment and storage mediums, by the way that according to token bucket setting scheduling public library is preset, the scheduling public library is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, dispatch resource consumption data according to the history and determine preset schedule strategy；Management is scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy, the target dispatch task-set is the set to scheduler task run based on Node.js, it being capable of the efficient efficiency of management, improve resource utilization, improve task execution efficiency, effective control task degree of concurrence and rhythm, and cost is relatively low, is easily accessed existing system.
Description
Technical field
The present invention relates to big data fields more particularly to a kind of task scheduling and managing method, device, equipment and storage to be situated between
Matter.
Background technique
During routine office work, the running environment of most of literal translation formula scripting language JavaScript is allowed now
JavaScript operates in the development platform Node.js of server-side when carrying out the scheduling in library, more to the consumption of system resource,
Such as reaction equation extension programming library RxJS (Reactive Extensions for JavaScript) etc., RxJS is one and is based on
Library of the Observable data flow in Asynchronous Programming application, but similar library generally only considers production and consumption, does not consider resource
The case where consumption, so that a large amount of bandwidth resources, processor resource and memory source be caused to be wasted, and will cause office effect
Rate is low.
Summary of the invention
The main purpose of the present invention is to provide a kind of task scheduling and managing method, device, equipment and storage mediums, it is intended to
Solve serious waste of resources in scheduling storehouse management process in the prior art, the low technical problem of office efficiency.
To achieve the above object, the present invention provides a kind of task scheduling and managing method, the task scheduling and managing method packet
Include following steps:
Scheduling public library is set according to default token bucket, the scheduling public library is run in running environment Node.js；
The history scheduling resource consumption data for obtaining the scheduling public library, dispatch resource consumption data according to the history
Determine preset schedule strategy；
Management, the target are scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy
Scheduler task collection is the set to scheduler task run based on Node.js.
Preferably, the basis presets token bucket setting scheduling public library, and the scheduling public library is in running environment
The step of being run in Node.js, comprising:
Obtain the corresponding token bucket algorithm of the default token bucket；
Target public library is cured as in the form of code according to the token bucket algorithm, using the target public library as institute
Scheduling public library is stated, the scheduling public library is run in running environment Node.js.
Preferably, the history for obtaining the scheduling public library dispatches resource consumption data, is dispatched according to the history
Resource consumption data determine the step of preset schedule strategy, comprising:
The history scheduling resource consumption data in the scheduling public library are obtained, resource consumption number is dispatched according to the history
According to determining token volume residual；
The current scheduling rate for obtaining current scheduling task in real time, by the token volume residual and default threshold token value into
Row compares, and obtains the first comparison result；The current scheduling rate is compared with the preset task scheduling rates, is obtained
Second comparison result；
The preset schedule strategy is determined according to first comparison result and second comparison result.
Preferably, described that the preset schedule strategy is determined according to first comparison result and second comparison result
The step of, comprising:
It is that the token volume residual is less than default threshold token value, and described second compares knot in first comparison result
When fruit is that the current scheduling rate is greater than the preset task scheduling rates, determine that the preset schedule strategy is currently to adjust
Degree task is cached；
It is that the token volume residual is greater than or equal to default threshold token value, and described second in first comparison result
When comparison result is that the current scheduling rate is greater than the preset task scheduling rates, the preset schedule strategy is determined to incite somebody to action
The current scheduling task is sent.
Preferably, the history obtained in the scheduling public library dispatches resource consumption data, according to the history tune
The step of degree resource consumption data determine token volume residual, comprising:
The corresponding history of the scheduling public library, which is obtained, by default public library calling interface dispatches resource consumption data；
History CPU consumption data and history memory consumption data are obtained from history scheduling resource consumption data, it is right
The history CPU consumption data and the history memory consumption data are analyzed, and token volume residual is obtained.
Preferably, described that pipe is scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy
The step of reason, the target dispatch task-set is the set to scheduler task run based on Node.js, comprising:
Obtain the task quantity for the waiting task for needing to be performed simultaneously in target dispatch task-set；
Obtain scheduling public library default while running number of tasks, by it is described default and meanwhile run number of tasks with it is described
Task quantity compares；
Be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy to the target
The task that scheduler task is concentrated is scheduled management；
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, to scheduling public library progress
It updates, the task in the target dispatch task-set is scheduled according to updated scheduling public library.
Preferably, it is described be greater than or equal in the task quantity it is described default while when running number of tasks, to the tune
Degree public library is updated, and is scheduled according to updated scheduling public library to the task in the target dispatch task-set
Step, comprising:
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, open operation token bucket and dispatch and connects
Mouthful；
The default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；
Public library is dispatched according to updated default update of token bucket, according to updated scheduling public library to described
Task in target dispatch task-set is scheduled.
In addition, to achieve the above object, the present invention also proposes a kind of Portable Batch System equipment, the Portable Batch System
Equipment includes: memory, processor and is stored in the task schedule pipe that can be run on the memory and on the processor
The step of reason program, the Portable Batch System program is arranged for carrying out task scheduling and managing method as described above.
In addition, to achieve the above object, the present invention also proposes a kind of storage medium, task is stored on the storage medium
Management and running program, the Portable Batch System program realize Portable Batch System side as described above when being executed by processor
The step of method.
In addition, to achieve the above object, the present invention also provides a kind of Portable Batch System device, the Portable Batch Systems
Device includes: setup module, tactful determining module and scheduler module；
Wherein, the setup module, for according to token bucket setting scheduling public library is preset, the scheduling public library to be transported
It is run in row environment Node.js；
The strategy determining module, the history for obtaining the scheduling public library dispatches resource consumption data, according to institute
It states history scheduling resource consumption data and determines preset schedule strategy；
The scheduler module, for being carried out according to the scheduling public library and preset schedule strategy to target dispatch task-set
Management and running, the target dispatch task-set are the set to scheduler task run based on Node.js.
Task scheduling and managing method proposed by the present invention, by according to default token bucket setting scheduling public library, the tune
Degree public library is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, according to
The history scheduling resource consumption data determine preset schedule strategy；According to the scheduling public library and preset schedule strategy to mesh
Mark scheduler task collection is scheduled management, and the target dispatch task-set is the collection to scheduler task run based on Node.js
Close, can the efficient efficiency of management, improve resource utilization, improve task execution efficiency, effective control task degree of concurrence and
Rhythm, and cost is relatively low, is easily accessed existing system.
Detailed description of the invention
Fig. 1 is the Portable Batch System device structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of task scheduling and managing method first embodiment of the present invention；
Fig. 3 is the flow diagram of task scheduling and managing method second embodiment of the present invention；
Fig. 4 is the flow diagram of task scheduling and managing method 3rd embodiment of the present invention；
Fig. 5 is the functional block diagram of Portable Batch System device first embodiment of the present invention.
The object of the invention is realized, the embodiments will be further described with reference to the accompanying drawings for functional characteristics and advantage.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The solution of the embodiment of the present invention is mainly: the present invention passes through according to default token bucket setting scheduling public library,
The scheduling public library is run in running environment Node.js；Obtain the history scheduling resource consumption number of the scheduling public library
According to, according to the history dispatch resource consumption data determine preset schedule strategy；According to the scheduling public library and preset schedule
Strategy is scheduled management to target dispatch task-set, and the target dispatch task-set is to be run based on Node.js wait dispatch
The set of task, can the efficient efficiency of management, improve resource utilization, improve task execution efficiency, effective control task is simultaneously
Hair degree and rhythm, and cost is relatively low, is easily accessed existing system, solves and provides in scheduling storehouse management process in the prior art
Source waste is serious, the low technical problem of office efficiency.
Referring to Fig.1, Fig. 1 is the Portable Batch System device structure for the hardware running environment that the embodiment of the present invention is related to
Schematic diagram.
As shown in Figure 1, the Portable Batch System equipment may include: processor 1001, such as central processing unit
(Central Processing Unit, CPU), communication bus 1002, user interface 1003, network interface 1004, memory
1005.Wherein, communication bus 1002 is for realizing the connection communication between these components.User interface 1003 may include standard
Wireline interface, wireless interface.Network interface 1004 optionally may include standard wireline interface and wireless interface (as wirelessly
Fidelity (WIreless-FIdelity, WI-FI) interface).Memory 1005 can be the random access memory of high speed
(Random Access Memory, RAM) memory, be also possible to stable memory (Non-volatile Memory,
), such as magnetic disk storage NVM.Memory 1005 optionally can also be the storage device independently of aforementioned processor 1001.
It will be understood by those skilled in the art that Portable Batch System device structure shown in Fig. 1 is not constituted to this
The restriction for management and running equipment of being engaged in may include perhaps combining certain components or difference than illustrating more or fewer components
Component layout.
As shown in Figure 1, as may include operating device, network communication mould in a kind of memory 1005 of storage medium
Block, user terminal interface module and Portable Batch System program.
Scheduling public library is set according to default token bucket, the scheduling public library is run in running environment Node.js；
The history scheduling resource consumption data for obtaining the scheduling public library, dispatch resource consumption data according to the history
Determine preset schedule strategy；
Management, the target are scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy
Scheduler task collection is the set to scheduler task run based on Node.js.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
Obtain the corresponding token bucket algorithm of the default token bucket；
Target public library is cured as in the form of code according to the token bucket algorithm, using the target public library as institute
Scheduling public library is stated, the scheduling public library is run in running environment Node.js.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
The history scheduling resource consumption data in the scheduling public library are obtained, resource consumption number is dispatched according to the history
According to determining token volume residual；
The current scheduling rate for obtaining current scheduling task in real time, by the token volume residual and default threshold token value into
Row compares, and obtains the first comparison result；The current scheduling rate is compared with the preset task scheduling rates, is obtained
Second comparison result；
The preset schedule strategy is determined according to first comparison result and second comparison result.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
It is that the token volume residual is less than default threshold token value, and described second compares knot in first comparison result
When fruit is that the current scheduling rate is greater than the preset task scheduling rates, determine that the preset schedule strategy is currently to adjust
Degree task is cached；
It is that the token volume residual is greater than or equal to default threshold token value, and described second in first comparison result
When comparison result is that the current scheduling rate is greater than the preset task scheduling rates, the preset schedule strategy is determined to incite somebody to action
The current scheduling task is sent.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
The corresponding history of the scheduling public library, which is obtained, by default public library calling interface dispatches resource consumption data；
History CPU consumption data and history memory consumption data are obtained from history scheduling resource consumption data, it is right
The history CPU consumption data and the history memory consumption data are analyzed, and token volume residual is obtained.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
Obtain the task quantity for the waiting task for needing to be performed simultaneously in target dispatch task-set；
Obtain scheduling public library default while running number of tasks, by it is described default and meanwhile run number of tasks with it is described
Task quantity compares；
Be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy to the target
The task that scheduler task is concentrated is scheduled management；
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, to scheduling public library progress
It updates, the task in the target dispatch task-set is scheduled according to updated scheduling public library.
Further, processor 1001 can call the Portable Batch System program stored in memory 1005, also execute
It operates below:
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, open operation token bucket and dispatch and connects
Mouthful；
The default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；
Public library is dispatched according to updated default update of token bucket, according to updated scheduling public library to described
Task in target dispatch task-set is scheduled.
The present embodiment dispatches public library, the scheduling public library through the above scheme, by being arranged according to default token bucket
It is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, according to the history
Scheduling resource consumption data determine preset schedule strategy；Target dispatch is appointed according to the scheduling public library and preset schedule strategy
Business collection is scheduled management, and the target dispatch task-set is the set to scheduler task run based on Node.js, Neng Gougao
The efficiency of management is imitated, resource utilization is improved, improves task execution efficiency, effective control task degree of concurrence and rhythm, and
Cost is relatively low, is easily accessed existing system.
Based on above-mentioned hardware configuration, task scheduling and managing method embodiment of the present invention is proposed.
It is the flow diagram of task scheduling and managing method first embodiment of the present invention referring to Fig. 2, Fig. 2.
In the first embodiment, the task scheduling and managing method the following steps are included:
Step S10, according to token bucket setting scheduling public library is preset, the scheduling public library is in running environment Node.js
Middle operation.
It should be noted that the default token bucket is for pre-set storage token and with constant rate output token
Bucket, the token in the default token bucket can be put into bucket with given pace, and each token operation source sends given pace
Bit, such as send a packet, flow regulator will be deleted and the equal-sized token of packet from the default token bucket
It counts, the token in token bucket can be not only removed, and can also equally be added inward, so in order to guarantee that interface has number at any time
According to passing through, just scheduling public library, the scheduling must be can be set by the default token bucket ceaselessly toward in bucket plus token
Public library is the pre-set public library for being scheduled to system task, and the scheduling public library is in running environment
It being run in Node.js, Node.js is a scripting language Javascript running environment (runtime environment),
Node.js be one based on Chrome JavaScript operation when the platform established, for easily build fast response time,
It is easy to the network application extended.
Further, the step S10 the following steps are included:
Obtain the corresponding token bucket algorithm of the default token bucket；
Target public library is cured as in the form of code according to the token bucket algorithm, using the target public library as institute
Scheduling public library is stated, the scheduling public library is run in running environment Node.js.
It should be understood that the token bucket algorithm be according to constant prefixed time interval into the default token bucket
The algorithm for adding token, is no longer added to if the default token bucket has been expired, and new request comes temporarily, can be corresponding defeated
Corresponding token out blocks if without token or refuses service；After the token bucket algorithm code, it can root
Target public library is cured as in the form of code according to the token bucket algorithm, the target public library is public as the scheduling
Library, the scheduling public library are run in running environment Node.js.
Step S20, the history for obtaining the scheduling public library dispatches resource consumption data, dispatches resource according to the history
Consumption data determines preset schedule strategy.
It is understood that the history scheduling resource consumption data are the scheduling public library in preset period of time
Resource consumption data are dispatched, the preset schedule strategy is pre-set scheduling strategy, can by the preset schedule strategy
In a manner of the management and running for determining scheduler task.
Step S30, management is scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy,
The target dispatch task-set is the set to scheduler task run based on Node.js.
It should be understood that can be to target dispatch task-set according to the scheduling public library and the preset schedule strategy
It is scheduled management, the target dispatch task-set is pre-set for storing the set of scheduler task, passes through the tune
Degree public library and preset schedule strategy are scheduled management to target dispatch task-set, being capable of the efficient efficiency of management.
The present embodiment dispatches public library, the scheduling public library through the above scheme, by being arranged according to default token bucket
It is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, according to the history
Scheduling resource consumption data determine preset schedule strategy；Target dispatch is appointed according to the scheduling public library and preset schedule strategy
Business collection is scheduled management, and the target dispatch task-set is the set to scheduler task run based on Node.js, Neng Gougao
The efficiency of management is imitated, resource utilization is improved, improves task execution efficiency, effective control task degree of concurrence and rhythm, and
Cost is relatively low, is easily accessed existing system.
Further, Fig. 3 is the flow diagram of task scheduling and managing method second embodiment of the present invention, as shown in figure 3,
Task scheduling and managing method second embodiment of the present invention is proposed based on first embodiment, in the present embodiment, the step S20,
Specifically includes the following steps:
Step S21, the history obtained in the scheduling public library dispatches resource consumption data, is dispatched and is provided according to the history
Source consumption data determines token volume residual.
It should be noted that dispatching resource consumption by the history for obtaining the scheduling public library in preset period of time
Data dispatch resource consumption data according to the history and determine token volume residual, i.e., dispatch resource consumption according to the history
Data can determine the corresponding quantity consumed of the token consumed, according to the quantity consumed, can determine that the scheduling is public
Still remaining token quantity in library altogether.
Further, the step S21 the following steps are included:
The corresponding history of the scheduling public library, which is obtained, by default public library calling interface dispatches resource consumption data；
History CPU consumption data and history memory consumption data are obtained from history scheduling resource consumption data, it is right
The history CPU consumption data and the history memory consumption data are analyzed, and token volume residual is obtained.
It should be understood that the default public library calling interface is pre-set calling interface, it is used for from the tune
Spending in public library calls history to dispatch resource consumption data, and the default public library calling interface can be with lower interface
Ticket.block (ms) // ms milliseconds of execution task of stopping；Ticket.add (more) // more token of increase is launched and is enabled
Board is for task progress；Ticket.setRateLimit (v) // setting task flank speed is no more than v；
Ticket.setWorkerLimit (v) // setting can currently run the worker quantity of task；ticket.run
(routine) // operation token bucket scheduling, scheduler task theme is routine call back function；Ticket.stop () // stopping
Ticket scheduling, can also be that other kinds of interface, the present embodiment are without restriction to this certainly.
It is understood that obtaining scheduler task library history by default public library calling interface dispatches resource consumption
Data dispatch resource consumption data according to the history and determine preset schedule strategy；It can obtain and use the scheduler task
The history CPU consumption data and history memory consumption data in library, to the history CPU consumption data and the history memory consumption
Data are analyzed, and determine token volume residual based on the analysis results.
Step S22, the current scheduling rate for obtaining current scheduling task in real time, by the token volume residual and default order
Board threshold value is compared, and obtains the first comparison result；The current scheduling rate and the preset task scheduling rates are carried out
Compare, obtains the second comparison result.
It is understood that the current scheduling rate is to dispatch the quantity of current scheduling task, by by the token
Volume residual is compared with the threshold token value, can obtain the first comparison result, according to the current scheduling rate and institute
It states preset task scheduling rates to be compared, the second comparison result can be obtained, can be determined according to first comparison result
The token quantity of current residual can determine the scheduling rates of current scheduling task according to second comparison result, thus root
Determine whether to be updated the scheduling public library with current scheduling rate according to still remaining token quantity.
Step S23, the preset schedule strategy is determined according to first comparison result and second comparison result.
It should be understood that determining the preset schedule plan according to first comparison result and second comparison result
Slightly, i.e., by the token volume residual compared with default threshold token value and the current scheduling rate and the preset task
The comparison test of scheduling rates determines the preset schedule strategy.
Further, the step S23 the following steps are included:
It is that the token volume residual is less than default threshold token value, and described second compares knot in first comparison result
When fruit is that the current scheduling rate is greater than the preset task scheduling rates, determine that the preset schedule strategy is currently to adjust
Degree task is cached；
It is that the token volume residual is greater than or equal to default threshold token value, and described second in first comparison result
When comparison result is that the current scheduling rate is greater than the preset task scheduling rates, the preset schedule strategy is determined to incite somebody to action
The current scheduling task is sent.
It, can it is understood that when the token volume residual is smaller, and when the current scheduling rate meets the requirements
To cache the current scheduling task, i.e., when current token surplus is less, sufficient token is not used at this time
Task schedule, therefore current scheduling task is cached, when waiting tokens quantity abundance, then it is scheduled.
It should be understood that when the token volume residual is greater than or equal to default threshold token value, i.e., current token
Volume residual is more sufficient, and current scheduling rate at this time meets the requirements, therefore at this time can be by the current scheduling task
It is sent；Conversely, proving tune at this time if the current scheduling rate is less than or equal to the preset task scheduling rates
It is inadequate to spend rate, is not enough to carry out task-scheduling operation, if therefore the current scheduling rate be less than or equal to described default appoint
Business scheduling rates, then without task-scheduling operation, until just carrying out task schedule when the current scheduling rate meets the requirements
Operation.
The present embodiment dispatches resource consumption data through the above scheme, by obtaining the history in the scheduling public library,
Resource consumption data, which are dispatched, according to the history determines token volume residual；The current scheduling speed of current scheduling task is obtained in real time
The token volume residual is compared by rate with default threshold token value, obtains the first comparison result；By the current scheduling speed
Rate is compared with the preset task scheduling rates, obtains the second comparison result；According to first comparison result and described
Second comparison result determines the preset schedule strategy, can the efficient efficiency of management, improve resource utilization, the task of improving holds
Line efficiency, effective control task degree of concurrence and rhythm, and cost is relatively low, is easily accessed existing system.
Further, Fig. 4 is the flow diagram of task scheduling and managing method 3rd embodiment of the present invention, as shown in figure 4,
Task scheduling and managing method 3rd embodiment of the present invention, in the present embodiment, the step S30 packet are proposed based on second embodiment
Include following steps:
Step S31, the task quantity for the waiting task for needing to be performed simultaneously in target dispatch task-set is obtained.
It should be noted that the waiting task for needing to be performed simultaneously in the target dispatch task-set needs to carry out simultaneously
The task of row processing may further determine that the scheduling of current task scheduling by obtaining the task quantity of parallel processing task
Mode.
Step S32, it obtains scheduling public library default while running number of tasks, it will be described default while running task
Number is compared with the task quantity.
It should be understood that described preset while running number of tasks as that can run simultaneously in pre-set scheduling public library
The quantity of row task can determine the target by will be described default while running number of tasks compared with the task quantity
Whether the task that scheduler task is concentrated can be scheduled management；It is described default while running number of tasks and can be and disappeared by CPU
Consumption and memory consumption determine, generally can be and dispatch the available institute of resource consumption data according to the history of the scheduling public library
History CPU consumption data and the history memory consumption data are stated, is disappeared to the history CPU consumption data and the history memory
Consumption data are analyzed, and are determined preset task scheduling rates based on the analysis results and are preset while running task quantity, certainly also
It can determine by other means described default while run number of tasks, the present embodiment is without restriction to this.
Step S33, be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy pair
Task in the target dispatch task-set is scheduled management.
The task quantity be less than it is described it is default run number of tasks simultaneously when, that is, show the token progress for having sufficient at this time
Therefore the scheduling of parallel task can be scheduled the task in the target dispatch task-set according to preset schedule strategy
Management, the method for determination of the target dispatch task-set can be according to preset matching rule to the task in goal task pond into
Row classification, the meeting the preset matching rule of the task is summarized, using summarized results as target dispatch task-set, certainly
It is also possible to determine the target dispatch task-set by other means, the present embodiment is without restriction to this；Having determined
It states to can use default queue after target dispatch task-set and cache in the target dispatch task-set and respectively invites me wait dispatch, it is described
Default queue can be priority query, custom queuing or Weighted Fair Queuing etc., and the present embodiment is without restriction to this.
Step S34, the task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, to the scheduling public affairs
Library is updated altogether, is scheduled according to updated scheduling public library to the task in the target dispatch task-set.
It is understood that being greater than or equal in the task quantity described default while when running number of tasks, show this
When there is no sufficient token to carry out parallel task scheduling increase newly therefore, it is necessary to be updated to the scheduling public library
Token it is recent, the task in the target dispatch task-set can be scheduled according to updated scheduling public library.
Further, the step S34 specifically includes the following steps:
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, open operation token bucket and dispatch and connects
Mouthful；
The default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；
Public library is dispatched according to updated default update of token bucket, according to updated scheduling public library to described
Task in target dispatch task-set is scheduled.
It is understood that the token bucket dispatch interface is the pre-set interface for scheduling token bucket, pass through
The token bucket dispatch interface can adjust back the default token bucket, and then complete the update to the default token bucket, according to
Updated default token bucket can update the scheduling public library, and then update the target dispatch task-set；
In the concrete realization, described default while when running number of tasks, Ke Yigen is greater than or equal in the task quantity
Stop executing corresponding goal task according to preset stopping calling interface, or can be increased according to default increase calling interface default
The newly-increased token is updated the scheduling public library, according to updated scheduling public library by the newly-increased token of quantity
The goal task is executed；The scheduling public library is updated described pre- as the newly-increased token to be added to
If in token bucket, dispatching public library according to updated default update of token bucket, unlatching operation token bucket tune is generally required
Interface is spent, the default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；Before needing using the default increase calling interface, need to open operation token bucket.The quantity of newly-increased token can be by
The Expenditure Levels of current CPU and memory determine, can increase inquiry acquisition in table newly according to default token is preset, described default
Token increases the mapping relations that table reflection token increases quantity and the Expenditure Levels of different degrees of CPU and memory newly newly, by current
The Expenditure Levels of CPU and memory, i.e. current scheduling resource consumption data can dynamically adjust newly-increased token, and then to concurrently appointing
The quantity of business carries out dynamic adjustment.
The present embodiment through the above scheme, passes through the waiting task for needing to be performed simultaneously in acquisition target dispatch task-set
Task quantity；Obtain scheduling public library default while running number of tasks, by it is described it is default run simultaneously number of tasks and
The task quantity compares；Be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy
Management is scheduled to the task in the target dispatch task-set；It is greater than or equal to described preset simultaneously in the task quantity
When running number of tasks, the scheduling public library is updated, the target dispatch is appointed according to updated scheduling public library
The task that business is concentrated is scheduled, and can dynamically adjust the quantity of scheduler task, and the efficient efficiency of management improves resource utilization,
Task execution efficiency, effective control task degree of concurrence and rhythm are improved, and cost is relatively low, is easily accessed existing system.
Based on the embodiment of above-mentioned task scheduling and managing method, the present invention further provides a kind of Portable Batch System dresses
It sets.
It is the functional block diagram of Portable Batch System device first embodiment of the present invention referring to Fig. 5, Fig. 5.
In Portable Batch System device first embodiment of the present invention, the Portable Batch System device include: setup module 10,
Tactful determining module 20 and scheduler module 30；
Wherein, the setup module 10, for according to token bucket setting scheduling public library is preset, the scheduling public library to exist
It is run in running environment Node.js.
It should be noted that the default token bucket is for pre-set storage token and with constant rate output token
Bucket, the token in the default token bucket can be put into bucket with given pace, and each token operation source sends given pace
Bit, such as send a packet, flow regulator will be deleted and the equal-sized token of packet from the default token bucket
It counts, the token in token bucket can be not only removed, and can also equally be added inward, so in order to guarantee that interface has number at any time
According to passing through, just scheduling public library, the scheduling must be can be set by the default token bucket ceaselessly toward in bucket plus token
Public library is the pre-set public library for being scheduled to system task, and the scheduling public library is in running environment
It being run in Node.js, Node.js is a scripting language Javascript running environment (runtime environment),
Node.js be one based on Chrome JavaScript operation when the platform established, for easily build fast response time,
It is easy to the network application extended.
Further, the setup module 10 includes:
Token bucket algorithm obtains module, for obtaining the corresponding token bucket algorithm of the default token bucket；
Public library curing module will for being cured as target public library in the form of code according to the token bucket algorithm
The target public library is run in running environment Node.js as the scheduling public library, the scheduling public library.
It should be understood that the token bucket algorithm be according to constant prefixed time interval into the default token bucket
The algorithm for adding token, is no longer added to if the default token bucket has been expired, and new request comes temporarily, can be corresponding defeated
Corresponding token out blocks if without token or refuses service；After the token bucket algorithm code, it can root
Target public library is cured as in the form of code according to the token bucket algorithm, the target public library is public as the scheduling
Library, the scheduling public library are run in running environment Node.js.
The strategy determining module 20, the history for obtaining the scheduling public library dispatch resource consumption data, according to
The history scheduling resource consumption data determine preset schedule strategy.
It is understood that the history scheduling resource consumption data are the scheduling public library in preset period of time
Resource consumption data are dispatched, the preset schedule strategy is pre-set scheduling strategy, can by the preset schedule strategy
In a manner of the management and running for determining scheduler task.
Further, the tactful determining module 20 includes:
Token quantity determining module dispatches resource consumption data for obtaining the history in the scheduling public library, according to
The history scheduling resource consumption data determine token volume residual.
It should be noted that dispatching resource consumption by the history for obtaining the scheduling public library in preset period of time
Data dispatch resource consumption data according to the history and determine token volume residual, i.e., dispatch resource consumption according to the history
Data can determine the corresponding quantity consumed of the token consumed, according to the quantity consumed, can determine that the scheduling is public
Still remaining token quantity in library altogether.
Further, the token quantity determining module includes:
Resource consumption obtains module, and for being obtained by default public library calling interface, the scheduling public library is corresponding to be gone through
History dispatches resource consumption data；
Data analysis module, for obtaining history CPU consumption data from history scheduling resource consumption data and going through
History memory consumption data analyze the history CPU consumption data and the history memory consumption data, and it is surplus to obtain token
Remainder amount.
It should be understood that the default public library calling interface is pre-set calling interface, it is used for from the tune
Spending in public library calls history to dispatch resource consumption data, and the default public library calling interface can be with lower interface
Ticket.block (ms) // ms milliseconds of execution task of stopping；Ticket.add (more) // more token of increase is launched and is enabled
Board is for task progress；Ticket.setRateLimit (v) // setting task flank speed is no more than v；
Ticket.setWorkerLimit (v) // setting can currently run the worker quantity of task；ticket.run
(routine) // operation token bucket scheduling, scheduler task theme is routine call back function；Ticket.stop () // stopping
Ticket scheduling, can also be that other kinds of interface, the present embodiment are without restriction to this certainly.
It is understood that obtaining scheduler task library history by default public library calling interface dispatches resource consumption
Data dispatch resource consumption data according to the history and determine preset schedule strategy；It can obtain and use the scheduler task
The history CPU consumption data and history memory consumption data in library, to the history CPU consumption data and the history memory consumption
Data are analyzed, and determine token volume residual based on the analysis results.
Further, the token quantity determining module further include:
Comparison module, for obtaining the current scheduling rate of current scheduling task in real time, by the token volume residual with
Default threshold token value is compared, and obtains the first comparison result；By the current scheduling rate and preset task scheduling speed
Rate is compared, and obtains the second comparison result.
It is understood that the current scheduling rate is to dispatch the quantity of current scheduling task, by by the token
Volume residual is compared with the threshold token value, can obtain the first comparison result, according to the current scheduling rate and institute
It states preset task scheduling rates to be compared, the second comparison result can be obtained, can be determined according to first comparison result
The token quantity of current residual can determine the scheduling rates of current scheduling task according to second comparison result, thus root
Determine whether to be updated the scheduling public library with current scheduling rate according to still remaining token quantity.
Comparison strategy determining module, it is described pre- for being determined according to first comparison result and second comparison result
If scheduling strategy.
It should be understood that determining the preset schedule plan according to first comparison result and second comparison result
Slightly, i.e., by the token volume residual compared with default threshold token value and the current scheduling rate and the preset task
The comparison test of scheduling rates determines the preset schedule strategy.
Further, the comparison strategy determining module includes:
Cache module, for being the token volume residual less than default threshold token value in first comparison result, and
When second comparison result is that the current scheduling rate is greater than the preset task scheduling rates, the preset schedule is determined
Strategy is to cache current scheduling task；
Sending module, for being that the token volume residual is greater than or equal to default token threshold in first comparison result
Value, and second comparison result be the current scheduling rate be greater than the preset task scheduling rates when, determine described pre-
If scheduling strategy is to send the current scheduling task.
It, can it is understood that when the token volume residual is smaller, and when the current scheduling rate meets the requirements
To cache the current scheduling task, i.e., when current token surplus is less, sufficient token is not used at this time
Task schedule, therefore current scheduling task is cached, when waiting tokens quantity abundance, then it is scheduled.
It should be understood that when the token volume residual is greater than or equal to default threshold token value, i.e., current token
Volume residual is more sufficient, and current scheduling rate at this time meets the requirements, therefore at this time can be by the current scheduling task
It is sent；Conversely, proving tune at this time if the current scheduling rate is less than or equal to the preset task scheduling rates
It is inadequate to spend rate, is not enough to carry out task-scheduling operation, if therefore the current scheduling rate be less than or equal to described default appoint
Business scheduling rates, then without task-scheduling operation, until just carrying out task schedule when the current scheduling rate meets the requirements
Operation.
The scheduler module 30, for according to the scheduling public library and preset schedule strategy to target dispatch task-set into
Row management and running, the target dispatch task-set are the set to scheduler task run based on Node.js.
It should be understood that can be to target dispatch task-set according to the scheduling public library and the preset schedule strategy
It is scheduled management, the target dispatch task-set is pre-set for storing the set of scheduler task, passes through the tune
Degree public library and preset schedule strategy are scheduled management to target dispatch task-set, being capable of the efficient efficiency of management.
Further, the scheduler module 30 includes:
Task quantity determining module, for obtaining appointing for the waiting task for needing to be performed simultaneously in target dispatch task-set
Business quantity.
It should be noted that the waiting task for needing to be performed simultaneously in the target dispatch task-set needs to carry out simultaneously
The task of row processing may further determine that the scheduling of current task scheduling by obtaining the task quantity of parallel processing task
Mode.
Quantity comparison module will be described default same for obtaining the default of the scheduling public library while running number of tasks
Shi Yunhang number of tasks is compared with the task quantity.
It should be understood that described preset while running number of tasks as that can run simultaneously in pre-set scheduling public library
The quantity of row task can determine the target by will be described default while running number of tasks compared with the task quantity
Whether the task that scheduler task is concentrated can be scheduled management；It is described default while running number of tasks and can be and disappeared by CPU
Consumption and memory consumption determine, generally can be and dispatch the available institute of resource consumption data according to the history of the scheduling public library
History CPU consumption data and the history memory consumption data are stated, is disappeared to the history CPU consumption data and the history memory
Consumption data are analyzed, and are determined preset task scheduling rates based on the analysis results and are preset while running task quantity, certainly also
It can determine by other means described default while run number of tasks, the present embodiment is without restriction to this.
Dispatching management module, for the task quantity be less than it is described it is default run number of tasks simultaneously when, according to presetting
Scheduling strategy is scheduled management to the task in the target dispatch task-set.
The task quantity be less than it is described it is default run number of tasks simultaneously when, that is, show the token progress for having sufficient at this time
Therefore the scheduling of parallel task can be scheduled the task in the target dispatch task-set according to preset schedule strategy
Management, the method for determination of the target dispatch task-set can be according to preset matching rule to the task in goal task pond into
Row classification, the meeting the preset matching rule of the task is summarized, using summarized results as target dispatch task-set, certainly
It is also possible to determine the target dispatch task-set by other means, the present embodiment is without restriction to this；Having determined
It states to can use default queue after target dispatch task-set and cache in the target dispatch task-set and respectively invites me wait dispatch, it is described
Default queue can be priority query, custom queuing or Weighted Fair Queuing etc., and the present embodiment is without restriction to this.
Update module, it is described default while when running number of tasks for being greater than or equal in the task quantity, to described
Scheduling public library is updated, and is adjusted according to updated scheduling public library to the task in the target dispatch task-set
Degree.
It is understood that being greater than or equal in the task quantity described default while when running number of tasks, show this
When there is no sufficient token to carry out parallel task scheduling increase newly therefore, it is necessary to be updated to the scheduling public library
Token it is recent, the task in the target dispatch task-set can be scheduled according to updated scheduling public library.
Further, the update module includes:
Token bucket dispatch interface, it is described default while when running number of tasks for being greater than or equal in the task quantity,
Open operation token bucket dispatch interface；
Callback module is completed for adjusting back the default token bucket according to the operation token bucket dispatch interface to described
The update of default token bucket；
Update of token bucket module, for dispatching public library according to updated default update of token bucket, according to update
Scheduling public library afterwards is scheduled the task in the target dispatch task-set.
It is understood that the token bucket dispatch interface is the pre-set interface for scheduling token bucket, pass through
The token bucket dispatch interface can adjust back the default token bucket, and then complete the update to the default token bucket, according to
Updated default token bucket can update the scheduling public library, and then update the target dispatch task-set；
In the concrete realization, described default while when running number of tasks, Ke Yigen is greater than or equal in the task quantity
Stop executing corresponding goal task according to preset stopping calling interface, or can be increased according to default increase calling interface default
The newly-increased token is updated the scheduling public library, according to updated scheduling public library by the newly-increased token of quantity
The goal task is executed；The scheduling public library is updated described pre- as the newly-increased token to be added to
If in token bucket, dispatching public library according to updated default update of token bucket, unlatching operation token bucket tune is generally required
Interface is spent, the default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；Before needing using the default increase calling interface, need to open operation token bucket.The quantity of newly-increased token can be by
The Expenditure Levels of current CPU and memory determine, can increase inquiry acquisition in table newly according to default token is preset, described default
Token increases the mapping relations that table reflection token increases quantity and the Expenditure Levels of different degrees of CPU and memory newly newly, by current
The Expenditure Levels of CPU and memory, i.e. current scheduling resource consumption data can dynamically adjust newly-increased token, and then to concurrently appointing
The quantity of business carries out dynamic adjustment.
The present embodiment dispatches public library, the scheduling public library through the above scheme, by being arranged according to default token bucket
It is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, according to the history
Scheduling resource consumption data determine preset schedule strategy；Target dispatch is appointed according to the scheduling public library and preset schedule strategy
Business collection is scheduled management, and the target dispatch task-set is the set to scheduler task run based on Node.js, Neng Gougao
The efficiency of management is imitated, resource utilization is improved, improves task execution efficiency, effective control task degree of concurrence and rhythm, and
Cost is relatively low, is easily accessed existing system.
In addition, the embodiment of the present invention also proposes a kind of storage medium, Portable Batch System is stored on the storage medium
Program realizes following operation when the Portable Batch System program is executed by processor:
Scheduling public library is set according to default token bucket, the scheduling public library is run in running environment Node.js；
The history scheduling resource consumption data for obtaining the scheduling public library, dispatch resource consumption data according to the history
Determine preset schedule strategy；
Management, the target are scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy
Scheduler task collection is the set to scheduler task run based on Node.js.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
Obtain the corresponding token bucket algorithm of the default token bucket；
Target public library is cured as in the form of code according to the token bucket algorithm, using the target public library as institute
Scheduling public library is stated, the scheduling public library is run in running environment Node.js.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
The history scheduling resource consumption data in the scheduling public library are obtained, resource consumption number is dispatched according to the history
According to determining token volume residual；
The current scheduling rate for obtaining current scheduling task in real time, by the token volume residual and default threshold token value into
Row compares, and obtains the first comparison result；The current scheduling rate is compared with the preset task scheduling rates, is obtained
Second comparison result；
The preset schedule strategy is determined according to first comparison result and second comparison result.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
It is that the token volume residual is less than default threshold token value, and described second compares knot in first comparison result
When fruit is that the current scheduling rate is greater than the preset task scheduling rates, determine that the preset schedule strategy is currently to adjust
Degree task is cached；
It is that the token volume residual is greater than or equal to default threshold token value, and described second in first comparison result
When comparison result is that the current scheduling rate is greater than the preset task scheduling rates, the preset schedule strategy is determined to incite somebody to action
The current scheduling task is sent.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
The corresponding history of the scheduling public library, which is obtained, by default public library calling interface dispatches resource consumption data；
History CPU consumption data and history memory consumption data are obtained from history scheduling resource consumption data, it is right
The history CPU consumption data and the history memory consumption data are analyzed, and token volume residual is obtained.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
Obtain the task quantity for the waiting task for needing to be performed simultaneously in target dispatch task-set；
Obtain scheduling public library default while running number of tasks, by it is described default and meanwhile run number of tasks with it is described
Task quantity compares；
Be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy to the target
The task that scheduler task is concentrated is scheduled management；
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, to scheduling public library progress
It updates, the task in the target dispatch task-set is scheduled according to updated scheduling public library.
Further, following operation is also realized when the Portable Batch System program is executed by processor:
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, open operation token bucket and dispatch and connects
Mouthful；
The default token bucket is adjusted back according to the operation token bucket dispatch interface, is completed to the default token bucket more
Newly；
Public library is dispatched according to updated default update of token bucket, according to updated scheduling public library to described
Task in target dispatch task-set is scheduled.
The present embodiment dispatches public library, the scheduling public library through the above scheme, by being arranged according to default token bucket
It is run in running environment Node.js；The history scheduling resource consumption data for obtaining the scheduling public library, according to the history
Scheduling resource consumption data determine preset schedule strategy；Target dispatch is appointed according to the scheduling public library and preset schedule strategy
Business collection is scheduled management, and the target dispatch task-set is the set to scheduler task run based on Node.js, Neng Gougao
The efficiency of management is imitated, resource utilization is improved, improves task execution efficiency, effective control task degree of concurrence and rhythm, and
Cost is relatively low, is easily accessed existing system.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of task scheduling and managing method, which is characterized in that the described method includes:
Scheduling public library is set according to default token bucket, the scheduling public library is run in running environment Node.js；
The history scheduling resource consumption data for obtaining the scheduling public library, dispatch resource consumption data according to the history and determine
Preset schedule strategy；
Management, the target dispatch are scheduled to target dispatch task-set according to the scheduling public library and preset schedule strategy
Task-set is the set to scheduler task run based on Node.js.
2. the method as described in claim 1, which is characterized in that the basis presets token bucket setting scheduling public library, described
The step of scheduling public library is run in running environment Node.js, comprising:
Obtain the corresponding token bucket algorithm of the default token bucket；
Target public library is cured as in the form of code according to the token bucket algorithm, using the target public library as the tune
Public library is spent, the scheduling public library is run in running environment Node.js.
3. method according to claim 2, which is characterized in that the history scheduling resource for obtaining the scheduling public library disappears
Data are consumed, the step that resource consumption data determine preset schedule strategy is dispatched according to the history, comprising:
The history scheduling resource consumption data in the scheduling public library are obtained, it is true that resource consumption data are dispatched according to the history
Determine token volume residual；
The current scheduling rate for obtaining current scheduling task in real time, the token volume residual is compared with default threshold token value
Compared with the first comparison result of acquisition；The current scheduling rate is compared with the preset task scheduling rates, obtains second
Comparison result；
The preset schedule strategy is determined according to first comparison result and second comparison result.
4. method as claimed in claim 3, which is characterized in that described to be compared according to first comparison result and described second
As a result the step of the preset schedule strategy is determined, comprising:
It is that the token volume residual is less than default threshold token value, and second comparison result is in first comparison result
When the current scheduling rate is greater than the preset task scheduling rates, determine that the preset schedule strategy is to appoint current scheduling
Business is cached；
It is that the token volume residual is greater than or equal to default threshold token value, and described second compares in first comparison result
When being as a result greater than the preset task scheduling rates for the current scheduling rate, determining that the preset schedule strategy is will be described
Current scheduling task is sent.
5. method as claimed in claim 4, which is characterized in that the history obtained in the scheduling public library dispatches resource
Consumption data dispatches the step of resource consumption data determine token volume residual according to the history, comprising:
The corresponding history of the scheduling public library, which is obtained, by default public library calling interface dispatches resource consumption data；
History CPU consumption data and history memory consumption data are obtained from history scheduling resource consumption data, to described
History CPU consumption data and the history memory consumption data are analyzed, and token volume residual is obtained.
6. method as claimed in claim 5, which is characterized in that described according to the scheduling public library and preset schedule strategy pair
Target dispatch task-set is scheduled management, and the target dispatch task-set is to be run based on Node.js to scheduler task
The step of set, comprising:
Obtain the task quantity for the waiting task for needing to be performed simultaneously in target dispatch task-set；
It obtains scheduling public library default while running number of tasks, it will be described default while running number of tasks and the task
Quantity compares；
Be less than in the task quantity it is described default while when running number of tasks, according to preset schedule strategy to the target dispatch
Task in task-set is scheduled management；
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, more to scheduling public library progress
Newly, the task in the target dispatch task-set is scheduled according to updated scheduling public library.
7. method as claimed in claim 6, which is characterized in that described to be greater than or equal to described preset together in the task quantity
When Shi Yunhang number of tasks, the scheduling public library is updated, according to updated scheduling public library to the target dispatch
The step of task in task-set is scheduled, comprising:
The task quantity be greater than or equal to it is described it is default run number of tasks simultaneously when, open and run token bucket dispatch interface；
The default token bucket is adjusted back according to the operation token bucket dispatch interface, completes the update to the default token bucket；
Public library is dispatched according to updated default update of token bucket, according to updated scheduling public library to the target
The task that scheduler task is concentrated is scheduled.
8. a kind of Portable Batch System device, which is characterized in that described device includes: setup module, tactful determining module and tune
Spend module；
Wherein, the setup module, for according to token bucket setting scheduling public library is preset, the scheduling public library to be in operation ring
It is run in the Node.js of border；
The strategy determining module, the history for obtaining the scheduling public library are dispatched resource consumption data, are gone through according to described
History scheduling resource consumption data determine preset schedule strategy；
The scheduler module, for being scheduled according to the scheduling public library and preset schedule strategy to target dispatch task-set
Management, the target dispatch task-set is the set to scheduler task run based on Node.js.
9. a kind of Portable Batch System equipment, which is characterized in that the Portable Batch System equipment includes: memory, processor
And it is stored in the Portable Batch System program that can be run on the memory and on the processor, the Portable Batch System
Program is arranged for carrying out the step of task scheduling and managing method as described in any one of claims 1 to 7.
10. a kind of storage medium, which is characterized in that be stored with Portable Batch System program, the task on the storage medium
Realizing the task scheduling and managing method as described in any one of claims 1 to 7 when management and running program is executed by processor
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910205701.1A CN110058941A (en) | 2019-03-16 | 2019-03-16 | Task scheduling and managing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910205701.1A CN110058941A (en) | 2019-03-16 | 2019-03-16 | Task scheduling and managing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110058941A true CN110058941A (en) | 2019-07-26 |
Family
ID=67317084
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910205701.1A Pending CN110058941A (en) | 2019-03-16 | 2019-03-16 | Task scheduling and managing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110058941A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111880919A (en) * | 2020-07-29 | 2020-11-03 | 平安国际融资租赁有限公司 | Data scheduling method, system and computer equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6011798A (en) * | 1997-08-15 | 2000-01-04 | Intel Corporation | Adaptive transmit rate control scheduler |
| US20140379506A1 (en) * | 2013-06-25 | 2014-12-25 | Amazon Technologies, Inc. | Token-based pricing policies for burst-mode operations |
| CN106982268A (en) * | 2016-01-18 | 2017-07-25 | 腾讯科技（北京）有限公司 | A kind of information processing method and server |
| US20170249104A1 (en) * | 2016-02-25 | 2017-08-31 | SK Hynix Inc. | Memory controller and request scheduling method using the same |
| CN107222358A (en) * | 2016-03-21 | 2017-09-29 | 深圳市中兴微电子技术有限公司 | Wrap flux monitoring method per second and device |
| CN107634913A (en) * | 2017-08-22 | 2018-01-26 | 中国电子科技集团公司第五十四研究所 | A kind of service traffics control and the satellite borne equipment system of Differentiated Services |
| CN108366020A (en) * | 2018-02-02 | 2018-08-03 | 网宿科技股份有限公司 | A kind of method and system of the acquisition request of transmission data resource |
-
2019
- 2019-03-16 CN CN201910205701.1A patent/CN110058941A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6011798A (en) * | 1997-08-15 | 2000-01-04 | Intel Corporation | Adaptive transmit rate control scheduler |
| US20140379506A1 (en) * | 2013-06-25 | 2014-12-25 | Amazon Technologies, Inc. | Token-based pricing policies for burst-mode operations |
| CN106982268A (en) * | 2016-01-18 | 2017-07-25 | 腾讯科技（北京）有限公司 | A kind of information processing method and server |
| US20170249104A1 (en) * | 2016-02-25 | 2017-08-31 | SK Hynix Inc. | Memory controller and request scheduling method using the same |
| CN107222358A (en) * | 2016-03-21 | 2017-09-29 | 深圳市中兴微电子技术有限公司 | Wrap flux monitoring method per second and device |
| CN107634913A (en) * | 2017-08-22 | 2018-01-26 | 中国电子科技集团公司第五十四研究所 | A kind of service traffics control and the satellite borne equipment system of Differentiated Services |
| CN108366020A (en) * | 2018-02-02 | 2018-08-03 | 网宿科技股份有限公司 | A kind of method and system of the acquisition request of transmission data resource |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111880919A (en) * | 2020-07-29 | 2020-11-03 | 平安国际融资租赁有限公司 | Data scheduling method, system and computer equipment |
| CN111880919B (en) * | 2020-07-29 | 2024-04-02 | 平安国际融资租赁有限公司 | Data scheduling method, system and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106055395B (en) | Deadline constrains workflow schedule method in a kind of cloud environment based on ant colony optimization algorithm | |
| CN104572307B (en) | The method that a kind of pair of virtual resource carries out flexible scheduling | |
| Zhu et al. | Scheduling stochastic multi-stage jobs to elastic hybrid cloud resources | |
| CN110990138B (en) | Resource scheduling method, device, server and storage medium | |
| CN108628674A (en) | Method for scheduling task, cloud platform based on cloud platform and computer storage media | |
| CN110413391A (en) | Deep learning task service method for ensuring quality and system based on container cluster | |
| CN110389816B (en) | Method, apparatus and computer readable medium for resource scheduling | |
| CN107193652B (en) | The flexible resource dispatching method and system of flow data processing system in container cloud environment | |
| CN103873587B (en) | A kind of method and device that scheduling is realized based on cloud platform | |
| CN110221901A (en) | Container asset creation method, apparatus, equipment and computer readable storage medium | |
| CN115248728A (en) | Distributed training task scheduling method, system and device for intelligent computing | |
| CN110058924A (en) | A kind of container dispatching method of multiple-objection optimization | |
| CN109857551A (en) | Dispatching method and device, the electronic equipment of Service Source based on cloud computing | |
| CN111782355A (en) | Cloud computing task scheduling method and system based on mixed load | |
| Shin et al. | Dynamic voltage scaling of periodic and aperiodic tasks in priority-driven systems | |
| CN110502321A (en) | A kind of resource regulating method and system | |
| CN109542608A (en) | A kind of cloud artificial tasks dispatching method based on mixing queuing network | |
| CN106648831B (en) | Cloud workflow schedule method based on glowworm swarm algorithm and dynamic priority | |
| Down et al. | The N-network model with upgrades | |
| Li et al. | Endpoint-flexible coflow scheduling across geo-distributed datacenters | |
| CN106407007B (en) | Cloud resource configuration optimization method for elastic analysis process | |
| Tran et al. | Multi-stage resource-aware scheduling for data centers with heterogeneous servers | |
| CN110058941A (en) | Task scheduling and managing method, device, equipment and storage medium | |
| CN109976873A (en) | The scheduling scheme acquisition methods and dispatching method of containerization distributed computing framework | |
| CN105426247A (en) | HLA federate planning and scheduling method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |