CN108762900A - High frequency method for scheduling task, system, computer equipment and storage medium - Google Patents
High frequency method for scheduling task, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN108762900A CN108762900A CN201810485941.7A CN201810485941A CN108762900A CN 108762900 A CN108762900 A CN 108762900A CN 201810485941 A CN201810485941 A CN 201810485941A CN 108762900 A CN108762900 A CN 108762900A
- Authority
- CN
- China
- Prior art keywords
- scheduling
- task
- database
- timed task
- high frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to dispatching technique field more particularly to a kind of method for scheduling task, system, computer equipment and storage mediums.Method for scheduling task includes：Dispatch server calls default timed task frame in the database, is timed task scheduling, and timed task frame is preset with timed task, and timed task is configured with task definition, scheduling rule and scheduling information, and scheduling information stores in the database.Dispatch server configuration schedules routine interface modifies to the scheduling rule and scheduling information of timed task, and dispatcher interface is encapsulated as api interface and is placed in django engineerings.Dispatch server configuration monitoring device carries out SQL query to database according to scheduled monitor mode, is notified after obtaining monitored results.The technical program is used as new scheduling engine by introducing timed task frame, is configured according to timed task and starts task scheduling, the high frequency task scheduling of support minute, even second rank.
Description
Technical field
The present invention relates to dispatching technique field more particularly to a kind of method for scheduling task, system, computer equipment and storages
Medium.
Background technology
Task scheduling refers to being based on given point in time, and given interval or the given number that executes execute task automatically.
In enterprise-level application, often formulate some plan targets, i.e., at some time point in do something, core be with when be
Focus, i.e., a specific time point, system executes a specified operation, and task scheduling is related to multi-thread concurrent, line
Cheng Chi maintenances, the protection of run time rule parsing, operation scene are to restore etc..Existing task scheduling mode mainly has
Task scheduling under task scheduling under MapReduce frames, the task scheduling based on particle cluster algorithm, cloud computing environment and void
Quasi- machine is integrated and timed task dispatching service system.
Though these above-mentioned task scheduling modes can realize task scheduling, these task scheduling platforms be all only capable of with when be
Focus can only set the task scheduling using hour as rank, can not support the high frequency task with minute rank or second rank
Scheduling causes setting number limited, and the task execution stand-by period is longer, can not be scheduled task in time, can not issue minute
The task of rank or second rank also limits the application scenarios of dispatching platform.
Invention content
In view of this, it is necessary to for the Mission Scheduling that can only be set in the prior art using hour as rank, provide
A kind of high frequency method for scheduling task, system, computer equipment and storage medium.
A kind of high frequency method for scheduling task, the high frequency method for scheduling task include：
Dispatch server calls default timed task frame in the database, is timed task scheduling, the timing
Task framework is preset with timed task, and the timed task is configured with task definition, scheduling rule and scheduling information, scheduling information
Storage is in the database；
Dispatch server configuration schedules routine interface appoints any timing in timed task frame by dispatcher interface
The scheduling rule and scheduling information of business are modified, and dispatcher interface is encapsulated as api interface and is placed in django engineerings；
Dispatch server configuration monitoring device, the monitor is according to scheduled monitor mode to being stored with the number of scheduling information
SQL query is carried out according to library, is notified after obtaining monitored results.
The dispatch server is by calling configure tools to install python automatically in one of the embodiments,
Program, the timed task frame are included in the python programs, i.e. the setting of completion timing task framework.
When scheduling information stores in one of the embodiments, ORM tools, scheduling clothes are preset in dispatch server
Device be engaged in by calling ORM tools to read scheduling information, is written in database in the form of scheduled digitization, that is, completes scheduling information
Storage.
The monitor mode is monitored using setting polling time interval in one of the embodiments,；
The monitored results are the exception information in database, including error information when scheduler task, time-out information, institute
Monitored results are stated to be notified by way of mail or phone.
Also include in one of the embodiments, scheduler modules, the dispatch server in the python programs
Using the reschedule_job interfaces of scheduler modules as dispatcher interface, complete to scheduling rule and scheduling information
Modification.
The database uses relevant database, non-relational database or memory number in one of the embodiments,
According to library.
The scheduling rule includes scheduling mode in one of the embodiments, and the scheduling mode includes blocking model
Or asynchronous mode, the dispatch server complete the modification to scheduling mode by the dispatcher interface.
A kind of high frequency task scheduling system, the high frequency task scheduling system include：
Timed task dispensing unit calls default timed task frame in the database for dispatch server, carries out
Timed task is dispatched, and the timed task frame is preset with timed task, and the timed task is configured with task definition, scheduling rule
Then stored in the database with scheduling information, scheduling information；
Interface dispensing unit is used for dispatch server configuration schedules routine interface, is appointed to timing by dispatcher interface
The scheduling rule and scheduling information of any timed task are modified in business frame, and dispatcher interface is encapsulated as api interface
It is placed in django engineerings；
Monitoring unit is used for dispatch server configuration monitoring device, and the monitor is according to scheduled monitor mode to storage
There is the database of scheduling information to carry out SQL query, is notified after obtaining monitored results.
A kind of computer equipment, including database and processor are stored with computer-readable instruction in the database, institute
When stating computer-readable instruction and being executed by the processor so that the processor executes the step of above-mentioned high frequency method for scheduling task
Suddenly.
A kind of storage medium being stored with computer-readable instruction, the computer-readable instruction are handled by one or more
When device executes so that one or more processors execute the step of above-mentioned high frequency method for scheduling task.
Above-mentioned high frequency method for scheduling task, device, computer equipment and storage medium, including dispatch server are called and are preset
Timed task frame in the database, is timed task scheduling, and timed task frame is preset with timed task, timed task
Configured with task definition, scheduling rule and scheduling information, scheduling information stores in the database；Dispatch server configuration schedules journey
Sequence interface repaiies the scheduling rule and scheduling information of any timed task in timed task frame by dispatcher interface
Change, dispatcher interface is encapsulated as api interface and is placed in django engineerings；Dispatch server configuration monitoring device, monitor
SQL query is carried out to the database for being stored with scheduling information according to scheduled monitor mode, is notified after obtaining monitored results.
The technical program is used as new scheduling engine by introducing timed task frame, is configured according to timed task and starts task scheduling,
The high frequency task scheduling of support minute, even second rank；Database realizing scheduling information persistence is written into scheduling information；
Dynamic modification task scheduling frequency is realized by api interface, by the task scheduling in a manner of support timing, time interval etc.；It introduces
Monitor is realized to the real time monitoring of scheduling process, finds in time and change the problem in task scheduling.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field
Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention
Limitation.
Fig. 1 is the flow chart of the high frequency method for scheduling task in one embodiment of the invention；
Fig. 2 is the flow chart of the newly-increased timed task in one embodiment of the invention；
Fig. 3 is the structure chart of the high frequency task scheduling system in one embodiment of the invention.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that is used in the specification of the present invention arranges
It refers to there are the feature, integer, step, operation, element and/or component, but it is not excluded that presence or addition to take leave " comprising "
Other one or more features, integer, step, operation, element, component and/or their group.
Fig. 1 is the flow chart of the high frequency method for scheduling task in one embodiment of the invention, as shown in Figure 1, a kind of high frequency
Method for scheduling task includes the following steps：
Step S1, dispatch server calls default timed task frame in the database, is timed task scheduling, fixed
When task framework be preset with timed task, timed task is configured with task definition, scheduling rule and scheduling information, and scheduling information is deposited
Storage is in the database.
Dispatch server in the present embodiment can select Linux server.Linux server is a kind of using Linux
The network server of system is used for business processing application, such as network and system management, data base administration and Web service, is tool
A kind of server of standby high-performance and increasing income property.Linux server has splendid system stability, safety, due to using
Multi-user operating system, therefore the flexibility having had and scalability, no matter processor or machine architecture can well into
Receiving in row resource.Software in Linux server is free, thus Linux server can more save in application and development
Cost.Most of customer service can carry out more free exploitation with linux system to business.
New scheduling engine is introduced in Linux server, i.e., has preset being used for timed task tune in Linux server
The timed task frame of degree.It, can be fixed by calling the automatic installation kit of configure tools to contain when Linux server is preset
When task framework python programs, it is automatic that timed task frame is installed.Linux server starts timed task framework functions
Before, several timed tasks can be increased newly as needed in Linux server, its corresponding is configured for each timed task
Business content, scheduling rule and scheduling information.Wherein, task definition is task execution code, and scheduling rule is task triggering mode,
Scheduling information is the Scheduling content after task triggering.After having configured timed task, Linux server starts timed task frame,
Each timed task can execute corresponding scheduling information according to its scheduling rule by task definition.
When as different such as dispatch server selection, when timed task frame is installed, it need to only pass through the ring of modification operating system
Timed task frame is installed to selected dispatch server and mapping out the work for timed task frame can be completed by border variable.
Timed task frame acquiescence storage be simply scheduling information preserve in memory, when program midway stop or
When person's system runs quickly routed, the scheduling information of all operations can all lose.For example a certain timed task needs to execute 100 times, if held
Row is to system crash at 50 times, and the execution counter of task will be since 0 when system reboot.Therefore the present embodiment believes scheduling
In the database, after database preserves scheduling information, even if being restarted after system crash, the scheduling of timed task is believed for breath storage
Breath can still be restored, and in previous example, task needs to execute 100 times, if heavy after system crash when going to 50 times
New operation, counter will be started counting up from 51, and the present embodiment has used database preservation scheduling information to realize scheduling information and held
Longization.
Preserve scheduling information database can select relevant database PostgreSQL, PostgreSQL be one from
By Object-relational Database server (data base management system), PostgreSQL provides other opposite open source codes
Database Systems (such as MySQL and Firebird) and proprietary system (such as Oracle, Sybase and Microsoft SQL
Server another selection except).PostgreSQL can be used for C/S (client/server) environment, PostgreSQL installations
Core is database service end process, need to access storage data in the database application program must by database into
Journey, such client-side program can not directly access data.PostgreSQL support space querying, support all size text,
Support server side scripts, included full-text search function.The scheduling information storages of PostgreSQL in this present embodiment, after being
It is convenient that continuous modification scheduling rule and scheduling information and SQL query provide.
Non-relational database MongoDB can be selected by preserving the database of scheduling information.MongoDB can quick, peace
Complete and automation realization node or data center's failure transfer.Although MongoDB does not support affairs, its insertion speed is non-
Often fast, in view of the weak data structure pattern of MongoDB, 1 newer field of addition will not have old table any influence, therefore entire
Process can very quickly.When application program changes, does not need special database administrator yet and remove modification database mould
Formula.In addition, MongoDB is suitble to the persistence of class, class that can be serialized into JSON and be stored in MongoDB.Therefore, in this reality
It applies in example, when timed task needs to load the business datum of a large amount of low values, for example when log collection, selects MongoDB that can obtain
To efficient storage speed.
Memory database Redis can also be selected by preserving the database of scheduling information.Redis is a use increased income
ANSI C languages write, support network, can based on memory also can persistence log type, Key-Value databases, and provide more
The API of kind language.It supports numerous value storage classes, including string (character string), list (chained list), set (collection
Close), zset (sorted set-- ordered sets) and hash (Hash type).Redis supports different unordered, orderly lists,
The advanced server end atomic operation such as intersection, union between unordered, orderly set.Redis also supports that master-slave synchronisation, data can
Can be associated with other main services from server from server to be synchronized from server from master server to any number of
Device, this makes Redis can perform single layer tree copying.Timed task in the present embodiment is when for example storage class is complex, selection
Redis can obtain preferably storing operation.
Step S2, dispatch server configuration schedules routine interface, by dispatcher interface to appointing in timed task frame
The scheduling rule and scheduling information of one timed task are modified, and dispatcher interface is encapsulated as api interface and is placed on
In django engineerings.
In order to realize dynamic modification task scheduling rule and scheduling information, appointing in a manner of support timing, time interval etc.
Business scheduling, the present embodiment are additionally arranged dispatcher interface, complete the modification to scheduling rule and scheduling information by the interface, such as
The primary task of scheduling in original 3 minutes, can be modified as 5 minutes once by dispatcher interface.
Api interface is a kind of open interface, and foreground can realize inquiry, the additions and deletions to database by calling api interface
Change, reduce the coupling of intermodule, improve the flexibility of database, changed convenient for system upgrade, therefore for the ease of modification, adjusts
Degree routine interface is encapsulated as api interface.
Django is the Web application frameworks of an open source code, and the api interface of encapsulation is placed in django engineerings
After calling, the opening of api interface is realized, when needing to change scheduling rule or scheduling information, is by Web application calls
It can complete to change, change and its conveniently.
Step S3, dispatch server configuration monitoring device, monitor is according to scheduled monitor mode to being stored with scheduling information
Database carry out SQL query, obtain monitored results after notified.
Using developed application supervision platform and third party's monitoring tools, wherein third party supervises monitor in this step
Control tool can be configured by web interface, realize monitoring purpose.For example, SQL may be used in the monitor in this step
Server database monitoring softwares are realized the real time monitoring to data in database and are divided in order to use SQL query database
Analysis.Monitor mode may be used setting polling time interval and be monitored.Time interval can be as needed, set with hour as
Unit is monitored for one day for unit.
SQL is a kind of abbreviation to structured query language, is a kind of data base querying and programming language, for depositing
Access according to this and inquiry, update and administrative relationships Database Systems, while be also database script file extension name.It allows
User works in high level data structure, does not require the specified deposit method to data of user, does not also need user and understands specifically
Data location mode, so with entirely different fabric disparate databases system, identical structuring can be used
Query language inputs the interface with management as data.Structured query language sentence can be nested, and it is great that this makes it have
Flexibility and powerful function.The present embodiment monitors database in real time using SQL query, can find and change to appoint in time
The exception occurred in business scheduling.
The present embodiment realizes higher frequency task scheduling, database is written in scheduling information by introducing new scheduling engine
Mode, realize scheduling information persistence, by api interface realize dynamic change scheduling rule and scheduling information work(
Can, it introduces and monitors it, can find that scheduling is abnormal and carries out time update by api interface in time.
In one embodiment, step S1 includes default timed task frame：
By calling configure tools to install python programs automatically, timed task frame is included in dispatch server
In python programs, i.e. the setting of completion timing task framework.
Python (computer programming language) is a kind of explanation type computer programming language of object-oriented.
Python grammer simple and clears have abundant and powerful library, can be various module (the especially C/ made of other language
C++ it) is easily bound up very much.Its coding of timed task frame based on python programs is more succinct, can it is convenient with
The web frames such as django, which combine, carries out restful API exploitations, is combined more closely with existing dispatching platform function.
Timed task frame can select Quartz modules or apscheduler modules, preferably apscheduler modules.
A Python timed task frame of the apscheduler modules based on Quartz, the institute for realizing Quartz is functional, and makes
With conveniently.Apscheduler provides the calling rule based on date, Fixed Time Interval and crontab types, and can
With persistence task.Based on these functions, using apscheduler modules as new scheduling engine, the timed task of realization
Meets the needs of high frequency task.
By taking apscheduler modules are arranged in Linux dispatch servers as an example, apscheduler modules are python packets,
The deployment of python packets takes the strategy being integrally packaged with python files to be configured.And configure kits contain greatly
The command-line option of amount, dispatch server call configure tools that can realize Python by changing command-line option
The automatic installation of program, automatically according to after the completion, you can use apscheduler modules.
The present embodiment disposes apscheduler modules as timed task frame in such a way that python files are integrally packaged
Frame, functions of modules is abundant, easy to use, can be compatible with existing dispatching platform well.
In one embodiment, as shown in Fig. 2, step S1 further includes newly-increased timed task：
Step S102A：Instantiate a scheduler class；
Step S102B：Add task definition and scheduling information；
Step S102C：Calling rule is configured, and triggers task in a manner of calling.
Such as newly-increased timed task is：
It indicates to execute a my_job function, output hello world every 5s.
In one embodiment, in step S102B, also in the database by scheduling information storage：In dispatch server
In be preset with ORM tools, dispatch server is written by calling ORM tools to read scheduling information in the form of scheduled digitization
In database, that is, complete the storage of scheduling information.
ORM tools are the abbreviations of Object Relation Mapping, for realizing different type system in Object-Oriented Programming Language
Conversion between data, the method that it provides conceptual, understandable modeled data.ORM tools
The SQLAlchemy module shields grammatical differences of underlying database, only need the link information of configuration database can to write data
Enter database.ORM tools and SQLAlchemy modules can support relevant database and non-relational database and memory number
According to library.
The present embodiment is written in database scheduling information by the SQLAlchemy modules of ORM tools in real time, ORM tools
Compatible all kinds of existing databases can preferably be applied in existing dispatching platform, realize the function of scheduling information persistence.
Specifically, only needing the link information of configuration database using ORM tools, you can realize the write-in work of information, ORM
The relevant database that the SQLAlchemy of tool is supported, when database uses relevant database postgresql, an allusion quotation
The configuration of type is as follows：
When using non-relational database MongoDB and memory database Redis such as database, ablation process is and above-mentioned
Relevant database PostgreSQL is similar.
In one embodiment, also include scheduler modules in step S2, in python programs, dispatch server will
The reschedule_job interfaces of scheduler modules are completed to scheduling rule and scheduling information as dispatcher interface
Modification.Reschedule_job interfaces, which are placed on, to be encapsulated as api interface and is placed in django engineerings.
Specifically, such as the primary task of scheduling in original 3 minutes is modified as scheduling in 5 minutes once, may be used such as lower section
Formula：
Scheduler.reschedule_job (' my_job_id', trigger='cron', minute='*/5')
In one embodiment, scheduling rule includes scheduling mode, and scheduling mode includes blocking model or asynchronous mode, is adjusted
Spend modification of the server by dispatcher interface completion to scheduling mode.
By api interface when modifying, in addition to timing, time interval, crontab expression formula modes scheduling into
Row modification is outer, can also modify to scheduling mode, such as selects blocking model or asynchronous mode.
Under blocking model, scheduling meeting next time waits for the end of last scheduling.Specifically, such as the frequency of some scheduling
It is primary for 3 minutes, if it has been more than 3 minutes that wherein certain primary this, which dispatches corresponding Runtime, for blocking model, under
It is primary call can wait for this time task run be over and just start to dispatch.
It is then finished in asynchronous mode without waiting for the last time, carries out asynchronous schedule, cover in practical application often
The scene seen.Specifically, if the frequency of some scheduling is 3 minutes primary, if wherein certain primary this dispatches corresponding task fortune
The row time has been more than 3 minutes, for asynchronous mode, to after 3 minutes, starts to reschedule the task but regardless of last task
Operating condition how.
In one embodiment, in step S3, monitor mode is monitored using setting polling time interval.
Developed application supervision platform and third party's monitoring tools, wherein third party's monitoring tools may be used in monitor
It can be configured by web interface, realize monitoring purpose.The monitor mode of monitor is carried out using setting polling time interval
When monitoring, according to time interval, SQL query periodically is carried out to the database for being stored with scheduling information.
In one embodiment, in step S3, monitored results are the exception information in database, including when scheduler task
Error information, time-out information, monitored results are notified by way of mail or phone.
After monitor carries out SQL query by polling time interval, the result of inquiry is real-time scheduling information, and monitoring is normal
Have in seeing, in task scheduling with the presence or absence of the situation that reports an error, whether scheduler task run time is also not complete more than a certain threshold value
At etc. abnormal conditions.Monitor is exactly that whether will produce these abnormal conditions in monitoring data library, when there are abnormal conditions,
Monitored results are notified into related personnel by modes such as mails or phone, related personnel has found simultaneously in time according to monitored results
Change the problems in task scheduling.
In one embodiment it is proposed that a kind of high frequency task scheduling system, as shown in figure 3, high frequency task scheduling system
Including：
Timed task dispensing unit calls default timed task frame in the database for dispatch server, carries out
Timed task is dispatched, and timed task frame is preset with timed task, and timed task is configured with task definition, scheduling rule and scheduling
Information, scheduling information store in the database；
Interface dispensing unit is used for dispatch server configuration schedules routine interface, is appointed to timing by dispatcher interface
The scheduling rule and scheduling information of any timed task are modified in business frame, and dispatcher interface is encapsulated as api interface
It is placed in django engineerings；
Monitoring unit, is used for dispatch server configuration monitoring device, and monitor is adjusted according to scheduled monitor mode to being stored with
The database for spending information carries out SQL query, is notified after obtaining monitored results.
In one embodiment, for timed task dispensing unit in default timed task frame, dispatch server passes through tune
Python programs are installed automatically with configure tools, timed task frame is included in python programs, i.e., completion timing is appointed
The deployment of business frame.
In one embodiment, timed task dispensing unit presets ORM when scheduling information is stored in dispatch server
Tool, dispatch server are written in the form of scheduled digitization in database, i.e., by calling ORM tools to read scheduling information
Complete the storage of scheduling information.
In one embodiment, monitor mode is monitored using setting polling time interval.
In one embodiment, monitored results are the exception information in database, including error information when scheduler task,
Time-out information, monitored results are notified by way of mail or phone.
In one embodiment it is proposed that a kind of computer equipment, including database and processor, it is stored in database
Computer-readable instruction, when computer-readable instruction is executed by processor so that processor executes real when computer-readable instruction
Existing following steps：The timed task frame dispatched for timed task is preset in dispatch server, presets timed task frame
When, for dispatch server by calling configure tools to install python programs automatically, timed task frame is included in python
In program.Timed task frame is preset with timed task, and timed task is configured with task definition, scheduling rule and scheduling information,
Scheduling information stores in the database, when scheduling information stores, ORM tools is preset in dispatch server, dispatch server is logical
It crosses calling ORM tools and reads scheduling information, be written in database in the form of scheduled digitization.Dispatch server preset schedule journey
Sequence interface repaiies the scheduling rule and scheduling information of any timed task in timed task frame by dispatcher interface
Change, dispatcher interface is encapsulated as api interface and is placed in django engineerings.Dispatch server configuration monitoring device, monitor
SQL query is carried out to the database for being stored with scheduling information according to scheduled polling time interval, postal is crossed after obtaining monitored results
The mode of part or phone is notified.
In one embodiment it is proposed that a kind of storage medium being stored with computer-readable instruction, computer-readable finger
When order is executed by one or more processors so that one or more processors execute following steps：It is pre- in dispatch server
If for the timed task frame of timed task scheduling, when presetting timed task frame, dispatch server passes through calling
Configure tools install python programs automatically, and timed task frame is included in python programs.Timed task frame is pre-
Equipped with timed task, timed task is configured with task definition, scheduling rule and scheduling information, and scheduling information is stored in database
In, when scheduling information stores, ORM tools are preset in dispatch server, dispatch server is by calling ORM tools to read scheduling
Information is written in the form of scheduled digitization in database.Dispatch server preset schedule routine interface, is connect by scheduler program
Mouth modifies to the scheduling rule and scheduling information of any timed task in timed task frame, and dispatcher interface is packed
It is placed in django engineerings for api interface.Dispatch server configuration monitoring device, monitor is according to scheduled polling time interval
Database to being stored with scheduling information carries out SQL query, crosses mail after obtaining monitored results or the mode of phone is notified.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium may include：Read-only data library (ROM, Read Only Memory), Random Access Data library (RAM, Random
Access Memory), disk or CD etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to keep description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, it is all considered to be the range of this specification record.
Some exemplary embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but
It cannot be construed as a limitation to the scope of the present invention.It should be pointed out that for the ordinary skill people of this field
For member, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the present invention's
Protection domain.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (10)
1. a kind of high frequency method for scheduling task, which is characterized in that the high frequency method for scheduling task includes：
Dispatch server calls default timed task frame in the database, is timed task scheduling, the timed task
Frame is preset with timed task, and the timed task is configured with task definition, scheduling rule and scheduling information, scheduling information storage
In the database；
Dispatch server configuration schedules routine interface, by dispatcher interface to any timed task in timed task frame
Scheduling rule and scheduling information are modified, and dispatcher interface is encapsulated as api interface and is placed in django engineerings；
Dispatch server configuration monitoring device, the monitor is according to scheduled monitor mode to being stored with the database of scheduling information
SQL query is carried out, is notified after obtaining monitored results.
2. high frequency method for scheduling task according to claim 1, which is characterized in that the dispatch server passes through calling
Configure tools install python programs automatically, and the timed task frame is included in the python programs, that is, completes
The setting of timed task frame.
3. high frequency method for scheduling task according to claim 1, which is characterized in that when scheduling information stores, taken in scheduling
ORM tools are preset in business device, dispatch server is by calling ORM tools to read scheduling information, in the form of scheduled digitization
It is written in database, that is, completes the storage of scheduling information.
4. high frequency method for scheduling task according to claim 1, which is characterized in that the monitor mode is using setting poll
Time interval is monitored；
The monitored results are the exception information in database, including error information when scheduler task, time-out information, the prison
Control result is notified by way of mail or phone.
5. high frequency method for scheduling task according to claim 2, which is characterized in that also include in the python programs
Scheduler modules, the dispatch server connect the reschedule_job interfaces of scheduler modules as scheduler program
Mouthful, complete the modification to scheduling rule and scheduling information.
6. high frequency method for scheduling task according to claim 1, which is characterized in that the database uses relational data
Library, non-relational database or memory database.
7. high frequency method for scheduling task according to claim 1, which is characterized in that the scheduling rule includes dispatching party
Formula, the scheduling mode include blocking model or asynchronous mode, and the dispatch server is completed by the dispatcher interface
Modification to scheduling mode.
8. a kind of high frequency task scheduling system, which is characterized in that the high frequency task scheduling system includes：
Timed task dispensing unit calls default timed task frame in the database for dispatch server, is timed
Task scheduling, the timed task frame are preset with timed task, the timed task configured with task definition, scheduling rule and
Scheduling information, scheduling information store in the database；
Interface dispensing unit is used for dispatch server configuration schedules routine interface, by dispatcher interface to timed task frame
The scheduling rule and scheduling information of any timed task are modified in frame, and dispatcher interface is encapsulated as api interface placement
In django engineerings；
Monitoring unit, is used for dispatch server configuration monitoring device, and the monitor is adjusted according to scheduled monitor mode to being stored with
The database for spending information carries out SQL query, is notified after obtaining monitored results.
9. a kind of computer equipment, including database and processor, it is stored with computer-readable instruction in the database, it is described
When computer-readable instruction is executed by the processor so that the processor is executed such as any one of claim 1 to 7 right
It is required that the step of high frequency method for scheduling task.
10. a kind of storage medium being stored with computer-readable instruction, the computer-readable instruction is handled by one or more
When device executes so that one or more processors execute the high frequency task tune as described in any one of claim 1 to 7 claim
The step of degree method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810485941.7A CN108762900A (en) | 2018-05-21 | 2018-05-21 | High frequency method for scheduling task, system, computer equipment and storage medium |
| PCT/CN2018/104362 WO2019223173A1 (en) | 2018-05-21 | 2018-09-06 | High-frequency task scheduling method and system, and computer device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810485941.7A CN108762900A (en) | 2018-05-21 | 2018-05-21 | High frequency method for scheduling task, system, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108762900A true CN108762900A (en) | 2018-11-06 |
Family
ID=64007174
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810485941.7A Withdrawn CN108762900A (en) | 2018-05-21 | 2018-05-21 | High frequency method for scheduling task, system, computer equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108762900A (en) |
| WO (1) | WO2019223173A1 (en) |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109753354A (en) * | 2018-11-26 | 2019-05-14 | 平安科技（深圳）有限公司 | Processing method, device and the computer equipment of Streaming Media task based on multithreading |
| CN110688212A (en) * | 2019-09-26 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Timing management method and system based on quartz |
| CN111460772A (en) * | 2020-02-28 | 2020-07-28 | 上海维信荟智金融科技有限公司 | Automatic report processing method and system |
| CN111475272A (en) * | 2020-04-07 | 2020-07-31 | 四川虹美智能科技有限公司 | Method and device for controlling Java Web application timing task and task scheduling platform |
| CN111782351A (en) * | 2019-07-18 | 2020-10-16 | 北京京东尚科信息技术有限公司 | Distributed task scheduling method and device |
| CN112187570A (en) * | 2020-09-15 | 2021-01-05 | 中信银行股份有限公司 | Risk detection method and device, electronic equipment and readable storage medium |
| WO2021000758A1 (en) * | 2019-07-04 | 2021-01-07 | 中国建设银行股份有限公司 | Robotic resource task cycle management and control method and apparatus |
| CN113127158A (en) * | 2019-12-30 | 2021-07-16 | 百度在线网络技术（北京）有限公司 | Method and device for executing data processing task |
| CN113485799A (en) * | 2021-06-21 | 2021-10-08 | 上海百秋电子商务有限公司 | Method, device, equipment and storage medium for executing same timing task by multiple libraries |
| CN115333939A (en) * | 2022-07-27 | 2022-11-11 | 青岛海尔空调电子有限公司 | Operation control method, device and medium of internet of things gateway supporting edge computing |
| CN115599656A (en) * | 2022-12-12 | 2023-01-13 | 深圳联友科技有限公司（Cn） | Monitoring alarm realization method based on Java self-defined SQL |
| CN115829034A (en) * | 2023-01-09 | 2023-03-21 | 白杨时代(北京)科技有限公司 | Method and device for constructing knowledge rule execution framework |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111078383A (en) * | 2019-12-24 | 2020-04-28 | 浙江诺诺网络科技有限公司 | Timed task management method, device, equipment and storage medium |
| CN114696888B (en) * | 2022-04-25 | 2022-10-21 | 北京航天驭星科技有限公司 | Port task processing method, device, equipment and medium of satellite measurement, operation and control system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156920A (en) * | 2011-04-20 | 2011-08-17 | 铁道部运输局 | Task management dispatching system based on multi-dimensional law customization and task management dispatching method based on multi-dimensional law customization |
| CN102880503B (en) * | 2012-08-24 | 2015-04-15 | 新浪网技术(中国)有限公司 | Data analysis system and data analysis method |
| CN103593236B (en) * | 2013-11-14 | 2017-02-22 | 华为技术有限公司 | Computer equipment, method and device for scheduling service process |
-
2018
- 2018-05-21 CN CN201810485941.7A patent/CN108762900A/en not_active Withdrawn
- 2018-09-06 WO PCT/CN2018/104362 patent/WO2019223173A1/en active Application Filing
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109753354A (en) * | 2018-11-26 | 2019-05-14 | 平安科技（深圳）有限公司 | Processing method, device and the computer equipment of Streaming Media task based on multithreading |
| WO2021000758A1 (en) * | 2019-07-04 | 2021-01-07 | 中国建设银行股份有限公司 | Robotic resource task cycle management and control method and apparatus |
| CN111782351A (en) * | 2019-07-18 | 2020-10-16 | 北京京东尚科信息技术有限公司 | Distributed task scheduling method and device |
| CN110688212A (en) * | 2019-09-26 | 2020-01-14 | 山东浪潮通软信息科技有限公司 | Timing management method and system based on quartz |
| CN113127158A (en) * | 2019-12-30 | 2021-07-16 | 百度在线网络技术（北京）有限公司 | Method and device for executing data processing task |
| CN111460772A (en) * | 2020-02-28 | 2020-07-28 | 上海维信荟智金融科技有限公司 | Automatic report processing method and system |
| CN111475272A (en) * | 2020-04-07 | 2020-07-31 | 四川虹美智能科技有限公司 | Method and device for controlling Java Web application timing task and task scheduling platform |
| CN112187570A (en) * | 2020-09-15 | 2021-01-05 | 中信银行股份有限公司 | Risk detection method and device, electronic equipment and readable storage medium |
| CN113485799A (en) * | 2021-06-21 | 2021-10-08 | 上海百秋电子商务有限公司 | Method, device, equipment and storage medium for executing same timing task by multiple libraries |
| CN113485799B (en) * | 2021-06-21 | 2023-10-20 | 上海百秋新网商数字科技有限公司 | Method, device, equipment and storage medium for executing same timing task by multiple libraries |
| CN115333939A (en) * | 2022-07-27 | 2022-11-11 | 青岛海尔空调电子有限公司 | Operation control method, device and medium of internet of things gateway supporting edge computing |
| CN115599656A (en) * | 2022-12-12 | 2023-01-13 | 深圳联友科技有限公司（Cn） | Monitoring alarm realization method based on Java self-defined SQL |
| CN115829034A (en) * | 2023-01-09 | 2023-03-21 | 白杨时代(北京)科技有限公司 | Method and device for constructing knowledge rule execution framework |
| CN115829034B (en) * | 2023-01-09 | 2023-05-30 | 白杨时代(北京)科技有限公司 | Method and device for constructing knowledge rule execution framework |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019223173A1 (en) | 2019-11-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108762900A (en) | High frequency method for scheduling task, system, computer equipment and storage medium | |
| EP2721489B1 (en) | Software virtual machine for acceleration of transactional data processing | |
| US8812752B1 (en) | Connector interface for data pipeline | |
| CN110989983A (en) | Zero-coding application software rapid construction system | |
| US8725707B2 (en) | Data continuous SQL process | |
| CN107103064B (en) | Data statistical method and device | |
| WO2020228534A1 (en) | Micro-service component-based database system and related method | |
| KR20200004835A (en) | Containerized deployment of microservices based on monolithic legacy applications | |
| CN111125444A (en) | Big data task scheduling management method, device, equipment and storage medium | |
| CN110532074A (en) | A kind of method for scheduling task and system of multi-tenant Mode S aaS service cluster environment | |
| CN111459763A (en) | Cross-kubernets cluster monitoring system and method | |
| CN113298503A (en) | Government affair-oriented workflow management system and database and table dividing method thereof | |
| US20210326197A1 (en) | System And Method For Automatically Identifying And Resolving Computing Errors | |
| CN112148788A (en) | Data synchronization method and system for heterogeneous data source | |
| CN110569113A (en) | Method and system for scheduling distributed tasks and computer readable storage medium | |
| CN111966692A (en) | Data processing method, medium, device and computing equipment for data warehouse | |
| CN111240819A (en) | Dispatching task issuing system and method | |
| Bausch et al. | Bioopera: Cluster-aware computing | |
| CN109408212B (en) | Task scheduling component construction method and device, storage medium and server | |
| US10534640B2 (en) | System and method for providing a native job control language execution engine in a rehosting platform | |
| US20200073727A1 (en) | Scheduling software jobs having dependencies | |
| CN113722141B (en) | Method and device for determining delay reason of data task, electronic equipment and medium | |
| Provatas et al. | Selis bda: Big data analytics for the logistics domain | |
| CN115185700B (en) | High-integration single-process container management method | |
| US11775418B2 (en) | Techniques and architectures for providing an isolated runtime context in a shared environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181106 |
|
| WW01 | Invention patent application withdrawn after publication |