CN113434268A - Workflow distributed scheduling management system and method - Google Patents
Workflow distributed scheduling management system and method Download PDFInfo
- Publication number
- CN113434268A CN113434268A CN202110644173.7A CN202110644173A CN113434268A CN 113434268 A CN113434268 A CN 113434268A CN 202110644173 A CN202110644173 A CN 202110644173A CN 113434268 A CN113434268 A CN 113434268A
- Authority
- CN
- China
- Prior art keywords
- flow
- workflow
- module
- service
- scheduling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 130
- 230000008569 process Effects 0.000 claims abstract description 75
- 238000012544 monitoring process Methods 0.000 claims abstract description 39
- 230000011218 segmentation Effects 0.000 claims abstract description 30
- 238000010276 construction Methods 0.000 claims abstract description 23
- 238000005206 flow analysis Methods 0.000 claims abstract description 11
- 238000005520 cutting process Methods 0.000 claims abstract description 10
- 238000009826 distribution Methods 0.000 claims abstract description 8
- 238000003780 insertion Methods 0.000 claims abstract description 7
- 230000037431 insertion Effects 0.000 claims abstract description 7
- 238000007726 management method Methods 0.000 claims description 71
- 238000005457 optimization Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 5
- 238000012545 processing Methods 0.000 abstract description 2
- 238000003672 processing method Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 9
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000009969 flowable effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The embodiment of the invention provides a workflow distributed scheduling management system and a method, wherein the system comprises: the process construction module is used for realizing the construction of the service scheme process and the information configuration on the network page; the flow analysis and segmentation module is used for analyzing and segmenting the service scheme flow to generate an optimized cutting result and sending the cutting result to the flow reconstruction module; the flow reconstruction module is used for flow reassembly, including generation of monitoring insertion of the element flow and the sub-flow for realizing the workflow distribution type flow. The flow scheduling module is used for generating relevant scheduling information of distributed scheduling of the work flow, inserting flow variables of the element flow and issuing the element flow; and the service agent module is used for receiving and executing related scheduling tasks of the meta-process and realizing the distributed execution of the service scheme process. The workflow processing method and the workflow processing system can carry out flow segmentation and reconstruction through the flow analysis segmentation module and the flow reconstruction module, and can conveniently realize the decentralized distributed scheduling of the workflow.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a workflow distributed scheduling management system and a workflow distributed scheduling management method.
Background
Currently, workflow management and scheduling is performed by a single centralized workflow management engine. The engine is responsible for formulating task execution, monitoring workflow status and ensuring task relevance. However, in having cross-enterprise organizational workflow services, a centralized workflow management system is not ideal. Under centralized management control, the process is performed in relation to cross-domain security issues between different enterprise organizations. It can be seen that for a workflow service across an enterprise business application, the service is distributed, heterogeneous and autonomous in nature and is not suitable for centralized control. Secondly, centralized workflow management systems often cause performance bottlenecks in the case of handling large-scale concurrent workflows and multiple instances. In addition, the traditional workflow model of the traditional workflow management system can only be edited and modified in the design stage, and once the workflow is deployed and operated, the workflow cannot be adjusted. Due to uncertainty and variability of environment and user requirements in practical application, designers often cannot guarantee that all services can be considered in a design stage, so that a lot of service logics are difficult to define and complete in advance and need to be constructed or dynamically adjusted in real time, and therefore, dynamic adjustment supporting workflow also becomes a technical challenge in a workflow distributed execution scheduling process. Some workflow distributed scheduling management systems are disclosed in the prior art, such as a "lightweight distributed workflow engine construction system" in patent document with publication number CN112581080A, a "distributed workflow scheduling method, device, storage medium and electronic device" in patent document with publication number CN111950988A, and a "distributed workflow management system" in patent document with publication number CN 112070452A. As can be seen from the analysis of the technical details in the above documents, the aspects of distributed scheduling management of workflows, dynamic adjustment of workflow models, management design of service computing nodes, and the like are not perfect, and the aspects are mainly embodied in the following aspects:
first, the prior art does not support dynamic adjustment of workflow models. In the prior art, only complete workflow service is allowed to be built in advance in the construction of the workflow service, the relay execution of the workflow is not allowed, and the requirement of dynamic adjustment of a workflow model under the condition of variable application environments cannot be met.
Second, the prior art does not support the decentralized implementation of the service node. The existing open-source framework Dophin scheduler realizes the decentralization of Master nodes and the decentralization of Worker nodes, but cannot really realize the nondifferentiation of the two nodes, and cannot fully utilize the computing resources of a cluster under the concurrency of light-weight workflow tasks.
Disclosure of Invention
The invention provides a workflow distributed scheduling management system and a workflow distributed scheduling management method, which can solve the technical problem.
The technical scheme for solving the technical problems is as follows:
in a first aspect, an embodiment of the present invention provides a workflow distributed scheduling management system, including: the system comprises a flow construction module, a flow analysis and segmentation module, a flow reconstruction module, a flow scheduling module and a service agent module, wherein:
the process construction module is used for realizing the construction of the service scheme process and the information configuration on the network page; the web page includes: the method comprises the following steps of (1) actively selecting a page, a task configuration page and a process construction page;
the flow analysis and segmentation module is used for analyzing and segmenting the service scheme flow to generate an optimized cutting result and sending the cutting result to the flow reconstruction module;
the flow reconstruction module is used for flow reassembly, including generation of monitoring insertion of the element flow and the sub-flow for realizing the workflow distribution type flow.
The flow scheduling module is used for generating relevant scheduling information of distributed scheduling of the work flow, inserting flow variables of the element flow and issuing the element flow;
the service agent module is embedded in the computing node and used for receiving and executing related scheduling tasks of the meta-process and realizing distributed execution of the service scheme process.
In some embodiments, the workflow distributed scheduling management system further includes: and the process monitoring module is used for monitoring the real-time state of the service scheme process and the real-time geographic position of the computing node.
In some embodiments, the workflow distributed scheduling management system includes a node management module, where the node management module is used for managing a computing node, and includes at least: checking the position of the computing node, modifying the state, adding and deleting the computing node.
In some embodiments, the workflow distributed scheduling management system includes a service management module, and the service management module is configured to provide management and viewing of service plan processes with users.
In some embodiments, the workflow distributed scheduling management system serves a computing cluster, and the computing cluster provides a basic operating environment for upper-layer applications; and receiving and executing the issued meta-flow information.
In a second aspect, an embodiment of the present invention provides a method for managing workflow distributed scheduling, including:
receiving and resolving a workflow model constructed by a user service,
based on multi-condition constraints, modeling is carried out with high service quality and low time delay to obtain a multi-objective optimization problem, and an optimized segmentation scheme is generated according to an intelligent optimization algorithm, wherein the multi-condition constraints at least comprise: service location constraints, execution environment constraints, and parallel gateways;
according to the optimized segmentation scheme, automatically segmenting an original flow of user service to obtain a plurality of sub-flows, and storing the plurality of sub-flows;
receiving and analyzing a plurality of sub-processes, and adding a service monitoring task after each sub-process;
constructing a meta-flow according to the segmentation logic and the result of the optimized segmentation scheme;
generating corresponding scheduling information according to a random scheduling algorithm;
and storing all the distributed scheduling information in the process variables of the element process, and simultaneously issuing the element process to the computing node for execution.
In some embodiments, the workflow distributed scheduling management method further includes:
and the service agent in the computing node can automatically execute the element process after receiving the execution information of the element process, and simultaneously acquire corresponding sub-process information from the process variable to issue.
In some embodiments, the workflow distributed scheduling management method further includes:
and the sub-processes automatically execute response monitoring tasks after being issued to the computing nodes for execution, and the sub-processes and the element processes are communicated and interacted in real time.
In some embodiments, the workflow distributed scheduling management method further includes:
and monitoring the execution information of the element flow and displaying the execution information of the element flow.
In some embodiments, the workflow distributed scheduling management method further includes:
the meta-process automatically completes the distributed scheduling information of the workflow; the scheduling information includes: scheduling node information and sub-flow information.
The invention has the beneficial effects that: the embodiment of the invention provides a workflow distributed scheduling management system and a method thereof, wherein the system comprises: the process construction module is used for realizing the construction of the service scheme process and the information configuration on the network page; the flow analysis and segmentation module is used for analyzing and segmenting the service scheme flow to generate an optimized cutting result and sending the cutting result to the flow reconstruction module; the flow reconstruction module is used for flow reassembly, including generation of monitoring insertion of the element flow and the sub-flow for realizing the workflow distribution type flow. The flow scheduling module is used for generating relevant scheduling information of distributed scheduling of the work flow, inserting flow variables of the element flow and issuing the element flow; the service agent module is embedded in the computing node and used for receiving and executing related scheduling tasks of the meta-process and realizing distributed execution of the service scheme process. The workflow processing method and the workflow processing system can divide and reconstruct the workflow through the workflow analyzing and dividing module and the workflow reconstructing module, can conveniently realize the decentralized distributed scheduling of the workflow, and simultaneously meet the dynamic adjustment requirement of the workflow model.
Drawings
Fig. 1 is a first schematic diagram of a workflow distributed scheduling management system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a workflow distribution type scheduling management system according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a workflow distributed scheduling management method according to an embodiment of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
In order that the above objects, features and advantages of the present application can be more clearly understood, the present disclosure will be further described in detail with reference to the accompanying drawings and examples. It is to be understood that the embodiments described are only a few embodiments of the present disclosure, and not all embodiments. The specific embodiments described herein are merely illustrative of the disclosure and are not limiting of the application. All other embodiments that can be derived by one of ordinary skill in the art from the description of the embodiments are intended to be within the scope of the present disclosure.
It is noted that, in this document, relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
Those skilled in the art will appreciate that although some embodiments described herein include some features included in other embodiments instead of others, combinations of features of different embodiments are meant to be within the scope of the application and form different embodiments.
The following first introduces terms related to the present application.
An activity selection page and a task configuration page.
The activity selection page provides various different workflow tasks, and can be divided into service tasks, monitoring tasks, user tasks and the like according to different functions. The user can select the task required by the user to drag to connect and construct the service flow. The service task can be regarded as an automation task, and only the service task definition needs to be carried out in advance, and the service task can be automatically executed when the process is executed to the corresponding task computing node. The user task is regarded as a waiting task, namely, the blocking waiting is carried out in the execution process of the flow, and the flow can be continuously executed after the manual activity of the specified user is completed. The monitoring task is regarded as a trigger task, namely monitoring needs to be added at the specified position of the service flow, and the monitor task can be automatically started after the current flow task is finished.
The task configuration page provides information configuration of various active flow tasks. The task configuration comprises the following steps: task ID, task name, task execution mode (asynchronous and synchronous), whether an execution monitor is configured or not, and configuration information such as a designated class path. The information configuration of the user task comprises the following steps: task description information, task execution mode (synchronous or asynchronous), whether to configure an execution listener, assign users, form references, and the like.
Fig. 1 is a first schematic diagram of a workflow distributed scheduling management system according to an embodiment of the present invention.
In a first aspect, an embodiment of the present invention provides a workflow distributed scheduling management system, including: a flow construction module 101, a flow analysis and segmentation module 102, a flow reconstruction module 103, a flow scheduling module 104, and a service agent module 105, wherein:
the process construction module 101 is used for implementing construction and information configuration of a service scheme process on a network page; the web page includes: the method comprises the following steps of (1) actively selecting a page, a task configuration page and a process construction page;
specifically, the process construction page in the embodiment of the application provides functions of connection, deletion, adjustment and the like of the active task. The process construction module realizes the complete construction of the service scheme process, and after the construction of the service scheme process is completed, the process file corresponding to the service scheme process and conforming to the BPMN2.0 can be obtained. The process file is a process file generated by automatic analysis after a certain service process is constructed. The startEvent element is regarded as the flow start, the serviceTask is regarded as the service task, and the sequenceFlow represents the connection line, including the predecessor and successor of the connection line.
The flow analysis and segmentation module 102 is used for analyzing and segmenting the service scheme flow, generating an optimized cutting result and sending the cutting result to the flow reconstruction module;
specifically, the flow parsing and dividing module 102 in the embodiment of the present application is used for parsing and dividing the service scheme flow. The module firstly reads XML file information of a corresponding service scheme flow, sequentially searches elements such as sequence flow in the XML file information to acquire corresponding connection information, and finally converts the service scheme flow into a data flow logic diagram for analyzing a flow logic structure. The segmentation constraint rule is based on rules such as gateway constraint, the intelligent segmentation is carried out on the flow DAG through an intelligent segmentation algorithm, the optimal optimized segmentation result is finally generated, and the segmentation result is stored by taking the connection point as a unit. And finally, dividing the service scheme flow into a plurality of sub-flows according to the division scheme.
The process reconfiguration module 103 is used for process reassembly, including generating monitoring insertions for implementing the elementary processes and sub-processes of the workflow distribution process.
Specifically, the flow reconstruction module 103 in this embodiment is configured to generate monitoring insertions for implementing the element flows and the sub-flows of the workflow distribution type flow. The process reconfiguration module 103 receives the sub-process information of the service plan partitioned by the process parsing and partitioning module, sequentially traverses the structure of the sub-process, and adds a service monitoring task before the end mark of the sub-process, wherein the monitoring task performs active responsive interactive communication with the main process at the end stage of the distributed execution process of the subsequent sub-process. After receiving the segmentation logic scheme and the result of the flow analysis segmentation module, the flow reconstruction module generates a meta-flow with a similar structure according to the segmentation logic scheme.
The flow scheduling module 104 is configured to generate relevant scheduling information of distributed scheduling of the workflow, and insertion of flow variables of the meta-flow and issuance of the meta-flow;
specifically, the flow scheduling module in the embodiment of the present application implements generation of distributed scheduling information and scheduling and issuing of a meta-flow. The scheduling information is divided into two parts, wherein one part is the scheduling information of the computing node, namely the computing node information sent by the sub-process, such as an IP address, an engine port and the like. The other part is flow scheduling information, which includes: sub-process information, deployment information of meta-processes, user allocation information, and the like. And after generating all the distributed scheduling information, the flow scheduling module randomly selects the element flow issued by the computing node and inserts all the scheduling information into the element flow in a flow variable mode. And the service agent in the computing node automatically executes after receiving the issuing information of the element flow, and the task of the element flow acquires the relevant scheduling information of the corresponding sub-flow from the flow variable to perform distributed issuing of the sub-flow, and then enters a user task for waiting. And when the sub-process is finished, the monitoring task is executed, interactive response is carried out on the sub-process and the meta-process, user allocation is completed, the meta-process continues to execute the subsequent process, and the distributed scheduling of the workflow is automatically realized.
The service agent module 105 is embedded in the computing node, and is used for receiving and executing related scheduling tasks of the meta-processes, so as to implement distributed execution of the service scheme processes.
Specifically, the service agent module 105 in the embodiment of the present application is mainly applied to a service computing engine, and is used for executing related scheduling work of a meta-process. The service agent obtains corresponding sub-process information from the process variables of the element process, and schedules the computing node information and the user task information to be subsequently waited. Secondly, judging the effectiveness of the scheduling information, and simultaneously checking whether the issued computing node is normal, if the computing node is off-line, selecting a normal computing node from the computing node set for issuing. And finally, carrying the updated variable information and the user task information distributed for the sub-process to perform issuing execution of the sub-process, and finally returning to the process state.
Fig. 2 is a schematic diagram of a workflow distribution type scheduling management system according to an embodiment of the present invention;
in some embodiments, the workflow distributed scheduling management system further includes: and the process monitoring module 201 is used for monitoring the real-time state of the service scheme process and the real-time geographic position of the computing node.
Specifically, in this embodiment, the process monitoring module 201 completes real-time monitoring of the state of the service scheme process. Because the original service scheme flow is segmented by the flow analyzing and segmenting module, a plurality of sub-flows which are executed in a scattered way cannot be monitored in the distributed execution process of the workflow, and the flow monitoring module monitors the state of the original service scheme flow by monitoring the state of the original flow. The sub-process is inserted into the process reconstruction module for service monitoring, namely, a service monitoring task is automatically responded at the end stage of the sub-process, and the task acquires information of a corresponding meta-process of the process and carries out response interaction on the meta-process. Meanwhile, the process monitoring module monitors the progress state of the original process to realize real-time monitoring of the process.
In some embodiments, the workflow distributed scheduling management system further includes: a node management module 202, configured to manage the computing cluster nodes, and at least include: checking the position of the computing node, modifying the state, adding and deleting the computing node.
The node management module 202: the module mainly implements configuration management of the compute nodes. The method comprises the functions of checking and monitoring the geographical position of the computing node, modifying the configuration of information such as a port and an IP address and the like.
In some embodiments, the workflow distributed scheduling management system further includes: and the service management module 203 is used for providing management and viewing of the service scheme flow with the user.
The service management module 203 is used for providing management and viewing of service schemes with users. The service management module comprises the operations of uploading, searching, checking, deleting, downloading and the like of the service scheme. It may be a web page showing the corresponding functions of the service plan management module. The uploading of the service scheme needs to compile the service scheme name and the service scheme description information, and select the flow file which is generated by the flow construction module and accords with the BPMN2.0 standard to upload. The search of the service scheme requires that a keyword of a file name is input in a search box and a search is clicked to check a corresponding search result. The service plan view function will read the information of the corresponding service plan, i.e. read the flow XML file. And traversing the sequence flow in sequence through the flow analysis engine to acquire the connection information of the sequence flow, converting the connection information into a DAG (direct current) diagram, and displaying the service scheme flow according to the corresponding diagram display rule.
In some embodiments, the workflow distributed scheduling management system serves a computing cluster, and the computing cluster provides a basic operating environment for upper-layer applications; and receiving and executing the issued meta-flow information.
Specifically, the underlying engine of the service computing cluster in the embodiment of the present application is a flowable6.5.0 workflow computing engine, and meanwhile, container arrangement and monitoring are performed by using kubernets.
The invention provides a workflow distributed dispatching management method based on a Flowable workflow calculation engine, so that a decentralized workflow distributed dispatching management system is realized. The system realizes the distributed scheduling execution of the workflow and the real-time state monitoring of the workflow through the division and reconstruction of the service flow and the element flow constructed by the system. The system realizes decentralized control, and can dynamically adjust the workflow model in a mode of suspending the original process.
Fig. 3 is a schematic diagram of a workflow distributed scheduling management method according to an embodiment of the present invention.
In a second aspect, an embodiment of the present invention provides a method for managing workflow distributed scheduling, including:
s301: receiving and resolving a workflow model constructed by a user service,
s302: based on multi-condition constraints, modeling is carried out with high service quality and low time delay to obtain a multi-objective optimization problem, and an optimized segmentation scheme is generated according to an intelligent optimization algorithm;
wherein the multi-conditional constraints comprise at least: service location constraints, execution environment constraints, and parallel gateways;
s303: according to the optimized segmentation scheme, automatically segmenting an original flow of user service to obtain a plurality of sub-flows, and storing the plurality of sub-flows;
receiving and analyzing a plurality of sub-processes, and adding a service monitoring task after each sub-process;
s304: constructing a meta-flow according to the segmentation logic and the result of the optimized segmentation scheme;
s305: generating corresponding scheduling information according to a random scheduling algorithm;
s306: and storing all the distributed scheduling information in the process variables of the element process, and simultaneously issuing the element process to the computing node for execution.
In some embodiments, the workflow distributed scheduling management method further includes:
and the service agent in the computing node can automatically execute the element process after receiving the execution information of the element process, and simultaneously acquire corresponding sub-process information from the process variable to issue.
In some embodiments, the workflow distributed scheduling management method further includes:
and the sub-processes automatically execute response monitoring tasks after being issued to the computing nodes for execution, and the sub-processes and the element processes are communicated and interacted in real time.
In some embodiments, the workflow distributed scheduling management method further includes:
and monitoring the execution information of the element flow and displaying the execution information of the element flow.
In some embodiments, the workflow distributed scheduling management method further includes:
the meta-process automatically completes the distributed scheduling information of the workflow; the scheduling information includes: and scheduling the computing node information and the sub-process information.
Those skilled in the art will appreciate that the description of each embodiment has a respective emphasis, and reference may be made to the related description of other embodiments for those parts of an embodiment that are not described in detail.
Although the embodiments of the present application have been described in conjunction with the accompanying drawings, those skilled in the art will be able to make various modifications and variations without departing from the spirit and scope of the application, and such modifications and variations are included in the specific embodiments of the present invention as defined in the appended claims, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of various equivalent modifications and substitutions within the technical scope of the present disclosure, and these modifications and substitutions are intended to be included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
While the invention has been described with reference to specific embodiments, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A workflow distributed scheduling management system, comprising: the system comprises a flow construction module, a flow analysis and segmentation module, a flow reconstruction module, a flow scheduling module and a service agent module, wherein:
the process construction module is used for realizing construction of a service scheme process and information configuration on a network page; the web page includes: the method comprises the following steps of (1) actively selecting a page, a task configuration page and a process construction page;
the flow analysis and segmentation module is used for analyzing and segmenting the service scheme flow to generate an optimized cutting result and sending the cutting result to the flow reconstruction module;
the flow reconstruction module is used for reassembling the flow, and comprises the steps of generating monitoring insertion of a meta-flow and a sub-flow for realizing the workflow distribution type flow;
the flow scheduling module is used for generating relevant scheduling information of distributed scheduling of the work flow, inserting flow variables of the meta-flow and issuing the meta-flow;
the service agent module is embedded in the computing node and used for receiving and executing the related scheduling task of the meta-process and realizing the distributed execution of the service scheme process.
2. The workflow distributed schedule management system of claim 1 wherein the system further comprises: and the flow monitoring module is used for monitoring the real-time state of the service scheme flow and the real-time geographic position of the computing node.
3. The workflow distributed schedule management system of claim 1 wherein the system further comprises: a node management module for management of computing nodes, the node management module comprising at least: checking the position of the computing node, modifying the state, adding and deleting the computing node.
4. The workflow distributed schedule management system of claim 1 wherein the system further comprises: and the service management module is used for providing management and viewing of the service scheme flow with the user.
5. The workflow distributed schedule management system of claim 1 wherein the system further comprises: the service computing cluster provides a basic operation environment for the upper application; and receiving and executing the issued meta-flow information.
6. A workflow distributed scheduling management method is characterized by comprising the following steps:
receiving and resolving a workflow model constructed by a user service,
based on multi-condition constraints, modeling is carried out with high service quality and low time delay to obtain a multi-objective optimization problem, and an optimized segmentation scheme is generated according to an intelligent optimization algorithm, wherein the multi-condition constraints at least comprise: service location constraints, execution environment constraints, and parallel gateways;
according to the optimized segmentation scheme, automatically segmenting an original flow of user service to obtain a plurality of sub-flows, and storing the plurality of sub-flows;
receiving and analyzing the plurality of sub-processes, and adding a service monitoring task after each sub-process;
constructing a meta-flow according to the segmentation logic and the result of the optimized segmentation scheme;
generating corresponding scheduling information according to a random scheduling algorithm;
and storing all the distributed scheduling information in the process variables of the element process, and simultaneously issuing the element process to the computing node for execution.
7. The workflow distributed scheduling management method of claim 6, further comprising:
and the service agent in the computing node automatically executes the element flow after receiving the execution information of the element flow, and simultaneously acquires corresponding sub-flow information from the flow variables for issuing.
8. The workflow distributed scheduling management method of claim 7, further comprising:
and the sub-process automatically executes a response monitoring task after being issued to the computing node for execution, and the sub-process and the element process are communicated and interacted in real time.
9. The workflow distributed scheduling management method of claim 7, further comprising: and monitoring the execution information of the element flow and displaying the execution information of the element flow.
10. The workflow distributed scheduling management method of claim 6 wherein the meta-process automatically completes the distributed scheduling information of the workflow; the scheduling information includes: and scheduling the computing node information and the sub-process information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110644173.7A CN113434268A (en) | 2021-06-09 | 2021-06-09 | Workflow distributed scheduling management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110644173.7A CN113434268A (en) | 2021-06-09 | 2021-06-09 | Workflow distributed scheduling management system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113434268A true CN113434268A (en) | 2021-09-24 |
Family
ID=77755506
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110644173.7A Pending CN113434268A (en) | 2021-06-09 | 2021-06-09 | Workflow distributed scheduling management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113434268A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986516A (en) * | 2021-12-27 | 2022-01-28 | 广州朗国电子科技股份有限公司 | Distributed task scheduling system based on Hongming system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5893128A (en) * | 1993-03-01 | 1999-04-06 | Nauckhoff; Sven | Distributed work flow management |
| CN102509197A (en) * | 2011-12-01 | 2012-06-20 | 中国移动通信集团广东有限公司 | Workflow management system and workflow management method |
| CN102902739A (en) * | 2012-09-13 | 2013-01-30 | 杭州电子科技大学 | Workflow flow construction method for uncertain data sources under cloud computing environment |
| US20130290239A1 (en) * | 2010-11-10 | 2013-10-31 | Telefonica S.A. | Method and a system for service lifecycle management in networked environments |
| US20190196672A1 (en) * | 2013-12-06 | 2019-06-27 | Biodatomics, LLC | Visual effects system for "big data" analysis workflow editors, distribution platforms, execution engines, and management systems comprising same |
| CN112217852A (en) * | 2019-07-12 | 2021-01-12 | 上海芯港信息科技有限责任公司 | Platform-as-a-service system and method based on workflow engine |
| CN112506498A (en) * | 2020-11-30 | 2021-03-16 | 广东电网有限责任公司 | Intelligent visual API arrangement method, storage medium and electronic equipment |
| CN112698931A (en) * | 2021-01-12 | 2021-04-23 | 北京理工大学 | Distributed scheduling system for cloud workflow |
-
2021
- 2021-06-09 CN CN202110644173.7A patent/CN113434268A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5893128A (en) * | 1993-03-01 | 1999-04-06 | Nauckhoff; Sven | Distributed work flow management |
| US20130290239A1 (en) * | 2010-11-10 | 2013-10-31 | Telefonica S.A. | Method and a system for service lifecycle management in networked environments |
| CN102509197A (en) * | 2011-12-01 | 2012-06-20 | 中国移动通信集团广东有限公司 | Workflow management system and workflow management method |
| CN102902739A (en) * | 2012-09-13 | 2013-01-30 | 杭州电子科技大学 | Workflow flow construction method for uncertain data sources under cloud computing environment |
| US20190196672A1 (en) * | 2013-12-06 | 2019-06-27 | Biodatomics, LLC | Visual effects system for "big data" analysis workflow editors, distribution platforms, execution engines, and management systems comprising same |
| CN112217852A (en) * | 2019-07-12 | 2021-01-12 | 上海芯港信息科技有限责任公司 | Platform-as-a-service system and method based on workflow engine |
| CN112506498A (en) * | 2020-11-30 | 2021-03-16 | 广东电网有限责任公司 | Intelligent visual API arrangement method, storage medium and electronic equipment |
| CN112698931A (en) * | 2021-01-12 | 2021-04-23 | 北京理工大学 | Distributed scheduling system for cloud workflow |
Non-Patent Citations (1)
| Title |
|---|
| LEI FANG 等: "Meta-process: a noval approach for decentralized execution of process" * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113986516A (en) * | 2021-12-27 | 2022-01-28 | 广州朗国电子科技股份有限公司 | Distributed task scheduling system based on Hongming system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Peng et al. | Assignment and scheduling communicating periodic tasks in distributed real-time systems | |
| US6915338B1 (en) | System and method providing automatic policy enforcement in a multi-computer service application | |
| Petriu et al. | Applying the UML performance profile: Graph grammar-based derivation of LQN models from UML specifications | |
| US6799314B2 (en) | Work flow management method and work flow management system of controlling a work flow | |
| US8307054B2 (en) | Systems and/or methods for location transparent routing and execution of processes | |
| Jonsson et al. | A parametrized branch-and-bound strategy for scheduling precedence-constrained tasks on a multiprocessor system | |
| CN117354260A (en) | Electromagnetic transient cross-domain distributed parallel computing scheduling method and device | |
| CN114924858A (en) | Task scheduling method and device, storage medium and electronic equipment | |
| In et al. | Sphinx: A scheduling middleware for data intensive applications on a grid | |
| Zhou et al. | AHPA: adaptive horizontal pod autoscaling systems on alibaba cloud container service for kubernetes | |
| CN113220480B (en) | Distributed data task cross-cloud scheduling system and method | |
| CN113434268A (en) | Workflow distributed scheduling management system and method | |
| US20050198614A1 (en) | Management platform and evironment | |
| Virani et al. | Service composition based on multi agent in cloud environment | |
| Tan et al. | A mathematical model, heuristic, and simulation study for a basic data staging problem in a heterogeneous networking environment | |
| Zhu et al. | Automated application component placement in data centers using mathematical programming | |
| CN115237547A (en) | Unified container cluster hosting system and method for non-intrusive HPC computing cluster | |
| Volckaert et al. | Network aware scheduling in grids | |
| Yasmin et al. | A constraint programming-based resource allocation and scheduling of map reduce jobs with service level agreement | |
| Zhang et al. | Workflow-oriented grid service composition and scheduling | |
| US20090293064A1 (en) | Synchronizing shared resources in an order processing environment using a synchronization component | |
| Sirjani et al. | Reactive actors: Isolation for efficient analysis of distributed systems | |
| Theiss et al. | A Java software agent framework for hard real-time manufacturing control | |
| Koehler et al. | Connector rewriting with high-level replacement systems | |
| Amer et al. | Software Performance Evaluation: Graph grammar-based Transformation of UML design models into performance models |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210924 |