CN109002351A - A kind of nested type workflow setting method - Google Patents

A kind of nested type workflow setting method Download PDF

Info

Publication number
CN109002351A
CN109002351A CN201810696802.9A CN201810696802A CN109002351A CN 109002351 A CN109002351 A CN 109002351A CN 201810696802 A CN201810696802 A CN 201810696802A CN 109002351 A CN109002351 A CN 109002351A
Authority
CN
China
Prior art keywords
anchor point
outer layer
link block
calculate node
internal layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810696802.9A
Other languages
Chinese (zh)
Other versions
CN109002351B (en
Inventor
康波
孟祥飞
李健增
刘光明
菅晓东
彭修乾
马庆珍
司道军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Supercomputer Center In Tianjin
Original Assignee
National Supercomputer Center In Tianjin
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Supercomputer Center In Tianjin filed Critical National Supercomputer Center In Tianjin
Priority to CN201810696802.9A priority Critical patent/CN109002351B/en
Priority to CN202010258341.4A priority patent/CN111475271B/en
Publication of CN109002351A publication Critical patent/CN109002351A/en
Application granted granted Critical
Publication of CN109002351B publication Critical patent/CN109002351B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The present invention relates to a kind of nested type workflow setting methods, it include: the output anchor point for comparing the input anchor point and outer layer link block of outer layer calculate node, if the anchor point that fully enters of outer layer calculate node is not present in the output anchor point of any outer layer link block, the outer layer calculate node ID list ID of the outer layer calculate node being put into the outer operative stream first order;Step S300, compare the input anchor point of the output anchor point and outer layer calculate node of the outer layer link block in the outer layer link block ID list in the outer operative stream first order, the outer layer calculate node ID the list under identical circumstances ID of the outer layer calculate node being put into the outer operative stream second level;By outer operative stream it is at different levels in outer layer calculate node ID list successively add in outer layer task execution sequence list.The present invention can obtain the workflow of different software frame in the workflow and operation of the arbitrary topology combination of different execution modules in same software frame.

Description

A kind of nested type workflow setting method
Technical field
The present invention relates to a kind of nested type workflow setting methods.
Background technique
Supercomputer is a huge computer system, is mainly used to undertake great scientific research, national defence tip The mass computing project and data processing task of technology and national economy field, such as a wide range of weather forecast arrange satellite photo, The exploration of Nuclear Physics, research intercontinental missile, spaceship etc..Therefore, a large amount of calculating are commonly installed on supercomputer Machine software is called in different application as needed with facilitating.However, since the computer that different application field needs is soft Part combination is different, and the parameter configuration of each computer software is different, and the data volume of processing is different, it is therefore desirable to before job execution It is configured to environment is calculated.In the operation for being related to multiple software collaborations, generally require to each mutually independent software Execution sequence carries out personalized customization.Each computing module is also required to the tool by its coupled relation and operation in single software Body situation is customized execution sequence.For the software or computing module after customization, then need further in job script Determine that its executes sequence.When executing numerous computing modules of multiple softwares or individual software in operation, generally require to spend Take a large amount of energy to formulate workflow.Therefore there is still a need for workflow setting method so as to it is accurate, quickly and easily formulate work It flows.
Summary of the invention
In order to solve the above technical problems, the present invention provides a kind of nested type workflow setting methods, comprising the following steps:
Step S100 obtains outer layer calculate node and its ID, input anchor point and output anchor point;Obtain outer layer link block and Its ID, input anchor point and output anchor point;
Step S200 compares the output anchor point of the input anchor point and outer layer link block of outer layer calculate node, if outer layer meter The anchor point that fully enters of operator node is not present in the output anchor point of any outer layer link block, then by the outer layer calculate node ID is put into the outer layer calculate node ID list in the outer operative stream first order;The outer layer for comparing the outer operative stream first order calculates section The input anchor point of the output anchor point and outer layer link block of point, if the input anchor point of outer layer link block and any first order outer layer The output anchor point of calculate node is identical, then the ID of the outer layer link block is put into the connection of the outer layer in the outer operative stream first order Module I D list;
Step S300 compares the outer layer link block in the outer layer link block ID list in the outer operative stream first order The input anchor point for exporting anchor point and outer layer calculate node, is put into outer layer work for the ID of the outer layer calculate node under identical circumstances Make the outer layer calculate node ID list in the stream second level;Compare the output anchor point of the outer layer calculate node of the outer operative stream second level With the input anchor point of outer layer link block, if input anchor point and any second level outer layer calculate node of outer layer link block is defeated Anchor point is identical out, then the outer layer link block ID list being put into the ID of the outer layer link block in the outer operative stream second level;
Step S400 repeats step S300, until all outer layer calculate nodes and outer layer link block are all put into outer layer work Make to flow the outer layer calculate node ID list and outer layer link block ID list at different levels;
Step S500, by outer operative stream it is at different levels in outer layer calculate node ID list successively to add outer layer task execution suitable In sequence table.
The present invention can obtain the workflow and work of the arbitrary topology combination of different execution modules in same software frame The workflow of different software frame in industry.
Detailed description of the invention
Fig. 1 is workflow topological structure schematic diagram of the invention;
Fig. 2 is the schematic diagram of nested type workflow of the invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, the present invention will be made further in conjunction with attached drawing Detailed description.This description is to describe specific implementation consistent with the principles of the present invention by way of example, and not limitation Mode, the description of these embodiments is detailed enough, so that those skilled in the art can practice the present invention, is not being taken off Other embodiments can be used in the case where from scope and spirit of the present invention and can change and/or replace each element Structure.Therefore, the following detailed description should not be understood from restrictive sense.
It is different that data structure used by the computer software of different task is executed in operation, such as the output of up-stream software Data may be needed could be as the input data of down-stream software by conversion;In addition, up-stream software may also export it is a variety of not Same data, and down-stream software needs partial data therein as input data;Therefore it needs to formulate work in script file It flows to smoothly complete operation.
In one embodiment of the invention, a kind of nested type workflow setting method is provided.In general, workflow is wanted substantially Element includes node (such as software, computing module etc.), anchor point (such as data file etc.) and connects (such as data conversion module Deng), the various combination of three will form the different workflow form such as one-to-one, one-to-many, many-one, multi-to-multi.Section Point, anchor point, connection should include but is not limited to ID, show the parameters such as title, and wherein ID is character string, and there is uniqueness can recognize Property.Nested type workflow includes two layers: outer operative stream is by the independently working script of no coupled relation according to certain figure sequence Composition, inner operative stream are made of the module in internal independence job script with preceding coupling according to certain figure sequence.It is nested Formula workflow design is provided by server as rear end, and user on the browser on computer by realizing.
Further, the script file includes the executable script of the first order for executing outer operative stream, wherein described outer Layer workflow includes the outer layer calculate node formed by computer software each in computer software group and for receiving upstream The output data of outer layer calculate node and convert thereof into downstream outer layer calculate node input data outer layer link block, often A outer layer calculate node has one or more input anchor points for receiving input data and one or more for exporting number According to output anchor point, each outer layer link block, which has, one or more exports anchor from upstream outer layer calculate node for receiving The input anchor point of the output data of point and one or more output datas that are used for are as downstream outer layer calculate node input data Output anchor point, the first order can be performed script include each outer layer calculate node computation sequence.
Further, the workflow includes outer operative stream, and the outer operative stream is to execute multiple conducts in operation The sequence of the computer software of outer layer calculate node, the outer layer calculate node is connected with each other by outer layer link block, described Outer layer link block is used to receive the output data of upstream outer layer calculate node and converts thereof into downstream outer layer calculate node Input data, each outer layer calculate node have one or more for receiving the input anchor point and one or more of input data For the output anchor point of output data, there is each outer layer link block one or more to calculate for receiving from upstream outer layer Node exports the input anchor point of the output data of anchor point and one or more calculate for output data as downstream outer layer is saved The output anchor point of point input data.
Further, the outer operative stream includes source node, intermediate node and tail node, and the source node is all defeated Enter the outer layer calculate node that anchor point does not receive input data from the output anchor point of outer layer link block;The intermediate node is tool There is at least one input anchor point to receive the outer layer calculate node of input data from the output anchor point of outer layer link block, and this is outer The output data of at least one output anchor point of layer calculate node inputs the defeated of anchor point as at least one outer layer link block Enter data;The tail node is that there is at least one input anchor point to receive input data from the output anchor point of outer layer link block Outer layer calculate node, and the output data of all output anchor points of the outer layer calculate node is all without being used as outer layer link block Input anchor point input data;It includes successively executing source node, intermediate node and tail node that script, which can be performed, in the first order Computation sequence.
Further, the script file further includes the inner operative for executing at least one outer layer calculate node Script can be performed in the second level of stream, wherein the inner operative stream is including one or more internal layer calculate nodes and for receiving The output data of the upstream internal layer calculate node and data after being stored as the input data of downstream internal layer calculate node connect There are one or more input anchor points for receiving input data and one or more to use for connection module, each internal layer calculate node In the output anchor point of output data, there is each Data connection module one to be used to receive from the defeated of upstream internal layer calculate node The input anchor point of the output data of anchor point and one or more output datas that are used for are inputted as downstream internal layer calculate node out The output anchor point of data, the second level can be performed described in the computation sequence that script includes each internal layer calculate node and insertion The position for corresponding to the outer layer calculate node in script can be performed in the first order.
Specifically, the described method comprises the following steps:
Step S100 obtains outer layer calculate node and its ID, input anchor point and output anchor point;Obtain outer layer link block and Its ID, input anchor point and output anchor point;
Step S200 compares the output anchor point of the input anchor point and outer layer link block of outer layer calculate node, if outer layer meter The anchor point that fully enters of operator node is not present in the output anchor point of any outer layer link block, then by the outer layer calculate node ID is put into the outer layer calculate node ID list in the outer operative stream first order;The outer layer for comparing the outer operative stream first order calculates section The input anchor point of the output anchor point and outer layer link block of point, if the input anchor point of outer layer link block and any first order outer layer The output anchor point of calculate node is identical, then the ID of the outer layer link block is put into the connection of the outer layer in the outer operative stream first order Module I D list;
Step S300 compares the outer layer link block in the outer layer link block ID list in the outer operative stream first order The input anchor point for exporting anchor point and outer layer calculate node, is put into outer layer work for the ID of the outer layer calculate node under identical circumstances Make the outer layer calculate node ID list in the stream second level;Compare the output anchor point of the outer layer calculate node of the outer operative stream second level With the input anchor point of outer layer link block, if input anchor point and any second level outer layer calculate node of outer layer link block is defeated Anchor point is identical out, then the outer layer link block ID list being put into the ID of the outer layer link block in the outer operative stream second level;
Step S400 repeats step S300, until all outer layer calculate nodes and outer layer link block are all put into outer layer work Make to flow the outer layer calculate node ID list and outer layer link block ID list at different levels;
Step S500, by outer operative stream it is at different levels in outer layer calculate node ID list successively to add outer layer task execution suitable In sequence table.
Further, the nested type workflow setting method, further comprising the steps of:
Step S600, to the outer layer calculate node that step S100 is obtained, the internal layer for obtaining the outer layer calculate node calculates section Point and its ID, input anchor point and output anchor point, and obtain the internal layer link block and its ID, input anchor of the outer layer calculate node Point and output anchor point;
Step S610 compares the output anchor point of the input anchor point and internal layer link block of internal layer calculate node, if internal layer meter The anchor point that fully enters of operator node is not present in the output anchor point of any internal layer link block, then by the internal layer calculate node ID is put into the internal layer calculate node ID list in the inner operative stream first order;Compare the output anchor of the internal layer calculate node of the first order The input anchor point of point and internal layer link block, if the input anchor point of internal layer link block and any first order internal layer calculate node It is identical to export anchor point, then the ID of the internal layer link block is put into the column of the internal layer link block ID in the inner operative stream first order Table;
Step S620 compares the internal layer link block in the internal layer link block ID list in the inner operative stream first order The input anchor point for exporting anchor point and internal layer calculate node, is put into internal layer work for the ID of the internal layer calculate node under identical circumstances Make the internal layer calculate node ID list in the stream second level;Compare the output anchor point of the internal layer calculate node of the inner operative stream second level With the input anchor point of internal layer link block, if internal layer link block input anchor point and any inner operative stream second level internal layer The output anchor point of calculate node is identical, then the ID of the internal layer link block is put into the connection of the internal layer in the inner operative stream second level Module I D list;
Step S630 repeats step S620, until all internal layer calculate nodes and internal layer link block are all put into internal layer work Make to flow the internal layer calculate node ID list and internal layer link block ID list at different levels;
Step S640, by inner operative stream it is at different levels in internal layer calculate node ID list successively to add internal layer task execution suitable In sequence table;
Step S650 sets the configuration parameter of the internal layer calculate node to the internal layer calculate node that step S600 is obtained.
Further, in the step s 100, by determining outer layer in graphical operation interface with towed mode of operation The input anchor point of calculate node and the corresponding relationship inputted between anchor point and output anchor point for exporting anchor point and outer layer link block, The graphical operation interface includes the outer layer node pool for representing outer layer calculate node figure for rendering, outer layer connection mould is presented The outer layer link block pond of block graphics and outer operative stream editing area have on outer layer calculate node figure and respectively represent input anchor The pattern of point and output anchor point has the pattern for respectively representing input anchor point and exporting anchor point, tool on outer layer link block figure Body the following steps are included:
Step S110 drags outer layer calculate node figure to outer operative stream editing area, from outer layer from outer layer node pool Outer layer link block figure is dragged in link block pond to outer operative stream editing area, then by pulling outer layer calculate node The input anchor point or output anchor point of figure are connected with each other with the output anchor point of corresponding outer layer link block or input anchor point, thus It determines the input anchor point of outer layer calculate node and exports between the input anchor point of anchor point and outer layer link block and output anchor point Corresponding relationship.
Referring to Fig.1, there is node 11 left side square to indicate the output anchor point that input anchor point 111 and the right dot indicate 121 and 122, node 21 has input anchor point 211 and 212 and output anchor point 221 and 222, and node 22 has input anchor point 212 With output anchor point 223, node 31 has input anchor point 311 and 312 and output anchor point 321, and node 32 has input anchor point 313 With output anchor point 322;Wherein, it is connect by pulling to pass through the output anchor point 122 of node 11 with the input anchor point 211 of node 21 131 connections, in other words, connect 131 input anchor point be exactly node 11 output anchor point 122, connect 131 output anchor point just It is the input anchor point 211 of node 21;Similarly, node 21 is connect by connection 231 and 232 with node 31 and node 32 respectively, Node 22 is connect by connection 233 with node 31.
Further, in step S600, by determining internal layer in graphical operation interface with towed mode of operation The input anchor point of calculate node and the corresponding relationship inputted between anchor point and output anchor point for exporting anchor point and internal layer link block, The graphical operation interface includes the underlay nodes pond for representing internal layer calculate node figure for rendering, internal layer connection mould is presented The internal layer link block pond of block graphics and inner operative stream editing area have on internal layer calculate node figure and respectively represent input anchor The pattern of point and output anchor point has the pattern for respectively representing input anchor point and exporting anchor point, tool on internal layer link block figure Body the following steps are included:
Step S605 drags internal layer calculate node figure to inner operative stream editing area, from internal layer from underlay nodes pond Internal layer link block figure is dragged in link block pond to inner operative stream editing area, then by pulling internal layer calculate node The input anchor point or output anchor point of figure are connected with each other with the output anchor point of corresponding internal layer link block or input anchor point, thus It determines the input anchor point of internal layer calculate node and exports between the input anchor point of anchor point and internal layer link block and output anchor point Corresponding relationship.
Further, the graphical operation interface further includes the input provided for the internal layer calculate node as parameter value The parameter setting window of data clicks internal layer calculate node in internal layer Workflow editing area, pops up parameter setting window and be arranged (parameter includes but is not limited to the file address of inputoutput data, software program title used, node, nucleus number, meter to parameter Point counting area etc.).
It, can be in a manner of patterned to underlay nodes (including the node in node 2 by clicking node 2 referring to Fig. 2 2-1,2-2 and 2-3) further operation is carried out to determine the topological relation of its execution sequence, and further click on node 2-2 To be configured to its parameter 2-2-1,2-2-2 and 2-2-3.
Graphical operation interface is more friendly intuitive to user, can improve workflow configuration efficiency and accurate significantly Property.
Further, each step of the nested type workflow setting method is implemented as follows, wherein
In the step s 100, the vector set of eM outer layer calculate node is obtainedWherein For the vector of i-th of outer layer calculate nodeecnIDiFor i-th of outer layer meter The ID of operator node, ecninADi={ ecninADi1,…,ecninADieM1It is total eM1 of i-th outer layer calculate node defeated Enter the address set of anchor point, ecnoutADi={ ecnoutADi1,…,ecnoutADieM2It is the total of i-th of outer layer calculate node The address set of eM2 output anchor point of meter, calculates eCN0In all outer layer calculate nodes input anchor point address setCalculate eCN0In all outer layer calculate nodes output anchor point address set And obtain the vector set of eN outer layer link blockMould wherein is connected for j-th of outer layer The vector of blocketlIDjFor the ID of j-th of outer layer link block, etlinADj= {etlinADj1,…,etlinADjeN1It is that j-th outer layer link block amounts to the eN1 address set for inputting anchor point, etloutADj={ etloutADj1,…,etloutADjeN2It is amounting to eN2 and exporting anchor point for j-th outer layer link block Address set calculates eTL0In all outer layer link blocks input anchor point address setMeter Calculate eTL0In all outer layer link blocks output anchor point address set
In step s 200, from the vector set eCN of outer layer calculate node0In extract one by oneEcnIDiWith ecninADi, the value of i is 1 ... eM, if ecninADi∩ tetloutAD=Φ, wherein Φ is empty set, then by ecnIDiIt is added outer The set escnID of layer source node ID1, thus obtain the eN of the workflow first ordersn1The ID set escnID of a outer layer source node1 ={ ecnID1,…,ecnIDNsn1And vector setCalculate esCN1 In all outer layer calculate nodes output anchor point address setMeter Calculate the vector set erCN of remaining outer layer calculate node1=eCN0-esCN1And its address set of input anchor point
From eTL0Middle extractionAnd etlinADjk∈ tescnoutAD1Outer layer link block vector set as the workflow first order, thus obtain the outer layer of the workflow first order The number of link block is eNst1=| esTL1|, ID collection is combined intoExport the ground of anchor point Location collection is combined intoCalculate remaining outer layer link block vector set erTL1=eTL0-esTL1
In step S300, from erCN1Middle extractionAnd ecninADjk∈testloutAD1Outer layer calculate node vector set as the workflow second level, thus obtain workflow The number of the outer layer calculate node of second level is eNsn2=| esCN2|, ID collection is combined into Output anchor point address set beRemaining outer layer is calculated to calculate The vector set erCN of node2=erCN1-esCN2
From erTL1Middle extractionAnd etlinADjk∈ tescnoutAD2Outer layer link block vector set as the workflow second level, thus obtain the outer layer of the workflow second level The number of link block is eNst2=| esTL2|, ID collection is combined intoExport the ground of anchor point Location collection is combined intoCalculate remaining outer layer link block vector set erTL2=erTL1-esTL2
In step S400, repeat step S300 until reach JT grades of workflow, remaining outer layer calculate node to Duration set erCNJT=erCN(JT-2)-erCNJT=Φ, and erTL(JT-1)=eTL(JT-3)-esTL(JT-1)=Φ;
Step S500 forms work flow vector JV=(escnID1,escnID3,…,escnIDJT) appoint as the outer layer Business execution sequence list.
Similarly the method in above-mentioned steps also can be applied to step 600 to step 640, to outer layer calculate node ecnIDiInternal layer calculate node and link block handled, until reach inner operative stream TTiGrade, remaining outer layer meter The vector set irCN of operator nodeTTi=irCN(TTi-2)-irCNTTi=Φ, and irTL(TTi-1)=iTL(TTi-3)-isTL(TTi-1) =Φ;To form workflow vector T V in step 650i=(iscnID1,iscnID3,…,iscnIDTTi) as described outer Layer calculate node ecnIDiInternal layer task execution sequence list.
Using nested type workflow setting method of the invention, more efficiently workflow can be configured, matched Executable script is generated for outer operative stream and each inner operative stream with can be convenient after the completion of setting.When executing workflow, After the execution sequence list (such as workflow management sequence array) for obtaining outer operative stream, in sequence, the number is successively traversed All outer node layers of group record successively execute the corresponding inner operative stream of the node and execute foot for the ID of each node This.For example, specific execution operation is as follows: a) logging in Milky Way supercomputer by SSH mode, is mentioned by order line form Perform script is handed over, " yhbatch-N N1-p P1-n n1 XXX.bat ", wherein N1 is number of nodes, and data type is integer;P1 For partition name, data type is character string;N1 is nucleus number, and data type is integer;XXX.bat is mission script filename, Data type is character string.B) executive condition of the setting control Programmable detection workflow utilizes the return value of " yhq " order to make For judgement symbol.If return value is sky, then it represents that execute completion;It is not completed conversely, then executing.C) when the inner operative stream executes After the completion, it returns to calculate and successfully prompt.After the completion of the corresponding inner operative stream of all nodes of outer layer executes, workflow execution is then It completes.
According to disclosed specification of the invention, other realizations of the invention are obvious for those skilled in the art 's.The various aspects of embodiment and/or embodiment can be used for system of the invention and side individually or with any combination In method.Specification and example therein should be only be regarded solely as it is exemplary, the actual scope of the present invention and spirit by appended right Claim indicates.

Claims (6)

1. a kind of nested type workflow setting method, comprising the following steps:
Step S100 obtains outer layer calculate node and its ID, input anchor point and output anchor point;Obtain outer layer link block and its ID, input anchor point and output anchor point;
Step S200 compares the output anchor point of the input anchor point and outer layer link block of outer layer calculate node, if outer layer calculates section The anchor point that fully enters of point is not present in the output anchor point of any outer layer link block, then is put the ID of the outer layer calculate node Enter the outer layer calculate node ID list in the outer operative stream first order;Compare the outer layer calculate node of the outer operative stream first order The input anchor point of anchor point and outer layer link block is exported, if the input anchor point of outer layer link block and any first order outer layer calculate The output anchor point of node is identical, then the outer layer link block being put into the ID of the outer layer link block in the outer operative stream first order ID list;
Step S300 compares the output of the outer layer link block in the outer layer link block ID list in the outer operative stream first order The input anchor point of anchor point and outer layer calculate node, is put into outer operative stream for the ID of the outer layer calculate node under identical circumstances Outer layer calculate node ID list in the second level;Compare the output anchor point of the outer layer calculate node of the outer operative stream second level and outer The input anchor point of layer link block, if the output anchor of the input anchor point and any second level outer layer calculate node of outer layer link block Identical, the then outer layer link block ID list being put into the ID of the outer layer link block in the outer operative stream second level of point;
Step S400 repeats step S300, until all outer layer calculate nodes and outer layer link block are all put into outer operative stream Outer layer calculate node ID list and outer layer link block ID list at different levels;
Step S500, by outer operative stream it is at different levels in outer layer calculate node ID list successively add outer layer task execution sequence and arrange In table.
2. the nested type workflow setting method according to claim 1, further comprising the steps of:
Step S600, to step S100 obtain outer layer calculate node, obtain the outer layer calculate node internal layer calculate node and Its ID, input anchor point and output anchor point, and obtain the outer layer calculate node internal layer link block and its ID, input anchor point and Export anchor point;
Step S610 compares the output anchor point of the input anchor point and internal layer link block of internal layer calculate node, if internal layer calculates section The anchor point that fully enters of point is not present in the output anchor point of any internal layer link block, then is put the ID of the internal layer calculate node Enter the internal layer calculate node ID list in the inner operative stream first order;Compare the output anchor point of the internal layer calculate node of the first order with The input anchor point of internal layer link block, if the output of the input anchor point and any first order internal layer calculate node of internal layer link block Anchor point is identical, then the internal layer link block ID list being put into the ID of the internal layer link block in the inner operative stream first order;
Step S620 compares the output of the internal layer link block in the internal layer link block ID list in the inner operative stream first order The input anchor point of anchor point and internal layer calculate node, is put into inner operative stream for the ID of the internal layer calculate node under identical circumstances Internal layer calculate node ID list in the second level;Compare the output anchor point of the internal layer calculate node of the inner operative stream second level with it is interior The input anchor point of layer link block, if the input anchor point of internal layer link block and the internal layer of any inner operative stream second level calculate The output anchor point of node is identical, then the internal layer link block being put into the ID of the internal layer link block in the inner operative stream second level ID list;
Step S630 repeats step S620, until all internal layer calculate nodes and internal layer link block are all put into inner operative stream Internal layer calculate node ID list and internal layer link block ID list at different levels;
Step S640, by inner operative stream it is at different levels in internal layer calculate node ID list successively add internal layer task execution sequence and arrange In table.
3. the nested type workflow setting method according to claim 2, further comprising the steps of:
Step S650 sets the configuration parameter of the internal layer calculate node to the internal layer calculate node that step S600 is obtained.
4. the nested type workflow setting method as claimed in one of claims 1-3, wherein in the step s 100, lead to Cross the input anchor point and output anchor point and outer for determining outer layer calculate node with towed mode of operation in graphical operation interface Corresponding relationship between the input anchor point and output anchor point of layer link block, the graphical operation interface include generation for rendering The outer layer node pool of off-balancesheet layer calculate node figure, the outer layer link block pond that outer layer link block figure is presented and outer operative Editing area is flowed, there is the pattern for respectively representing input anchor point and exporting anchor point, outer layer link block on outer layer calculate node figure There is the pattern for respectively representing input anchor point and exporting anchor point on figure, specifically includes the following steps:
Step S110 drags outer layer calculate node figure to outer operative stream editing area from outer layer node pool, connects from outer layer Outer layer link block figure is dragged in module pond to outer operative stream editing area, then by pulling outer layer calculate node figure Input anchor point or output anchor point and the output anchor point of corresponding outer layer link block or input anchor point interconnection, so that it is determined that It is corresponding between the input anchor point and output anchor point of outer layer calculate node and the input anchor point of outer layer link block and output anchor point Relationship.
5. the nested type workflow setting method according to claim 4, wherein in step S600, by graphical The input anchor point of internal layer calculate node is determined with towed mode of operation in operation interface and exports anchor point and internal layer link block Input anchor point and export anchor point between corresponding relationship, the graphical operation interface include represent for rendering internal layer calculating The underlay nodes pond of node figure, the internal layer link block pond that internal layer link block figure is presented and inner operative stream editing area, There is the pattern for respectively representing input anchor point and exporting anchor point on internal layer calculate node figure, have on internal layer link block figure It respectively represents input anchor point and exports the pattern of anchor point, specifically includes the following steps:
Step S605 drags internal layer calculate node figure to inner operative stream editing area from underlay nodes pond, connects from internal layer Internal layer link block figure is dragged in module pond to inner operative stream editing area, then by pulling internal layer calculate node figure Input anchor point or output anchor point and the output anchor point of corresponding internal layer link block or input anchor point interconnection, so that it is determined that It is corresponding between the input anchor point and output anchor point of internal layer calculate node and the input anchor point of internal layer link block and output anchor point Relationship.
6. the nested type workflow setting method as claimed in one of claims 1-5, wherein
In the step s 100, the vector set of eM outer layer calculate node is obtainedWherein for The vector of i-th of outer layer calculate nodeecnIDiFor i-th of outer layer calculate node ID,For the ground for amounting to eM1 input anchor point of i-th of outer layer calculate node Location set,For eM2 output anchor of total of i-th of outer layer calculate node The address set of point calculates eCN0In all outer layer calculate nodes input anchor point address set Calculate eCN0In all outer layer calculate nodes output anchor point address setAnd it obtains The vector set of eN outer layer link blockWherein for the vector of j-th of outer layer link blocketlIDjFor the ID of j-th of outer layer link block, Total eN1 for j-th of outer layer link block inputs the address set of anchor point, For the address set for amounting to eN2 output anchor point of j-th of outer layer link block, eTL is calculated0In all outer layer link blocks Input the address set of anchor pointCalculate eTL0In all outer layer link blocks output anchor point ground Location set
In step s 200, from the vector set eCN of outer layer calculate node0In extract one by oneEcnIDiAnd ecninADi, The value of i be 1 ... eM, if ecninADi∩ tetloutAD=Φ, wherein Φ is empty set, then by ecnIDiOuter layer source node ID is added Set escnID1, thus obtain the eN of the workflow first ordersn1The ID set escnID of a outer layer source node1= {ecnID1,…,ecnIDNsn1And vector setCalculate esCN1In The address set of the output anchor point of all outer layer calculate nodesIt calculates The vector set erCN of remaining outer layer calculate node1=eCN0-esCN1And its address set of input anchor point
From eTL0Middle extractionAnd etlinADjk∈tescnoutAD1Conduct The outer layer link block vector set of the workflow first order, the number for thus obtaining the outer layer link block of the workflow first order are eNst1=| esTL1|, ID collection is combined intoOutput anchor point address set beCalculate remaining outer layer link block vector set erTL1=eTL0- esTL1
In step S300, from erCN1Middle extractionAnd ecninADjk ∈testloutAD1Outer layer calculate node vector set as the workflow second level, thus obtain the outer of the workflow second level The number of layer calculate node is eNsn2=| esCN2|, ID collection is combined intoExport anchor Point address set beCalculate remaining outer layer calculate node Vector set erCN2=erCN1-esCN2
From erTL1Middle extractionAnd etlinADjk∈tescnoutAD2Make For the outer layer link block vector set of the workflow second level, the number of the outer layer link block of the workflow second level is thus obtained For eNst2=| esTL2|, ID collection is combined intoOutput anchor point address set beCalculate remaining outer layer link block vector set erTL2= erTL1-esTL2
In step S400, step S300 is repeated until JT grades of workflow of arrival, the vector set of remaining outer layer calculate node Close erCNJT=erCN(JT-2)-erCNJT=Φ, and erTL(JT-1)=eTL(JT-3)-esTL(JT-1)=Φ;
Step S500 forms work flow vector JV=(escnID1,escnID3,…,escnIDJT) held as the outer layer task Row sequence list.
CN201810696802.9A 2018-06-29 2018-06-29 Nested workflow setting method Active CN109002351B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810696802.9A CN109002351B (en) 2018-06-29 2018-06-29 Nested workflow setting method
CN202010258341.4A CN111475271B (en) 2018-06-29 2018-06-29 Workflow setting method based on outer computing node

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810696802.9A CN109002351B (en) 2018-06-29 2018-06-29 Nested workflow setting method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202010258341.4A Division CN111475271B (en) 2018-06-29 2018-06-29 Workflow setting method based on outer computing node

Publications (2)

Publication Number Publication Date
CN109002351A true CN109002351A (en) 2018-12-14
CN109002351B CN109002351B (en) 2020-05-05

Family

ID=64602119

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810696802.9A Active CN109002351B (en) 2018-06-29 2018-06-29 Nested workflow setting method
CN202010258341.4A Active CN111475271B (en) 2018-06-29 2018-06-29 Workflow setting method based on outer computing node

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202010258341.4A Active CN111475271B (en) 2018-06-29 2018-06-29 Workflow setting method based on outer computing node

Country Status (1)

Country Link
CN (2) CN109002351B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101071480A (en) * 2007-06-15 2007-11-14 南京联创科技股份有限公司 Universal structured process dispatch method based on work flowfor complicated service system
CN101216911A (en) * 2008-01-04 2008-07-09 清华大学 Dynamic workflow model subdivision method supporting distributed execution
CN102324069A (en) * 2011-09-02 2012-01-18 北京致远协创软件有限公司 Workflow establishing method and workflow establishing system
CN104317642A (en) * 2014-09-28 2015-01-28 华为技术有限公司 Method and device for configuring software in cloud calculation environment
CN105447643A (en) * 2015-11-30 2016-03-30 北京航空航天大学 Cloud computing platform-oriented scientific workflow system and method
CN105868431A (en) * 2015-01-22 2016-08-17 京微雅格(北京)科技有限公司 Anchor point based wiring method
CN106878356A (en) * 2015-12-11 2017-06-20 中国移动通信集团公司 A kind of dispatching method and calculate node

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8718382B2 (en) * 2012-01-31 2014-05-06 Synopsys, Inc. Scalable pattern matching between a pattern clip and a pattern library
CN103297984B (en) * 2013-05-29 2016-04-13 烽火通信科技股份有限公司 A kind of system and method for WDM network topology structure vector quantization

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101071480A (en) * 2007-06-15 2007-11-14 南京联创科技股份有限公司 Universal structured process dispatch method based on work flowfor complicated service system
CN101216911A (en) * 2008-01-04 2008-07-09 清华大学 Dynamic workflow model subdivision method supporting distributed execution
CN102324069A (en) * 2011-09-02 2012-01-18 北京致远协创软件有限公司 Workflow establishing method and workflow establishing system
CN104317642A (en) * 2014-09-28 2015-01-28 华为技术有限公司 Method and device for configuring software in cloud calculation environment
CN105868431A (en) * 2015-01-22 2016-08-17 京微雅格(北京)科技有限公司 Anchor point based wiring method
CN105447643A (en) * 2015-11-30 2016-03-30 北京航空航天大学 Cloud computing platform-oriented scientific workflow system and method
CN106878356A (en) * 2015-12-11 2017-06-20 中国移动通信集团公司 A kind of dispatching method and calculate node

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
宋炜炜: "基于时空信息云平台的空间大数据管理和高性能计算研究", 《中国博士学位论文全文数据库基础科学辑(月刊 )》 *
王小龙,等;: "GMA架构下监控信息工作流模型探讨", 《甘肃科学学报》 *

Also Published As

Publication number Publication date
CN111475271B (en) 2023-04-25
CN109002351B (en) 2020-05-05
CN111475271A (en) 2020-07-31

Similar Documents

Publication Publication Date Title
US20070271499A1 (en) Signal navigation and label propagation in block diagrams
CN104834479A (en) Method and system for automatically optimizing configuration of storage system facing cloud platform
CN107563596A (en) A kind of evaluation index equilibrium state analysis method based on Bayes's causal network
CN103605869B (en) Towards the three-dimensional implementation digital prototype system and its construction method of spacecraft
CN106096644B (en) Method for measuring similarity and device based on probability workflow
CN102160050A (en) Systems and methods for the determination of active constraints in a network using slack variables
CN104866585A (en) Comprehensive processing system for experimental flight-test data
CN101320315A (en) Apparatus for generating job network flow from job control statement described in job control language and its method
Leung et al. Scalable semantic annotation using lattice-based ontologies
CN103149840B (en) Semanteme service combination method based on dynamic planning
CN103226728A (en) Intelligent detection and yield optimization method for HDPE (high density polyethylene) cascade polymerization reaction course
CN108958937A (en) A kind of templating calculating environment configurations method
CN102331987A (en) Patent data mining system and method
CN109002351A (en) A kind of nested type workflow setting method
Bile et al. Towards automating the sizing process in conceptual (airframe) systems architecting
CN104899042A (en) Embedded machine vision inspection program development method and system
Kolcio et al. Model-based approach to rover health assessment for increased productivity
CN106682275A (en) Load processing method and device for industrial plant structural modeling
CN104408326B (en) A kind of appraisal procedure to survey of deep space independent navigation filtering algorithm
CN108536919B (en) Lunar exploration spacecraft offline task efficiency evaluation system and evaluation method thereof
CN106777676A (en) A kind of correlating method of the design and processes task based on structure matrix
CN107682193A (en) A kind of common communication multi-business flow method of estimation
Alston et al. High fidelity multidisciplinary optimization (HFMDO)
Austin et al. Rapid SmallSat Mission Formulation: Integrated and Concurrent Modeling in JPL's Team Xc
CN108875208A (en) Multi-body Satellite dynamic system calculation method and system based on set membership iteration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant