CN111475296B - Computing environment configuration method based on inner and outer layer workflows - Google Patents
Computing environment configuration method based on inner and outer layer workflows Download PDFInfo
- Publication number
- CN111475296B CN111475296B CN202010258332.5A CN202010258332A CN111475296B CN 111475296 B CN111475296 B CN 111475296B CN 202010258332 A CN202010258332 A CN 202010258332A CN 111475296 B CN111475296 B CN 111475296B
- Authority
- CN
- China
- Prior art keywords
- computer software
- input
- anchor point
- computing node
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
Abstract
The invention relates to a computing environment configuration method based on inner and outer layer workflows, which comprises the following steps: receiving a selection operation of selecting a computer software group from a computer software group list by a user, or receiving a selection operation of selecting computer software from the computer software group list by the user so as to form a new computer software group; receiving a selection operation of selecting a parameter configuration file from a parameter configuration file list of each computer software in the computer software group by a user, or receiving a parameter value input by the user so as to form a parameter value input operation of a new parameter configuration file; receiving a selection operation of selecting a script file from a script file list of the computer software group by a user, or receiving a script command input operation of forming a new script file by a script command input by the user; and forming a templated computing environment according to the computer software group, the parameter configuration file and the script file. The invention can ensure that a user can accurately, conveniently and rapidly perform the configuration of the computing environment in the process of using the supercomputer.
Description
Technical Field
The invention relates to a computing environment configuration method based on inner and outer layer workflows.
Background
The super computer is a huge computer system, and is mainly used for bearing large-scale calculation tasks and data processing tasks in the fields of important scientific research, national defense tip technology and national economy, such as large-scale weather forecast, satellite photograph arrangement, atomic nucleus physical exploration, intercontinental missile research, spacecraft and the like. Therefore, supercomputers are typically equipped with extensive amounts of computer software to facilitate calls as needed in different applications. However, since the combinations of computer software needed in different application fields are different, the parameter configuration of each computer software is different, and the amount of data processed is different, it is necessary to configure the computing environment before the job is executed. Because of the vast amount of computer software, frequent upgrades and changes, how to accurately, conveniently and quickly configure a computing environment has become an important need for users to use supercomputers for reasons such as the fact that some users are not familiar with supercomputer systems, software and usage.
Disclosure of Invention
In order to solve the technical problem, the present invention provides a computing environment configuration method based on an inner-outer workflow, wherein the computing environment includes a computer software group, a parameter configuration file of each computer software in the computer software group, and a script file for executing the computer software group, and the configuration method includes the following steps:
step S100, receiving a selection operation of selecting a computer software group from a computer software group list by a user, or receiving a selection operation of selecting computer software from a computer software list by a user so as to form a new computer software group;
step S300, receiving a selection operation of selecting a parameter configuration file from a parameter configuration file list of each computer software in the computer software group by a user, or receiving a parameter value input by the user so as to form a parameter value input operation of a new parameter configuration file;
step S500, receiving a selection operation of selecting a script file from a script file list of the computer software group by a user, or receiving a script command input operation of forming a new script file by a script command input by the user;
and step S700, forming a templated computing environment according to the computer software group, the parameter configuration file and the script file.
The invention can ensure that a user can accurately, conveniently and rapidly perform the configuration of the computing environment in the process of using the supercomputer.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
FIG. 2 is a schematic diagram of a graphical interface in one embodiment of the invention;
FIG. 3 is a schematic diagram of a workflow topology in the present invention;
FIG. 4 is a schematic diagram of a nested workflow in accordance with the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings. The description herein describes specific embodiments, by way of illustration and not limitation, consistent with the principles of the present invention, which are described in sufficient detail to enable those skilled in the art to practice the invention, other embodiments may be utilized and the structure of elements may be changed and/or replaced without departing from the scope and spirit of the invention. The following detailed description is, therefore, not to be taken in a limiting sense.
The invention provides a computing environment configuration method based on inner and outer layer workflows, wherein the computing environment mainly comprises a computer software group which is required to run on a high-performance computer such as a Tianhe series supercomputer and comprises a plurality of computer software for executing a job, each task in the job requires one or more software processes in the software group, a parameter configuration file of each computer software in the computer software group which is determined according to the type and the requirement of the job and the task, such as grid parameters which are required to be determined by computing fluid mechanics software Fluent and the like, and a script file used for executing the job, such as the execution sequence of each task or software, the number of computing nodes, the number of cores, the computing partition and the like which are required to be distributed for each task. Referring to fig. 1 and 2, the configuration method includes the steps of:
step S010, receiving a selection operation of selecting a job type from a job type list by a user, or receiving input information of the user to create a job type input operation of a new job type;
step S100, receiving a selection operation of selecting a computer software group from a computer software group list corresponding to the job type by a user; or receiving a selection operation of selecting the computer software from the computer software list by a user so as to form a new computer software group;
step S300, receiving a selection operation of selecting a parameter configuration file from a parameter configuration file list of each computer software in the computer software group by a user, or receiving a parameter value input by the user so as to form a parameter value input operation of a new parameter configuration file;
step S500, receiving a selection operation of selecting a script file from a script file list of the computer software group by a user, or receiving a script command input operation of forming a new script file by a script command input by the user;
and step S700, forming a templated computing environment according to the computer software group, the parameter configuration file and the script file.
Further, to facilitate the user to select the most frequently used software group, parameter value and script in the history, step S100 further includes: increasing the weight of the selected computer software group to be preferentially displayed in the computer software group list; or adding the new computer software group to the computer software group list; step S300 further includes: the operation of adding the selected parameter configuration file to preferentially display the weight in the parameter configuration file list; or adding the new parameter configuration file to the parameter configuration file list; step S500 further includes: increasing the priority display weight of the selected script file in the script file list; or an operation of adding a new script file to the script file list. For example, the priority display weight may be a value of the frequency or the duty ratio of the corresponding option selected in the history record, and obviously, the larger the value is, the more the number of times the option is selected, the greater the possibility of realizing the job requirement is, so that all the options can be arranged from high to low according to the priority display weight, so that the option with high priority display weight is convenient for the user to judge and select. Preferably, the individual options and the values of their preferential display weights may be displayed together. Preferably, the user may be presented with several options with the highest priority display weights, e.g., 5-10 options, first, and not with the remaining options, or only when the user further clicks or the like.
Further, step S100 further includes: an operation of modifying a selected set of computer software from a list of sets of computer software, wherein the modification is selected from the group of computer software selected for adding, deleting or replacing to the computer software in the selected set of computer software; and adding the modified computer software group to a computer software group list; step S300 further includes: modifying the parameter values in the selected parameter configuration file; and adding the modified parameter profile to the parameter profile list; step S500 further includes: modifying the instruction in the selected script file; and an operation of adding the modified script file to the script file list. In this way new options can be added continuously.
In some cases, the data structures adopted by the computer software executing different tasks in the job are different, for example, the output data of the upstream software may need to be converted to be the input data of the downstream software; in addition, the upstream software may output a plurality of different data, and the downstream software needs part of the data as input data; therefore, a workflow needs to be formulated in the script file to smoothly complete the job. Further, the script file includes a first level executable script that executes an outer layer workflow, wherein the outer layer workflow includes outer layer computing nodes formed by respective computer software in a set of computer software and a data conversion connection module for receiving output data of an upstream outer layer computing node and converting it into input data of a downstream outer layer computing node, each outer layer computing node having one or more input anchors for receiving the input data and one or more output anchors for outputting the data, each data conversion connection module having one or more input anchors for receiving output data from the output anchors of the upstream outer layer computing node and one or more output anchors for outputting the data as the input data of the downstream outer layer computing node, the first level executable script including a computation order of the respective outer layer computing nodes.
Further, the outer workflow comprises a source node, an intermediate node and a tail node, wherein the source node is an outer computing node of which all input anchors do not receive input data from output anchors of the data conversion connection module; the intermediate node is an outer layer computing node having at least one input anchor point for receiving input data from an output anchor point of the data conversion connection module, and the output data of the at least one output anchor point of the outer layer computing node is used as the input data of the input anchor point of the at least one data conversion connection module; the tail node is an outer layer computing node which is provided with at least one input anchor point and receives input data from the output anchor points of the data conversion connection module, and the output data of all the output anchor points of the outer layer computing node are not used as the input data of the input anchor points of the data conversion connection module; the first-level executable script includes a sequence of computations to sequentially execute a source node, an intermediate node, and a tail node.
Further, the script file further includes a second-level executable script for executing an inner-layer workflow of at least one of the outer-layer computing nodes, wherein the inner-layer workflow includes one or more inner-layer computing nodes and a data connection module for receiving and storing output data of an upstream inner-layer computing node as input data of a downstream inner-layer computing node, each inner-layer computing node having one or more input anchors for receiving the input data and one or more output anchors for outputting the data, each data connection module having one input anchor for receiving the output data from the output anchor of the upstream inner-layer computing node and one or more output anchors for outputting the data as input data of the downstream inner-layer computing node, the second-level executable script including a calculation order of the respective inner-layer computing nodes and being embedded in the first-level executable script at a position corresponding to the outer-layer computing node.
The invention can ensure that a user can accurately, conveniently and rapidly perform the configuration of the computing environment in the process of using the supercomputer.
Further, the calculation sequence of each outer layer calculation node in the first-level executable script is calculated by the following steps:
step S610, obtaining an outer layer computing node and an ID, an input anchor point and an output anchor point thereof; obtaining an outer layer connection module and an ID, an input anchor point and an output anchor point thereof;
step S620, comparing the input anchor points of the outer computing nodes with the output anchor points of the outer connecting modules, and if all the input anchor points of the outer computing nodes are not in the output anchor points of any outer connecting modules, putting the ID of the outer computing nodes into an outer computing node ID list in the first stage of the outer workflow; comparing the output anchor point of the outer layer computing node of the first stage of the outer layer workflow with the input anchor point of the outer layer connecting module, and if the input anchor point of the outer layer connecting module is the same as the output anchor point of any outer layer computing node of the first stage, putting the ID of the outer layer connecting module into an ID list of the outer layer connecting module in the first stage of the outer layer workflow;
step S630, comparing the output anchor point of the outer layer connection module in the outer layer connection module ID list in the first stage of the outer layer workflow with the input anchor point of the outer layer calculation node, and under the same condition, putting the ID of the outer layer calculation node into the outer layer calculation node ID list in the second stage of the outer layer workflow; comparing the output anchor point of the outer layer computing node of the second stage of the outer layer workflow with the input anchor point of the outer layer connecting module, and if the input anchor point of the outer layer connecting module is the same as the output anchor point of any second stage outer layer computing node, putting the ID of the outer layer connecting module into an outer layer connecting module ID list in the second stage of the outer layer workflow;
step S640, repeating step S630 until all the outer computing nodes and the outer connection modules are put into the outer computing node ID list and the outer connection module ID list in each stage of the outer workflow;
step S650, sequentially adding the outer layer computing node ID list in each stage of the outer layer workflow to the outer layer task execution order list.
Further, the nested workflow setting method further comprises the following steps:
step S660, for the outer layer computing node obtained in step S610, obtaining an inner layer computing node and an ID, an input anchor point and an output anchor point of the outer layer computing node, and obtaining an inner layer connecting module and an ID, an input anchor point and an output anchor point of the outer layer computing node;
step S661, comparing the input anchor points of the inner computing nodes with the output anchor points of the inner connecting modules, if all the input anchor points of the inner computing nodes are not in the output anchor points of any inner connecting modules, putting the ID of the inner computing nodes into an inner computing node ID list in the first stage of the inner workflow; comparing the output anchor point of the inner layer computing node of the first stage with the input anchor point of the inner layer connecting module, and if the input anchor point of the inner layer connecting module is the same as the output anchor point of any inner layer computing node of the first stage, putting the ID of the inner layer connecting module into an ID list of the inner layer connecting module in the first stage of the inner layer workflow;
step S662, comparing the output anchor point of the inner layer connection module in the inner layer connection module ID list in the first stage of the inner layer workflow with the input anchor point of the inner layer calculation node, and under the same condition, putting the ID of the inner layer calculation node into the inner layer calculation node ID list in the second stage of the inner layer workflow; comparing the output anchor point of the inner layer computing node of the second stage of the inner layer workflow with the input anchor point of the inner layer connecting module, and if the input anchor point of the inner layer connecting module is the same as the output anchor point of the inner layer computing node of any inner layer workflow second stage, putting the ID of the inner layer connecting module into an inner layer connecting module ID list in the second stage of the inner layer workflow;
step S663, repeating the step S662 until all the inner layer computing nodes and the inner layer connecting modules are put into an inner layer computing node ID list and an inner layer connecting module ID list in each level of the inner layer workflow;
s664, sequentially adding the ID list of the inner computing node in each level of the inner workflow into an inner task execution sequence list;
step S665, setting configuration parameters of the inner layer computing node for the inner layer computing node obtained in step S610.
Further, in step S610, the correspondence between the input anchor point and the output anchor point of the outer computing node and the input anchor point and the output anchor point of the outer connecting module are determined by a drag operation manner on a graphical operation interface, where the graphical operation interface includes an outer node pool for presenting a graph representing the outer computing node, an outer connecting module pool for presenting a graph of the outer connecting module, and an outer workflow editing area, the graph of the outer computing node has patterns representing the input anchor point and the output anchor point, and the graph of the outer connecting module has patterns representing the input anchor point and the output anchor point, respectively, and specifically includes the following steps:
step S611, drag the outer computing node graph from the outer node pool to the outer workflow editing area, drag the outer connecting module graph from the outer connecting module pool to the outer workflow editing area, and then connect the input anchor point or output anchor point of the outer computing node graph with the output anchor point or input anchor point of the corresponding outer connecting module by dragging, thereby determining the corresponding relation between the input anchor point and output anchor point of the outer computing node and the input anchor point and output anchor point of the outer connecting module.
Referring to fig. 3, node 11 has left square blocks representing input anchor points 111 and right dot representing output anchor points 121 and 122, node 21 has input anchor points 211 and 212 and output anchor points 221 and 222, node 22 has input anchor points 212 and output anchor point 223, node 31 has input anchor points 311 and 312 and output anchor point 321, and node 32 has input anchor point 313 and output anchor point 322; wherein, the output anchor 122 of the node 11 is connected with the input anchor 211 of the node 21 through the connection 131 by dragging, in other words, the input anchor of the connection 131 is the output anchor 122 of the node 11, and the output anchor of the connection 131 is the input anchor 211 of the node 21; similarly, node 21 is connected to node 31 and node 32 by connections 231 and 232, respectively, and node 22 is connected to node 31 by connection 233.
Further, in step S600, the correspondence between the input anchor point and the output anchor point of the inner computing node and the input anchor point and the output anchor point of the inner connecting module are determined by a drag operation manner on a graphical operation interface, where the graphical operation interface includes an inner node pool for presenting a graph representing the inner computing node, an inner connecting module pool for presenting a graph of the inner connecting module, and an inner workflow editing area, the graph of the inner computing node has patterns representing the input anchor point and the output anchor point, and the graph of the inner connecting module has patterns representing the input anchor point and the output anchor point, respectively, and specifically includes the following steps:
dragging an inner computing node graph from an inner node pool to an inner workflow editing area, dragging an inner connecting module graph from an inner connecting module pool to the inner workflow editing area, and then connecting an input anchor point or an output anchor point of the inner computing node graph with an output anchor point or an input anchor point of a corresponding inner connecting module through dragging, so that the corresponding relation between the input anchor point and the output anchor point of the inner computing node and the input anchor point and the output anchor point of the inner connecting module is determined.
Further, the graphical operation interface further comprises a parameter setting window for providing the inner computing node with input data as parameter values, clicking the inner computing node in the inner workflow editing area, popping up the parameter setting window and setting parameters (the parameters include, but are not limited to, file addresses of input and output data, names of used software programs, nodes, cores, computing partitions, and the like).
Referring to fig. 4, by clicking on node 2, further operations may be performed graphically on the inner level nodes in node 2 (including nodes 2-1,2-2 and 2-3) to determine the topological relationship of their execution order, and further clicking on node 2-2 to set its parameters 2-2-1, 2-2-2 and 2-2-3.
The graphical operation interface is more friendly and visual to the user, and the workflow configuration efficiency and accuracy can be remarkably improved.
Further, the steps of the nested workflow setting method are implemented in a manner wherein,
in step S610, a vector set of eM outer layer computing nodes is obtained
Wherein vector for the ith outer computing node +.>
ecnID i Calculating the ID of the node for the ith outer layer, ecninAD i ＝{ecninAD i1 ,…,ecninAD ieM1 Aggregate eM1 input anchor address set for ith outer layer compute node, eccutAD i ＝{ecnoutAD i1 ,…,ecnoutAD ieM2 Aggregate eM2 output anchor address set for ith outer layer compute node, compute eCN 0 Address set of input anchor points of all outer layer computing nodes in the network
Calculation eCN 0 Address set of output anchor point of all outer layer computing nodes +.>
And obtaining a vector set of eN outer connection modules +.>
Wherein vector for j-th outer connection module +.>
etlID j etlinAD for the ID of the j-th outer connection module j ＝{etlinAD j1 ,…,etlinAD jeN1 Aggregate address set of eN1 input anchor points aggregated for jth outer layer connection module, etloutAD j ＝{etloutAD j1 ,…,etloutAD jeN2 Aggregate eN2 output anchor address set for j-th outer layer connection module, calculate eTL 0 Address set of input anchor point of all outer layer connection modules +.>
Calculation eTL 0 All outer layer connecting modules of the deviceAddress set of out anchor point->
In step S620, the vector set eCN of the node is calculated from the outer layer 0 Extracting one by one
Is (1) ecnID i And ecninAD i I has a value of 1 … eM, if ecninAD i Inverted tetloutload=Φ, where Φ is the empty set, then the ecndid will be i Joining a set of outer source node IDs escnIDs 1 Thereby obtaining the eN of the first stage of the workflow sn1 ID set escnID of each outer source node 1 ＝{ecnID 1 ,…,ecnID Nsn1 ' vector set>
Calculation of esCN 1 Address set of output anchor point of all outer layer computing nodes +.>
Computing a vector set erCN of remaining outer computing nodes 1 ＝eCN 0 -esCN 1 Address set of input anchor point
From eTL 0 Extraction of the Chinese medicine
And etlinAD jk ∈tescnoutAD 1 The outer layer connection module vector set used as the first stage of the workflow is obtained, and the number of the outer layer connection modules of the first stage of the workflow is eN st1 ＝|esTL 1 I, ID set is->
The address set of the output anchor point is
Calculating remaining outer connection module vector set erTL 1 ＝eTL 0 -esTL 1 ；
In step S630, the slave erCN 1 Extraction of the Chinese medicine
And ecninAD jk ∈testloutAD 1 The outer layer computing node vector set of the second stage of the workflow is obtained, and the number of the outer layer computing nodes of the second stage of the workflow is eN sn2 ＝|esCN 2 I, ID set is->
The address set of the output anchor is +.>
Computing a vector set erCN of remaining outer computing nodes 2 ＝erCN 1 -esCN 2 ；
Slave erTL 1 Extraction of the Chinese medicine
And etlinAD jk ∈tescnoutAD 2 The outer layer connection module vector set used as the second stage of the workflow is obtained, and the number of the outer layer connection modules of the second stage of the workflow is eN st2 ＝|esTL 2 I, ID set is->
The address set of the output anchor point is
Calculating remaining outer connection module vector set erTL 2 ＝erTL 1 -esTL 2 ；
In step S640, step S630 is repeated until the jth stage of the workflow is reached, and the vector set erCN of the remaining outer computing nodes JT ＝erCN (JT-2) -erCN JT =Φ, and erTL (JT-1) ＝eTL (JT-3) -esTL (JT-1) ＝Φ；
In step S650, a workflow vector jv= (escndid is formed 1 ,escnID 3 ,…,escnID JT ) As the outer task execution order list.
The method similar to the above steps can be applied to steps 600 to 640, and calculates the ecnID of the node to the outside layer i The inner computing node and the connection module of the (E) are processed until reaching the TT of the inner workflow i Stage, vector set of remaining outer computing nodes irCN TTi ＝irCN (TTi-2) -irCN TTi =Φ, and irTL (TTi-1) ＝iTL (TTi-3) -isTL (TTi-1) =Φ; thereby forming a workflow vector TV in step 650 i ＝(iscnID 1 ,iscnID 3 ,…,iscnID TTi ) As the outer layer computing node ecnID i Is a list of the inner layer task execution order.
By adopting the nested workflow setting method, the workflow can be more efficiently configured, and executable scripts can be conveniently generated for the outer layer workflow and each inner layer workflow after the configuration is completed. When executing the workflow, after obtaining an execution sequence list (for example, a flow calculation sequence array) of the outer workflow, traversing all outer nodes recorded by the array in sequence, and executing an inner workflow execution script corresponding to each node in sequence according to the ID of the node. For example, the specific execution operations are as follows: a) Logging in a Tianhe supercomputer in an SSH mode, submitting an execution script in a command line mode, wherein N1 is the number of nodes, and the data type is integer; p1 is a partition name, and the data type is a character string; n1 is the number of cores, and the data type is integer; and XXX.bat is a task script file name, and the data type is a character string. b) The setup control program detects the execution of the workflow and uses the return value of the "yhq" command as a judgment flag. If the return value is null, the execution is completed; otherwise, execution is not complete. c) And returning a calculation success prompt after the execution of the inner layer workflow is completed. And after the execution of the inner workflow corresponding to all the nodes of the outer layer is completed, the execution of the workflow is completed.
Furthermore, other implementations of the invention will be apparent to those skilled in the art from consideration of the specification of the invention disclosed. Embodiments and/or aspects of embodiments may be used in the systems and methods of the present invention alone or in any combination. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
Claims (7)
1. A computing environment configuration method based on an inner-outer workflow, wherein the computing environment comprises a computer software group, a parameter configuration file of each computer software in the computer software group, and a script file for executing the computer software group, the configuration method comprising the steps of:
step S100, receiving a selection operation of selecting a computer software group from a computer software group list by a user, or receiving a selection operation of selecting computer software from a computer software list by a user so as to form a new computer software group;
step S300, receiving a selection operation of selecting a parameter configuration file from a parameter configuration file list of each computer software in the computer software group by a user, or receiving a parameter value input by the user so as to form a parameter value input operation of a new parameter configuration file;
step S500, receiving a selection operation of selecting a script file from a script file list of the computer software group by a user, or receiving a script command input operation of forming a new script file by a script command input by the user;
step S700, a templated computing environment is formed according to the computer software group, the parameter configuration file and the script file;
wherein the script file comprises a first level executable script that executes an outer layer workflow, wherein the outer layer workflow comprises outer layer computing nodes formed by respective computer software in a set of computer software and a data conversion connection module for receiving output data of an upstream outer layer computing node and converting it into input data of a downstream outer layer computing node, each outer layer computing node having one or more input anchors for receiving input data and one or more output anchors for outputting data, each data conversion connection module having one or more input anchors for receiving output data from an output anchor of an upstream outer layer computing node and one or more output anchors for outputting data as input data of a downstream outer layer computing node, the first level executable script comprising a computation order of the respective outer layer computing nodes; wherein the script file further comprises a second level executable script for executing an inner layer workflow of at least one of the outer layer computing nodes, wherein the inner layer workflow comprises one or more inner layer computing nodes and a data connection module for receiving and storing output data of an upstream inner layer computing node as input data of a downstream inner layer computing node, each inner layer computing node having one or more input anchor points for receiving input data and one or more output anchor points for outputting data, each data connection module having one input anchor point for receiving output data from an output anchor point of an upstream inner layer computing node and one or more output anchor points for outputting data as input data of a downstream inner layer computing node, the second level executable script comprising a calculation order of the respective inner layer computing nodes and being embedded in the first level executable script at a location corresponding to the outer layer computing node.
2. The computing environment configuration method of claim 1, further comprising: step S010, receiving a selection operation of selecting a job type from a job type list by a user, or receiving input information of the user to create a job type input operation of a new job type; then, in step S100, a computer software group is selected from a computer software group list corresponding to the job type.
3. The computing environment configuration method of claim 1 or 2, wherein,
step S100 further includes: increasing the weight of the selected computer software group to be preferentially displayed in the computer software group list; or adding the new computer software group to the computer software group list;
step S300 further includes: the operation of adding the selected parameter configuration file to preferentially display the weight in the parameter configuration file list; or adding the new parameter configuration file to the parameter configuration file list;
step S500 further includes: increasing the priority display weight of the selected script file in the script file list; or an operation of adding a new script file to the script file list.
4. The computing environment configuration method of claim 1 or 2, wherein,
step S100 further includes: an operation of modifying a selected set of computer software from a list of sets of computer software, wherein the modification is selected from the group of computer software selected for adding, deleting or replacing to the computer software in the selected set of computer software; and adding the modified computer software group to a computer software group list;
step S300 further includes: modifying the parameter values in the selected parameter configuration file; and adding the modified parameter profile to the parameter profile list;
step S500 further includes: modifying the instruction in the selected script file; and an operation of adding the modified script file to the script file list.
5. The computing environment configuration method according to claim 1, wherein in step S500, the script command input operation is implemented in a drag operation manner on a graphical operation interface, the graphical operation interface including an outer node pool for presenting an outer computing node graphic having thereon a pattern representing an input anchor point and an output anchor point, a conversion connection module pool for presenting a data conversion connection module graphic having thereon a pattern representing an input anchor point and an output anchor point, respectively, and an outer workflow editing area, the data conversion connection module graphic having thereon a pattern representing an input anchor point and an output anchor point, respectively, specifically comprising the steps of:
step S510, dragging the outer computing node graph from the outer node pool to the outer workflow editing area, dragging the data conversion connection module graph from the conversion connection module pool to the outer workflow editing area, and then interconnecting the input anchor point or the output anchor point of the outer computing node graph with the output anchor point or the input anchor point of the corresponding data conversion connection module by dragging, thereby completing the design of the outer workflow.
6. The computing environment configuration method of claim 5, wherein the graphical operation interface further comprises an inner node pool presenting an inner computing node graph, a connection module pool presenting a data connection module graph, and an inner workflow editing area, the inner computing node graph having thereon patterns representing input anchor points and output anchor points, respectively, and the data connection module graph having thereon patterns representing the input anchor points and the output anchor points, respectively, and further comprising the steps of:
and step S520, clicking an outer computing node in the outer workflow editing area to enter an inner workflow editing area, dragging an inner computing node graph from an inner node pool to the inner workflow editing area, dragging a data connection module graph from a connection module pool to the inner workflow editing area, and then connecting an input anchor point or an output anchor point of the inner computing node graph with an output anchor point or an input anchor point of a corresponding data connection module through dragging, thereby completing the design of the inner workflow and generating a second-stage executable script.
7. The computing environment configuration method of claim 6 wherein the graphical operator interface further includes a parameter setup window providing input data as parameter values for the inner computing node, step S520 further comprising: clicking the inner computing node in the inner workflow editing area, popping up a parameter setting window and setting parameters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010258332.5A CN111475296B (en) | 2018-06-29 | 2018-06-29 | Computing environment configuration method based on inner and outer layer workflows |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010258332.5A CN111475296B (en) | 2018-06-29 | 2018-06-29 | Computing environment configuration method based on inner and outer layer workflows |
| CN201810696816.0A CN108958937B (en) | 2018-06-29 | 2018-06-29 | Template computing environment configuration method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810696816.0A Division CN108958937B (en) | 2018-06-29 | 2018-06-29 | Template computing environment configuration method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111475296A CN111475296A (en) | 2020-07-31 |
| CN111475296B true CN111475296B (en) | 2023-04-21 |
Family
ID=64484338
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010258332.5A Active CN111475296B (en) | 2018-06-29 | 2018-06-29 | Computing environment configuration method based on inner and outer layer workflows |
| CN201810696816.0A Active CN108958937B (en) | 2018-06-29 | 2018-06-29 | Template computing environment configuration method |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810696816.0A Active CN108958937B (en) | 2018-06-29 | 2018-06-29 | Template computing environment configuration method |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111475296B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112882817B (en) * | 2021-03-24 | 2022-08-12 | 国家超级计算天津中心 | Workflow processing method based on super computer |
| CN114579129B (en) * | 2022-05-09 | 2022-07-29 | 国家超级计算天津中心 | Automatic construction method and device for parameter interface of cloud native solver |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7886264B1 (en) * | 2004-06-25 | 2011-02-08 | Apple Inc. | Automatic conversion for disparate data types |
| CN103336689A (en) * | 2013-06-27 | 2013-10-02 | 曙光信息产业(北京)有限公司 | Processing method for GEMS (Global Monitoring for Environment and Security) |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8271974B2 (en) * | 2008-10-08 | 2012-09-18 | Kaavo Inc. | Cloud computing lifecycle management for N-tier applications |
| CN104317642B (en) * | 2014-09-28 | 2017-12-29 | 华为技术有限公司 | Software deployment method and apparatus under cloud computing environment |
| CN107203421B (en) * | 2016-08-28 | 2020-07-21 | 深圳晶泰科技有限公司 | Self-adaptive combined workflow method in cloud computing environment |
| CN107066338A (en) * | 2017-04-13 | 2017-08-18 | 中国人民解放军国防科学技术大学 | The computing environment method of automatic configuration of distributed computing system |
-
2018
- 2018-06-29 CN CN202010258332.5A patent/CN111475296B/en active Active
- 2018-06-29 CN CN201810696816.0A patent/CN108958937B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7886264B1 (en) * | 2004-06-25 | 2011-02-08 | Apple Inc. | Automatic conversion for disparate data types |
| CN103336689A (en) * | 2013-06-27 | 2013-10-02 | 曙光信息产业(北京)有限公司 | Processing method for GEMS (Global Monitoring for Environment and Security) |
Non-Patent Citations (1)
| Title |
|---|
| 耿卫民 ; 高超 ; 彭程 ; 禹彩辉 ; 肖虹 ; .气动计算软件集成系统中的远程控制.航空工程进展.2012,(第02期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108958937B (en) | 2020-05-05 |
| CN108958937A (en) | 2018-12-07 |
| CN111475296A (en) | 2020-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108959328B (en) | Knowledge graph processing method and device and electronic equipment | |
| Song et al. | Surrogate-based aerodynamic shape optimization of a civil aircraft engine nacelle | |
| US8499284B2 (en) | Visualizing relationships among components using grouping information | |
| CN111475296B (en) | Computing environment configuration method based on inner and outer layer workflows | |
| Jacobson et al. | Evaluation of time-domain damping identification methods for flutter-constrained optimization | |
| CN106021824A (en) | Method for applying deterministic finite element software to analysis of simple or large-size complicated structure containing interval parameters | |
| US11886776B2 (en) | Techniques for generating graph-based representations of complex mechanical assemblies | |
| Boden et al. | Distributed multidisciplinary optimization and collaborative process development using RCE | |
| Burton et al. | Efficient supersonic air vehicle analysis and optimization implementation using SORCER | |
| US11132477B1 (en) | Interactive simulation and solver for mechanical, fluid, and electro-mechanical systems | |
| CN113792464A (en) | Coupling interface interaction method, system, simulation system, equipment and storage medium | |
| Allen et al. | Rotor blade design framework for airfoil shape optimization with performance considerations | |
| CN111475271B (en) | Workflow setting method based on outer computing node | |
| CN102236733B (en) | Method and device for computing cooling tower by using general program ANSYS | |
| CN108897619A (en) | A kind of multi-layer resource flexibility configuration method for supercomputer | |
| JP2019148876A (en) | Control device, data processing method and program | |
| CN105069195A (en) | Deep design method and system for electromechanical earthquake resistance | |
| CN114117950B (en) | Flutter judgment method for shuttle aircraft based on acting principle | |
| Sistla et al. | Aircraft design problem implementation under the Common Object Request Broker Architecture | |
| Lwin et al. | A distributed Web-based framework for helicopter rotor blade design | |
| CN111797576A (en) | Batch construction and submission method for aerospace multivariable CFD operation | |
| CN102436611B (en) | Method for realizing workflow simplification by feature ring | |
| Bogdanov et al. | Problems of development of complex multilayered applications in distributed environment | |
| Burton et al. | Efficient supersonic air vehicle design using the Service-Oriented Computing Environment (SORCER) | |
| Ahn et al. | Web-Based Integrated Research Environment for Aerodynamic Analyses and Design |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |