CN113127175A - Host job scheduling operation method and device - Google Patents
Host job scheduling operation method and device Download PDFInfo
- Publication number
- CN113127175A CN113127175A CN202110538317.0A CN202110538317A CN113127175A CN 113127175 A CN113127175 A CN 113127175A CN 202110538317 A CN202110538317 A CN 202110538317A CN 113127175 A CN113127175 A CN 113127175A
- Authority
- CN
- China
- Prior art keywords
- host
- job
- scheduling
- execution
- job scheduling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000012545 processing Methods 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 16
- 238000012163 sequencing technique Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 abstract description 5
- 238000009434 installation Methods 0.000 description 25
- 238000010586 diagram Methods 0.000 description 23
- 230000008569 process Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009472 formulation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000002045 lasting effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a host job scheduling operation method and a host job scheduling operation device, wherein the method comprises the following steps: receiving a job scheduling operation request sent by a client; generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs; generating a host job scheduling schedule according to the flow chart; sending a host operation execution request to a host end; and receiving the host operation execution result fed back by the host end, and sending the host operation execution result to the client. The operation with high parallelism and the complex series relation between the operations are converted into a visual flow chart, so that the possibility of errors is reduced; and generating a host job scheduling schedule by taking the flow chart as a reference, and sending a host job execution request to the host terminal, so that the scheduling and running of the host job are automatically completed, the manual intervention degree is low, and the workload of service personnel is reduced. The invention can be used in the technical field of chips.
Description
Technical Field
The invention relates to the technical field of chips, in particular to a host job scheduling operation method and device.
Background
At present, in a core bank system, version deployment of a host product comprises two major processes, namely application version installation and implementation of related version installation operations such as file definition, database definition, data conversion updating and the like, along with the gradual improvement of a DevOps system and concept, a similar automatic deployment platform finishes the installation work of a host application version, but the implementation of the version installation operation is still submitted in a manual SUB (SUB) -based mode, the operation flow of the installation operation in the traditional mode exposes many problems, firstly, the operation parallelism is high, the series relation among operations is complex, whether the current operation can be executed needs to be manually judged for the execution result of the previous operation, the manual intervention degree is high, and the workload of business personnel is large; secondly, the manual operation judgment process is time-consuming and labor-consuming, and is easy to operate by mistake.
Disclosure of Invention
The embodiment of the invention provides a host job scheduling operation method, which is used for reducing the workload of service personnel and reducing the occurrence of errors and comprises the following steps:
receiving a job scheduling operation request sent by a client;
generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
generating a host operation scheduling schedule according to the flow chart;
sending a host job execution request to a host terminal according to a host job scheduling schedule;
and receiving a host operation execution result fed back by the host end, and sending the host operation execution result to the client.
In a specific embodiment, generating a flowchart of the host job execution according to the job scheduling operation request includes:
determining node information and connection information according to the job scheduling operation request;
wherein the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: connecting line hash ID, initial node hash ID of the connecting line and connecting line pointing node hash ID;
and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
In a specific implementation process, according to the flowchart, generating a host job scheduling schedule includes:
determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
In a specific embodiment, a method for scheduling and running a host job is further provided, which further includes:
if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
The embodiment of the invention also provides a host job scheduling operation device, which is used for reducing the workload of business personnel and reducing the occurrence of errors, and comprises the following components:
the client requirement receiving module is used for receiving a job scheduling operation request sent by a client;
the flow chart generating module is used for generating a flow chart when the host machine works according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
the operation scheduling module is used for generating a host operation scheduling schedule according to the flow chart;
the job execution request sending module is used for sending a host job execution request to the host terminal according to the host job scheduling schedule;
and the result feedback module is used for receiving the host operation execution result fed back by the host end and sending the host operation execution result to the client.
In a specific embodiment, the flowchart generating module is specifically configured to:
determining node information and connection information according to the job scheduling operation request;
wherein the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: connecting line hash ID, initial node hash ID of the connecting line and connecting line pointing node hash ID;
and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
In specific implementation, the job scheduling module is specifically configured to:
determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
The specific embodiment of the present invention further provides a host job scheduling device, further comprising: an error reporting processing module, configured to:
if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
The embodiment of the invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can be run on the processor, wherein the processor realizes the host job scheduling and running method when executing the computer program.
An embodiment of the present invention also provides a computer-readable storage medium, where a computer program for executing the above host job scheduling method is stored in the computer-readable storage medium.
In the embodiment of the invention, the operation request is scheduled by receiving the job sent by the client; generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs; generating a host job scheduling schedule according to the flow chart; sending a host job execution request to a host terminal according to a host job scheduling schedule; and receiving the host operation execution result fed back by the host end, and sending the host operation execution result to the client. The method has the advantages that the operation with high parallelism and the complex series relation among the operations are converted into a visual flow chart, the execution sequence, the parallel condition and the front-back association of the operation of the host computer are displayed visually and clearly, and the possibility of errors is reduced; and generating a host job scheduling schedule by taking the flow chart as a reference, and sending a host job execution request to the host terminal, so that the scheduling and running of the host job are automatically completed, the manual intervention degree is low, and the workload of service personnel is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 is a diagram illustrating a method for scheduling and running a host job according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a process for implementing step 102 according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating a process for implementing step 103 according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating a method for scheduling host jobs according to an embodiment of the present invention.
FIG. 5 is a diagram illustrating a communication architecture of an automated scheduling tool for host installation jobs according to an embodiment of the present invention.
FIG. 6 is a schematic diagram of a specific flow chart in an embodiment of the present invention.
FIG. 7 is a diagram illustrating an initialized job scheduling schedule in an embodiment of the present invention.
FIG. 8 is a diagram illustrating a job scheduling schedule that may be executed in accordance with an embodiment of the present invention.
FIG. 9 is a diagram illustrating a job scheduling and monitoring interface according to an embodiment of the present invention.
FIG. 10 is a diagram of an affected node for error reporting by job #03DDROP in accordance with an embodiment of the present invention.
FIG. 11 is a flowchart illustrating job automation scheduling in an embodiment of the present invention.
FIG. 12 is a diagram illustrating a host-side JCLSTART operation in accordance with an embodiment of the present invention.
FIG. 13 is a diagram illustrating a host-side job execution process according to an embodiment of the present invention.
FIG. 14 is a diagram illustrating a host job scheduling device according to an embodiment of the present invention.
FIG. 15 is a diagram of a host job scheduling device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a host job scheduling operation method, which is used for reducing the workload of service personnel and reducing the occurrence of errors, and as shown in figure 1, the method comprises the following steps:
step 101: receiving a job scheduling operation request sent by a client;
step 102: generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
step 103: generating a host job scheduling schedule according to the flow chart;
step 104: sending a host job execution request to a host terminal according to a host job scheduling schedule;
step 105: and receiving the host operation execution result fed back by the host end, and sending the host operation execution result to the client.
As can be known from the flow shown in fig. 1, in the embodiment of the present invention, an operation request is scheduled by receiving a job sent by a client; generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs; generating a host job scheduling schedule according to the flow chart; sending a host job execution request to a host terminal according to a host job scheduling schedule; and receiving the host operation execution result fed back by the host end, and sending the host operation execution result to the client. The method has the advantages that the operation with high parallelism and the complex series relation among the operations are converted into a visual flow chart, the execution sequence, the parallel condition and the front-back association of the operation of the host computer are displayed visually and clearly, and the possibility of errors is reduced; and generating a host job scheduling schedule by taking the flow chart as a reference, and sending a host job execution request to the host terminal, so that the scheduling and running of the host job are automatically completed, the manual intervention degree is low, and the workload of service personnel is reduced.
In specific implementation, a job scheduling operation request sent by a client is firstly sent.
Next, according to the job scheduling operation request, a flowchart of the host job execution is generated, and as shown in fig. 2, the specific implementation process includes:
step 201: determining node information and connection information according to the job scheduling operation request;
step 202: and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
The flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs. In a specific embodiment, the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: the connection line hash ID, the initial node hash ID of the connection line and the connection line point node hash ID.
Because the flow chart is more strongly visualized, the flow chart can be displayed to the client, but the host can not directly execute the host operation according to the flow chart. Therefore, after generating the flowchart of the host job execution, the specific implementation process of generating the host job scheduling schedule according to the flowchart includes, as shown in fig. 3:
step 301: determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
step 302: sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
step 303: and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
One node in the flow chart represents one host operation, a plurality of nodes are connected in sequence to represent one host operation execution branch line, different branch lines have a logical relation of execution sequence, and the plurality of host operation execution branch lines are sequenced according to the execution sequence of the plurality of branch lines to obtain a host operation scheduling initial schedule. In a specific embodiment, because the job scheduling schedule needs to further maintain the scheduling information related to the host, the preset scheduling parameters include parameters such as a job name, a storage path of the job at the host, an execution user/password, a job operation mode (normal/pause/skip), a job return code decision criterion, and the like, and according to the specific host job, the scheduling parameters are configured for each host job to obtain the host job scheduling schedule.
And after the host job scheduling schedule is obtained, sending a host job execution request to the host terminal according to the host job scheduling schedule. In the specific embodiment, the host end starts a long-hang monitoring service processing job JCLSTART, monitors whether a sent host job execution request exists in real time, and after monitoring, the host executes corresponding host jobs and feeds back results.
And receiving a host operation execution result fed back by the host end, and sending the host operation execution result to the client.
In a specific embodiment, a method for scheduling and running a host job is further provided, as shown in fig. 4, on the basis of fig. 1, the method further includes:
step 401: if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
step 402: and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
After the host executes the relevant job, an error reporting situation may occur, if the host does not execute the relevant job, the program is blocked, and the next step cannot be executed, at this time, the error reporting needs to be fed back to the client, and after the client selects the processing mode such as skipping, ignoring and the like, and receives the error reporting processing mode sent by the client, the host job scheduling schedule is adaptively adjusted, for example, when the processing mode to be ignored is selected, the error is ignored, the next job of the branch line is continuously executed, and the next job is continuously sent to the host.
A specific example is given below to illustrate how embodiments of the present invention perform host job scheduling operations. The embodiment provides a new mode for submitting host installation jobs, a complete installation job scheduling list is built based on an X86 platform, automatic scheduling of host end installation jobs is completed through an X86 page, one-key installation of jobs is realized, and version deployment efficiency is improved.
Firstly, communication architecture design is carried out: and building a host installation job automatic scheduling tool based on the X86 platform, wherein the host installation job automatic scheduling tool comprises a Web server and a Web database.
The browser (client) requests a page by adopting an HTTP (hyper text transport protocol), a websocket communication mode is added on the page of the job scheduling plan table, a small amount of communication can be kept on a TCP (transmission control protocol) layer, B/S (browser/server) duplex communication can be realized, the data transmission quantity is small, compared with a polling query mode, invalid requests are eliminated, the execution result is correspondingly fast, and the communication efficiency is improved. The method includes that asynchronous communication is achieved between an X86-end Server and a host in a socket mode, a long hanging monitoring service processing operation (JCLSTART) needs to be started at the host, the host serves as a socket Server to wait for connection of the X86-end Server, a request sent by the X86-end Server is monitored and received, and a result is returned to an X86 front end after the request of the X86 end is processed.
In specific implementation, the automatic scheduling tool for the host installation work is developed based on open source frames such as Spring, springMVC, MyBatis, Bootstrap, JQuery and the like by adopting Java and HTML languages. Background development is performed by adopting languages such as REXX, JCL and the like, the system runs under a z/OS system, and a database adopts DB 2.
After the communication architecture is built, making a flow chart and storing node information:
determining the tandem relation, the execution sequence and the parallel degree among installation operations by formulating a flow chart, and recording node information and connection information when storing a database, wherein the node information comprises an operation name, a node hash id, a vertex position (left/top), a node block width and height and node properties (main nodes/virtual main nodes); the connection information includes a connection hash id, an initial node hash id of the connection, and a connection point node hash id, thereby completely storing information of a flowchart, as shown in fig. 6.
Description of node Properties:
a. a master node: host operation capable of independent installation (frame of jigsaw pattern mark)
b. Virtual master node: one set name (box of gear style identification) is not a real installation job, but for the convenience of flowchart recording, a plurality of parallel jobs are grouped into one node, and the plurality of parallel jobs in the virtual master node must be successfully executed at the same time to execute the host job of the next node. Under the virtual main node, several host job records can be hung and executed simultaneously, but these records are not represented in the flow chart, and they are maintained in the job scheduling plan table, so as to reduce the complex diagram of the flow chart and raise the operation efficiency.
After the flow chart is manufactured and the node information is stored, generating and maintaining a job scheduling schedule:
the flowchart only visually shows the context between the installation jobs at the host side, and the initialized job scheduling schedule needs to be generated reversely according to the flowchart in the next step, as shown in fig. 7. The job scheduling schedule table needs to further maintain host-related scheduling information, including a job name, a storage path of the job at the host, an execution user/password, a job operation mode (normal/pause/skip), and a job return code determination criterion (in a specific example, the job return code is less than or equal to 0004, which represents that the execution is successful), and an executable schedule table is finally generated by adding the jobs that can be executed concurrently and concurrently under the virtual host node, as shown in fig. 8.
After the operation scheduling schedule is maintained, the installation operation is automatically scheduled and monitored in sequence:
the method comprises the steps of checking the job to be submitted, clicking batch submission to automatically schedule the job batch, monitoring the execution result of the job in real time and updating the result on a page, wherein the updated content relates to the JOBID, the execution result (execution success/execution failure), the start time and the end time of the job. If the execution of the job on a branch is in error, then all subsequent jobs on that branch are not scheduled for execution, and the execution of the jobs on the remaining branches is not affected, see FIGS. 9 and 10.
After the maintenance of the job scheduling list is completed, the job execution at the host end can be automatically scheduled and the execution result at the host end can be monitored according to the maintenance flow, and the specific flow is shown in fig. 11.
The specific embodiment not only supports the selection of batch submission of a plurality of jobs, but also can carry out single-step submission work on a single job, thereby meeting the scheduling work of daily installation jobs.
Analyzing a task at a host side and executing the operation:
the host side starts a long hang monitor service to process a job JCLSTART, and monitors whether a job execution request sent from the front end of X86 exists in real time, and the method is shown in figure 12. The data information in the job execution request parsing packet sent by the X86 front end is monitored, the installation jobs (e.g., # AUBMS100, AUADX100) specified by the submission in the JDWS X series scheduling job specified path are submitted with the specified host user (r is, e.g., BAAP019), and the results of the jobs are returned to the X86 front end, see fig. 13. The host side is used as a socket server side, circularly waits for a communication packet sent by an X86 side (client side), analyzes data information in the data packet, submits specific operation under a specified path by using a specified host user, and returns a direct result of the operation to the host side.
Therefore, operation and maintenance personnel can finish the automatic scheduling of the host installation operation on an interactive interface without logging in a host end to manually submit the host operation. The technical requirements of operators can be simplified, the operation and maintenance operation is simplified, the efficiency is improved, the risk is reduced, and the management and control are convenient.
In the automatic host installation job scheduling tool based on the X86 platform in the specific example, the job execution scheduling function on the host is realized through the operation of the front-end X86 platform (browser), and the job execution flow is flexibly configured and built through the integration of the execution characteristics of the installation job flow. The X86 platform page response is fast, and easy operation can be installed and carried out to the installation operation by one key, compares in traditional manual submission host computer operation, has further reduced the manual operation part of version deployment, strengthens lasting integration, lasts the delivery capability, has promoted automatic fortune dimension level, has promoted the degree of accuracy that the version was delivered.
The platform is used for configuring the operation execution flow, all operations can be recorded, traceable and recheckable, and meanwhile, the established operation flow can be regulated and controlled in real time according to the actual situation, so that the operation is flexible.
The automatic scheduling tool for the host installation operation based on the X86 platform has the advantages that the configuration process is visual and easy to operate no matter in the process chart formulation or in the maintenance stage of the operation flow deployment plan list, the traditional manual operation is replaced, the real-time configuration modification is supported, and the interaction is humanized.
The implementation of the above specific application is only an example, and the rest of the embodiments are not described in detail.
Based on the same inventive concept, embodiments of the present invention further provide a host job scheduling and running apparatus, where the principle of the problem solved by the host job scheduling and running apparatus is similar to that of the host job scheduling and running method, so the implementation of the host job scheduling and running apparatus can refer to the implementation of the host job scheduling and running method, repeated details are not described, and the specific structure is as shown in fig. 14:
a client requirement receiving module 1401, configured to receive a job scheduling operation request sent by a client;
a flow chart generating module 1402, configured to generate a flow chart of the host job when executing according to the job scheduling operation request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
a job scheduling module 1403, configured to generate a host job scheduling schedule according to the flowchart;
a job execution request sending module 1404, configured to send a host job execution request to the host according to the host job scheduling schedule;
the result feedback module 1405 is configured to receive a host job execution result fed back by the host side, and send the host job execution result to the client.
In a specific embodiment, the flowchart generating module 1402 is specifically configured to:
determining node information and connection information according to the job scheduling operation request;
wherein the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: connecting line hash ID, initial node hash ID of the connecting line and connecting line pointing node hash ID;
and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
In a specific embodiment, the job scheduling module 1403 is specifically configured to:
determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
In an embodiment, there is further provided a host job scheduling device, as shown in fig. 15, on the basis of fig. 14, the host job scheduling device further includes:
an error reporting processing module 1501, configured to:
if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
The embodiment of the invention also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can be run on the processor, wherein the processor realizes the host job scheduling and running method when executing the computer program.
An embodiment of the present invention also provides a computer-readable storage medium, where a computer program for executing the above host job scheduling method is stored in the computer-readable storage medium.
In summary, the host job scheduling operation method and apparatus provided in the embodiments of the present invention have the following advantages:
scheduling an operation request by receiving a job sent by a client; generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs; generating a host job scheduling schedule according to the flow chart; sending a host job execution request to a host terminal according to a host job scheduling schedule; and receiving the host operation execution result fed back by the host end, and sending the host operation execution result to the client. The method has the advantages that the operation with high parallelism and the complex series relation among the operations are converted into a visual flow chart, the execution sequence, the parallel condition and the front-back association of the operation of the host computer are displayed visually and clearly, and the possibility of errors is reduced; and generating a host job scheduling schedule by taking the flow chart as a reference, and sending a host job execution request to the host terminal, so that the scheduling and running of the host job are automatically completed, the manual intervention degree is low, and the workload of service personnel is reduced.
Although the present invention provides method steps as described in the examples or flowcharts, more or fewer steps may be included based on routine or non-inventive labor. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or client product executes, it may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.
As will be appreciated by one skilled in the art, embodiments of the present description may be provided as a method, apparatus (system) or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In this document, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "upper", "lower", and the like, indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience in describing the present invention and simplifying the description, but do not indicate or imply that the referred devices or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention. Unless expressly stated or limited otherwise, the terms "mounted," "connected," and "connected" are intended to be inclusive and mean, for example, that they may be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. The present invention is not limited to any single aspect, nor is it limited to any single embodiment, nor is it limited to any combination and/or permutation of these aspects and/or embodiments. Moreover, each aspect and/or embodiment of the present invention may be utilized alone or in combination with one or more other aspects and/or embodiments thereof.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention, and they should be construed as being included in the following claims and description.
Claims (10)
1. A host job scheduling operation method is characterized by comprising the following steps:
receiving a job scheduling operation request sent by a client;
generating a flow chart of the host machine during the operation according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
generating a host operation scheduling schedule according to the flow chart;
sending a host job execution request to a host terminal according to a host job scheduling schedule;
and receiving a host operation execution result fed back by the host end, and sending the host operation execution result to the client.
2. The method according to claim 1, wherein generating a flowchart of host job execution according to the job scheduling execution request includes:
determining node information and connection information according to the job scheduling operation request;
wherein the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: connecting line hash ID, initial node hash ID of the connecting line and connecting line pointing node hash ID;
and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
3. The method of claim 1, wherein generating a host job scheduling schedule according to the flowchart comprises:
determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
4. The host job scheduling method of claim 1, further comprising:
if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
5. A host job scheduling device, comprising:
the client requirement receiving module is used for receiving a job scheduling operation request sent by a client;
the flow chart generating module is used for generating a flow chart when the host machine works according to the operation scheduling and operating request; the flow chart is used for representing the context, execution sequence and parallelism degree among a plurality of host jobs;
the operation scheduling module is used for generating a host operation scheduling schedule according to the flow chart;
the job execution request sending module is used for sending a host job execution request to the host terminal according to the host job scheduling schedule;
and the result feedback module is used for receiving the host operation execution result fed back by the host end and sending the host operation execution result to the client.
6. The host job scheduling device of claim 5, wherein the flowchart generation module is specifically configured to:
determining node information and connection information according to the job scheduling operation request;
wherein the node information includes: host job name, node hash ID, vertex position, node block width and height, and node properties; the connection information includes: connecting line hash ID, initial node hash ID of the connecting line and connecting line pointing node hash ID;
and determining each node and the connection between the nodes according to the node information and the connection information, and generating a flow chart when the host works.
7. The host job scheduling device according to claim 5, wherein the job scheduling module is specifically configured to:
determining a plurality of host operation execution branch lines and an execution sequence executed by the plurality of branch lines according to the flow chart; each host operation execution branch line at least comprises one host operation;
sequencing the plurality of host operation execution branches according to the execution sequence of the plurality of branches to obtain a host operation scheduling initial schedule;
and generating a host job scheduling schedule according to the preset scheduling parameters and the host job scheduling initial schedule.
8. The host job scheduling apparatus according to claim 5, further comprising: an error reporting processing module, configured to:
if the host machine operation execution result shows error reporting, receiving an error reporting processing mode sent by the client;
and adjusting the host job scheduling schedule according to the error reporting processing mode, and resending a new host job execution request to the host.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 4 when executing the computer program.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110538317.0A CN113127175A (en) | 2021-05-18 | 2021-05-18 | Host job scheduling operation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110538317.0A CN113127175A (en) | 2021-05-18 | 2021-05-18 | Host job scheduling operation method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113127175A true CN113127175A (en) | 2021-07-16 |
Family
ID=76782131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110538317.0A Pending CN113127175A (en) | 2021-05-18 | 2021-05-18 | Host job scheduling operation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113127175A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933618A (en) * | 2015-06-03 | 2015-09-23 | 中国银行股份有限公司 | Monitoring method and apparatus for batch work operation data of core banking system |
| CN110427260A (en) * | 2019-08-09 | 2019-11-08 | 中国工商银行股份有限公司 | Host job scheduling method, apparatus and system |
| CN110471754A (en) * | 2019-08-22 | 2019-11-19 | 中国工商银行股份有限公司 | Method for exhibiting data, device, equipment and storage medium in job scheduling |
| CN110990222A (en) * | 2019-11-27 | 2020-04-10 | 中国银行股份有限公司 | Cross-platform graphical operation monitoring method and device based on mainframe |
| CN111736969A (en) * | 2020-06-16 | 2020-10-02 | 中国银行股份有限公司 | Distributed job scheduling method and device |
| CN111861426A (en) * | 2020-08-05 | 2020-10-30 | 中国工商银行股份有限公司 | Method and apparatus for credit approval, electronic device, and medium |
| CN111930487A (en) * | 2020-08-28 | 2020-11-13 | 北京百度网讯科技有限公司 | Job flow scheduling method and device, electronic equipment and storage medium |
| CN112035233A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Big data batch job task scheduling method and device |
| CN112581018A (en) * | 2020-12-28 | 2021-03-30 | 北京世纪互联宽带数据中心有限公司 | Process task management method, system, device and storage medium |
-
2021
- 2021-05-18 CN CN202110538317.0A patent/CN113127175A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933618A (en) * | 2015-06-03 | 2015-09-23 | 中国银行股份有限公司 | Monitoring method and apparatus for batch work operation data of core banking system |
| CN110427260A (en) * | 2019-08-09 | 2019-11-08 | 中国工商银行股份有限公司 | Host job scheduling method, apparatus and system |
| CN110471754A (en) * | 2019-08-22 | 2019-11-19 | 中国工商银行股份有限公司 | Method for exhibiting data, device, equipment and storage medium in job scheduling |
| CN110990222A (en) * | 2019-11-27 | 2020-04-10 | 中国银行股份有限公司 | Cross-platform graphical operation monitoring method and device based on mainframe |
| CN111736969A (en) * | 2020-06-16 | 2020-10-02 | 中国银行股份有限公司 | Distributed job scheduling method and device |
| CN111861426A (en) * | 2020-08-05 | 2020-10-30 | 中国工商银行股份有限公司 | Method and apparatus for credit approval, electronic device, and medium |
| CN111930487A (en) * | 2020-08-28 | 2020-11-13 | 北京百度网讯科技有限公司 | Job flow scheduling method and device, electronic equipment and storage medium |
| CN112035233A (en) * | 2020-09-01 | 2020-12-04 | 中国银行股份有限公司 | Big data batch job task scheduling method and device |
| CN112581018A (en) * | 2020-12-28 | 2021-03-30 | 北京世纪互联宽带数据中心有限公司 | Process task management method, system, device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8301935B2 (en) | Distributed batch runner | |
| CN109889381B (en) | Automatic configuration management method and device based on fort machine | |
| US20160094483A1 (en) | Methods and systems for portably deploying applications on one or more cloud systems | |
| CN111897638B (en) | Distributed task scheduling method and system | |
| CN107016094B (en) | Project shared file multi-person collaborative development method, device and system | |
| US20130290412A1 (en) | Method, apparatus, and system for data task processing | |
| JP2018530070A (en) | System and method for building, optimizing and implementing a platform on a cloud-based computing environment | |
| CN110389834A (en) | A kind of method and apparatus for submitting deep learning training mission | |
| CN114996006A (en) | Server arrangement configuration execution method, device, equipment and medium | |
| CN112882863A (en) | Method, device and system for recovering data and electronic equipment | |
| CN113778486A (en) | Containerization processing method, device, medium and equipment for code pipeline | |
| CN110717739A (en) | Workflow issuing method, device, equipment and computer readable storage medium | |
| CN109905263A (en) | A kind of automation O&M deployment system | |
| WO2013171864A1 (en) | Work management method and management system | |
| CN112383507A (en) | Firewall policy management method, device and system and computer readable storage medium | |
| US10430232B2 (en) | Controllable workflow in software configuration automation | |
| CN117389843B (en) | Intelligent operation and maintenance system, method, electronic equipment and storage medium | |
| CN113176996A (en) | Fault processing method, engine, plug-in probe, device and readable storage medium | |
| CN113127175A (en) | Host job scheduling operation method and device | |
| CN111522630B (en) | Method and system for executing planned tasks based on batch dispatching center | |
| CN107944743A (en) | The operation and maintenance method, apparatus and system of a kind of large computer system | |
| US20080178182A1 (en) | Work state returning apparatus, work state returning method, and computer product | |
| CN116401074A (en) | Service-based data interaction method and system | |
| US10592227B2 (en) | Versioned intelligent offline execution of software configuration automation | |
| CN117390841B (en) | Different-place collaborative simulation platform architecture based on super computing cloud and design method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |