JP2005275522A - Batch processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a completely platform-free batch processing system. <P>SOLUTION: The batch processing system implemented for execution in a Java<SP>TM</SP>environment comprises an Ant-implemented script tool 12 for holding script files describing the contents of batch processing and for requesting the execution of processing according to the script files, a plurality of executable files 21 in an EJB (Enterprise JavaBeans<SP>TM</SP>) format for executing predetermined processing, and a Java-program-implemented batch manager 11 for specifying executable files 21 corresponding to the request from the script tool 12 in the plurality of executable files 21 and instructing the specified executable files 21 to execute processing. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a computer system that performs batch processing.

  In batch processing that processes a large amount of data collectively, a processing procedure is described in a script file, and processing is executed according to the script file. In the script file, predetermined commands and the like are described according to the order of processing to be executed. As the script file, a shell script is used in the Unix (registered trademark) OS (Operating System), and a Windows script (batch file) is used in the Windows (registered trademark).

  Even in a batch processing system in a multi-platform environment, each of the Unix-based OS and Windows uses the respective scripts and depends on the OS. That is, even if the program is a batch processing system designed to operate in a multi-platform environment such as JAVA (registered trademark), the script file is still dependent on the OS.

  For this reason, for example, while the environment at the development stage is Windows, when using a Unix-based OS in an operating environment in which the system operates after release, the program created in the development environment can be ported as it is, but the script file is There was a problem that could not be transplanted. In other words, in the conventional platform-free batch processing system, the script is platform-dependent and incomplete.

  Accordingly, an object of the present invention is to provide a complete platform-free batch processing system.

  A batch processing system according to an embodiment of the present invention holds a script file in which the contents of a batch process are described, and executes a predetermined process with a script processing unit that requests execution of the process according to the script file. And a batch processing unit that specifies an execution file corresponding to the request from the script processing unit from the plurality of execution files, and instructs the specified execution file to execute the process.

  In a preferred embodiment, the batch processing system is implemented to be executable in a JAVA environment. At this time, the plurality of execution files may be mounted in an EJB (Enterprise Java Beans) format, and the batch processing unit may be mounted in a JAVA program. Further, the script processing unit may be realized by an ant.

  In a preferred embodiment, a job scheduler that activates the script processing unit according to a predetermined job schedule may be further provided.

  Hereinafter, a batch processing system according to an embodiment of the present invention will be described with reference to the drawings.

  The overall structure of this system is shown in FIG. As shown in the figure, the system includes a batch server 1, one or more AP servers 2, and an operation monitoring server 3, which are connected to each other via a network 9. In this system, based on an instruction from the operation monitoring server 3 that manages a job schedule, the batch server 1 causes a predetermined execution file installed in the AP server 2 to execute a series of batch jobs. As shown in the figure, when there are a plurality of AP servers 2, a load distribution device 8 may be further provided to distribute the processing to the plurality of AP servers 2.

  The batch server 1, each AP server 2, and the operation monitoring server 3 are all configured by, for example, a general-purpose computer system, and individual components or functions in each server 1, 2, 3 described below are, for example, This is realized by executing a computer program.

  The batch server 1 includes a batch manager 11 that manages batch processing, a script tool 12 that makes a processing request to the batch manager 11 according to a script that describes batch processing, and a batch log 13 that records the execution history of the batch processing.

  The batch manager 11 instructs the execution file 21 of the AP server 2 to execute a predetermined process in accordance with a processing request from the script tool 12. For example, the batch manager 11 includes a batch activation processing unit 15 and a conversion table 16.

  In the conversion table 16, for example, as shown in FIG. 2, an AP server group name 161 and a network logical name 162 are associated with each other. The AP server group name 161 is an AP server group name used in a script file described later. The network logical name 162 is a name indicating a logical place on the network. The load balancer 8 converts the network logical name 162 into an address for specifying a physical position on the individual AP server 2.

  The batch activation processing unit 15 specifies a network logical name and an execution file based on a processing request from the script tool 12, and instructs the execution of the processing. For example, when the batch activation processing unit 15 receives designation of an AP server group name and an execution file name as a processing request, it acquires a network logical name 162 corresponding to the AP server group name 161 from the conversion table 16, and the network logical name The execution of the process is instructed using the execution file. The batch activation processing unit 15 adds, to the batch log 13, the processing contents and date / time that have been instructed to execute as described above.

  The system can be implemented, for example, to operate in a JAVA environment. In this case, the batch activation processing unit 15 can be described by a Java program.

  The script tool 12 includes a plurality of script files 121. Then, the script tool 12 executes processing according to the contents described in each script file 121. The script file 121 is created in advance by a system administrator or the like based on business specifications. For example, each script file 121 describes a batch processing procedure performed by the system. An example of the script file 121 is shown in FIG. In this example, one job (described later) corresponds to one script file 121. Note that each script file 121 is actually described according to a predetermined grammar unique to each script, but here is described in ordinary text for easy understanding.

  When this system is mounted so as to operate in the JAVA environment, the script tool 12 can be realized by using a build tool called ant. Here, ant corresponds to a makefile command in Unix. That is, ant is not generally recognized as a tool for controlling execution of batch processing. The inventor of the present invention pays attention to the function of an ant that has been used only as a build tool in the past, and has found the applicability to batch process execution control.

  Further, when the script tool 12 is implemented as an ant, a processing request from the script tool 12 may be made in a JMX (Java Management eXtensions) format.

  Referring to FIG. 1 again, each AP server 2 includes an execution file 21 having a plurality of execution formats and a data storage unit 22. Each execution file 21 reads data from the data storage unit 22 and writes data as necessary, and executes predetermined processing. When the present system is implemented so as to be operable in the JAVA environment, each executable file 21 can be realized in the form of EJB (Enterprise Java Beans).

  The operation monitoring server 3 includes a job scheduler 31 and a timer unit 32 that provides the current time. For example, the job scheduler 31 holds a job schedule 33 as shown in FIG. In the job schedule 33, as shown in the figure, an activation time is designated for each job. One job includes one or more processes. The job scheduler 31 manages processing in units of jobs. The job scheduler 31 refers to the current time indicated by the time measuring unit 32 and instructs the batch server 1 to execute a predetermined job according to the job schedule 33.

  Next, an outline of the operation of this system will be described according to the sequence chart shown in FIG.

  First, at a predetermined time determined in the job schedule, the job scheduler 31 instructs the script tool 12 to start a predetermined script. Here, it is assumed that the time is 22:00, and the job scheduler 31 instructs the script tool 12 to start “job A”, and therefore instructs the script tool 12 to start the corresponding script.

  The script tool 12 refers to the script file 121 that has been instructed to start, and executes the processing described therein. In this case, the script tool 12 sequentially requests the batch manager 11 to execute the contents described in the script file corresponding to “job A”. That is, the script tool 12 notifies the batch manager 11 of “execute execution file A of group A”, “execute execution file B of group A”, and the like.

  When the batch manager 11 receives the above processing request, the batch activation processing unit 15 instructs the AP server 2 to execute the processing via the load balancer 8 based on the contents of each processing request. Then, in the AP server 2 that has received this execution instruction, the execution file 21 or the like related to the execution instruction executes a predetermined process.

  Note that when the batch activation processing unit 15 instructs the AP server 2 to execute processing, the AP server group name included in the processing request from the script tool 12 is referred to the network logical name 162 with reference to the conversion table 16. The converted execution instruction is transmitted to the load balancer 8.

  Thereby, it is possible to realize a system that performs batch processing based on a job schedule.

  Furthermore, conventionally, JAVA has no script tool that can be used to control batch processing. For this reason, in the case of a batch system operating in the Unix environment, it must be described in a shell script, and in the case of a batch system operating in the Windows environment, it must be described in a Windows script. By using a script tool in the JAVA environment, the system can be operated on both Unix machines and Windows machines.

  As a result, even when a Unix machine is used for the operating environment and a relatively inexpensive Windows machine is used, not only the executable file but also the script can be used exactly the same, and the development efficiency can be improved. improves. Not only that, there are many test tools that support ant, leading to greater efficiency in the entire development process.

  The above-described embodiments of the present invention are examples for explaining the present invention, and are not intended to limit the scope of the present invention only to those embodiments. Those skilled in the art can implement the present invention in various other modes without departing from the gist of the present invention.

  For example, the batch server, the AP server, and the operation monitoring server described above can be realized in a centralized manner on a single computer machine, or can be realized separately on a single computer machine. It can also be realized in a distributed manner by a plurality of computer machines.

1 is an overall configuration diagram of a batch processing system according to an embodiment of the present invention. It is a figure which shows an example of a conversion table. It is a figure which shows an example of a script file. It is a figure which shows an example of a job schedule. It is a sequence chart which shows the process outline | summary of this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Batch server, 2 ... AP server, 3 ... Operation monitoring server, 9 ... Network, 11 ... Batch manager, 12 ... Script tool, 31 ... Job scheduler.

Claims (4)

A script processing unit that holds a script file in which the contents of the batch processing are described, and requests execution of processing according to the script file;
A plurality of executable files for executing a predetermined process;
A batch processing system comprising: a batch processing unit that specifies an execution file corresponding to a request from the script processing unit from the plurality of execution files and instructs the specified execution file to execute the processing. The batch processing system is implemented to be executable in a JAVA (registered trademark) environment,
The plurality of executable files are implemented in the form of EJB (Enterprise Java Beans),
The batch processing unit is implemented by a JAVA program,
The batch processing system according to claim 1, wherein the script processing unit is realized by an ant.   The batch processing system according to claim 1, further comprising a job scheduler that activates the script processing unit according to a predetermined job schedule. Hold a script file that describes the contents of the batch process, request execution of the process according to the script file,
A batch processing method for specifying an execution file corresponding to the processing request from a plurality of execution files for executing a predetermined process, and instructing the specified execution file to execute the process.

Images