JP2810141B2 - Online BMP processing method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention relates to a BM that collectively processes a large amount of data using online transactions in online processing.
Regarding P processing method.

[Conventional technology]

Conventionally, as a batch processing method in an online processing system, a transaction that is a trigger of data processing is generated for a user using the online processing system, and reading of processing data is performed as a part of the transaction processing. It should be noted that Japanese Patent Application Laid-Open No. 58-11415
No. 3 is mentioned.

[Problems to be solved by the invention]

According to the prior art, transaction processing requires complicated processing such as reading of processing data and management of data serial numbers and numbers. In addition, even if a failure occurs during the batch processing and the processing ends abnormally, it is necessary to process the batch data on the magnetic tape again from the first case, and there has been a problem that the batch processing takes time. . Even when one of the batch data has a creation error, there is also a problem that the processing of the data is not performed in the batch processing but is performed manually by keying after the batch processing.

Furthermore, when batch processing is performed during online data processing, the operation method is complicated and time-consuming, such as monitoring the system load so as not to adversely affect the online processing.

An object of the present invention is to provide an online BMP processing method that manages the input of online batch data, and can reduce the operation of online BMP processing and the burden of transactions.

Another object of the present invention is to manage input, diversify the form of batch processing, interrupt / restart processing, and reduce
It is an object of the present invention to provide an online BMP processing method that facilitates operation according to the load of the system.

It is another object of the present invention to provide an online BMP processing method in which batch data is read in units of blocks and processing performance is improved.

[Means for solving the problem]

The present invention relates to a batch message processing process (BMP process) that collectively processes a large number of data transmitted from each terminal of an electronic computer system that performs online processing to a host using an online transaction. (Input DB) and input
The DB is read one record at a time, and online transactions up to the number of transactions that can be started simultaneously according to the number of transactions that can be started simultaneously, in the case of serial, or in the case of random, according to the start mode specified in the input DB management table. Is activated to manage the reading of input data.

Further, the online BMP processing method in the present invention
The data of B is read in block units, and the data of the next block is read while the transaction of the deblocked record is activated.

Further, in the online BMP processing method according to the present invention, the number of records that have been processed is updated in the input DB processing table, thereby restarting from the interrupted record in the restart processing after the processing is interrupted. .

Further, in the online BMP processing method according to the present invention, the number of transactions to be started simultaneously is managed in the minimum configuration unit of the input DB in the input DB management table, and the number of transactions to be started during the BMP processing is changed by a command.
Change the specific gravity of MP processing while online.

〔Example〕

According to the present invention, in a BMP process for collectively processing a large number of data transmitted from each terminal of a computer system constituting an online processing system to a central center using online transactions, the data is used as one input DB, The DB is read one record at a time, and online transactions are performed one by one in the case of serial or in accordance with the number of transactions that can be simultaneously started in the case of serial, depending on the startup mode specified in the input DB management table. By starting, the reading of input data is managed.

The present invention also provides a BMP processing management table having an input DB name and a BMP processing status for managing the entire BMP processing as shown in FIG. It is pointed from the configuration management table that has the same hierarchy configuration as the input DB configuration, the processing status, the number of transactions, and the number of processed items for each hierarchy configuration, and the lowest configuration management table. And a read block management table having a block number for managing the read block, a record number, a processing status, and the number of processed blocks.

In the above configuration, the BMP process management table manages the entire BMP process, and expresses the entire BMP process by the BMP name. The BMP process start command designates the BMP name and starts the BMP process.

The input DB name is the name of the input DB used in the BMP process.The configuration management table address points to the configuration management table used in the BMP process. The status of whether the command is stopped is managed, and commands that can be accepted are determined based on the status.

The configuration management table can be created corresponding to the hierarchical structure of the input DB, and controls a read schedule of the input DB. The higher-level configuration manages the lower-level configuration, and controls the number of transactions to be activated and the mode of activation. A transaction is started for the lowest configuration under the management of the higher configuration. One configuration unit has a configuration name, a processing status, a transaction count, a processed count, and a start mode. The lowest configuration has a read block management table address and points to the read block management table. The read block management table manages the records of the input DB to be processed in block units, and has the read block number, the record number in one block, the processing status, and the number of processed records in one block. Here, by managing the two read block management tables as one set, it is possible to read the input DB using the other read block management table while activating a transaction for processing one block. It becomes possible, and I / O processing of input DB and transaction processing can be performed in parallel.

 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram illustrating an embodiment of the present invention. FIG. 2 is a flowchart until a transaction for record processing is started. When a start command specifying a BMP name is input from the console device 1 during online operation, a BMP start task 2 is started, and a specified BMP processing management table 3 is selected from several BMP processing management tables 3 created before online start. The BMP processing management table 3 having the BMP name is found. The input DB 4 and the configuration management table 5 are allocated as specified in the BMP processing management table 3, and the read block management table 6 that is twice as many as the number of startup transactions specified in the top configuration of the configuration management table 5 is secured. Then, the BMP operation environment is created, the BMP schedule task 7 is started, and the BMP start task 2 ends. The BMP schedule task 7 checks the configuration management table 5 from the upper level, and determines the lowest bootable configuration. The upper configuration can specify the number of transactions to be activated and the activation mode for the lower configuration, and the activation mode can specify serial or random. In the case of serial, starting from the leftmost configuration of the lower configuration, only one configuration can be started at the same time. In the case of random, the configuration is started from the left end of the lower configuration, and a plurality of configurations are started up to the number of transactions that can be started. When the lowest configuration that can be activated and the number of transactions to be activated are determined, the input DB read tasks 8 for the number of transactions are assigned to the two read block management tables 6 corresponding to the configuration and activated, and the BMP schedule task 7 is started. Ends. Input DB read task 8 started multiple times
Is exclusively controlled so that only one task can move to the lowest constituent unit at the same time, and reads the input DB in block units according to the key of the input DB specified for the constituent unit. The read information includes the serial number of block 9, the number of records in block 9, the serial number of the first record in block 9, the relative record number in block 9 to be processed next, and the number of processed records in block 9. It is set in the read block management table 6. If started from the BMP schedule task 7, the transaction start task 10 reads the input DB once more in block units, sets information in the other read block management table 6, and processes the first read block 9. And the input DB read task 8 ends. Transaction start task
In step 10, the record to be processed in the block 9 is determined from the information in the read block management table 6, and a transaction is started using the record, the constituent names from the highest to the lowest, and the record serial number as interfaces. After the transaction, the relative record number and the number of processed records in the block 9 to be processed next in the read block management table 6 are updated, and the next transaction start task 10 is started to process the next record. The transaction start task 10 ends. In this manner, the records read in block units are processed by activating a transaction one by one. If the next record to be processed is lost in block 9, the input DB
The read task 8 is started, and the transaction start task 10 ends. The input DB read task 8 clears the read block management table 6 by reflecting information such as the number of processed records from the information in the read block management table 6 in the lowest configuration, and reads the other read block management table that has already been read. Assign transaction and start task 10
Start Further, in parallel with the transaction start task, the input DB read task 8 sets information in the read block management table that has read and cleared the input DB in block units, and the input DB read task 8 ends. When there is no more data to be read into the key of the input DB of the lowest configuration and the transaction activation task 10 cannot be activated, the BMP schedule task 7 is activated and the service is shifted to another service of the lowest configuration. BMP scheduled task 7 when all lower-level configuration services are completed
Starts the BMP end task 11. BMP end task 11, BM
The resources allocated by the P start task 2 are released, and the BMP process ends. According to this embodiment, it is possible to reduce the load of the input process from the user's transaction and the load of the transaction activation process suitable for the configuration of the input data, and improve the performance by reading the input data in block units.

FIG. 3 is a block diagram when the BMP process is interrupted. To interrupt BMP processing, use console device 1
Enter the suspend command specifying the MP name. The suspend command sets the suspend request ID in the BMP processing management table 3. When the active transaction ends, the transaction activation task 10 determines the interruption request ID in the BMP processing management table 3, stops the activation of the transaction activation task 10 that processes the next record, and reads the input DB as the interruption request. Activate task 8. The input DB read task does not clear the read block management table 6,
The BMP schedule task 7 is started as a suspension request. B
The MP schedule task 7 chains the read block management table 6 in ascending order of the block serial number, and activates the BMP end task 11. The BMP end task 11 releases resources other than the table and suspends the BMP process. To restart the suspended BMP, the restart command specifying the BMP name is input to the console device 1. The same processing as that at the time of the start is performed. However, when the input DB read task 8 is started, the read block management table 6 chained is allocated and started from the top of the chain, and the input DB read task is allocated and started. The state before the interruption is restored by determining the block to be read according to the block serial number in the read block management table. According to the present embodiment, it is possible to reduce the burden of managing the interruption point of the process in the user's transaction.

The number of startup transactions in the configuration management table 5 determined by the BMP schedule task 7 can be changed by a command from the console device, thereby enabling BMP operation according to the CPU load status.

〔The invention's effect〕

According to the present invention, as compared with the conventional BMP processing, the input data management processing does not need to be performed by a user transaction, so that the processing load can be reduced (30%).

In addition, the input DB is read in block units, and read processing and transaction processing are executed in parallel.
Processing performance is improved (1.5 times) compared to BMP processing.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention, FIG. 2 is a flow chart from the start of a BMP to the start of a transaction which is an embodiment of the present invention, and FIG. 3 is a BM which is an embodiment of the present invention.
It is a block diagram at the time of P process interruption. DESCRIPTION OF SYMBOLS 1 ... Console apparatus, 2 ... BMP start task, 3 ... BMP process management table, 4 ... Input DB, 5 ... Configuration management table, 6
... Read block management table, 7 ... BMP schedule task, 8 ... Input DB read task, 9 ... Input block,
10: Transaction start task, 11: BMP end task.

Continuation of front page (72) Inventor Koji Akimura 890 Kashimada, Sachi-ku, Kawasaki-shi, Kanagawa Prefecture Information system factory of Hitachi, Ltd. (56) References JP-A-64-61852 (JP, A) JP-A Sho JP-A-63-163659 (JP, A) JP-A-63-159757 (JP, A) JP-A-58-114153 (JP, A) JP-A-55-116157 (JP, A)

Claims (4)

(57) [Claims] 1. A batch message processing method for batch-processing a large number of data transmitted from each terminal of an electronic computer system performing online processing to a host using an online transaction, wherein the data is used as one input database, An input database management table including a startup mode is provided corresponding to the hierarchical configuration of the input database, records of the input database are read out in block units, and deblocked records are converted into the minimum unit of the configuration of the input database management table. One record is read for each transaction, and online transactions are activated one by one or up to the number of transactions that can be activated simultaneously according to the activation mode specified in the input database management table. Online bar Ji message processing processing method. 2. The system according to claim 1, wherein the data of the input database is read in units of blocks, and the data of the next block is read while the transaction of the deblocked record is activated. Online batch message processing method. 3. By updating the number of processed records in the input database management table,
2. The online batch message processing method according to claim 1, wherein in the restart processing after the interruption during the processing, the record is restarted from the record after the interruption. 4. A method for managing the number of transactions to be started simultaneously in the minimum configuration unit of the input database in the input database management table, changing the number of transactions to be started during batch message processing by a command, and 2. The online batch message processing method according to claim 1, wherein the processing density during online processing is changed.