JP2004303096A - Job management method, job management device, and job management program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To execute a batch service without having any influence on the performance of an online service during operation of the online service even when the online service and the batch service have the same resources as access objects. <P>SOLUTION: This job management method comprises storing application kind information for every service application; assigning, when a page for a database access request is on buffer on a first buffer cache, the page from a first buffer cache; assigning, when the page is on buffer on a second buffer cache, the page from a second buffer cache; assigning, when the page is not on buffer either of the buffer caches and the kind of service application is a batch service application program based on the application kind information, the page from the second buffer cache, and assigning from the first buffer cache if not so. Even if the online service and the batch service have the same resources as the access object, the batch service can be executed without having any influence on the performance of the online service during the operation of the online service. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to job management related to a transaction processing program, and in particular, even when an online job and a batch job access the same resource (table), a new batch job dedicated buffer cache is provided to improve the performance of the online job. And technology for preventing deterioration.
[0002]
[Prior art]
In the conventional database system, there is only one buffer cache for accessing the database. Therefore, if a batch operation accessing the same database as the online operation is performed during the operation of the online operation, a buffer used by the online operation is used. When a page on the cache is evicted by a batch job, the I / O amount to the disk for accessing the database of the online job increases, which is a major cause of deteriorating the response of the online job.
[0003]
To solve this problem, if the online job and the batch job do not access the same resource (table), the problem can be solved by setting up a necessary amount of database buffer cache for each resource in advance. . However, in the case where the same resource is to be accessed, a procedure of executing a batch job after temporarily stopping the online job is taken at present, and the continuous operability for 24 hours 365 days is impaired.
[0004]
If online and batch operations access the same resources, another method is to manage the amount of buffer cache used by online and batch operations in the same database buffer cache. Can be However, in the case of this method, in a system using a plurality of database buffer caches, such as establishing a database buffer cache for each resource, the buffer cache used by the online business and the batch business is used for each database buffer cache. Must be managed, which increases management costs.
[0005]
Further, if the batch processing is executed as a non-transaction or as one transaction in the entire batch processing, when an error occurs, the batch processing must be re-executed from the beginning, and the processing takes a very long time. In order to prevent such a situation, it is common practice to execute batch processing as a transaction, and to repeatedly execute the transaction by dividing the transaction into a unit of processing. As a result, even if an error occurs, re-execution from the point of occurrence of the error can be completed, so that it is used as an operation such as 24 hours 365 days continuous operability.
[0006]
As a remedy to the above problem, as a file updating method including a storage medium storing a file and an extended storage device for accessing the data, the extended storage device is temporarily disconnected from online business, In the online business, the reference business is continued using the file on the storage medium, while the batch business updates the record using the extended storage device, and updates the record on the extended storage device after the batch business is completed. A file update method has been disclosed in which a file is updated by batch reloading to a file on a storage medium (for example, see Patent Document 1).
[0007]
According to the above-mentioned remedy, the extended storage device can be temporarily occupied and used by the batch operation, eliminating the conflict between the resources of the online operation and the batch operation, and without affecting the online operation while continuing the online operation. It has become possible to execute high-speed batch operations.
[0008]
[Patent Document 1]
JP-A-6-139120 (pages 2-3)
[0009]
[Problems to be solved by the invention]
However, with the above improvement measures, if the online business does not perform data update processing, there is no competition between the resources of the online business and the batch business, and a high-speed batch business that does not affect the online business while continuing online is performed. Although it is possible to execute, but if the batch operation and online operation update the same resource, exclusive control and database update are performed so that the online operation can correctly recognize the resource updated in the batch operation. I / O is required, and the impact of the batch operation on the online operation still remains.
[0010]
The present invention has been proposed in view of the above circumstances, and even when an online job and a batch job access the same resource (including an update process), the online job can be executed during the online job operation. The purpose is to be able to execute batch tasks without affecting performance.
[0011]
[Means for Solving the Problems]
FIG. 1 shows an overall configuration diagram of Embodiment 1 of the present invention. The job management program 10 of the present invention is executed on a computer that behaves as the job management apparatus 1, and for each business application, whether the business application is for online business or batch business (in the present invention, batch business is online business operation) The application type storage means 111 for storing in the storage device the application type information for identifying whether or not the batch operation is executed without affecting the performance of the online operation. When added to the application environment opening unit 11 of the job management program 10 and detects that the page for the database access request is on-buffer on the first buffer cache shared by a plurality of online business applications, the corresponding page is detected. Page into the first buffer A first page allocating unit 124 that allocates a page for a database access request when the first page allocating unit 124 detects that a page for a database access request is on-buffer on a second buffer cache shared by a plurality of batch business applications; The second page allocating unit 125 allocated from the second buffer cache is added to the buffer control unit 123 of the job management program related to the conventional transaction processing.
[0012]
Further, when detecting that the page for the database access request is not on-buffer on any buffer cache, the type of the business application that requested the database access is determined based on the application type information, In the case of an application program, a corresponding page is allocated from the second buffer cache; otherwise, a corresponding page is allocated from the first buffer cache. It is added to the buffer control unit 123 of the job management program related to the transaction processing.
[0013]
The batch job shares only the on-buffer part of the first buffer cache (the page accessed by the online job), and if it is not on-buffer on the first buffer cache, cuts out a new page from the second buffer cache . Since the batch job does not cut out new pages from the first buffer cache in this way, the batch job does not evict pages accessed by the online business from the first buffer cache, and the performance of the online job is not Has no effect.
[0014]
Furthermore, since the page frequently accessed by the online job is in the on-buffer in the first buffer cache, the order in which the buffer cache is checked to see if it is on-buffer is executed by the first page allocating means first. However, the search time can be minimized by causing the second page allocating unit to execute only when the first page allocating unit cannot detect the on-buffer.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 shows an overall configuration diagram of Embodiment 1 of the present invention. The job management program 10 of the present invention stores, for each business application, application type information for identifying whether the business application is for online business or batch business in the application control table shown in FIG. 2. The means 111 is added to the application environment opening unit 11 for allocating resources to the application of the job management program 10 related to the conventional transaction processing and making the application executable.
[0016]
Further, when it is detected that the page for the access request to the database 21 on the external storage device 2 is on-buffer in the first buffer cache 14 (conventional database buffer cache) shared by a plurality of online business applications. A first page allocating means 124 for allocating a corresponding page from the first buffer cache 14, and a page for a database access request being buffered on a second buffer cache 15 shared by a plurality of batch business applications. And the second page allocating means 125 for allocating the relevant page from the second buffer cache 15 to manage the database buffer cache of the job management program related to the conventional transaction processing. Add to Ffa controller 123.
[0017]
Further, upon detecting that the page for the database access request is not on-buffer in any buffer cache, the type of the business application that requested the database access is determined based on the application control table shown in FIG. In the case of a business application program, a third page allocating means for allocating a corresponding page from the second buffer cache 15 and allocating a corresponding page from the first buffer cache 14 otherwise. 126 is added to the buffer control unit 123 of the job management program related to the conventional transaction processing.
[0018]
As described above, for a batch business application that is executed during the online business operation without affecting the performance of the online business, the system uses a buffer cache dedicated to the batch business (the second buffer cache) separately from the database buffer cache. By assigning 15), since the batch business application does not use the database buffer cache used by the online business, the cache hit rate of the database buffer cache can be guaranteed, and the performance of the online business can be guaranteed.
[0019]
The second buffer cache 15 mainly serves as an I / O work area, and does not expect a cache hit rate. As shown in FIG. 9, one second buffer cache 15 exists in the system and is shared between batch business applications. The size of the second buffer cache 15 is dynamically determined according to the multiplicity of the batch operation. The size is expanded when the multiplicity increases, and reduced when the multiplicity decreases. The size per batch job is 1 MB (megabyte) when nothing is specified, but can be changed by an external parameter.
[0020]
Since the job management program is a conventional function, a detailed description of each processing unit is omitted, and only a minimum necessary for describing the job management program. The transaction start processing unit 121 generates an operating environment for exclusive control, buffer control, and log control in order to start a transaction. The exclusive control processing unit 122 occupies and releases exclusive use of resources. 123 manages the buffer cache of the database.
[0021]
The log control processing unit 127 collects an update log of the database in preparation for transaction recovery (rollback or down recovery or media recovery), and the transaction end processing unit 128 performs transaction rollback or transaction Perform commit and collect the operating environment of exclusive control, buffer control, and log control.
[0022]
The buffer control processing unit 123 includes a buffer search / allocation process, a buffer reference / update process, and a buffer return process. The conventional buffer search / allocation process searches and allocates a page in the database buffer cache, allocates a new buffer if it does not exist, performs I / O (read), and only allocates a buffer if it exists. . The allocated buffer is not subject to the buffer eviction by the empty buffer generation processing that operates in the background. The first, second, and third page allocating means of the present invention are obtained by adding functions to this processing.
[0023]
The buffer reference / update processing refers to or updates the allocated buffer on the memory, and performs I / O (writing) in the background. The buffer return process returns the allocated buffer. When the buffer is returned, it becomes a target of buffer eviction by the empty buffer generation processing that operates in the background.
FIG. 2 shows an example of the application control table. The control table includes, for example, the number of allocated CPUs, the number of CPUs, and the like for each application executor constituting a job (a dispatch unit of a database system, and a plurality of application executors share one thread). The information necessary for controlling the application execution body such as the allocation ratio of the application is stored. In the present invention, in the application control table, type information indicating whether or not the application is a batch business (described as a batch business in the present invention) that is executed during the online business operation without affecting the performance of the online business. to add.
[0024]
Application type: Indicates one of the following types.
FIG. 3 shows an example of an on-buffer determination control table. Once a page is on the buffer, it remains in the hash chain until it is evicted from the buffer and reused (used on another page). The hash value is determined from the resource code, and buffers (pages) having the same hash value are chain-managed with the same hash entry. In the buffer search, a hash value of the search target page is calculated, a hash chain connected from the corresponding hash entry is searched in a queue, and if there is, it is treated as an on-buffer. This control table is conventional and does not particularly relate to the present invention, so that the detailed description is omitted.
[0025]
FIG. 4 is a schematic flowchart showing the flow of the entire job processing related to the transaction processing. When a job of an online job or a batch job is input to the job management apparatus 1, the job management program 10 assigns, for an application program constituting the job, resource allocation and environmental conditions for controlling the execution of the application. The application is set to be executable (S401). The process related to the transaction is performed the requested number of times (S402), and the closing process of the application environment such as releasing the resources of the terminated application is performed (S403).
[0026]
FIG. 5 is a flowchart showing a flow of processing related to a part of the additional processing according to the present invention with respect to the conventional application environment opening processing. When an application control table is created based on environment parameters for an application specified by a user, the user is asked to specify a batch operation or an online operation by an external parameter, and this information is added to the application control table (S501). The application type is determined (S502), and in the case of a batch job, the buffer cache for the batch job is extended (S503). Since this batch business buffer cache does not require a cache hit rate, the initial value is, for example, 1 megabyte, and a new application program is opened according to the number of application programs to be multiplexed. It increases by 1 megabyte each time and is collected when closed.
[0027]
FIG. 6 is a flowchart showing a flow of processing related to a part of the additional processing according to the present invention with respect to the conventional application environment closing processing. Referring to the application control table (S601), if the application type is batch business, the buffer cache for the batch business is reduced (S603).
FIG. 7 shows processing related to the function addition processing for the buffer control processing unit 123 (the buffer search / allocation processing in the buffer control processing as described in FIG. 1) of the transaction processing unit 12 of the conventional job management program 10. It is a flowchart which shows a flow. First, the first (online business) buffer cache is searched to determine whether the buffer is on-buffer (S701). If the first buffer cache is an on-buffer, a corresponding buffer is allocated (S703); otherwise, a second (for batch business) buffer cache is searched to determine whether it is an on-buffer (S703). S702). If the second buffer cache is an on-buffer, a corresponding buffer is allocated (S703); otherwise, a new buffer allocation / read process shown in FIG. 8 is performed (S704).
FIG. 8 is a flowchart showing the flow of the new buffer allocation / read processing. First, the application type is referred to from the application control table (S801), and it is determined whether the application type is a batch operation (S802). If it is a batch job, the corresponding page is allocated from the second buffer cache (S803). If not, the corresponding page is allocated from the first buffer cache (S804). Next, data is read from the database to the corresponding page (S805). The data reading process is a conventional process and is not a part related to the present invention, so that the details of the process are omitted.
[0028]
FIG. 9 shows the relationship between the online business application, the batch business application, and the buffer cache. Pages accessed by online business applications and batch business applications may conflict. Both the online business application and the batch business application search for an online business buffer cache that can be expected to have a cache hit rate, and then search for a batch business buffer cache. The page may exist in one of the buffer caches, and if so, use that buffer cache. (The online business application temporarily uses the batch business buffer cache, and the batch business application uses the online business buffer cache.) Buffer cache may be used). If the buffer does not exist in either buffer cache, the online business application can cut out the buffer from the online business buffer cache and the batch business application can cut out the buffer from the batch business buffer cache and use it. Even in the case of the access target, the batch operation can be performed in parallel with the online operation while the performance of the online operation is guaranteed, and continuous operation for 24 hours and 365 days can be realized. Further, it is not necessary to manage whether the online business and the batch business use the same resource as the access target, and the management cost can be reduced.
[0029]
【The invention's effect】
Even if the same resource is accessed by the database system, it is possible to perform batch operations in parallel with online operations while guaranteeing the performance of online operations, enabling continuous operation 24 hours a day, 365 days a year. Become.
Further, it is not necessary to manage whether the online business and the batch business use the same resource as the access target, and the management cost can be reduced.
[Brief description of the drawings]
FIG. 1 is an overall configuration diagram of a first embodiment. FIG. 2 is an example of an application control table. FIG. 3 is an example of an on-buffer determination control table. FIG. [FIG. 6] Flow of application environment closing process [FIG. 7] Flow of buffer search / allocation process [FIG. 8] Flow of new buffer allocation / read process [FIG. 9] Relationship diagram between business application and buffer cache [code] Description]
REFERENCE SIGNS LIST 1 job management device 2 external storage device 10 job management program 11 application environment opening unit 12 transaction processing unit 13 application environment closing unit 14 first buffer cache 15 second buffer cache 111 dictionary information providing program 121 transaction start processing unit 122 exclusive Control processing unit 123 Buffer control processing unit 124 First page allocation unit 125 Second page allocation unit 126 Third page allocation unit 127 Log control processing unit 128 Transaction end processing unit

Claims (4)

Allocating a corresponding page from the first buffer cache upon detecting that a page for a database access request is on-buffer on a first buffer cache shared by a plurality of online business applications;
When detecting that the page for the database access request is on-buffer on the second buffer cache shared by a plurality of batch business applications, allocating the relevant page from the second buffer cache;
When detecting that the page for the database access request is not on-buffer on any buffer cache, the type of the business application that requested the database access is determined based on the application type information stored in the storage device in advance. Allocating a corresponding page from the second buffer cache in the case of an application program for batch business, and otherwise allocating a corresponding page from the first buffer cache. Characterized job management method. For each business application, an application type storage unit that stores application type information for identifying whether the business application is for online business or batch business in a storage device,
When detecting that a page for a database access request is on-buffer on a first buffer cache shared by a plurality of online business applications, a first page to allocate a corresponding page from the first buffer cache Assigning means;
When detecting that a page for a database access request is on-buffer on a second buffer cache shared by a plurality of batch business applications, a second page allocation for allocating a corresponding page from the second buffer cache Means,
When detecting that the page for the database access request is not on-buffer on any buffer cache, the type of the business application that requested the database access is determined based on the application type information, and the application for the batch business is determined. In the case of a program, a third page allocating unit that allocates a corresponding page from the second buffer cache, and otherwise allocates a corresponding page from the first buffer cache. Job management device. For each business application, an application type storage unit that stores application type information for identifying whether the business application is for online business or batch business in a storage device,
When detecting that a page for a database access request is on-buffer on a first buffer cache shared by a plurality of online business applications, a first page to allocate a corresponding page from the first buffer cache Assigning means;
When detecting that a page for a database access request is on-buffer on a second buffer cache shared by a plurality of batch business applications, a second page allocation for allocating a corresponding page from the second buffer cache Means,
When detecting that the page for the database access request is not on-buffer on any buffer cache, the type of the business application that requested the database access is determined based on the application type information, and the application for the batch business is determined. In the case of a program, a corresponding page is allocated from the second buffer cache; otherwise, a corresponding page is allocated from the first buffer cache. program. The job management program according to claim 3, wherein the second page allocating means executes only when the first page allocating means detects that the buffer is not on-buffer on the first buffer cache.

Images