CN113204490A

CN113204490A - Batch operation testing method and device, electronic equipment and storage medium

Info

Publication number: CN113204490A
Application number: CN202110590048.2A
Authority: CN
Inventors: 周晟; 黄剑文; 何芬; 周德龙
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2021-05-28
Filing date: 2021-05-28
Publication date: 2021-08-03

Abstract

The invention discloses a test method and device for batch operation, electronic equipment and a storage medium, and relates to the field of artificial intelligence, wherein the method comprises the following steps: generating a test case of the operation to be tested based on preset case comparison information and backup information corresponding to the operation to be tested, wherein the backup information comprises: historical test data; generating test operation based on a preset test operation template according to the test case; and responding to the trigger to execute the batch job test, executing the test operation according to the preset test execution time of each job to be tested, and recording a corresponding test log according to the test operation process of each job to be tested. By the method and the device, the batch program testing efficiency can be effectively improved, and the batch testing cost is saved.

Description

Batch operation testing method and device, electronic equipment and storage medium

Technical Field

The invention relates to the field of artificial intelligence, in particular to a test method and device for batch operation, electronic equipment and a storage medium.

Background

At present, IBM mainframe computers (mainframes) are generally adopted by domestic large traditional banks, and the coding Language used is the COBOL (Common Business-Oriented Language). The COBOL language is a process-oriented high-level programming language, is mainly used for data processing, is one of the preferred languages for commercial calculation, and has the characteristics of popular understanding, large calculation amount and the like. In actual work, the powerful computing function of the COBOL language is most commonly applied to processing various online and batch functions such as complex logic operations.

After a developer finishes writing a certain COBOL program, the program result needs to be verified on a mainframe (host), that is, case testing is performed. However, the currently compiled cases do not support direct calling and data multiplexing, each case needs to manually prepare test data, and the test data is invalidated after being used up, and in addition, the test process does not support multiplexing, which all results in that the continuous integration of the test and the automation of the batch test cannot be well realized, and further results in the problems of low efficiency of the batch program test and high cost of the batch test.

Disclosure of Invention

In view of the above, the present invention provides a batch testing method, apparatus, electronic device and storage medium to solve at least one of the above-mentioned problems.

According to a first aspect of the present invention, there is provided a method of testing a batch job, the method comprising:

generating a test case of the operation to be tested based on preset case comparison information and backup information corresponding to the operation to be tested, wherein the backup information comprises: historical test data;

generating test operation based on a preset test operation template according to the test case;

and responding to the trigger to execute the batch job test, executing the test operation according to the preset test execution time of each job to be tested, and recording a corresponding test log according to the test operation process of each job to be tested.

According to a second aspect of the present invention, there is provided a batch job testing apparatus, the apparatus comprising:

the test case generating unit is used for generating a test case of the operation to be tested based on preset case comparison information and backup information corresponding to the operation to be tested, wherein the backup information comprises: historical test data;

the test operation generating unit is used for generating test operation based on a preset test operation template according to the test case;

the test unit is used for responding to the trigger to execute the batch job test and executing the test operation according to the preset test execution time of each job to be tested;

and the log recording unit is used for recording corresponding test logs according to the test operation process of each job to be tested.

According to a third aspect of the present invention, there is provided an electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method when executing the program.

According to a fourth aspect of the invention, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.

According to the technical scheme, the test case of the operation to be tested is generated based on the historical test data and case comparison information corresponding to the operation to be tested, then the test operation is generated according to the test case and the test operation template, when the batch operation test is triggered to be executed, the test operation is executed according to the preset test execution time of each operation to be tested, and the corresponding test log is recorded according to the test operation process of each operation to be tested, so that the automatic batch operation test can be realized, compared with the prior art, the batch program test efficiency can be effectively improved, and the batch test cost is saved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.

FIG. 1 is a flow diagram of a batch job testing method according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of a test job template according to an embodiment of the present invention;

FIG. 3 is a flow diagram of a batch test job according to an embodiment of the present invention;

FIG. 4 is a block diagram of a batch job testing apparatus according to an embodiment of the present invention;

fig. 5 is a schematic block diagram of a system configuration of an electronic apparatus 600 according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

At present, the COBOL language-based case test cannot well realize the continuous integration of the test and the automation of batch test, so that the batch program test efficiency is low, and the batch test cost is high. Specifically, the COBOL language-based case batch test mainly has the following problems:

case does not support direct call

The test cases of the host batch version at each stage are compiled greatly, the formed cases have high descriptive components and high instructive value, and the cases in the excel form also do not support direct calling. From the analysis of the automated testing angle, an expression form of a test case must be searched, so that the test branch can be clearly shown, and direct calling can be supported.

Second, data does not support multiplexing

The test personnel prepare the test cases one by one according to the test cases, continuously enrich and modify the test data in the test process, each case needs to prepare the test data manually, and the test data is wasted after being used up. So that each test requires a large amount of test data to be prepared without accumulation of data. If each test data can be saved, a basis can be laid for multiple executions of each case.

Thirdly, the test process does not support multiplexing

At present, batch test execution generally carries out verification of program logic functions by manually submitting test operation, and the other form is that upstream prepared test data is used, long-flow business logic verification is carried out in batches by using TWS, and technical verification and business verification are combined and are one-time verification processes and cannot be reused. The large-batch execution of the TWS meets the requirement of multiple-round tests, but the period is too long, and the opportunity is limited. If a mechanism for automatic case execution can be designed, the test process can be multiplexed many times.

Based on the above reasons, the embodiment of the invention provides a batch operation test scheme, which saves test data, takes the test data as an execution case, and can compile test operation to support automatic multiple execution, so that the batch program test efficiency can be effectively improved, and the batch test cost can be saved. Embodiments of the present invention are described in detail below with reference to the accompanying drawings.

FIG. 1 is a flow chart of a batch job testing method according to an embodiment of the present invention, as shown in FIG. 1, the method comprising:

step 101, generating a test case of an operation to be tested based on preset case comparison information and backup information corresponding to the operation to be tested, wherein the backup information comprises: historical test data.

In actual operation, in response to performing the host table recovery operation, a test case of the job to be tested is generated based on the case collation information (which may be in the form of a table, for example) and the backup information.

And 102, generating a test operation based on a preset test operation template according to the test case.

And 103, executing the batch job test in response to the trigger, executing the test operation according to the preset test execution time of each job to be tested, and recording a corresponding test log according to the test operation process of each job to be tested.

The test case of the operation to be tested is generated based on the historical test data and case comparison information corresponding to the operation to be tested, then the test operation is generated according to the test case and the test operation template, when the batch operation test is triggered to be executed, the test operation is executed according to the preset test execution time of each operation to be tested, and the corresponding test log is recorded according to the test operation process of each operation to be tested, so that the automatic batch operation test can be realized, compared with the prior art, the batch program test efficiency can be effectively improved, and the batch test cost is saved.

In step 101, the generated test cases further include current test data, and for facilitating the batch job test subsequently, the test cases may be saved in the form of test data, that is, saved as corresponding backup information.

In actual practice, before the triggering of step 103 to execute the batch job test, a triggering program (or called an open job) may be set according to a predetermined rule, where the triggering program indicates a batch test start time and a test execution time of each job to be tested.

The predetermined rule may be a rule according to actual tests, and the present invention is not limited thereto.

In one embodiment, the backup information further includes: and (5) historical testing operation results.

After the execution of step 103 is completed, a test verification operation may be performed according to the test operation result of the job to be tested and the historical test operation result in the backup information. Therefore, whether the test data of the automatic test is consistent with the historical test data or not can be judged, and when the test data is inconsistent with the historical test data, an alarm can be given out, so that the worker can conveniently process the test data.

For better understanding of the present invention, the following describes an embodiment of the present invention in detail by taking a lot test based on the COBOL language as an example.

In this embodiment, an automated testing method for implementing COBOL batch operations is constructed, and the method can configure case information in a case comparison table (corresponding to the case comparison information) shown in table 1 below, implement timed running of test operations, automatically perform data recovery of operations, automatically run COBOL batch functions, automatically verify test results, and automatically record functions of test execution.

The method specifically comprises the following four steps:

step 1, case writing is carried out according to a case comparison table shown in table 1, the case comparison table is a data source table used for defining each tested program, and one piece of test data is uniquely determined through indexes of the data source table. The case comparison table may be a general table, and each field is set based on different jobs, such as a case number, whether SQL (Structured Query Language) is executed, and the like.

TABLE 1

And 2, acquiring a test data backup table (corresponding to the backup information) corresponding to the data source table names of the tested COBOL program one by one, and storing specific test data for storing the test cases in a test data form subsequently, wherein one test data corresponds to one test scene.

And 3, completing the recovery of the test data from the test data table to the data source table based on a preset common test job template, reading the test file data, completing the calling execution of the job to be tested, comparing the execution results and recording the execution log.

The test operation template may be an existing test operation template, and the present invention is not limited thereto.

And 4, respectively formulating corresponding test data based on the tested COBOL program function and the branch function, and storing the test data in a test data backup table and a case comparison table.

An example is given below.

In this example, the version needs to verify and test the new COBOL program a, the data source tables of the program a are D, E, and F, and the program a function logic includes two test cases:

test case 1: updating the table D under the condition that the data of the test case 1 are met in the table D;

test case 2: and updating tables E and F under the condition that the data of the test case 2 are met in the table D.

The automated test procedure was performed as follows:

step 1: and establishing corresponding test data backup tables D1, E1 and F1 according to the three source tables D, E and F required by the program A, wherein the backup table structure is consistent with the source data table. And importing the data prepared by verifying the test case 1 and the test case 2 into D1, E1 and F1 for storage, and then carrying out preparation data backup on the test case 1 and the test case 2.

Step 2: and (4) compiling a case comparison table, and corresponding the data prepared in the step (1) to the test case numbers one by one. That is, find the data in table D that satisfies test case 1, for example, the unique key is JCSEQNO (application No. 2002165360000032, PDCODE (product code) 80020000501, and insert the relevant case information into the case comparison table.

And step 3: writing a test job according to the test job template, where fig. 2 is a schematic diagram of the test job template, and as shown in fig. 2, the test job template includes:

1. backing up host files (optional, optional step of tested job related files)

And backing up the host files which need to be read by the program to the test directory.

2. Copying test files (optional, optional step of job under test involving files)

The prepared test data file is copied, consistent with the source file structure.

3. Host meter recovery

The step is realized by a public program, and the reading of the test cases set by the case comparison table by the public program comprises the following steps: and positioning the table which needs to be recovered by the operation, such as a test operation name, a table name, an environment name, a test table environment name, a data unique key, a key value, a deletion mark and the like, and reading the test data from the test table to a source data table. That is, in this case, the data of the D1, E1 and F1 backup tables are restored to the D, E and F tables, and whether the data of the same primary key of the source data table is deleted or not or the data of the test table is deleted can be confirmed according to the deletion flag in the tables.

4. Host job operation

And invoking the operation to be tested in the test operation.

5. Test log registration

And registering a test log, recording information such as a test case number, a test job name, a tested job name and the like as job operation information, and then, analyzing and counting data of the coverage rate of the test case.

6. Restoring host files (optional, optional step of tested job related files)

If so, restoring the host file backed up in the first step to the source host file.

7. Test verification

Comparing the test results, after the steps, comparing the data before and after the program operation, wherein the data before the program operation exists in the test data backup table, the data after the program operation exists in the source data table, and writing comparison SQL to be added in the last step of the test operation to verify the test data. For the case of unsuccessful verification, for example, test case 1 should update table D, but update tables E and F, an alarm may be issued to confirm the cause of the problem through manual intervention.

8. Test job library

Setting automatic operation time, and as shown in fig. 3, a flow diagram of batch test jobs is shown, and as shown in fig. 3, test jobs can be called through an open job, and in actual operation, it is also necessary to confirm whether 911 fault occurs in each job step if DEL (delete) and INS (write) are simultaneously performed on the same table, that is, a resource lock fault occurs.

From the above description, the batch job testing method based on the COBOL language has the following advantages:

1. the automatic test system can be automatically executed for multiple times, achieves the purpose of automatic test, can be used for continuous integration, and saves repeated test labor.

2. The completeness of the test data can be visually and conveniently evaluated.

3. And (5) uniformly managing the test data in a centralized manner. Through accumulation of each version, test data for a certain batch of functions is more and more perfect, and the test data can be directly used in both a development process and a test process.

4. The test operation is centralized and managed uniformly, and is opened to all people, and the development and the test can be detected and tested at any time and any place.

5. The test execution log is traceable.

6. The method is easy to popularize for each application, and can be automatically executed only by preparing data according to requirements and compiling test operation.

Based on similar inventive concepts, the embodiment of the present invention further provides a batch testing apparatus, which is preferably used to implement the processes in the above method embodiments.

Fig. 4 is a block diagram showing the structure of the batch job testing apparatus, and as shown in fig. 4, the apparatus includes: a test case generating unit 1, a test job generating unit 2, a test unit 3, and a log recording unit 4, wherein:

the test case generating unit 1 is configured to generate a test case of an operation to be tested based on preset case comparison information and backup information corresponding to the operation to be tested, where the backup information includes: historical test data.

Specifically, in response to executing the host table recovery operation, the test case generating unit 1 generates a test case of the job to be tested based on the case comparison information and the backup information.

And the test operation generating unit 2 is used for generating a test operation based on a preset test operation template according to the test case.

And the test unit 3 is used for responding to the trigger to execute the batch job test and executing the test operation according to the preset test execution time of each job to be tested.

And the log recording unit 4 is used for recording corresponding test logs according to the test operation process of each job to be tested.

The test case of the operation to be tested is generated by the test case generating unit 1 based on the historical test data and case comparison information corresponding to the operation to be tested, then the test operation generating unit 2 generates the test operation according to the test case and the test operation template, when the batch operation test is triggered to be executed, the test unit 3 executes the test operation according to the preset test execution time of each operation to be tested, and the log recording unit 4 records the corresponding test log according to the test operation process of each operation to be tested, so that the automatic batch operation test can be realized, compared with the prior art, the batch program test efficiency can be effectively improved, and the batch test cost is saved.

In practical operation, the above apparatus further comprises: a trigger program setting unit for setting a trigger program (i.e., the above-mentioned opening job) indicating a batch test start time and a test execution time of each job to be tested according to a predetermined rule.

The test cases generated by the test case generating unit 1 include: and (6) testing data.

The above-mentioned device still includes: and the storage unit is used for storing the test cases in the form of test data.

The backup information further includes: and (5) historical testing operation results.

The device further comprises: and the test verification unit is used for carrying out test verification operation according to the test operation result of the operation to be tested and the historical test operation result.

For the specific execution process of each unit, reference may be made to the description in the foregoing method embodiment, and details are not described here again.

In practical operation, the units may be arranged in combination or in a single arrangement, and the present invention is not limited thereto.

The present embodiment also provides an electronic device, which may be a desktop computer, a tablet computer, a mobile terminal, and the like, but is not limited thereto. In this embodiment, the electronic device may be implemented by referring to the above method embodiment and the batch job testing apparatus embodiment, and the contents thereof are incorporated herein, and repeated details are not repeated.

Fig. 5 is a schematic block diagram of a system configuration of an electronic apparatus 600 according to an embodiment of the present invention. As shown in fig. 5, the electronic device 600 may include a central processor 100 and a memory 140; the memory 140 is coupled to the central processor 100. Notably, this diagram is exemplary; other types of structures may also be used in addition to or in place of the structure to implement telecommunications or other functions.

In one embodiment, the batch job test function may be integrated into the central processor 100. The central processor 100 may be configured to control as follows:

As can be seen from the above description, in the electronic device provided in the embodiment of the present application, a test case of an operation to be tested is generated based on historical test data and case comparison information corresponding to the operation to be tested, and then a test operation is generated according to the test case and a test operation template, when a batch operation test is triggered to be performed, a test operation is performed according to a preset test execution time of each operation to be tested, and a corresponding test log is recorded according to a test operation process of each operation to be tested.

In another embodiment, the batch job test apparatus may be configured separately from the central processor 100, for example, the batch job test apparatus may be configured as a chip connected to the central processor 100, and the batch job test function is realized by the control of the central processor.

As shown in fig. 5, the electronic device 600 may further include: communication module 110, input unit 120, audio processing unit 130, display 160, power supply 170. It is noted that the electronic device 600 does not necessarily include all of the components shown in fig. 5; furthermore, the electronic device 600 may also comprise components not shown in fig. 5, which may be referred to in the prior art.

As shown in fig. 5, the central processor 100, sometimes referred to as a controller or operational control, may include a microprocessor or other processor device and/or logic device, the central processor 100 receiving input and controlling the operation of the various components of the electronic device 600.

The memory 140 may be, for example, one or more of a buffer, a flash memory, a hard drive, a removable media, a volatile memory, a non-volatile memory, or other suitable device. The information relating to the failure may be stored, and a program for executing the information may be stored. And the central processing unit 100 may execute the program stored in the memory 140 to realize information storage or processing, etc.

The input unit 120 provides input to the cpu 100. The input unit 120 is, for example, a key or a touch input device. The power supply 170 is used to provide power to the electronic device 600. The display 160 is used to display an object to be displayed, such as an image or a character. The display may be, for example, an LCD display, but is not limited thereto.

The memory 140 may be a solid state memory such as Read Only Memory (ROM), Random Access Memory (RAM), a SIM card, or the like. There may also be a memory that holds information even when power is off, can be selectively erased, and is provided with more data, an example of which is sometimes called an EPROM or the like. The memory 140 may also be some other type of device. Memory 140 includes buffer memory 141 (sometimes referred to as a buffer). The memory 140 may include an application/function storage section 142, and the application/function storage section 142 is used to store application programs and function programs or a flow for executing the operation of the electronic device 600 by the central processing unit 100.

The memory 140 may also include a data store 143, the data store 143 for storing data, such as contacts, digital data, pictures, sounds, and/or any other data used by the electronic device. The driver storage portion 144 of the memory 140 may include various drivers of the electronic device for communication functions and/or for performing other functions of the electronic device (e.g., messaging application, address book application, etc.).

The communication module 110 is a transmitter/receiver 110 that transmits and receives signals via an antenna 111. The communication module (transmitter/receiver) 110 is coupled to the central processor 100 to provide an input signal and receive an output signal, which may be the same as in the case of a conventional mobile communication terminal.

Based on different communication technologies, a plurality of communication modules 110, such as a cellular network module, a bluetooth module, and/or a wireless local area network module, may be provided in the same electronic device. The communication module (transmitter/receiver) 110 is also coupled to a speaker 131 and a microphone 132 via an audio processor 130 to provide audio output via the speaker 131 and receive audio input from the microphone 132 to implement general telecommunications functions. Audio processor 130 may include any suitable buffers, decoders, amplifiers and so forth. In addition, an audio processor 130 is also coupled to the central processor 100, so that recording on the local can be enabled through a microphone 132, and so that sound stored on the local can be played through a speaker 131.

Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the steps of the batch job testing method.

In summary, in order to effectively improve the efficiency of batch program testing, save the cost of batch testing, and promote the self-testing level of batch programs, the embodiment of the invention prepares a test data storage scheme, takes the test data as an execution case, compiles test operation to support automatic multiple execution, and develops tool operation to realize the functions of automatic batch data recovery, automatic execution, and automatic checking of test results on the basis of not additionally increasing the workload of testers according to the current situation of the testing environment.

The preferred embodiments of the present invention have been described above with reference to the accompanying drawings. The many features and advantages of the embodiments are apparent from the detailed specification, and thus, it is intended by the appended claims to cover all such features and advantages of the embodiments which fall within the true spirit and scope thereof. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the embodiments of the invention to the exact construction and operation illustrated and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope thereof.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The principle and the implementation mode of the invention are explained by applying specific embodiments in the invention, and the description of the embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A method for testing a batch job, the method comprising:

2. The method of claim 1, wherein prior to triggering execution of a batch job test, the method further comprises:

and setting a trigger program according to a preset rule, wherein the trigger program indicates the start time of batch testing and the test execution time of each job to be tested.

3. The method of claim 1, wherein the test case comprises: testing data, the method further comprising:

and storing the test case in the form of test data.

4. The method of claim 3, wherein generating the test case of the job to be tested based on preset case comparison information and backup information corresponding to the job to be tested comprises:

and generating a test case of the job to be tested based on the case comparison information and the backup information in response to executing the host table recovery operation.

5. The method of claim 4, wherein the backup information further comprises: historical test operation results, after recording the test log according to the test operation process, the method further comprising:

and performing test verification operation according to the test operation result of the operation to be tested and the historical test operation result.

6. A batch job testing apparatus, comprising:

7. The apparatus of claim 6, further comprising:

and the trigger program setting unit is used for setting a trigger program according to a preset rule, and the trigger program indicates the start time of batch testing and the test execution time of each job to be tested.

8. The apparatus of claim 6, wherein the test case comprises: test data, the apparatus further comprising:

and the storage unit is used for storing the test cases in the form of test data.

9. The apparatus according to claim 8, wherein the test case generation unit is specifically configured to:

10. The apparatus of claim 9, wherein the backup information further comprises: historical test operation results, the apparatus further comprising:

and the test verification unit is used for carrying out test verification operation according to the test operation result of the operation to be tested and the historical test operation result.

11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method according to any of claims 1 to 5 are implemented when the processor executes the program.

12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 5.