TWI519946B - Regression testing system and method in variable database environment - Google Patents

Description

Regression test system and method in variable database environment

The invention relates to a regression test system and a method; in particular, particularly relates to a regression test system and method in a variable database environment, which provides an automated extraction test case and is compatible with individual processing to ensure that the processing of the test case is met. NCC specifications, individual capitalization laws and business rules. In addition, automated selection regression cases are also provided. The test cases are dynamically adjusted according to the version of the regression target, and the corresponding test cases are loaded for the regression targets of different versions, different functions and business logics. Test to meet the testing needs in different situations.

Regression testing means that after modifying the old program, re-testing to confirm that the modification has not introduced a new error or caused another program to generate an error. As the software changes, the functionality and application interface of the software and the implementation of the software evolve. Some test cases in the test case library may lose relevance and effectiveness, while other test cases may become obsolete. Some test cases will not work at all.

Regression testing relies heavily on a large number of manual execution controls, including test data preparation, putting test data into the system, performing functional tests, and verifying system production. Whether the results are in line with expectations. At present, the focus of the industry's practice on testing is mostly on the user's graphical interface, recording user behavior, and verifying the resulting image.

In the previous method of "Recognition Data" of the Republic of China Invention Patent No. 201007446, it is proposed to first define a plurality of specifications, and then select one of the specification codes to use the verification data, and then compare the verification results, and the method is applicable to the verification data. The situation in which the type of change is less, because it has limitations on the verification conditions. However, the demand is changing with each passing day, and the verification data needs to be updated frequently as the demand changes. If the specifications need to be changed frequently, it will be time-consuming and labor-intensive.

It can be seen that there are still many shortcomings in the above-mentioned methods of use, which is not a good design, but needs to be improved.

In view of the shortcomings derived from the above-mentioned conventional methods, the inventor of the present invention has improved and innovated, and after years of painstaking research, he finally succeeded in researching and developing this invention.

The object of the present invention is to provide a regression test system and method in a variable database environment, and automatically process data filling when the system information model changes, so as to maintain the validity and correctness of the test case and ensure the correctness of the regression result. Integrity, reduce the time spent on case re-extraction, and also deal with the capital processing when extracting test cases, to ensure that the information of the test cases is not involved in the individual capital, in line with NCC norms, individual capital laws, to avoid leakage due to test cases, resulting in leakage Customer loss and the impact of the company's reputation.

The second object of the present invention is to provide an automated selection regression case. For example, the test case is dynamically adjusted according to the version of the regression target, and the corresponding test cases of different versions, different functions and business logics are loaded to test the test cases to meet the test requirements under different conditions.

The regression test system and method in a variable database environment that achieves the above object is mainly composed of (1) a regression target setting module responsible for defining the attributes of the regression content target, and (2) a dynamic sampling for defining the sampling condition and its weight. Conditional component module, (3) Data processing module responsible for extracting test cases and verification, (4) Sample data storage module responsible for accessing test cases (5) Responsible for calculating weights and adopting test cases and performing regression testing The execution module, and (6) the result comparison module responsible for comparing the regression results

The regression test system and method in the variable database environment provided by the invention have the following advantages when compared with other conventional technologies:

1. Automated processing of data filling, for the processing of system information model changes, in order to maintain the validity and correctness of test cases, reduce the time spent on case re-extraction; ensure the integrity and correctness of regression test execution.

2. Automated extraction of test cases, and compatible with the processing of individual assets, to ensure that the processing of the extracted test cases is in line with NCC regulations, individual capital laws and business rules.

3. Automated selection of regression cases, dynamic adjustment of the regression case adopted by the version of the regression target, through the regression participation index and sampling condition weights can be tested for different versions, different functions and business logic regression indicators, loading corresponding test cases To meet the testing needs under different conditions.

101‧‧‧Extract test case information

102‧‧‧Verification test case information

103‧‧‧Regression test

104‧‧‧Comparison results

1011‧‧‧ Extract input/output data content and definition

1012‧‧‧Exhibition and alteration

1031‧‧‧Copy test cases to the environment of the return target

1032‧‧‧ Calculate test case weights

1033‧‧‧Confirmation of the system information model for returning to the environment

1034‧‧‧Information filling

1035‧‧‧Load test case information

1036‧‧‧ Perform regression testing

1041‧‧‧Data conversion

1042‧‧‧Unmatched processing

1043‧‧‧Business key-value comparison

1044‧‧‧ Output comparison results

20‧‧‧Regression test system in a variable database environment

201‧‧‧Return target setting module

202‧‧‧ Dynamic sampling conditions form the module

203‧‧‧ data sampling module

204‧‧‧Sampling data storage module

205‧‧‧ Remote Execution Module

206‧‧‧Results comparison module

2011‧‧‧Set the components of the regression target

2012‧‧‧Assembling setting components

2021‧‧‧Conditional assembly components

2022‧‧‧ conditional verification component

2023‧‧‧Conditional translation components

2024‧‧‧Subcondition setting

2025‧‧‧Operator

Please refer to the detailed description of the present invention and the accompanying drawings, which can further understand the technical content of the present invention and its effect. The related drawings are: Figure 1 is a regression test system and method in the variable database environment of the present invention. Method flow chart.

Figure 2 is a flow chart showing the steps of extracting test case information of the regression test system and method in the variable database environment of the present invention.

Figure 3 is a flow chart showing the steps of the regression test system and method in the variable database environment of the present invention.

Figure 4 is a flow chart showing the results of the comparison of the regression test system and method in the variable database environment of the present invention.

Figure 5 is a system architecture diagram of a regression test system and method in a variable database environment of the present invention.

Figure 6 is a functional module architecture diagram of a regression module of a regression test system and method in a variable database environment of the present invention.

Figure 7 is a functional module architecture diagram of the dynamic condition component module of the regression test system and method in the variable database environment of the present invention.

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

Hereinafter, the present invention is further described with reference to the accompanying drawings: the present invention is a regression test system and method in a variable database environment, please refer to FIG. 1 , and FIG. 1 is a regression test system and method in a variable database environment of the present invention. Method flow chart. As shown in FIG. 1 , the present invention provides a regression test system and method in a variable database environment. Before implementing the method, it is necessary to define the content attributes of the regression target (verification program name and path, regression reference index, input/ Output data and assignment rules), sampling conditions and sampling condition weight values, the following steps for the implementation of this method include: extracting test case information 101: using a custom sampling strategy (random number or direct designation) to the regression target actual operating environment extraction test Case S, S _m is the mth test case, and its m value is a non-negative integer; verification test case information 102: responsible for confirming whether the test case S satisfies the sampling condition (α ₁ , α ₂ , α ₃ .... α _n ), taking the test case S ₁ as an example, verifying whether the sampling condition α ₁ is satisfied, and verifying C _ij =S _i α _{j by the} following formula, where i m,j n,n 1 is substituted into the test case S ₁ and the sampling condition α ₁ , and the result is as follows: C ₁₁ = S ₁ α ₁ If C ₁₁ is 1, it means that S ₁ satisfies the sampling condition α ₁ , and vice versa, the sampling condition α ₁ is not satisfied.

Confirm that the test case S _i satisfies all sampling conditions α , as listed in the following formula:

The above formula indicates whether the verification result C _{i of the} test case S _i satisfies the sampling condition α , if C _i 1 means that the test case S _i satisfies at least one sampling condition α _j , that is, the test case Si is used for subsequent regression test, and vice versa.

Perform regression test 103: Load the test case verified by the verification test case information 102 into the execution environment of the regression target, and calculate the test case weight result Z used in the regression, and calculate according to the regression participation index. Regression is used to test the regression targets of different versions, different functions and business logics; the comparison result 104: Responsible for comparing the regression results, comparing the test cases (output data) with the regression execution results.

Please refer to FIG. 2, which is a step-by-step diagram of the extraction test case information of the regression test system and method in the variable database environment of the present invention. As shown in FIG. 2, the present invention provides a regression test system and method in a variable database environment, wherein the program step of extracting test case information 101 includes: extracting input/output data content and defining 1011: according to the content of the regression target The input/output data defined by the attribute obtains the input/output data content of the test case in the actual operating environment of the regression target, and the data field and type definition of the input/output data, as the basis for distinguishing the system information model in the future; Wipe and change 1012: According to the regression standard for the test cases The content field definition defined by the content attribute is processed, erased or altered, avoiding the problem of foreign capital leakage and compatible with the processing of individual capital specifications, ensuring that the processing of the extracted test cases complies with the NCC standard, the individual capital method and Business Rules.

Please refer to FIG. 3, which is a sequence diagram of the regression test of the regression test system and method in the variable database environment of the present invention. As shown in FIG. 3, the present invention provides a regression test system and method in a variable database environment, wherein the step of performing the regression test 103 includes: copying the test case to the regression target environment 1031: the test case that will pass the verification Copy to the execution environment and perform data cleanup actions to ensure that only valid test data exists in the regression execution environment and there is no test data affecting regression execution; Calculate test case weight 1032: Calculate test case weights in the current regression target execution environment The result Z, taking the test case S_i as an example, can calculate its weight result Z_i as follows: Where β _j is the weight value defined for α _j and confirms the PY of Z _i , that is, whether the test case S _i is used for this regression, wherein P is a regression participation index, defined by the content attribute of the regression target, Y is obtained by the following formula: Through Decide whether to use the test case in this regression; confirm the system information model 1033 of the return environment: the data field and type of the input/output data obtained according to the data field and type definition of the input/output data of the test case Define the data field and type definition corresponding to the execution environment of the regression target, and judge whether the system information model has any change. If there is any change, jump to the data padding 1034. Otherwise, jump to the load test case 1035. Data filling 1034: mainly for the processing of system information model changes, in order to maintain the validity and correctness of the test case, to ensure the integrity and correctness of the regression test execution, for the transaction field, according to the content attributes of the regression target The assignment rule defined by the field produces its data content. If not, the data field content is directly assigned to the Null value; the test case information 1035 is loaded: the test case is loaded into the regression target execution environment for subsequent Perform a regression test; perform a regression test 1036: a verification program and a program defined by the content attributes of the regression target Call path, perform regression testing.

Please refer to FIG. 4, which is a flow chart of the comparison result of the regression test system and method in the variable database environment of the present invention. As shown in FIG. 4, the present invention provides a regression test system and method in a variable database environment, wherein the program step of performing the comparison result 104 includes: performing data conversion 1041: testing the test case (output data) and regression The result is converted into a consistent data format by the current system information model of the regression execution environment; the non-alignment processing 1042: the data format converted by the data conversion 1041 is identified according to the definition of the content attribute of the regression target, Identifying the field is not necessary for comparison processing, speeding up the comparison processing; performing business key value comparison 1043: comparing the data format after conversion and identification according to the definition of the data service key value defined by the content attribute of the regression target, During the comparison process, the data with the same business key value is paired, and then the field contents are compared. If there is no comparison between the fields, the results are compared one by one. Otherwise, the comparison of the contents of the field is ignored, and then the comparison of the contents of the next field is performed; the output comparison result is 1044: according to the ratio The difference between the test case (input data, output data) and the regression test result can be found in the report content corresponding to the result output.

Please refer to FIG. 5. FIG. 5 is a system architecture diagram of a regression test system and method in the variable database environment of the present invention. As shown in FIG. 5, the present invention provides a regression test system and method in a variable database environment, which mainly comprises six major units: a regression target setting module 201, a dynamic sampling condition forming module 202, and a data sampling module. 203. The sample data storage module 204, the remote execution program module 205, and the result comparison module 206. The data temporary storage 207 is responsible for storing the data generated by the above modules during the execution of the regression test.

Please refer to FIG. 6. FIG. 6 is a functional module architecture diagram of a regression module of the regression test system and method in the variable database environment of the present invention. As shown in FIG. 6, the present invention provides a regression test system and method in a variable database environment, wherein a functional module architecture diagram of the regression target setting module 201 defines a content attribute of a regression target by setting a component of the regression target 2011. The regression test target can be dynamically added, and the content of the regression target is converted into the object used in the system by the assembly setting component 2012, and is provided to the sample data storage module 204, the remote execution program module 205, and the result comparison module. 206 used.

The content attribute information of the regression target is stored in the data temporary storage 207, and the content attributes of the regression target include: the verification program name and the path, the regression participation index, the input/output data, and the assignment rule. Input/output data content includes: name, location, type (database/archive), field definition, data business key definition (business key), personal fund field definition, no match field setting Righteousness and so on. The definition of the data service key value is convenient for identifying the correspondence between different pen data when the data is subsequently compared, and there is no situation in which different pen data is treated as the same data. The definition of the individual fund field is convenient for erasing or altering the personal fund field when extracting data.

No, than the definition of the field, such as the serial number field, the result data of each execution may be different, but it does not affect the correctness of the overall data. We define this field as a field that does not need to be compared. In the subsequent comparison regression execution result, the field will be skipped; the assignment rule is set for the data field of the system model change, and whether the field data is used or assigned to a single specific value, Specifying the field data from a specific value range and assigning the field data to a specific value according to certain specific columns in the test case data, if there is no setting, directly assigning the data field to a Null value; The participation index is responsible for calculating whether to use the test case during the regression, and the regression case can be automatically selected through the attribute, and the regression case adopted is dynamically adjusted according to the version of the regression target. The purpose of the above content attributes is to dynamically add or modify the relevant parameter content of the regression, and as a unified data definition center of other modules.

Please refer to FIG. 7. FIG. 7 is a functional module architecture diagram of a dynamic condition component module of the regression test system and method in the variable database environment of the present invention. As shown in FIG. 5 and FIG. 7, the present invention provides a regression test system and method in a variable database environment, wherein the dynamic sampling condition component module 202 is responsible for defining different functions and services for providing the conditional assembly component 2021. The sampling condition, and the weight value of each sampling condition is defined, and the condition defined by the elastic assembly sub-condition setting 2024 and the operation unit 2025 are processed into sampling conditions, and the sampling verification is performed via the condition verification component 2022 to determine whether the sampling condition is correct. If yes, the delivery condition translation component 2023 processes, translates, and generates sampling conditions for the data sampling module 203 to perform sampling.

The sub-condition setting 2024 provides a setting condition definition for subsequent reuse in conditional assembly; the condition verification element 2022 is responsible for verifying whether the logical condition of the sampling condition composed of the conditional assembly element 2021 is correct to ensure sampling condition logic. The validity and correctness of the conditional translation component 2023 is responsible for translating the sampling conditions into objects executable by the data sampling module 203.

The data sampling module 203 implements the extraction test case information 101 and the verification test case information 102 of the regression test method in the variable database environment, provides an automated extraction case and confirms whether each test case satisfies the sampling condition, and finally meets the sampling. The conditional case data is delivered to the sample data storage module 204 for subsequent processing.

The sample data storage module 204 is used as a unified interface for the test cases of the system, and is responsible for accessing the test cases of the data sampling module 203, the remote execution program module 205, and the result comparison module 206. Receiving the call of the data sampling module 203, storing the test case that meets the verification result, and also providing the call of the remote execution program module 205 and the result comparison module 206, reading the stored test case information, due to the sampling data The save module 204 only performs relatively simple data access operations, so the stability is high, and it is not affected by business logic changes, so it can operate for a long time.

The remote execution program module 205 implements the regression test 103 in the regression test method in the variable database environment; the result comparison module 206 implements the regression test method in the variable database environment to compare the results 104. .

The detailed description above is specifically described for one possible embodiment of the present invention, but the embodiment is not intended to limit the scope of the patent of the present invention. Equivalent implementations or modifications departing from the spirit of the invention are intended to be included in the scope of the invention.

To sum up, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of the past. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.

103‧‧‧Regression test

1031‧‧‧Copy test cases to the environment of the return target

1032‧‧‧ Calculate test case weights

1033‧‧‧Confirmation of the system information model for returning to the environment

1034‧‧‧Information filling

1035‧‧‧Load test case information

1036‧‧‧ Perform regression testing

Claims (10)

A regression test method in a variable database environment, the steps of which include at least: A. extracting test case information, extracting a test case from a custom sampling strategy mode to a real operating environment of the regression target, and transmitting the test case to the verification test case information; B. The verification test case information confirms whether the test case satisfies the sampling condition; C. performs regression test, performs data clearing on the regression execution environment and calculates loading the appropriate test case for regression test; and D. performs comparison test, Compare the output data of the test cases used in the regression test with the regression execution results. For example, the regression test method in the change database environment described in claim 1 of the patent application, wherein the step of extracting test case information further comprises: A1. extracting input/output data content and definition, as defined by the content attribute of the regression target Input/output data, obtain the input/output data content of the test case in the actual operating environment of the regression target, the data field and type definition of the input/output data, as the basis for distinguishing the system information model in the future; and A2. Wipe and change, and the test cases extracted are processed according to the definition of the individual resource fields defined by the content attributes of the regression target, and erased or altered. Regression measurement in the context of the change database as described in item 1 of the patent application scope The test method, wherein the step of performing the regression test further comprises: C1. copying the test case to the environment of the regression target, copying the test case passed through the verification to the execution environment and performing a data clearing action to ensure that only valid in the regression execution environment exists. Test data and no test data affecting regression execution; C2. Calculate test case weights, calculate test cases that meet the regression test; C3. Confirm the system information model of the regression environment, and input/output data according to test cases Field and type definition The data field and type definition of the input/output data obtained are compared with the corresponding data field and type definition of the execution environment of the regression target to determine whether the system information model has changed. If there is a change, it will jump to fill the data, otherwise it will jump to the test case information; C4. Fill in the data, and deal with the system information model change, to maintain the validity and correctness of the test case and ensure the regression test execution. Integrity, correctness, for the transaction field, according to the content attribute of the regression target The assignment rule defined by the bit produces its data content. If not, the content of the data field is directly assigned to the Null value; C5. Load the test case information, load the test case into the execution environment of the regression target; and C6. In the regression test, the call is performed according to the verification program and the path defined by the content attribute of the regression target, and the regression test is performed. The regression test method in the environment of the change database described in claim 1 of the patent application, wherein the step of comparing the results further comprises: D1. Perform data conversion, convert test cases and regression results into a consistent data format in the current regression environment system information model; D2. Perform non-alignment processing, and perform data conversion steps to convert the data format according to the content attributes of the regression target. It is defined that no more than the identification of the field to identify the field is not necessary for comparison processing, speed up the comparison processing; D3. Perform business key value comparison, according to the data attribute key value defined by the content attribute of the regression target The data format after conversion and identification is compared. In the comparison process, the data with the same business key value is paired, and then the content of the field is compared. If the field is processed, the output result is compared one by one. Conversely, the comparison of the contents of the field is ignored, and then the comparison of the contents of the next field is performed; and D4. The output comparison result, according to the report content corresponding to the output of the comparison result, the test case and the regression are known. The difference in test results. A regression test system in a variable database environment, the system comprising at least: a regression target setting module, defining a content attribute of the regression target, and elastically increasing the regression test target to serve as a unified data definition center of other modules; Dynamic sampling conditions form a module that defines sampling conditions covering different functions and services, and defines weight values for each sampling condition; a data sampling module that provides automated extraction of cases and determines whether each test case satisfies the sampling conditions; The sample data storage module is a unified interface for the data of the test cases. Providing the data sampling module, the remote execution program module, and the result comparison module call, accessing the test case information; and a remote execution program module for returning to the execution environment initialization and calculating the loading suitable The test case is subjected to a regression test; and a result comparison module compares the regression result, and compares the test case with the regression execution result; wherein the regression target setting module transmits the test case to the dynamic sampling condition Forming a module, defining the test case and transmitting it to the data sampling module, performing the judgment and transmitting to the sample data storage module for access, and the remote execution program module performs a regression test, and transmitting the test case to The result is compared with the module, and the test case is transmitted back to the sample data saving module. The regression test system in the variable database environment described in claim 5, wherein the regression target setting module further comprises: a component for setting a regression target, and providing a setting function of each attribute of the content attribute of the regression target; An assembly setting component provides for converting the content attribute of the regression target into an object used inside the system, and is connected to the component of the set regression target. The regression test system in the variable database environment as described in claim 5, wherein the content attribute of the regression target has a verification program name, a path, a regression participation index, and an input/output data or an assignment rule. A regression test system in a variable database environment as described in claim 7 wherein the input/output data has a name, location, type, Field definition, data business key definition, collateral field definition or no match field definition. The regression test system in the variable database environment described in claim 5, wherein the dynamic sampling condition component module further comprises: a sub-condition setting, defining data; an operation element, processing the data as a sampling condition a conditional assembly component that assembles the sub-condition setting and operation elements into a condition; a conditional verification component that verifies whether the condition conforms to the operational logic; and a conditional translation component that translates into an identifiable decision logic; wherein The conditional assembly component merges and assembles the sub-condition setting with the data of the operand as a condition, and the condition is transmitted to the conditional verification component for determination, and then the condition is transmitted to the conditional translation component. The regression test system in the variable database environment as described in claim 5, wherein the data sampling module further comprises: a random sampling component, extracting data; and a data verification component, receiving the data for verification.