CN117762814A

CN117762814A - Test result recording method, device, equipment, medium and product

Info

Publication number: CN117762814A
Application number: CN202410005408.1A
Authority: CN
Inventors: 管斌
Original assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Current assignee: China Construction Bank Corp; CCB Finetech Co Ltd
Priority date: 2024-01-02
Filing date: 2024-01-02
Publication date: 2024-03-26

Abstract

The application provides a test result recording method, a device, equipment, a medium and a product, which relate to the technical field of computers and comprise the following steps: analyzing the first program to be tested to obtain at least one input variable for storing input data and at least one result variable for storing test results; screening at least one input variable to obtain M input variables; generating a test result reference table according to the M input variables and at least one result variable; obtaining a plurality of groups of variable values; testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable; and storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in a test result reference table to obtain test records corresponding to each group of variable values. According to the mode, whether the result is the same as the result recorded in the test result reference table or not can be automatically compared in the test, and the accuracy of test result comparison is improved.

Description

Test result recording method, device, equipment, medium and product

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method, an apparatus, a device, a medium, and a product for recording test results.

Background

When a system function test with huge service data volume is performed, a large number of background asynchronous tasks can calculate the data. When a new function is on line, a developer and a tester can manually calculate and verify the calculation result. After entering stock development, these historical functions will make automated test cases, automatically testing at each version, avoiding influencing the results of the old functions due to new function modifications. The tester can compare the automatic result of the automatic test by fixing the test data and storing the test result table data under the test data as a reference and comparing the automatic test result of the subsequent version with the reference.

The existing method for storing the test reference results is to directly establish a database test result reference table in the test environment database, and the fields of the table are consistent with the actual table fields to be compared. After the fixed test data is tested, the test results in the database table are imported into the corresponding test result reference table, and then the test reference result is obtained.

The data in the test results of part of functions in the system are hooked with variables such as accounting date, but the variable fields are not in the test result table. For example, if the primary key is unchanged, the data of the result table will refresh the fields of the remaining amount, the remaining number, etc. according to the change of the accounting date. If the test data of a certain accounting date can be stored only according to the existing method for storing the test reference result, no method exists for automatically comparing the updated results of the accounts under different accounting dates, so that the test result is inaccurate in comparison, and the test process is affected.

Disclosure of Invention

According to the test result recording method, device, equipment, medium and product, the accuracy of test result comparison can be improved.

In a first aspect, an embodiment of the present application provides a test result recording method, including:

analyzing the first program to be tested to obtain at least one input variable for storing input data and at least one result variable for storing test results;

screening the at least one input variable to obtain M input variables, wherein M is a positive integer;

generating a test result reference table according to the M input variables and the at least one result variable, wherein the test result reference table comprises a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable;

obtaining a plurality of groups of variable values, wherein each group of variable values comprises a variable value of each input variable, and the variable values of the M input variables in different groups of variable values are different;

testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable;

and storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in the test result reference table to obtain test records corresponding to each group of variable values.

In a second aspect, the present application provides a test result recording apparatus, the apparatus comprising:

the analysis module is used for analyzing the first program to be tested to obtain at least one input variable for storing input data and at least one result variable for storing test results;

the screening module is used for screening the at least one input variable to obtain M input variables, wherein M is a positive integer;

the generating module is used for generating a test result reference table according to the M input variables and the at least one result variable, wherein the test result reference table comprises a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable;

the acquisition module is used for acquiring a plurality of groups of variable values, wherein each group of variable values comprises variable values of each input variable, and the variable values of the M input variables in different groups of variable values are different;

the testing module is used for testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable;

and the storage module is used for storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in the test result reference table to obtain test records corresponding to each group of variable values.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor and a memory storing computer program instructions;

the processor when executing the computer program instructions implements the test result recording method as in any one of the embodiments of the first aspect.

In a fourth aspect, embodiments of the present application provide a computer storage medium having stored thereon computer program instructions which, when executed by a processor, implement a test result recording method as in any one of the embodiments of the first aspect.

In a fifth aspect, embodiments of the present application provide a computer program product, where instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to perform a test result recording method implementing any one of the embodiments of the first aspect described above.

The test result recording method, device, equipment, medium and product in the embodiment of the application, wherein the method comprises the following steps: analyzing the first program to be tested to obtain at least one input variable for storing input data and at least one result variable for storing test results; screening the at least one input variable to obtain M input variables, wherein M is a positive integer; generating a test result reference table according to the M input variables and the at least one result variable, wherein the test result reference table comprises a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable; obtaining a plurality of groups of variable values, wherein each group of variable values comprises a variable value of each input variable, and the variable values of the M input variables in different groups of variable values are different; testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable; and storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in the test result reference table to obtain test records corresponding to each group of variable values. In the test process, the variable values of M input variables in the test result reference table can be used for testing the first program to be tested, and the variable values of the obtained result variables are compared with the variable values of the corresponding result variables in the test result reference table, so that in the automatic test, whether the result is identical to the recorded result in the test result reference table can be automatically compared, and the accuracy of test result comparison is improved.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described, and it is possible for a person skilled in the art to obtain other drawings according to these drawings without inventive effort.

FIG. 1 is a flow chart of a test result recording method according to an embodiment of the present application;

FIG. 2 is a second flow chart of a test result recording method according to an embodiment of the present disclosure;

FIG. 3 is a third flow chart of a test result recording method according to an embodiment of the present application;

FIG. 4 is a schematic structural diagram of a test result recording device according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure. The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.

It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.

In order to solve the problems in the prior art, the embodiment of the application provides a test result recording method, a device, equipment, a medium and a product. The following first describes a test result recording method provided in the embodiment of the present application.

Fig. 1 is a flow chart illustrating a test result recording method according to an embodiment of the present application. As shown in fig. 1, the method specifically may include the following steps:

step 101, analyzing the first program to be tested to obtain at least one input variable for storing input data and at least one result variable for storing test results.

The first program to be tested may be any program to be tested. The first program to be tested may be a program code, or may be a function implemented by the first program to be tested, and if the first program to be tested is a program code, the program code is parsed to obtain at least one input variable and at least one result variable, where the input variable is used to store an input variable value, and the result variable is used to store an output variable value.

If the first program to be tested is a function realized by the first program to be tested, analyzing the function to obtain a variable value required to be input by the function test and an output variable value.

By analyzing the first program to be tested, an input variable and an output variable can be obtained, and the data type of the input variable and the data type of the output variable can be obtained, wherein the data type refers to the variable value which can be decimal, integer, text or date, and the like.

Step 102, screening the at least one input variable to obtain M input variables, wherein M is a positive integer.

After the input variables are obtained, the input variables are filtered, for example, the input variables with variable values related to time are filtered, and M input variables are obtained. The M input variables are input variables associated with time, and their values are associated with time, for example, if the first program to be tested is a balance for counting the current year, the input variables are the current time period from 1 month 1 day of the current year, and the result variables are balance data of the current time period.

And 103, generating a test result reference table according to the M input variables and the at least one result variable, wherein the test result reference table comprises a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable.

The test result reference table includes a plurality of fields, each field corresponding to one of the M input variables or to one of the result variables. For example, if the number of input variables is 1 and the number of result variables is 1, the test result reference table may include 2 fields, one field corresponding to the input variables and one field corresponding to the result variables.

Step 104, obtaining a plurality of groups of variable values, wherein each group of variable values comprises variable values of each input variable, and the variable values of the M input variables in different groups of variable values are different.

At the time of testing, there may be multiple sets of test data, i.e., multiple sets of variable values, each set of variable values including a variable value for each input variable, in different sets, variable values for M input variables being different, e.g., if the number of input variables is 1, variable values for input variables in different sets being different; if the number of input variables is 2, the variable values of the input variables in different groups may be partially the same, partially different, or all different, and are not limited herein.

And 105, testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable.

And taking each group of variable values as input values, and testing the first program to be tested to obtain an output result of the first program to be tested, namely a value corresponding to a result variable. Each set of variable values corresponds to a variable value corresponding to a result variable.

And 106, storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in the test result reference table to obtain test records corresponding to each group of variable values.

In this step, variable values of M input variables and variable values of corresponding result variables are stored in the test result reference table, variable values of input variables are stored in fields corresponding to input variables, variable values of result variables are stored in fields corresponding to result variables, and each set of variable values corresponds to one or more test records in the test result reference table.

In this embodiment, variable values of M input variables and variable values of a result variable are stored in a test result reference table, and in the case that the variable values of the input variables are the same, the variable values of the result variable are necessarily the same, in the test process, the variable values of M input variables in the test result reference table may be used to test the first program to be tested, and the obtained variable values of the result variable are compared with the variable values of the result variable corresponding to the test result reference table, so that in the automated test, whether the result is the same as the result recorded in the test result reference table can be automatically compared, and the accuracy of test result comparison can be improved.

Fig. 2 is a flow chart illustrating a test result recording method according to an embodiment of the present application. As shown in fig. 2, the method specifically may include the following steps:

step 201, analyzing the first program to be tested, to obtain at least one input variable for storing input data and at least one result variable for storing test results.

Step 202, screening the at least one input variable to obtain M input variables, where M is a positive integer.

And 203, generating a test result reference table according to the M input variables and the at least one result variable, wherein the test result reference table comprises a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable.

Step 204, obtaining variable values of N input variables from the configuration file, to obtain variable values of the N input variables in different groups of variable values, where the N input variables are input variables except the M input variables in the at least one input variable, N is a positive integer, and variable values of the N input variables in different groups of variable values are the same.

In this step, the input variables are divided into M input variables and N input variables, wherein each of the M input variables is time-dependent, and wherein among the variable values of the different groups, the variable value of at least one of the M input variables is different, and wherein for the N input variables, the variable values of the N input variables are the same in the different groups.

In step 205, variable values of the M input variables are received.

Steps 204-205 are one specific implementation of step 104.

The variable values of the M input variables are received, which may be: receiving user input, wherein the user input is used for determining variable values of the M input variables, or receiving test results of a second program to be tested, and the test results of the second program to be tested comprise the variable values of the M input variables.

That is, each set of variable values of the M input variables may be determined based on user input, or may be a test result of the second program to be tested.

And step 206, testing the first program to be tested by adopting each group of variable values to obtain variable values corresponding to each result variable.

And step 207, storing the variable values of the M input variables corresponding to each group of variable values and the variable values of each result variable into corresponding fields in the test result reference table to obtain test records corresponding to each group of variable values.

Step 208, obtaining first variable values of M input variables in the first test record from the test result reference table. The first test record may be any one of the test records in the test result reference table.

Step 209, obtaining variable values of N input variables from the configuration file, where the variable values of N input variables remain unchanged in each test record and may be stored in the configuration file.

Step 210, testing the first program to be tested by adopting the variable values of the N input variables and the first variable values of the M input variables to obtain a result value corresponding to each result variable;

step 211, comparing the result value corresponding to each result variable with the variable value of each result variable in the first test record, to obtain a comparison result.

If the comparison results are the same, the result of the test is the same as the previous test result, and the first program to be tested has no problem; if the test results are different, the test results are different from the previous test results (the test records stored in the test result reference table are the previous test results, and the test results are used as reference records to participate in comparison), and the first program to be tested may have problems and needs to be eliminated.

Further, a first field and a second field are newly added in the test result reference table, wherein the first field is used for recording the same times of comparison results, and the second field is used for recording the test times and is convenient for checking the history comparison records.

In this embodiment, the M input variables and the corresponding test results of the initial test are stored in the test result reference table, and when the test is performed again, the variable values of the input variables can be directly obtained from the test result reference table and the configuration file, and the test results are compared with the variable values of the result variables in the test result reference table, so that the whole test process does not need to manually determine the variable values of the input variables, or manually determine whether the test results are accurate, and the test efficiency can be greatly improved.

Fig. 3 is a schematic flow chart of a test result recording method according to an embodiment of the present application.

The test result recording method provided by the embodiment of the application has the main content that when a database test result reference table is newly built, the field of the related variable is newly added; when the test result in the database table is imported into the corresponding test result reference table, the newly added field is used as a variable, and all the results taking the variable as the test input value are imported into the corresponding test result reference table; filtering the newly added fields when comparing the results, and comparing according to the newly added fields as comparison parameters. The dimension of the test result is expanded through the newly added variable field, and when the result is automatically compared, the dimension can be automatically compared by taking the newly added field as a parameter to filter.

The test result recording method comprises the following steps:

1. and identifying variable fields which need to be added in the test result reference table relative to the test result table according to the property of the function to be tested, and adding corresponding fields in the test result reference table.

2. And performing test execution by taking the newly added field as a variable, importing test result table data obtained by each variable value into a test result reference table, and filling the variable value into the newly added field. Thus, the test result data is expanded through the added fields.

3. And the subsequent automatic test task is called and executed according to the added field value, and the filtering and the automatic comparison of the execution result of each time according to the corresponding newly added field value are carried out.

In the embodiment of the application, the method for automatically comparing the test results by expanding the dimension of the test results has the main advantages that the dimension of the test results is expanded through the newly added variable fields, and when the results are automatically compared, the automatic comparison can be performed by filtering according to the newly added fields as parameters. The method of expanding the dimension of the original test result table by adding the field of the test result reference table enables the test result reference which cannot be stored originally to be stored, so that in the automatic test, the test result can automatically compare whether the result is consistent with the historical version or not, and the test efficiency is greatly improved.

Fig. 4 is a schematic structural view of a test result recording apparatus according to an embodiment of the present application, and for convenience of explanation, only a portion related to the embodiment of the present application is shown.

Referring to fig. 4, the test result recording apparatus 400 may include:

an analysis module 401, configured to analyze a first program to be tested, to obtain at least one input variable for storing input data and at least one result variable for storing a test result;

a screening module 402, configured to screen the at least one input variable to obtain M input variables, where M is a positive integer;

a generating module 403, configured to generate a test result reference table according to the M input variables and the at least one result variable, where the test result reference table includes a plurality of fields, and each field corresponds to one variable of the M input variables and the at least one result variable;

a first obtaining module 404, configured to obtain a plurality of sets of variable values, where each set of variable values includes a variable value of each input variable, and variable values of the M input variables in different sets of variable values are different;

the first testing module 405 is configured to test the first program to be tested by using each set of variable values, so as to obtain a variable value corresponding to each result variable;

and the storage module 406 is configured to store variable values of the M input variables corresponding to each set of variable values and variable values of each result variable to corresponding fields in the test result reference table, so as to obtain a test record corresponding to each set of variable values.

In one embodiment of the present application, the screening module 402 includes:

and the screening sub-module is used for analyzing the at least one input variable, screening out the input variables with the variable values associated with time, and obtaining M input variables.

In an embodiment of the present application, the first obtaining module 404 includes:

the acquisition submodule is used for acquiring variable values of N input variables from the configuration file to obtain variable values of the N input variables in different groups of variable values, wherein the N input variables are input variables except the M input variables in the at least one input variable, N is a positive integer, and the variable values of the N input variables in different groups of variable values are the same;

and the receiving submodule is used for receiving variable values of the M input variables.

In an embodiment of the present application, the receiving submodule is configured to:

receiving user input for determining variable values of the M input variables,

or,

and receiving a test result of a second program to be tested, wherein the test result of the second program to be tested comprises variable values of the M input variables.

In an embodiment of the present application, the apparatus 400 further includes:

the second acquisition module is used for acquiring first variable values of M input variables in a first test record from the test result reference table;

the third acquisition module is used for acquiring variable values of N input variables from the configuration file;

the second testing module is used for testing the first program to be tested by adopting the variable values of the N input variables and the first variable values of the M input variables to obtain a result value corresponding to each result variable;

and the comparison module is used for comparing the result value corresponding to each result variable with the variable value of each result variable in the first test record to obtain a comparison result.

In an embodiment of the present application, the apparatus further includes a recording module, configured to add a first field and a second field to the test result reference table, where the first field is used to record the same number of times of the comparison result, and the second field is used to record the number of times of the test.

The test result recording apparatus 400 provided in this embodiment of the present application can implement each process implemented by the foregoing method embodiment, and in order to avoid repetition, a description is omitted here.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.

Fig. 5 shows a schematic hardware structure of an electronic device according to an embodiment of the present application.

The electronic device may include a processor 501 and a memory 502 in which program instructions are stored.

The steps of any of the various method embodiments described above are implemented when the processor 501 executes a program.

For example, a program may be partitioned into one or more modules/units, which are stored in the memory 502 and executed by the processor 501 to complete the present application. One or more of the modules/units may be a series of program instruction segments capable of performing specific functions to describe the execution of the program in the device.

In particular, the processor 501 may include a Central Processing Unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or may be configured to implement one or more integrated circuits of embodiments of the present application.

Memory 502 may include mass storage for data or instructions. By way of example, and not limitation, memory 502 may comprise a Hard Disk Drive (HDD), floppy Disk Drive, flash memory, optical Disk, magneto-optical Disk, magnetic tape, or universal serial bus (Universal Serial Bus, USB) Drive, or a combination of two or more of the foregoing. Memory 502 may include removable or non-removable (or fixed) media, where appropriate. Memory 502 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, the memory 502 is a non-volatile solid state memory.

The memory may include Read Only Memory (ROM), random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors) it is operable to perform the operations described with reference to methods in accordance with aspects of the present disclosure.

The processor 501 implements any one of the methods of the above embodiments by reading and executing program instructions stored in the memory 502.

In one example, the electronic device may also include a communication interface 503 and a bus 510. The processor 501, the memory 502, and the communication interface 503 are connected to each other via a bus 510 and perform communication with each other.

The communication interface 503 is mainly used to implement communication between each module, apparatus, unit and/or device in the embodiments of the present application.

Bus 510 includes hardware, software, or both that couple the components of the online data flow billing device to each other. By way of example, and not limitation, the buses may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a micro channel architecture (MCa) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of the above. Bus 510 may include one or more buses, where appropriate. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.

In addition, in combination with the method in the above embodiment, the embodiment of the application may be implemented by providing a storage medium. The storage medium has program instructions stored thereon; the program instructions, when executed by a processor, implement any of the methods of the embodiments described above.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running a program or instructions, the processes of the above method embodiment are realized, the same technical effects can be achieved, and in order to avoid repetition, the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application provide a computer program product, which is stored in a storage medium, and the program product is executed by at least one processor to implement the respective processes of the above method embodiments, and achieve the same technical effects, and are not repeated herein.

It should be clear that the present application is not limited to the particular arrangements and processes described above and illustrated in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present application are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications, and additions, or change the order between steps, after appreciating the spirit of the present application.

The functional blocks shown in the above block diagrams may be implemented in hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the present application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine readable medium or transmitted over transmission media or communication links by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transfer information. Examples of machine-readable media include electronic circuitry, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio Frequency (RF) links, and the like. The code segments may be downloaded via computer grids such as the internet, intranets, etc.

It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, the present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be different from the order in the embodiments, or several steps may be performed simultaneously.

Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable test result recording apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable test result recording apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to being, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware which performs the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In the foregoing, only the specific embodiments of the present application are described, and it will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to the corresponding processes in the foregoing method embodiments, which are not repeated herein. It should be understood that the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive various equivalent modifications or substitutions within the technical scope of the present application, which are intended to be included in the scope of the present application.

Claims

1. A method of recording test results, the method comprising:

2. The method of claim 1, wherein filtering the at least one input variable to obtain M input variables, comprises:

and analyzing the at least one input variable, screening out input variables with variable values related to time, and obtaining M input variables.

3. The method of claim 1, wherein obtaining a plurality of sets of variable values comprises:

obtaining variable values of N input variables from a configuration file to obtain variable values of the N input variables in different groups of variable values, wherein the N input variables are input variables except the M input variables in the at least one input variable, N is a positive integer, and the variable values of the N input variables in different groups of variable values are the same;

variable values of the M input variables are received.

4. A method according to claim 3, wherein receiving variable values of the M input variables comprises:

receiving user input for determining variable values of the M input variables,

or,

5. A method according to claim 3, wherein after obtaining test records corresponding to each set of variable values, the method further comprises:

acquiring first variable values of M input variables in a first test record from the test result reference table;

acquiring variable values of N input variables from the configuration file;

testing the first program to be tested by adopting the variable values of the N input variables and the first variable values of the M input variables to obtain a result value corresponding to each result variable;

and comparing the result value corresponding to each result variable with the variable value of each result variable in the first test record to obtain a comparison result.

6. The method of claim 5, wherein comparing the result value corresponding to each result variable with the variable value of each result variable in the first test record, and after obtaining the comparison result, the method further comprises:

and a first field and a second field are newly added in the test result reference table, wherein the first field is used for recording the same times of comparison results, and the second field is used for recording the test times.

7. A test result recording apparatus, the apparatus comprising:

8. An electronic device, the device comprising: a processor and a memory storing computer program instructions;

the processor, when executing the computer program instructions, implements the test result recording method according to any one of claims 1-6.

9. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon computer program instructions, which when executed by a processor, implement the test result recording method according to any of claims 1-6.

10. A computer program product, characterized in that instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to perform the test result recording method according to any of claims 1-6.