WO2020248506A1

WO2020248506A1 - Evaluation method and device for application program testing, and server and storage medium

Info

Publication number: WO2020248506A1
Application number: PCT/CN2019/118663
Authority: WO
Inventors: 何兵
Original assignee: 平安科技（深圳）有限公司
Priority date: 2019-06-14
Filing date: 2019-11-15
Publication date: 2020-12-17
Also published as: CN110399289B; CN110399289A

Abstract

An evaluation method for application program testing, comprising: when first test data and second test data which are sent by different terminals and used for testing a same preset application program are received, respectively obtaining a first dictionary file and first function information in the first test data and a second dictionary file and second function information in the second test data (S10); respectively reading first identification information of the first function information in the first dictionary file and second identification information of the second function information in the second dictionary file (S20); respectively determining whether the first function information and the second function information are executed functions according to the first identification information and the second identification information (S30); and when at least one of the first function information and the second function information is an executed function, calculating the coverage rate of the application program (S40). Further disclosed are a device, a server, and a storage medium. By means of multiple dictionary files, not only is the test precision calculation improved, but also the working efficiency is improved.

Description

Evaluation method, device, server and storage medium for application program testing

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 14, 2019, with the application number 201910514835.1, and the title of the invention "Appraisal method, device, server and storage medium for application testing", all of which are passed The reference is incorporated in the application.

Technical field

This application relates to the field of cloud technology, and in particular to an evaluation method, device, server and storage medium for application program testing.

Background technique

Code coverage is a measurement in software testing, which describes the proportion and extent of the source code executed in the program. Currently, in the field of software testing, technicians need to obtain the code coverage of the program, and determine whether the program is fully and effectively tested according to the code coverage.

The currently acquired code coverage rate is to record the code information that has been executed when the test equipment tests the code in the program, and calculate the code coverage rate of the program based on the code information that has been executed. When multiple people test the same application on the same test device or the same person on different test devices, code coverage with different results is obtained. The code coverage rate cannot be simply added up. When the reference code coverage rate is the maximum, there are some codes that have been executed in other test results but have not been executed in the test results, which leads to the code coverage rate of the test program is not accurate.

Summary of the invention

The main purpose of this application is to provide an evaluation method for application testing, which aims to solve the problem that the existing technology is limited to a user testing one APP on a test device, which leads to inaccurate code coverage of the test program. problem.

In order to achieve the foregoing objective, the first aspect of the present application provides an evaluation method for application testing, which includes: receiving first test data sent by a first terminal for testing a preset application and testing sent by a second terminal. When the second test data of the application program is preset, the first dictionary file and the first function information in the first test data, and the second dictionary file and the second function information in the second test data are respectively obtained; Respectively read the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file; according to the first identification information and the second Identification information, respectively determining whether the first function information and the second function information are executed functions; when at least one of the first function information and the second function information is an executed function, it is calculated The coverage of the application.

A second aspect of the present application provides an evaluation device for application testing, including: an acquiring unit configured to receive first test data sent by a first terminal for testing a preset application and a test sent by a second terminal When the second test data of the application program is preset, the first dictionary file and the first function information in the first test data, and the second dictionary file and the second function information in the second test data are respectively obtained; The reading unit is used to read the first identification information of the first function information in the first dictionary file, and the second identification information of the second function information in the second dictionary file; the determination unit uses For determining whether the first function information and the second function information are executed functions respectively according to the first identification information and the second identification information; the calculation unit is used for when the first function information and the When at least one of the second function information is an executed function, the coverage rate of the application program is calculated.

A third aspect of the present application provides an evaluation server for application program testing, including: a memory and at least one processor, the memory stores instructions, and the memory and the at least one processor are interconnected by wires; A processor invokes the instructions in the memory, so that the evaluation server of the application program test executes the method described in the first aspect.

The fourth aspect of the present application provides a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions run on a computer, the computer executes the above-mentioned first aspect method.

The evaluation method, device, server, and storage medium of application program testing proposed in the embodiments of the present application are tested by receiving the first test data sent by the first terminal to test the preset application program and the test sent by the second terminal. When the second test data of the application program is preset, the first dictionary file and the first function information in the first test data, and the second dictionary file and the second function information in the second test data are respectively obtained; Respectively read the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file; according to the first identification information and the second Identification information, respectively determining whether the first function information and the second function information are executed functions; when at least one of the first function information and the second function information is an executed function, it is calculated The coverage rate of the application program realizes that obtaining the execution status of the function in the test data through multiple dictionary files not only improves the test accuracy calculation, but also improves the work efficiency, and the execution result of the function in the test data is stored in the background. Follow.

Description of the drawings

FIG. 1 is a schematic diagram of the server structure of the hardware operating environment involved in the embodiment of the application;

FIG. 2 is a schematic flowchart of a first embodiment of the evaluation method for application program testing in this application;

3 is a schematic flowchart of a second embodiment of the evaluation method for application program testing in this application;

4 is a schematic flowchart of a third embodiment of the evaluation method for application program testing in this application;

FIG. 5 is a schematic flowchart of a fourth embodiment of the evaluation method for application program testing in this application;

6 is a schematic flowchart of a fifth embodiment of the evaluation method for application program testing in this application;

FIG. 7 is a schematic flowchart of a sixth embodiment of the evaluation method for application testing in this application;

Fig. 8 is a detailed flowchart of step S41 in Fig. 7.

Detailed ways

The embodiments of this application provide a proposed evaluation method, device, server and storage medium for application testing. Obtaining the execution status of functions in the test data through multiple dictionary files not only improves the test accuracy calculation, but also improves work efficiency, and The execution result of the function in the test data is saved in the background, and there is a trace to follow.

In order to enable those skilled in the art to better understand the solutions of the present application, the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, without having to use To describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances so that the embodiments described herein can be implemented in an order other than the content illustrated or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device including a series of steps or units is not necessarily limited to those clearly listed Steps or units, but may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or equipment. To facilitate understanding, the following describes the specific process of the embodiment of the present application, as shown in FIG. 1, which is a schematic diagram of the server structure of the hardware operating environment involved in the solution of the embodiment of the present application.

The terminal in the embodiment of this application is a server.

As shown in FIG. 1, the terminal may include a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as a magnetic disk memory. Optionally, the memory 1005 may also be a storage device independent of the foregoing processor 1001.

Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine some components, or arrange different components.

As shown in FIG. 1, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an evaluation program for application program testing.

In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to the back-end server and communicate with the back-end server; the user interface 1003 is mainly used to connect to the client (user side) and communicate with the client; and the processor 1001 can be used to call the evaluation program of the application test stored in the memory 1005, and perform the following operations:

When the first test data of the test preset application sent by the first terminal and the second test data of the test preset application sent by the second terminal are received, the first dictionary file and the first dictionary file in the first test data are respectively obtained A function information, and the second dictionary file and the second function information in the second test data;

Respectively read the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

According to the first identification information and the second identification information, respectively determine whether the first function information and the second function information are executed functions;

When at least one of the first function information and the second function information is an executed function, the coverage rate of the application program is calculated.

Further, the processor 1001 may call the evaluation program of the application test stored in the memory 1005, and also perform the following operations:

When the first test data of the test preset application sent by the first terminal and the second test data of the test preset application sent by the second terminal are received, the first binary file in the first test data is obtained respectively , The first function name and the first function class name, and the second binary file, the second function name and the second function class name in the second test data, where the first function name and the first function class At least one name, second function name, and second function class name;

The first binary file is converted into the first dictionary file according to the first function name and the first function class name, and the second binary file is converted into the first dictionary file according to the second function name and the second function class name. Two dictionary files.

Determine whether the format information of the first dictionary file and the second dictionary file is a preset JSON format;

When it is determined that the format information of the first dictionary file and/or the second dictionary file is not the preset JSON format, the preset conversion program is obtained, and the first key value and the first value value in the data element of the first dictionary file are read. / Or the second key value and the second value value in the data element of the second dictionary file;

Combine the first key value and the first value value into string characters to generate the first dictionary file in JSON format and/or combine the second key value and the second value value into string characters to generate the second dictionary in JSON format file.

Search separately for the first type of information in the first dictionary file of the first function class name in the JSON format, and the second type of information in the second dictionary file of the second function class name in the JSON format;

The first identification information of the first function name in the first type of information is read according to the first function name, and the second identification information of the second function name in the second type of information is read according to the second function name.

When the first identification information and the second identification information are not the same, it is determined that the function corresponding to the first function name and the second function name is an executed function;

When the first identification information and the second identification information are the same and are an executed function identification, it is determined that the function corresponding to the first function name and the second function name is an executed function.

Further, the processor 1001 may call an evaluation program for application program testing stored in the memory 1005, and also perform the following operations:

Record the number of executed functions in the first test data or the second test data respectively;

According to the number of executed functions in the first test data and the second test data, and the number of all functions in the first test data or the second test data, the coverage rate of the application program is calculated.

Further, the processor 1001 may call the evaluation calculation program of the application test stored in the memory 1005, and also perform the following operations:

When the first function name or the second function name determined to be an executed function is acquired, the first function name or the second function name is set up, where the names of the first function name and the second function name The same information;

By filtering the same first function name or the second function name, one is retained, the number of executed functions in the set is recorded, and the number of executed functions in the recorded set is used as the first test data or the second test The number of executed functions of the data.

2, this application is a first embodiment of an evaluation method for application testing, and the evaluation method for application testing includes:

Step S10, when the first test data of the test preset application sent by the first terminal and the second test data of the test preset application sent by the second terminal are received, the first dictionary in the first test data is obtained respectively File and first function information, and second dictionary file and second function information in the second test data;

The server receives the first test data and the second test data of the application program sent by the terminal, the first test data and the second test data are the test data of the application program, and obtains the first dictionary file and the first function information in the first test data , And the second dictionary file and second function information in the second test data, and the function class names, function names, and number of functions in the first test data and the second test data are the same. The first test data and the second test data are data files of the executed functions and the unexecuted functions in the application obtained by detecting the coverage of the same application by different terminals. The application is APP, which can be different functions such as communication APP. Different terminals mark the executed function and the unexecuted function separately in the process of detecting application coverage, and mark the executed function name and the unexecuted function name in the test data according to the class The difference generates a dictionary file. When the server receives the first test data sent by the first terminal and the second test data sent by the second terminal, the server obtains the first dictionary file in the first test data and the second dictionary file in the second test data respectively, and the server receives The test data sent by the terminal is not only two copies, but also multiple copies of test data.

Step S20, respectively reading the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

When the server obtains the first dictionary file and function information in the first test data, it obtains the identification information of the function in the first dictionary file according to the function information. For example, when the name of the function information is obtained, according to the function The name is searched in the first dictionary file, the identification information corresponding to the searched function name is red identification, or the identification information corresponding to the searched function name is green identification. When the second dictionary file and the function information in the second test data are obtained, the identification information of the function in the second dictionary file is obtained according to the function information, for example, when the name of the function information is obtained, according to the function name Searching in the second dictionary file, the identification information corresponding to the searched function name is red identification, or the identification information corresponding to the searched function name is green identification. When the server obtains all the function information in the first test data or the second test data, it obtains the corresponding identification information of the search function information in the first dictionary file and the second dictionary file, respectively.

Step S30, according to the first identification information and the second identification information, respectively determine whether the first function information and the second function information are executed functions;

When the server obtains the identification information of all functions in the first test data or the second test data in the first dictionary file and the second dictionary file, it is determined whether the identification information of the function information is an executed function. When the red flag is not executed function flag, the green flag is executed function flag. Or, when the red flag is the executed function flag, the green flag is the unexecuted function flag. Judge the function according to the color of the mark, and determine whether the function is an executed function.

Step S40: When at least one of the first function information and the second function information is an executed function, the coverage rate of the application program is calculated.

When the server obtains the determined executed function, it counts the number of executed functions and the number of functions of all functions in the first test data or the second test data. Divide the executed functions by the total of all functions to calculate the function coverage of the application.

In this embodiment, the server receives the first test data and the second test data of the application program sent by different terminals, and obtains the dictionary file and function information in the first test data and the second test data respectively. After obtaining the function information, When identifying information in the first dictionary file and the second dictionary file, determine whether the function is an executed function. When the number of executed functions is counted, the total number of functions in the first test data or the second test data is obtained , Calculate the function coverage of the application. Summarize the test data of multiple persons or computers in parallel to the server. The server obtains the execution of the function in the test data through multiple dictionary files, which not only improves the test accuracy calculation, but also improves the work efficiency. The execution result of the function in the test data is saved in There are traces to follow in the background.

Further, referring to FIG. 3, FIG. 3 is a second embodiment provided by the application test evaluation method of this application. Based on the embodiment shown in FIG. 2, step S10 includes:

Step S11, when the first test data of the test preset application sent by the first terminal and the second test data of the test preset application sent by the second terminal are received, the first and the second test data of the first test data are respectively acquired. Binary file, the first function name and the first function class name, and the second binary file, the second function name and the second function class name in the second test data;

In step S12, the first binary file is converted into a first dictionary file according to the class by the first function name and the first function class name, and the second binary file is converted according to the class by the second function name and the second function class name. Convert to the second dictionary file.

The first test data and the second test data received by the server are both test data of the application, and the first function name, the first function class name and the number of functions in the first test data are the same as the second function name in the second test data The name of the second function class and the number of functions are the same. The first test data and the second test data are data files of functions that have been executed and functions that have not been executed in the application program obtained by the terminal from detecting the coverage rate of the application program. In the process of detecting application coverage, the server marks the executed function and the unexecuted function separately, and marks the executed function name and the unexecuted function name in the test data according to the class distinction Generate a binary file. When the server obtains the binary file in the test data, it automatically converts the binary file into a dictionary file according to the function name and the label information of the function. And obtain the function name in the first test data or the second test data and the name of the function class where the function name is located.

In this embodiment, the server receives the first test data and the second test data of the application program sent by the terminal, and obtains the binary file, the function name and the function class name in the first test data and the second test data, respectively. When the binary file is obtained, the binary file is automatically converted into a dictionary file according to the class by the name of the function and the name of the function class. The binary file in the test data is converted into a dictionary file through the function name and function class name to improve the efficiency of the server receiving test data.

Referring to Fig. 4, Fig. 4 is a third embodiment provided by the application test evaluation method of this application. Based on the embodiment shown in Fig. 2, after step S12, it includes:

Step S50: Determine whether the format information of the first dictionary file and the second dictionary file are in a preset JSON format;

Step S60: When it is determined that the format information of the first dictionary file and/or the second dictionary file is not the preset JSON format, obtain the preset conversion program, and read the first key value and the first key value in the data element of the first dictionary file. value value and/or the second key value and the second value value in the data element of the second dictionary file;

Step S70, splicing the first key value and the first value value into a string character to generate a first dictionary file in JSON format and/or splicing the second key value and the second value value into a string character to generate a JSON format The second dictionary file.

When the server obtains the first dictionary file of the first test data and the second dictionary file of the second test data, it obtains the format information of the first dictionary file and the second dictionary file, and determines the format information or the first dictionary file of the first dictionary file. Second, whether the format information of the dictionary file is a preset JSON format. When the format information of the first dictionary file or the format information of the second dictionary file is not the preset JSON format, the server obtains the data elements in the first dictionary file and the data elements in the second dictionary file, and starts the pre-stored conversion program. The format conversion program can use I/O to program in the dictionary file formatted as a text file for the startup programming language, and convert the text format of the acquired dictionary file into JSON format by using the FileWriter class. Specifically, read the key value and value in the data element in the dictionary file of the first test data and the data element in the dictionary file of the second test data respectively, where the key is a legal variable name, and the value is the result value. The server splices the read key value and value value into a string character through a pre-stored conversion program to generate a JSON (JavaScript Object Notation) object and a dictionary file in the array format. The dictionary form of the label information of the function in the test data in the file text is as follows:

After being converted to JSON through a conversion program, this is the case:

{"Class A":{"Function 1":"YES","Function 2":"NO","Function 3":"NO","Function 4":"YES"},"Class B":{ "Function 1": "NO", "Function 2": "NO", "Function 3": "YES"}} When the server converts the dictionary file in the text file format into JSON format, the server uses the function in the test data The information obtains the identification information of the corresponding function in the dictionary file. The identification information "YES" indicates that the function has been executed, and "NO" indicates that the function has not been executed.

In this embodiment, when the server obtains that the format information of the first dictionary file or the second dictionary file is not the preset JSON format, it obtains the data elements in the first dictionary file or the data elements in the second dictionary file, and starts pre-storing The conversion program reads the data elements in the dictionary file of the first test data and the key and value values in the data elements in the dictionary file of the second test data respectively, and the server passes the read key and value values The pre-stored conversion program is spliced into string characters to generate the first dictionary file and/or the second dictionary file in JSON format. Convert the format of the dictionary file to the JSON format, so that the server can quickly obtain the function identifier in the dictionary file.

Referring to FIG. 5, FIG. 5 is a fourth embodiment provided by the application program test evaluation method of this application. Based on the embodiment shown in FIG. 2, step S20 includes:

Step S21, searching respectively for the first type of information in the first dictionary file of the first function class name in the JSON format, and the second type of information in the second dictionary file of the second function class name in the JSON format;

Step S21: Read the first identification information of the first function name in the first type of information according to the first function name, and read the second function name in the second type of information according to the second function name. The second identification information.

When the server obtains the first dictionary file and function name and function class name in the first test data, it obtains the class of the function in the first dictionary file according to the function class name, and then obtains the function according to the function name The corresponding identifier in the class. For example, when the function class name is class A, the first dictionary file is searched according to the class A name of the function. When class A is searched, the search is performed according to the function name function 1, and the function is found. The identification information corresponding to the name is "YES", or the identification information corresponding to the searched function name is "NO". When the server obtains the second dictionary file and function name and function class name in the second test data, it obtains the class of the function in the second dictionary file according to the function class name, and then obtains the function according to the function name The corresponding identifier in the class. For example, when the function class name is class A, the second dictionary file is searched according to the class A name of the function. When class A is searched, the search is performed according to the function name function 1, and the function is found. The identification information corresponding to the name is the "YES" mark, or the identification information corresponding to the searched function name is the "NO" mark. After the server obtains all the function names and class formations in the first test data or the second test data, it searches for the corresponding identification information of the function in the first dictionary file and the second dictionary file, respectively.

In this embodiment, when the server obtains the name of the function and the new name of the class in the first test data or the second test data, it obtains the corresponding identification information in the first dictionary file and the second dictionary file, and the server passes Multiple dictionary files to obtain the execution status of functions in the test data to improve test accuracy.

Referring to FIG. 6, FIG. 6 is a fifth embodiment provided by the application program test evaluation method of this application. Based on the embodiment shown in FIG. 2, step S30 includes:

Step S31: When the first identification information and the second identification information are not the same, determine that the function corresponding to the first function name and the second function name is an executed function;

Step S32: When the first identification information and the second identification information are the same and are the executed function identification, it is determined that the function corresponding to the first function name and the second function name is the executed function.

When the server obtains the same function in the test data according to the identification information of the name in the first dictionary file and the second dictionary file in JSON format, determine the identification information of the function in the first dictionary file and second dictionary file in JSON format Whether it is the same. When the identification information is not the same, the function is determined to be an executed function. For example, when the function is identified as "YES" in the first dictionary file in JSON format, it is in the second dictionary file in JSON format. "NO" logo. Or, when the function is identified as "NO" in the first dictionary file in JSON format and "YES" in the second dictionary file in JSON format, the server determines that the function is an executed function. When the identification information is the same and the identification information is an executed function identification, it is determined that the function is an executed function. For example, when the function is identified as "YES" in the first dictionary file and the second dictionary file in JSON format, the server also determines that the function is an executed function.

In this embodiment, the server obtains the identification information of the same function in the first dictionary file in JSON format and the second dictionary in JSON format. When the identification information is not the same, it is determined that the function is an executed function. When the same and the identification information is an executed function identification, it is determined that the function is an executed function, and the server obtains the execution status of the function in the test data through multiple dictionary files to improve the test accuracy.

Referring to FIG. 7, FIG. 7 is a sixth embodiment of the application program test evaluation method of this application. Based on the embodiment shown in FIG. 2, step S40 includes:

Step S41: Record the number of executed functions in the first test data or the second test data respectively;

Step S42: Calculate the application program according to the number of executed functions in the first test data or the second test data, and the number of all functions in the first test data or the second test data For example, when the number of executed functions in the first test data or the second test data is 86, and the total number of functions in the first test data or the second test data is 100, the application The coverage rate of the program is 86%, where the number of executed functions in the first test data or the second test data is 86 as determined executed functions.

When the server obtains the name of the determined function, it records the name of the function determined as executed in the first test data or the second test data, and counts the number of the executed function. When the server obtains the number of executed functions in the first test data or the second test data and the total number of functions in the first test data or the second test data, the number of executed functions is set to the total number of functions to obtain the total number of functions for the application. Function coverage. Multi-person or multi-machine parallel test data is aggregated to the server for calculation, which improves work efficiency, and the execution result of the function in the test data is stored in the background for traceability.

Referring to FIG. 8, FIG. 8 is a detailed flowchart of step S41 in FIG. 7, and step S41 includes:

Step S411: When the first function name or the second function name determined to be an executed function is acquired, the first function name or the second function name is set up, wherein the first function name or the second function name The function name is the same as the name information of the second function name;

Step S412: Retain one by filtering out the same name of the first function or the name of the second function, recording the number of executed functions in the set, and taking the number of executed functions in the recorded set as the first The number of executed functions of one test data or the second test data.

When the server obtains the first function name or the second function name that is determined to be an executed function, the first function name or the second function name is set up, wherein the first function name Same as the name information of the second function name, one is reserved by filtering out the same first function name or the second function name, the number of executed functions in the set is recorded, and the recorded The number of executed functions is used as the number of executed functions of the first test data or the second test data. For example, when the first function name in the set is function 1, and the second function name is also function 1, remove Any function name is function 1, where the first function name and the second function name belong to the same function class name. When multiple class names appear, the same function name in the same class name in the set is filtered out.

In this embodiment, when the server obtains the first function name and the second function name that is determined to be an executed function, it sets up the first function name and the second function name, wherein the first function name The name information of a function name is the same as the name information of the second function name, one is reserved by filtering the second function name of the same first function name, and the number of executed functions in the set is recorded. Through the collection, the number of executed functions can be quickly obtained.

In addition, an embodiment of the present application also proposes a server. The server includes a memory, a processor, and an evaluation program for application testing stored on the memory and running on the processor. The application testing When the evaluation program is executed by the processor, the steps of the evaluation method for application test described in the above embodiment are implemented.

In addition, the present application also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on the computer, the computer executes the following steps:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. A dictionary file and first function information, and a second dictionary file and second function information in the second test data;

Respectively reading the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

Claims

An evaluation method for application program testing. The evaluation method for test data testing includes:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. A dictionary file and first function information, and a second dictionary file and second function information in the second test data;

Respectively reading the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

According to the first identification information and the second identification information, respectively determine whether the first function information and the second function information are executed functions;

When at least one of the first function information and the second function information is an executed function, the coverage rate of the application program is calculated.
The evaluation method of application testing according to claim 1, wherein the first test data sent by the first terminal for testing the preset application and the second test data sent by the second terminal for testing the preset application are received. When testing data, acquiring the first dictionary file and first function information in the first test data, and the second dictionary file and second function information in the second test data, respectively, includes:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. Binary file, the first function name and the first function class name, and the second binary file, the second function name and the second function class name in the second test data, wherein the first function The name, the name of the first function class, the name of the second function, and the name of the second function class are at least one;

The first binary file is converted into a first dictionary file according to the class according to the first function name and the first function class name, and the second function name and the second function class name The second binary file is converted into a second dictionary file according to the class.
The evaluation method for application testing according to claim 2, wherein the first binary file is converted into a first dictionary file according to the class by the first function name and the first function class name, and After the second function name and the second function class name convert the second binary file into a second dictionary file according to the class, it includes:

Judging whether the format information of the first dictionary file and the second dictionary file is a preset JSON format;

When it is determined that the format information of the first dictionary file and/or the second dictionary file is not the preset JSON format, obtain the preset conversion program, and read the first key value in the data element of the first dictionary file And the first value and/or the second key value and the second value in the data element of the second dictionary file;

Concatenate the first key value and the first value value into a string character, generate a first dictionary file in JSON format and/or concatenate the second key value and the second value value into a string character , Generate the second dictionary file in JSON format.
The evaluation method for application testing according to claim 2, wherein the first identification information of the first function information in the first dictionary file and the second function information in the second dictionary file are respectively read The second identification information includes:

Search respectively for the first type of information of the name of the first function class in the first dictionary file in the JSON format and the second type of information of the name of the second function class in the second dictionary file in the JSON format ；

According to the first function name, read the first identification information of the first function name in the first type of information, and according to the second function name, read the second function name in the The second identification information in the second type of information.
5. The evaluation method of application test according to claim 4, said determining whether the first function information and the second function information are executed functions according to the first identification information and the second identification information, respectively, include:

When the first identification information and the second identification information are not the same, determining that the function corresponding to the first function name and the second function name is an executed function;

When the first identification information and the second identification information are the same and are an executed function identification, it is determined that the function corresponding to the first function name and the second function name is an executed function.
7. The evaluation method for application testing according to any one of claims 1 to 5, wherein when at least one of the first function information and the second function information is an executed function, the Application coverage, including:

Respectively recording the number of executed functions in the first test data or the second test data;

According to the number of executed functions in the first test data or the second test data, and the number of all functions in the first test data or the second test data, the coverage rate of the application program is calculated .
7. The evaluation method of application testing according to claim 6, wherein said recording respectively the number of executed functions in said first test data and said second test data according to said, comprising:

When the first function name or the second function name that is determined to be an executed function is acquired, the first function name or the second function name is set up, wherein the first function name and The name information of the second function name is the same;

By filtering out the same name of the first function or the name of the second function and retaining one, the number of executed functions in the set is recorded, and the recorded number of executed functions in the set is taken as the first The number of executed functions of the test data or the second test data.
An evaluation device for application program testing, the evaluation device for test data testing includes:

The obtaining unit is configured to obtain the first test data when the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received respectively The first dictionary file and the first function information in the data, and the second dictionary file and the second function information in the second test data.

A reading unit, configured to read the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file respectively;

A determining unit, configured to determine whether the first function information and the second function information are executed functions according to the first identification information and the second identification information;

The calculation unit is configured to calculate the coverage rate of the application program when at least one of the first function information and the second function information is an executed function.
According to the appraisal device for application test according to claim 8, the acquiring unit is specifically configured to:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. Binary file, the first function name and the first function class name, and the second binary file, the second function name and the second function class name in the second test data, wherein the first function The name, the name of the first function class, the name of the second function, and the name of the second function class are at least one;

The first binary file is converted into a first dictionary file according to the class according to the first function name and the first function class name, and the second function name and the second function class name The second binary file is converted into a second dictionary file according to the class.
The evaluation device for application testing according to claim 8, wherein the device for incrementally constructing a CUBE model specifically further comprises:

A determining format unit, configured to determine whether the format information of the first dictionary file and the second dictionary file is a preset JSON format;

The conversion unit is configured to obtain a preset conversion program when it is determined that the format information of the first dictionary file and/or the second dictionary file is not a preset JSON format, and read the data elements of the first dictionary file The first key value and the first value value of and/or the second key value and the second value value in the data element of the second dictionary file;

A generating unit, configured to splice the first key value and the first value value into a string character, generate a first dictionary file in JSON format and/or combine the second key value and the second value value Concatenate into string characters to generate a second dictionary file in JSON format.
According to the appraisal device for application test according to claim 9, the reading unit is specifically configured to:

Search respectively for the first type of information of the name of the first function class in the first dictionary file in the JSON format and the second type of information of the name of the second function class in the second dictionary file in the JSON format ；

According to the first function name, read the first identification information of the first function name in the first type of information, and according to the second function name, read the second function name in the The second identification information in the second type of information.
According to the appraisal device for application testing according to claim 11, the determining unit is specifically configured to:

When the first identification information and the second identification information are not the same, determining that the function corresponding to the first function name and the second function name is an executed function;

When the first identification information and the second identification information are the same and are an executed function identification, it is determined that the function corresponding to the first function name and the second function name is an executed function.
According to the evaluation device for application testing according to any one of claims 8-12, the calculation unit is specifically configured to:

A recording subunit for recording the number of executed functions in the first test data or the second test data;

The calculation subunit is used to calculate the total number of functions in the first test data or the second test data and the number of all functions in the first test data or the second test data. The coverage of the application.
The evaluation device for application testing according to claim 13, wherein the recording subunit is specifically configured to:

When the first function name or the second function name that is determined to be an executed function is acquired, the first function name or the second function name is set up, wherein the first function name and The name information of the second function name is the same;

By filtering out the same name of the first function or the name of the second function and retaining one, the number of executed functions in the set is recorded, and the recorded number of executed functions in the set is taken as the first The number of executed functions of one test data or the second test data.
An evaluation server for application program testing includes a memory, a processor, and computer readable instructions stored on the memory and capable of running on the processor, and the processor executes the computer readable instructions as follows step:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. A dictionary file and first function information, and a second dictionary file and second function information in the second test data;

Respectively reading the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

According to the first identification information and the second identification information, respectively determine whether the first function information and the second function information are executed functions;

When at least one of the first function information and the second function information is an executed function, the coverage rate of the application program is calculated.
The evaluation server for application testing according to claim 15, wherein the processor executes the computer-readable instructions to implement the first test data and the second terminal of the test preset application sent by the first terminal When the sent second test data of the preset application is tested, the first dictionary file and the first function information in the first test data, and the second dictionary file and the second dictionary file in the second test data are obtained respectively. The second function information includes the following steps:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. Binary file, the first function name and the first function class name, and the second binary file, the second function name and the second function class name in the second test data, wherein the first function The name, the name of the first function class, the name of the second function, and the name of the second function class are at least one;

The first binary file is converted into a first dictionary file according to the class according to the first function name and the first function class name, and the second function name and the second function class name The second binary file is converted into a second dictionary file according to the class.
The evaluation server for application testing according to claim 16, wherein the processor executes the computer-readable instructions to implement the first binary entry through the first function name and the first function class name After the control file is converted into the first dictionary file according to the class, and the second binary file is converted into the second dictionary file according to the class according to the second function name and the second function class name, the following steps are further included:

Judging whether the format information of the first dictionary file and the second dictionary file is a preset JSON format;

When it is determined that the format information of the first dictionary file and/or the second dictionary file is not the preset JSON format, obtain the preset conversion program, and read the first key value in the data element of the first dictionary file And the first value and/or the second key value and the second value in the data element of the second dictionary file;

Concatenate the first key value and the first value value into a string character, generate a first dictionary file in JSON format and/or concatenate the second key value and the second value value into a string character , Generate the second dictionary file in JSON format.
The evaluation server for application testing according to claim 16, wherein the processor executes the computer-readable instructions to implement the reading of the first identification information and the first identification information in the first dictionary file of the first function information respectively. The second identification information of the second function information in the second dictionary file includes the following steps:

Search respectively for the first type of information of the name of the first function class in the first dictionary file in the JSON format and the second type of information of the name of the second function class in the second dictionary file in the JSON format ；

According to the first function name, read the first identification information of the first function name in the first type of information, and according to the second function name, read the second function name in the The second identification information in the second type of information.
The evaluation server for application testing according to claim 18, wherein said processor executes said computer-readable instructions to realize said determining said first function information and said first function information and said second identification information respectively according to said first identification information and second identification information. Whether the second function information is an executed function includes the following steps:

When the first identification information and the second identification information are not the same, determining that the function corresponding to the first function name and the second function name is an executed function;

When the first identification information and the second identification information are the same and are an executed function identification, it is determined that the function corresponding to the first function name and the second function name is an executed function.
A computer-readable storage medium that stores computer instructions, and when the computer instructions are executed on a computer, the computer executes the following steps:

When the first test data for testing the preset application program sent by the first terminal and the second test data for testing the preset application program sent by the second terminal are received, the first test data in the first test data is obtained respectively. A dictionary file and first function information, and a second dictionary file and second function information in the second test data;

Respectively reading the first identification information of the first function information in the first dictionary file and the second identification information of the second function information in the second dictionary file;

According to the first identification information and the second identification information, respectively determine whether the first function information and the second function information are executed functions;

When at least one of the first function information and the second function information is an executed function, the coverage rate of the application program is calculated.