WO2019169760A1

WO2019169760A1 - Test case range determining method, device, and storage medium

Info

Publication number: WO2019169760A1
Application number: PCT/CN2018/089318
Authority: WO
Inventors: 陈晓芳
Original assignee: 平安科技（深圳）有限公司
Priority date: 2018-03-06
Filing date: 2018-05-31
Publication date: 2019-09-12
Also published as: CN108491321A; CN108491321B

Abstract

The present application provides a test case range determining method. The method comprises: recording first code coverage data when a user executes an operation behavior in an operating environment of a system, and preliminarily determining a test case set; recording second code coverage data when the test case set is executed in a test environment of the system; calculating a difference between the first code coverage data and the second code coverage data; if the difference does not meet a preset condition, localizing a difference code between the first code coverage data and the second code coverage data, adjusting the test case set, executing the adjusted test case set, and acquiring updated second code coverage data; and if the difference meets the preset condition, determining the test case set as a final test case set. The present application further provides an electronic device and a storage medium. The present application quickly and accurately determines a test case range, thereby enabling the test case range to be close to the actual operations of a user and improving test efficiency.

Description

Test case range determining method, device and storage medium

This application is based on the priority of the Chinese Patent Application entitled "Test Method Range Determination Method, Apparatus and Storage Medium", which is filed on March 6, 2018, with the application number of CN201810183368.4, which is filed on March 6, 2018. The content is incorporated herein by reference.

Technical field

The present application relates to the field of computer technology, and in particular, to a test case range determining method, an electronic device, and a computer readable storage medium.

Background technique

Testing is the process of operating a program under specified conditions to detect procedural errors, measure software quality, and evaluate whether it meets design requirements. A Test Case is a set of test inputs, execution conditions, and expected results that are programmed for a particular purpose to test a program path or verify that a particular requirement is met.

Now, each system or software version has a shorter iteration period. To complete the test in a shorter time, this requires a clear test range. At present, most of the test scope is obtained by estimation or by topology, but the scope of the acquisition is limited, so that the scope of the test is not comprehensive enough. Therefore, there is a need to provide a method for quickly and accurately determining the range of test cases.

Summary of the invention

The present application provides a test case range determining method, an electronic device, and a computer readable storage medium. The main purpose of the present invention is to quickly and accurately determine the range of test cases, so that the test case range is close to the actual operation of the user, and the test efficiency is improved.

To achieve the above objective, the present application provides a method for determining a test case range, the method comprising:

S1. Recording a first code coverage data when the user performs an operation behavior in a system operating environment, analyzing the first code coverage data to derive a user operation behavior, and initially determining a test case set;

S2. Receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

S3, analyzing the first code coverage data and the second code coverage data, obtaining a difference between the first code coverage data and the second code coverage data, and determining whether the difference satisfies Set conditions;

S4. When the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate a difference code between the first code coverage data and the second code coverage data. Adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to S3;

S5. When the difference between the first code coverage data and the second code coverage data meets a preset condition, determine that the test case set is a final test case set.

In addition, in order to achieve the above object, the present application further provides an electronic device, the device comprising a memory, a processor, and a memory of a test case range determining program executable on the processor, the program being Any step of the test case range determination method as described above is implemented when the processor executes.

In addition, in order to achieve the above object, the present application further provides a computer readable storage medium having stored thereon a test case range determining program, which is executed by a processor to implement the test case range as described above. Determine any step of the method.

Compared with the prior art, the test case range determining method, the electronic device and the computer readable storage medium proposed by the present application initially determine the scope of the test case according to the first code coverage data obtained by the user performing the operation behavior in the operating environment of the system. , reducing the effectiveness of the test case, improving the efficiency of the test case range determination; and executing the test case in the system test environment to obtain the second code coverage data, comparing the two sets of code coverage data to obtain the difference code, adjusting the test case according to the difference code, determining The final test case scope maximizes the test case range to the user's actual operating behavior and improves test efficiency.

DRAWINGS

1 is a schematic diagram of a preferred embodiment of a server of the present application;

2 is a schematic diagram of a program module of the test case range determining program of FIG. 1;

3 is a flow chart of a preferred embodiment of a method for determining a test case range of the present application.

The implementation, functional features and advantages of the present application will be further described with reference to the accompanying drawings.

Detailed ways

It is understood that the specific embodiments described herein are merely illustrative of the application and are not intended to be limiting.

The application provides a server 1. Referring to FIG. 1, a schematic diagram of a preferred embodiment of the server 1 of the present application is shown.

In this embodiment, the server 1 may be a rack server, a blade server, a tower server, or a rack server.

The server 1 includes a memory 11, a processor 12, a communication bus 13, a network interface 14, and a display 15.

The memory 11 includes at least one type of readable storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (for example, an SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. The memory 11 may be an internal storage unit of the server 1, such as the hard disk of the server 1, in some embodiments. The memory 11 may also be an external storage device of the server 1 in other embodiments, such as a plug-in hard disk equipped on the server 1, a smart memory card (SMC), and a secure digital (Secure Digital, SD) ) cards, flash cards, etc. Further, the memory 11 may also include both an internal storage unit of the server 1 and an external storage device. The memory 11 can be used not only for storing application software and various types of data installed in the server 1, such as the test case range determining program 10, but also for temporarily storing data that has been output or is to be output.

The processor 12, in some embodiments, may be a Central Processing Unit (CPU), controller, microcontroller, microprocessor or other data processing chip for running program code or processing stored in the memory 11. Data, such as test case range determining program 10, and the like.

Communication bus 13 is used to implement connection communication between these components.

The network interface 14 may include a standard wired interface, a wireless interface (such as a WI-FI interface), and is typically used to establish a communication connection between the server 1 and other electronic devices. For example, the server 1 may extract code coverage data from the server side (not shown) of the code coverage tool through the network interface 14, and the server side deployment server 1 of the code coverage tool is configured to receive the code coverage tool. The code sent by the client (not shown) covers the data, and the client of the code coverage tool is deployed on the system to be tested.

The display 15 (Display) may be an LED display, a liquid crystal display, a touch liquid crystal display, and an Organic Light-Emitting Diode (OLED) touch device. Among them, the display 15 may also be referred to as a display screen or display unit for displaying information processed in the server 1 and a user interface for displaying visualization.

Figure 1 shows only server 1 with components 11-14, but it should be understood that not all illustrated components may be implemented, and more or fewer components may be implemented instead.

Optionally, the server 1 may further include a user interface, and the user interface may include an input unit such as a keyboard, and the optional user interface may further include a standard wired interface and a wireless interface.

In the embodiment shown in FIG. 1, a test case range determining program 10 is stored in the memory 11. When the processor 12 executes the test case range determining program 10 stored in the memory 11, the following steps are implemented:

A1. Recording a first code coverage data when the user performs an operation behavior in a system operating environment, analyzing the first code coverage data to derive a user operation behavior, and initially determining a test case set;

A2. Receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

A3, analyzing the first code coverage data and the second code coverage data, obtaining a difference between the first code coverage data and the second code coverage data, and determining whether the difference satisfies Set conditions;

A4. When the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate a difference code between the first code coverage data and the second code coverage data. Adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to A3;

A5. When the difference between the first code coverage data and the second code coverage data meets a preset condition, determine that the test case set is a final test case set.

In this embodiment, the solution of the present application is described by taking the system P as an example. On the client side of the system P deployment code coverage tool, deploy the code coverage tool on the server side of the server side, for example, the client and server side of the Jacobo code coverage tool. Specifically, the client of the Jacoco code coverage tool is used to record the user's behavior in the actual operating environment of the system, and the coverage of the system code when executing the test case in the system's test environment; Jacoco code coverage The server side of the tool is used to receive coverage of the system code recorded by the client of the Jacoco Code Coverage Tool.

When testing the system P after the version update, you need to ensure that the scope of the test case meets the test requirements. Start the client deployed in System P's Jacoco Code Coverage Tool to monitor the user's operating behavior in the actual operating environment of the system. The operation behavior includes: the user clicks on the system, executes a certain function module of the system, or performs some operation flow, and the client of the Jacoco code coverage tool records the system code corresponding to the function module or the operation flow executed by the user, and Generate the first code to overwrite the data. The client of the Jacoco Code Coverage Tool sends the generated first code coverage data to the server side of the Jacobo Code Coverage Tool, which extracts the first code coverage data from the server side of the Jacobo Code Coverage Tool and passes the server 1 The display is shown to the tester for the tester to analyze the first code coverage data to initially determine the scope of the test case for System P. It can be understood that the function code or the operation flow executed by the user will be overwritten in the corresponding code in the system P, and the code corresponding to the function module or the operation flow that has not been executed will not be overwritten. Specifically, the first code coverage data includes: a package, a class, a method, and a line information that are covered by the code of the system P when the user performs the foregoing operation behavior in the actual operating environment of the system P. In the first code coverage data collection process, the first coverage of the corresponding package, class, and method, and the first ratio of the number of lines of the covered code to the total number of lines of the code of the system P are calculated.

Further, after extracting the first code coverage data from the server side of the Jacoco code coverage tool, the server 1 analyzes the overwritten code in the first code coverage data. It can be understood that the function module or the operation flow of the system is implemented by the average code. Therefore, according to the code covered in the first code coverage data, it can be deduced which functional modules or operations are performed by the user in the actual operating environment of the system P. Process. According to the deduced operation flow, the scenarios of each operation flow are respectively determined, and corresponding test cases are further obtained, and a preliminary determined test case set is generated. For example, mining the code data in the first code coverage data, and finding that the code corresponding to the MD5 algorithm is overwritten, and the code corresponding to the sha-1 algorithm is not overwritten, then it can be determined that the MD5 algorithm is invoked in the operation flow executed by the user, and the test is performed. When designing a test case, the person needs to override the calling scenario of the MD5 algorithm. Determining the test case set is a technical means known to those skilled in the art and will not be described here.

Receiving the instruction to execute the test case set, opening the client of the Jacoco code coverage tool deployed in the test environment of the system P, and executing the test case in the test case set obtained by the above steps in the test environment of the system P, recording the execution test In the case of the use case, the code of the system P is covered, and the second code covers the data. Specifically, the second code coverage data includes: a package, a class, a method, and a row information that are covered in the code of the system P when the test case is executed in the test environment of the system P. Similarly, in the second code coverage data collection process, the second coverage of the corresponding package, class, method, and the second ratio of the number of lines of the covered code to the total number of lines of the code of the system P are calculated.

It should be noted that when the test case is executed, there may be cases where the returned test result is inconsistent with the expected result. In this scheme, the user's operation behavior is emphasized, and the focus is on the operation flow performed by the user, because the specific value of the input itself is different, and the test result does not affect the coverage of the system code, so Does not affect the second code coverage data.

The covered part of the two sets of code coverage data contains multiple packages, each of which includes a class, the method includes a method, and the method includes a code line. If the difference in the coverage of a package in the two sets of code coverage data does not meet the preset conditions, it indicates that there are differences in the classes included in the package, the methods and methods included in the class, and further explains the preliminary determination. The test behaviors that are not covered by the test case set and executed by the user in the actual operating environment of the system P need to further improve the test cases.

Specifically, the coverage of each packet included in the first code coverage data in the first code coverage data and the second code coverage data is separately read, and each packet is calculated in the first code coverage data and the second code coverage data. The difference degree of the coverage ratio is filtered out, and the difference code corresponding to the preset threshold is filtered out, and the difference code corresponding to the partial packet whose difference is smaller than the preset threshold is determined. Among them, the formula for calculating the difference is:

M=(A-B)/A

Where M is the difference between the coverage of the packet in the first code coverage data and the coverage in the second code coverage data, where A is the coverage of the packet in the first code coverage data, and B is the Coverage coverage in the second code coverage data.

For example, the coverage of a packet in the first code coverage data is 40%, and the coverage in the second code coverage data is 35%. The difference in coverage of the packet in the two sets of code coverage data is calculated according to the calculation formula. The degree is 5%. If the preset threshold is 3% and the difference is greater than the preset threshold, the difference code corresponding to the package needs to be further determined. Further comparing the coverage of the class included in the package, filtering one or more classes whose first coverage is inconsistent with the second coverage, and further covering the method included in the one or more classes The situation is analyzed, and one or more methods with inconsistent coverage in the two sets of code coverage data are compared and selected, and the final difference code is specific to the code line. For example, after the above analysis step, it is found that the 10th to 20th lines of codes covered in the first code coverage data are not covered in the second code coverage data, then the 10th to 20th lines of codes are The difference code between the data is overwritten for the two sets of code.

So far, the difference code between the first code coverage data and the second code coverage data has been located. The difference code is analyzed to determine an application scenario and an operation flow or a function module corresponding to the difference code. If the existing test case set includes the test case corresponding to the application scenario, the test case is adjusted, if the existing If the test case does not contain the test case corresponding to the application scenario, the test case corresponding to the application scenario is added, and the initially determined test case set is updated.

Continue to receive instructions to execute the test case, retrieve and execute the added or adjusted test case from the updated test case set, and the client of the Jacoco code coverage tool records the third code coverage data. As an implementation manner, the second code coverage data is updated by using the third code coverage data to obtain the updated second code coverage data, specifically, the uncovered difference code is extracted from the second code coverage data, and The coverage status of the difference code that coincides with the covered code in the third code coverage data is updated, that is, the status that is not covered is updated to the covered status.

Further, obtaining the coverage ratio of the packet in the updated second code coverage data, and calculating a difference degree of coverage of each packet in the first code coverage data and the second code coverage data, when the difference degree of each packet is smaller than Or equal to the preset threshold, indicating that the test case does not need to be adjusted. Otherwise, continue to perform the above steps of determining the difference code and adjusting the test case.

It can be understood that the smaller the difference between the packets of the second code coverage data and the first code coverage data, the closer the coverage of the test case is to the actual operation of the user, and the tester can adjust the difference preset according to the requirement. The size of the threshold. In other embodiments, when the preset threshold of the degree of difference is 0, that is, the code covering the third code coverage data is compared with the difference code, when the code covered in the third code coverage data is completely The difference code is included, and after the second code coverage data is updated, the difference between the calculated first code coverage data and the second code coverage data is 0, indicating that the newly added or adjusted test case range has been completely covered. The application scenario and operation flow that are not covered in the above steps. Through this step, the scope of the test case can completely include the behavior of the user in the actual operating environment of the system, and the accuracy of the test is improved.

The server 1 proposed by the foregoing embodiment initially determines the scope of the test case according to the first code coverage data obtained by the user performing the operation behavior in the operating environment of the system, reduces the validity of the test case, and improves the efficiency of determining the scope of the test case; The test case is executed in the system test environment to obtain the second code coverage data, and the difference code between the two sets of code coverage data is obtained, the test case is adjusted according to the difference code, and the final test case range is determined, so that the test case range is maximized close to the actual operation of the user. Behavior, improve test efficiency.

Alternatively, in other embodiments, the test case scope determining program 10 may also be divided into one or more modules, one or more modules being stored in the memory 11 and being processed by one or more processors (this Embodiments are executed by processor 12) to accomplish the present application, and a module referred to herein refers to a series of computer program instructions that are capable of performing a particular function. For example, as shown in FIG. 2, it is a schematic diagram of a program module of the test case range determining program 10 in FIG. 1. In this embodiment, the test case range determining program 10 can be divided into a first recording module 110 and a second recording module 120. The analysis module 130, the update module 140, and the determination module 150, the functions or operation steps implemented by the modules 110-150 are similar to the above, and are not described in detail herein, for example, where:

The first recording module 110 is configured to record first code coverage data when the user performs an operation behavior in a running environment of the system, analyze the first code coverage data to derive a user operation behavior, and initially determine a test case set;

a second recording module 120, configured to receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

The analyzing module 130 is configured to analyze the first code coverage data and the second code coverage data to obtain a difference between the first code coverage data and the second code coverage data, and determine the Whether the difference meets the preset conditions;

The updating module 140 is configured to: when the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate the first code coverage data and the second code coverage data a difference code between the two, adjusting the test case set according to the difference code, executing the adjusted test case set, and obtaining the updated second code coverage data;

The determining module 150 is configured to determine that the test case set is a final test case set when a difference between the first code coverage data and the second code coverage data satisfies a preset condition.

In addition, the present application also provides a talent management method. Referring to Figure 3, there is shown a flow chart of a preferred embodiment of the talent management method of the present application. The method can be performed by a device that can be implemented by software and/or hardware.

In this embodiment, the talent management method includes steps S1-S5:

It can be understood that the first code coverage data generated by the client of the Jacoco code coverage tool in a short time to record the user behavior may not fully represent all the functional modules or operation processes executed by the user in the system P, in order not to waste Under the premise of resources, the first code covers the data more comprehensively, and filters the first code coverage data in the time dimension, and sets a preset time interval, for example, two days after the time point of opening the client of the Jacoco code coverage tool. The first code coverage data for the time period is taken as the final first code coverage data and sent to the server side of the Jacobo Code Coverage Tool.

M=(A-B)/A

In other embodiments, for the uncovered system code in the first code coverage data, for example, the code corresponding to the sha-1 algorithm, the reason why the sha-1 algorithm is not called is analyzed, if the sha-1 algorithm corresponds to the segment The code has no operational scenarios, or the user does not perform such operations. The uncovered code corresponding to the sha-1 algorithm can be used as redundant code to remove it from the system code, thereby reducing the system code size.

The method for determining the scope of the test case proposed by the above embodiment, according to the first code coverage data obtained by the user in performing the operation behavior in the operating environment of the system, initially determines the scope of the test case, reduces the effectiveness of the test case, and improves the efficiency of determining the scope of the test case. And execute the test case in the system test environment to obtain the second code coverage data, compare the two sets of code coverage data to get the difference code, adjust the test case according to the difference code, determine the final test case range, and make the test case range be as close as possible to the user. The actual operational behavior improves test efficiency.

In addition, the embodiment of the present application further provides a computer readable storage medium. The computer readable storage medium stores a test case range determining program 10, and when the program is executed by the processor, the following operations are implemented:

The specific embodiment of the computer readable storage medium of the present application is substantially the same as the specific embodiment of the method for determining the scope of the test case described above, and is not described herein.

It should be noted that the foregoing serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments. And the terms "including", "comprising", or any other variations thereof are intended to encompass a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a plurality of elements includes not only those elements but also Other elements listed, or elements that are inherent to such a process, device, item, or method. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, the device, the item, or the method that comprises the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM as described above). , a disk, an optical disk, including a number of instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the various embodiments of the present application.

The above is only a preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of this application.

Claims

A test case range determining method is applied to an electronic device, the method comprising:

S1. Recording a first code coverage data when the user performs an operation behavior in a system operating environment, analyzing the first code coverage data to derive a user operation behavior, and initially determining a test case set;

S2. Receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

S3, analyzing the first code coverage data and the second code coverage data, obtaining a difference between the first code coverage data and the second code coverage data, and determining whether the difference satisfies Set conditions;

S4. When the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate a difference code between the first code coverage data and the second code coverage data. Adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to S3;

S5. When the difference between the first code coverage data and the second code coverage data meets a preset condition, determine that the test case set is a final test case set.
The test case range determining method according to claim 1, wherein the step S3 comprises:

Reading, respectively, a coverage ratio of each packet included in the first code coverage data in the first code coverage data and the second code coverage data;

Calculating, respectively, a difference in coverage of each packet in the first code coverage data and the second code coverage data; and

Determining whether the degree of difference of each packet is less than or equal to a preset threshold.
The method for determining a test case range according to claim 2, wherein said "when said difference between said first code coverage data and said second code coverage data does not satisfy a preset condition, said determining said The steps of the first code overlay data and the second code overlay data difference code include:

When the each package includes one or more packets whose degree of difference is greater than a preset threshold, the one or more packets are filtered out;

Comparing the coverage of the class included in the one or more packages in the first code coverage data and the second code coverage data, respectively, screening the first code coverage data and the second code Overlay one or more classes with different coverage in the data;

Comparing the coverage of the method included in the one or more classes in the first code coverage data and the second code coverage data, respectively, filtering out the first code coverage data and the second code One or more methods that cover different coverage in the data; and

Comparing the coverage of the code lines included in the one or more methods in the first code coverage data and the second code coverage data, respectively, screening out the first code coverage data and the second The code covers different lines of code in the coverage data, and determines a difference code between the first code coverage data and the second code coverage data.
The method for determining a test case range according to claim 3, wherein the first code coverage data comprises: a user executing the operation flow in a production environment, and a package, a class, a method, and a line covered in the system code. information.
The method for determining a test case range according to claim 4, wherein the second code coverage data comprises: executing the test case set in the test environment, the package, class, method, and line covered in the system code. information.
An electronic device, comprising: a memory, a processor, wherein the memory stores a test case range determining program runable on the processor, and the program is implemented by the processor as follows step:

A1. Recording a first code coverage data when the user performs an operation behavior in a system operating environment, analyzing the first code coverage data to derive a user operation behavior, and initially determining a test case set;

A2. Receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

A3, analyzing the first code coverage data and the second code coverage data, obtaining a difference between the first code coverage data and the second code coverage data, and determining whether the difference satisfies Set conditions;

A4. When the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate a difference code between the first code coverage data and the second code coverage data. Adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to A3;

A5. When the difference between the first code coverage data and the second code coverage data meets a preset condition, determine that the test case set is a final test case set.
The electronic device of claim 6, wherein the step A3 comprises:

Reading, respectively, a coverage ratio of each packet included in the first code coverage data in the first code coverage data and the second code coverage data;

Calculating, respectively, a difference in coverage of each packet in the first code coverage data and the second code coverage data; and

Determining whether the degree of difference of each packet is less than or equal to a preset threshold.
The electronic device according to claim 7, wherein said "determining said first code when a difference between said first code coverage data and said second code coverage data does not satisfy a preset condition The steps of overlaying the difference code between the data and the second code overlay data include:

When the each package includes one or more packets whose degree of difference is greater than a preset threshold, the one or more packets are filtered out;

Comparing the coverage of the class included in the one or more packages in the first code coverage data and the second code coverage data, respectively, screening the first code coverage data and the second code Overlay one or more classes with different coverage in the data;

Comparing the coverage of the method included in the one or more classes in the first code coverage data and the second code coverage data, respectively, filtering out the first code coverage data and the second code One or more methods that cover different coverage in the data; and

Comparing the coverage of the code lines included in the one or more methods in the first code coverage data and the second code coverage data, respectively, screening out the first code coverage data and the second The code covers different lines of code in the coverage data, and determines a difference code between the first code coverage data and the second code coverage data.
The electronic device according to claim 8, wherein the first code coverage data comprises: a user executing the operation flow in the production environment, the package, class, method and line information covered in the system code.
The electronic device according to claim 9, wherein the second code coverage data comprises: executing the test case set, the package, class, method, and line information covered in the system code in a test environment.
A computer readable storage medium, characterized in that the computer readable storage medium stores a test case range determining program, and when the program is executed by the processor, the following steps are implemented:

A1. Recording a first code coverage data when the user performs an operation behavior in a system operating environment, analyzing the first code coverage data to derive a user operation behavior, and initially determining a test case set;

A2. Receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

A3, analyzing the first code coverage data and the second code coverage data, obtaining a difference between the first code coverage data and the second code coverage data, and determining whether the difference satisfies Set conditions;

A4. When the difference between the first code coverage data and the second code coverage data does not satisfy a preset condition, locate a difference code between the first code coverage data and the second code coverage data. Adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to A3;

A5. When the difference between the first code coverage data and the second code coverage data meets a preset condition, determine that the test case set is a final test case set.
The computer readable storage medium of claim 11 wherein said step A3 comprises:

Reading, respectively, a coverage ratio of each packet included in the first code coverage data in the first code coverage data and the second code coverage data;

Calculating, respectively, a difference in coverage of each packet in the first code coverage data and the second code coverage data; and

Determining whether the degree of difference of each packet is less than or equal to a preset threshold.
The computer readable storage medium according to claim 12, wherein said "determining said difference when said difference between said first code coverage data and said second code coverage data does not satisfy a preset condition The steps of the first code overlay data and the second code overlay data difference code include:

When the each package includes one or more packets whose degree of difference is greater than a preset threshold, the one or more packets are filtered out;

Comparing the coverage of the class included in the one or more packages in the first code coverage data and the second code coverage data, respectively, screening the first code coverage data and the second code Overlay one or more classes with different coverage in the data;

Comparing the coverage of the method included in the one or more classes in the first code coverage data and the second code coverage data, respectively, filtering out the first code coverage data and the second code One or more methods that cover different coverage in the data; and

Comparing the coverage of the code lines included in the one or more methods in the first code coverage data and the second code coverage data, respectively, screening out the first code coverage data and the second The code covers different lines of code in the coverage data, and determines a difference code between the first code coverage data and the second code coverage data.
The computer readable storage medium of claim 13, wherein the first code coverage data comprises: a user executing the operation flow in a production environment, a package, a class, a method, and a line covered in the system code information.
The computer readable storage medium of claim 14, wherein the second code coverage data comprises: executing the test case set in a test environment, the covered packages, classes, methods, and lines in the system code information.
A test case scoping program, characterized in that the program comprises:

a first recording module, configured to record first code coverage data when the user performs an operation behavior in a running environment of the system, analyze the first code coverage data to derive a user operation behavior, and initially determine a test case set;

a second recording module, configured to receive an instruction to execute the test case set, and record second code coverage data when the test case set is executed in a test environment of the system;

An analysis module, configured to analyze the first code coverage data and the second code coverage data, obtain a difference between the first code coverage data and the second code coverage data, and determine the difference Whether the preset conditions are met;

And an updating module, configured to locate between the first code coverage data and the second code coverage data when a difference between the first code coverage data and the second code coverage data does not satisfy a preset condition a difference code, adjusting the test case set according to the difference code, executing the adjusted test case set, obtaining the updated second code coverage data, and the process returns to A3;

And a determining module, configured to determine, when the difference between the first code coverage data and the second code coverage data meets a preset condition, the test case set as a final test case set.
The test case range determining program according to claim 16, wherein said analyzing said first code coverage data and said second code coverage data to obtain said first code coverage data and said The step of the second code covering the difference between the data and determining whether the difference satisfies the preset condition includes:

Reading, respectively, a coverage ratio of each packet included in the first code coverage data in the first code coverage data and the second code coverage data;

Calculating, respectively, a difference in coverage of each packet in the first code coverage data and the second code coverage data; and

Determining whether the degree of difference of each packet is less than or equal to a preset threshold.
The test case range determining program according to claim 17, wherein said "determining said difference when said difference between said first code coverage data and said second code coverage data does not satisfy a preset condition The steps of the first code overlay data and the second code overlay data difference code include:

When the each package includes one or more packets whose degree of difference is greater than a preset threshold, the one or more packets are filtered out;

Comparing the coverage of the class included in the one or more packages in the first code coverage data and the second code coverage data, respectively, screening the first code coverage data and the second code Overlay one or more classes with different coverage in the data;

Comparing the coverage of the method included in the one or more classes in the first code coverage data and the second code coverage data, respectively, filtering out the first code coverage data and the second code One or more methods that cover different coverage in the data; and

Comparing the coverage of the code lines included in the one or more methods in the first code coverage data and the second code coverage data, respectively, screening out the first code coverage data and the second The code covers different lines of code in the coverage data, and determines a difference code between the first code coverage data and the second code coverage data.
The test case scope determining program according to claim 18, wherein the first code coverage data comprises: a user executing the operation flow in a production environment, and a package, a class, a method, and a line covered in the system code. information.
The test case scope determining program according to claim 19, wherein the second code coverage data comprises: executing the test case set in the test environment, the covered packages, classes, methods, and lines in the system code. information.