WO2018120965A1

WO2018120965A1 - Automatic test method and device, and computer-readable storage medium

Info

Publication number: WO2018120965A1
Application number: PCT/CN2017/105011
Authority: WO
Inventors: 孙锦程
Original assignee: 上海壹账通金融科技有限公司
Priority date: 2016-12-30
Filing date: 2017-09-30
Publication date: 2018-07-05
Also published as: CN106776339B; CN106776339A

Abstract

An automatic test method and device. The method comprises: during the operation of a software system, analyzing whether a software code of the software system is modified in real time or regularly (S10); if it is analyzed that the software code of the software system is modified, finding the modified software code, and determining an automatic test execution script associated with the found modified software code according to pre-stored associated data between the software code and the automatic test execution script (S20); and running each determined automatic test execution script in the software system with the modified software code, and generating a test report (S30). The above-mentioned method improves the test efficiency, makes it easier to find a test error and saves manpower and material resources.

Description

Automated test method, computer readable storage medium and device

The present application claims priority to Chinese Patent Application No. 20161126121, filed on Dec.

Technical field

The present invention relates to the field of computer technologies, and in particular, to an automated test method, a computer readable storage medium, and an apparatus.

Background technique

At present, after a software system is online, if the developer has modified the software code of the software system, the developer needs to run the test of all the automated test execution scripts in a large number of operating scenarios for the software system after the code is modified. Especially for some large software systems, the number of automated test execution scripts that need to be executed automatically will usually exceed tens of thousands. All of these automated test execution scripts will take a lot of time to run, and it will cost a lot. Time to analyze automated test execution scripts with test errors, wasting a lot of manpower and resources, and often making mistakes.

Summary of the invention

The main object of the present invention is to provide an automated test method, computer readable storage medium and device, which aim to improve the efficiency and cost of automated testing.

To achieve the above object, the present invention provides an automated test method, the method comprising the following steps:

During the running of the software system, whether the software code of the software system is modified in real time or periodically;

If the software code of the software system is modified, the modified software code is found, and the automation associated with the found modified software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Test execution script;

The determined individual automated test execution scripts are run in the software system after the software code is modified, and a test report is generated.

Preferably, before the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system, the method further comprises:

Running each of the automated test execution scripts corresponding to the software system one by one, and analyzing and recording the software code associated with the automated test execution script during the execution of an automated test execution script, the software associated with the automated test execution script The code is the software code that is invoked during the running of the automated test execution script;

Save the associated data of the software code and the automated test execution script.

Preferably, the determining each of the automatics is run in the software system after the software code is modified Before testing the execution script and generating the test report, it also includes:

Analyzing whether an automated test execution script associated with the modified software code is determined;

If yes, executing the steps of running the determined automated test execution scripts in the software system after the software code is modified, and generating a test report;

If not, a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.

Preferably, the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system comprises:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.

Preferably, the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.

In addition, in order to achieve the above object, the present invention also provides an automated testing device, the automated testing device comprising:

a first analysis module, configured to analyze whether the software code of the software system is modified in real time or timing during the running of the software system;

a determining module, configured to: if the software code of the software system is modified, find the modified software code, and determine and modify the modified software according to the associated data of the pre-saved software code and the automated test execution script An automated test execution script associated with the code;

The test module is configured to run the determined individual automated test execution scripts in the software system after the software code is modified, and generate a test report.

Preferably, the automated testing device further comprises:

a recording module, configured to run each of the automated test execution scripts corresponding to the software system one by one, and analyze and record the software code associated with the automated test execution script during an automated test execution script running, the automated test execution The software code associated with the script is the software code that is invoked during the running of the automated test execution script;

A save module that holds the associated data of the software code and the automated test execution script.

Preferably, the automated testing device further comprises:

a second analysis module, configured to analyze whether an automated test execution script associated with the modified software code is determined;

The reminder module is configured to generate a reminder message if there is no automated test execution script associated with the modified software code to remind the user to add a corresponding automated test execution script for the modified software code.

Preferably, the first analysis module is further configured to:

Preferably, the test report includes a list of automated test execution scripts in which a test error has occurred Information, and/or, error type information for testing errors.

Moreover, the present invention also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of the automated test method and apparatus described above.

The automated test method, the computer readable storage medium and the device provided by the invention determine the software to be modified through the associated data of the pre-stored software code and the automated test execution script when the software code of the software system is modified. The code is associated with an automated test execution script and runs the determined automated test execution scripts in the software system after the software code is modified to generate a test report. Since it is only necessary to determine the automated test execution script associated with the modified software code and execute the determined automated test execution script to complete the test without running all automated test execution scripts on the software system after the code is modified. Improves test efficiency and makes it easier to find test errors, saving manpower and material resources.

DRAWINGS

1 is a schematic flow chart of a first embodiment of an automated test method according to the present invention;

2 is a schematic flow chart of a second embodiment of an automated test method according to the present invention;

3 is a schematic flow chart of a third embodiment of an automated test method according to the present invention;

4 is a schematic diagram of functional modules of a first embodiment of an automated test apparatus according to the present invention;

5 is a schematic diagram of functional modules of a second embodiment of an automated test apparatus according to the present invention;

FIG. 6 is a schematic diagram of functional modules of a third embodiment of an automated test apparatus according to the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments, in order to make the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The present invention provides an automated test method.

1 is a schematic flow chart of a first embodiment of an automated test method according to the present invention.

In a first embodiment, the automated test method comprises:

Step S10: During the running of the software system, analyze whether the software code of the software system is modified in real time or periodically;

After a software system is online, depending on the actual operating conditions of the software system, developers sometimes need to make partial modifications to the software code of the software system, such as adding code, modifying code, deleting code, and so on. In this embodiment, during the online operation of the software system, whether the software code of the software system is modified, such as whether there is new code, modified code, deleted code, etc., is analyzed in real time or at a time (for example, 23:59 every day).

In an implementation manner, during the running of the software system, the system log information is retrieved in real time or periodically, and the software modification log of the software system is extracted from the system log information to analyze whether the software code of the software system is modified.

In another implementation manner, a software modification information collection module may be pre-configured on the software system, and the information acquisition module is modified by the software to detect and record detailed information of each software code modification in real time or periodically, such as modifying. Type, modification time, modification party identity information, etc., and use the detected software modification information for more detailed analysis to determine whether the software code of the software system should be identified as being modified. For example, it may be preset that after the set time period or the set high level developer modifies the software code of the software system, the software system is not required to be automatically tested, and then the information acquisition module is modified by the software. It also records that the software code of the software system has been modified by the high-level developer in the set time period or setting, and the software code identified as the software system is not modified, which is more flexible and practical.

Step S20: If the software code of the software system is modified, the modified software code is found, and the associated software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Connected automated test execution scripts;

If it is analyzed that the software code of the software system is modified, such as adding new code, modifying code, deleting code, etc., the modified software code is found, and the modified software code is also the software code of the software system. The pre-modified original software code corresponding to the modified code, and determining the automated test execution script associated with the modified software code based on the pre-stored software code and the associated data of the automated test execution script. The associated data of the software code and the automated test execution script may be an analysis of the software code of the software system and each of the automated test execution scripts in advance, and find an automated test execution script corresponding to each piece of software code of the software system, and Save the association. The associated data of the software code and the automated test execution script may also be obtained from the cloud server, for example, the software code provided by the same software system as the software system may be directly obtained from the cloud server and the associated test data of the automated test execution script; The cloud server obtains the associated data of the software code provided by the software system identical or similar to the software system and the automated test execution script, and compares and selects the data of the most accurate software code and the automated test execution script, which is not limited herein. .

Step S30, running the determined various automated test execution scripts in the software system after the software code is modified, and generating a test report.

After determining the automated test execution script associated with the modified software code, the determined individual automated test execution scripts may be run in the software system after the software code is modified to modify the software code. The system performs automated testing, that is, using the automated test execution script associated with the original software code before modification, to automatically test the software system whose code has been modified to test the modified software system and before the modification. The original software code has the same or similar modified content in terms of content, function, function, etc., whether there is any incompatibility, mismatch, etc., and generates a test report. The test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error, including but not limited to an H5 page exception, a system crash, and the like.

In the embodiment, when the software code of the software system is modified, the automated test execution script associated with the modified software code is determined by the pre-stored software code and the associated data of the automated test execution script, and the software code is The modified automated test execution scripts are run in the modified software system to generate test reports. Since it is only necessary to determine the automated test execution script associated with the modified software code and execute the determined automated test execution script to complete the test without running all automated test execution scripts on the software system after the code is modified. Improves test efficiency and makes it easier to find test errors, saving manpower and material resources.

As shown in FIG. 2, the second embodiment of the present invention provides an automated test method. Based on the foregoing embodiment, before the step S10, the method further includes:

Step S40, running each of the automated test execution scripts corresponding to the software system one by one, and analyzing and recording the software code associated with the automated test execution script during an automated test execution script running process, wherein the automated test execution script is related to the automated test execution script The associated software code is the software code that is invoked during the running of the automated test execution script;

In step S50, the associated data of the software code and the automated test execution script is saved.

In this embodiment, for each software system, each of the automated test execution scripts corresponding to the software system is run one by one, and during an automated test execution script running process, the software code associated with the automated test execution script is analyzed and recorded, The software code associated with the automated test execution script refers to the software code that is invoked during the execution of the automated test execution script. In this way, one or more automated test execution scripts associated with each piece of software code of the software system can be accurately found, and the recorded software data of the software system and the associated data of the automated test execution script can be saved. For subsequent use in determining an automated test execution script associated with the software code being modified in the software system.

As shown in FIG. 3, the third embodiment of the present invention provides an automated test method. Based on the foregoing embodiment, before the step S30, the method further includes:

Step S60, analyzing whether an automated test execution script associated with the modified software code is determined;

If yes, proceed to step S30;

If not, step S70 is executed to generate reminder information to remind the user to add a corresponding automated test execution script for the modified software code.

In this embodiment, when the automated test execution script associated with the modified software code is determined, if the automated test execution script associated with the modified software code is not found, the modified software code is not previously associated with the relevant The automated test execution script or the modified software code is new code, there is no automated test execution script associated with it, and the developer is required to manually add automated test execution scripts. Then generating reminder information such as pop-up information on the interface, or sending reminder information to a predetermined terminal, such as a developer's mobile phone, to remind the developer to manually write a script for the modified software code or to retrieve an existing script. Add the corresponding automated test execution script to enable more comprehensive automated testing of the software system with the modified software code.

The invention further provides an automated test device.

Referring to FIG. 4, FIG. 4 is a schematic diagram of functional modules of a first embodiment of an automated test apparatus according to the present invention.

In a first embodiment, the automated test device comprises:

The first analysis module 01 is configured to analyze whether the software code of the software system is modified in real time or timing during the running of the software system;

The determining module 02 is configured to: if the software code of the software system is modified, find the modified software code, and determine and modify the modified software according to the associated data of the pre-saved software code and the automated test execution script. An automated test execution script associated with the software code;

a test module 03, configured to run the determined each in the software system after the software code is modified Automate test execution scripts and generate test reports.

As shown in FIG. 5, the second embodiment of the present invention provides an automated testing device. Based on the foregoing embodiments, the method further includes:

The recording module 04 is configured to run each of the automated test execution scripts corresponding to the software system one by one, and analyze and record the software code associated with the automated test execution script during an automated test execution script operation, and the automated test The software code associated with the execution script is the software code that is invoked during the running of the automated test execution script;

The saving module 05 is used to save the associated data of the software code and the automated test execution script.

As shown in FIG. 6, the third embodiment of the present invention provides an automatic testing device. Based on the foregoing embodiments, the method further includes:

a second analysis module 06, configured to analyze whether an automated test execution script associated with the modified software code is determined;

Reminder module 07 for automated test execution if not associated with the modified software code The script generates a reminder message to remind the user to add a corresponding automated test execution script for the modified software code.

Furthermore, the present invention also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the automated test method and apparatus of the various embodiments described above step.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and can also be implemented by hardware, but in many cases, the former is A better implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

The preferred embodiments of the present invention have been described above with reference to the drawings, and are not intended to limit the scope of the invention. The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments. Additionally, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.

A person skilled in the art can implement the invention in various variants without departing from the scope and spirit of the invention. For example, the features of one embodiment can be used in another embodiment to obtain a further embodiment. Any modifications, equivalent substitutions and improvements made within the technical concept of the invention are intended to be included within the scope of the invention.

Claims

An automated test method, characterized in that the method comprises the following steps:

During the running of the software system, whether the software code of the software system is modified in real time or periodically;

If the software code of the software system is modified, the modified software code is found, and the automation associated with the found modified software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Test execution script;

The determined individual automated test execution scripts are run in the software system after the software code is modified, and a test report is generated.
The automated testing method according to claim 1, wherein the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system further comprises:

Running each of the automated test execution scripts corresponding to the software system one by one, and analyzing and recording the software code associated with the automated test execution script during the execution of an automated test execution script, the software associated with the automated test execution script The code is the software code that is invoked during the running of the automated test execution script;

Save the associated data of the software code and the automated test execution script.
The automated testing method according to claim 1, wherein the step of executing the determined individual automated test execution scripts in the software system after the software code is modified and generating the test report further comprises:

Analyzing whether an automated test execution script associated with the modified software code is determined;

If yes, executing the steps of running the determined automated test execution scripts in the software system after the software code is modified, and generating a test report;

If not, a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.
The automated testing method according to claim 2, wherein the step of running the determined individual automated test execution scripts in the software system after the software code is modified and generating the test report further comprises:

Analyzing whether an automated test execution script associated with the modified software code is determined;

If yes, executing the steps of running the determined automated test execution scripts in the software system after the software code is modified, and generating a test report;

If not, a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.
The automated testing method according to claim 1, wherein the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system include:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
The automated testing method according to claim 2, wherein the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system comprises:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
The automated test method according to claim 1, wherein the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.
The automated test method according to claim 2, wherein the test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.
An automated testing device, characterized in that the automated testing device comprises:

a first analysis module, configured to analyze whether the software code of the software system is modified in real time or timing during the running of the software system;

a determining module, configured to: if the software code of the software system is modified, find the modified software code, and determine and modify the modified software according to the associated data of the pre-saved software code and the automated test execution script An automated test execution script associated with the code;

The test module is configured to run the determined individual automated test execution scripts in the software system after the software code is modified, and generate a test report.
The automated testing device of claim 9 further comprising:

a recording module, configured to run each of the automated test execution scripts corresponding to the software system one by one, and analyze and record the software code associated with the automated test execution script during an automated test execution script running, the automated test execution The software code associated with the script is the software code that is invoked during the running of the automated test execution script;

A save module that holds the associated data of the software code and the automated test execution script.
The automated testing device of claim 9 further comprising:

a second analysis module, configured to analyze whether an automated test execution script associated with the modified software code is determined;

Reminder module for automated test execution feet if not associated with the modified software code In this case, a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.
The automated testing device of claim 10, further comprising:

a second analysis module, configured to analyze whether an automated test execution script associated with the modified software code is determined;

The reminder module is configured to generate a reminder message if there is no automated test execution script associated with the modified software code to remind the user to add a corresponding automated test execution script for the modified software code.
The automated testing device of claim 9, wherein the first analysis module is further configured to:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
The automated testing device of claim 10, wherein the first analysis module is further configured to:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.
The automated test apparatus according to claim 9, wherein said test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.
The automated test apparatus according to claim 10, wherein said test report includes list information of an automated test execution script in which a test error occurs, and/or error type information of the test error.
A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program, and when the computer program is executed by the processor, the following steps are implemented:

During the running of the software system, whether the software code of the software system is modified in real time or periodically;

If the software code of the software system is modified, the modified software code is found, and the automation associated with the found modified software code is determined according to the associated data of the pre-saved software code and the automated test execution script. Test execution script;

The determined individual automated test execution scripts are run in the software system after the software code is modified, and a test report is generated.
The computer readable storage medium according to claim 17, wherein said computer program is processed by said processor before said step of analyzing whether software code of said software system is modified in real time or timing during operation of said software system When executed, the following steps are also implemented:

Running each of the automated test execution scripts corresponding to the software system one by one, and analyzing and recording the software code associated with the automated test execution script during the execution of an automated test execution script, the software associated with the automated test execution script The code is the software code that is invoked during the running of the automated test execution script;

Save the associated data of the software code and the automated test execution script.
A computer readable storage medium according to claim 17 or 18, wherein said step of executing said determined automated test execution script in said software system after said software code is modified and generating a test report When the computer program is executed by the processor, the following steps are also implemented:

Analyzing whether an automated test execution script associated with the modified software code is determined;

If yes, executing the steps of running the determined automated test execution scripts in the software system after the software code is modified, and generating a test report;

If not, a reminder message is generated to remind the user to add a corresponding automated test execution script for the modified software code.
The computer readable storage medium according to claim 17 or 18, wherein the step of analyzing whether the software code of the software system is modified in real time or timing during the running of the software system comprises:

During the running of the software system, the software modification log of the software system is analyzed in real time or periodically to analyze whether the software code of the software system is modified; the modification includes adding a new code, modifying a code, or deleting a code.