WO2017067441A1

WO2017067441A1 - Method, device and system for testing application, and non-transient machine-readable storage medium

Info

Publication number: WO2017067441A1
Application number: PCT/CN2016/102418
Authority: WO
Inventors: 梁捷; 卢威
Original assignee: 广州爱九游信息技术有限公司
Priority date: 2015-10-19
Filing date: 2016-10-18
Publication date: 2017-04-27
Also published as: CN106598835A; CN106598835B

Abstract

Provided are a method, device and system for testing an application, and a non-transient machine-readable storage medium. The method comprises: transmitting a test script, which is pre-stored and is used for controlling the running of an application, to a test terminal according to a test instruction (S101); controlling the test script to run on the test terminal, so as to control the running of the application on the test terminal (S102); and receiving running data, which is transmitted by the test terminal, of the application in the test terminal (S103). It can be seen that the method takes a test instruction as a trigger condition to trigger a test process of an application. Therefore, the testing process can be automatically triggered; and compared with an existing method of testing in dependence on manpower, the test efficiency of the application is improved.

Description

Test method, device, system and non-transitory machine readable storage medium for an application

Technical field

The present application relates to the field of computers, and in particular, to a test method, apparatus, system, and non-transitory machine readable storage medium for an application.

Background technique

With the development of smart phones, the development of applications for smart phones is increasing. Before the application is delivered to the user, the developer needs to test the stability of the application. The essence of the stability test is to collect the running data of the application by running the application on the test terminal, and analyze whether the running of the application is stable according to the running data.

At present, the stability test scheme applicable to mobile phone applications on the market mainly corresponds to manual operation to observe whether an abnormal phenomenon such as application crash, card frequency, etc. is wasted, labor is wasted, and test efficiency is low.

Thus, there is a need for an application testing solution that can increase the efficiency of application testing.

Summary of the invention

In view of the above technical problems, it is an object of the present invention to provide a test method, apparatus, system and non-transitory machine readable storage medium for an application which can improve the test efficiency of an application.

In order to achieve the above object, the present invention provides the following technical solutions:

According to an aspect of the present invention, a test method for an application is provided, comprising:

Sending a pre-stored test script for controlling the running of the application to the test terminal according to the test instruction;

Controlling the test script to run on the test terminal to control operation of the application on the test terminal;

Receiving operation data of the application sent by the test terminal in the test terminal.

Optionally, the step of sending a pre-stored test script for controlling the running of the application to the test terminal may include:

Obtaining a list of pre-selected test terminals, the list of test terminals including at least one test terminal;

Connecting with a preset interface of the test terminal in the list of the test terminals by using a preset connection manner;

A pre-stored test script for controlling the running of the application is sent to the successfully connected test terminal through the preset interface.

Optionally, the test instructions may include code submission instructions for the application.

Optionally, the step of sending the pre-stored test script for controlling the running of the application to the test terminal according to the test instruction may include:

When the code submission instruction of the application is detected, it is determined whether the interval between the current time and the time of the last test is greater than a preset time interval. If the determination is yes, the test script is sent to the test terminal.

Optionally, the step of controlling the test script to run on the test terminal to control the operation of the application on the test terminal may include:

Sending a monitoring software installation package to the testing terminal to install the monitoring software in the testing terminal;

Sending a test startup instruction to the test terminal, the test startup instruction is used to start the test script in the test terminal to start running, so that the running test script starts monitoring software on the test terminal, And launching and running the application through the monitoring software. Optionally, the step of sending a test start command to the test terminal may include:

In the case that the application is already installed on the test terminal, after the version of the application on the test terminal is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, the test is performed. The terminal sends a test start command; or

If the application is not installed on the test terminal, send an installation package of the application and an installation instruction to the test terminal, where the installation instruction is used to instruct the test terminal to install using an installation package of the application. The application sends a test start command to the test terminal after the version of the application on the test terminal matches the version indicated by the code submitted by the code submission instruction of the application.

Optionally, the method may further include:

Recording an operation process on the application by software installed in the terminal device, and generating the test script according to the recorded content; or

A test script is generated by receiving and compiling a code input by a user, wherein the test script includes instructions for controlling the application to run on the test terminal.

According to another aspect of the present invention, there is also provided a test method of another application, which is applied to a test terminal, the method comprising:

Receiving, by the control terminal, a pre-stored test script for controlling the running of the application according to the test instruction;

Running the application on the test terminal in response to the control end controlling the test script;

Collecting operation data of the application in the test terminal;

Uploading the running data to the control terminal.

Optionally, the step of running the application on the test terminal in response to the control of the test script by the control terminal may include:

Receiving a test start command sent by the control terminal;

And executing the test script according to the test start command sent by the control terminal to control the operation of the application on the test terminal.

Optionally, the step of running the test script to control the running of the application on the test terminal according to the test start command sent by the control terminal may include:

Receiving a monitoring software installation package sent by the control terminal;

Installing the monitoring software on the test terminal by using the monitoring software installation package;

And executing the test script according to the test startup command sent by the control terminal, so that the running test script starts the monitoring software on the test terminal, and starts and runs the application through the monitoring software.

Optionally, the step of starting and running the application by using the monitoring software may include: starting the application by the monitoring software and controlling execution business logic of the application.

Optionally, the step of collecting the operation data for use in the test terminal may include: collecting, by the monitoring software, an execution log of the application execution service logic; and/or collecting, by the monitoring software Apply performance data during the run.

Optionally, the method may further include: collecting, by the monitoring software, data indicating whether the test terminal is successfully connected to the control terminal, data indicating whether the monitoring software is successfully installed, and indicating whether the test script is started. Successful data, data indicating whether the monitoring software is successfully started, and data indicating whether the application is successfully started.

Optionally, the test instructions can include code submission instructions for the application.

Optionally, before the step of the test terminal receiving the test start command sent by the control terminal, the method may further include:

In a case where the application is installed on the test terminal, the version of the installed application is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application; or

If the application is not installed on the test terminal, receiving an installation package of the application and an installation instruction sent by the control terminal, and installing the application by using an installation package of the application according to the installation instruction. .

According to another aspect of the present invention, there is also provided an application testing apparatus comprising:

a sending module, configured to send, to the test terminal, a pre-stored test script for controlling the running of the application according to the test instruction;

a control module, configured to run on the test terminal by controlling the test script to control operation of the application on the test terminal;

And a receiving module, configured to receive operation data of the application sent by the test terminal in the test terminal.

Optionally, the device may further include:

An obtaining module, configured to obtain a list of pre-selected test terminals, where the list of test terminals includes at least one test terminal, and the sending module performs a test in a list with the test terminal by using a preset connection manner The preset interface of the terminal is connected, and the pre-stored test script for controlling the running of the application is sent to the successfully connected test terminal through the preset interface.

Alternatively, the test instructions can include code submission instructions for the application.

Optionally, the device may further include: a determining module, configured to determine, when the code submission instruction of the application is detected, whether the interval between the current time and the time of the last test is greater than a preset time interval, When the module determines to be YES, the transmitting module transmits the test script to the test terminal.

Optionally, the control module may be configured to send a test start instruction to the test terminal, where the test start command is used to start the test script in the test terminal to start running, so that the running The test script starts monitoring software on the test terminal, and starts and runs the application through the monitoring software.

The sending module is further configured to send a monitoring software installation package to the testing terminal to send the monitoring software in the testing terminal before the control module sends a test startup command to the testing terminal.

Optionally, in a case that the application is installed on the test terminal, after the version of the application on the test terminal is consistent with a version indicated by a code submitted by a code submission instruction corresponding to the application, Sending, by the sending module, a test start instruction to the test terminal, or sending the application installation package to the test terminal by the sending module if the application is not installed on the test terminal; An installation instruction, the installation instruction is used to instruct the test terminal to install the application by using an installation package of the application, and the version of the application on the test terminal is submitted with a code submission instruction corresponding to the application. After the versions indicated by the code are consistent, the sending module sends a test start command to the test terminal.

Optionally, the device may further include:

a test script generating module, configured to record an operation process of the application by software installed in the terminal device, and generate the test script according to the recorded content; or generate a test script by receiving and compiling a code input by the user, The test script includes instructions for controlling the application to run on the test terminal.

a receiving module, configured to receive a pre-stored test script for controlling operation of the application sent by the control terminal according to the test instruction;

a running module, configured to run the application on the testing device in response to control of the test script by the control terminal;

a collection module, configured to collect operation data of the application in the testing device;

The uploading module is configured to upload the running data to the control terminal.

Optionally, the receiving module receives a test start command sent by the control terminal, and the running module runs the test script according to the test start command received by the receiving module to control the application in the test Operation on the device.

Optionally, the receiving module further receives the monitoring software installation package sent by the control terminal, and the device may further include an installation module, configured to install the monitoring software on the testing device by using a monitoring software installation package, where the operating module And executing the test script according to the test start instruction received by the receiving module, so that the running test script starts the monitoring software on the testing device, and starts and runs the application through the monitoring software.

Optionally, the running module further controls execution business logic of the application by using the monitoring software.

Optionally, the collecting module collects an execution log of execution business logic of the application by using the monitoring software, and/or the collecting module collects performance data during running of the application by using the monitoring software.

Optionally, the collecting module further collects, by the monitoring software, data indicating whether the testing device is successfully connected to the control terminal, data indicating whether the monitoring software is successfully installed, and indicating whether the testing script is successfully started. Data, data indicating whether the monitoring software is successfully started, and data indicating whether the application is successfully started.

Optionally, the test instruction includes a code submission instruction of the application.

Optionally, the device may further include: a version maintenance module, before the receiving module receives the test start command sent by the control terminal,

In a case where the application is installed on the test terminal, the version maintenance module guarantees that the version of the local application is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, or

In the case that the application is not installed on the test terminal, the receiving module receives an installation package of the application and an installation instruction sent by the control terminal, and the version maintenance module utilizes the installation instruction according to the installation instruction. The application's installation package installs the application.

According to another aspect of the present invention, there is also provided an application testing system comprising:

Control terminal and test terminal;

The control end is configured to send, to the test terminal, a pre-stored test script for controlling the running of the application according to the test instruction; and control the test script to run on the test terminal to control the application to be Running on the test terminal;

The test terminal is configured to collect and upload operation data of the application in the test terminal to the control terminal.

Optionally, the control end sends a test start instruction to the test terminal,

The test terminal runs the test script according to the received test start command sent by the control terminal to control the operation of the application on the test terminal.

Optionally, the control terminal sends a monitoring software installation package to the test terminal, where the test terminal installs the monitoring software by using the monitoring software installation package, and the testing terminal sends the monitoring software according to the received control terminal. Testing a startup command, running the test script, so that the running test script starts monitoring software on the test terminal, and starts and runs through the monitoring software The application.

Optionally, the test terminal is further configured to: before the control terminal sends the test start command to the test terminal, if the application is installed on the test terminal, the version of the installed application is The version of the code indicated by the code submission instruction corresponding to the application is guaranteed to be consistent, or

The control terminal is further configured to send, when the application is not installed on the test terminal, an installation package of the application and an installation instruction to the test terminal, where the test terminal is further configured to use the installation instruction according to the installation instruction. The application is installed using the installation package of the application.

According to another aspect of the present invention, there is also provided a non-transitory machine readable storage medium having stored thereon executable code that, when executed by a processor, causes the processor to execute The test method described in the text.

The testing method and device, the system and the non-transitory machine readable storage medium of the application according to the present invention send a pre-stored test script for controlling the running of the application to the test terminal according to the test instruction, and control the test. A script runs on the test terminal to control the operation of the application on the test terminal and collect operational data of the application in the test terminal. Therefore, the invention uses the test command as a trigger condition, which can trigger the test process of the application, and improves the efficiency of the application test compared with the existing method of relying on the manual test.

DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly described below. It should be understood that the following drawings show only certain embodiments of the present invention, and therefore It should be seen as a limitation on the scope, and those skilled in the art can obtain other related drawings according to these drawings without any creative work.

1 is a flowchart of a test method of an application disclosed in an embodiment of the present application;

2 is a flowchart of a test method of still another application disclosed in an embodiment of the present application;

FIG. 3 is a flowchart of still another application testing method disclosed in the embodiment of the present application;

4 is a flowchart of a test method of still another application disclosed in an embodiment of the present application;

FIG. 5 is a flowchart of still another application testing method disclosed in the embodiment of the present application;

FIG. 6 is a schematic structural diagram of an application testing apparatus according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of another testing apparatus according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of an application testing system disclosed in an embodiment of the present application.

detailed description

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

During the development of the application, the developer can write and submit the code for the application on the development platform, or modify the code multiple times and submit the modified code. The testing method, device and system of the application disclosed in the embodiments of the present application aim at realizing the automatic execution of the test. The method and the device in the embodiments of the present application may be applied to the Android platform, and may also be applied to other platforms, which are not limited herein.

FIG. 1 is a schematic flowchart of a test method of an application disclosed in an embodiment of the present application. The execution body of this embodiment may be a control terminal.

Referring to FIG. 1, in step S101, a pre-stored test script for controlling the operation of the application is sent to the test terminal according to the test command.

The test instruction may be an instruction issued by a (third party) tester to test the application to be tested, or may be a code submission instruction of the application submitted by the application developer. For example, the developer can submit the code of the developed/updated application after completing the development of the code of the new application, or after updating or maintaining the code of the existing application, in response to the developer. The code of the submitted application sends the corresponding test script to the test terminal.

In step S102, the control test script is run on the test terminal to control the operation of the application on the test terminal.

In step S103, the running data of the application sent by the test terminal in the test terminal is received.

It can be seen from the above steps that, for the test method described in this embodiment, the application test process is triggered by the test command, and the test process can be automatically started and the test data in the test process can be collected without human intervention test process, thereby greatly Save manpower and increase test efficiency.

Further, in this embodiment, the application testing process may use the code submission instruction as a trigger condition, that is, after the developer submits the application code, the application may be automatically collected. The data generated by the operation of the terminal is tested, so that the stability result of the application running in the test terminal can be obtained according to the running data. Therefore, in this embodiment, the development process of the application can be "seamlessly" coupled with the testing process of the application. Further, based on the testing process described in this embodiment, the test process of the latest code after submission can be automatically triggered regardless of the number of code modifications made by the researcher to the application.

The method of testing the stability of the application by simulating the process of using the application on the terminal by the existing R&D personnel (for example, the R&D personnel can manually operate the application on the terminal, experience the stability of the application, or on the terminal. Automatically running the application and recording the running process of the application, and observing the stability of the application by playing back. Compared with the method described in this embodiment, the test process can be manually triggered without the developer, and in the case of modifying the code multiple times, It does not require the user to manually trigger the test process repeatedly, which can improve the efficiency of the test.

So far, the flow of the test method applied to the control end of the present invention is briefly described with reference to FIG. 1, and a specific feasible implementation process of the test method shown in FIG. 1 will be described in detail below with reference to FIG. 2 and FIG. 3 respectively.

2 is a schematic flow chart of a test method of an application according to another embodiment of the present invention. In this embodiment, it is assumed that the application to be tested is installed on the test terminal (the cause of the situation may be that the test application is tested before, and the test process after the update version). Control terminal.

As shown in FIG. 2, in step S201, it is monitored whether there is an application code submission instruction.

If the monitoring result is no, step S201 is continued, and if the monitoring result is yes, step S202 is performed.

As described above, the code corresponding to the code submission instruction in this embodiment may be the code submitted after the original application is updated.

In step S202, a list of test terminals selected in advance is acquired, and the list of test terminals includes at least one test terminal.

The list of test terminals can be selected in advance by the developer. From the perspective of the accuracy of the test results, the more test terminals, the more test data is collected, and the more accurate the test results are based on the collected data.

In step S203, a preset connection mode is used to connect with a preset interface of the test terminal in the list of the test terminals.

Among them, the appropriate connection method and combination can be selected according to the actual selected test terminal. Connect with the appropriate preset interface. For example, when the test terminal is an Android mobile phone, TCP can be used as a connection method through the WIFI network, and an attempt is made to connect with the interface of the Android mobile phone service.adb.tcp.port.

In step S204, the pre-stored test script and the monitoring software installation package are sent to the successfully connected test terminal through the preset interface.

In step S205, after the version of the application on the test terminal is consistent with the version indicated by the code submission instruction of the application (in the case of having multiple code submission instructions, the version indicated by the last submitted code submission instruction is a test start command is sent to the test terminal, and the test start command is used to instruct the test terminal to start the test script to start running, so that the test script in operation starts the monitoring software on the test terminal, and passes the monitoring software. Start and run the app.

Assume that the version of the application installed on the test terminal is 1.0, and the submitted code has been upgraded to 2.0. After connecting with the R&D platform, the application in the test terminal can automatically upgrade the version, specific version identification and trigger upgrade. The process can be referred to the prior art and will not be described here.

Specifically, in this embodiment, after the version is upgraded, the startup command is sent to the test terminal, the test script is started, the monitoring software is started by the test script, and the application to be tested is started by the monitoring software, and the application execution logic is controlled by the application to be tested.

In step S206, an execution log of the application execution service logic is received from the test terminal, and performance data during the application operation process is collected by the monitoring software.

In step S207, the execution log is displayed in real time.

The existing application test method, after submitting the application installation package, is unable to know the specific test content, and only obtains some report data in the end, and the data is mainly for simple installation and uninstallation.

In contrast, in this embodiment, the application running business logic can be controlled, and the execution log of the business logic is collected and displayed in real time, so the developer can grasp the running status of the application in real time, and the developer can also adjust the test according to the execution log. The policy (for example, the adjusted test script can be sent to the test terminal through the control terminal according to the execution log), so that the test process is closer to the actual use situation, so that the stability test data is more reliable.

It can be seen from the above steps that the application testing method described in this embodiment can not only realize the integration of the process of the testing process and the application development process, but also deeply obtain the application business. Execute logical execution logs to improve the credibility of the testing process and results.

FIG. 3 is a schematic flowchart of a test method of an application according to another embodiment of the present invention.

In this embodiment, it is assumed that the application to be tested is not installed on the test terminal (the cause of the situation may be that the application to be tested has not been tested before, or the test terminal newly added in the test list has not tested the application to be tested). The execution body of this embodiment is a control terminal.

Referring to FIG. 3, in step S301, a test script is generated.

Here, the operation process of the application running on the terminal device can be recorded by installing corresponding software on the terminal device, and a test script is generated according to the recorded content. Alternatively, you can generate a test script by receiving and compiling the code entered by the user.

Based on the way the test script is generated by receiving and compiling the user-entered code, the developer can customize the test script so that the test script has different test functions to achieve the diversity of the test.

It should be noted that the terminal device mentioned herein may be a test terminal or other terminals.

In step S302, it is detected whether there is an application code submission instruction. If the detection result is yes, step S303 is performed, and if the detection result is no, it is continuously detected whether there is an application code submission instruction.

In step S303, it is determined whether the interval between the current time and the time of the last test is greater than the preset time interval. If the determination result is yes, step S304 is performed, and if the determination result is no, the process returns to step S302.

In this embodiment, the purpose of the determining step of step S303 is to prevent the test process from being triggered too frequently to save resources. For example, in the process of code development, developers may frequently modify the code of an application. Sometimes the code is submitted only to save the written code, not the completion of the code. Therefore, in practical applications, development The personnel can set the test start cycle according to actual needs.

In step S304, a pre-stored test script, monitoring software, and an installation package of the application are transmitted to the test terminal.

In step S305, an installation instruction for instructing the test terminal to install the application using the installation package of the application is sent to the test terminal.

In step S306, after the version of the application on the test terminal is consistent with the version indicated by the code submission instruction, a test for instructing the test terminal to start the test script test is sent to the test terminal. The instruction is started so that the test script starts the monitoring software on the test terminal, and the application is started and run by the monitoring software.

Specifically, the installation command and the test startup instruction can be sent to the test terminal through the debug bridge Debug Bridge.

It should be noted that the version of the installation package of the application may be inconsistent with the version indicated by the code submitted corresponding to the code submission instruction, that is, the installation package is a low version, and the code submitted corresponding to the code submission instruction indicates a high version, in which case After the test terminal completes the application installation, the application will automatically upgrade to the new version.

Wherein, as described above, the code submitted corresponding to the code submission instruction may be all or part of the code of the application after the developer develops or updates the application. In the case of submitting multiple code commit instructions, the version indicated by the code corresponding to the last code commit instruction may be used.

In step S307, various types of data sent by the test terminal are received.

Here, the test terminal collects relevant data during the running process of the application to be tested, and sends the data to the control terminal.

For example, the test terminal may collect an execution log of the application execution service logic, collect performance data during the application running process by using the monitoring software, collect data indicating whether the test terminal indicates successful connection, and indicate the test package. Whether to install successful data, data indicating whether the test script starts successfully, data indicating whether the monitoring software is successfully started, and data indicating whether the application is successfully started.

Different from the above embodiment, in this embodiment, in addition to collecting the running data of the application to be tested, the installation and startup data of the application to be tested, and the startup data of the test script and the monitoring software may be collected to further Comprehensively grasp the situation during the test.

In step S308, a report is generated using the collected data, and the report is displayed.

The application testing method described in this embodiment can test the application by using a developer-defined test script, and present the test result in the form of a report. Therefore, not only has high test efficiency, but also greatly facilitates developers. usage of.

So far, the specific flow when the test method of the application of the present invention is implemented as the control end is described in detail with reference to FIGS.

4 is a schematic flow chart of a test method of an application according to another embodiment of the present invention.

Different from the embodiment described above in connection with FIG. 1 to FIG. 3, this embodiment is based on the test terminal. The main body of the line describes it. The details mentioned in the embodiment have been described in detail above, and only the steps performed by the test terminal are described herein. For the details, reference may be made to the related description.

As shown in FIG. 4, in step S401, the pre-stored test script for controlling the operation of the application sent by the control terminal according to the test command is received.

In step S402, the application is run on the test terminal in response to the control end controlling the test script.

Here, the test terminal can receive the test start instruction sent by the control end, and run the test script according to the test start instruction to control the operation of the application on the test terminal.

In step S403, operational data applied in the test terminal is collected.

Here, the test terminal can also receive the monitoring software installation package sent by the control terminal, and install the monitoring software on the test terminal by using the software installation package, so that the running test script can start the monitoring software on the test terminal, and is started by the monitoring software. Run the application to be monitored. That is to say, the application can be launched by the monitoring software and control the execution business logic of the application.

The execution log of the application execution business logic and the performance data during the application running process may also be collected through the monitoring software.

And the monitoring software collects data indicating whether the test terminal indicates successful connection with the control terminal, data indicating whether the monitoring software is successfully installed, data indicating whether the test script is successfully started, data indicating whether the monitoring software is successfully started, and indicating whether the application is started. Successful data.

In step S404, the collected operational data is uploaded to the control terminal.

Thus, the test terminal can run the application, collect the operation data, and upload the operation data under the control of the control terminal.

In addition, the concepts of the test command, the test script, the test start command, and the monitoring software installation package described in this embodiment can be referred to the related description above, and details are not described herein again.

In the case that the application to be detected has been installed on the test terminal, the test terminal can match the version of the locally applied application with the version guarantee indicated by the code submission instruction of the application.

In the case that the application is not installed on the test terminal, the test terminal may receive an installation package of the application sent by the control terminal and an installation instruction, and install the application by using an installation package of the application according to the installation instruction.

FIG. 5 is a schematic flowchart of a test method of an application according to another embodiment of the present invention. Different from the above embodiments, in this embodiment, the focus is on the description between the control terminal and the test terminal. Interaction process.

As shown in FIG. 5, in step S501, the control terminal sends a pre-stored test script for controlling the running of the application and a monitoring software installation package to the test terminal according to the test instruction.

In step S502, the test terminal installs the monitoring software using the monitoring software installation package.

In step S503, in the case that the application is installed on the test terminal, the test terminal agrees that the version of the local application is consistent with the version indicated by the code submitted by the application last time.

In step S504, if the application is not installed on the test terminal, the control terminal sends the installation package of the application and the installation instruction to the test terminal.

In step S505, the test terminal installs the application by using the installation package of the application according to the installation instruction.

In step S506, the control terminal controls the test script to run on the test terminal to control the operation of the application on the test terminal.

Specifically, the specific implementation manner in which the control terminal controls the test script to run on the test terminal can be implemented by the interaction between the control terminal and the test terminal, that is, the control terminal sends a test start command to the test terminal, and the test terminal according to the test start command Run a test script to control the operation of the application on the test terminal.

Further, the test terminal runs the test script according to the test start command sent by the control end, so that the running test script starts the monitoring software on the test terminal, and starts and runs the application through the monitoring software.

In step S507, the test terminal collects and uploads the operation data of the application in the test terminal to the control terminal.

It can be seen from the steps in this embodiment that the control end interacts with the test terminal to automatically trigger the test process of the application without manually simulating the application process on the test terminal, thereby improving the test efficiency. At the same time, it is convenient to test the user's use.

Corresponding to the above method embodiment, the embodiment of the present application also discloses an application testing device.

6 is a schematic block diagram showing the structure of an application test apparatus according to an embodiment of the present invention.

Wherein, the application testing device of the embodiment corresponds to the method described in the above-mentioned FIGS. 1 to 3. Therefore, the functional modules in the application testing device of the present embodiment can be used to perform the relevant steps in the methods described in FIGS. 1-3. In the following, only the structure of the application test device will be described. For the details, reference may be made to the related description above in conjunction with FIGS.

Referring to FIG. 6, the application testing device of this embodiment includes a sending module 601 and a control module 602. And a receiving module 603.

The sending module 601 can send a pre-stored test script for controlling the running of the application to the test terminal according to the test instruction.

The control module 602 can control the test script to run on the test terminal to control the operation of the application on the test terminal.

The receiving module 603 can receive the running data of the application sent by the testing terminal in the testing terminal.

Optionally, the application testing device of this embodiment may further include an obtaining module 604. The obtaining module 604 can obtain a list of test terminals selected in advance, and the list of test terminals includes at least one test terminal.

The sending module 601 can connect with the preset interface of the test terminal in the list of the test terminal by using a preset connection manner, and send the test script to the test terminal with successful connection through the preset interface.

Optionally, the application testing device of this embodiment may further include a test script generating module 606.

The test script generation module 606 can record the operation process of the application by software installed in the terminal device, and generate a test script according to the recorded content; or generate a test script by receiving and compiling the code input by the user.

Optionally, the application testing device of this embodiment may further include a determining module 605.

The determining module 605 can determine whether the interval between the current time and the time of the last test is greater than a preset time interval, if the test instruction (which may be the code submission instruction of the application) is detected, and if the determination result is yes, then the test is performed. The terminal sends a pre-stored test script.

Specifically, the specific implementation manner of the control module 602 controlling the test script to run on the test terminal to control the operation of the application on the test terminal may be: sending a test start command to the test terminal, where The test startup command is used to start the test script in the test terminal to start running, so that the test script in operation starts monitoring software on the test terminal, and starts and runs the monitoring software through the monitoring software. In this case, the sending module 601 is further configured to: before the control module 602 sends a test start command to the test terminal, send a monitoring software installation package to the test terminal, to install in the test terminal. The monitoring software.

Further, the specific implementation manner of the control module 602 sending the test startup command to the test terminal may be: when the application is installed on the test terminal, the version of the application on the test terminal a generation submitted with a code submission instruction corresponding to the application After the version of the code indication is consistent, the sending module 601 sends a test start command to the test terminal; or, if the application is not installed on the test terminal, the sending module 601 sends the test command to the test terminal. An installation package of the application, and an installation instruction, the installation instruction is used to instruct the test terminal to install the application by using an installation package of the application, where the version of the application and the code corresponding to the application are on the test terminal After the version indicated by the code submitted by the instruction is identical, the sending module 601 sends a test start instruction to the test terminal.

Further, the function of the test script is that after the start of the running, the running test script starts the monitoring software on the testing terminal, and the monitoring software starts the application and controls the application to execute the business logic.

Specifically, the receiving module 603 may receive an execution log of the application execution service logic sent by the test terminal, and collect performance data during the running of the application by using the monitoring software.

Further, the receiving module 603 is further configured to receive, by the test terminal, data indicating whether the connection is successful, data indicating whether the test package is successfully installed, data indicating whether the test script is successfully started, and indicating whether the monitoring software is Start successful data and data indicating whether the application started successfully.

The device described in this embodiment can not only integrate the process of the test process and the application development process, but also deeply obtain the execution log of the application execution logic of the application, thereby improving the credibility of the test process and the result.

It should be noted that the apparatus in this embodiment may be integrated on the development platform of the code as a part of the background of the development platform, and the execution logic thereof may be referred to the foregoing embodiment.

FIG. 7 is a schematic block diagram showing the structure of an application test apparatus according to an embodiment of the present invention.

Wherein, the application testing device of the present embodiment corresponds to the method described above in connection with FIG. Therefore, the functional modules in the application testing device of the present embodiment can be used to perform the relevant steps in the method described in FIG. In the following, only the structure of the application test device will be described, and for the details thereof, reference may be made to the related description in conjunction with FIG. 4 above.

Referring to FIG. 7, the application testing device of this embodiment includes a receiving module 701, an operating module 702, a collecting module 703, and an uploading module 704.

The receiving module 701 can receive a pre-stored test script for controlling the running of the application sent by the control terminal according to the test instruction.

The running module 702 can operate on the testing device in response to the control end controlling the test script. use.

The collection module 703 can collect operational data that is applied in the testing device.

The uploading module 704 can upload the running data collected by the collecting module 703 to the control terminal.

Specifically, the receiving module 701 can receive the test startup command sent by the control terminal, and the running module 702 can run the test script according to the test startup command received by the receiving module 701 to control the operation of the application on the testing device.

Further, the running module 702 can run the test script according to the test start instruction received by the receiving module, so that the running test script starts the monitoring software on the testing device, and starts and runs the application through the monitoring software.

Optionally, the collecting module 703 may further collect, by using the monitoring software, data indicating whether the testing device is successfully connected to the control terminal, data indicating whether the monitoring software is successfully installed, and indicating whether the testing script is successfully started. Data, data indicating whether the monitoring software is successfully started, and data indicating whether the application is successfully started.

Optionally, the application testing device of this embodiment may further include an installation module 705. The receiving module 701 can receive the monitoring software installation package sent by the control terminal, the installation module 705 can install the monitoring software on the testing device by using the monitoring software installation package, and the running module 702 runs the testing script according to the test startup instruction to make the running test script Start the monitoring software on the test device and start and run the application through the monitoring software.

Optionally, the application testing device of this embodiment may further include a version maintenance module 706. Before the receiving module 701 receives the test start command sent by the control terminal, in the case that the application is installed on the test device, the version maintenance module 706 may change the version of the local application with the code indicated by the code submission instruction corresponding to the application. To ensure consistency, in the case that the application is not installed on the testing device, the receiving module 701 can receive the installation package and the installation instruction of the application sent by the control terminal, and then the version maintenance module 706 can use the installation package of the application to install the application according to the installation instruction. .

FIG. 8 is a schematic block diagram showing the structure of an application test system according to an embodiment of the present invention.

As shown in FIG. 8, the application test system includes a control terminal 801 and one or more test terminals 802.

Specifically, the control terminal 801 is configured to send, to the test terminal 802, a pre-stored test script for controlling the running of the application according to the test instruction; and control the test script to run on the test terminal to control the The application is applied to the test terminal 802. The test terminal 802 is configured to collect and upload the operation data of the application in the test terminal 802 to the control terminal 801.

Specifically, the specific implementation manner in which the control terminal 801 controls the test script to run on the test terminal 802 may be: the control terminal 801 sends a test start command to the test terminal 802, and the test terminal 802 sends the test terminal 802 according to the control terminal 801. The test launch command runs the test script to control the operation of the application on the test terminal 802.

Further, the specific implementation manner of the test terminal 802 running the test script to control the operation of the application on the test terminal 802 according to the test start command sent by the control terminal 801 may be: according to the control end a test start command sent by 801, running the test script, so that the running test script starts monitoring software on the test terminal 802, and starts and runs the application through the monitoring software; in this case, the control The terminal 801 is further configured to: before the test script is sent according to the test start command sent by the control terminal 801, send the monitoring software installation package to the test terminal 802; the test terminal 802 is further configured to: The monitoring software is installed using the monitoring software installation package.

Optionally, the test terminal 802 is further configured to: before the control terminal 801 sends a test start command to the test terminal 802, if the application is installed on the test terminal 802, the application is locally The version of the version is consistent with the version of the code indicated by the code submission instruction corresponding to the application. Alternatively, the control terminal 801 is further configured to: when the application is not installed on the test terminal 802, send an installation package of the application and an installation instruction to the test terminal 802; and the test terminal 802 is further configured to: The installation instruction installs the application by using an installation package of the application.

The application testing system in this embodiment can improve the efficiency of application testing through the interaction between the control terminal 801 and the test terminal 802.

The functions described in the methods of the embodiments of the present application, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computing device readable storage medium. Based on such understanding, a portion of the embodiments of the present application that contributes to the prior art or a portion of the technical solution may be embodied in the form of a software product stored in a storage medium, including a plurality of instructions for causing a The computing device (which may be a personal computer, server, mobile computing device, or network device, etc.) performs all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

Therefore, the above technical idea of the present invention can also be implemented as a non-transitory machine readable A storage medium on which executable code is stored. When the executable code is executed by the processor, the processor is caused to perform the method described above.

In another aspect, the above technical concept of the present invention can also be embodied as a computing device including a processor and a non-transitory machine readable storage medium. The non-transitory machine readable storage medium stores executable code thereon. When the executable code is executed by the processor, the processor is caused to perform the method described above.

Further, the above technical idea of the present invention can also be embodied as a computer program product including executable code. When the executable code is executed by the processor, the processor is caused to perform the method described above.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same or similar parts of the respective embodiments may be referred to each other.

The above description of the disclosed embodiments enables those skilled in the art to make or use the application. Various modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the application. Therefore, the application is not limited to the embodiments shown herein, but is to be accorded the broadest scope of the principles and novel features disclosed herein.

Claims

An application test method is applied to the control end, and the method includes:

Sending a pre-stored test script for controlling the running of the application to the test terminal according to the test instruction;

Controlling the test script to run on the test terminal to control operation of the application on the test terminal;

Receiving operation data of the application sent by the test terminal in the test terminal.
The testing method according to claim 1, wherein the step of transmitting a pre-stored test script for controlling the running of the application to the test terminal comprises:

Obtaining a list of pre-selected test terminals, the list of test terminals including at least one test terminal;

Connecting with a preset interface of the test terminal in the list of the test terminals by using a preset connection manner;

A pre-stored test script for controlling the running of the application is sent to the successfully connected test terminal through the preset interface.
The test method according to claim 1, wherein

The test instructions include code submission instructions for the application.
The testing method according to claim 3, wherein the step of transmitting a pre-stored test script for controlling the running of the application to the test terminal according to the test instruction comprises:

When the code submission instruction of the application is detected, it is determined whether the interval between the current time and the time of the last test is greater than a preset time interval, and if the determination is yes, the test is sent to the test terminal. script.
The testing method according to any one of claims 1 to 4, wherein the step of controlling the test script to run on the test terminal to control the operation of the application on the test terminal comprises:

Sending a monitoring software installation package to the test terminal to install the monitoring in the test terminal software;

Sending a test startup instruction to the test terminal, the test startup instruction is used to start the test script in the test terminal to start running, so that the running test script starts the monitoring on the test terminal Software and launches and runs the application through the monitoring software.
The testing method according to claim 5, wherein the step of transmitting a test start command to the test terminal comprises:

In the case that the application is already installed on the test terminal, after the version of the application on the test terminal is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, the test is performed. The terminal sends a test start command; or

If the application is not installed on the test terminal, send an installation package of the application and an installation instruction to the test terminal, where the installation instruction is used to instruct the test terminal to install using an installation package of the application. The application sends a test start command to the test terminal after the version of the application on the test terminal matches the version indicated by the code submitted by the code submission instruction of the application.
The testing method according to claim 1, further comprising:

Recording an operation process of the application by software installed in the terminal device, and generating the test script according to the recorded content; or

Generate test scripts by receiving and compiling code entered by the user.

The test script includes instructions for controlling the application to run on the test terminal.
An application test method is applied to a test terminal, the method comprising:

Receiving, by the control terminal, a pre-stored test script for controlling the running of the application according to the test instruction;

Running the application on the test terminal in response to the control end controlling the test script;

Collecting operation data of the application in the test terminal;

Uploading the running data to the control terminal.
The testing method according to claim 8, wherein the step of running the application on the test terminal in response to the control of the test script by the control terminal comprises:

Receiving a test start command sent by the control terminal;

The test script is run to control the operation of the application on the test terminal according to the test start command.
The testing method according to claim 9, wherein the step of running the test script to control the operation of the application on the test terminal according to the test start instruction comprises:

Receiving a monitoring software installation package sent by the control terminal;

Installing the monitoring software on the test terminal by using the monitoring software installation package;

And executing the test script according to the test start instruction, so that the running test script starts the monitoring software on the test terminal, and starts and runs the application through the monitoring software.
The testing method according to claim 10, wherein the step of starting and running the application by the monitoring software comprises:

The application is launched by the monitoring software and controls the execution business logic of the application.
The test method according to claim 11, wherein said collecting said operational data for use in said test terminal comprises:

Collecting, by the monitoring software, an execution log of the application execution business logic; and/or

The performance data during the running of the application is collected by the monitoring software.
The testing method according to claim 10, further comprising:

Collecting, by the monitoring software, data indicating whether the test terminal is successfully connected to the control terminal, data indicating whether the monitoring software is successfully installed, data indicating whether the test script is successfully started, and indicating whether the monitoring software is Start successful data and data indicating whether the application started successfully.
The test method according to claim 9, wherein

The test instructions include code submission instructions for the application.
The test method according to claim 14, wherein before the step of receiving the test start command sent by the control terminal, the method further comprises:

In a case where the application is installed on the test terminal, the version of the installed application is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application; or

If the application is not installed on the test terminal, receiving an installation package of the application and an installation instruction sent by the control terminal, and installing the application by using an installation package of the application according to the installation instruction. .
An application testing device comprising:

a sending module, configured to send, to the test terminal, a pre-stored test script for controlling the running of the application according to the test instruction;

a control module, configured to control the test script to run on the test terminal, to control operation of the application on the test terminal;

And a receiving module, configured to receive operation data of the application sent by the test terminal in the test terminal.
The testing device of claim 16 further comprising:

An obtaining module, configured to obtain a list of pre-selected test terminals, where the list of test terminals includes at least one test terminal,

The sending module is connected to the preset interface of the test terminal in the list of the test terminal by using a preset connection manner, and sends the pre-stored control unit to the test terminal with successful connection through the preset interface. A test script that runs the application.
The test apparatus according to claim 16, wherein

The test instructions include code submission instructions for the application.
The testing device of claim 18, further comprising:

a determining module, configured to determine, when the code submission instruction of the application is detected, whether the interval between the current time and the time of the last test is greater than a preset time interval,

When the determining module determines to be YES, the sending module sends the test script to the testing terminal.
The test apparatus according to claim 18, wherein

The control module is specifically configured to send a test start instruction to the test terminal, where the test start command is used to start the test script in the test terminal to start running, so that the test script in operation is in the The monitoring software is started on the test terminal, and the application is started and run by the monitoring software.

The sending module is further configured to send a monitoring software installation package to the testing terminal to send the monitoring software in the testing terminal before the control module sends a test startup command to the testing terminal.
The test apparatus according to claim 20, wherein

In the case that the application is installed on the test terminal, after the version of the application on the test terminal is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, the sending is performed by the sending The module sends the test start command to the test terminal, or

If the application is not installed on the test terminal, the sending module sends an installation package of the application and an installation instruction to the test terminal, where the installation instruction is used to instruct the test terminal to use the The installation package of the application installs the application, and after the version of the application on the test terminal is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, the sending module sends the test module to the test terminal. Send the test start command.
The testing device according to claim 16, further comprising: a test script generating module, configured to:

Recording an operation process on the application by software installed in the terminal device, and generating the test script according to the recorded content; or

Generating the test script by receiving and compiling the code entered by the user,

The test script includes instructions for controlling the application to run on the test terminal.
An application testing device comprising:

a receiving module, configured to receive a pre-stored test script for controlling operation of the application sent by the control terminal according to the test instruction;

a running module, configured to run the application on the testing device in response to control of the test script by the control terminal;

a collection module, configured to collect operation data of the application in the testing device;

The uploading module is configured to upload the running data to the control terminal.
The test apparatus according to claim 23, wherein

Receiving, by the receiving module, a test startup instruction sent by the control terminal,

The running module runs the test script according to the test start instruction received by the receiving module to control the running of the application on the testing device.
The test apparatus according to claim 24, wherein the receiving module further receives a monitoring software installation package sent by the control terminal, the device further comprising:

Installing a module for installing the monitoring software on the testing device using the monitoring software installation package,

The running module runs the test script according to the test start command, so that the running test script starts monitoring software on the testing device, and starts and runs the application through the monitoring software.
The test apparatus according to claim 25, wherein

The running module further controls execution business logic of the application through the monitoring software.
The test apparatus according to claim 26, wherein

Collecting, by the monitoring module, an execution log of execution business logic of the application, and/or

The collecting module collects performance data during the running of the application by using the monitoring software.
The test apparatus according to claim 24, wherein

The collecting module further collects, by the monitoring software, data indicating whether the testing device is successfully connected to the control terminal, data indicating whether the monitoring software is successfully installed, data indicating whether the testing script is successfully started, and indication Whether the monitoring software starts successful data and data indicating whether the application is successfully started.
The test apparatus according to claim 23, wherein

The test instructions include code submission instructions for the application.
The testing device according to claim 29, further comprising: a version maintenance module, before the receiving module receives the test start command sent by the control terminal,

In a case where the application is installed on the test device, the version maintenance module guarantees that the version of the installed application is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application, or

In the case that the application is not installed on the testing device, the receiving module receives an installation package of the application and an installation instruction sent by the control terminal, and the version maintenance module utilizes the installation instruction according to the installation instruction. The application's installation package installs the application.
An application test system comprising: a control terminal and a test terminal,

The control end is configured to send, to the test terminal, a pre-stored test script for controlling the running of the application according to the test instruction; and control the test script to run on the test terminal to control the application to be Running on the test terminal;

The test terminal is configured to collect and upload operation data of the application in the test terminal to the control terminal.
The test system according to claim 31, wherein

The control end sends a test start instruction to the test terminal,

The test terminal runs the test script according to the received test start command sent by the control terminal to control the operation of the application on the test terminal.
The test system according to claim 32, wherein

The control end sends a monitoring software installation package to the test terminal,

The test terminal installs the monitoring software by using the monitoring software installation package,

The test terminal runs the test script according to the received test start command sent by the control terminal, so that the running test script starts the monitoring software on the test terminal, and is started and run by the monitoring software. The application.
The test system according to claim 31, wherein

The test instructions include code submission instructions for the application.
The test system according to claim 34, wherein before said control terminal sends a test start command to said test terminal,

In the case that the application is installed on the test terminal, the test terminal is further configured to ensure that the version of the installed application is consistent with the version indicated by the code submitted by the code submission instruction corresponding to the application; or

In the case that the application is not installed on the test terminal, the control terminal sends an installation package of the application and an installation instruction to the test terminal, and the test terminal is further configured to use the installation instruction according to the installation instruction. The installation package of the application installs the application.
A non-transitory machine-readable storage medium having stored thereon executable code that, when executed by a processor, causes the processor to perform the method of any one of claims 1 to method.