CN113553257A

CN113553257A - Test method, test device, storage medium and electronic equipment

Info

Publication number: CN113553257A
Application number: CN202110796007.9A
Authority: CN
Inventors: 杨锋
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2021-07-14
Filing date: 2021-07-14
Publication date: 2021-10-26
Anticipated expiration: 2041-07-14
Also published as: CN113553257B

Abstract

The disclosure relates to a testing method, a testing device, a storage medium and electronic equipment, which are used for realizing synchronous testing in a cross-platform multi-equipment scene and improving testing efficiency. The method comprises the following steps: obtaining a test case compiled based on a uniform standard interface of a plurality of test script terminals; sending a starting command to a server, wherein the starting command is used for indicating the server to start the automatic test scripts preset by the plurality of test script terminals and the network services related to the automatic test scripts; and sending the test cases to the plurality of test script terminals through the network service, so that each test script terminal calls a target test function in the corresponding automatic test script based on the identification parameters and the function names, and executing the target test function based on the execution parameters.

Description

Test method, test device, storage medium and electronic equipment

Technical Field

The present disclosure relates to the field of automatic testing technologies, and in particular, to a testing method, an apparatus, a storage medium, and an electronic device.

Background

The UI (User Interface) test is used to test whether the layout of the functional modules in the User Interface is reasonable, the overall style is consistent, the response of each control is correct, and the like. In the related art, UI automation test generally only supports a single application scenario, and thus, the UI automation test needs to be performed one by one for application programs running on different test devices. Specifically, corresponding test cases need to be written for different test devices, and then the application programs running on the different test devices are tested one by one through the test cases, which consumes much labor and time and cannot meet the requirement of efficient testing in a multi-device scene.

Disclosure of Invention

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

In a first aspect, the present disclosure provides a method of testing, the method comprising:

the method comprises the steps that a test case compiled based on a unified standard interface of a plurality of test pin home terminals is obtained, each test pin home terminal of the plurality of test pin home terminals is preset with an automatic test script aiming at a specified platform, different test script terminals correspond to different specified platforms, each automatic test script is used for controlling test equipment corresponding to the specified platform to perform test operation, and the test case comprises identification parameters of to-be-tested contents, function names of test functions to be executed in the automatic test scripts and execution parameters required by the test functions;

sending a starting command to a server, wherein the starting command is used for indicating the server to start an automatic test script preset by the plurality of test script local ends and a network service related to the automatic test script, and the network service is used for controlling the communication between the test script local ends and a test control end;

and sending the test cases to the plurality of test script terminals through the network service, so that each test script terminal calls a target test function in the corresponding automatic test script based on the identification parameters and the function names, and executing the target test function based on the execution parameters.

In a second aspect, the present disclosure provides a test apparatus, the apparatus comprising:

the system comprises an acquisition module, a test module and a test module, wherein the acquisition module is used for acquiring a test case compiled based on a unified standard interface of a plurality of test script terminals, each test script terminal in the plurality of test script terminals is preset with an automatic test script aiming at a specified platform, different test script terminals correspond to different specified platforms, each automatic test script is used for controlling test equipment corresponding to the specified platform to perform test operation, and the test case comprises an identification parameter of content to be tested, a function name of a test function to be executed in the automatic test script and an execution parameter required by the test function;

the starting module is used for sending a starting command to a server, the starting command is used for indicating the server to start the automatic test scripts preset by the plurality of test script local ends and the network service related to the automatic test scripts, and the network service is used for controlling the communication between the test script local ends and the test control end;

the test module is used for sending the test cases to the plurality of test script ends through the network service so that each test script end calls a target test function in the corresponding automatic test script based on the identification parameters and the function names and executes the target test function based on the execution parameters.

In a third aspect, the present disclosure provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processing apparatus, implements the steps of the method of the first aspect.

In a fourth aspect, the present disclosure provides an electronic device comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method of the first aspect.

Through the technical scheme, the test control end can obtain the test cases compiled based on the unified standard interfaces of the plurality of test script ends, each test script end is preset with the automatic test script aiming at the appointed platform, and therefore after the test cases are sent to the plurality of test script ends, each test script end can call the target test function in the corresponding automatic test script based on the test cases so as to control the test equipment of different platforms to execute the test operation. Therefore, under a cross-platform multi-device test scene, a corresponding test case does not need to be written for each device, and a unified test case can be introduced, so that the labor and time consumed under the multi-device test scene can be reduced, and the test efficiency is improved. And a network service associated with the automatic test script can be set between the test control end and the test script end, so that the communication between the test control end and the automatic test script can be ensured through the network service, and the problem of cross-platform calling of test cases is solved.

Additional features and advantages of the disclosure will be set forth in the detailed description which follows.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale. In the drawings:

FIG. 1 is a flow chart illustrating a testing method according to an exemplary embodiment of the present disclosure;

FIG. 2 is a process diagram illustrating a testing method according to an exemplary embodiment of the present disclosure;

FIG. 3 is a block diagram illustrating a test apparatus according to an exemplary embodiment of the present disclosure;

fig. 4 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units. It is further noted that references to "a", "an", and "the" modifications in the present disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

In the related art, UI automation test generally only supports a single application scenario, and thus, the UI automation test needs to be performed one by one for application programs running on different platforms. Specifically, corresponding test cases need to be written for different platforms at first, and then the application programs running on the different platforms are tested one by one through the test cases, which needs to consume much labor and time, and cannot meet the requirement of efficient testing in a cross-platform and multi-device scene. For example, in a live education scenario, the electronic devices used by different roles of the student and the teacher may be different, and platforms on which the electronic devices operate may also be different, such as windows platform, android platform, and iOS platform. In such a scenario, more than 90% of test cases need to be completed by cooperation of multiple electronic devices running with different platforms, and therefore the UI automation test framework for a single device is far from meeting the requirements.

In view of this, the embodiments of the present disclosure provide a testing method, an apparatus, a storage medium, and an electronic device, so as to implement automatic UI testing in a cross-platform and multi-device scenario, and improve testing efficiency.

FIG. 1 is a flow chart illustrating a testing method according to an exemplary embodiment of the present disclosure. Referring to fig. 1, the test method includes:

step 101, obtaining a test case compiled based on a plurality of uniform standard interfaces of a test script terminal. Each of the plurality of test script home terminals is preset with an automatic test script aiming at a specified platform, different test script terminals correspond to different specified platforms, each automatic test script is used for controlling test equipment corresponding to the specified platform to perform test operation, and a test case comprises an identification parameter of content to be tested, a function name of a test function to be executed in the automatic test script and an execution parameter required by the test function;

and 102, sending a starting command to the server, wherein the starting command is used for instructing the server to start the automatic test scripts preset by the plurality of test script terminals and the network services related to the automatic test scripts. The network service is used for controlling the communication between the test script terminal and the test control terminal;

103, sending test cases to a plurality of test script terminals through the network service, so that each test script terminal calls a target test function in the corresponding automatic test script based on the identification parameters and the function names, and executing the target test function based on the execution parameters.

Through the technical scheme, the test control end can obtain the test cases compiled based on the unified standard interfaces of the plurality of test script ends, each test script end is preset with the automatic test script aiming at the appointed platform, and therefore after the test cases are sent to the plurality of test script ends, each test script end can call the target test function in the corresponding automatic test script based on the test cases so as to control the test equipment corresponding to different test platforms to execute the test operation. Therefore, under the cross-platform multi-device test scene, the corresponding test case does not need to be written for each device, and the unified test case can be introduced, so that the labor and time consumed under the multi-device test scene can be reduced, and the test efficiency is improved. And a network service associated with the automatic test script can be set between the test control end and the test script end, so that the communication between the test control end and the automatic test script can be ensured through the network service, and the problem of cross-platform calling of test cases is solved.

The following is a detailed illustration of the various steps described above in order to provide a better understanding of the testing methods provided by the present disclosure to those skilled in the art.

It should be understood at first that, the test devices of different platforms refer to that the operating systems of the test devices are different, so that the automatic test scripts preset at multiple test script terminals may be set for the operating systems of the test devices to implement the targeted test operation on the test devices. In addition, in order to synchronously test a plurality of test devices of different platforms and improve the test efficiency, a plurality of test script ends can externally package a unified interface, the unified interface is used for abstracting the automation capacity which is set for realizing the same function for different test script ends, so as to shield the difference realized by the same function on the automatic test scripts preset by different test script ends, thereby calling the unified interface through the same test case, each test script end can call a target test function in the corresponding automatic test script based on the transmitted test case, and further controlling the corresponding test device to execute the test operation.

For example, for a login test of the same application program running on a plurality of test devices, the types of login interfaces are different because the operating systems of the plurality of test devices are different. According to the mode provided by the disclosure, firstly, a Login function can be defined in an automatic test script preset at a plurality of test script ends, parameters comprise a Login parameter Account used for representing a Login Account and a verification parameter Code used for representing a Login verification Code, and a return value can be set to be a Boolean type used for indicating Login success or Login failure. The method comprises the steps that the automatic operation is logged on each test device, and the login interface is named logic _ page in a unified mode.

In this case, a Login test case is compiled according to the unified specification interface of the multiple test script terminals, where the Login test case may include an identification parameter logic _ page of the content to be tested, a function name Login of a test function to be executed in the automatic test script, and an execution parameter account and code required by the test function. Then, according to the identification parameter Login _ page, all test functions corresponding to the page to be tested are determined in the automatic test script corresponding to each test device, and then a target test function can be determined in all test functions corresponding to the page to be tested according to the function name Login. Finally, the Login function may be executed based on the execution parameters account and code. Therefore, after the test control end sends the test cases compiled according to the unified standard interface to the test script, the test script end can call the corresponding functions in the corresponding automatic test scripts to execute test operation, synchronous test on a plurality of devices is achieved, manpower and time consumed in the test process are reduced, and test efficiency is improved.

In a possible manner, a test case set written based on a unified specification interface of a plurality of test script terminals may be obtained, where the test case set includes a plurality of groups of test cases for executing different test operations, each group of test cases has a sequence identifier, and the sequence identifier is used to specify an execution sequence of the test operations. Correspondingly, the test case sets can be sent to the multiple test script terminals through the network service, so that each test script terminal calls multiple test functions in the corresponding automatic test script based on multiple identification parameters and multiple function names in the test case sets, and sequentially executes the multiple test functions based on the sequence identification to control the corresponding test equipment to execute multiple test operations.

It should be understood that, in the related art, automation test cases for different platforms generally use automation frames corresponding to the respective platforms, and automation UI operations are directly combined in the test cases to form one automation test case. Because the test case is determined for the platform, the automatic test case can only complete the automation operation defined in the automatic test case in series on a single device corresponding to the platform, and cannot meet the test requirement in a cross-platform multi-device scene.

In the embodiment of the disclosure, a test case set including a plurality of groups of test cases may be obtained, and then after the test case set is sent to a plurality of test case home terminals through a network service, each test case home terminal may call a plurality of test functions in a corresponding automatic test script based on a plurality of identification parameters and a plurality of function names in the test case set, and sequentially execute the plurality of test functions based on a sequence identification corresponding to each test case in the test case set, so that a corresponding test device may be controlled to execute a plurality of test operations in series, that is, the test device may be controlled to execute a series of customized automation operations, manpower and time consumed in a test process are reduced, and test efficiency is improved.

For example, multiple groups of test cases in the test case set can be transmitted to the test trigger function of the corresponding test page class in the form of the function block, so that a user can arbitrarily combine UI operation interfaces in the function block, and the UI operation interface combination in the function block can be changed without rewriting a test script under the condition that the test logic is changed, thereby reducing the labor and time consumed in the test process and improving the test efficiency.

In a possible mode, the test case may correspond to a concurrent extension function, and the concurrent extension function is used for controlling a plurality of test script terminals to call corresponding test functions in corresponding automatic test scripts in a multi-thread manner.

It should be understood that, for automated testing in a cross-platform multi-device scenario, operations in the same scenario need to be performed on multiple devices at the same time, for example, a live education scenario, operations for all students on different platforms to enter a classroom, and the like need to be performed at the same time. In order to adapt to the problems of automation execution efficiency and convenience in the scene, the automatic test case in the scene can be further optimized.

For example, a concurrent extension function may be set for the test case, so that concurrent test operations on multiple test devices are implemented through the concurrent extension function. The concurrent extension function can be used for multithreading to control a plurality of test script terminals to call corresponding test functions in corresponding automatic test scripts, so that based on the concurrent extension function, multithreading can be started to call a plurality of test functions concurrently, and corresponding test equipment can be controlled to execute a plurality of test operations concurrently.

It should be understood that the concurrent extension function may adopt a template function normalized form to realize code reuse, further reducing the manpower and time consumed in the test process, thereby improving the test efficiency.

In a possible mode, the test case can be converted into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control end and the plurality of test script ends, and a target test case is obtained. Accordingly, the target test case can be sent to the corresponding test script end through the network service associated with each automatic test script.

In the embodiment of the disclosure, in order to implement the cross-platform multi-device test, a test case is written according to the unified standard interface of the plurality of test script local ends. However, in practical applications, the specific data form and/or the specific number of parameters of the test case required by the automatic test script preset in each test script terminal may be different. Therefore, in order to more efficiently execute the automatic test based on the test cases and the automatic test scripts at the test script end, the test cases can be converted into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control end and the test script ends to obtain a target test case.

For example, the single interface parameter rule is set for parameters required by the automatic test script in each test script terminal, so that the test case is converted based on the single interface rule to obtain a target test case, and the target test case may correspond to each automatic test script one to one. And then, the target test case can be sent to the corresponding test script end through the network service associated with each automatic test script, so that the test script end can quickly realize automatic test according to the target test case and the automatic test script which are matched with each other, and the automatic test efficiency is improved.

In a possible manner, the identification information and the network connection information of the test device may also be registered to the device status server for each test device through a corresponding automatic test script. Correspondingly, the target test equipment in the connection state can be determined through the equipment state server, the target automatic test script for controlling the target test equipment to perform test operation is determined, and then the test case is sent to the test script end with the preset target automatic test script through the network service.

For example, after the test case is obtained, a corresponding number of test devices and corresponding network services may be activated. For example, a start command may be sent to the chassis server, the chassis server may start a plurality of Docker services after receiving the command, and each Docker service may start an automatic test script preset by the test script end and a network service associated with the automatic test script. The automatic test script is an automatic test script for different platforms, so that the automatic test script can automatically acquire a test device corresponding to an operating system and keep control over the test device. The network service is started and simultaneously registers the identification information and the network connection information of the test equipment to the equipment state server through the test equipment, such as registering the equipment ID and the IP address of the test equipment to the equipment state server.

Thereafter, the state of the test equipment may be confirmed, completing the pre-test preparation. For example, this stage may determine whether a test device registered in the device state server is online, and may delete from the device state server for test devices that are registered but not online. For the online test device, that is, the target test device in the connection state is determined, a target automatic test script for controlling the target test device to perform the test operation may be further determined, and then the test case is sent to the plurality of test script terminals through the network service. In addition, before the test case is sent, the target test equipment can be subjected to prepositive operations such as starting an application program to be tested, logging in an account and the like, so that after the test case is received, automatic test can be directly executed based on the test case, and the test efficiency is improved.

In a possible manner, sending the test case to the test script end through the network service may also be: the method comprises the steps of firstly determining a page base class packaged in advance, wherein the page base class comprises a test trigger function, the reference of the test trigger function comprises a first reference for representing identification information of a page to be tested, a second reference for representing identification information of the test function to be executed and a third reference for representing execution parameters required by the test function to be executed, then determining a test page class inherited from the page base class aiming at the page to be tested, taking the identification parameters, the function name and the execution parameters as the reference, calling the test trigger function of the test page class, and finally sending a test case to a test script terminal through the test trigger function and a network service.

In a possible manner, the page base class may be obtained by: and under the condition that the test script end and the test control end carry out socket communication, packaging each automatic test script in the test script end as a socket server end to obtain a socket entity class, and carrying out abstract packaging on the common attributes of the socket entity class based on the page object model to obtain a page base class.

It should be understood that the embodiment of the present disclosure needs to define UI automation tests in a multi-device interaction scenario, and therefore, each test script may be used as a Server instead of a Client. Therefore, each test script end starts the automatic test script, and after the automatic test script controls the test equipment, the test script end can be used as a Server to wait for communication messages transmitted by the test control end, such as transmitted test cases and the like, so that synchronous automatic test of a plurality of test equipment is realized.

For example, the test control end and the test script end may perform Socket communication, and in this case, each automatic test script in the test script end may be packaged as a Socket server end to obtain a Socket entity class. Taking a multi-device interaction scene in an educational live broadcast scene as an example, a student socket class can be packaged and realized, and automatic test scripts for different operating systems can be associated with one physical device under the operating system, for example, the automatic test scripts can be a windows student terminal, an iOS student terminal, or an android student terminal, and each automatic test script can be associated with one socket server during running. In the embodiment of the present disclosure, each Socket server may be abstracted uniformly at the test control end into a Socket entity class that needs to communicate, that is, each automatic test script in the test script end is encapsulated as a Socket server end, so as to obtain a Socket entity class.

Illustratively, the inside of the Socket entity class mainly needs to define the variables shown in table 1. It should be understood that the variables shown in table 1 are common variables required in the socket communication process, and are not described here again:

TABLE 1

Variable names	Type (B)	Means of
			name	String	Indicating the identity of a test device
ip	String	IP address of automatic test script Server end
			port	String	Port of automatic test script Server end
socket	Socket type	Socket connection object of test control end and automatic test script Server end
			inputStream	InputStream	Input stream corresponding to variable socket for reading in communication process
outputStream	OutputStream	Output stream corresponding to variable socket and used for reading in communication process

In order to implement synchronous testing of multiple test devices, in addition to the variables shown in table 1, the interface shown in table 2 may be encapsulated in a Socket entity class.

TABLE 2

The abstracted Socket entity class can be packaged and abstracted to form a page base class BasePage layer based on the page object model, the BasePage layer serves as a base class of each page in the page object model to hold a Socket entity class object, and an Invoke method and a screen shot method are provided. For example, the variable definition of the page base class can be as shown in Table 3, and the method definition of the page base class can be as shown in Table 4.

TABLE 3

TABLE 4

Exemplarily, referring to table 4, a corresponding UI operation interface function packaged at the test script end may be remotely called through an invoke issuing command, so that through the normalization of interface consistency, the automated operation with the same cross-platform calling function may be realized. In addition, it should be understood that the params parameter and the function return value are designed to be of any type, so that the expansibility and the usability of the interface can be improved.

For example, in the Login test in the above example, an operation page of Login may be defined at the test script end to inherit from the encapsulated page base class BasePage, where the parameters are account and code, and are consistent with the Login interface definitions of each test script end, and the return values are also consistent, so that an invoke function (i.e., a test trigger function) of the test page class may be called, and a list formed by combining the account and the code and the timeout time of the operation are introduced as the parameter mehod and the params. Therefore, after the test case is sent to the test script end through the invoke function, each test script end can call the corresponding login function in the corresponding automatic test script according to the test case to perform login test. For example, the test script end may preset a corresponding test processing function, in which a test case transmitted through the test control end is used as a reference, and is routed to a corresponding page to be tested, and the test script end calls a test function packaged in the corresponding automatic test script in a reflection manner. And then, the result of the reflection call, namely the test result, can be returned to the test control end.

For example, referring to table 4, the page base class may further include a test result function screen, where the test result function is used by the test script terminal to perform a screenshot operation on the test device after the test device performs the test operation. Correspondingly, after the test page class inherited from the page base class is determined, a user-defined screenshot parameter can be obtained, the user-defined screenshot parameter is used as a reference, a test result function of the test page class is called to indicate a test script terminal to perform screenshot operation on the test equipment after the test equipment performs test operation, a target screenshot used for representing the test result is obtained, and then the test control terminal can receive the target screenshot sent by the test script terminal through the network service. Therefore, the test result can be captured and returned to the test control end, the test control end can conveniently integrate the test results of the plurality of test devices and can conveniently display the test results in a unified manner, and a user can conveniently check the test results of the plurality of test devices.

By the method, the contents to be tested corresponding to each test device can be abstractly packaged into different test page classes based on the page base class packaged in advance, so that the test case is sent to the test script terminal by calling the test trigger function of the test page class. The test page class inherits from the page base class, and each test script end is provided with a uniform interface aiming at the corresponding parameter of the page base class, so that each test script end can be uniformly scheduled to control the test equipment to test through the test trigger function of the test page class, synchronous test under a multi-equipment scene is realized, and the test efficiency is improved.

The test method provided by the present disclosure is explained below by another exemplary embodiment.

Referring to fig. 2, first, a test case is compiled based on the unified specification interfaces of a plurality of test script terminals. Taking an education live broadcast scene as an example, a teacher and a student use different application programs, the application programs run under different platforms and have different implementation logics, but page display and control operation in the same application program are unified. In this case, two test page classes of the teacher end and the student end can be packaged, and a plurality of test sub-pages and test operations can be packaged under each test page class. In the process of writing the test case, the test case set can be obtained only by specifying the execution flow of each test operation under different test page types.

After the test case set is obtained, the slave machine may be activated, so as to activate the corresponding number of test devices and the corresponding network services. For the specific process, reference may be made to the above description, which is not repeated here. After that, the test equipment may be initialized, i.e., the state of the test equipment may be confirmed, and the preparation before the test is completed. For the specific process, reference may be made to the above description, which is not repeated here.

Next, an interface guarantee mechanism may be set for the test case, a retry mechanism may be added for the test case returned as a false error, and functions such as an exception receiving and exception screenshot function of each test device may be encapsulated for problem troubleshooting. In addition, parameters included in the test case set can be converted into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control end and the plurality of test script ends, and a target test case set is obtained.

Finally, the target test case set can be issued. For example, the target test case set may be issued to the network layer of each test script terminal through the network layer of the test control terminal. And after receiving the target test case set, the network layer of each test script end controls the corresponding automatic test script to execute and call the corresponding target test function, and further controls the corresponding test equipment to execute the test operation corresponding to the target test function. After the test operation is completed, the returned field, exception, screenshot information and the like can be returned to the test control terminal. It should be understood that, in the embodiment of the present disclosure, during the test execution, the test script terminal serves as a communication Server terminal, and during the device state registration and the test result feedback, the test script terminal serves as a communication Client terminal.

By the mode, the test control end can obtain the test cases compiled according to the uniform interface, and then the corresponding test functions in the corresponding automatic test scripts are called through the same test case, so that synchronous test under a multi-device scene can be realized, and the test efficiency is improved.

Based on the same inventive concept, the present disclosure also provides a testing device, which can be a part or all of an electronic device through software, hardware or a combination of both. Referring to fig. 3, the test apparatus 300 includes:

an obtaining module 301, configured to obtain a test case compiled based on a unified standard interface of multiple test leg home terminals, where each test leg home terminal in the multiple test leg home terminals is preset with an automatic test script for a specified platform, and different test script terminals correspond to different specified platforms, each automatic test script is used to control a test device corresponding to a specified platform to perform a test operation, and the test case includes an identification parameter of content to be tested, a function name of a test function to be executed in the automatic test script, and an execution parameter required by the test function;

a starting module 302, configured to send a starting command to a server, where the starting command is used to instruct the server to start an automatic test script preset by the multiple test script bases and a network service associated with the automatic test script, where the network service is used to control communication between the test script bases and the test control terminal;

the test module 303 is configured to send the test case to the multiple test script ends through the network service, so that each test script end calls a target test function in a corresponding automatic test script based on the identification parameter and the function name, and executes the target test function based on the execution parameter.

Optionally, the apparatus 300 further comprises:

the conversion module is used for converting parameters included in the test case into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control end and the plurality of test script ends to obtain a target test case;

the test module 303 is configured to:

and sending the target test case to a corresponding test script end through the network service associated with each automatic test script.

Optionally, the apparatus 300 further comprises:

the registration module is used for registering the identification information and the network connection information of the test equipment to an equipment state server through the corresponding automatic test script aiming at each test equipment;

the test module 303 is configured to:

determining target test equipment in a connection state through the equipment state server, and determining a target automatic test script for controlling the target test equipment to perform test operation;

and sending the test case to a test script end preset with the target automatic test script through the network service.

Optionally, the obtaining module 301 is configured to:

acquiring a test case set compiled based on a uniform standard interface of a plurality of test feet, wherein the test case set comprises a plurality of groups of test cases for executing different test operations, each group of test cases is provided with a sequence identifier, and the sequence identifier is used for designating the execution sequence of the test operations;

the test module 303 is configured to:

and sending the test case sets to the plurality of test script ends through the network service so that each test script end calls a plurality of test functions in the corresponding automatic test script based on a plurality of identification parameters and a plurality of function names in the test case sets, and sequentially executing the plurality of test functions based on the sequence identification so as to control the corresponding test equipment to execute a plurality of test operations.

Optionally, the test case corresponds to a concurrent extension function, and the concurrent extension function is used for controlling the multiple test script terminals to call the corresponding test functions in the corresponding automatic test scripts in a multi-thread manner.

Optionally, the test module 303 is configured to:

determining a page base class packaged in advance, wherein the page base class comprises a test trigger function, and the entry of the test trigger function comprises a first entry for representing the identification information of a page to be tested, a second entry for representing the identification information of the test function to be executed and a third entry for representing the required execution parameter of the test function to be executed;

determining a test page class inherited from the page base class aiming at the page to be tested, taking the identification parameter, the function name and the execution parameter as input parameters, and calling a test trigger function of the test page class;

and sending the test cases to the plurality of test script terminals through the test trigger function and the network service.

Optionally, the apparatus 300 further comprises:

and the packaging module is used for packaging each automatic test script in the test script end as a socket server under the condition that the test script end and the test control end carry out socket communication to obtain a socket entity class, and carrying out abstract packaging on the common attribute of the socket entity class based on a page object model to obtain the page base class.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Based on the same inventive concept, the disclosed embodiments also provide a non-transitory computer-readable storage medium, on which a computer program is stored, which, when executed by a processing device, implements the steps of any of the above-described test methods.

Based on the same inventive concept, an embodiment of the present disclosure further provides an electronic device, including:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to implement the steps of any of the above-described test methods.

Referring now to FIG. 4, a block diagram of an electronic device 400 suitable for use in implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 4, electronic device 400 may include a processing device (e.g., central processing unit, graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage device 408 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.

Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 408 including, for example, tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 409, or from the storage device 408, or from the ROM 402. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 401.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the communication may be performed using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: the method comprises the steps that a test case compiled based on a unified standard interface of a plurality of test pin home terminals is obtained, each test pin home terminal of the plurality of test pin home terminals is preset with an automatic test script aiming at a specified platform, different test script terminals correspond to different specified platforms, each automatic test script is used for controlling test equipment corresponding to the specified platform to perform test operation, and the test case comprises identification parameters of to-be-tested contents, function names of test functions to be executed in the automatic test scripts and execution parameters required by the test functions; sending a starting command to a server, wherein the starting command is used for indicating the server to start an automatic test script preset by the plurality of test script local ends and a network service related to the automatic test script, and the network layer is used for controlling the communication between the test script local ends and a test control end; and sending the test cases to the network services of the plurality of test script terminals, so that each test script terminal calls a target test function in the corresponding automatic test script based on the identification parameters and the function names, and executes the target test function based on the execution parameters.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The modules described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the name of a module in some cases does not constitute a limitation on the module itself.

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

Example 1 provides, in accordance with one or more embodiments of the present disclosure, a testing method, the method comprising:

Example 2 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

converting parameters included in the test case into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control terminal and the plurality of test script terminals to obtain a target test case;

the sending the test case to the network layer of the plurality of test script terminals through the network service includes:

Example 3 provides the method of example 1, further comprising, in accordance with one or more embodiments of the present disclosure:

for each test device, registering the identification information and the network connection information of the test device to a device state server through the corresponding automatic test script;

Example 4 provides the method of any one of examples 1 to 3, wherein obtaining the test case written based on the unified specification interfaces of the multiple test scripts comprises:

the sending the test case to the plurality of test script terminals through the web service so that each test script terminal calls a target test function in a corresponding automatic test script based on the identification parameter and the function name and executes the target test function based on the execution parameter includes:

and sending the test case sets to the plurality of test script ends through the network service so that each test script end calls a plurality of test functions in the corresponding automatic test script based on a plurality of identification parameters and a plurality of function names in the test case sets, and sequentially executing the test functions based on the sequence identification.

Example 5 provides the method of example 4, the test case corresponding to a concurrent extension function for multithreading control of the plurality of test script ends to call the corresponding test function in the corresponding automatic test script, according to one or more embodiments of the present disclosure.

Example 6 provides the method of any one of examples 1 to 3, wherein sending the test case to the plurality of test script terminals through the web service, according to one or more embodiments of the present disclosure, includes:

Example 7 provides the method of example 6, the page base class obtained by:

and under the condition that the test script end and the test control end carry out socket communication, packaging each automatic test script in the test script end as a socket server end to obtain a socket entity class, and carrying out abstract packaging on the common attributes of the socket entity class based on a page object model to obtain the page base class.

Example 8 provides, in accordance with one or more embodiments of the present disclosure, a test apparatus, the apparatus comprising:

Example 9 provides a non-transitory computer-readable storage medium having stored thereon, a computer program that, when executed by a processing device, implements the steps of the method of any of examples 1-7, in accordance with one or more embodiments of the present disclosure.

Example 10 provides, in accordance with one or more embodiments of the present disclosure, an electronic device comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method of any of examples 1-7.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Claims

1. A method of testing, the method comprising:

2. The method of claim 1, further comprising:

converting parameters in the test cases into parameters required by each automatic test script based on a single interface parameter rule predefined between the test control end and the plurality of test script ends to obtain target test cases;

the sending the test case to the plurality of test script terminals through the network service includes:

3. The method of claim 1, further comprising:

4. The method according to any one of claims 1 to 3, wherein the obtaining of the test case written based on the unified specification interfaces of the plurality of test script terminals includes:

5. The method of any of claims 1-3, wherein the test cases correspond to concurrent extension functions, and the concurrent extension functions are used for controlling the multiple test script terminals to call corresponding test functions in corresponding automatic test scripts in a multi-thread manner.

6. The method according to any one of claims 1-3, wherein said sending the test case to the plurality of test script terminals through the web service comprises:

and sending the test case to the test script end through the test trigger function and the network service.

7. The method of claim 6, wherein the page base class is obtained by:

8. A test apparatus, the apparatus comprising:

9. A non-transitory computer readable storage medium, having stored thereon a computer program, characterized in that the program, when executed by a processing device, implements the steps of the method of any one of claims 1-7.

10. An electronic device, comprising:

a storage device having a computer program stored thereon;

processing means for executing the computer program in the storage means to carry out the steps of the method according to any one of claims 1 to 7.