CN112231199A

CN112231199A - Test method and device for object to be tested and test system

Info

Publication number: CN112231199A
Application number: CN201910639512.5A
Authority: CN
Inventors: 杜兴文; 王哲
Original assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Jingdong Shangke Information Technology Co Ltd
Current assignee: Beijing Jingdong Century Trading Co Ltd; Beijing Jingdong Shangke Information Technology Co Ltd
Priority date: 2019-07-15
Filing date: 2019-07-15
Publication date: 2021-01-15

Abstract

The present disclosure provides a test method for an object to be tested, comprising: obtaining a test case; running the test case to obtain operation information to be sent to the terminal equipment, wherein the operation information indicates the operation to be executed by the terminal equipment on an operable object aiming at the object to be tested; receiving a first working parameter of an object to be tested from a detection device; and generating a test report of the object to be tested according to the first working parameter. Wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation. The present disclosure also provides a test device for an object to be tested and a test system.

Description

Test method and device for object to be tested and test system

Technical Field

The present disclosure relates to the field of information technology, and more particularly, to a test method and apparatus for an object to be tested, and a test system.

Background

With the popularization and deepening of the technology of the internet of things, the human society is entering a new era of 'everything interconnection', and with the rapid development of the internet of things, new products of the internet of things are continuously researched and developed. With the access of thousands of items of internet of things equipment, enormous workload is added to product testers.

In the course of implementing the disclosed concept, the inventors found that there are at least the following technical problems in the prior art: the test of the products of the internet of things usually relates to functional test and performance test, and the existing test method usually needs deep participation of testers and is complex in test process. Moreover, the existing testing technology has no formed frame structure, the application range is narrow, and a testing method needs to be established for each type of products.

Disclosure of Invention

In view of this, the present disclosure provides a testing method and apparatus for an object to be tested, and a testing system, which can improve testing efficiency and have a high degree of automation.

One aspect of the present disclosure provides a testing method for a subject to be tested, the method comprising: obtaining a test case; running the test case to obtain operation information to be sent to the terminal equipment, wherein the operation information indicates the operation to be executed by the terminal equipment on an operable object aiming at the object to be tested; receiving a first working parameter of an object to be tested from a detection device; and generating a test report of the object to be tested according to the first working parameter. Wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation.

Optionally, the test method for the object to be tested further includes, before running the test case: acquiring engineering codes from a predetermined space in response to receiving the test task; and compiling the engineering codes by adopting a compiler so as to construct a test environment for providing support for running the test cases. Wherein the test task is received in response to a trigger operation to execute the test task; the test task is matched with an object to be tested; and the test case includes a test script that executes the test task.

Optionally, the test script includes: a first test script which is uniquely matched with an object to be tested is acquired from a first storage layer; and a second test script matching with the plurality of test objects is acquired from the second storage layer. Wherein the plurality of test objects includes an object to be tested.

Optionally, the testing method for a subject to be tested further includes: acquiring input parameter information, wherein the input parameter information comprises input parameters of a test case; and running the test case based on the input parameter information to obtain the operation information to be sent to the terminal equipment.

Optionally, the input parameter information further includes user information; the test method for the object to be tested further includes: and sending a test report of the object to be tested to a server aiming at the user information according to the user information.

Optionally, the testing method for the object to be tested further includes, after obtaining the operation information to be sent to the terminal device: acquiring state information of an operable object after the completion operation is executed; and determining a second working parameter of the object to be tested according to the state information. Wherein the test report is generated based on the first operating parameter and the second operating parameter.

Optionally, the object to be tested includes a smart device, and the operable object includes a control included in a client application for the smart device.

Another aspect of the present disclosure provides a testing device for a subject to be tested, including: the case acquisition module is used for acquiring a test case; the case running module is used for running the test case to obtain operation information to be sent to the terminal equipment, and the operation information indicates the operation to be executed by the terminal equipment on the operable object aiming at the object to be tested; the working parameter receiving module is used for receiving a first working parameter of the object to be tested from the detection device; and the test report generating module is used for generating a test report of the object to be tested according to the first working parameter. Wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation.

Another aspect of the present disclosure also provides a test system, including: the terminal equipment is provided with a client application aiming at the object to be tested, the client application comprises at least one control, and the terminal equipment is used for responding to the operation of any one control in the at least one control and controlling the working state of the object to be tested; the detection device is used for detecting a first working parameter of the object to be tested; and the testing device is in communication connection with the terminal equipment and the detection device, is provided with a testing framework and is used for executing the testing method for the object to be tested.

Optionally, the testing device is provided with a main thread and a sub-thread, and the testing framework comprises a continuous integration tool installed with a project management plug-in. The continuous integration tool is used for generating a test task based on the project management plug-in and generating a trigger operation for executing the test task; the main thread is used for responding to the triggering operation of executing the testing task and sending the testing task to the sub-thread aiming at the testing task. The child threads are used to: acquiring engineering codes from a predetermined space in response to receiving the test task; and compiling the engineering codes by adopting a compiler so as to construct a test environment for providing support for running the test cases. The test task is matched with the object to be tested, and the test case comprises a test script for executing the test task.

Optionally, the test framework includes an open source tool for testing, which is integrated in the persistent integration tool, the project management plug-in and the use case execution framework, and the test framework is provided with a first storage tier and a second storage tier. The first storage layer stores a first test script which is uniquely matched with the object to be tested, and the second storage layer stores a second test script which is matched with the plurality of test objects. The use case execution framework is to: acquiring a first test script aiming at a test task from a first storage layer, and acquiring a second test script aiming at the test task from a second storage layer to obtain a test case; and running the test case, and calling the test open source tool to obtain the operation information to be sent to the terminal equipment. Wherein the plurality of test objects includes an object to be tested.

Another aspect of the present disclosure provides an electronic device comprising one or more processors; and a storage device for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the above-described testing method with an object to be tested.

Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause the processor to perform the above-described testing method with an object to be tested.

Another aspect of the present disclosure provides a computer program comprising computer executable instructions for implementing the above-described testing method with an object to be tested when executed.

The test method of the embodiment of the disclosure can realize the operation of the operable object of the terminal device by running the case, thereby controlling the working state of the object to be tested, and automatically generating the test report by receiving the working parameters of the terminal device from the object to be tested. Therefore, the test method can realize the automatic test of the whole flow, thereby improving the test efficiency and saving the test cost.

Drawings

For a more complete understanding of the present disclosure and the advantages thereof, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:

fig. 1 schematically illustrates a test method and apparatus for an object to be tested, and an application scenario of a test system according to an embodiment of the present disclosure;

FIG. 2 schematically illustrates a structural schematic of a test system according to an embodiment of the present disclosure;

FIG. 3 schematically illustrates a structural schematic of a test frame according to an embodiment of the disclosure;

FIG. 4 schematically shows a flow chart of a testing method for an object to be tested according to a first illustrative embodiment of the present disclosure;

FIG. 5 schematically shows a flow chart of a testing method for an object to be tested according to a second exemplary embodiment of the present disclosure;

FIG. 6 schematically shows a flow chart of a testing method for an object to be tested according to a third exemplary embodiment of the present disclosure;

FIG. 7 schematically shows a flow chart of a testing method for a subject to be tested according to a fourth exemplary embodiment of the present disclosure;

FIG. 8 schematically illustrates a flow chart for automated testing of an object under test in a particular application scenario;

FIG. 9 schematically shows a block diagram of a test apparatus for a subject to be tested according to an embodiment of the present disclosure; and

fig. 10 schematically shows a block diagram of an electronic device adapted to perform a testing method for an object to be tested according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

Some block diagrams and/or flow diagrams are shown in the figures. It will be understood that some blocks of the block diagrams and/or flowchart illustrations, or combinations thereof, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the instructions, which execute via the processor, create means for implementing the functions/acts specified in the block diagrams and/or flowchart block or blocks. The techniques of this disclosure may be implemented in hardware and/or software (including firmware, microcode, etc.). In addition, the techniques of this disclosure may take the form of a computer program product on a computer-readable storage medium having instructions stored thereon for use by or in connection with an instruction execution system.

An embodiment of the present disclosure provides a test method for a subject to be tested, the method including: firstly, obtaining a test case; and then, running the test case to obtain operation information to be sent to the terminal equipment, wherein the operation information indicates the operation to be executed on the operable object aiming at the object to be tested by the terminal equipment. Then, a first working parameter of the object to be tested from the detection device is received. And finally, generating a test report of the object to be tested according to the first working parameter. Wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation.

Fig. 1 schematically shows an application scenario diagram of a test method and apparatus for an object to be tested, and a test system according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, an application scenario 100 of the present disclosure includes a first terminal device 101, a second terminal device 102, and a network 103. The network 103 is used to provide a medium for a communication link between the first terminal apparatus 101 and the second terminal apparatus 102. Network 103 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The first terminal device 101 may be, for example, various electronic devices with processing functions, and may include, but are not limited to, a computer cluster, a desktop computer, a laptop portable computer, a tablet computer, a smart phone, or the like. The second terminal device 102 may be, for example, an electronic device capable of installing various client applications, which may include, but is not limited to, a desktop computer, a laptop portable computer, a tablet computer, a smart phone, a smart wearable device, a smart speaker, or the like, for example.

For example, a test frame may be integrated in the first terminal device 101, and is used to implement control over a UI (User Interface) control of a client application installed in the second terminal device 102 through interaction with the second terminal device 102, so as to implement automated testing of the client application.

According to an embodiment of the present disclosure, as shown in fig. 1, the application scenario 100 may further include a database server 104, and the database server 104 may be, for example, a database for storing codes. The first terminal device 101 obtains engineering code from the database server 104 through the network 103 so as to provide a running environment for the automated testing.

According to an embodiment of the present disclosure, as shown in fig. 1, the application scenario 100 may further include a detection apparatus 105 and a smart device 106. For example, a client application matched with the smart device 106 may be installed in the second terminal device 102 to implement intelligent control on the smart device 106.

The smart device 106 may include, for example, a smart light device or a smart household appliance device. The detection device 105 is in communication connection with the first terminal device 101, and the detection device 105 is configured to detect an operating state of the smart device 106 and send the operating parameters to the first terminal device 101. The first terminal device 101 may also control a client application installed in the second terminal device 102 and matched with the smart device 106 through interaction with the second terminal device 102, so as to control the second terminal device 102 to send a control instruction to the cloud, and forward the control instruction to the smart device 106 via the cloud, thereby controlling the operating state of the smart device 106. With the above arrangement, the first terminal device 101 can realize control over the intelligent device 106 via the second terminal device 102, thereby realizing automatic testing of the intelligent device 106.

It should be noted that the testing method for the object to be tested provided by the embodiment of the present disclosure may be generally executed by the first terminal device 101. Accordingly, the testing method for the object to be tested provided by the embodiment of the present disclosure may be generally disposed in the first terminal device 101.

It should be understood that the number and types of first terminal device, second terminal device, detection device, and smart device in fig. 1 are merely illustrative. The first terminal device, the second terminal device, the detection device and the intelligent device can be any type and number according to implementation requirements.

To enable testing of a smart device 106 as in fig. 1, the disclosed embodiments provide a testing system.

Fig. 2 schematically shows a structural schematic diagram of a test system according to an embodiment of the present disclosure.

As shown in fig. 2, the test system of the embodiment of the present disclosure includes: a terminal device 210, a detection means 220 and a test means 230.

According to the embodiment of the present disclosure, the terminal device 210 is installed with a client application for the object to be tested, where the client application includes at least one control, and is configured to control the working state of the object to be tested in response to an operation on any one of the at least one control. The terminal device 210 may be, for example, the second terminal device 102 described in fig. 1, the object to be tested may be, for example, the smart device in fig. 1, and the client application is an application for the smart device, so as to control an operating state of the smart device through an operation on a space of the client application.

The detecting device 220 is used for detecting a first operating parameter of the object to be tested.

According to an embodiment of the present disclosure, the detection device 220 may be matched to an object to be tested, for example. When the object to be tested is a smart lamp device, the detection device 220 may be, for example, a detection device integrated with a light sensor, so as to detect an operating parameter of the smart lamp device. It is understood that the above-mentioned type of the detecting device 220 is only used as an example to facilitate understanding of the present disclosure, and the detecting device 220 may be integrated with different sensors, such as a temperature sensor, a pressure sensor, etc., according to actual needs.

According to an embodiment of the present disclosure, when the detection device 220 is a detection device integrated with a light sensor, the detection device may employ a chip of BH1750FVI for detecting light intensity, for example, and the light sensor may have a built-in 16-bit analog-to-digital converter. The detection device supports a light source which does not distinguish the environment, and has light splitting characteristics close to visual sensitivity. It is to be understood that the chip and transducer type employed by the detection device 220 are merely examples to facilitate understanding of the present disclosure, and the present disclosure is not limited thereto.

The testing device 230 is in communication connection with the terminal device 210 and the detecting device 220. The test device 230 may be integrated in the first terminal apparatus 101 in fig. 1, for example.

According to the embodiment of the present disclosure, the detection apparatus 220 may be inserted into a port (Socket) provided in the first terminal device 101 through a data line (e.g., a USB data line), so as to achieve the instant connection between the detection apparatus 220 and the test apparatus 230. Thereby providing conditions for operation and data communication between the detection device 220 and the test device. The detecting device 220 may calculate the brightness value and the color value in real time according to the detected brightness and color change, and transmit the test result data to the testing device 230 through the data line.

According to an embodiment of the present disclosure, the testing device 230 may be installed with a testing architecture, for example, to execute a testing task for testing an object to be tested through the testing architecture. The testing personnel can configure the testing task through the testing framework, and the testing framework can respond to the triggering operation of executing the testing task and automatically acquire the pre-stored testing script matched with the testing task. By running the test script, the operation of the control in the client application for the object to be tested in the terminal equipment can be simulated, so that the working state of the intelligent equipment is controlled. According to the actual working state of the intelligent equipment detected by the simulation operation and detection device, the result of whether the object to be tested can work normally can be obtained, and a test report for the object to be tested is generated according to the result.

In summary, the test system according to the embodiment of the disclosure can respond to the trigger operation of executing the test task by setting the detection device and the test device, thereby realizing the automatic test of the intelligent device. The whole process can be free of human intervention, so that the detection efficiency and the detection precision can be improved.

Fig. 3 schematically shows a structural schematic of a test frame according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, as shown in FIG. 3, the test framework 300 may include a persistent integration tool with a project management plug-in 310 installed. The continuous integration tool is used for generating a test task based on the project management plug-in and generating a trigger operation for executing the test task.

Consistent integration tools may include Jenkins, Team City, or Travis CI, for example, or the like, according to embodiments of the present disclosure. Jenkins is an open source software project, is a continuous integration tool developed based on Java, is used for monitoring continuous and repeated work, and aims to provide an open and easy-to-use software platform to enable continuous integration of software to be possible. When a task is created in Jenkins, the types are: a multi-configuration project (built multi-configuration project) is constructed, which is a powerful application that allows for continuous integration and continuous delivery of items. The triggering operation of executing the test task generated by the persistent integration tool can be triggered by a tester through a UI provided by the persistent integration tool, or the triggering operation of executing the test task can be triggered by the persistent integration tool at regular time.

The project management plug-in may be, for example, Maven, and is used to help a developer download a program package (e.g., jar package, engineering code, etc.) to facilitate creating a configuration project. Moreover, the project management plug-in can maintain a Maven warehouse to uniformly manage the downloaded program packages and avoid repeated copying and version conflict of the program packages. The continuous integration tool may create the test task based on the Project management plug-in, for example, creating a configuration Project (Project configuration) through the Project management plug-in, and storing the created test task in a configuration Project library. The library of configuration items may be, for example, a certain memory space in the first terminal device 101.

According to an embodiment of the present disclosure, to support testing of cross-platform compatibility, the persistent integration tool may implement multi-platform support using, for example, Slave and Master mechanisms. Thus, the test device 230 may be provided with a main thread and a sub-thread, for example. The main thread may be used, for example, as a Slave, and the sub-thread may be used, for example, as a Slave.

The main thread may be used to send a test task to a sub-thread for the test task in response to a trigger operation for executing the test task, for example. After the sub-thread receives the test task, firstly, an environment for executing the test task needs to be established, and then a test case is obtained and operated for testing. The test task may include information such as a test type, a test object identifier, and a test system type. The test type may be, for example, test brightness, test color, and the like. The test object identification is an identification for the object to be tested, and the test task is matched with the object to be tested. For example, when the object to be tested is a smart lamp device, the test object identifier may include, for example, a model number of the smart lamp device. The test system type may include, for example, a system type of the system run by the terminal device 210, and may be, for example, Android, iOS, Windows, OS, Microsoft, or the like. Through the setting of each piece of information in the test task, the sub-thread can conveniently obtain the matched test case.

According to embodiments of the present disclosure, the child thread may be used, for example, to: firstly, responding to the received test task, and acquiring an engineering code from a preset space; and then compiling the engineering codes by adopting a compiler so as to construct a test environment for providing support for running the test cases. The predetermined space may be, for example, a code library storing codes required by the operation of each system of the enterprise; the acquired engineering code may be, for example, a jar package, and the engineering code may be stored in a test workspace preset by the test apparatus. Wherein the child thread can compile the engineering code by executing a predefined shell script, for example, thereby completing the construction of the test environment. The shell script is a program file which is convenient to execute at one time by putting various analysis commands into one file in advance.

After the test environment is established, the sub-thread can acquire the test case to start testing the object to be tested. The test case may include, for example, a test script for executing a test task assigned to the child thread. In order to reduce the difficulty of developing test scripts, the embodiment of the disclosure may store different types of scripts hierarchically. For example, test scripts for a single type of object to be tested may be stored in different storage spaces than test scripts that are common to different types of objects to be tested. Thus, as shown in fig. 3, the test architecture 300 may be provided with a first storage layer 340 and a second storage layer 350.

According to an embodiment of the present disclosure, a first test script package uniquely matching an object to be tested may be stored in the first storage tier 340. The first test script may include, for example, a script for controlling a control in a client application for an object to be tested, the control being used for controlling an operating parameter or an operating state of the object to be tested. A second test script store matching each of the plurality of test objects may be packaged in the second storage tier 350. In particular, the second test script comprises a script for implementing some common operations and common procedures common with respect to a plurality of test objects including an object to be tested. For example, the second test script may include a script for implementing the operations of logging in to the client application. According to the embodiment of the disclosure, the second test script can be packaged in an Operation form, so that the difficulty of developing the test script is reduced.

In order to facilitate efficient management of the running of test cases, according to an embodiment of the present disclosure, as shown in fig. 3, a test framework may be further integrated with a case execution framework 320, for example. The use case execution framework 320 may include, for example, a TestNG framework, thereby making writing of development test scripts more flexible and powerful. A developer may write a test script through the TestNG framework and store the test script in the first storage layer 340 or the second storage layer 350.

According to an embodiment of the present disclosure, the use case execution framework 320 is further configured to, for example, perform the following operations: first, a first test script for the test task is obtained from the first storage layer 340, and a second test script for the test task is obtained from the second storage layer, so as to obtain a test case, where the test case includes the first test script and the second test script. And then, running the test case to obtain the operation information to be sent to the terminal equipment. Finally, a test report 380 of the object to be tested is generated according to the first working parameter and the obtained operation information sent by the detection device 220. For example, when the operation information is to control the object to be tested (for example, the intelligent lamp device) to change the brightness, whether the brightness is changed or not may be determined according to the first operating parameter (the brightness value of the intelligent lamp device), and if the brightness is changed, a test report with normal brightness adjustment may be generated. And if the brightness is not changed, generating a test report of brightness adjustment faults.

To facilitate automated execution of tests in accordance with embodiments of the present disclosure, as shown in FIG. 3, the test architecture 300 may include, for example, a test open source tool 330 integrated with a persistent integration tool, an integration project management plug-in 310, and a use case execution framework 320. The test sourcing tool may be, for example, an Appium sourcing automation test framework. The core of the open source test tool 330 may be, for example, a service framework that exposes a series of REST APIs (internet software). When the TestNG obtains the operation information to be sent to the terminal device through the operation case, the test open source tool can be called. In order to facilitate control of a control applied by a client in the terminal device 210 according to the operation information, logic for simulating manual operation according to the operation information may be further added to the open source test tool, and control logic matched with the operation logic and the operation flow of the test case is further added.

According to the embodiment of the present disclosure, in order to determine the operation information, information such as a page element of the client application needs to be obtained in advance. Therefore, as shown in fig. 3, the test architecture further includes a component 370, which can obtain the page element of the client application through the XM1 layout file of the client application, generate the page element management class required by the test framework, and encapsulate the page element management class in the component 370. When the TestNG runs the use case, the operation information can be obtained by calling the page element management class. According to the embodiment of the disclosure, since the app may be used to test native and hybrid mobile applications of the iOS and the Android, as shown in fig. 3, the test framework of the embodiment of the disclosure may be used to test client applications running in the iOS operating system and the Android operating system. For example, a test script for testing client applications running in different operating systems may have a label corresponding to the operating system, so as to obtain an accurate test case. The test framework may communicate with the terminal device via a Proxy protocol 360, for example.

In accordance with an embodiment of the present disclosure, to facilitate the invocation of a Page element management class in a Component 370(Component), the Component 370 may store the Page element management class using a Page-Object schema to store management classes associated with all controls in the same Page in the same file.

According to the embodiment of the present disclosure, in order to facilitate the sequential running of the test cases, as shown in fig. 3, input parameters are required to be imported for the test script, and the input parameter information may include input parameters of the test cases, such as parameters related to the jdk environment, for example. Accordingly, the use case execution framework 320 may run test cases based on the input parameter information.

According to the embodiment of the present disclosure, in order to further improve the automation of the test, by running the test case, after the case execution framework 320 generates the test report 380, the test report 380 may be sent to a mailbox account or other communication accounts of the user. Therefore, in order to send the test report 380 to the user, the user information may be imported along with the input parameter information. The user information may include data such as a user name related to a communication account of the user, and the test report may be sent to the server for the user information by running the test case. For example, when the communication account is a mailbox, the test report may be sent to a server corresponding to the mailbox, and at the same time, the user name needs to be sent while the test report is sent, so that the test report is stored in a storage space corresponding to the user name in the server.

According to the embodiment of the disclosure, after the child thread obtains the test task, for example, the automated test of the object to be tested can be completed by calling the test framework. The testing method executed by the sub-thread is described in detail in the following description of fig. 4 to 7.

Fig. 4 schematically shows a flow chart of a testing method for an object to be tested according to a first exemplary embodiment of the present disclosure.

As shown in fig. 4, the test method for a subject to be tested according to an embodiment of the present disclosure may include operations S401 to S404.

In operation S401, a test case is acquired; in operation S402, the test case is run to obtain operation information to be sent to the terminal device.

According to an embodiment of the disclosure, the operations S401 to S402 may be performed by the use case execution framework 320 in the test architecture. Wherein the operation information indicates an operation to be performed by the terminal device 210 on an operable object for the object to be tested.

According to an embodiment of the present disclosure, the object to be tested may include, for example, the smart device 106 in fig. 1, and the operable object includes a control included in a client application for the smart device 106 in the terminal device 210.

In operation S403, a first operating parameter of an object to be tested from a detection apparatus is received.

The detecting device may be, for example, the detecting device 220 described in fig. 2, and when the object to be tested is an intelligent lamp device, the first operating parameter may include, for example, a brightness value of the lamp device, a color value of the lamp device, or whether the lamp device is turned on or off. When the object to be tested is a smart refrigerator or other smart device, the first operating parameter may include, for example, temperature, power, voltage value, and the like. The type of the object to be tested and the first working parameter are not limited by the disclosure, and the disclosure can be set according to actual requirements. The first working parameter characterizes the execution of the operation executed by the operable object of the object to be tested, and the working state of the object to be tested.

In operation S404, a test report of the object to be tested is generated according to the first operating parameter.

According to an embodiment of the present disclosure, the method for generating the test report in operation S404 may also be written into a test case. Accordingly, the operation S404 can also be implemented by the use case execution framework 320 in fig. 3 to execute the test case.

According to the embodiment of the disclosure, a running environment is provided for running test cases. The test method for a to-be-tested object according to the embodiment of the present disclosure needs to include an operation of establishing a runtime environment by importing engineering code, in addition to operations S401 to S404.

Fig. 5 schematically shows a flow chart of a testing method for an object to be tested according to a second exemplary embodiment of the present disclosure.

As shown in fig. 5, the test method for a subject to be tested according to the embodiment of the present disclosure may further include operations S505 to S506 in addition to operations S401 to S404. The operations S505 to S506 are performed before the operation S402.

In operation S505, in response to receiving the test task, engineering code is acquired from a predetermined space.

According to embodiments of the present disclosure, a child thread may receive a test task, for example, in response to a triggering operation to execute the test task. And after receiving the test task, acquiring the engineering code from the code library. Since the test task includes the test object identifier, the test task matches the object to be tested described in operations S403 to S404.

According to an embodiment of the present disclosure, the running test case may specifically be a test script including an execution test task. In the architecture shown in FIG. 3, the test scripts may include, for example, a first test script and a second test script. Wherein a first test script is obtained from the first storage tier 340, which is uniquely matched to the object to be tested, and a second test script is obtained from the second storage tier 350, which is matched to a plurality of test objects including the object to be tested. For example, the first test script only matches with the intelligent lamp equipment, and the second test script not only matches with the intelligent lamp equipment, but also matches with other intelligent equipment such as an intelligent refrigerator and an intelligent air conditioner.

In operation S506, the engineering code is compiled using a compiler to construct a test environment that provides support for running the test case.

According to an embodiment of the present disclosure, this operation S506 may specifically be, for example, compiling the engineering code by executing a predefined shell script. The shell script is described in detail with reference to fig. 3, and is not described herein again.

Fig. 6 schematically shows a flow chart of a testing method for an object to be tested according to a third exemplary embodiment of the present disclosure.

As shown in fig. 6, in order to facilitate the running of the test case, the test method for the object to be tested may further include operation S607 in addition to operation S401 to operation S404. This operation S607 is performed before the test case is run.

In operation S607, input parameter information is acquired.

According to an embodiment of the present disclosure, the input information may be, for example, in response to an operation input by a tester, for example, the tester may input the input parameter information through an interface provided by the continuous integration tool. The input parameter information comprises input parameters of the test case, so that smooth operation of the test case is facilitated.

Accordingly, as shown in fig. 6, operation S402 in fig. 4 may be performed by operation S602. In operation S602, a test case is run based on the input parameter information, and operation information to be transmitted to the terminal device is obtained. The operation S602 may include, for example: and taking the input parameter information as the value of the variable in the test case to run the test case.

According to an embodiment of the present disclosure, in order to further improve the automation of the test and improve the user experience, the test report generated in operation S404 may be sent to the user. Accordingly, the input parameter information acquired in operation S607 may further include user information. And sending a test report to the user according to the user information.

For example, as shown in fig. 6, the testing method for the object to be tested according to the embodiment of the present disclosure may further include an operation S608 of sending a test report of the object to be tested to a server for the user information according to the user information. If the user information is the wechat account, the operation S608 may be to send the test report to the server corresponding to the wechat. Meanwhile, in operation S608, when the test report is transmitted, the user information may also be transmitted at the same time, so that the server for the user information stores the test report in the storage space corresponding to the user information.

According to the embodiment of the present disclosure, in order to improve the accuracy of the generated test report, after the testing device 230 simulates an artificial operation to perform an operation indicated by the operation information obtained in operation S402 on an operable object matched with the object to be tested, it may further determine whether the simulated artificial operation is successfully performed according to the operable object, that is, the state of the control corresponding to the object to be tested in the client application. And deducing the working parameters of the object to be tested according to the determination result. Finally, the inferred working parameters are compared with the working parameters detected by the detecting device 220 to determine whether the object to be tested can work normally.

Fig. 7 schematically shows a flow chart of a testing method for a subject to be tested according to a fourth exemplary embodiment of the present disclosure.

As shown in fig. 7, the test method for a subject to be tested according to the embodiment of the present disclosure may include, for example, operations S709 to S710 in addition to operations S401 to S404.

In operation S709, state information of the manipulatable object after the completion operation is performed is acquired. In operation S710, a second operating parameter of the object to be tested is determined according to the state information.

According to the embodiment of the disclosure, when the operable object is a switch control of a smart lamp device, and the operation information indicates that the switch control is opened, after the completion of the operation is executed, the state information of the switch control is "Open" or "Open" displayed by the switch control. According to the state information, it can be determined that the intelligent lamp equipment is in an open state, and the second working parameter of the intelligent lamp equipment is the working state of the intelligent lamp equipment, or the second working parameter can be the brightness value and/or the color value of the intelligent lamp equipment in normal working.

Accordingly, as shown in fig. 7, operation S404 may be implemented by operation S704. In operation S704, a test report of the object to be tested is generated according to the first and second operating parameters.

According to an embodiment of the present disclosure, the operation S704 may compare the first operating parameter and the second operating parameter, and generate a test report according to the comparison result. For example, when the detection device 220 detects the lighting emitted by the intelligent light-type device, it may be determined that the first operating parameter is in the operating state, and when it is determined that the second operating parameter is also in the operating state through operation S710, it may be determined that the comparison result is that the first operating parameter is consistent with the second operating parameter, so as to generate a test report that the intelligent light-type device can operate. When the first working parameter is the brightness value a, the second working parameter is the brightness value b, and a is less than b, the comparison result can be determined to be that the first working parameter is inconsistent with the second working parameter, and therefore a test report of insufficient brightness of the intelligent lamp equipment is generated.

Fig. 8 schematically shows a flowchart for performing an automated test on an object under test in a specific application scenario.

According to an embodiment of the present disclosure, as shown in fig. 8, in a case where an object to be tested is an intelligent lamp, a process of performing an automated test on the object to be tested may include the following operations;

firstly, the continuous integration tool Jenkins is used for automatically triggering or manually triggering the triggering operation of executing the test task. The Master can respond to the trigger operation and acquire the test task matched with the trigger operation from the preset configuration project. The trigger operation may have test information indicating a test type and an object to be tested, for example, and the main thread may acquire a test task having the test type and an object to be tested identifier from a configuration item as a test task to be executed.

After the Master acquires the test task, the test task may be allocated to the matched Slave. The test task may further include a Slave identifier, for example, to indicate a Slave for executing the test task. The Master may assign a test task to the Slave matching the Slave identity.

After the Slave receives the Test task, the engineering code can be obtained from the code library and stored in a Test workspace (Test workplace). And compiling the engineering codes stored in the test working space so as to construct and obtain an operating environment for executing the test task.

After the running environment for executing the test task is established, the Slave can acquire the test script matched with the test task, and the simulation click of the control in the client application for the intelligent lamp is realized by running the test script.

After finishing this simulation and clicking, terminal equipment can respond to this simulation and click, sends the request instruction to the high in the clouds to request the high in the clouds to control the smart lamp, thereby change the switch of smart lamp, or change the luminance or the colour of smart lamp.

And finally, the Slave can receive the working parameters of the intelligent lamp detected by the detection device, generate a test report according to the working parameters, and send the generated test report to a server corresponding to the user account.

In summary, the automated test of the object to be tested according to the embodiment of the disclosure can realize the automated test of the whole process, thereby effectively improving the test efficiency and effectively reducing the test cost.

Fig. 9 schematically shows a block diagram of a test apparatus for an object to be tested according to an embodiment of the present disclosure.

As shown in fig. 9, a testing apparatus 900 for an object to be tested according to an embodiment of the present disclosure may include a use case acquiring module 901, a use case running module 902, an operating parameter receiving module 903, and a test report generating module 904.

The use case obtaining module 901 is configured to obtain a test case (operation S401).

The use case running module 902 is configured to run the test case to obtain operation information to be sent to the terminal device (operation S402). Wherein the operation information indicates an operation to be performed by the terminal device on an operable object for the object to be tested.

The operation parameter receiving module 903 is configured to receive a first operation parameter of the object to be tested from the detecting apparatus (operation S403). Wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation.

The test report generating module 904 is configured to generate a test report of the object to be tested according to the first operating parameter (operation S404).

According to an embodiment of the present disclosure, the testing apparatus 900 for an object to be tested may further include an engineering code obtaining module 905 and a compiling module 906. Wherein the engineering code obtaining module 905 is configured to obtain the engineering code from the predetermined space in response to receiving the test task (operation S505). The compiling module 906 is configured to compile the engineering code with a compiler to construct a test environment for providing support for running the test case (operation S506).

According to an embodiment of the present disclosure, the test script includes: a first test script which is uniquely matched with an object to be tested is acquired from a first storage layer; and a second test script matching with the plurality of test objects is acquired from the second storage layer. Wherein the plurality of test objects includes an object to be tested.

According to an embodiment of the present disclosure, the testing apparatus 900 for a subject to be tested may further include: a parameter information acquiring module 907 for acquiring input parameter information (operation S607). The input parameter information may include input parameters of the test case. Accordingly, the use case running module 902 is specifically configured to run the test case based on the input parameter information, and obtain the operation information to be sent to the terminal device (operation S602).

According to an embodiment of the present disclosure, the input parameter information further includes user information, and the testing apparatus for the object to be tested may further include a test report sending module 908 for sending a test report of the object to be tested to a server for the user information according to the user information (operation S608).

According to an embodiment of the present disclosure, the testing apparatus 900 for an object to be tested may further include a status information obtaining module 909 and an operating parameter determining module 910. The status information obtaining module 909 is configured to obtain the status information of the operable object after the completion operation is executed after the use case execution module 902 obtains the operation information to be sent to the terminal device (operation S709). The operation parameter determining module 910 is configured to determine a second operation parameter of the object to be tested according to the status information (operation S710). Accordingly, the test report generating module 904 is configured to generate a test report of the object to be tested according to the first operating parameter and the second operating parameter (operation S704).

Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.

For example, any plurality of the use case obtaining module 901, the use case running module 902, the working parameter receiving module 903, the test report generating module 904, the engineering code obtaining module 905, the compiling module 906, the parameter information obtaining module 907, the test report sending module 908, the state information obtaining module 909 and the working parameter determining module 910 may be combined and implemented in one module, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to the embodiment of the present disclosure, at least one of the use case obtaining module 901, the use case running module 902, the working parameter receiving module 903, the test report generating module 904, the engineering code obtaining module 905, the compiling module 906, the parameter information obtaining module 907, the test report sending module 908, the state information obtaining module 909, and the working parameter determining module 910 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three manners of software, hardware, and firmware, or implemented by a suitable combination of any of them. Alternatively, at least one of the use case obtaining module 901, the use case running module 902, the working parameter receiving module 903, the test report generating module 904, the engineering code obtaining module 905, the compiling module 906, the parameter information obtaining module 907, the test report sending module 908, the state information obtaining module 909, and the working parameter determining module 910 may be at least partially implemented as a computer program module, and when the computer program module is run, the corresponding function may be executed.

Fig. 10 schematically shows a block diagram of an electronic device adapted to perform a testing method for an object to be tested according to an embodiment of the present disclosure. The electronic device shown in fig. 10 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 10, an electronic device 1000 according to an embodiment of the present disclosure includes a processor 1001 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)1002 or a program loaded from a storage section 1008 into a Random Access Memory (RAM) 1003. The processor 1001 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the present disclosure.

In the RAM 1003, various programs and data necessary for the operation of the electronic apparatus 1000 are stored. The processor 1001, ROM 1002, and RAM 1003 are connected to each other by a bus 1004. The processor 1001 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM 1002 and/or the RAM 1003. Note that the programs may also be stored in one or more memories other than the ROM 1002 and the RAM 1003. The processor 1001 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.

Electronic device 1000 may also include an input/output (I/O) interface 1005, the input/output (I/O) interface 1005 also being connected to bus 1004, according to an embodiment of the present disclosure. Electronic device 1000 may also include one or more of the following components connected to I/O interface 1005: an input section 1006 including a keyboard, a mouse, and the like; an output section 1007 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage portion 1008 including a hard disk and the like; and a communication section 1009 including a network interface card such as a LAN card, a modem, or the like. The communication section 1009 performs communication processing via a network such as the internet. The driver 1010 is also connected to the I/O interface 1005 as necessary. A removable medium 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 1010 as necessary, so that a computer program read out therefrom is mounted into the storage section 1008 as necessary.

According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication part 1009 and/or installed from the removable medium 1011. The computer program performs the above-described functions defined in the system of the embodiment of the present disclosure when executed by the processor 1001. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.

According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 1002 and/or the RAM 1003 described above and/or one or more memories other than the ROM 1002 and the RAM 1003.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

It will be appreciated by those skilled in the art that the foregoing describes embodiments of the disclosure. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims

1. A testing method for a subject to be tested, comprising:

obtaining a test case;

running the test case to obtain operation information to be sent to terminal equipment, wherein the operation information indicates an operation to be executed by the terminal equipment on an operable object aiming at the object to be tested;

receiving a first working parameter of the object to be tested from a detection device; and

generating a test report of the object to be tested according to the first working parameter,

wherein the first operating parameter characterizes an operating state in which the object to be tested is in response to the execution of the operation.

2. The method of claim 1, wherein the method further comprises, prior to running the test case:

acquiring engineering codes from a predetermined space in response to receiving the test task; and

compiling the engineering code by adopting a compiler to construct a test environment for providing support for running the test case,

wherein the test task is received in response to a trigger operation to execute the test task; the test task is matched with the object to be tested; and the test case comprises a test script for executing the test task.

3. The method of claim 2, wherein the test script comprises:

a first test script which is uniquely matched with the object to be tested is acquired from a first storage layer; and

a second test script matching each of the plurality of test objects retrieved from the second storage tier,

wherein the plurality of test objects includes the object to be tested.

4. The method of claim 1, wherein:

the method further comprises the following steps: acquiring input parameter information, wherein the input parameter information comprises input parameters of the test case;

and running the test case based on the input parameter information to obtain operation information to be sent to the terminal equipment.

5. The method of claim 4, wherein the input parameter information further comprises user information; the method further comprises the following steps:

and sending a test report of the object to be tested to a server aiming at the user information according to the user information.

6. The method of claim 1, wherein the method further comprises, after the obtaining of the operational information to be transmitted to the terminal device:

acquiring state information of the operable object after the operation is completed; and

determining a second working parameter of the object to be tested according to the state information,

wherein the test report is generated as a function of the first operating parameter and the second operating parameter.

7. The method of claim 1, wherein:

the object to be tested comprises an intelligent device; and

the actionable object includes a control included in a client application for the smart device.

8. A testing device for a subject to be tested, comprising:

the case acquisition module is used for acquiring a test case;

the case running module is used for running the test case to obtain operation information to be sent to the terminal equipment, and the operation information indicates the operation to be executed by the terminal equipment on the operable object aiming at the object to be tested;

the working parameter receiving module is used for receiving a first working parameter of the object to be tested from the detection device; and

a test report generating module for generating a test report of the object to be tested according to the first working parameter,

9. A test system comprises

The terminal equipment is provided with a client application aiming at the object to be tested, and the client application comprises at least one control and is used for responding to the operation of any one control in the at least one control and controlling the working state of the object to be tested;

the detection device is used for detecting a first working parameter of the object to be tested; and

the testing device is in communication connection with the terminal equipment and the detection device, and is provided with a testing framework for executing the testing method according to any one of claims 1-7.

10. A test system according to claim 9, wherein the test apparatus is provided with a main thread and a sub-thread, the test architecture comprising a persistent integration tool with a project management plug-in installed, wherein:

the continuous integration tool is used for generating a test task based on the project management plug-in and generating a trigger operation for executing the test task;

the main thread is used for responding to the triggering operation of executing the test task and sending the test task to the sub-thread aiming at the test task; and

the child threads are used to:

in response to receiving the test task, obtaining engineering code from a predetermined space; and

wherein the test task is matched with the object to be tested; the test case comprises a test script for executing the test task.

11. The system of claim 10, wherein the test framework comprises a test open source tool integrated with a persistent integration tool that integrates the project management plug-in and use case execution framework, and the test framework is provided with a first storage tier and a second storage tier; wherein:

the first storage layer stores a first test script which is uniquely matched with the object to be tested; and

the second storage layer stores a second test script matched with a plurality of test objects;

the use case execution framework is used for:

acquiring a first test script aiming at the test task from the first storage layer, and acquiring a second test script aiming at the test task from the second storage layer to obtain the test case; and

running the test case, calling the test open source tool to obtain operation information to be sent to the terminal equipment,

wherein the plurality of test objects includes the object to be tested.