WO2017197829A1

WO2017197829A1 - Test information management method and apparatus, and test case execution system and device

Info

Publication number: WO2017197829A1
Application number: PCT/CN2016/101781
Authority: WO
Inventors: 周胜宝
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-05-19
Filing date: 2016-10-11
Publication date: 2017-11-23
Also published as: CN107402854A

Abstract

A test information management method and apparatus, and a test case execution system and device. The test information management apparatus monitors information interaction between a test case execution system and a real tested device, and collects interaction information therebetween, and then stores the collected interaction information (S101); the interaction information comprises a control instruction sent to the real tested device by the test case execution system according to a test case, and the execution result of the test executed by the real tested device according to the control instruction; finally, the interaction information is imported to a virtual tested device (S102). The method and apparatus effectively solve the problems of waste of human resources and low working efficiency of the test system in the prior art, thereby saving human resources and improving the working efficiency.

Description

Test information management method, device, test case execution system and device

The present application is based on a Chinese patent application filed on Jan. 19, 2016, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of software testing and hardware testing, and in particular, to a test information management method, apparatus, test case execution system and device.

Background technique

With the development of information technology, the software and hardware market is becoming more and more prosperous. At the same time, providing better software or hardware has become the aim and goal of many businesses; in order to make the production equipment or designed software have better performance and User experience, usually the merchant will do a lot of testing before putting the product into use.

In the prior art, there is a case in which the test of the test device by the actual device under test often has problems such as occupying more resources, having a large maintenance workload, and taking time in the debugging process; thus, the prior art proposes Construct a virtual device under test corresponding to the device under test. The virtual device under test has exactly the same environmental conditions as the device under test. This method can save a lot of resources and time, and can be used as an continuation of automated test cases. The integrated test environment can be verified in time and quickly when test cases and keywords are modified. However, using this method often requires testing in a real test environment to facilitate the detection of the availability of test cases. For the test cases that have passed the test under the real test, the interaction information between the test system and the real device under test needs to be manually filled into the virtual device under test when using these test cases; in actual use, Test cases tend to have a large number, and the amount of interaction information generated when the test system interacts with the information of the actual device under test is even larger; this will waste more manpower in some repetitive work. Up, and work efficiency is also low. In summary, the test system in the prior art has the problem of wasting human resources and inefficient work.

Summary of the invention

The main technical problem to be solved by the present invention is to provide a test information management method, device, and test case execution system and device, which solves the problem of waste of human resources and low work efficiency in the test system in the prior art.

To solve the above technical problem, the present invention provides a test information management method, including:

Collecting interaction information between the test case execution system and the real device under test, and saving the interaction information; the interaction information includes a control instruction sent by the test case execution system to the real device under test according to the test case, and Determining an execution result obtained by the real device under test according to the control instruction;

Importing the interaction information into a virtual device under test corresponding to the real device under test.

In an embodiment of the present invention, before saving the interaction information, the method further includes: determining whether the interaction information already exists locally, and when the determination result is no, saving the interaction information; otherwise, not saving the location Interacting information.

In an embodiment of the present invention, saving the interaction information includes: converting the format of the interaction information into a target format, and saving interaction information of the target format; the target format is completed with the virtual device under test When testing the test case, the format required for the test information matches.

In an embodiment of the present invention, before collecting the interaction information between the test case execution system and the real device under test, the method further includes: monitoring a communication protocol channel between the test case execution system and the real device under test. Monitor the information interaction between the test case execution system and the real device under test.

The invention also provides a test information management device, comprising:

The processing module is configured to collect interaction information between the test case execution system and the real device under test, and save the interaction information, where the interaction information includes a test case execution system that is sent to the real device under test according to the test case. a control instruction, and an execution result obtained by the real device under test according to the control instruction;

The import module is configured to import the interaction information into a virtual device under test corresponding to the real device under test.

In an embodiment of the present invention, the method further includes: a determining module, configured to determine whether the interaction information already exists locally, and when the determination result is no, the processing module saves the interaction information; otherwise, the processing The module does not save the interaction information.

In an embodiment of the present invention, the processing module includes a format conversion sub-module, configured to convert a format of the interaction information into a target format, and save interaction information of the target format; the target format and the virtual When the device under test completes the test for the test case, the format required for the test information matches.

In an embodiment of the present invention, the monitoring module is further configured to monitor between the test case execution system and the real device under test before collecting the interaction information between the test case execution system and the real device under test. The communication protocol channel monitors the information interaction between the test case execution system and the real device under test.

The present invention further provides a test case execution system, comprising: the test information management device in the above embodiment, configured to control a real device under test to execute a test case by using a control command, and receive the test device by the real device under test to execute the test case. The result of the execution.

The present invention also provides an apparatus, comprising: the test information management apparatus in the above embodiment, for testing The control instruction of the execution system executes the test case, and sends the execution result of the test case to the test case execution system, or is used to complete the test of the corresponding test case according to the interaction information.

The invention provides a test information management method, device, test case execution system and device, and the test information management device monitors the information interaction between the test case execution system and the real device under test, and collects two The interaction information between the two, and then the collected interaction information is saved; the interaction information includes a control instruction sent by the test case execution system to the real device under test according to the test case, and the real device under test performs the test according to the control instruction. The result of the execution; finally, the interaction information is imported to the virtual device under test. In this way, the test information management can be used to collect the relevant information of the test case when testing the real device under test; then the information is imported into the virtual device under test, and the virtual device under test can directly utilize the above interaction information and test. The use case execution system interacts to complete testing of the virtual device under test. It does not require the staff to manually fill in the execution test, the interaction information between the test system and the real device under test, which can effectively solve the problem of wasted human resources and low work efficiency in the test system in the prior art; thereby saving human resources. To improve the efficiency of work.

DRAWINGS

1 is a flowchart of a test information management method according to Embodiment 1 of the present invention;

2 is a schematic structural diagram of a test information management apparatus according to Embodiment 2 of the present invention;

3 is a schematic diagram of a system of a specific example of a test information management apparatus according to Embodiment 2 of the present invention;

4 is a flowchart of a specific example of a test information management apparatus in Embodiment 2 of the present invention;

FIG. 5 is a schematic structural diagram of a test case execution system according to Embodiment 2 of the present invention; FIG.

FIG. 6 is a schematic structural diagram of a device in Embodiment 2 of the present invention.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings.

Embodiment 1:

This embodiment provides a test information management method. Referring to FIG. 1, the method includes:

S101: Collect interaction information between the test case execution system and the real device under test, and save the interaction information;

S102: Import the interaction information into the virtual device under test.

In this embodiment, step S101 is first performed to collect interaction information between the test case execution system and the real device under test, and save the interaction information. For example, it is now necessary to test the dialing function of a mobile phone, so the test case execution system sends a control command to the mobile phone under test, for example, needs to perform a dialing action, dial a number, etc.; The test case is executed according to the control command, and the test result is returned to the test case execution system. In the above process, the test case execution system sends a control command to the mobile phone under test and the mobile phone executes the test according to the control command, and the execution result returned to the test case execution system is collected. And the collected interactive information is saved for subsequent use. Therefore, the interaction information includes a control instruction sent by the test case execution system to the real device under test according to the test case, and an execution result obtained by the real device under test according to the control instruction.

In a specific implementation manner, in order to avoid repeated storage and waste resources, there is a judgment process before the collected interactive information is saved, and it is determined whether the interactive information already exists locally, if it is already saved. There is no need to waste resources to save; but if it is not saved, it is necessary to save it.

In order to save resources and time, the prior art proposes to construct a virtual device under test corresponding to the real device under test, and the virtual device under test has exactly the same environmental conditions; if the virtual device under test is to be normal After completing the test, you usually need to get the interactive information. However, since the format of the information collected by the test information management device is inconsistent with the format required for the virtual device under test to complete the test, it is usually necessary to perform format conversion on the interaction information. For example, the information format that the test information management device may collect is: control command: A; response message: B. Here, the control command A is the information sent by the test case execution system to the real device under test; and the response message B is also the response information of the real device under test. However, the virtual device under test is used as the device under test to simulate the real device under test. Therefore, if it is directly saved in the original format, it will be understood that the virtual device under test sends a control command A to the test case execution system. The test case execution system replies to the virtual device under test with a response message B; obviously, this does not work, so the format is converted and converted into a target format, and the target format is the virtual device under test. When testing a test case, the test information needs to be in a format that matches the format. The above examples are only used to illustrate the solution of the present invention, and are not intended to limit the scope of the present invention. Depending on the situation, the virtual device under test may also need a variety of other formats to complete the test.

After the interaction information is saved, the saved interaction information needs to be imported to the virtual device under test, and step S102 is performed. Usually, the test case execution system stores the written test case; the test case execution system sends the control command, which is generated according to the test case. The test case may define one or more items to be tested, so The test case execution system sends the corresponding control instruction to the real device under test, and the expected execution result is defined in the test case; the test case execution success can be judged according to the actual execution result. Then, the test case execution system can test the virtual device under test for the corresponding test case, and the execution efficiency is greatly improved compared with the use of the real test device, and the running time is greatly reduced.

The final purpose is to enable the obtained information to work successfully on the virtual device test system. Therefore, it is first required to ensure that the acquired information is working properly. In a specific implementation manner of this embodiment, the information is also monitored. The information interaction between the test case execution system and the real device under test. The monitoring test system generally runs on the test equipment, and may be some commonly used automatic test systems. It may also be a manual test system executed by the staff. The test personnel execute the system to issue control commands to the real device under test through the test case execution system. For example, it is now necessary to test the dialing function of a mobile phone, so the test case execution system sends a control command to the mobile phone under test, for example, a dialing action, a dialing number, etc.; the mobile phone executes the test case according to the control command, and then the test is performed. The result is returned to the test case execution system.

In a specific implementation manner, the information interaction between the monitoring test instance execution system and the real device under test is completed by monitoring the communication protocol channels of the two, and the so-called communication protocol channel is the communication communication between the two. Ways, communication protocols, etc. For example, the test case execution system needs to test the remote radio unit. The two use the Telnet protocol (remote terminal protocol) to communicate. The test case execution system uses the Telnet protocol to send control commands to the remote radio unit to be tested. The unit also uses the Telnet protocol to send the execution result, so that the monitoring of the information interaction between the test case execution system and the real device under test only needs to monitor the Telnet channel between the two.

With the test information management method of the embodiment, the test information management device performs monitoring of information interaction between the test case execution system and the real device under test, collects interaction information, saves the interaction information, and then saves the interaction information. Imported into the virtual device under test, and the format of the saved interactive information is the format that the test information needs to be completed when the virtual device under test is tested; thus, not only human resources can be saved, human resource costs are reduced, and resource waste is reduced; Reduce the probability of errors, improve work efficiency, and improve the quality of work.

Embodiment 2:

The present embodiment provides a test information management apparatus. Referring to FIG. 2, the test information management apparatus 2 includes a processing module 21 and an import module 22. The processing module 21 is configured to collect interaction information between the test case execution system and the real device under test, and save the interaction information. The import module 22 is configured to import the interaction information into the virtual device test system.

In this embodiment, the test information management apparatus 2 may further include a monitoring module 23 for monitoring information interaction between the test case execution system and the real device under test. The monitoring test system generally runs on the test equipment, and may be some commonly used automatic test systems. It may also be a manual test system executed by the staff. The test personnel execute the system to issue control commands to the real device under test through the test case execution system. In a specific implementation manner, the information interaction between the monitoring test instance execution system and the real device under test is completed by monitoring the communication protocol channels of the two, and the so-called communication protocol channel is the communication communication between the two. Ways, communication protocols, etc. For example, the test case execution system needs to test the switch controller, and the two use the UDP protocol (user datagram protocol) for communication. The test case execution system uses the UDP protocol to send control commands to the switch controller under test, and the switch control is tested. The controller also uses the UDP protocol to send the execution result, so that the monitoring of the information interaction between the test case execution system and the real device under test only needs to monitor the UDP channel between the two.

After monitoring the information interaction between the test case execution system and the real device under test, the processing module 21 collects the interaction information between the two, and the interaction information includes the control that the test case execution system sends to the real device under test according to the test case. The instruction, and the actual device under test perform the test according to the control instruction.

In a specific implementation manner, in order to avoid redundant storage and waste resources, a judging module 24 is further configured to determine whether the interaction information already exists locally before saving the interaction information, and if it is already saved, it is unnecessary. Saving the waste resource again; but if not saved, it will be saved by the processing module 21.

In order to save resources and time, the prior art proposes to construct a virtual device under test corresponding to the real device under test, and the virtual device under test has exactly the same environmental conditions; if the virtual device under test is to be normal After completing the test, you usually need to get the interactive information. However, since the format of the information collected by the test information management device is inconsistent with the format required for the virtual device under test to complete the test, it is usually necessary to perform format conversion on the interaction information. In a specific implementation manner of the present invention, a format conversion sub-module 211 is further disposed in the processing module, configured to convert the format of the interaction information into a target format and save the target format when the interaction information is saved. Interactive information. The target format is the format that the test information needs to be provided when the virtual device under test corresponding to the real device under test completes the test case. Therefore, when the target format is tested with the virtual device under test for the test case, The test information needs to match the format. After the interaction information is saved, the saved interaction information needs to be imported into the virtual device under test. This step is completed by the import module 22.

The test information management device 2 in this embodiment will be described below with a specific example. For the system schematic diagram, please refer to FIG. 3. The monitoring module 23, the processing module 21, the importing module 22 and the judging module 24 are included; the processing module 21 includes a format conversion sub-module 211. The test information management device 2 is provided as an independent device, and is disposed outside the test case execution system 31 and the real device under test 32. For its specific workflow, please refer to Figure 4, including:

S401: The monitoring module of the test information management device starts monitoring information interaction between the test case execution system and the real device under test;

S402: The test case execution system sends a control command to the real device under test;

S403: The processing module of the test information management device collects a control command.

S404: The real device under test performs a test according to the control command, and obtains an execution result;

S405: The real device under test sends the execution result to the test case execution system.

S406: The processing module of the test information management device collects the execution result,

S407: The conversion sub-module of the test information management device performs format conversion on the collected control command and execution result. change;

S408: The judgment module of the test information management device determines whether to save; if yes, execute 409, otherwise execute S410;

S409: The processing module of the test information management device saves the interaction information of the target format;

S410: The import module of the test information management device imports the interaction information of the target format into the virtual device under test.

In this embodiment, a test case execution system is further protected. The test case execution system may include the test information management device in this embodiment. Please refer to FIG. 5, that is, all functions of the test information management device 2 are Integrated into the test case execution system 51, the test case execution system 51 is configured to control the real device under test 52 to execute the test case by using the control command, and receive the execution result of the test device by the real device under test 52, and import the interaction information into Virtual device under test 53. The virtual device under test 53 has the same function, the same operating environment, and the like as the real device under test 52; it may complete all functions of the real device under test 52 in the form of software. The above examples are only used to illustrate the solution of the present invention, and are not intended to limit the scope of the present invention.

In the embodiment, a device is also protected, and the device may include the test information management device in this embodiment. Referring to FIG. 6, that is, all the functions of the test information management device 2 are integrated into the device 61. The device 61 is typically a virtual device that can have the same functionality as a real device and can be used as a device under test (i.e., the aforementioned virtual device under test). The real device under test 63 performs a corresponding action according to the control instruction of the test case execution system 62, and transmits an execution result of the execution test to the test case execution system 62, thereby completing some tests. The test information management device 2 in the device 61 monitors the interaction and collects the interaction information (the interaction information includes the above control command and the execution result), and then saves the interaction information, and the test module of the device 61 obtains the interaction information and completes Subsequent testing of the corresponding test case. The device 61 has the same function, the same operating environment, and the like as the real device under test 63; it may complete all functions of the real device under test 52 in the form of software. The above examples are only used to illustrate the solution of the present invention, and are not intended to limit the scope of the present invention.

In a specific implementation manner of the embodiment, the device may also be a real device under test, and communication between the real device under test and the virtual device under test is established; when the device under test is provided with the test in the embodiment. The information management device can import the play interaction information into the virtual device under test after the real device under test saves the interaction information.

The test information management apparatus in this embodiment can be used to execute the test information management method of the above embodiment. That is to say, for each step in the test information management method of the above-described embodiment, the test information management apparatus in this embodiment has a corresponding module to complete, although it may not be enumerated in this embodiment. When the test information management device is set in the test case execution system and the device, corresponding modules are also provided to complete the steps of the test information management method of the above embodiment. The test information management device and the test case are executed in this embodiment. The system and equipment can complete the whole process of testing without manual participation; not only can save human resources, reduce human resource costs, reduce resource waste; it can also reduce the probability of error, improve work efficiency, and improve work quality. Moreover, the test information management device can flexibly select its setting position according to requirements, and can be used independently or in other systems, which is convenient and flexible.

Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in a storage medium (ROM/RAM, diskette, optical disk) by a computing device, and in some cases The steps shown or described may be performed in an order different than that herein, or they may be separately fabricated into individual integrated circuit modules, or a plurality of the modules or steps may be implemented as a single integrated circuit module. Therefore, the invention is not limited to any particular combination of hardware and software.

The above is a further detailed description of the present invention in connection with the specific embodiments, and the specific embodiments of the present invention are not limited to the description. It will be apparent to those skilled in the art that the present invention may be made without departing from the spirit and scope of the invention.

Industrial applicability

The invention relates to the field of software testing and hardware testing to solve the problem of inefficient testing. In the present application, the test information management device monitors the information interaction between the test case execution system and the real device under test, and collects the interaction information between the two, and then saves the collected interaction information, and finally The interactive information is imported to the virtual device under test. In this way, when testing the real device under test through the test information management, the relevant information of the test case is executed; then the information is imported into the virtual device under test, and the virtual device under test can directly use the interaction information and the test case execution system. Interact and complete the test of the virtual device under test. Therefore, the problem that the test system wastes human resources and the work efficiency is low in the prior art is solved.

Claims

A test information management method, which includes:

Collecting interaction information between the test case execution system and the real device under test, and saving the interaction information; the interaction information includes a control instruction sent by the test case execution system to the real device under test according to the test case, and Determining an execution result obtained by the real device under test according to the control instruction;

Importing the interaction information into a virtual device under test corresponding to the real device under test.
The test information management method according to claim 1, wherein before the saving of the interaction information, the method further comprises: determining whether the interaction information already exists locally, and when the determination result is no, saving the interaction information; Otherwise, the interaction information is not saved.
The test information management method according to claim 1 or 2, wherein the saving the interaction information comprises: converting the format of the interaction information into a target format, and saving interaction information of the target format; When the virtual device under test completes the test for the test case, the format required for the test information matches.
The test information management method according to claim 1 or 2, further comprising: monitoring the test case execution system and the real device under test before collecting the interaction information between the test case execution system and the real device under test The communication protocol channel between the two is used to monitor the information interaction between the test case execution system and the real device under test.
A test information management device, comprising:

The processing module is configured to collect interaction information between the test case execution system and the real device under test, and save the interaction information, where the interaction information includes a test case execution system that is sent to the real device under test according to the test case. a control instruction, and an execution result obtained by the real device under test according to the control instruction;

The import module is configured to import the interaction information into a virtual device under test corresponding to the real device under test.
The test information management apparatus according to claim 5, further comprising a determination module configured to determine whether the interaction information is already present locally, and when the determination result is no, the processing module saves the interaction information; Otherwise, the processing module does not save the interaction information.
The test information management apparatus according to claim 5 or 6, wherein the processing module comprises a format conversion sub-module, configured to convert the format of the interaction information into a target format, and to save interaction information of the target format; When the target format and the virtual device under test complete the test for the test case, the format required for the test information matches.
The test information management apparatus according to claim 5 or 6, further comprising a monitoring module configured to monitor the execution of the test case before collecting the interaction information between the test case execution system and the real device under test The communication protocol channel between the system and the real device under test monitors the information interaction between the test case execution system and the real device under test.
A test case execution system, comprising the test case management device according to any one of claims 5-8, configured to control a real device under test to execute a test case by using a control command, and receive the real device under test to execute the test case The execution result of the test case.
An apparatus, comprising the test case management apparatus according to any one of claims 5-8, configured to execute a test case according to a control instruction of a test case execution system, and transmit the test to the test case execution system The execution result of the use case, or used to complete the test of the corresponding test case based on the interaction information.