WO2019071436A1

WO2019071436A1 - Automated test system

Info

Publication number: WO2019071436A1
Application number: PCT/CN2017/105558
Authority: WO
Inventors: 任权
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-10-10
Filing date: 2017-10-10
Publication date: 2019-04-18

Abstract

An automated test system. The system comprises: a first terminal device (101), disposed inside a shielding box (104); an access point (103), disposed inside the shielding box (104) and used for providing a first access service for the first terminal device (101); a second terminal device (102), disposed outside the shielding box (104), the second terminal device (102) being connected to the first terminal device (101) by means of a first data line and connected to the access point (103) by means of a second data line, and the second terminal device (102) controlling the access point (103) and the first terminal device (101) to test the quality of the first access service. By providing the shielding box (104) and an external computer, the test device in the shielding box (104) is controlled by the external computer to perform automated testing, thereby resolving the problem of inaccurate test data caused by interference during test.

Description

An automated test system

Technical field

The present invention relates to the field of wireless communication technologies, and in particular, to a WiFi throughput automatic test system.

Background technique

With the continuous enrichment of smart mobile terminal functions, more and more users are accustomed to using smart mobile terminals to browse information and exchange information. In the process of using smart mobile terminals, WiFi is inevitably used as a way to connect to the Internet. Transmission performance and stability are important evaluation criteria for WiFi signal quality.

The WiFi throughput test is a key test technique for verifying the performance and stability of WiFi transmission. It measures the transmission capability of WiFi under various conditions according to the channel model of WiFi and the transmission mode of the transmission protocol model. However, the current WiFi throughput test mainly relies on manual testing. Because the shielding measures are not perfect during the test, the test is easily interfered by various instruments, resulting in a large difference in test data.

Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to solve the problem that the test data is inaccurate when the WiFi throughput rate test is easily interfered. By providing a shielding box and an external computer, the use of an external computer to control the shielding box is realized. The test equipment is automatically tested to solve the problem of being susceptible to interference during the test.

The invention provides an automated test system comprising:

The first terminal device is disposed in the shielding box;

An access point is disposed in the shielding box, and is configured to provide a first access service for the first terminal device;

a second terminal device disposed outside the shielding box, wherein the second terminal device is connected through the first data line Connected to the first terminal device, the second terminal device is connected to the access point by using a second data line, and the second terminal device controls the access point between the access point and the first terminal device The quality of the first access service is tested.

Optionally, the system further includes:

The third terminal device is disposed in the shielding box;

The access point is further configured to provide a second access service for the third terminal device;

The second terminal device is further configured to connect to the third terminal device by using a third data line, where the second terminal device controls the second access between the access point and the third terminal device The quality of the service is tested.

Optionally, the first terminal device is a client, and the third terminal device is a server, or the first terminal device is a client, and the third terminal device is a client.

Optionally, when the first terminal device, the second terminal device, or the third terminal device is used as a server, the parameter set by the server includes at least the server listening port number, the number of test threads, A transport layer protocol and a reporting time interval, wherein the reporting time interval is a time interval between outputting two rate values.

Optionally, when the first terminal device, the second terminal device, or the third terminal device is used as a client, the parameter set by the client includes at least an IP address of the server, and the server monitors Port number, number of test threads, and test time.

Optionally, the second terminal device sets the access point parameter, where the access point parameter includes at least a service set identifier, a password, an encryption mode, a bandwidth, a transmission mode, and a transmission protocol type of the wireless access point. . The transmission mode includes at least 802.11b, 802.11g, 802.11n and 802.11mixed, and the transmission protocol type includes at least a TCP transmission protocol and a UDP transmission protocol.

Optionally, the number of the first terminal device or the third terminal device is one or more.

By implementing the embodiment of the present invention, the test device and the access point can be placed in the shielding box during the WiFi throughput test, and the test equipment and the access point inside the shielding box are configured by the computer device placed outside the shielding box. Relevant parameters, control the test system for automated testing, to solve the problem that the test data is inaccurate when the WiFi throughput test is easily interfered.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic block diagram of an automated test system according to an embodiment of the present invention;

2 is a test flow chart of an automated test system according to an embodiment of the present invention;

3 is a schematic diagram of an automated test system provided by this embodiment;

4 is a schematic block diagram of another automated test system according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of another automated test system provided by this embodiment; FIG.

FIG. 6 is a schematic diagram of another automated test system provided by this embodiment.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

It should be noted that the terms used in the embodiments of the present invention are merely for describing a specific embodiment. The purpose is not intended to limit the invention. The singular forms "a", "the" and "the" It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "on" or "in response to determining" or "in response to detecting" depending on the context. . Similarly, the phrase "if determined" or "if detected [condition or event described]" may be interpreted in context to mean "once determined" or "in response to determining" or "once detected [condition or event described] ] or "in response to detecting [conditions or events described]".

It can be understood that the access point (AP) in the embodiment of the present invention is a device that can form a wireless local area network, and can be a wireless router, or a smart phone or a tablet computer that can enable the WiFi sharing function. A variety of terminal devices, such as a personal digital assistant (PDA), a mobile Internet device (MID), a notebook computer, a smart wearable device (such as a smart watch, a smart wristband), are not limited in the embodiment of the present invention.

It can be understood that, in the embodiment of the present invention, the shielding box is a fully enclosed shielding box, and when the access point and other terminal devices are placed therein for testing experiments, the test results may be affected in the test experiment. External interference, wherein the test experiment includes, but is not limited to, a WiFi throughput test, a delay test, and the like. The first terminal device refers to a device to be tested that is placed in the shielding box and can be connected to the access point by wireless, and can be a smart phone, a tablet computer, a personal digital assistant, a mobile internet device, a notebook computer, and a smart wearable device. Various terminal devices such as devices, the second terminal device is placed outside the shielding box, and the access point and the first terminal device in the shielding box can be connected through a data line, which can be various types such as a tablet computer, a mobile internet device, a notebook computer, and the like. The terminal device is not limited in the embodiment of the present invention.

The embodiment of the invention discloses an automatic test system, which automatically controls the equipment inside the shielding box by using a computer placed outside the shielding box by placing the access point and the terminal device to be tested into the designed fully enclosed shielding box. It can solve the problem that the system is susceptible to other interferences in the test project and the test data is inaccurate.

Please refer to FIG. 1. FIG. 1 is a schematic block diagram of an automated test system according to an embodiment of the present invention. As shown in FIG. 1, the automatic test system includes:

The first terminal device 101, the second terminal device 102, the access point 103, and the shielding box 104.

Before the start of the test, the first terminal device and the access point are placed inside the shielding box, and the access point is used to provide a first access service for the first terminal device, where the The second terminal device is disposed outside the shielding box. Before the start of the test, the first terminal device and the access point are placed inside the shielding box, and the first terminal device is connected to the first interface inside the shielding box by using the first data line. The second data line is used to connect the access point to a second interface inside the shielding box. Closing the shielding box, connecting, on the outside of the shielding box, the first terminal device to the first interface outside the shielding box, and the second data line connecting the second interface a second interface of the terminal device and the outside of the shielding box.

As shown in FIG. 2, FIG. 2 is a process when the test system performs a test, and includes the following steps:

S101. The second terminal device sets an operating parameter of the access point, where the working parameter is used to indicate a transmission mode and a transmission protocol type of the access point.

The second terminal device first configures an operating parameter of the access point by using the second data line, where the service parameter includes, but is not limited to, a transmission mode, a transmission protocol type, a working channel, and a bandwidth of the access point. .

S102. The second terminal device sets the parameter of the first terminal device as the client end and the second terminal device as the server end, and tests the uplink of the first terminal device in the shielding box. rate.

The second terminal device sets the first parameter of the second terminal device as the server, and the first parameter includes at least the listening port number, the number of test threads, the transport layer protocol, and the reporting time interval of the second terminal device, where The reporting time interval is a time interval between outputting two test rate values, and the second terminal device further sets, by using the first data line, a second parameter when the first terminal device is used as a client. The second parameter includes at least an IP address of the second terminal device, a listening port number of the second terminal device, a number of test threads, a test time, and the like, and controls the first terminal device to connect to the access point. Wherein, the test time is the duration of the test. Finally, a test is initiated to test an uplink transmission rate of the first terminal when the access point is connected to the access box.

S103. The second terminal device sets a downlink rate of the first terminal device in the shielding box by setting the first terminal device as a parameter of the server end and the second terminal device as a client.

The second terminal device sets a third parameter when the first terminal device is used as a server, and the third parameter includes at least the listening port number, the number of test threads, the transport layer protocol, and the first terminal device as the server. Reporting a time interval or the like, wherein the reporting time interval is a time interval between outputting two test rate values, and the second terminal device further sets a fourth parameter when the second terminal device is a client, The fourth parameter includes at least the IP address, the listening port number, the number of test threads, and the test time of the first terminal device as a server, and controls the first terminal device to connect to the access point, where the test time The length of time for this test. Finally, a test is initiated to test the downlink transmission rate of the first terminal when the access point is connected in the shielding box.

S104. The second terminal device resets the transmission mode of the access point, and repeats the foregoing steps S102 and S103 to test the uplink and downlink rates of the first terminal in the shielding box in different transmission modes.

For example, as shown in FIG. 3, FIG. 3 is a schematic diagram of an automated test system provided by this embodiment, showing an automatic test system for WiFi throughput. In FIG. 3, the mobile phone and the router respectively correspond to the first terminal device and the access point, and are placed inside the shielding box, and the desktop computer outside the shielding box is the second terminal device. The desktop computer is connected to the router through a corresponding interface on the shielding box by a twisted pair cable, and is connected to the mobile phone through a corresponding interface on the shielding box by using a USB cable.

The desktop computer sets, by the twisted pair, a transmission mode, a transmission protocol type, an access point name, a password, and the like of the access point, where the transmission mode includes at least 802.11b, 802.11g, 802.11n, and 802.11. In this embodiment, the 802.11b mode is first set, and the pure protocol type includes at least a Transmission Control Protocol (TCP) and a User Datagram Protocol (UDP), in this embodiment. Set to TCP.

The desktop computer opens the iperf test software, and configures the parameter of the desktop computer as a server, for example, selecting a listening port number of 5001, a test thread number of 1, a data output format of Mbits, a reporting time interval of 1 second, and a transmission protocol. For example, if the mobile phone is an Android system mobile phone, the desktop computer sets the parameters of the iperf on the mobile phone end by using an adb command. At this time, the mobile phone is used as a client, and the parameters to be set at least include the desktop computer. IP address, setting the test time to 60 seconds, the listening port 5001 of the desktop computer, etc. Finally, the desktop computer controls the desktop computer and the mobile phone to run the test software, and the desktop computer will each The uplink transmission rate after the mobile phone is connected to the router is outputted for 1 second, and the average uplink transmission rate during the test time is output after 60 seconds of the test time.

After testing the uplink transmission rate, the downlink transmission rate of the mobile phone as the server is tested. At this time, the desktop computer only needs to write "iperf-s" through the adb command, and the mobile phone is set as the server. can. The desktop computer sets its parameters as a client in its own iperf, for example, the mobile phone serves as the IP address of the server, the listening port number is 5001, and the test time is 60 seconds. Reporting time interval 1 second, test thread number is 1, transmission protocol is TCP, etc., start test software on the mobile phone and the desktop computer, and test, the desktop computer will output the mobile phone connection every 1 second The uplink transmission rate after the router is output, and after 60 seconds of the test time, the average downlink transmission rate during the test period is output. It should be understood that the above examples are by way of example only and are not to be construed as limiting.

Testing the uplink and downlink transmission rate of the mobile phone in the 802.11b mode of the router, and then resetting the transmission mode of the router, and testing the mobile phone in the 802.11g, 802.11n, and 802.11mixed transmission modes of the router. Uplink and downlink transmission rates in the shielded box.

It can be understood that the shielding box includes a plurality of twisted pair interfaces and a USB interface both externally and internally, and a plurality of twisted pairs and/or USB cables can be connected at the same time, and the shielding box is fully enclosed after being closed. The interference outside the shielding box can be shielded to prevent interference from various instruments outside the box to the WiFi throughput test.

Optionally, the related parameters of the first terminal device and the access point may also be set outside the shielding box before being placed in the shielding box, and then placed in the shielding box after the setting is completed. The embodiment of the invention is not specifically limited.

It can be understood that the above automatic test system can be used to test other network parameters in addition to testing the WiFi throughput rate, for example, by configuring related parameters on other test software, testing the system's packet loss rate and delay time. The embodiment of the present invention is not specifically limited.

By implementing the above embodiment, when testing the WiFi throughput rate, the test device and the access point are placed in the shielding box, and the relevant parameters of the test device and the access point inside the shielding box are configured by the computer device placed outside the shielding box. Control the test system for automated testing to solve the problem that the test data is inaccurate due to interference in the WiFi throughput test.

Referring to FIG. 4, FIG. 4 is a schematic block diagram of another automatic test system according to an embodiment of the present invention, where the test system includes:

The first terminal device 401, the second terminal device 402, the access point 403, the shielding box 404, and the third terminal device 405.

Before the test is started, the first terminal device, the access point, and the third device are placed inside the shielding box, and the access point is used to provide a first access service for the first terminal device. And the third terminal device provides a second access service, where the second terminal device is disposed outside the shielding box. Before the test is started, the first terminal device, the access point, and the third terminal device are placed inside the shielding box, and the first terminal device and the shielding box are connected by using a first data line. The first interface is connected to the access point and the second interface inside the shielding box by using a second data line, and the third terminal device is connected to the third interface inside the shielding box by using a third data line. Closing the shielding box, connecting, on the outside of the shielding box, the first terminal device and the first interface outside the shielding box by using a first data line, and connecting the second terminal device and the second data line with a second data line The second interface outside the shielding box is connected to the third terminal and the third interface outside the shielding box by using a third data line.

When testing, the test system performs the test as follows:

S201. The second terminal device sets an operating parameter of the access point, where the working parameter is used to indicate a transmission mode and a transmission protocol type of the access point.

S202. The second terminal device sets a parameter of the first terminal device as a client end and the third terminal device as a server end, and tests an uplink rate and a location of the first terminal device in the shielding box. The third terminal downlink rate is described.

The second terminal device sets a first parameter when the third terminal device is used as a server, and the first parameter includes at least a listening port number, a test thread number, and a transport layer protocol of the third terminal device. And reporting a time interval or the like, wherein the reporting time interval is a time interval between outputting two test rate values, and the second terminal device further sets the first terminal device as a client through the first data line a second parameter, the second parameter includes at least an IP address of the third terminal device, a listening port number of the third terminal device, a number of test threads, a test time, and the like, wherein the test time is The length of the test. Finally, the test is started, the second terminal device controls the first terminal device and the third terminal device to connect to the access point, and tests that the first terminal connects the access point in the shielding box. The uplink transmission rate and the downlink transmission rate when the third terminal connects the access point in the shielding box.

S203. The second terminal device resets the transmission mode of the access point, and repeats the foregoing step S202, and tests an uplink rate and the third terminal of the first terminal device in the shielding box in different transmission modes. Terminal downlink rate.

For example, if the first terminal device is a mobile phone, the second terminal device is a desktop computer, the access point is a router, and the third terminal device is a laptop computer, the above experiment may constitute a WiFi throughput rate. Up-and-down collision experiments in automated test systems. As shown in FIG. 2A, FIG. 2A is a schematic diagram of the WiFi throughput automatic test system. The external desktop computer of FIG. 2A is connected to the mobile phone in the shielding box through a USB cable, and the external desktop computer is respectively connected to the router and the notebook computer in the shielding box through two twisted pairs.

The desktop computer sets, by the twisted pair, a transmission mode, a transmission protocol type, an access point name, a password, and the like of the access point, where the transmission mode includes at least 802.11b, 802.11g, 802.11n, and 802.11. In this embodiment, the 802.11b mode is first set, and the transport protocol type includes at least a Transmission Control Protocol (TCP) and a User Datagram Protocol (UDP). In this embodiment, Set to TCP.

The desktop computer controls the notebook computer to open the iperf test software, and configure the notebook The parameters of the computer as the server, for example, the selection of the listening port number is 5001, the number of test threads is 1, the data output format is Mbits, the reporting interval is 1 second, the transmission protocol is TCP, etc., and then, if the mobile phone is an Android system a mobile phone, wherein the desktop computer sets an iperf parameter on the mobile phone by using an adb command. At this time, the mobile phone is used as a client, and the parameter to be set includes at least an IP address of the notebook computer, and the test time is 60 seconds. Monitoring port 5001, etc. Finally, the desktop computer controls the notebook computer and the mobile phone to run the test software, and the desktop computer outputs the uplink transmission after the mobile phone is connected to the router every 1 second. The rate and the downlink transmission rate of the notebook computer, after 60 seconds of the test time, output the average uplink transmission rate of the mobile phone and the downlink transmission rate of the notebook computer during the test time. It should be understood that the above examples are by way of example only and are not to be construed as limiting.

Testing the uplink transmission rate of the mobile phone in the 802.11b mode and the downlink transmission rate of the notebook, that is, completing an automatic test of the WiFi throughput rate when the uplink and downlink are transmitted in the same spatial channel, and then resetting the router. a transmission mode, respectively testing, by the router in the 802.11g, 802.11n, and 802.11mixed transmission modes, an uplink transmission rate of the mobile phone in the shielding box and a downlink transmission rate of the notebook computer in the shielding box .

By implementing the above embodiment, the shielding device and the external computer are used to control the terminal device in the shielding box to communicate with the access point, thereby completing the automatic test, which can solve the test process easily He interfered with the problem.

The embodiment of the present invention further provides another automated test system. Compared with the system shown in FIG. 1, the system adds a plurality of first terminal devices in the shielding box to form a test scenario in which multiple test machines compete, and the test system includes :

The first terminal device, the access point, the second terminal device, and the shielding box.

The first terminal device includes at least two identical terminal devices, the first terminal device and the access point are placed inside the shielding box, and the access point is used to be the first terminal. The device provides a first access service, and the second terminal device is disposed outside the shielding box. Before the start of the test, the first terminal device and the access point are placed inside the shielding box, and the first terminal device is connected to the first interface inside the shielding box by using the first data line. The second data line is used to connect the access point to a second interface inside the shielding box. Closing the shielding box, connecting, on the outside of the shielding box, the first terminal device to the first interface outside the shielding box, and the second data line connecting the second interface The terminal device and the second interface outside the shielding box are connected to the third terminal and the third connection outside the shielding box by the third data line.

When testing, the test system performs the test as follows:

S301. The second terminal device sets an operating parameter of the access point, where the working parameter is used to indicate a transmission mode and a transmission protocol type of the access point.

S302. The second terminal device sets the uplink rate of the first terminal device in the shielding box when the first terminal device is used as a parameter of the client and the second terminal device as the server.

The second terminal device sets a first parameter when the second terminal device is used as a server, and the first parameter includes at least a listening port number, a test thread number, a transport layer protocol, and a report time of the second terminal device. An interval or the like, wherein the reporting time interval is a time interval between outputting two test rate values, and the second terminal device further sets, by using the first data line, a plurality of first terminal devices as a client a second parameter, where the second parameter includes at least an IP address of the second terminal device, a listening port number of the second terminal device, a number of test threads, a test time, and the like, and controls the first terminal device connection The access point, wherein the test time is the duration of the test. Finally, a test is initiated to test an uplink transmission rate of the first terminal when the access point is connected to the access box.

S303. The second terminal device resets the transmission mode of the access point, and repeats the foregoing step S302 to test that the first terminal device and the third terminal device are in the shielding box in different transmission modes. Up and down rate.

For example, if the first terminal device is a mobile phone, the second terminal device is a desktop computer, and the access point is a router, the above experiment may constitute a multi-test machine competition experiment in the WiFi throughput automatic test system. . As shown in FIG. 6, FIG. 6 is a schematic diagram of the WiFi throughput automatic test system. In Fig. 6, the external desktop computer is connected to four mobile phones in the shielding box through a USB cable, and the external desktop computer is connected to the router in the shielding box through two twisted pairs.

The desktop computer opens the iperf test software, and configures the parameter of the desktop computer as a server. For example, the listening port number is 5001, the number of test threads is 1, and the data output format is Mbits. The reporting interval is 1 second, the transmission protocol is TCP, etc., and then, if the mobile phone is an Android system mobile phone, the desktop computer sets the parameters of the iperf on the plurality of mobile phones by using the adb command, and all the four mobile phones are used as the client. The parameter to be set includes at least the IP address of the desktop computer, the test time is set to 60 seconds, the listening port 5001 of the desktop computer, etc., and finally, the desktop computer controls the desktop computer and the four mobile phones to operate the The test software outputs the uplink transmission rate of each mobile phone connected to the router every 1 second, and outputs an average uplink transmission rate of each mobile phone during the test time after 60 seconds of the test time.

Testing the uplink transmission rate of the mobile phone in the 802.11b mode and the downlink transmission rate of the notebook, that is, completing the automatic test of the WiFi throughput rate when a multi-test machine competes, and then resetting the transmission mode of the router. Testing uplink and downlink transmission rates of the mobile phone in the shielding box in the 802.11g, 802.11n, and 802.11 mixed transmission modes of the router.

By implementing the above embodiment, the shielding device and the external computer are used to control the terminal device in the shielding box to communicate with the access point, thereby completing the automatic test, and solving the problem that the monitoring process is susceptible to other interference.

One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

What has been disclosed above is only a preferred embodiment of the present invention, and of course, the present invention cannot be limited thereto. Those skilled in the art can understand that all or part of the process of implementing the above embodiments, and equivalent changes made according to the claims of the present invention, are still within the scope of the invention.

Claims

An automatic test system, comprising:

The first terminal device is disposed in the shielding box;

An access point is disposed in the shielding box, and is configured to provide a first access service for the first terminal device;

The second terminal device is disposed outside the shielding box, the second terminal device is connected to the first terminal device by using a first data line, and the second terminal device is connected to the access point by using a second data line, where The second terminal device controls the quality of the first access service between the access point and the first terminal device to be tested.
The system of claim 1 wherein the system further comprises:

The third terminal device is disposed in the shielding box;

The access point is further configured to provide a second access service for the third terminal device;

The second terminal device is further configured to connect to the third terminal device by using a third data line, where the second terminal device controls the second access between the access point and the third terminal device The quality of the service is tested.
The system of claim 2 wherein:

The first terminal device is a client, and the second terminal device or the third terminal device is a server; or

The first terminal device is a server, and the second terminal device is a client.
A system according to claim 1 or 2, wherein

When the first terminal device, the second terminal device, or the third terminal device is used as a server, the parameters set by the server include at least the server listening port number, the number of test threads, the transport layer protocol, and Reporting interval, wherein the reporting interval is between output rate values Interval.
A system according to claim 1 or 2, wherein

When the first terminal device, the second terminal device, or the third terminal device is used as a client, the parameter set by the client includes at least an IP address of the server, the server listening port number, and a test. Number of threads and test time.
The system of claim 1 wherein:

The second terminal device sets the access point parameter, where the access point parameter includes at least a service set identifier, a password, an encryption mode, a bandwidth, a transmission mode, and a transmission protocol type of the wireless access point.
The system of claim 6 wherein:

The transmission mode of the access point includes at least 802.11b, 802.11g, 802.11n and 802.11mixed, and the transmission protocol type of the access point includes at least a TCP transmission protocol and a UDP transmission protocol.
The system according to claim 1, wherein the number of the first terminal devices is one or more.