WO2017152880A1

WO2017152880A1 - Method for testing performance of mobile network, mobile terminal, server and testing system

Info

Publication number: WO2017152880A1
Application number: PCT/CN2017/076325
Authority: WO
Inventors: 尹建华
Original assignee: 中兴通讯股份有限公司
Priority date: 2016-03-11
Filing date: 2017-03-10
Publication date: 2017-09-14
Also published as: CN107182075A

Abstract

Disclosed is a method for testing performance of a mobile network, comprising the following steps: a mobile terminal sending a first-type control packet to a server, and continuously sending a first-type data packet to the server after receiving a reply from the server; after the first-type data packet is sent, the mobile terminal sending a second-type control packet to the server to inform the server that uplink data transmission of a current round is completed; and receiving a second-type data packet sent by the server, acquiring uplink performance statistical data calculated by the server when a third-type control packet sent by the server is received, calculating downlink performance statistical data of the current round, and witting the uplink performance statistical data and the downlink performance statistical data into a testing log file. Also disclosed are a mobile terminal, a server and a testing system. The present invention can test the performance of a real network so as to acquire indexes such as packet loss, disorder and throughput on an end-to-end link, thereby being able to accurately diagnose a mobile network.

Description

Mobile network performance testing method, mobile terminal, server and test system

Technical field

The present invention relates to the field of communications technologies, and in particular, to a performance testing method for a mobile network, a mobile terminal, a server, and a testing system.

Background technique

At present, the optimization for mobile networks is gradually concentrated on user perception, and the influencing factors of user perception are obviously very complicated. Excluding the factors such as tariffs and psychological differences, all links from the terminal to the end-to-end link of the server, Both may affect the performance of the business, and thus affect the user's perception of the quality of the service.

The current optimization method is often focused on a single point on the end-to-end link, such as packet capture on the terminal side, packet capture on the internal network element of the access network, or monitoring analysis using a hard probe device. These methods can solve some problems, but when it is necessary to conduct an in-depth analysis of a certain indicator for a single complaint case, if it needs to be hop-by-hop, package-by-package analysis and troubleshooting, it still seems to be incapable.

The above content is only used to assist in understanding the technical solutions of the present invention, and does not constitute an admission that the above is prior art.

Summary of the invention

The main purpose of the present invention is to provide a performance testing method for a mobile network, a mobile terminal, a server, and a test system, which are designed to perform performance testing on a real network by using a mobile terminal to obtain packet loss and mess on an end-to-end link. Indicators such as order and throughput allow accurate diagnosis of mobile networks.

To achieve the above objective, the present invention provides a performance testing method for a mobile network, and the performance testing method of the mobile network includes the following steps:

The mobile terminal sends the first type control packet to the server, and after receiving the reply of the server, continuously sends a predetermined number of first type data packets to the server;

After the first type of data packet is sent, the mobile terminal sends the second type control packet to the a server to notify the server that the uplink data transmission is completed in the current round;

Receiving a second type of data packet sent by the server, and receiving the third type control packet sent by the server, acquiring uplink performance statistics calculated by the server, and calculating downlink performance statistics of the current round, The uplink performance statistics and downlink performance statistics are written into the test log file.

Preferably, after the step of receiving the second type of data packet sent by the server, the method further includes:

Determining whether the value of the terminal time stamp bounce field of the second type of data packet is a first predetermined value;

If not, acquiring a receiving moment of the second type of data packet;

Calculating a difference between the receiving time, the first predetermined value, and the internal processing delay of the server, obtaining a valid delay, and recording the valid delay into the test log file;

The internal processing delay of the server is calculated by the server according to a difference between a current time and a joining time of the first type of data packet into the queue.

Preferably, when receiving the third type control packet sent by the server, acquiring uplink performance statistics calculated by the server, and calculating downlink performance statistics of the current round, and using the uplink performance statistics and the downlink The steps to write performance statistics to the test log file include:

When receiving the third type control packet, the mobile terminal acquires uplink performance statistics calculated by the server from the third type control packet;

Calculating downlink performance statistics of the current round including the packet loss rate, the out-of-order rate, and the throughput rate indicator according to the message queue corresponding to the server side;

And synthesizing the results of the cost round test according to the downlink performance statistics and the uplink performance statistics, and recording the results in the test log file.

To achieve the above objective, the present invention also provides a performance testing method for a mobile network, where the performance testing method of the mobile network includes:

When receiving the first type control packet sent by the mobile terminal, the server bounces the first type control packet back to the mobile terminal;

Receiving a first type of data packet sent by the mobile terminal, and continuously transmitting a predetermined number of second type data packets to the mobile terminal when receiving the second type of control packet sent by the mobile terminal;

After the second type of data packet is sent, the uplink performance statistics of the current round are calculated, and the uplink performance statistics are put into the third type control packet, and then the third type control packet is used. Sending to the mobile terminal, where the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into the test log file.

Preferably, when the server receives the first type control packet sent by the mobile terminal, the step of bounce the first type control packet back to the mobile terminal includes:

The server parses out an international mobile subscriber identity (IMSI) contained in the first type of control packet, and searches for a corresponding user record according to the IMSI;

If the user record is found, the server bounces the first type control packet back to the mobile terminal, and creates a new user record;

If not, the server creates a new user record and bounces the first type of control packet back to the mobile terminal.

Preferably, the step of the server bounces the first type of control packet back to the mobile terminal after receiving the first type of control packet sent by the mobile terminal further includes:

The server searches for a corresponding user record according to the IMSI;

If the user record is found, the server extracts the number of rounds of the first type of data packet, the terminal side packet time stamp field, and the serial number, and places the first type data packet according to the serial number. Entering a predetermined position of the queue, and setting the in-position field of the queue to a second predetermined value;

If not, the first type of data packet is ignored.

Preferably, after the step of placing the first type of data packet into a predetermined position of the queue according to the serial number, and setting the in-position field of the queue to a second predetermined value, the method further includes:

Obtaining, by the server, the current time and the enqueue time of the first type of data packet into the queue;

Calculating a difference between the current time and the enqueue time, and obtaining a processing delay of the server.

To achieve the above objective, the present invention further provides a mobile terminal, where the mobile terminal includes:

a first sending module, configured to send a first type control packet to the server, and continuously send a predetermined number of first type data packets to the server after receiving the reply of the server;

The second sending module is configured to send the second type of control packet to the server after the first type of data packet is sent, to notify the server that the uplink data transmission is completed in the current round;

The calculation processing module is configured to receive the second type of data packet sent by the server, and obtain the uplink performance statistics calculated by the server when receiving the third type control packet sent by the server, and calculate the current round of the performance statistics Downstream performance statistics, the uplink performance statistics and the next Line performance statistics are written to the test log file.

Preferably, the server comprises:

a bounce module, configured to bounce the first type control packet back to the mobile terminal when receiving the first type control packet sent by the mobile terminal;

a third sending module, configured to receive a first type of data packet sent by the mobile terminal, and continuously send a predetermined number of second types to the mobile terminal when receiving the second type of control packet sent by the mobile terminal data pack;

The fourth sending module is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet, and then The three types of control packets are sent to the mobile terminal, so that the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into the test log file.

To achieve the above object, the present invention also provides a test system including a mobile terminal and a server.

The mobile terminal includes:

The calculation processing module is configured to receive the second type of data packet sent by the server, and obtain the uplink performance statistics calculated by the server when receiving the third type control packet sent by the server, and calculate the current round of the performance statistics The downlink performance statistics data is sent to the test log file by using the uplink performance statistics and the downlink performance statistics.

The server includes:

The fourth sending module is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet, and then Sending the third type control packet to the mobile terminal, where the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into a test log file.

The performance testing method for the mobile network provided by the present invention, the mobile terminal, the server and the testing system, send the first type control packet to the server through the mobile terminal, and continuously send the first type data packet to the server after receiving the reply from the server After the transmission is completed, the mobile terminal sends the second type control packet to the server to notify the current round of uplink data transmission, and obtains the uplink performance statistics calculated by the server when receiving the third type control packet sent by the server. And calculating downlink performance statistics of the current round, and then writing the uplink performance statistics and downlink performance statistics into the test log file. In this way, the mobile terminal is used to perform performance testing on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, so that the mobile network can be accurately diagnosed.

DRAWINGS

1 is a schematic flowchart of a first embodiment of a performance testing method for a mobile network according to the present invention;

2 is a schematic diagram of an embodiment of different types of control packets and data packets defined by the present invention;

3 is a schematic diagram of sending and receiving a packet between a mobile terminal and a server according to the present invention;

4 is a schematic flowchart diagram of a second embodiment of a performance testing method for a mobile network according to the present invention;

FIG. 5 is a schematic diagram showing the refinement process of step S13 in FIG. 4;

6 is a schematic flowchart of a third embodiment of a performance testing method for a mobile network according to the present invention;

FIG. 7 is a schematic diagram showing the refinement process of step S21 in FIG. 6;

FIG. 8 is a schematic diagram showing the field composition of each message according to the present invention; FIG.

9 is a schematic flowchart of a fourth embodiment of a performance testing method for a mobile network according to the present invention;

10 is a schematic flowchart of a fifth embodiment of a performance testing method for a mobile network according to the present invention;

11 is a schematic diagram of a message queue on the server side;

FIG. 12 is a schematic diagram of functional modules of an embodiment of a mobile terminal according to the present invention; FIG.

FIG. 13 is a schematic diagram of functional modules of an embodiment of a server according to the present invention; FIG.

14 is a schematic diagram of functional modules of an embodiment of a test system of the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The present invention provides a performance testing method for a mobile network. Referring to FIG. 1, in an embodiment, the performance testing method of the mobile network includes the following steps:

Step S11, the mobile terminal sends the first type control packet to the server, and after receiving the reply of the server, continuously sends a predetermined number of first type data packets to the server;

In the present invention, the mobile terminal and the server are used together, and both parties need to comply with a specific test protocol, and the protocol mainly includes an interaction step, a format definition of the control packet and the data packet, and an abnormal situation processing. Therefore, from the perspective of implementation, the mobile terminal periodically sends the uplink control packet and the data packet in a specific mode according to the test protocol, receives the downlink data packet and completes the statistical calculation, and saves the test log file for subsequent analysis; and the server presses the control protocol. Receiving various uplink data packets, calculating the uplink performance statistics indicators, carrying them to the mobile terminal, and transmitting the downlink control packets and data packets according to the test protocol.

In this embodiment, the first type control packet carries the control parameter of the downlink sending packet, and after the mobile terminal receives the reply of the server, the mobile terminal starts the sending process.

The present invention defines different types of control packets and data packets, a first type of control packet (S packet), a first type of data packet (U packet), a second type of control packet (# packet), and a second type of data packet (D). Package), third type control package ($package), fourth type control package (T package), specifically refer to Figure 2 and Figure 3:

Among them, the S and T packages are the control packets issued by the user after pressing the start and stop buttons, respectively, and other packages will appear in each round of testing. For example, if the user configures 10 rounds of tests, the test will normally include U(N)-#-D(N)-$-U(N)-#-D(N)-$-.. This cycle is 10 times. N is configurable and can be selected by the protocol executor. In the following, N=1000 is taken as an example. Where 1000 appears, it corresponds to 1000 U or D packages.

Step S12: After the first type of data packet is sent, the mobile terminal sends a second type control packet to the server, to notify the server that the uplink data transmission is complete.

In this embodiment, after the N U packets are sent, the mobile terminal notifies the server that the uplink data transmission of the current round is completed, and the server starts to continuously send N D packets at this time.

Step S13: Receive a second type of data packet sent by the server, and obtain uplink performance statistics calculated by the server when receiving the third type control packet sent by the server, and calculate downlink performance statistics of the current round. Data, the uplink performance statistics and downlink performance statistics The data is written to the test log file.

In this embodiment, after receiving the $ packet, the mobile terminal calculates the downlink performance statistics of the current round, and writes the test log file together with the uplink performance statistics calculated by the server.

The above is a round of packet sending loop, and the normal situation will enter the next round of the packet sending loop, and steps S11 to S13 are repeated. When the mobile terminal receives the stop command, the fourth type control packet is sent to the server to end the mobile Network performance testing.

In this embodiment, the mobile terminal enters the next round of packet transmission, the mobile terminal first sends N U packets, and the server sends N D packets, that is, adopts a half duplex test mode until the user presses the stop button to trigger a stop command, and the mobile terminal Then send a T packet to the server to end the performance test for the mobile network.

The mobile network mentioned in the present invention includes, but is not limited to, GSM (Global System for Mobile Communication), UMTS (Universal Mobile Telecommunications System, UMTS (Universal Mobile Telecommunications System), CDMA ( Code Division Multiple Access, TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplex-Long Term Evolution), TDD-LTE ( Wireless system such as time division duplexing-long-term evolution technology. In addition to the access network, it also includes PS (Packet Switch) data domain core network, IP transmission network and various service servers on the Internet, which constitutes the whole. End-to-end service transmission path.

The performance testing method for the mobile network provided by the present invention sends a first type control packet to the server through the mobile terminal, and continuously sends the first type data packet to the server after receiving the reply from the server, and the mobile terminal sends the first type data packet to the server. The second type of control packet is sent to the server to notify the current round of uplink data transmission. When the third type control packet sent by the server is received, the uplink performance statistics calculated by the server are obtained, and the downlink performance of the current round is calculated. The statistics are then written into the test log file by the uplink performance statistics and the downlink performance statistics. In this way, the mobile terminal is used to perform performance testing on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, so that the mobile network can be accurately diagnosed.

In an embodiment, as shown in FIG. 4, on the basis of the foregoing embodiment of FIG. 1, in the embodiment, the step S13, after receiving the second type of data packet sent by the server, further includes:

Step S14, determining whether the value of the terminal timestamp bounce field of the second type of data packet is the first predetermined value;

Step S15, if no, acquiring a receiving moment of the second type of data packet;

Step S16: Calculate a difference between the receiving time, the first predetermined value, and the internal processing delay of the server, obtain a valid delay, and record the valid delay into the test log file.

In this embodiment, when the mobile terminal receives each D packet, the "terminal time stamp bounce" field in the D packet is directly taken from the "terminal side packet time stamp Tm" field in the corresponding U packet. If the terminal side time stamp Tm included in the terminal side is not 0 (the first predetermined value), the "server internal processing delay" in the D packet can be subtracted according to the difference between the receiving time and the Tm, thereby obtaining an effective one. Round trip delay and record the round trip delay to the test log file. If Tm is 0, the round trip delay cannot be obtained. Similar to the processing of the uplink U packet by the server, the mobile terminal extracts relevant information of each D packet and records it in the message queue on the mobile terminal side.

In an embodiment, as shown in FIG. 5, on the basis of the foregoing embodiment of FIG. 1 or FIG. 4, in the embodiment, the step S13 includes:

Step S131, the mobile terminal acquires uplink performance statistics calculated by the server from the third type control packet when receiving the third type control packet.

Step S132, calculating downlink performance statistics of the current round including the packet loss rate, the out-of-order rate, and the throughput rate indicator according to the queue corresponding to the server side;

Step S133, according to the downlink performance statistics data, combined with the uplink performance statistics data, comprehensively collate the final result of the cost round test, and record it in the test log file.

In this embodiment, since the $packet indicates that the downlink D packet is sent, the mobile terminal starts to receive the downlink corresponding packet according to the message queue of the mobile terminal (corresponding to the server side) after receiving the first packet. Indicators such as rate, out-of-order rate and throughput rate, combined with the uplink corresponding indicator extracted from the package (because the uplink indicator has been calculated by the server, the field is placed in the $package, the mobile terminal can extract it), as this round The final result of the test is recorded in the test log file.

The mobile terminal continues to receive the $packet and should normally receive four more. If you have received 4 After receiving n (n<4), the remaining $ packets expired during the receiving process (the timeout threshold is determined by the executor), and it is considered that the packet is received and the mobile terminal enters the next round. U-#-D-$ send and receive loop. It can be understood that this embodiment does not limit the specific number of receiving $packets.

When the user presses the test stop button, the mobile terminal continuously sends a predetermined number, such as 5 T packets, to the server, at which point the test is directly ended and the local resources are released. When the server receives the first T packet, it deletes the record corresponding to the user, and after receiving other duplicate T packets, there is no action.

The present invention also provides a performance testing method for a mobile network. Referring to FIG. 6, in an embodiment, the performance testing method of the mobile network includes the following steps:

Step S21: When receiving the first type control packet sent by the mobile terminal, the server bounces the first type control packet back to the mobile terminal;

In the present invention, the mobile terminal and the server are used together, and both parties need to comply with a specific test protocol, and the protocol mainly includes an interaction step, a format definition of the control packet and the data packet, and an abnormal situation processing. Therefore, from the perspective of implementation, the mobile terminal periodically sends the uplink control packet and the data packet in a specific mode according to the test protocol, receives the downlink data packet and completes the statistical calculation, and saves the test log file for subsequent analysis; and the server presses the control protocol. Receiving various uplink data packets, carrying the uplink indicators into the mobile terminal, and transmitting the downlink control packets and data packets according to the test protocol.

Step S22, receiving a first type of data packet sent by the mobile terminal, and continuously transmitting a predetermined number of second type data packets to the mobile terminal when receiving the second type control packet sent by the mobile terminal;

In this embodiment, the server continuously sends a predetermined number of N D packets to the mobile terminal, and after the transmission is completed, the server calculates the uplink performance statistics of the current round, and puts the uplink performance statistics into the $package, and then Send the $ packet to the mobile terminal. Among them, the $ package also indicates that the downlink data of this round has been sent.

Step S23, after the second type of data packet is sent, calculate uplink performance statistics of the current round, and put the uplink performance statistics into a third type control packet, and then use the third type control packet. Sending to the mobile terminal, where the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into the test log file.

In this embodiment, when the server sends the D packet, the server calculates the uplink statistics of the current round, and puts the uplink performance statistics into the $packet, and sends the data to the mobile terminal, after the mobile terminal receives the $packet. The downlink performance statistics of the current round are calculated, and the mobile terminal writes the uplink performance statistics and the downlink performance statistics together into the test log file.

The above is a round of packet delivery cycle. Normally, the next round of the packet issuance cycle is repeated, and steps S21 to S23 are repeated. When the mobile terminal receives the stop command, the fourth type control packet is sent to the server, when the server receives the message. When the T packet is used, the performance test for the mobile network is ended.

The performance testing method for the mobile network provided by the present invention, when the server receives the first type control packet sent by the mobile terminal, bounces the first type control packet back to the mobile terminal, and receives the second type control sent by the mobile terminal. When the packet is transmitted, the second type of data packet is continuously sent to the mobile terminal, waiting for After the transmission is completed, the uplink performance statistics of the current round are calculated, and placed in the third type control packet, and then the third type control packet is sent to the mobile terminal, so that the mobile terminal performs uplink performance statistics and the calculated downlink performance. Statistics are written to the test log file. In this way, by performing performance tests on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, accurate diagnosis of the mobile network can be performed.

In an embodiment, as shown in FIG. 7, on the basis of the foregoing embodiment of FIG. 6, in the embodiment, the step S21 includes:

Step S211, the server parses out an international mobile subscriber identity IMSI contained in the first type control packet, and searches for a corresponding user record according to the IMSI;

Step S212, if the user record is found, the server bounces the first type control packet back to the mobile terminal, and creates a new user record;

In this embodiment, the process of receiving the S packet by the server is as follows:

The server parses the IMSI contained in the S packet, and searches for the corresponding user record according to the IMSI; if the user record corresponding to the IMSI is found, it indicates that the resource preparation of the server side has been completed, but the response S packet that may be bounced back by the server last time may be If it is lost, the mobile terminal does not receive it, and this time it receives the retransmission S packet sent by the mobile terminal again. At this time, the server only needs to replay the retransmitted S packet. Another possibility is that when the mobile network was tested for performance last time, the mobile terminal was abnormal, causing it to fail to exit normally. In order to put the system in a predictable initialization state, the user record corresponding to the IMSI needs to be re-established.

Step S213, if not, the server creates a new user record and bounces the first type control packet back to the mobile terminal.

In this embodiment, if the server does not find the user record corresponding to the IMSI, a new user record corresponding to the IMSI is created, wherein the core information included in the newly created user record is a message queue of length 1000, each message The field composition is as shown in FIG. 8 , which specifically includes: the round number of rounds of the package, the serial number Seq of the packet, the time stamp Tm of the terminal side, the time stamp Ts of the server side, and whether the predetermined slot of the queue receives the package Valid. Before each round of packet delivery, all fields of all messages are reset to zero. After the user record is created, the server bounces back to the S packet as a response (here, the bouncing back server returns the received packet to the mobile terminal as it is), and the mobile terminal receives A predetermined number of N U packets are continuously transmitted to the server immediately after the response.

Therefore, in the present invention, the server only needs to receive the S packet, regardless of whether it is repeated or not, to establish a new user record corresponding to the IMSI, and bounce back the S packet to the mobile terminal. The mobile terminal must receive the bounced S packet before it can start sending U packets to the server. In this way, the mobile terminal can confirm that the server resource (message queue) is allocated.

In this embodiment, the mobile terminal uses a receiving timeout mechanism (the threshold can be selected by the actual performer). If the mobile terminal receives the S packet timeout, the S packet is retransmitted, and the process continues to try the predetermined number of times, such as 5 times, if within 5 times. All failed, the mobile terminal gave up the test and prompted the user to fail the test.

In an embodiment, as shown in FIG. 9, on the basis of the foregoing embodiment of FIG. 7, in this embodiment, after the step S21, the method further includes:

Step S24, the server searches for a corresponding user record according to the IMSI;

Step S25: If the user record is found, the server extracts the number of rounds of the first type of data packet, the terminal side packet time stamp field, and the serial number, and the first type according to the serial number. The data packet is placed in a predetermined position of the queue, and the in-position field of the queue is set to a second predetermined value;

Step S26, if no, the first type of data packet is ignored.

In this embodiment, the server searches for the corresponding user record according to the IMSI. If the corresponding user record is not found, the T packet may first arrive and trigger the user record to be deleted, and the U packet is the out-of-order packet. . Therefore, no action is taken at this time, and the U package is ignored.

If the server finds the corresponding user record according to the IMSI, the server extracts the round number of rounds of each U packet, the time stamp field Tm of the terminal side, and the serial number, and subscripts the serial number to find the message queue. Corresponding location, write the corresponding message, and set the Valid field of the message to 1. The Ts timestamp field in the message is the time when the server receives the packet, in case it is used to calculate the delay of the internal processing of the server. If a location does not receive a packet at the end, indicating that the U packet is missing, the Tm corresponding to this location is 0.

After the mobile terminal sends 1000 U packets, it directly sends a #Pack, and then starts receiving the D packets sent by the server. If the timeout server has not received the D packet, the #包 will be sent repeatedly. If the D packet is still not received after the predetermined number of attempts, such as 5 times, the mobile terminal abandons the test and prompts the user to fail the test.

In an embodiment, as shown in FIG. 10, on the basis of the foregoing embodiment of FIG. 9, in the embodiment, after the step S25, the method further includes:

Step S26, the server acquires the current time and the enqueue time of the first type of data packet into the queue;

Step S27: Calculate a difference between the current time and the enqueue time to obtain a server internal processing delay.

In this embodiment, the field definitions of most of the packages have been explicitly shown in Figures 1 and 2, and only the D packets and the packets are highlighted here. The "terminal timestamp bounce" field in the D packet is directly taken from the "terminal side packet timestamp" field in the corresponding U packet, and the mobile terminal receives the D packet minus the bounced U packet transmission time stamp. This is the round-trip delay of this particular sequence number packet, denoted as T1. However, since each packet is queued in the server (the downlink transmission process can be started after all the uplink packets are received in sequence), the "server internal processing delay" field is provided in the D packet, which is recorded as T2, T1-T2. It reflects the end-to-end round-trip delay on the true transmission path. Finally, the $ packet contains performance statistics about the current round of the uplink, because this information can only be fed back to the mobile terminal by the server. The mobile terminal can calculate the downlink performance statistics of the current round.

When the server receives the # packet, no matter how many times it receives the # packet, it immediately starts sending 1000 D packets in sequence. The "server internal processing delay" field in the packet is determined by the server according to the current time and the corresponding U packet. The difference between the entry time Ts is calculated. It should be noted that, as described in step S26, for a message whose Tm is 0 in the queue, the Tm field of the corresponding D packet is also 0. After the mobile terminal receives the D packet (if the D packet is not lost), it can be determined whether the U packet corresponding to the location is lost during uplink transmission by checking whether the Tm field of the D packet is 0. Through this mechanism, the mobile terminal can learn the specific number of each downlink packet by analyzing the receiving queue of the D packet, and can also derive the specific number of each uplink packet by using the Tm field of the D packet.

After all the D packets are sent, the server calculates the uplink packet loss rate, out-of-order rate and throughput rate according to the message queue to construct the $ packet, and then continuously sends 5 packets to the terminal to ensure that the terminal can receive the packet.

As shown in FIG. 11, according to the message queue of the server, the performance indicators of the uplink can be calculated. The mobile terminal also maintains a similar queue, and the calculation method is similar, which is omitted here. T1 in Figure 10< T2<T3<...<Ti<...<T1000 is an incremental sequence, and X represents that the uplink U packet corresponding to the serial number is not received by the server. The calculation methods of each indicator are as follows:

1) Upstream packet loss rate = sum of all Xs / 1000;

2) Upstream throughput rate = sum of bytes of all packets received in the uplink / (maximum value of Ti - minimum value of Ti);

Because of the possibility of out-of-order, T2 and T3 in Figure 10 represent that the U packet with sequence number 3 arrives before the second, so the maximum and minimum values of Ti need to be scanned after the message queue is obtained;

3) Upstream out-of-order rate = sum of times of uplink out-of-orders / total number of packets received in the uplink;

Out-of-order number calculation: For each non-X message, extract its Ts value (marked as left) and the next Ts value (denoted as right). If right<left, it is recorded as an out-of-order. For example, T2 < T3 in Fig. 4, so an out of order occurs.

The present invention further provides a mobile terminal 1. Referring to FIG. 12, in an embodiment, the mobile terminal 1 includes:

The first sending module 11 is configured to send the first type control packet to the server, and continuously send a predetermined number of first type data packets to the server after receiving the reply of the server;

In the present invention, the mobile terminal 1 and the server are used together, and both parties need to comply with a specific test protocol, and the protocol mainly includes an interaction step, a control packet and a format definition of the data packet, and an abnormal situation processing. Therefore, from the perspective of implementation, the mobile terminal 1 periodically transmits the uplink control packet and the data packet in a specific mode according to the test protocol, receives the downlink data packet and completes the statistical calculation, and saves the test log file for subsequent analysis; The protocol receives various uplink data packets, carries the calculation of the uplink indicator to the mobile terminal 1, and sends the downlink control packet and the data packet according to the test protocol.

In this embodiment, the first type control packet carries the control parameters of the downlink packet, and after the mobile terminal 1 receives the reply from the server, the mobile terminal 1 starts the packet sending process.

Among them, the S and T packages are the control packets issued by the user after pressing the start and stop buttons, respectively, and other packages will appear in each round of testing. For example, if the user configures 10 rounds of tests, the test is normal. In the line, it will contain U(N)-#-D(N)-$-U(N)-#-D(N)-$-... cycles 10 times. N is configurable and can be selected by the protocol executor. In the following, N=1000 is taken as an example. Where 1000 appears, it corresponds to 1000 U or D packages.

The second sending module 12 is configured to send the first type of data packet to the server, and the mobile terminal 1 sends the second type of control packet to the server to notify the server that the uplink data transmission is completed.

In this embodiment, after the N U packets are transmitted, the mobile terminal 1 notifies the server that the uplink data transmission of the current round is completed by the # packet, and the server starts to continuously send N D packets at this time.

The calculation processing module 13 is configured to receive the second type of data packet sent by the server, and obtain the uplink performance statistics calculated by the server when the third type control packet sent by the server is received, and calculate the current round The downlink performance statistics data is written into the test log file by using the uplink performance statistics and the downlink performance statistics.

In this embodiment, after receiving the $ packet, the mobile terminal 1 calculates the downlink performance statistics of the current round, and writes the test log file together with the uplink performance statistics calculated by the server.

The above is a round of packet transmission cycle. Normally, the next round of the packet issuance cycle is repeated, and steps S11 to S13 are repeated. When the mobile terminal 1 receives the stop command, the fourth type control packet is sent to the server to end the target. Performance testing of mobile networks.

In this embodiment, the next round of the packet issuance cycle, the mobile terminal 1 first sends N U packets, and the server sends N D packets, that is, adopts the half duplex test mode until the user presses the stop button to trigger the stop command, and moves. Terminal 1 then sends a T packet to the server to end the performance test for the mobile network.

The mobile terminal 1 provided by the present invention sends a first type of data packet to the server by sending a first type of control packet to the server, and after receiving the reply of the server, continuously sends the first type of data packet to the server, and after the transmission is completed, the second type control packet is sent to the server. In order to inform the current round of uplink data transmission completion, when receiving the third type control packet sent by the server, acquiring uplink performance statistics calculated by the server, and calculating downlink performance statistics of the current round, and then The uplink performance statistics and downlink performance statistics are written to the test log file. In this way, the mobile terminal 1 is used to perform performance tests on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, so that the mobile network can be accurately diagnosed.

The present invention also provides a server 2, referring to FIG. 13, in an embodiment, the server 2 includes:

The bounce module 21 is configured to, when receiving the first type control packet sent by the mobile terminal 1, bounce the first type control packet back to the mobile terminal 1;

In the present invention, the mobile terminal 1 and the server 2 are used together, and both parties need to comply with a specific test protocol, and the protocol mainly includes an interaction step, a control packet and a format definition of the data packet, and an abnormal situation processing. Therefore, from the perspective of implementation, the mobile terminal 1 periodically transmits the uplink control packet and the data packet in a specific mode according to the test protocol, receives the downlink data packet and completes the statistical calculation, and saves the test log file for subsequent analysis; The control protocol receives various uplink data packets, carries the calculation of the uplink indicator to the mobile terminal 1, and sends the downlink control packet and the data packet according to the test protocol.

In this embodiment, the first type control packet carries the control parameters of the downlink packet, and after the mobile terminal 1 receives the reply from the server 2, the mobile terminal 1 starts the packet sending process.

The third sending module 22 is configured to receive the first type of data packet sent by the mobile terminal 1, and continuously send the predetermined number to the mobile terminal 1 when receiving the second type of control packet sent by the mobile terminal 1. Second type of data packet;

In this embodiment, the server 2 continuously sends a predetermined number of N D packets to the mobile terminal 1. After the transmission is completed, the server 2 calculates the uplink performance statistics of the current round, and puts the uplink performance statistics into the package. In the middle, the $ packet is sent to the mobile terminal 1. Among them, the $ package also indicates that the downlink data of this round has been sent.

The fourth sending module 23 is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet, and then The third type of control packet is sent to the mobile terminal 1 for the mobile terminal 1 to write the uplink performance statistics and the calculated downlink performance statistics into the test log file.

In this embodiment, when the D packet is sent, the server 2 calculates the uplink statistics of the current round, and puts the uplink performance statistics into the $packet, and sends the data to the mobile terminal 1, when the mobile terminal 1 receives the After the $ packet, the downlink performance statistics of the current round are calculated, and the mobile terminal 1 writes the uplink performance statistics and the downlink performance statistics together into the test log file.

The above is a round of packet delivery cycle. Normally, the next round of the packet issuance cycle is repeated, and steps S21 to S23 are repeated. When the mobile terminal 1 receives the stop command, the fourth type control packet is sent to the server 2, when the server 2 When the T packet is received, the performance test for the mobile network is ended.

In this embodiment, the next round of the packet issuance loop, the mobile terminal 1 first sends N U packets, and the server 2 sends N D packets, that is, adopts the half duplex test mode until the user presses the stop button to trigger the stop command. The mobile terminal 1 then transmits a T packet to the server 2 to end the performance test for the mobile network.

The mobile network mentioned in the present invention includes, but is not limited to, GSM (Global System for Mobile Communication), UMTS (Universal Mobile Telecommunications System, UMTS (Universal Mobile Telecommunications System), CDMA ( Code Division Multiple Access, TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplex-Long Term Evolution), TDD-LTE ( Wireless system such as time division duplexing-long-term evolution technology. In addition to the access network, it also includes a PS (Packet Switch) data domain core network, an IP transmission network, and various service servers 2 on the Internet. End-to-end Service transmission path.

The server 2 provided by the present invention, when receiving the first type control packet sent by the mobile terminal 1, bounces the first type control packet back to the mobile terminal 1, and when receiving the second type control packet sent by the mobile terminal 1, And continuously transmitting the second type of data packet to the mobile terminal 1, and after the transmission is completed, calculating the uplink performance statistics data of the current round, and putting the third type control packet into the third type control packet, and then sending the third type control packet to the mobile terminal 1, The mobile terminal 1 writes the uplink performance statistics and the calculated downlink performance statistics into the test log file. In this way, by performing performance tests on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, accurate diagnosis of the mobile network can be performed.

The present invention also provides a test system 100. Referring to FIG. 14, in an embodiment, the test system 100 includes a mobile terminal 1 and a server 2.

In an embodiment, referring to FIG. 12, the mobile terminal 1 includes:

The first sending module 11 is configured to send the first type control packet to the server 2, and after receiving the reply of the server 2, continuously send a predetermined number of first type data packets to the server 2;

The second sending module 12 is configured to send the first type of data packet to the server 2, and the mobile terminal 1 sends the second type of control packet to the server 2 to notify the server 2 that the uplink data transmission is completed.

The calculation processing module 13 is configured to receive the second type of data packet sent by the server 2, and obtain the uplink performance statistics calculated by the server 2 when receiving the third type control packet sent by the server 2, and Calculating downlink performance statistics of the current round, and writing the uplink performance statistics and downlink performance statistics into the test log file;

In an embodiment, referring to FIG. 13, the server 2 includes:

The fourth sending module 23 is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet. The third type control packet is sent to the mobile terminal 1 for the mobile terminal 1 to write the uplink performance statistics and the calculated downlink performance statistics into the test log file.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Industrial applicability

The present invention relates to the field of communication technologies, in which a mobile terminal sends a first type of control packet to a server, and after receiving a reply from the server, continuously transmits a first type of data packet to the server, and after the transmission is completed, the mobile terminal sends a second type of control. Packet to the server to inform the current round of uplink data transmission completion, when receiving the third type control packet sent by the server, obtaining the calculation calculated by the server The uplink performance statistics are calculated, and the downlink performance statistics of the current round are calculated, and then the uplink performance statistics and the downlink performance statistics are written into the test log file. In this way, the mobile terminal is used to perform performance testing on the real network to obtain indicators such as packet loss, out-of-order, and throughput on the end-to-end link, so that the mobile network can be accurately diagnosed.

Claims

A performance testing method for a mobile network, the performance testing method of the mobile network includes:

The mobile terminal sends the first type control packet to the server, and after receiving the reply of the server, continuously sends a predetermined number of first type data packets to the server;

After the first type of data packet is sent, the mobile terminal sends a second type of control packet to the server to notify the server that the uplink data transmission is complete.

Receiving a second type of data packet sent by the server, and receiving the third type control packet sent by the server, acquiring uplink performance statistics calculated by the server, and calculating downlink performance statistics of the current round, The uplink performance statistics and downlink performance statistics are written into the test log file.
The method for testing a performance of a mobile network according to claim 1, after the step of receiving the second type of data packet sent by the server, the method further comprises:

Determining whether the value of the terminal time stamp bounce field of the second type of data packet is a first predetermined value;

If not, acquiring a receiving moment of the second type of data packet;

Calculating a difference between the receiving time, the first predetermined value, and the internal processing delay of the server, obtaining a valid delay, and recording the valid delay into the test log file;

The internal processing delay of the server is calculated by the server according to a difference between a current time and a joining time of the first type of data packet into the queue.
The performance testing method of the mobile network according to claim 1 or 2, wherein when receiving the third type control packet sent by the server, acquiring uplink performance statistics calculated by the server, and calculating the downlink of the current round Performance statistics, the steps of writing the uplink performance statistics and downlink performance statistics into the test log file include:

When receiving the third type control packet, the mobile terminal acquires uplink performance statistics calculated by the server from the third type control packet;

Calculating downlink performance statistics of the current round including the packet loss rate, the out-of-order rate, and the throughput rate indicator according to the message queue corresponding to the server side;

According to the downlink performance statistics and the uplink performance statistics, the test results of the cost round test are comprehensively compiled and recorded in the test log file.
A performance testing method for a mobile network, the performance testing method of the mobile network includes:

When the server receives the first type control packet sent by the mobile terminal, the first type control The package is bounced back to the mobile terminal;

Receiving a first type of data packet sent by the mobile terminal, and continuously transmitting a predetermined number of second type data packets to the mobile terminal when receiving the second type of control packet sent by the mobile terminal;

After the second type of data packet is sent, the uplink performance statistics of the current round are calculated, and the uplink performance statistics are put into the third type control packet, and then the third type control packet is sent to the The mobile terminal is configured to write, by the mobile terminal, the uplink performance statistics and the calculated downlink performance statistics into a test log file.
The method for testing performance of a mobile network according to claim 4, wherein when the server receives the first type of control packet sent by the mobile terminal, the step of bounce the first type of control packet back to the mobile terminal includes:

The server parses out an international mobile subscriber identity (IMSI) contained in the first type of control packet, and searches for a corresponding user record according to the IMSI;

If the user record is found, the server bounces the first type control packet back to the mobile terminal, and creates a new user record;

If not, the server creates a new user record and bounces the first type of control packet back to the mobile terminal.
The method for testing performance of a mobile network according to claim 4 or 5, wherein the step of the server bounces the first type of control packet back to the mobile terminal when receiving the first type of control packet sent by the mobile terminal It also includes:

The server searches for a corresponding user record according to the IMSI;

If the user record is found, the server extracts the number of rounds of the first type of data packet, the terminal side packet time stamp field, and the serial number, and puts the first type of data packet into the queue according to the serial number. a predetermined location, and setting the in-position field of the queue to a second predetermined value;

If not, the first type of data packet is ignored.
The method for testing performance of a mobile network according to claim 6, wherein the first type of data packet is placed in a predetermined position of the queue according to the serial number, and the in-position field of the queue is set to a second predetermined value. After the step, it also includes:

Obtaining, by the server, the current time and the enqueue time of the first type of data packet into the queue;

Calculating a difference between the current time and the enqueue time, and obtaining internal processing of the server Delay.
A mobile terminal, the mobile terminal comprising:

a first sending module, configured to send a first type control packet to the server, and continuously send a predetermined number of first type data packets to the server after receiving the reply of the server;

The second sending module is configured to send the second type of control packet to the server after the first type of data packet is sent, to notify the server that the uplink data transmission is completed in the current round;

The calculation processing module is configured to receive the second type of data packet sent by the server, and obtain the uplink performance statistics calculated by the server when receiving the third type control packet sent by the server, and calculate the current round of the performance statistics The downlink performance statistics data is written into the test log file by using the uplink performance statistics and the downlink performance statistics.
A server, the server comprising:

a bounce module, configured to bounce the first type control packet back to the mobile terminal when receiving the first type control packet sent by the mobile terminal;

a third sending module, configured to receive a first type of data packet sent by the mobile terminal, and continuously send a predetermined number of second types to the mobile terminal when receiving the second type of control packet sent by the mobile terminal data pack;

The fourth sending module is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet, and then The three types of control packets are sent to the mobile terminal, so that the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into the test log file.
A test system including a mobile terminal and a server,

The mobile terminal includes:

a first sending module, configured to send a first type control packet to the server, and continuously send a predetermined number of first type data packets to the server after receiving the reply of the server;

The second sending module is configured to send the second type of control packet to the server after the first type of data packet is sent, to notify the server that the uplink data transmission is completed in the current round;

The calculation processing module is configured to receive the second type of data packet sent by the server, and obtain the uplink performance statistics calculated by the server when receiving the third type control packet sent by the server, and calculate the current round of the performance statistics The downlink performance statistics data is sent to the test log file by using the uplink performance statistics and the downlink performance statistics.

The server includes:

a bounce module, configured to bounce the first type control packet back to the mobile terminal when receiving the first type control packet sent by the mobile terminal;

a third sending module, configured to receive a first type of data packet sent by the mobile terminal, and continuously send a predetermined number of second types to the mobile terminal when receiving the second type of control packet sent by the mobile terminal data pack;

The fourth sending module is configured to: after the second type of data packet is sent, calculate the uplink performance statistics of the current round, and put the uplink performance statistics into the third type control packet, and then The three types of control packets are sent to the mobile terminal, so that the mobile terminal writes the uplink performance statistics and the calculated downlink performance statistics into the test log file.