TWI682675B - Network quality detecting device and network quality detecting method - Google Patents

Abstract

A network quality detecting method adapted for detecting quality of an end-to-end mobile network of an user equipment. The network quality detecting method comprises: extracting application service network information of the user equipment; calculating customer experience index of the user equipment according to the application service network information; calculating a base station quality score, a status score of control plane network element, and a status score of user plane network element of the end-to-end mobile network according to the application service network information and the customer experience index; and calculating network quality index according to the base station quality score, the status score of control plane network element, and the status score of user plane network element.

Description

Network quality detection device and network quality detection method

The invention relates to a technique for measuring or estimating channel quality parameters, and in particular to a network quality detection device and a network quality detection method.

At present, mobile network operators are analyzing the key performance index (KPI) of each network component to determine the quality of the network, but not based on individual user experience and interoperability between base stations. ), core network component status, application service server status, or 4G hierarchical speed-up and speed-down and other factors to determine the quality of the network. However, the network quality assessed by the KPI of the network component alone does not reflect the actual experience of individual users. In addition, the cycle of evaluating network quality is often measured on a daily basis, and telecom operators cannot know that individual users have experienced a poor user experience in a short period of time based on the evaluation results of network quality.

Based on this, it is necessary to propose a network quality detection method that can reflect the user experience of individual users.

The invention provides a network quality detection device suitable for detecting the quality of an end-to-end mobile network corresponding to a user device. The network quality detection device includes a storage medium and a processor. The storage medium stores multiple modules. The processor is coupled to the storage medium. The processor accesses and executes the modules. The modules include a network characteristic parameter collection module, an experience score calculation module, and a network quality detection module. The network characteristic parameter collection module retrieves the application service online information corresponding to the user device. The experience score calculation module calculates the user experience index of the user device according to the online information of the application service. The network quality detection module calculates the base station quality score of the end-to-end mobile network, the signaling plane network component status score and the traffic plane network component status score based on the application service online information and user experience indicators, and according to the base The station quality score, signaling plane network component status score, and communication plane network component status score calculate the network quality index score.

The invention provides a network quality detection method suitable for detecting the quality of an end-to-end mobile network corresponding to a user device. The network quality detection method includes: acquiring application service online information corresponding to the user device; calculating the user experience index of the user device based on the application service online information; calculating the end-to-end mobile network based on the application service online information and user experience index Base station quality score, signaling plane network component status score and traffic plane network component state score; and network calculation based on base station quality score, signaling plane network component status score and traffic plane network component state score Quality index score.

Based on the above, the network quality detection device of the present invention can calculate the network quality index score corresponding to the end-to-end mobile network. Network administrators can quickly understand whether the end-to-end mobile network is cracked or obstructed based on the network quality index score.

In order to make the above-mentioned features and advantages of the present invention more obvious and understandable, the embodiments are specifically described below in conjunction with the accompanying drawings for detailed description as follows.

FIG. 1 illustrates a schematic diagram of a network quality detection device 10 according to an embodiment of the present invention. The network quality detection device 10 is suitable for detecting the quality of an end-to-end mobile network corresponding to a user device. The network quality detection device 10 may include a processor 110 and a storage medium 130. The storage medium 130 stores a plurality of modules. The modules may include a network characteristic parameter collection module 131, an experience score calculation module 132, a network quality detection module 133, and a comparison module 134. In this embodiment, the network feature parameter collection module 131, the experience score calculation module 132, the network quality detection module 133, and the comparison module 134 may be implemented using software modules. However, the network characteristic parameter collection module 131, the experience score calculation module 132, the network quality detection module 133, and the comparison module 134 may be implemented by software modules or hardware circuits. The invention is not limited to this. Modules can communicate through communication protocols such as IP-based communication, and the invention is not limited thereto.

The processor 110 is coupled to the storage medium 130, and accesses and executes the modules stored in the storage medium 130. The processor 110 may be, for example, a central processing unit (CPU), or other programmable general-purpose or special-purpose microprocessor (microprocessor), digital signal processor (DSP), or A programmable controller, an application specific integrated circuit (ASIC) or other similar components or a combination of the above components, the invention is not limited thereto.

The storage medium 130 may be, for example, any type of fixed or removable random access memory (RAM), read-only memory (ROM), flash memory (flash memory) ), hard disk drive (HDD), solid state drive (SSD) or similar components or a combination of the above components, the invention is not limited thereto.

FIG. 2 illustrates a schematic diagram of network quality detection using the network quality detection device 10 according to an embodiment of the present invention. In this embodiment, the user device 20 can be connected to the base station 30 or the base station 40, however, the number of base stations can be adjusted according to the usage environment of the user device 20, and the invention is not limited thereto. The network quality detection device 10 may be used to detect the quality of the end-to-end mobile network corresponding to the user device 20, where the end-to-end mobile network may include the wireless network WN, the core network CN, and the Internet NW At least one of them, where the wireless network WN, the core network CN, and the Internet NW and other networks may use a global system for mobile communication (GSM), a universal mobile telecommunication system (universal mobile telecommunication system , UMTS) or long term evolution (LTE) technology, the invention is not limited to this. The network quality detection device 10, the user device 20, the base station 30 or the base station 40 can communicate through a communication protocol such as IP-based communication, and the invention is not limited thereto.

Taking the wireless network WN and the core network CN as examples, assuming that the network quality detection device 10 wants to detect the quality of the wireless network WN or the core network CN corresponding to the user device 20, the network characteristic parameter collection module 131 The application service online information fp corresponding to the user device 20 may be retrieved from the wireless network WN or the core network CN, where the application service online information fp may include time and gate number (for example: international mobile subscriber identification code (international mobile subscriber identity (IMSI), mobile subscriber ISDN number (MSISDN)), application services (for example: APP or website), data volume, transmission speed, information of connected base stations or network components or The key performance indicator (KPI) is related to the characteristic parameters of the user device 20, and the key performance indicator may be related to the characteristic parameters such as the packet loss rate of the traffic packet or the signaling abnormality rate (for example: the number of program failures and the number of program successes). Specifically, the network characteristic parameter collection module 131 can periodically receive cross-interface signaling or traffic information of the user device 20 captured by the T-connector on the network, analyze the information, and generate corresponding application services Internet access information fp, wherein the cross-interface of the network may be, for example, an interface between a radio access network (RAN) of a 3G network or a 4G network and a core network.

Then, the experience score calculation module 132 can calculate the user experience index (CEI) of the user device 20 according to the application service online information fp. Factors such as different user devices or base stations to which the user is connected may cause the experience score calculation module 132 to obtain different application service online information, and the user experience index CEI calculated according to different application service online information may also be different. In this embodiment, if the value of the user experience index CEI of the user device 20 is higher, it means that the online experience of the user device 20 is better, but the invention is not limited thereto. The network quality detection device 10 can store the calculated user experience index CEI in a huge database for analysis by network administrators.

After the user experience index CEI is generated, the network quality detection module 133 can calculate the end-to-end mobile network corresponding to the user device 20 according to the user experience index CEI of the user device 20 and the application service online information fp (for example: wireless Network WN and core network CN) base station quality scores, signaling plane network component status scores, and communication plane network component status scores.

In one embodiment, the network quality detection module 133 may calculate the base station based on at least one of, for example, time, gate number, transmission speed, connected base station or network element information, and user experience index CEI Quality score. Furthermore, the network quality detection module 133 can determine whether there is a corresponding user based on parameters such as time, gate number, transmission speed, information of the connected base station or network element, or user experience index CEI The device and the connected base station (or network element) are related to the ping-pong effect, interference problems, coverage, antenna angle, codec technology or congestion problems. If these phenomena exist, it may indicate that the user equipment using the base station (or network element) corresponds to poor network quality. According to this, the network quality detection module 133 will calculate a lower base station quality score for the user device based on these phenomena. On the other hand, the network quality detection module 133 can prompt the network management personnel that the base station has encountered a phenomenon that affects the quality of the mobile network, and record the description of the phenomenon and the number of users affected by the phenomenon, the length of time and other information in a huge amount In the database, it serves as a reference basis for network administrators to evaluate and optimize mobile networks.

For example, the network quality detection module 133 may obtain parameters corresponding to the time of the user device 20 and the information of the connected base station or network element from the application service online information fp of the user device 20. Assuming that the user device 20 frequently changes hands between the base station 30 and the base station 40, it means that the base station 30 (or the base station 40) corresponding to the user device 20 may have a ping-pong effect. In this case, the network quality detection module 133 can calculate the user device 20 at the base station 30 and the base station 40 according to the parameters corresponding to the time corresponding to the user device 20 and the information of the connected base station or network element And determine that the user device 20 has a ping-pong effect associated with the user device 20 based on the residence time being below a threshold.

Traditionally, in the case of a ping-pong effect, even if the user device 20 has a poor Internet experience, the connection quality of the user device 20 to individual base stations (ie, base station 30 or base station 40) or the individual base stations The key performance indicators may be very good. In this way, the network administrator cannot know the fact that the user device 20 has a poor Internet experience through various information or parameters. Relatively speaking, the base station quality score calculated by the network quality detection device 10 of the present invention is not only related to the KPIs of individual base stations. When a ping-pong effect occurs but the connection quality of the user device 20 to individual base stations (or individual key performance indicators of those base stations) is very good, the network quality detection device 10 can still calculate The low base station quality score is used to prompt the network management personnel that the user experience of the device 20 is not good.

In one embodiment, the network quality detection module 133 may calculate the network element status score of the signaling plane according to at least one of, for example, time, gate number, signaling abnormality rate, and user experience index CEI. Furthermore, the network quality detection module 133 can determine whether there is a base station corresponding to the user device and the connected device based on parameters such as time, gate number, signaling abnormality rate, or user experience index CEI (or Network components) and related to the phenomenon of component parameter setting, component handshake complexity or congestion problems. If these phenomena exist, it may indicate that the signaling plane of the user device corresponds to poor network quality. According to this, the network quality detection module 133 will calculate a lower signaling element network component state score for the user device based on these phenomena. On the other hand, the network quality detection module 133 can prompt the network administrator that the user device has encountered a phenomenon that affects the quality of the mobile network, and record a huge amount of information on the description of the phenomenon and the number of users affected by the phenomenon, the length of time, etc. In the library, it is used as a reference for network management personnel to evaluate and optimize mobile networks.

In one embodiment, the network quality detection module 133 may calculate the communication plane according to at least one of time, gate number, application service, data volume, transmission speed, packet loss rate of the traffic packet, and user experience index CEI Network component status score. Furthermore, the network quality detection module 133 can determine whether there is a corresponding user device according to parameters such as time, gate number, application service, data volume, transmission speed, packet loss rate of the traffic packet, or user experience indicator CEI The communication surface of the base station (or network element) to which it is connected is related to the transmission bandwidth between the elements, the protocol between the elements, or the related phenomena of congestion. If these phenomena exist, it may indicate that the communication plane of the user device corresponds to poor network quality. According to this, the network quality detection module 133 will calculate a lower state component of the traffic network element for the user device based on these phenomena. On the other hand, the network quality detection module 133 can prompt the network administrator that the user device has encountered a phenomenon that affects the quality of the mobile network, and record a huge amount of information on the description of the phenomenon and the number of users affected by the phenomenon, the length of time, etc. In the library, it is used as a reference for network management personnel to evaluate and optimize mobile networks.

…公式（1） 其中α代表基地台品質分數、ρb代表基地台品質分數的權重、β代表信令面網路元件狀態分數、ρc代表信令面網路元件狀態分數的權重、γ代表訊務面網路元件狀態分數、ρu代表訊務面網路元件狀態分數的權重、i代表端對端網路路徑上的基地台的編號、j代表端對端網路路徑上的信令面網路元件的編號、k代表端對端網路路徑上的訊務面網路元件的編號、M代表端對端網路路徑上所經過的基地台總數、N代表端對端網路路徑上所經過的信令面網路元件總數並且Q代表端對端網路路徑上所經過的訊務面網路元件總數。 After calculating parameters such as base station quality score, signaling plane network element status score, and traffic plane network element status score, the network quality detection module 133 can further base on the base station quality score, signaling plane network The parameters such as the state component of the road component and the state component of the network component of the communication plane calculate the network quality index (NQI) score corresponding to the user device 20. The network quality index score NQI is used to indicate the quality of the end-to-end network corresponding to the user device 20. For example, if the network quality indicator score NQI of the user device 20 is too low, the network quality detection module 133 may determine the end-to-end corresponding to the user device 20 based on the network quality indicator score NQI being lower than a threshold The network is degraded or obstructed. In other words, the network administrator can determine whether the end-to-end network corresponding to the user device 20 needs to be repaired according to the network quality index score NQI. The calculation formula of the network quality index score NQI is shown in formula (1).

…Formula (1) where α represents the quality score of the base station, ρb represents the weight of the quality score of the base station, β represents the status score of the network element of the signaling plane, ρc represents the weight of the network element state score of the signaling plane, and γ represents the traffic Surface network component status score, ρu represents the weight of the traffic surface network component status score, i represents the number of the base station on the end-to-end network path, j represents the signaling surface network on the end-to-end network path Component number, k is the number of the traffic network element on the end-to-end network path, M is the total number of base stations passing through the end-to-end network path, N is passing through the end-to-end network path The total number of signaling plane network elements and Q represents the total number of traffic plane network elements passing through the end-to-end network path.

In one embodiment, the network quality detection module 133 can filter out the user experience index CEI that has less reference value. For example, the network quality detection module 133 may determine that the user experience index CEI corresponding to the user device is less referenced according to the dwell time of a user device at the connected base station or network element being less than a threshold value. Accordingly, the network quality detection module 133 may determine that the user experience index CEI of the user device that does not use the user device calculates the network quality index score NQI of the user device.

In an embodiment, the comparison module 134 can obtain a report rp corresponding to the user device 20, or a report rp corresponding to a base station or network element such as the base station 30, wherein the report rp can be associated with customer complaint data or Drive test results. The comparison module 134 can compare the report rp and the application service online information fp. If the content recorded in the report rp does not conform to the application service online information fp retrieved by the network characteristic parameter collection module, the comparison module 134 may analyze the degree of difference and difference accumulation between the report rp and the application service online information fp Times, and generate corresponding evaluation and modification suggestions. The comparison module 134 can record information such as the degree of difference, the cumulative number of differences, and evaluation and modification suggestions in a huge database as a reference basis for network administrators to evaluate the state of the mobile network and improve obstacles to the mobile network.

In addition, the comparison module 134 can adjust the calculation method of the network quality index score NQI or the user experience index CEI according to the report rp, the application service online information fp, and the network quality index score NQI. For example, if the content recorded in the report rp does not match the application service online information fp, it means that the actual user experience of the user device 20 may not meet the calculation result of the network quality index score NQI. Based on this, the comparison module 134 can adjust the calculation method of the network quality index score NQI (for example: adjust ρb, ρc, or ρu in formula (1)) so that the calculation result of the network quality index score NQI is more in line with the report rp The recorded content.

FIG. 3 illustrates a flowchart of a network quality detection method according to an embodiment of the present invention. The network quality detection method is suitable for detecting the quality of the end-to-end mobile network corresponding to the user device, and can be implemented by the network quality detection device 10 shown in FIG. 1.

In step S301, the Internet information of the application service corresponding to the user device is retrieved. In step S302, the user experience index of the user device is calculated according to the online information of the application service. In step S303, the base station quality score of the end-to-end mobile network, the signaling plane network component status score and the traffic plane network component status score are calculated based on the application service online information and user experience indicators. In step S304, a network quality indicator score is calculated according to the base station quality score, the signaling plane network element status score and the traffic plane network element status score.

In summary, the network quality detection device of the present invention can incorporate factors such as individual user's Internet experience experience, inter-base station interoperability, core network element status, application service server status, and 4G hierarchical speed-up and speed-down. The parameters used in the end-to-end mobile network quality analysis and calculate the network quality index score corresponding to the end-to-end mobile network. Network administrators can quickly understand whether the end-to-end mobile network is cracked or obstructed based on the network quality index score. On the other hand, network administrators can also determine which network element in the end-to-end mobile network path is obstructed based on the network quality index score and the cross-comparison results of application service online information. On the other hand, the network quality detection device can also adjust the calculation method of the network quality index score according to customer complaint data or drive test results, thereby improving the accuracy of calculating the network quality index score. Network administrators can query individual users' user experience indicators and network quality indicator scores, and then determine whether to repair base stations or network components in end-to-end mobile networks.

Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Any person with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention shall be subject to the scope defined in the appended patent application.

10‧‧‧Network quality detection device

110‧‧‧ processor

130‧‧‧storage media

131‧‧‧ Network characteristic parameter collection module

132‧‧‧Experience score calculation module

133‧‧‧ Network quality detection module

134‧‧‧ Comparison module

20‧‧‧User device

30, 40‧‧‧ base station

CEI‧‧‧User Experience Index

CN‧‧‧Core network

fp‧‧‧Application service online information

NQI‧‧‧Network Quality Index

NW‧‧‧Internet

rp‧‧‧Report

WN‧‧‧Wireless network

S301, S302, S303, S304 ‧‧‧ steps

FIG. 1 is a schematic diagram of a network quality detection device according to an embodiment of the present invention. FIG. 2 illustrates a schematic diagram of network quality detection using a network quality detection device according to an embodiment of the present invention. FIG. 3 illustrates a flowchart of a network quality detection method according to an embodiment of the present invention.

S301, S302, S303, S304 ‧‧‧ steps

Claims (9)

A network quality detection device suitable for detecting the quality of an end-to-end mobile network corresponding to a user device, the network quality detection device includes: a storage medium, a plurality of storage modules; and a processor, coupled In the storage medium, the processor accesses and executes the modules, wherein the modules include: a network characteristic parameter collection module, which retrieves application service online information corresponding to the user device, wherein the application service online information Including time and connected base station or network component information; experience score calculation module, based on the application service online information to calculate the user experience index of the user device; and network quality detection module, based on the application service Internet access information and the user experience index calculate the base station quality score, signaling plane network component status score and traffic plane network component status score of the end-to-end mobile network, and according to the base station quality score and the signaling The network component status score and the network component status score of the traffic plane calculate the network quality index score, wherein the network quality detection module calculates the network quality index based on the time and the information of the connected base station or network component The multiple dwell times of the user device in the connected base station or network element, and based on the dwell times being below the time threshold, it is determined that the occurrence of the ping-pong effect associated with the user device. The network quality detection device as described in item 1 of the scope of patent application further includes: The comparison module obtains a report related to customer complaint data or drive test results, and adjusts the calculation method of the network quality index score based on the report, the network quality index score, and the application service online information. The network quality detection device as described in item 1 of the patent application scope, wherein the network quality detection module determines that the end-to-end mobile network is degraded based on the network quality index score being lower than a threshold. The network quality detection device as described in item 1 of the patent scope, wherein the application service online information further includes at least one of a door number, application service, data volume, transmission speed, and key performance indicators, and the key performance The indicator is related to at least one of the packet loss rate of the traffic packet and the signaling anomaly rate. The network quality detection device as described in item 4 of the patent application scope, wherein the experience score calculation module calculates the second user experience index of the second user device according to the second application service online information corresponding to the second user device , The network quality detection module determines that the second user device does not use the second user experience indicator to calculate the second user device’s performance based on the second user device’s dwell time at the connected base station or network element being below a threshold Network quality indicator score. The network quality detection device as described in item 4 of the patent application scope, wherein the network quality detection module is based on the time, the gate number, the transmission speed, the connected base station or network element Information and at least one of the user experience indicators to calculate the quality score of the base station, wherein the network quality detection module is further based on the ping-pong effect, interference problem, coverage, antenna angle, codec technology corresponding to the base station And at least one of the congestion problems calculates the quality score of the base station. The network quality detection device according to item 4 of the patent application scope, wherein the network quality detection module is calculated based on at least one of the time, the gate number, the signaling abnormality rate, and the user experience indicator The signaling plane network component state score, wherein the network quality detection module further calculates the signaling plane network component state score according to at least one of component parameter settings, component handover complexity, and congestion problems. The network quality detection device as described in item 4 of the patent application scope, wherein the network quality detection module is based on the time, the gate number, the application service, the amount of data, the transmission speed, and the traffic packet The at least one of the packet loss rate and the user experience indicator calculates the state component of the network component of the traffic plane, wherein the network quality detection module is further based on at least one of the transmission bandwidth between the components, the protocol between the components and the congestion problem. One of them calculates the network component status score of the traffic plane. A network quality detection method is suitable for detecting the quality of an end-to-end mobile network corresponding to a user device. The network quality detection method includes: retrieving Internet information of application services corresponding to the user device, wherein the The application service online information includes time and information of the connected base station or network element; the user experience index of the user device is calculated based on the application service online information; the end pair is calculated based on the application service online information and the user experience index Base station quality score, signaling plane network element status score and traffic plane network element status score of the mobile network; based on the base station quality score, signaling plane network element status score and the traffic plane network Calculate the network quality indicator score based on the status score of the road component; and calculate the score based on the time and the information of the connected base station or network component The multiple dwell times of the user device in the connected base station or network element, and based on the dwell times being below the time threshold, it is determined that the occurrence of the ping-pong effect associated with the user device.

Images