CN113542050A

CN113542050A - Network performance monitoring method, device and system

Info

Publication number: CN113542050A
Application number: CN202011053487.1A
Authority: CN
Inventors: 许瑞岳; 石小丽
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-04-17
Filing date: 2020-09-29
Publication date: 2021-10-22

Abstract

The application provides a network performance monitoring method, a network performance monitoring device and a network performance monitoring system, relates to the technical field of communication, and can flexibly subscribe network performance data and improve network operation and maintenance efficiency. The method comprises the following steps: the management device receives request information from the demand device for requesting network performance data. The request information carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent. The management equipment determines network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition. The management device sends the network performance data to the demand device.

Description

Network performance monitoring method, device and system

The present application claims priority of the chinese patent application entitled "network performance monitoring method, apparatus and system" filed by the national intellectual property office at 17.04/2020, application number 202010306630.7, the entire contents of which are incorporated herein by reference.

Technical Field

The present application relates to the field of communications technologies, and in particular, to a method, an apparatus, and a system for monitoring network performance.

Background

With the development of communication technology, including the introduction of vertical industries, the increase of terminal devices and the diversity of services, the networks of operators are becoming more and more complex. The operation and maintenance difficulty is increased by the complex network, therefore, the network performance visualization becomes an important technical means for the network operation and maintenance, and operation and maintenance personnel can intuitively obtain network performance data based on the network performance visualization, so that the network performance problem can be quickly positioned, and the operation and maintenance cost is reduced.

However, in the existing network performance monitoring method, the demand device needs to specify a specific management object and a network performance data name to obtain the network performance data provided by the management device, so as to monitor the network performance.

By means of the method for obtaining the network performance data, on one hand, the demand equipment needs to appoint the management object in advance, and only the network performance data of the appointed management object can be obtained, and the flexibility is lacked. On the other hand, the demand device and the management device need to synchronize the management object and the network performance data name, so that correct network performance data can be obtained, and the network operation and maintenance efficiency is affected.

Disclosure of Invention

The network performance monitoring method, device and system can realize flexible subscription of network performance data and improve network operation and maintenance efficiency.

In order to achieve the purpose, the technical scheme is as follows:

in a first aspect, the present application provides a network performance monitoring method, which may include: the management device receives the request information from the demand device. Wherein the request information is for requesting network performance data. The request information carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. Wherein, the network performance data statistic granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent. And the management equipment determines the network performance data according to the network performance monitoring condition. Wherein the network performance data satisfies the network performance monitoring condition. The management device sends the network performance data to the demand device.

Illustratively, if the network performance monitoring condition includes that the network performance data statistic granularity is a region level, the management device may obtain the network performance data according to the requirement of the network performance statistic granularity. For example, the uplink and downlink user throughput rates of the region-level granularity may include an average of the uplink and downlink user throughput rates of all cells in the region.

Or, the network performance monitoring condition includes that the network performance data category is a capacity class. For example, the network performance data to which the demand device needs to subscribe or monitor is the network performance data of the capacity class. Examples may include: uplink and downlink throughput rates. The management device obtains the network performance data of the capacity class according to the network performance monitoring condition.

Or, the network performance monitoring condition includes a network performance data screening condition. Such as network performance data when network congestion occurs. Then, the management device may obtain the network performance data when the network is congested according to the network performance monitoring condition.

Or, the network performance monitoring condition includes a combination of network performance data statistics granularity, a network performance data category, and a network performance data screening condition. Such as uplink and downlink throughput when the network is congested.

Therefore, the network performance data can be flexibly subscribed by the demand equipment by using the network performance monitoring condition. And the management equipment directly determines the corresponding network performance data according to the network performance monitoring conditions. Moreover, the management equipment and the demand equipment can determine the network performance data without synchronizing the network performance data names, so that the operation and maintenance efficiency is improved.

In one possible implementation, the network performance monitoring condition includes a granularity of network performance data statistics. The management equipment determines network performance data according to the network performance monitoring condition, and the method comprises the following steps: the management device executes one or more of the following items according to the network performance data statistic granularity: collecting network performance data of network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

For example, the management device collects network performance data of a network performance statistics granularity, where the network performance data statistics granularity is network performance data of a network slice service level. Then, the management device needs to request the network device (e.g., the base station) to report the network performance data of the network slice service level, and directly send the network performance data to the required device after collecting (i.e., receiving) the network performance data of the network slice service level reported by the network device.

For another example, the management device statistically analyzes the network performance data of the network performance statistical granularity, and the network performance data statistical granularity is the network performance data of the network slice level. Then, the management device needs to receive the cell-level network performance data of the access network slice reported by the network device (e.g., the base station), and then generate the network slice-level network performance data through statistical analysis according to the cell-level network performance data of the access network slice. And then, sending the network performance data after the statistical analysis to the demand equipment.

For another example, if the management device queries the local database for the network performance data at the network performance statistics granularity, it indicates that the local database of the management device stores the network performance data at different network performance statistics granularities. Such as cell level network performance data, network slice level network performance data, etc. The network performance data in the local database may be network performance data directly stored after being collected by the management device in advance. Or, the network performance data stored after the statistical analysis can be collected and analyzed for the management device. Subsequently, the management device may directly invoke the network performance data of the corresponding network performance data statistics granularity in the local database according to the network performance data statistics granularity.

Therefore, the management equipment can flexibly determine the network performance data through various implementation modes according to the requirements contained in the network performance monitoring conditions carried in the received request information and actual conditions. For example, when the network performance data can be collected, the network performance data is directly collected, and the network performance condition is fed back in real time. For another example, under the condition that the network performance data acquisition cannot be performed, the network performance data which is already analyzed and counted in the local database can be directly called, so that the demand device can be directly applied after receiving the network performance data sent by the management device, the statistical analysis is not needed, and the efficiency is improved.

In one possible implementation, the network performance monitoring condition includes a network performance data category. The management equipment determines network performance data according to the network performance monitoring condition, and the method comprises the following steps: the management device determines a network performance data name corresponding to the network performance data category. The management device executes one or more of the following items according to the network performance data name: collecting network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

Corresponding to the above example of the network performance data statistical granularity, if the network performance monitoring condition includes the network performance data category, the management device may collect the network performance data according to the network performance data category, and then directly send the network performance data to the demand device. Or the network performance data can be collected according to the network performance data category, and then sent to the demand equipment after statistical analysis. Or the management device stores the network performance data after statistical analysis in a local database, and after receiving the network performance monitoring condition, queries corresponding network performance data in the local database according to the network performance data category.

In a possible implementation, the network performance monitoring condition includes a network performance data screening condition. The management equipment determines network performance data according to the network performance monitoring condition, and the method comprises the following steps: the management device executes one or more of the following items according to the network performance data screening conditions: the method comprises the steps of collecting network performance data meeting network performance data screening conditions, carrying out statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

Corresponding to the above example of the statistical granularity of the network performance data, if the network performance monitoring condition includes a network performance data screening condition, the management device may collect the network performance data according to the network performance data screening condition, and then directly send the network performance data to the demand device. Or the network performance data can be collected according to the network performance data screening conditions, and then sent to the demand equipment after statistical analysis. Or the management device stores the network performance data after statistical analysis in a local database, and after receiving the network performance monitoring conditions, screens the conditions according to the network performance data, and queries the corresponding network performance data in the local database.

In a possible implementation manner, the request information is network performance management configuration request information, network performance intention request information or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model comprises network performance monitoring conditions. The network performance intention request information carries a network performance intention model, and the network performance intention model comprises network performance monitoring conditions. The network performance task management request information carries network performance monitoring conditions.

Optionally, the demand device may send the request information to the management device through a different interface, and the demand device may match the interface type through the type of the request information. Then different types of request information may be configured for corresponding to different interfaces. And the different types of request information carry network performance monitoring conditions, so that flexible subscription of network performance data is realized.

In a possible implementation manner, the network performance monitoring condition further includes one or more of the following conditions: receiving an address, counting a period and reporting the period; the receiving address, the counting period and the reporting period are determined by the demand equipment according to one or more of the following contents: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. The management device sends network performance data to the demand device, including: and if the network performance monitoring condition also comprises a receiving address, the management equipment sends the network performance data to the demand equipment at the receiving address. And if the network performance monitoring condition also comprises a counting period, the management equipment counts the network performance data according to the counting period and sends the network performance data to the demand equipment. And if the network performance monitoring condition also comprises a reporting period, the management equipment sends the network performance data to the demand equipment according to the reporting period.

Optionally, if the network performance monitoring condition includes a receiving address, the management device may send the network performance data to the receiving address after determining the network performance data. The demand equipment directly receives the network performance data at the receiving address, so that the data loss can be prevented.

Further, different network performance data statistics granularities, different network performance data categories, and different network performance data screening conditions may correspond to the same or different receiving addresses. In this way, the demand device can directly distinguish the type of the received network performance data by different receiving addresses.

Optionally, if the network performance monitoring condition includes a statistical period, the management device determines the network performance data periodically according to the statistical period, so as to further save the power consumption of the device. Accordingly, the network performance data sent by the management device to the demand device is also the network performance data periodically determined by the demand device.

Optionally, if the network performance monitoring condition includes a reporting period, the management device sends the network performance data periodically according to the reporting period. And the demand equipment also receives the network performance data periodically according to the reporting period. Thus, further saving of device power consumption is achieved, and reception of network performance data can be guaranteed.

In one possible implementation, the network performance data statistics granularity includes one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

In one possible implementation, the network performance data category includes one or more of the following: coverage class, capacity class, quality class, switching class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracking data, MDT data, analysis data and QoE data.

In one possible implementation, the network performance data screening condition includes one or more of the following: network problem conditions, time range, network performance threshold range, area range.

Thus, the network performance monitoring conditions may include different network performance data statistics granularities, different network performance data categories, different network performance data screening conditions, or a combination of the three. And the demand equipment can realize more flexible subscription of network performance data.

In a second aspect, the present application provides a network performance monitoring method, which may include: the demand equipment sends request information to the management equipment; the request information is used for requesting network performance data, and carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received; the network performance data category is used for indicating the category of the network performance data to be received; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received. The demand device receiving network performance data from the management device; the network performance data satisfies the network performance monitoring condition.

In one possible implementation manner, before the requiring device sends the request information to the management device, the method further includes: the demand device receives a network performance monitoring condition. Or the demand equipment receives the network performance optimization demand or the network performance optimization intention; wherein the network performance optimization requirement or network performance optimization intent is used to optimize network performance. And the demand equipment determines the network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

Optionally, the demand device may directly receive the network performance monitoring condition input by the operation and maintenance personnel.

Illustratively, the demand equipment can display the statistical granularity of the network performance data, the category of the network performance data and the screening condition of the network performance data through a human-computer interaction page, and receive the input or selection of operation and maintenance personnel. Different operation and maintenance personnel (also called as clients) have different subscription or monitoring requirements for network performance data, and the demand equipment can directly receive the different subscription or monitoring requirements of the operation and maintenance personnel to carry out network operation and maintenance.

Optionally, in the network operation process, the demand device receives a network optimization demand or intention of a client or an automation module, and may determine the network performance monitoring condition according to the network optimization demand or intention.

For example, when the demand device receives a network slice delay optimization requirement, the delay of the network slice granularity to be monitored is determined according to the network slice delay optimization requirement. For another example, when the demand device receives the rate increase intention of the edge user, it determines the uplink and downlink throughput of the UE level and the uplink and downlink throughput of the area level at the time when the user rate needs to be monitored to be less than 5Mbps according to the rate increase intention of the edge user.

Therefore, the demand equipment can determine the network performance monitoring conditions required by operation and maintenance personnel or an automation module through the two different implementation modes. For example, the demand device directly receives the network performance monitoring condition. Or, in the network operation process, the demand device receives the network performance optimization demand or the network performance optimization intention, and determines the network performance monitoring condition by analyzing the network performance optimization demand or the network performance optimization intention. And then, the corresponding network performance data is acquired, and the operation and maintenance requirements are met.

In a possible implementation manner, the network performance monitoring condition further includes one or more of the following conditions: receiving an address, counting a period and reporting the period; the receiving address, the counting period and the reporting period are determined by the demand equipment according to one or more of the following contents: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. The demand device receives network performance data from the management device, including: if the network performance monitoring condition also includes the receiving address, the demand device receives the network performance data sent by the management device at the receiving address. And if the network performance monitoring condition also comprises a statistical period, the demand equipment receives the network performance data which is sent by the management equipment and is counted according to the statistical period. And if the network performance monitoring condition also comprises a reporting period, the demand equipment receives the network performance data sent by the management equipment according to the reporting period.

In addition, the technical effect of the network performance monitoring method of the second aspect may refer to the technical effect of the network performance monitoring method of the first aspect, and is not described herein again.

In a third aspect, the present application provides a network performance monitoring method, which may include: the demand equipment sends request information to the management equipment; the request information is used for requesting network performance data, and carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received by the demand equipment; the network performance data category is used for indicating the category of the network performance data to be received by the demand equipment; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received by the demand equipment. The management device receives the request information from the demand device. The management equipment determines network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition. The management device sends the network performance data to the demand device. The demand device receives network performance data from the management device.

In addition, for technical effects of the network performance monitoring method of the third aspect, reference may be made to the technical effects of the network performance monitoring method of the first aspect, and details are not described here.

In a fourth aspect, the present application provides a network performance monitoring apparatus, which may include: the device comprises a receiving module, a processing module and a sending module. The receiving module is used for receiving request information from the demand equipment; the request information is used for requesting network performance data; the request information carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent. The processing module is used for determining network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition. And the sending module is used for sending the network performance data to the demand equipment.

In a possible implementation manner, the processing module is specifically configured to execute one or more of the following items according to the network performance data statistics granularity: collecting network performance data of network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

In a possible implementation manner, the processing module is further configured to determine a network performance data name corresponding to the network performance data category. The processing module is specifically configured to execute one or more of the following items according to the network performance data name: collecting network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

In a possible implementation manner, the processing module is specifically configured to execute one or more of the following items according to the network performance data screening condition: the method comprises the steps of collecting network performance data meeting network performance data screening conditions, carrying out statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

In a possible implementation manner, the network performance monitoring condition further includes one or more of the following conditions: receiving an address, counting a period and reporting the period; the receiving address, the counting period and the reporting period are determined by the demand equipment according to one or more of the following contents: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. And the sending module is further used for sending the network performance data to the demand equipment at the receiving address if the network performance monitoring condition further comprises the receiving address. And the processing module is further used for counting the network performance data according to the counting period if the network performance monitoring condition further comprises the counting period. And the sending module is further used for sending the network performance data counted by the processing module according to the counting period to the demand equipment if the network performance monitoring condition further comprises the counting period. And the sending module is further used for sending the network performance data to the required equipment according to the reporting period if the network performance monitoring condition further includes the reporting period.

Alternatively, the receiving module and the transmitting module may be integrated together, such as a transceiver module, implemented by a transceiver or transceiver-related circuit components. The receiving module is used for receiving request information sent by the demand equipment. The sending module is used for sending the network performance to the demand equipment. The embodiment of the present application does not specifically limit the specific implementation manner of the receiving module and the sending module.

Optionally, the network performance monitoring apparatus of the fourth aspect may further include a storage module, where the storage module stores a program or instructions. The program or instructions, when executed by the processing module, enable the network performance monitoring apparatus of the third aspect to perform the network performance monitoring method of the first aspect.

It should be noted that the network performance monitoring apparatus in the fourth aspect may be a management device or a chip (system) or other component or assembly that can be disposed in the management device, which is not limited in this application.

It should be noted that, the network performance monitoring apparatus provided in the fourth aspect of the present application is configured to implement the network performance monitoring method provided in any one of the foregoing first aspect and possible implementation manners of the first aspect. Therefore, for a specific implementation of the network performance monitoring apparatus provided in the fourth aspect of the present application, reference may be made to the specific implementation of the network performance monitoring method provided in any one of the foregoing first aspect and possible implementation manners of the first aspect, and details are not repeated here.

In addition, for technical effects of the network performance monitoring apparatus of the fourth aspect, reference may be made to technical effects of the network performance monitoring method of the first aspect, and details are not repeated here.

In a fifth aspect, the present application provides a network performance monitoring apparatus, comprising: the device comprises a sending module and a receiving module. The sending module is used for sending request information to the management equipment; the request information is used for requesting network performance data, and carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received; the network performance data category is used for indicating the category of the network performance data to be received; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received. A receiving module for receiving network performance data from a management device; the network performance data satisfies the network performance monitoring condition.

In a possible implementation manner, the receiving module is further configured to receive a network performance monitoring condition. Alternatively, the apparatus further comprises a processing module. The receiving module is also used for receiving the network performance optimization requirement or the network performance optimization intention; wherein the network performance optimization requirement or network performance optimization intent is used to optimize network performance. And the processing module is also used for determining the network performance monitoring condition according to the network performance optimization requirement or the network performance optimization intention.

In a possible implementation manner, the network performance monitoring condition further includes one or more of the following conditions: receiving an address, counting a period and reporting the period; the receiving address, the counting period and the reporting period are determined by the processing module according to one or more of the following contents: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. And the receiving module is further used for receiving the network performance data sent by the management equipment at the receiving address if the network performance monitoring condition further comprises the receiving address. And the receiving module is further used for receiving the network performance data which is sent by the management equipment and counted according to the counting period if the network performance monitoring condition further comprises the counting period. And the receiving module is further configured to receive the network performance data sent by the management device according to the reporting period if the network performance monitoring condition further includes the reporting period.

Receiving module and transmitting module optionally, the receiving module and the transmitting module may also be integrated together, such as a transceiver module, implemented by a transceiver or transceiver-related circuit component. The receiving module is used for receiving the network performance data sent by the management equipment. The sending module is used for sending request information to the management equipment. The embodiment of the present application does not specifically limit the specific implementation manner of the receiving module and the sending module.

Optionally, the network performance monitoring apparatus of the fifth aspect may further include a storage module, where the storage module stores a program or instructions. The program or instructions, when executed by the processing module, enable the network performance monitoring apparatus of the fifth aspect to perform the network performance monitoring method of the second aspect.

It should be noted that the network performance monitoring apparatus of the fifth aspect may be a demand device or a chip (system) or other component or assembly that can be disposed in the demand device, and this application is not limited thereto.

It should be noted that, the network performance monitoring apparatus provided in the fifth aspect of the present application is configured to implement the network performance monitoring method provided in any possible implementation manner of the second aspect and the second aspect. Therefore, for a specific implementation of the network performance monitoring apparatus provided in the fifth aspect of the present application, reference may be made to a specific implementation of the network performance monitoring method provided in any one of the foregoing second aspect and possible implementation manners of the second aspect, and details are not repeated here.

In addition, for technical effects of the network performance monitoring apparatus in the fifth aspect, reference may be made to technical effects of the network performance monitoring method in the second aspect, and details are not repeated here.

In a sixth aspect, the present application provides a network performance monitoring apparatus, where the network performance monitoring apparatus may implement the function of the management device in the above method example, where the function may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software comprises one or more modules corresponding to the functions. The network performance monitoring device may exist in the product form of a chip.

With reference to the sixth aspect, in a possible implementation manner, the network performance monitoring apparatus includes a processor and a transceiver in a structure, where the processor is configured to support the network performance monitoring apparatus to perform corresponding functions in the foregoing method. The transceiver is used to support communication between the network performance monitoring apparatus and other devices. The network performance monitoring device may also include a memory, coupled to the processor, that stores program instructions and data necessary for the network performance monitoring device.

In a seventh aspect, the present application provides another network performance monitoring apparatus, where the network performance monitoring apparatus may implement a function of the demand device in the above method example, where the function may be implemented by hardware, or may be implemented by hardware executing corresponding software. The hardware or software comprises one or more modules corresponding to the functions. The network performance monitoring device may exist in the product form of a chip.

With reference to the seventh aspect, in a possible implementation manner, the structure of the network performance monitoring apparatus includes a processor and a transceiver, where the processor is configured to support the network performance monitoring apparatus to execute corresponding functions in the foregoing method. The transceiver is used to support communication between the network performance monitoring apparatus and other devices. The network performance monitoring device may also include a memory, coupled to the processor, that stores program instructions and data necessary for the network performance monitoring device.

In an eighth aspect, the present application provides a management device having a function of implementing the network performance monitoring method as described in the first aspect and any one of the possible implementation manners. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a ninth aspect, the present application provides a demand device having a function of implementing the network performance monitoring method as described in the second aspect and any one of the possible implementation manners. The function can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a tenth aspect, the present application provides a network performance monitoring system, which includes the management device provided in the eighth aspect and the demand device provided in the ninth aspect.

In an eleventh aspect, the present application provides a network performance monitoring system, including: a demand device and a management device. Wherein the demand device is to: sending request information to the management device; the request information is used for requesting network performance data, and carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received by the demand equipment; the network performance data category is used for indicating the category of the network performance data to be received by the demand equipment; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received by the demand equipment. The management device is configured to: receiving request information from a demand device; determining network performance data according to the network performance monitoring conditions; wherein the network performance data satisfies the network performance monitoring condition; the network performance data is sent to the demand device. The demand device is further configured to: network performance data is received from a management device.

In a twelfth aspect, the present application provides a computer-readable storage medium, comprising computer instructions, which, when executed on a server, cause the server to perform the network performance monitoring method as described in the first to third aspects, and any possible implementation manner thereof.

In a thirteenth aspect, the present application provides a computer program product, which when run on a server, causes the server to perform the network performance monitoring method as described in the first to third aspects above, and any one of any possible implementation manners.

In a fourteenth aspect, there is provided circuitry comprising processing circuitry configured to perform the network performance monitoring method as described in the first to third aspects above, and any one of the possible implementations thereof.

In a fifteenth aspect, an embodiment of the present application provides a chip, including: a processor and interface circuitry. And the interface circuit is used for receiving the code instruction and transmitting the code instruction to the processor. The processor is configured to execute the code instructions to perform the network performance monitoring method as described in the first to third aspects and any one of the possible implementations.

Drawings

Fig. 1 is a schematic structural diagram of a communication system architecture according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a communication device according to an embodiment of the present application;

fig. 3 is a first schematic diagram illustrating a network performance monitoring method according to an embodiment of the present application;

fig. 4 is a schematic diagram illustrating a network performance monitoring method according to an embodiment of the present application;

fig. 5 is a schematic diagram of a network performance monitoring condition acquisition interface provided in an embodiment of the present application;

fig. 6 is a first schematic structural diagram of a network performance monitoring apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a network performance monitoring apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a network performance monitoring system according to an embodiment of the present application;

fig. 9 is a schematic structural diagram of a chip system according to an embodiment of the present application.

Detailed Description

The network performance monitoring method, device and system provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings.

Before describing specific aspects of the present application, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

1) Demand equipment

Demand devices, which may also be referred to as consumers, are devices that use a network and monitor network performance to operate and maintain the network. Request information is provided according to the service requirement of the user, so that network performance data can be acquired for monitoring the network performance. The demand equipment may be a Business Support System (BSS), or a cross domain management function (CD-MnF), or a domain management function (domain-MnF).

2) Management device

The management device, which may also be referred to as Provider, is a device in the network for managing usage and monitoring of the demand device. And the management equipment acquires the network performance data according to the request information provided by the demand equipment and feeds the network performance data back to the demand equipment to realize the monitoring of the network performance. The management device may be a cross-domain management function (CD-MnF), or a domain management function (domain-MnF), or a network element.

It should be noted that the demand device and the management device may be functional units, may also be a chip system, or the like, and this is not specifically limited in this embodiment of the present application.

3) Network performance data

Refers to performance-related data that is exhibited by a device managed by a management device during operation, including service performance-related performance data, network-related performance data, and UE-related performance data.

The network performance monitoring method provided by the embodiment of the application is applied to the structural schematic diagram of the communication system architecture shown in fig. 1. As shown in fig. 1, the communication system 100 includes a Business Support System (BSS) 101, a cross-domain management system (CD-MnF) 102, a domain management system (domain-MnF) 103, and a plurality of network elements 104 in the mobile communication network, it should be noted that, 4 network elements 104 are illustrated in fig. 1, which represent four separate network elements respectively, and the logical architecture thereof is shown in fig. 1. The domain management system 103 can be understood as such.

The service support system 101, facing communication service (communication service), may provide functions and management services such as charging, settlement, accounting, customer service, business, network monitoring, communication service lifecycle management, service intent translation, and the like.

The business support system 101 includes an operator's operating system or a vertical industry operating system (vertical operational technology system). For example, the service support system 101 may be a communication service management service provider (MnS provider) or a communication service MnS provider.

The cross-domain management system 102 may also be referred to as a Network Management Function (NMF). The cross-domain management system 102 provides one or more of the following management functions or management services: the network management system comprises a network life cycle management system, a network deployment system, a network fault management system, a network performance management system, a network configuration management system, a network guarantee system, a network optimization function, a communication service provider network intention (intent-CSP) translation system, a communication service user network intention (intent-CSC) translation system and the like. A network herein may comprise one or more network elements, subnetworks, or network slices. For example, the cross-domain management system 102 may be a Network Slice Management Function (NSMF), or a Management Data Analysis Function (MDAF), or a self-organization network function (SON-function), or a cross-domain intention management function unit.

It should be noted that in some deployment scenarios, the cross-domain management system 102 may also provide one or more of the following management functions or management services: the method comprises the following steps of managing the life cycle of the sub-network, deploying the sub-network, managing the fault of the sub-network, managing the performance of the sub-network, managing the configuration of the sub-network, ensuring the sub-network, optimizing the sub-network, translating the sub-network intention of a communication service provider, translating the sub-network intention of a communication service user and the like. Wherein a sub-network may consist of a plurality of small sub-networks or of a plurality of network slice sub-networks. The cross-domain management system 102 may also be referred to as a network management service provider.

The domain management system 103 may also be referred to as a Network Management Function (NMF) or a network element management system. The domain management system 103 provides intra-domain network operation and maintenance functions, i.e. operation and maintenance functions of sub-networks or network elements, including one or more of the following functions or management services: the method comprises the following steps of managing the life cycle of a sub-network or a network element, deploying the sub-network or the network element, managing the fault of the sub-network or the network element, managing the performance of the sub-network or the network element, guaranteeing the sub-network or the network element, optimally managing the sub-network or the network element, translating the intention of the sub-network or the network element and the like. A sub-network here comprises one or more network elements. Alternatively, the sub-networks may also comprise one or more sub-networks, i.e. one or more sub-networks constitute a larger coverage sub-network. Alternatively, the sub-networks herein may also include one or more network slicing sub-networks. Then, the domain management system 103 may also be a network slice sub-network management function (NSSMF), a domain management data analysis system (domain-MDAF), a domain SON-function, or a domain intention management function unit.

The domain management system 103 may also be referred to as a sub network communication service provider (subnet communication service provider) or a network function management service provider (network communication service provider).

The domain management system 103 may be deployed in a manner including, but not limited to:

1) the domain management system 103 is deployed according to a network type, and may be deployed as one or a combination of the following items: the system comprises an access network domain management system, a core network domain management system and a transmission network domain management system.

2) The domain management system 103 is deployed according to an area, and may be deployed as a domain management system of a certain area. Such as Shanghai domain management system, Beijing domain management system, etc. That is, a network element or a set of cells included in a certain area may also be considered as a sub-network, i.e. a regional network.

The network element 104 is an entity providing network services, and includes a core network element, an access network element, and the like. For example, a core network element may include, but is not limited to, an access and mobility management function (AMF) entity, a Session Management Function (SMF) entity, a Policy Control Function (PCF) entity, a network data analysis function (NWDAF) entity, a network storage function (NRF), a gateway, and the like. Access network elements may include, but are not limited to: various types of base stations (e.g., next generation base station (gNB), evolved Node B (eNB), central unit Control Unit (CUCP), Central Unit (CU), Distributed Unit (DU), central unit user plane unit (CUUP), etc.).

The network element 104 may also provide one or more of the following management functions or management services: the method comprises the following steps of management of the life cycle of the network element, deployment of the network element, fault management of the network element, performance management of the network element, guarantee of the network element, optimization function of the network element, intention translation of the network element and the like.

The network element 104 may also be referred to as a network function management service provider (MnS provider).

The service support system 101 and the cross-domain management system 102 illustrated in fig. 1 may be an operator network operation and maintenance management system. Alternatively, the service support system 101 illustrated in fig. 1 is a third-party operation and maintenance system, and the cross-domain management system 102 is an operator network operation and maintenance management system. The domain management system 103 is an equipment manager system.

In the communication system architecture illustrated in fig. 1, if the cross-domain management system 102 is a management device, the service support system 101 is a demand device. If the domain management system 103 is a management device, the service support system 101 or the cross-domain management system 102 is a demand device. If the network element 104 is a management device, the service support system 101, the cross-domain management system 102, or the domain management system 103 is a demand device.

It should be noted that the communication system architecture shown in fig. 1 is a service management architecture, which provides network operation and maintenance services, and includes a management service provider (MnS provider) and a management service consumer (MnS provider). The management device in the embodiment of the present application may also be referred to as a management service provider, and the demand device may also be referred to as a management service consumer.

Optionally, the management device or the demand device for executing the network performance monitoring method provided by the present application may be implemented by one device, or may be implemented by multiple devices together, or may be a functional module in one device, or may also be a chip in one device, which is not specifically limited in this embodiment of the present application. It is understood that the above functions may be either network elements in a hardware device, software functions running on dedicated hardware, or virtualized functions instantiated on a platform (e.g., a cloud platform).

For example, the management device or the demand device executing the network performance monitoring method provided by the present application may be implemented by different devices. For example, by the communications apparatus 200 in fig. 2. Fig. 2 is a schematic structural diagram of a communication device according to an embodiment of the present application. The communication device 200 includes at least one processor 201, communication lines 202, memory 203, and at least one communication interface 204. Wherein the memory 203 may also be comprised in the processor 201.

The processor 201 may be a Central Processing Unit (CPU), other general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The communication link 202 may include a path for transmitting information between the aforementioned components.

A communication interface 204 for communicating with other devices. In the embodiment of the present application, the communication interface 204 may be a module, a circuit, a bus, an interface, a transceiver or other apparatuses capable of implementing a communication function, which is used for communicating with other devices. Alternatively, when the communication interface 204 is a transceiver, the transceiver may be a stand-alone transmitter operable to transmit information to other devices, or a stand-alone receiver operable to receive information from other devices. The transceiver may also be a component that integrates information sending and receiving functions, and the embodiment of the present application does not limit the specific implementation of the transceiver.

The memory 203 may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. Volatile memory can be Random Access Memory (RAM), which acts as external cache memory. By way of illustration, and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous link SDRAM (SLDRAM), and direct rambus RAM (DR RAM) or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 203 may be separate and coupled to the processor 201 via the communication line 202. The memory 203 may also be integrated with the processor 201.

The memory 203 is used for storing computer-executable instructions for implementing the scheme of the application, and is controlled to execute by the processor 201. The processor 201 is configured to execute computer-executable instructions stored in the memory 203, so as to implement the network performance monitoring method provided by the following embodiments of the present application.

It should be noted that the memory described herein is intended to comprise, without being limited to, these and any other suitable types of memory.

Optionally, the computer-executable instructions in the embodiments of the present application may also be referred to as application program codes, instructions, computer programs, or by other names, which are not specifically limited in the embodiments of the present application.

In particular implementations, processor 201 may include one or more CPUs such as CPU0 and CPU1 in fig. 2, for example, as one embodiment.

In particular implementations, communication apparatus 200 may include multiple processors, such as processor 201 and processor 207 in fig. 2, for example, as an example. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores for processing data (e.g., computer program instructions).

In one implementation, the communications apparatus 200 may further include an output device 205 and an input device 206. The output device 205 is in communication with the processor 201 and may display information in a variety of ways. For example, the output device 205 may be a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display device, a Cathode Ray Tube (CRT) display device, a projector (projector), or the like. The input device 206 is in communication with the processor 201 and may receive user input in a variety of ways. For example, the input device 206 may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.

The communication apparatus 200 may be a general-purpose device or a special-purpose device. In a specific implementation, the communication apparatus 200 may be a desktop computer, a portable computer, a network server, a Personal Digital Assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, an embedded device, or a device with a similar structure as in fig. 2. The embodiment of the present application does not limit the type of the communication apparatus 200.

In one possible implementation, when the communication apparatus 200 is used as a management device for executing the network performance monitoring method provided by the present application, the processor 201 executes or executes the software programs and/or modules stored in the memory 203 and calls the data stored in the memory 203 to perform the following functions:

the requested information is received from the demand device via the communication interface 204. The request information is used for requesting network performance data, and the request information carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. Wherein, the network performance data statistic granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent. The network performance data is sent to the demand device via the communication interface 204, and the network performance data satisfies the network performance monitoring condition.

In one possible implementation, if the communication apparatus 200 is used as a demand device for executing the network performance monitoring method provided by the present application, the processor 201 executes or executes the software programs and/or modules stored in the memory 203 and calls the data stored in the memory 203 to perform the following functions:

the request information is sent to the management device through the communication interface 204. The request information is used for requesting network performance data, and the request information carries network performance monitoring conditions. The network performance monitoring condition includes one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition. Wherein, the network performance data statistic granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent. Network performance data is received from the management device via the communication interface 204, the network performance data satisfying the network performance monitoring condition.

It should be noted that, in the following embodiments of the present application, names of messages between devices or names of parameters in messages are only an example, and other names may also be used in a specific implementation, which is not specifically limited in this embodiment of the present application.

Fig. 3 is a schematic diagram illustrating a first network performance monitoring method provided in the embodiment of the present application, as shown in fig. 3, the method may include S301 to S305:

s301, the demand equipment sends request information to the management equipment, and the request information carries network performance monitoring conditions.

The request information is used for requesting network performance data, and the request information carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition.

Optionally, the demand device may send the request information to the management device to subscribe to the network performance data, so as to monitor the network performance. The subscribing to the network performance data described in the embodiment of the present application includes controlling the network performance data to be periodically reported or inquiring the network performance data in real time.

In one possible implementation, the network performance data statistics granularity is used to describe the statistics granularity of the network performance data subscribed to or monitored by the requesting device. I.e. the granularity of the network performance data statistics is used to indicate the granularity of the network performance data to be received. The network performance data statistics granularity includes one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

For example, if the network performance data statistics granularity is in a region level, it indicates that the demand equipment needs the network performance data in the region level granularity. For example, the Reference Signal Received Power (RSRP) of the region level granularity may include an average value of RSRPs of all cells in the region. For another example, the uplink and downlink user throughput rates of the region-level granularity may include an average of the uplink and downlink user throughput rates of all cells in the region. As another example, the number of users at the region level granularity may include, for example, the sum of the number of users accessing the cell in the region. The area may include, for example, a set of network element devices or cells within a certain area.

It should be noted that the network performance data statistical formula or algorithm of the region level granularity may be pre-configured. For example, the network performance data may be preconfigured in the management device, and if the management device receives the request information sent by the demand device, where the network performance monitoring condition carried in the request information carries the statistical requirement of the area-level granularity, the network performance data may be counted according to a preconfigured statistical formula. For example, a Radio Resource Control (RRC) connection number summation formula is preconfigured in the management device. If the network performance data statistics granularity is area level, the sum of the RRC connection numbers of the cells in the current area can be calculated as the RRC connection number of the area level by using a pre-configured formula.

Illustratively, if the network performance statistics granularity is cell-level, it indicates that the demand device needs network performance data with cell-level granularity. For example, the RSRP of the cell-level granularity may include an average value of RSRPs of User Equipments (UEs) of all access cells. For another example, the uplink and downlink user throughput rates of the cell-level granularity may include an average of uplink and downlink user throughput rates of all UEs accessing the cell. For another example, the number of users with cell-level granularity may include the number of UEs accessing all cells. Wherein a cell represents a wireless covered area identified by a base station identity code or a global cell identity code.

It should be noted that the network performance data statistical formula or algorithm of the cell level granularity may be preset.

For example, if the granularity of the network performance statistics is grid level, it indicates that the demand device needs network performance data with grid level granularity. For example, the RSRP at the grid level granularity may include an average value of RSRPs of UEs on a grid. For another example, the uplink and downlink user throughput of the grid-level granularity may include an average of the uplink and downlink user throughput of the UE in the grid. As another example, the grid-level user number may include the number of UEs in the grid, for example. Wherein, the grid represents each small area after dividing the geographic area into a plurality of small areas, and each grid can be described as latitude and longitude information and grid size.

It should be noted that the network performance data statistical formula or algorithm with grid level granularity may be preset.

Illustratively, if the network performance statistics granularity is at a network element level, it indicates that the demand device needs network performance data at the network element level granularity. For example, the RSRP of the network element level granularity may include an average RSRP of UEs of the access network element. For another example, the uplink and downlink user throughput rates of the network element level granularity may include an average of the uplink and downlink user throughput rates of the UE accessing the network element. As another example, the number of users with the granularity at the network element level may include the number of UEs accessing the network element.

It should be noted that the network performance data statistical formula or algorithm at the network element level may be preset.

For example, if the granularity of the network performance statistics is at the network slice level, it indicates that the demand device needs network performance data at the network slice level granularity. For example, RSRP at network slice level granularity may include an average value of RSRPs of UEs accessing the network slice. For another example, the uplink and downlink user throughput rates at the network slice level granularity may include, for example, an average of the uplink and downlink user throughput rates of UEs accessing the network slice. As another example, the number of users at the network slice level granularity may include, for example, the number of UEs accessing the network slice. A network slice may include, for example, a logical network that satisfies a particular service or customer running on a general network infrastructure. The network slice is identified by a network slice instance, and the network slice in the embodiment of the present application refers to a network slice instance.

It should be noted that, the network performance data statistical formula or algorithm of the network slice level granularity may be preset.

For example, if the network performance statistics granularity is sub-network level, it indicates that the requesting device needs network performance data of sub-network level granularity. For example, the sub-network level granularity RSRP may comprise an average value of RSRPs of UEs accessing the sub-network. For another example, the uplink and downlink user throughput of the sub-network level granularity may include an average of the uplink and downlink user throughput of the UE accessing the sub-network. As another example, the number of users at sub-network level granularity may include, for example, the number of UEs accessing the sub-network. Wherein a sub-network is a collection of a set of network elements.

It should be noted that the statistical formula or algorithm of the network performance data at sub-network level granularity may be preset.

Illustratively, if the network performance statistics granularity is the network slice service level, it indicates that the demand device needs the network performance data of the network slice service level granularity. For example, RSRP at network slice traffic level granularity may include an average value of RSRPs of UEs accessing network slice traffic. For another example, the uplink and downlink user throughput rates of the network slice service level granularity may include, for example, an average of the uplink and downlink user throughput rates of the UE accessing the network slice service. As another example, the number of users at the network slice service level granularity may include, for example, the number of UEs accessing the network slice. The network slice service may include, for example, single network slice selection assistance information (S-NSSAI) for identifying a network slice.

It should be noted that the network performance data statistical formula or algorithm at the network slice level may be preset.

For example, if the granularity of the network performance statistics is at a tenant level, it indicates that the demand device needs network performance data at the tenant level granularity. For example, RSRP of tenant-level granularity may include an average value of RSRPs of UEs belonging to a tenant, for example. For example, the uplink and downlink user throughput of the tenant-level granularity may include an average of uplink and downlink user throughput of UEs belonging to the tenant. For example, the number of users with tenant-level granularity may include the number of UEs belonging to a tenant, for example. A tenant may include, for example, an instance of the presence of a Mobile Virtual Network Operator (MVNO) in a particular country or region.

It should be noted that the network performance data statistical formula or algorithm at the tenant level may be preset.

For example, if the granularity of the network performance statistics is user level, it indicates that the demand device needs the network performance data with the user level granularity. Such as time delay at user level granularity, user rate at user level granularity, etc. The network performance data of the user-level granularity is measured by the UE, reported to the management equipment and then sent to the demand equipment by the management equipment.

In one possible implementation, the network performance data class is used to describe a network performance class of network performance data that the demand device needs to subscribe to or monitor. I.e. the network performance data category is used to indicate the category of network performance data to be received. The network performance data categories include one or more of: coverage class, capacity class, quality class, switching class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracking data, MDT data, analysis data and QoE data.

For example, if the network performance data category is the coverage class, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance data of the coverage class. Examples may include: RSRP, signal to interference plus noise ratio (SINR), etc.

For example, if the network performance data category is a capacity class, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance data of the capacity class. Examples may include: uplink and downlink throughput, Physical Resource Block (PRB) usage, Radio Resource Control (RRC) connection count, and the like.

For example, if the network performance data category is quality class, the network performance data indicating that the demand device needs to subscribe to or monitor is quality class network performance data. Examples may include: uplink and downlink air interface time delay, packet loss rate, switching success rate and the like.

For example, if the network performance data category is the handover class, the network performance data indicating that the demand device needs to subscribe to or monitor is the handover class. Examples may include: the number of times of handover request execution, the number of times of successful handover execution, and the mean time of handover request execution.

For example, if the network performance data category is a resource class, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance data of the resource class. Examples may include: CPU occupancy, virtual resource usage, etc.;

for example, if the network performance data category is the user class, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance data of the user class. For example, user delay, user perception rate, number of users, user location, etc. may be included.

For example, if the network performance data category is the service class, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance data of the service class. For example, the information may include service delay, service sensing rate, delay jitter, etc., call drop rate, and packet loss rate.

For example, if the network performance data category is a performance measurement, the network performance data indicating that the demand device needs to subscribe to or monitor is the network performance measurement. For example, the resource utilization rate of the PRB, the number of execution times of the handover request, the CPU occupancy, and the like may be included.

For example, if the network performance data category is a Key Performance Indicator (KPI), the network performance data indicating that the demand device needs to subscribe to or monitor is the KPI. Which may include, for example, latency, throughput rate, etc.

For example, if the network performance data category is signaling trace (trace) data, the network performance data indicating that the requesting device needs to subscribe to or monitor is the signaling trace data. For example, packet delay measurement, packet loss rate measurement, and the like may be included.

For example, if the network performance data category is Minimization Drive Tests (MDT), the network performance data indicating that the required device needs to subscribe to or monitor is the MDT. For example, the Reference Signal Received Power (RSRP), signal to interference noise ratio (SINR), etc. may be included.

For example, if the network performance data category is the analysis data, the network performance data indicating that the demand device needs to subscribe to or monitor is the analysis data. The analysis data includes at least one of management analysis data and network analysis data. For example, may include coverage problem analysis data, capacity problem analysis data, traffic maps, coverage maps, and the like.

For example, if the network performance data category is quality of experience (QoE) data, the network performance data indicating that the demand device needs to subscribe to or monitor is the quality of experience data. For example, may include average throughput rate, frame rate, jitter period, etc.

In a possible implementation manner, the network performance data screening condition is used to describe a screening condition of network performance data that needs to be subscribed or monitored by the demand device, that is, the network performance data screening condition is used to indicate a screening condition that needs to be met by the network performance data to be received. The network performance data screening conditions include one or more of the following: network problem conditions, time range, network performance threshold range, area range.

Illustratively, if the network performance data screening condition includes a network problem condition, it indicates that the demand device needs to subscribe to or monitor the corresponding network performance data when the network problem occurs. Such as network performance data when network problems such as weak coverage, network congestion, etc. occur. The network performance data statistics granularity and the network performance data category may include RSRP when weak coverage occurs, RRC connection number when network congestion occurs, PRB usage rate when network congestion occurs, and the like.

For example, if the network performance data filtering condition includes a time range, it indicates that the demand device needs to subscribe to or monitor the network performance data within the specified time range. Such as network performance data for busy hours, certain time periods, idle hours, etc. The statistical granularity of the network performance data and the category of the network performance data may include the number of connections of users in busy hours, the user sensing rate in a certain time period, the idle time delay, and the like.

For example, if the network performance data filtering condition includes a network performance threshold range, it indicates that the demand device needs to subscribe to or monitor the network performance data within or outside the network performance threshold range. For example, a user perceived rate of <5Mbps, an RSRP value of RSRP < -20dB, etc.

For example, if the network performance data filtering condition includes an area scope, it indicates that the demand device needs to subscribe to or monitor the network performance data within the area scope. The area range can be expressed by one or more of the following ways: latitude and longitude, administrative area, Tracking Area Code (TAC). The area coverage may also represent a group of cells or a group of base stations, the area coverage being described by an identification of the area. For example, the user perception rate in the area range a, the number of users in the area range a, and the like.

S302, the management device receives request information from the demand device.

The request information received by the management device in S302, that is, the request information sent by the demand device in S301, is not described herein again.

S303, the management equipment determines network performance data according to the network performance monitoring condition.

Specifically, after receiving the request information sent by the demand device, the management device can obtain the network performance monitoring condition carried in the request information, and further determine the network data according to the network performance monitoring condition.

If the network performance monitoring condition includes the network performance data statistics granularity, the management device may perform statistical analysis on the network performance data corresponding to the network performance data statistics granularity according to the network performance data statistics formula or algorithm preconfigured in the management device described in S301.

Optionally, the network performance monitoring condition includes a network performance data statistics granularity, and the management device executes one or more of the following contents according to the network performance data statistics granularity: collecting network performance data of network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

Optionally, the network performance monitoring condition includes a network performance data category, the management device determines a network performance data name corresponding to the network performance data category, and executes one or more of the following contents according to the network performance data name: collecting network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

The correspondence between the network performance data category and the network performance data name may be configured in the management device in advance. For example, when the network performance data type is the coverage class, the network performance data name is RSRP or SINR.

Specifically, the management device obtains a corresponding network data name according to the network performance data type in the network performance monitoring condition. And then, acquiring corresponding network performance data according to the network data name.

For example, after the management device collects the network performance data of the coverage class, the management device directly sends the collected network performance data of the coverage class to the demand device.

For another example, after querying the RSRP value in the local database, the management device sends the queried RSRP value to the demand device.

Optionally, the network performance monitoring condition includes a network performance data screening condition, and the management device executes one or more of the following contents according to the network performance data screening condition: the method comprises the steps of collecting network performance data meeting network performance data screening conditions, carrying out statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

For example, the management device screens conditions according to network performance data, and acquires throughput rates of uplink and downlink users in busy hours.

For another example, the management device queries, according to the network performance data screening condition, the local database for the RSRP value when the weak coverage problem is detected.

S304, the management device sends the network performance data to the demand device.

The network performance data is obtained by the management device according to the network performance monitoring condition, and the network performance data can meet the network performance monitoring condition. After the management device obtains the network performance data according to the network performance monitoring condition, the management device may send the obtained network performance data to the demand device.

S305, the demand equipment receives the network performance data from the management equipment.

Specifically, the network performance data received by the demand device in S305 corresponds to a specific implementation manner of the management device in S304 for sending the network performance data, which is not described herein again.

After S305, the demand device may operate and maintain its managed network according to the network performance data.

It should be noted that, an execution sequence of the above steps included in the network performance monitoring method provided in the embodiment of the present application may be configured according to actual requirements, which is not specifically limited in this application, and fig. 3 only illustrates one possible execution sequence of the above steps included in the network performance monitoring method, and is not specifically limited.

Therefore, according to the network performance monitoring method provided by the embodiment of the application, the demand equipment obtains the network performance data statistic granularity and/or the network performance data category and/or the network performance data meeting the network performance data screening condition by configuring the network performance monitoring condition. The method and the device realize the flexible customization requirement of the network performance data, improve the flexibility of the control and the opening of the network performance data, and improve the network operation and maintenance efficiency.

Correspondingly, optionally, the demand device needs to determine the request information before sending the request information to the management device. That is, the demand device needs to determine the network performance monitoring condition first. Fig. 4 is a schematic diagram illustrating a network performance monitoring method according to an embodiment of the present application. As shown in fig. 4, the network performance monitoring method provided in the embodiment of the present application may further include, before S301, S301a or S301 b.

S301a, the demand device receives the network performance monitoring condition.

Specifically, the demand device may directly receive the network performance monitoring condition input by the operation and maintenance staff. That is, the network performance monitoring condition is determined by collecting the network performance monitoring requirement of the operation and maintenance personnel.

For example, fig. 5 is a schematic view of a network performance monitoring condition collection interface provided in the embodiment of the present application, and referring to fig. 5, the interface 510 is used for collecting network performance monitoring conditions. The demand equipment corresponds to the display interface 512 by collecting the network performance monitoring conditions selected by the operation and maintenance personnel in the menu bar 511. The need for the operation and maintenance personnel to subscribe to or monitor network performance data is collected via interface 512. For example, in fig. 5, the interface 512 displays the content of the network performance data filtering condition selected by the menu bar 511. The demand equipment determines the screening conditions of the network performance data by collecting the content input or selected by the operation and maintenance personnel on the interface 512.

It will be appreciated that the demand device may also receive the network performance monitoring condition in other ways. For example, other devices such as an automation module, transmitted network performance monitoring conditions, etc. are directly received. The embodiments of the present application are not particularly limited.

S301b, the demand equipment receives the network performance optimization demand or the network performance optimization intention, and determines the network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

The network performance optimization requirement or the network performance optimization intention is used for optimizing the network performance and carrying out network operation and maintenance management. In the network operation and maintenance process, the network performance monitoring condition can be determined according to the current network condition or real-time requirements. Different clients or automation modules have different requirements for subscribing or monitoring network performance, and the demand equipment can flexibly monitor the network performance according to the change of the requirements or intentions.

In this way, the demand device may determine the network performance monitoring condition required by the operation and maintenance personnel or the automation module through two different implementations of the above-mentioned S301a and S301 b. For example, the demand device directly receives the network performance monitoring condition. Or, in the network operation process, the demand device receives the network performance optimization demand or the network performance optimization intention, and determines the network performance monitoring condition by analyzing the network performance optimization demand or the network performance optimization intention. And then, the demand equipment can send a request message to the management equipment, wherein the request message carries the determined network performance monitoring conditions, and acquires corresponding network performance data, thereby realizing flexible network performance monitoring and meeting the operation and maintenance requirements.

Optionally, in the above S301a or S301b, in the process of determining the request information by the management device, other contents included in the network performance monitoring condition may be further determined. For example, the network performance monitoring condition further includes one or more of the following items: receiving an address, counting a period and reporting the period.

The receiving address, the counting period and the reporting period are determined by the demand equipment according to one or more of the following contents: the network performance data statistic granularity, the network performance data category and the network performance data screening condition.

In a possible implementation manner, the network performance monitoring condition further includes a receiving address set for one or more of the following items: different network performance data statistics granularity, different network performance data categories, and different receiving addresses set by network performance data screening conditions. The demand equipment receives the network performance data sent by the management equipment at the receiving address.

Illustratively, the demand device sets the same or different receive addresses for different network performance data statistics granularities. For example, the network performance data receiving address of the cell level granularity is address 1, and the network performance data receiving address of the network slice level granularity is address 2. Alternatively, the requiring device sets the same or different receiving addresses for different network performance data categories. For example, the network performance data receiving address of the capacity class is address a, and the network performance data receiving address of the coverage class is address B. Alternatively, the requesting device may set the same or different receiving addresses for different network performance data statistics granularity and different network performance data categories. For example, the network performance data receiving address of the cell-level granularity capacity class is address 3.

In this way, the demand device can directly distinguish the type of the received network performance data by different receiving addresses.

In a possible implementation manner, the network performance monitoring condition further includes a statistical period set for one or more of the following items: different network performance data statistics granularity, different network performance data categories, and different network performance data screening conditions. And the demand equipment receives the network performance data which is sent by the management equipment and counted according to the counting period.

Illustratively, the demand device sets the same or different statistical periods for different network performance data statistical granularities. For example, the network performance data statistics period of the cell level granularity is 5 minutes, and the network performance data statistics period of the network slice level granularity is 10 minutes. The demand device sets the same or different statistical periods for different network performance data categories. For example, the network performance data statistics period of the capacity class is 10 minutes, and the network performance data statistics period of the coverage class is 20 minutes.

In a possible implementation manner, the network performance monitoring condition further includes a reporting period set for one or more of the following: different network performance data statistics granularity, different network performance data categories, and different network performance data screening conditions. And the demand equipment receives the network performance data sent by the management equipment according to the reporting period.

Illustratively, the demand devices set the same or different reporting periods for different network performance data statistics granularities. For example, the reporting period of the network performance data of the cell level granularity is 5 minutes, and the reporting period of the network performance data of the network slice level granularity is 10 minutes. The demand equipment sets the same or different reporting periods according to different network performance data types. For example, the reporting period of the network performance data of the capacity class is 10 minutes, and the reporting period of the network performance data of the coverage class is 20 minutes.

Correspondingly, optionally, if the network performance monitoring condition includes the statistical period, in the above step S303, the management device determines the network performance data according to the network performance monitoring condition. The method can be specifically realized as follows: and the management equipment determines the network performance data according to the network performance monitoring conditions and the statistical period.

For example, the management device statistically analyzes the network performance data at the granularity of network performance statistics according to the statistical period. Therefore, the network performance data is periodically acquired, the purpose of network performance monitoring is met, and the power consumption can be saved.

It is to be understood that, correspondingly optionally, in the above S305, the demand device receives the network performance data determined by the management device according to the statistical period.

Correspondingly, optionally, if the network performance monitoring condition includes the receiving address, in the above S304, the management device sends the network performance data to the demand device, which may specifically be implemented as: and the management equipment sends the network performance data to the receiving address contained in the network performance monitoring condition corresponding to the demand equipment.

It can be understood that, correspondingly optionally, in the above S305, the demand device may receive the network performance data sent by the management device at the receiving address, so as to prevent data loss.

Correspondingly, optionally, if the network performance monitoring condition includes a reporting period, in the above S304, the management device sends the network performance data to the required device, which may specifically be implemented as: and the management equipment sends the network performance data to the required equipment according to the reporting period contained in the network performance monitoring condition.

It can be understood that, correspondingly, in the above S305, the demand device may receive the network performance data sent by the management device according to the reporting period, so as to save power consumption.

Optionally, in S301, the demand device may send the request information to the management device through a different interface, and the demand device may match the interface type through the type of the request information.

The request information is network performance management configuration request information, network performance intention request information or network performance task management request information. The network performance management configuration request information is sent through the management configuration interface, the network performance intention request information is sent through the intention interface, and the network performance task management request information is sent through the character management interface.

In a possible implementation manner, the request information is network performance management configuration request information, and the network performance management configuration request information carries a network performance management configuration model, where the network performance management configuration model includes a network performance monitoring condition. As shown in table 1 below, the attribute names corresponding to the network performance monitoring conditions are configured in the network performance management configuration model. After receiving the network performance management configuration request information, the management device can determine the network performance data to be monitored by reading the attribute name contained in the network performance management configuration model carried by the management device.

TABLE 1

In table 1 above, M indicates mandatory (regulatory), T indicates correct (true), and F indicates false (false). The network performance management configuration model may be a network performance management configuration model configured after adding a network performance monitoring condition based on an existing network performance management configuration model, and includes a network performance control object identifier, a state, file reporting indication information or stream reporting indication information in the existing network performance management configuration model, and details are not repeated herein.

Taking the statistical granularity of the network performance data in table 1 as an example, the attribute name is configured in the network performance configuration model, so that the support qualifier is identified as M, that is, the attribute is configured forcibly. The network performance data statistics granularity attribute is readable and writable. The granularity of the network performance data statistics in the network performance configuration model may vary according to the determined network performance monitoring conditions, and is not constant. The network performance data statistics granularity is unpublished.

In a possible implementation manner, the request information is network performance intention request information, and the network performance intention request information carries a network performance intention model, where the network performance intention model includes a network performance monitoring condition. As shown in table 2 below, an exemplary network performance intent model is presented. The intent objects in table 2 are the corresponding network performance monitoring conditions. After receiving the network performance intention request information, the management device can determine the network performance data to be monitored by reading the intention object contained in the network performance intention model carried by the management device.

TABLE 2

It should be noted that the network performance intention model may be a network performance intention model configured after adding a network performance monitoring condition based on an existing network performance intention model, and includes information such as an intention object identifier and an intention state in the existing network performance intention model, which is not described herein again.

In a possible implementation manner, the request information is network performance task management request information, and the network performance monitoring condition is carried in the network performance task management request information. After receiving the network performance task management request information, the management device can directly determine the network performance data to be monitored by reading the network performance monitoring conditions contained in the network performance task management request information.

It should be noted that the network performance task management request information may be a network performance task management request configured after adding a network performance monitoring condition based on an existing network performance task management request, and includes information such as a management object type, a management object identifier, a reporting mode, start time and end time, and priority carried in the existing network performance task management request information, which is not described herein again.

The network performance monitoring method provided by the embodiment of the present application is described in detail above with reference to fig. 3 and 4. The network performance monitoring apparatus provided in the embodiments of the present application is described in detail below with reference to fig. 6 and 7.

In a possible design, fig. 6 is a schematic structural diagram of a network performance monitoring apparatus provided in the embodiment of the present application. As shown in fig. 6, the network performance monitoring apparatus 600 includes: a receiving module 601, a processing module 602 and a sending module 603. The network performance monitoring apparatus 600 may be used to implement the functions of the management device involved in the above method embodiments. The network performance monitoring apparatus 600 may be a management device itself, a functional module or a chip in the management device, or an apparatus used in cooperation with the management device.

The receiving module 601 is configured to receive request information from a demand device. The request information is used to request network performance data. The request information carries network performance monitoring conditions.

Optionally, the network performance monitoring condition includes one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition.

Wherein, the network performance data statistic granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent.

The processing module 602 is configured to determine network performance data according to the network performance monitoring condition.

Wherein the network performance data satisfies the network performance monitoring condition.

A sending module 603, configured to send the network performance data to the demand device.

In a possible implementation, the processing module 602 is specifically configured to execute one or more of the following items according to the network performance data statistics granularity: collecting network performance data of network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

In a possible implementation manner, the processing module 602 is further configured to determine a network performance data name corresponding to the network performance data category.

The processing module 602 is specifically configured to execute one or more of the following items according to the network performance data name: collecting network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

In a possible implementation manner, the processing module 602 is specifically configured to execute one or more of the following items according to the network performance data screening condition: the method comprises the steps of collecting network performance data meeting network performance data screening conditions, carrying out statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

In a possible implementation manner, the request information is network performance management configuration request information, network performance intention request information or network performance task management request information.

Optionally, the network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes a network performance monitoring condition.

Optionally, the network performance intention request information carries a network performance intention model, and the network performance intention model includes a network performance monitoring condition.

Optionally, the network performance task management request information carries a network performance monitoring condition.

In a possible implementation manner, the network performance monitoring condition further includes one or more of the following conditions: receiving an address, counting a period and reporting the period.

The sending module 603 is further configured to send the network performance data to the demand device at the receiving address if the network performance monitoring condition further includes the receiving address.

The processing module 602 is further configured to, if the network performance monitoring condition further includes a statistical period, perform statistics on the network performance data according to the statistical period.

The sending module 603 is further configured to send, to the demand device, the network performance data counted by the processing module 602 according to the statistical period if the network performance monitoring condition further includes the statistical period.

The sending module 603 is further configured to send the network performance data to the required device according to the reporting period if the network performance monitoring condition further includes the reporting period.

Optionally, the network performance monitoring apparatus 600 shown in fig. 6 may further include a storage module (not shown in fig. 6) that stores programs or instructions. The program or instructions, when executed by the processing module 602, enable the network performance monitoring apparatus 600 shown in fig. 6 to perform the network performance monitoring method shown in fig. 3 or fig. 4.

The processing module 602 involved in the network performance monitoring apparatus 600 shown in fig. 6 may be implemented by a processor or a processor-related circuit component, and may be a processor or a processing unit. The receiving module 601 and the transmitting module 603 may also be integrated together, such as a transceiver module, implemented by a transceiver or transceiver-related circuit components. The receiving module 601 is configured to receive request information sent by a demand device. The sending module 603 is configured to send the network performance data to the demand device. The embodiment of the present application does not specifically limit the specific implementation manners of the receiving module 601 and the sending module 603. The operations and/or functions of the modules in the network performance monitoring apparatus 600 are respectively for implementing the corresponding flows of the network performance monitoring methods shown in fig. 3 or fig. 4, and are not described herein again for brevity.

The technical effect of the network performance monitoring apparatus 600 shown in fig. 6 can refer to the technical effect of the network performance monitoring method shown in fig. 3 or fig. 4, and is not described herein again.

In yet another possible design, fig. 7 is a schematic structural diagram of a network performance monitoring apparatus provided in the embodiment of the present application. As shown in fig. 7, the network performance monitoring apparatus 700 includes: a transmitting module 701 and a receiving module 702. The network performance monitoring apparatus 700 may be used to implement the functions of the demand devices involved in the above-described method embodiments. The network performance monitoring apparatus 700 may be a demand device itself, or may also be a functional module or chip in the demand device, or an apparatus used in cooperation with the demand device.

A sending module 701, configured to send request information to a management device. The request information is used for requesting network performance data, and the request information carries network performance monitoring conditions.

Wherein the network performance data statistics granularity is used to indicate the granularity of the network performance data to be received; the network performance data category is used for indicating the category of the network performance data to be received; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received.

A receiving module 702 is configured to receive network performance data from a management device.

In a possible implementation, the receiving module 702 is further configured to receive a network performance monitoring condition.

Optionally, the network performance monitoring apparatus 700 may further include a processing module 703.

The receiving module 702 is further configured to receive a network performance optimization requirement or a network performance optimization intention. Wherein the network performance optimization requirement or network performance optimization intent is used to optimize network performance.

The processing module 703 is further configured to determine a network performance monitoring condition according to the network performance optimization requirement or the network performance optimization intention.

The receiving address, the counting period, and the reporting period are determined by the processing module 703 according to one or more of the following: the network performance data statistic granularity, the network performance data category and the network performance data screening condition.

The receiving module 702 is further configured to receive, at the receiving address, the network performance data sent by the management device if the network performance monitoring condition further includes the receiving address.

The receiving module 702 is further configured to receive network performance data, which is sent by the management device and is counted according to the statistical period, if the network performance monitoring condition further includes the statistical period.

The receiving module 702 is further configured to receive the network performance data sent by the management device according to the reporting period if the network performance monitoring condition further includes the reporting period.

Optionally, the network performance monitoring apparatus 700 shown in fig. 7 may further include a storage module (not shown in fig. 7) that stores programs or instructions. The program or instructions, when executed by the processing module 703, enable the network performance monitoring apparatus 700 shown in fig. 7 to perform the network performance monitoring method shown in fig. 3 or fig. 4.

The processing module 703 involved in the network performance monitoring apparatus 700 shown in fig. 7 may be implemented by a processor or a processor-related circuit component, and may be a processor or a processing unit. The sending module 701 and the receiving module 702 may also be integrated together, such as a transceiver module, implemented by a transceiver or transceiver-related circuit components. The sending module 701 is configured to send request information to the management device. The receiving module 702 is configured to receive the network performance sent by the management device. The embodiment of the present application does not specifically limit the specific implementation manners of the sending module 701 and the receiving module 702. The operations and/or functions of the modules in the network performance monitoring apparatus 700 are respectively for implementing the corresponding flows of the network performance monitoring methods shown in fig. 3 or fig. 4, and are not described herein again for brevity.

The technical effect of the network performance monitoring apparatus 700 shown in fig. 7 can refer to the technical effect of the network performance monitoring method shown in fig. 3 or fig. 4, and is not described herein again.

Fig. 8 is a schematic structural diagram of a network performance monitoring system according to an embodiment of the present application. As shown in fig. 8, the network performance monitoring system 800 includes a demand device 801 and a management device 802.

The demand device 801 is configured to send request information to the management device 802. The request information is used for requesting network performance data, and the request information carries network performance monitoring conditions.

Wherein, the network performance data statistics granularity is used to indicate the granularity of the network performance data to be received by the demand device 801; the network performance data category is used to indicate the category of the network performance data to be received by the demand device 801; the network performance data filtering condition is used to indicate a filtering condition that needs to be satisfied by the network performance data to be received by the demand device 801.

A management device 802 for receiving the request information from the demand device 801.

The management device 802 is further configured to determine network performance data according to the network performance monitoring condition. Wherein the network performance data satisfies the network performance monitoring condition.

The management device 802 is also configured to send network performance data to the demand device 801.

The demand device 801 is also configured to receive network performance data from the management device 802.

It will be appreciated that more or fewer components than shown, or some components combined, or some components split, or a different arrangement of components may be included in the network performance monitoring system 800. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding component, and are not described herein again.

An embodiment of the present application further provides a chip system, as shown in fig. 9, where the chip system includes at least one processor 901 and at least one interface circuit 902. The processor 901 and the interface circuit 902 may be interconnected by wires. For example, the interface circuit 902 may be used to receive signals from other devices. Also for example, the interface circuit 902 may be used to send signals to other devices, such as the processor 901. Illustratively, the interface circuit 902 may read instructions stored in the memory and send the instructions to the processor 901. The instructions, when executed by the processor 901, may cause the network performance monitoring apparatus to perform the steps of the network performance monitoring method in the above-described embodiments. Of course, the chip system may further include other discrete devices, which is not specifically limited in this embodiment of the present application.

An embodiment of the present application further provides a chip system, including: a processor coupled to a memory for storing a program or instructions that, when executed by the processor, cause the system-on-chip to implement the method of any of the above method embodiments.

Optionally, the system on a chip may have one or more processors. The processor may be implemented by hardware or by software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, or the like. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

Optionally, the memory in the system-on-chip may also be one or more. The memory may be integrated with the processor or may be separate from the processor, which is not limited in this application. For example, the memory may be a non-transitory processor, such as a read only memory ROM, which may be integrated with the processor on the same chip or separately disposed on different chips, and the type of the memory and the arrangement of the memory and the processor are not particularly limited in this application.

The system-on-chip may be, for example, a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), a system on chip (SoC), a Central Processing Unit (CPU), a Network Processor (NP), a digital signal processing circuit (DSP), a Microcontroller (MCU), a Programmable Logic Device (PLD), or other integrated chips.

It will be appreciated that the steps of the above described method embodiments may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in a processor.

Embodiments of the present application also provide a storage medium for storing instructions for use by the above-described communication apparatus.

The embodiment of the present application further provides a computer-readable storage medium, where a computer instruction is stored in the computer-readable storage medium, and when the computer instruction runs on a server, the server is caused to execute the relevant method steps to implement the network performance monitoring method in the foregoing embodiment.

The embodiments of the present application further provide a computer program product, which when running on a computer, causes the computer to execute the above related steps, so as to implement the network performance monitoring method in the above embodiments.

In addition, embodiments of the present application also provide an apparatus, which may be specifically a component or a module, and may include one or more processors and memories connected to each other; wherein the memory is used to store computer programs, one or more of which comprise instructions. The instructions, when executed by the one or more processors, cause the apparatus to perform the network performance monitoring method in the above-described method embodiments.

The apparatus, the computer-readable storage medium, the computer program product, or the chip provided in the embodiments of the present application are all configured to execute the corresponding methods provided above, so that the beneficial effects achieved by the apparatus, the computer-readable storage medium, the computer program product, or the chip may refer to the beneficial effects in the corresponding methods provided above, and are not described herein again.

The steps of a method or algorithm described in connection with the disclosure herein may be embodied in hardware or in software instructions executed by a processor. The software instructions may be comprised of corresponding software modules that may be stored in Random Access Memory (RAM), flash memory, Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable disk, a compact disc read only memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuit (ASIC).

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.

In the embodiments provided in the present application, it should be understood that the disclosed method can be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of modules or units through some interfaces, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for monitoring network performance, the method comprising:

the management equipment receives request information from the demand equipment; the request information is used for requesting network performance data; the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent;

the management equipment determines the network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition;

the management device sends the network performance data to the demand device.

2. The method of claim 1, wherein the network performance monitoring condition comprises a granularity of statistics of the network performance data; the management device determines the network performance data according to the network performance monitoring condition, including:

the management device executes one or more of the following according to the network performance data statistic granularity: and acquiring the network performance data of the network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

3. The method of claim 1, wherein the network performance data category is included in a network performance monitoring condition; the management device determines the network performance data according to the network performance monitoring condition, including:

the management equipment determines a network performance data name corresponding to the network performance data type;

the management device executes one or more of the following items according to the network performance data name: collecting the network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

4. The method according to claim 1, wherein the network performance monitoring condition comprises the network performance data screening condition; the management device determines the network performance data according to the network performance monitoring condition, including:

the management device executes one or more of the following according to the network performance data screening condition: collecting the network performance data meeting the network performance data screening conditions, performing statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

5. The method according to any one of claims 1 to 4, wherein the request information is network performance management configuration request information, network performance intent request information or network performance task management request information;

the network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model comprises the network performance monitoring condition;

the network performance intention request information carries a network performance intention model, and the network performance intention model comprises the network performance monitoring conditions;

and the network performance task management request information carries the network performance monitoring condition.

6. The method of any of claims 1-5, wherein the network performance data statistics granularity comprises one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

7. The method according to any of claims 1-6, wherein the network performance data categories comprise one or more of: coverage class, capacity class, quality class, handover class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracing data, MDT data, analysis data, and QoE data.

8. The method according to any of claims 1-7, wherein the network performance data screening conditions comprise one or more of: network problem conditions, time range, network performance threshold range, area range.

9. A method for monitoring network performance, the method comprising:

the demand equipment sends request information to the management equipment; the request information is used for requesting network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received; the network performance data category is used for indicating the category of the network performance data to be received; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received;

the demand device receiving the network performance data from the management device; the network performance data satisfies the network performance monitoring condition.

10. The method of claim 9, wherein before the demand device sends the request information to the management device, the method further comprises:

the demand equipment receives the network performance monitoring condition;

alternatively, the first and second electrodes may be,

the demand equipment receives a network performance optimization demand or a network performance optimization intention; wherein the network performance optimization requirement or the network performance optimization intent is to optimize network performance;

and the demand equipment determines the network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

11. The method of claim 9 or 10, wherein the network performance data statistics granularity comprises one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

12. The method according to any of claims 9-11, wherein the network performance data categories comprise one or more of: coverage class, capacity class, quality class, switching class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracking data, MDT data, analysis data and QoE data.

13. The method according to any of claims 9-12, wherein the network performance data screening conditions comprise one or more of: network problem conditions, time range, network performance threshold range, area range.

14. A method for monitoring network performance, the method comprising:

the demand equipment sends request information to the management equipment; the request information is used for requesting network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received by the demand equipment; the network performance data category is used for indicating the category of the network performance data to be received by the demand equipment; the network performance data screening condition is used for indicating a screening condition which needs to be met by the network performance data to be received by the demand equipment;

the management device receives the request information from the demand device;

the management device sends the network performance data to the demand device;

the demand device receives the network performance data from the management device.

15. An apparatus for monitoring network performance, the apparatus comprising: the device comprises a receiving module, a processing module and a sending module;

the receiving module is used for receiving request information from the demand equipment; the request information is used for requesting network performance data; the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be sent;

the processing module is used for determining the network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition;

the sending module is configured to send the network performance data to the demand device.

16. The apparatus of claim 15,

the processing module is specifically configured to execute one or more of the following according to the network performance data statistics granularity: and acquiring the network performance data of the network performance statistic granularity, carrying out statistic analysis on the network performance data of the network performance statistic granularity, and inquiring the network performance data of the network performance statistic granularity in a local database.

17. The apparatus of claim 15,

the processing module is further configured to determine a network performance data name corresponding to the network performance data category;

the processing module is specifically configured to execute one or more of the following items according to the network performance data name: collecting the network performance data corresponding to the network performance data name, counting and analyzing the network performance data corresponding to the network performance data name, and inquiring the network performance data corresponding to the network performance data name in a local database.

18. The apparatus of claim 15,

the processing module is specifically configured to execute one or more of the following items according to the network performance data screening condition: collecting the network performance data meeting the network performance data screening conditions, performing statistical analysis on the network performance data meeting the network performance data screening conditions, and inquiring the network performance data meeting the network performance data screening conditions in a local database.

19. The apparatus according to any one of claims 15-18, wherein the request information is network performance management configuration request information, network performance intent request information or network performance task management request information;

20. The apparatus of any of claims 15-19, wherein the network performance data statistics granularity comprises one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

21. The apparatus according to any of claims 15-20, wherein the network performance data categories comprise one or more of: coverage class, capacity class, quality class, switching class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracking data, MDT data, analysis data and QoE data.

22. The apparatus according to any of claims 15-21, wherein the network performance data screening conditions comprise one or more of: network problem conditions, time range, network performance threshold range, area range.

23. An apparatus for monitoring network performance, the apparatus comprising: a transmitting module and a receiving module;

the sending module is used for sending request information to the management equipment; the request information is used for requesting network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received; the network performance data category is used for indicating the category of the network performance data to be received; the network performance data screening condition is used for indicating the screening condition which needs to be met by the network performance data to be received;

the receiving module is used for receiving the network performance data from the management equipment; the network performance data satisfies the network performance monitoring condition.

24. The apparatus of claim 23,

the receiving module is further configured to receive the network performance monitoring condition;

alternatively, the apparatus further comprises a processing module;

the receiving module is further used for receiving a network performance optimization requirement or a network performance optimization intention; wherein the network performance optimization requirement or the network performance optimization intent is to optimize network performance;

the processing module is further configured to determine the network performance monitoring condition according to the network performance optimization requirement or the network performance optimization intention.

25. The apparatus of claim 23 or 24, wherein the network performance data statistics granularity comprises one or more of: area level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

26. The apparatus according to any of claims 23-25, wherein the network performance data categories comprise one or more of: coverage class, capacity class, quality class, switching class, resource class, user class, service class, performance measurement quantity, key indicator KPI, signaling tracking data, MDT data, analysis data and QoE data.

27. The apparatus according to any of claims 23-26, wherein the network performance data screening conditions comprise one or more of: network problem conditions, time range, network performance threshold range, area range.

28. A network performance monitoring system, the system comprising: a demand device and a management device;

the demand device is to: sending request information to the management device; the request information is used for requesting network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring condition includes one or more of the following: network performance data statistics granularity, network performance data category and network performance data screening conditions; the network performance data statistics granularity is used for indicating the granularity of the network performance data to be received by the demand equipment; the network performance data category is used for indicating the category of the network performance data to be received by the demand equipment; the network performance data screening condition is used for indicating a screening condition which needs to be met by the network performance data to be received by the demand equipment;

the management device is configured to: receiving the request information from the demand equipment; determining the network performance data according to the network performance monitoring condition; wherein the network performance data satisfies the network performance monitoring condition; sending the network performance data to the demand device;

the demand device is further configured to: receiving the network performance data from the management device.

29. A management device comprising a memory, a processor, and a program stored on the memory and executable on the processor, wherein the processor implements the network performance monitoring method of any one of claims 1-8 when executing the program.

30. A demand device comprising a memory, a processor and a program stored on the memory and executable on the processor, wherein the processor implements the network performance monitoring method of any one of claims 9-13 when executing the program.

31. A network performance monitoring system comprising a management device according to claim 29 and a demand device according to claim 30.

32. A computer readable storage medium comprising computer instructions which, when run on an apparatus, cause the apparatus to perform the network performance monitoring method of any one of claims 1-8 or the network performance monitoring method of any one of claims 9-13.