CN113543164B

CN113543164B - Method for monitoring network performance data and related equipment

Info

Publication number: CN113543164B
Application number: CN202010305179.7A
Authority: CN
Inventors: 许瑞岳; 石小丽
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-04-17
Filing date: 2020-04-17
Publication date: 2023-07-18
Anticipated expiration: 2040-04-17
Also published as: CN113543164A; WO2021208877A1

Abstract

The embodiment of the application discloses a monitoring method of network performance data, which can be applied to a service management architecture. The method comprises the following steps: the execution device receives the network performance subscription request sent by the monitoring device, and determines network performance distribution information of a target network according to the network performance subscription request, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance; the execution device transmits the network performance distribution information of the target network to the monitoring device. The target network is thinned into a plurality of target objects, the execution device acquires network performance distribution information and reports the network performance distribution information to the monitoring device, so that the analysis efficiency of network performance data is improved, and the difficulty brought by the monitoring device in analyzing a large amount of different network performance data in the target network is reduced.

Description

Method for monitoring network performance data and related equipment

Technical Field

The embodiment of the application relates to the field of communication, in particular to a method for monitoring network performance data and related equipment.

Background

The operator network has been developed to the fifth generation mobile communication technology 5G, the network architecture becomes more flexible (such as service of the core network, separation of Centralized Unit (CU) and Distributed Unit (DU) of the radio access network (radio access network, RAN), flexible customization of network slices, etc.), the key index requirements on the delay, the rate, the connection scale, etc. of the network are continuously improved, the application industry is also more and more abundant and diversified, the performance guarantee and the flexibility of the service are radically changed, and the operation and maintenance difficulty of the network is increased.

The application of automation technology in mobile communication networks is becoming an important point of interest and research focus for the industry. By introducing automation techniques (such as artificial intelligence, machine learning, big data analysis) help solve the operational efficiency and capacity problems currently encountered in mobile communication networks. And the basis of network automation technology is network data (especially network performance data).

The conventional wireless network is based on cell or base station operation and maintenance, and the network performance data is also based on cell or base station statistics, in this case, the data size of the network performance data is large, and because the networking modes of different equipment vendors may be different, there is a difference between the network performance data, when the equipment vendors report a large amount of network performance data with difference to an operator management system, there is a difficulty in analyzing network problems (such as a network coverage situation) from the large amount of network performance data with difference by the operator management system.

Disclosure of Invention

The embodiment of the application provides a method for monitoring network performance data and related equipment, which can improve the efficiency of analyzing the network performance data.

An embodiment of the present application provides a method for monitoring network performance data, including: the execution device receives a network performance subscription request sent by the monitoring device, wherein the network performance subscription request is used for indicating the execution device to report network performance distribution information of a target network, and the network performance subscription request carries identification or regional range information of the target network; the execution device determines network performance distribution information of a target network according to the network performance subscription request, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance, the target object is used for describing at least one of a location area, time and a network performance category, and the target network is associated with the at least one target object; the execution device transmits the network performance distribution information of the target network to the monitoring device.

According to the embodiment of the application, the target network is thinned into the plurality of target objects, the execution device acquires the network performance distribution information and reports the network performance distribution information to the monitoring device, so that the analysis efficiency of the network performance data is improved, and the difficulty brought by the difference of networking modes of the target network is reduced.

Optionally, the network performance distribution information includes at least one of network performance data distribution information and network performance problem distribution information; the target network performance includes at least one of target network performance data, network performance issues, and network performance issue levels.

In this possible implementation manner, when the client needs to intuitively view the network performance of the target network, the monitoring device may select to send a network performance subscription request about the network performance problem distribution information to the execution device, and when the client needs to know the specific data of the target network, the monitoring device may select to send a network performance subscription request about the network performance data distribution information to the execution device.

Optionally, the executing device acquires original network performance data of the target network; the execution device determines a target object associated with the original network performance data; the execution device analyzes all original network performance data associated with the target object to obtain target network performance data; the execution device sends the network performance data distribution information of the target network to the monitoring device.

In the possible implementation manner, a feasibility scheme for acquiring the network performance data distribution information by the execution device is provided, and the feasibility of the scheme is improved.

Optionally, the executing device receives a network performance monitoring policy sent by the monitoring device, where the network performance monitoring policy is used to represent an association relationship between the target network performance data and the network performance problem or the network performance problem level; the execution device determines network performance problem distribution information according to the network performance monitoring strategy and the target network performance data, wherein the network performance problem distribution information comprises at least one target object and network performance problems or network performance problem grades associated with the at least one target object; the execution device sends the network performance problem distribution information to the monitoring device.

In the possible implementation manner, the executing device can directly determine the network performance problem or the network performance problem grade of the network performance data by receiving the network performance monitoring policy, and report the network performance problem or the network performance problem grade to the monitoring device, so that the monitoring device does not need to analyze the network performance problem or the network performance problem grade of the network performance data in a memory consumption mode, and the network performance problem distribution information fed back by the executing device can also enable the network problem of the target network to be more visual.

Optionally, when the target object is used for describing the location area, the executing device determines location information of original network performance data, where the location information is location information of terminal equipment when the original network performance data is generated, and the original network performance data is obtained by measuring the terminal equipment; the execution means determines a target object associated with the original network performance data based on the location information.

In this possible implementation manner, for the original network performance data irrelevant to time, the executing device may determine the location information, and associate the original network performance data with the corresponding target object according to the location information, which provides a feasibility scheme.

Optionally, when the target object is used for describing the location area and the time, the executing device determines location information and time information of original network performance data, where the location information is location information of a terminal device when the original network performance data is generated, the original network performance data is obtained by the measurement terminal device, and the time information is time information generated by the original network performance data; the execution means determines a target object associated with the original network performance data based on the location information and the time information.

In this possible implementation manner, for the original network performance data related to time, the executing device may determine the location information and the time information, and associate the original network performance data with the corresponding target object according to the location information and the time information, which provides a feasibility scheme.

Optionally, when the target object is used for describing a location area and a network performance class, the executing device determines location information and network performance class information of original network performance data, where the location information is location information of a terminal device when the original network performance data is generated, the original network performance data is obtained by the measurement terminal device, and the network performance class information includes at least one of a coverage class, a capacity class, a network quality class and a service quality class; the execution means determines a target object associated with the original network performance data based on the location information and the network performance class information.

In this possible implementation manner, for the original network performance data related to time, the executing device may determine location information and network performance class information, and associate the original network performance data with the corresponding target object according to the location information and the network performance class information, which provides a feasibility scheme.

Optionally, the executing device receives the construction information of the target object sent by the monitoring device; the execution device generates at least one target object associated with the target network according to construction information, wherein the construction information comprises one or more of a target network identifier, longitude and latitude of the target network, size of the target object and administrative region codes corresponding to the target network.

In this possible implementation manner, the executing device may generate the target object of the target network according to the construction information sent by the monitoring device, so as to facilitate the monitoring device to unify the construction information of the target network.

Optionally, the executing device sends parameter information of at least one target object to the monitoring device, wherein the parameter information comprises coordinates of a central point of the target object.

In this possible implementation manner, the monitoring device is beneficial to determine the position of each target object, and can perform visual presentation on the target objects in the target network.

A second aspect of an embodiment of the present application provides a method for monitoring network performance data, including: the monitoring device sends a network performance subscription request to the execution device, wherein the network performance subscription request is used for indicating the execution device to report network performance distribution information of the target network, and the network performance subscription request carries identification or regional range information of the target network; the monitoring device receives network performance distribution information sent by the execution device, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance, the target object is used for describing at least one of a location area, time and a network performance category, and the target network comprises at least one target object.

According to the embodiment of the application, the target network is thinned into the plurality of target objects, the network performance subscription request is sent to the execution device, the monitoring device receives the network performance distribution information reported by the execution device, so that the analysis efficiency of the network performance data is improved, and the difficulty brought by the difference of networking modes of the target network is reduced.

In this possible implementation, one or more of reporting data, and problem level in the problem may be selected and determined according to different needs.

Optionally, the target object is used to describe one or more of a location area, a time, or a network performance class.

Optionally, the monitoring device sends a network performance monitoring policy to the executing device, where the network performance monitoring policy is used to represent an association relationship between the target network performance data and the network performance problem or the network performance problem level; the monitoring device receives network performance problem distribution information sent by the executing device, wherein the network performance problem distribution information comprises at least one target object and network performance problems or network performance problem grades associated with the at least one target object.

In this possible implementation manner, the monitoring device is not used for analyzing the network performance problem or the network performance problem level of the network performance data by using the memory, and the network performance problem distribution information fed back by the execution device can also make the network problem of the target network more visual.

Optionally, the monitoring device sends construction information of the target object to the execution device, so that the execution device generates at least one target object associated with the target network according to the construction information, and the construction information includes one or more of a target network identifier, longitude and latitude of the target network, size of the target object, and administrative region code corresponding to the target network.

In this possible implementation manner, the monitoring device may send the construction information to the execution device, so that the execution device generates the target object of the target network according to the construction information, which is beneficial for the monitoring device to unify the construction information of the target network.

Optionally, the monitoring device receives parameter information of at least one target object sent by the executing device, and the parameter information includes coordinates of a center point of the target object.

In this possible implementation manner, the monitoring device is beneficial to determine the position of each target object, and can visually present the target objects in the target network.

A third aspect of the present application provides an execution apparatus for executing the method of the first aspect or any possible implementation manner of the first aspect. In particular, the execution means comprise modules or units for executing the method of the first aspect or any possible implementation of the first aspect.

A fourth aspect of the present application provides a monitoring device for performing the method of the second aspect or any possible implementation of the second aspect. In particular, the monitoring device comprises means or units for performing the method of the second aspect or any possible implementation of the second aspect.

A fifth aspect of the present application provides an execution device comprising a processor coupled to a memory for storing computer programs or instructions, the processor for executing the computer programs or instructions in the memory, such that the execution device performs the method of the first aspect.

A sixth aspect of the present application provides a monitoring device comprising a processor coupled to a memory for storing a computer program or instructions, the processor being for executing the computer program or instructions in the memory, such that the monitoring device performs the method of the first aspect.

A seventh aspect of the present application provides a computer storage medium having instructions stored therein which, when executed on a computer, cause the computer to perform the method of the foregoing first aspect or any possible implementation manner of the first aspect, the second aspect or any possible implementation manner of the second aspect.

An eighth aspect of the present application provides a computer program product which, when executed on a computer, causes the computer to perform the method of the first aspect or any possible implementation of the first aspect, the second aspect or any possible implementation of the second aspect.

A ninth aspect of the present application provides a communication system comprising the execution means (or the chip in the execution means) in the method of the first aspect described above and the monitoring means (or the chip in the monitoring means) in the method of the second aspect described above. Alternatively, the communication system includes the execution means of the fifth aspect and the monitoring means of the sixth aspect.

In a tenth aspect, the present application provides a communication system, including an execution device and a monitoring device, where the monitoring device is configured to send a network performance subscription request to the execution device, where the network performance subscription request is used to instruct the execution device to report network performance distribution information of a target network, and the network performance subscription request carries identification or area range information of the target network; the execution device is used for receiving the network performance subscription request and acquiring network performance distribution information according to the network performance subscription request, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance, the target object is used for describing at least one of a location area, time and a network performance category, and the target network is associated with the at least one target object; the execution device transmits the network performance distribution information to the monitoring device.

Optionally, the monitoring device sends construction information of the target object to the executing device, and the executing device is used for receiving the construction information and generating at least one target object associated with the target network according to the construction information. The execution device sends the parameter information of at least one target object to the monitoring device.

Optionally, the monitoring device sends a network performance monitoring policy to the executing device, where the network performance monitoring policy is used to represent an association relationship between the target network performance data and a network performance problem or a network performance problem level, and the executing device determines network performance problem distribution information according to the network performance monitoring policy and the target network performance data, where the network performance problem distribution information includes at least one target object and a network performance problem or a network performance problem level associated with the at least one target object.

The technical effects of the third, fifth, seventh, and eighth aspects or any one of the possible implementation manners of the third, fifth, seventh, and eighth aspects may be referred to the technical effects of the first aspect or the different possible implementation manners of the first aspect, which are not described herein.

The technical effects of the fourth, sixth, eighth, or any one of the possible implementation manners may be referred to the technical effects of the second aspect or the different possible implementation manners of the second aspect, which are not described herein.

Drawings

FIG. 1 is a schematic diagram of a network framework in an embodiment of the present application;

FIG. 2 is a flow chart of a method for monitoring network performance data according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a target network according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a target network associated with a target object according to an embodiment of the present application;

FIG. 5 is a schematic diagram of associating target network performance data with target objects according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a network performance problem level associated with a target object according to an embodiment of the present application;

FIG. 7 is a schematic structural diagram of an implementation device according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another embodiment of an implementation device;

FIG. 9 is a schematic structural diagram of a monitoring device according to an embodiment of the present application;

FIG. 10 is a schematic view of another embodiment of an implementation device;

fig. 11 is a schematic diagram of another structure of the monitoring device in the embodiment of the present application.

Detailed Description

The network performance visualization is the key of network operation and maintenance, the visual network performance index is the key of network rapid optimization, and the network performance problem can be rapidly positioned, so that the cost of network operation and maintenance is reduced. Especially when the industry vertical rents the operator network or uses the operator network to provide the service, the industry vertical user wants to intuitively see the network performance or the network problem, so as to analyze the influence on the service.

The implementation principle, the specific embodiments and the corresponding beneficial effects of the technical solution of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of a network framework provided in an embodiment of the present application. Referring to fig. 1, a network architecture in an embodiment of the present application includes:

a service support system 101, a cross-domain management function 102, a domain management function 103 and a network element 104.

In the embodiment of the present application, two domain management function units 103 and four network elements 104 are taken as examples for illustration, and in practical application, there may be more or fewer domain management units or network elements.

In this embodiment of the present application, the connections between the service support system 101, the cross-domain management function unit 102, the domain management function unit 103, and the network element 104 may be wireless network connections or wired network connections, and if the connections are through wireless network connections, the specific connection form may be a cellular wireless network, or a WiFi network, or other types of wireless networks; if connected via a wired network, the typical connection is in the form of a fiber optic network.

Each network element in the embodiment of the present application may be connected to the cross-domain management function unit 102 through the domain management function unit 103, or may be directly connected to the cross-domain management function unit 102, without passing through the domain management function unit 103, which is not limited herein specifically.

The service support system (business support system, BSS) 101 is for the communication service (communication service), and provides functions and management services such as charging, settlement, accounting, customer service, business, network monitoring, communication service life cycle management, and service intention translation. The service support system 101 may be an operation system of an operator or an operation system of a vertical industry (vertical OT system). A cross-domain management function (cross domain management function, CD-MnF) 102, also called a network management function (network management function, NMF). The cross-domain management function unit 102 provides one or more of the following management functions or management services: network life cycle management, network deployment, network fault management, network performance management, network configuration management, network security, network optimization function, network Intent (Intent-CSP) translation and the like; the network herein may comprise one or more network elements or subnetworks, which may be network slices. The network management Function may be a network slice management Function (network slice management Function, NSMF) or a cross-domain management data analysis Function (management data analytical Function, MDAF) or a cross-domain self-organizing network Function (self-organization network Function, SON Function) or a cross-domain intent management Function Intent Driven MnS. In some deployment scenarios, the cross-domain management function unit 102 may also provide lifecycle management of the sub-network, deployment of the sub-network, fault management of the sub-network, performance management of the sub-network, configuration management of the sub-network, security of the sub-network, optimization function of the sub-network, translation of the sub-network Intent [ Intent from communication service provider, intnt-CSP) or (Intent from communication service consumer, intnt-CSC) ], where the sub-network is composed of a plurality of small sub-networks, which may be network slice sub-networks. Domain management function (Domain management function, domain-MnF) 103, also called subnetwork management function (network management function, NMF) or network element management function. The domain management function unit 103 provides one or more of the following functions or management services: lifecycle management of a sub-network or network element, deployment of a sub-network or network element, fault management of a sub-network or network element, performance management of a sub-network or network element, safeguarding of a sub-network or network element, optimization function of a sub-network or network element, and Intent (Intent from network operator, intent-NOP) translation of a sub-network or network element, etc., where a sub-network comprises one or more network elements 104. The subnetworks may also comprise subnetworks, i.e. one or more subnetworks constitute a larger subnetwork. The subnetworks herein may also be network slice subnetworks. The Domain management system may be a network slice sub-network management Function (network slice subnet management Function, NSSMF), a Domain management data analysis Function (management data analytical Function, domain MDAF) or a Domain self-organizing network Function (self-organization network Function, SON Function) or a Domain intention management Function Intent Driven MnS.

Wherein the domain management function 103 may be deployed in the following manner, but is not limited to the following:

1. classifying according to network types: an access network domain management function (radio access network domain management function), a core network domain management function (core domain management function), a transport network domain management function (transport domain management function); or a domain network management system may manage two or all of the access network, the core network and the transport network.

2. Dividing according to administrative regions: a regional management function unit of a certain region, such as an overseas management function unit, a beijing domain management function unit, and the like.

The entity of the network element 104 providing the network service includes a core network element [ for example: access and mobility management functions (access and mobility management function, AMF), session management functions (session management function, SMF), policy control functions (policy control function, PCF), network data analysis functions (network data analytics function, NWDAF), network storage functions (network repository function, NRF, gateway, etc.) ], access network elements [ for example: base stations (gNB, eNB), centralized Control Units (CUCP), centralized Units (CU), distributed Units (DU), and centralized user plane units (CUUP), etc. Network element 104 may also provide one or more of the following management functions or management services: lifecycle management of network elements, deployment of network elements, fault management of network elements, performance management of network elements, guarantee of network elements, optimization function of network elements, intention translation of network elements and the like.

The servitization management architecture focuses on managing service providers and managing service consumers, such as:

when the management service is the management service provided by the above cross-domain management unit, the cross-domain management unit is a management service provider (management service producer, mnS producer), and the BSS is a management service consumer (management service consumer, mnS consumer).

When the management service is the management service provided by the domain management unit, the domain management unit is a management service provider, and the cross-domain management unit is a management service consumer.

When the management service is the management service provided by the network element, the network element is a management service provider, and the domain management unit is a management service consumer.

The combination forms of the execution device and the monitoring device in the embodiment of the application are various, and the specific forms are as follows:

1. the execution device is a cross-domain management functional unit, and the monitoring device is a BSS.

2. The execution device is a domain management functional unit, and the monitoring device is a cross-domain management functional unit.

3. The execution device is a network element, and the monitoring device is a domain management function unit, a cross-domain management function unit or a BBS.

The above three forms are merely examples, and the combination of the execution device and the monitoring device may be other cases, for example, when the service management architecture focuses on the management service provider and the management service consumer, the execution device may be the network performance management service provider, and the monitoring device may be the network performance management service consumer, which is not limited herein specifically.

The following describes a method for monitoring network performance data in the embodiment of the present application with reference to the network framework of fig. 1:

referring to fig. 2, an embodiment of a method for monitoring network performance data in an embodiment of the present application includes:

the target object in the embodiment of the present application may have various forms, and in particular, the target object is not limited to the form, and the following is described by taking a representation form of the target object as an example schematically, where the grid may be a grid array, the grid may be a position in the target network represented by a row and a column, and the grid may also be a position in the target network represented by a central point coordinate, and in particular, the target object is not limited to the form.

In this embodiment of the present application, the number of the execution devices may be one or more, which is not limited in particular herein, and of course, the number of the execution devices is large, which is favorable to improving the efficiency of the execution devices in analyzing the network performance distribution information, and reducing the difficulty caused by the difference of the networking modes of the target network.

201. The monitoring device transmits the construction information of the target object to the execution device.

In the embodiment of the present application, the target object is taken as a grid as an example for schematic description, and it is understood that the target object may also be a table, a histogram, or the like, which is not limited in this specific embodiment.

Optionally, the monitoring device sends construction information of the target object in the target network to the execution device, where the construction information includes one or more of a target network identifier, longitude and latitude of the target network, a size of the target network (for example, a size and dimension of a grid, where a length and a width of the grid are 5 meters respectively), and an administrative region code corresponding to the target network, where the target network is associated with at least one target object, for example, the target object is a grid, and the target network includes multiple grids.

Alternatively, the monitoring device may monitor network performance information of one or more target networks, and the construction information of the grids in different target networks may be different. For example: when the personnel concentration of the target network is high, the grid can be smaller; the grid may be larger when the target network is low in people concentration.

The shape of the target network may be a regular shape, an irregular shape, a quadrilateral shape, or a polygonal shape, for example. Fig. 3 is merely an example of a target network, and the specific shape of the target network is not limited herein.

202. The execution means generates at least one target object associated with the target network based on the build information.

Optionally, after receiving the construction information of the target object, the executing device rasterizes the target network according to the information such as the size and the dimension of the grid in the construction information to generate at least one target object.

The executing device divides the target network according to the geographic range information of the target network and the grid size in the construction information.

Optionally, after the execution device divides the target network, parameter information of a group of target objects (for example, grid points) corresponding to the target network is determined.

Fig. 4 is an exemplary illustration of the target network of fig. 3 being rasterized by an execution device. Wherein each square is a grid, and the execution device performs the target network rasterization processing on the grid into a plurality of grids. Of course, the shape of the grid may be a regular shape or an irregular shape, a quadrangular shape or a polygonal shape. Fig. 4 is merely an example of a grid, and the specific shape of the grid and the number of grids are not limited herein.

203. The execution device sends the parameter information of at least one target object to the monitoring device.

Optionally, after the execution device generates the at least one target object, the execution device sends parameter information of the at least one target object to the monitoring device. The parameter information of the target object may include: such as one or more of grid identification, longitude of grid center point, latitude of grid center point, etc.

204. The monitoring device sends a network performance subscription request to the execution device.

The monitoring device sends a network performance subscription request to the execution device, wherein the network performance subscription request is used for indicating the execution device to report network performance distribution information of the target network.

The network performance distribution information in the embodiment of the present application may be all network performance data of the target network, or may be network performance data of a certain area, or may be network performance data of a certain period of time or network performance data of a certain class, which is not limited herein.

Optionally, the network performance subscription request carries construction information of the target object.

Optionally, the monitoring device may also send target network information to the executing device, where the target network information includes any one or more of a target network identifier and a geographic range of the target network (e.g., a set of latitude and longitude points of the target network or a geographic administrative area code of the target network, etc.). Wherein the target network identification is used to represent a target network, for example: the target network is represented as a Distinguished Name (DN) of the target network.

The construction information and the target network information in the embodiment of the present application may be both carried in the network performance subscription request, or may be sent separately, which is not limited herein.

205. The monitoring device sends the network performance monitoring policy to the executing device.

Alternatively, the monitoring device may send a network performance monitoring policy to the executing device, the network performance monitoring policy describing an association of the network performance problem/network performance problem level with the target network performance data/raw network performance data.

The network performance monitoring policy in the embodiments of the present application may have various modes, and the following is schematically illustrated by taking the network performance monitoring policies shown in tables 1 to 4 as examples, where the specific mode of the network performance monitoring policy is set according to actual needs, and the specific mode is not limited herein.

Illustratively, table 1 is a network performance monitoring policy, which relates network performance problem level to network performance data, that is, relates network coverage level to a range of reference signal received power (reference signal receiving power, RSRP).

TABLE 1

Network performance problem rating	RSRP range value
		High height	-90＜RSRP＜-80
In (a)	-80≤RSRP≤-70
		Low and low	-70＜RSRP＜-60
Normal state	RSRP≥-60

In table 1, only the network performance data is taken as an example to schematically illustrate that RSRP is a value corresponding to the target network performance data or the original network performance data, and boundary values of each range of RSRP: -80, -70, and-60 are examples only, and specific boundary values, types of network performance data, and network performance problem levels are not specifically limited herein.

Illustratively, table 2 is an association of network performance problem levels with network performance data (raw network performance data or target network performance data) for another network performance monitoring policy.

I.e., the relationship of user rate ranking to the range value of the downstream throughput rate (downlink throughput).

TABLE 2

Network performance problem rating	DL through put range value
		High height	DL throughput＜2Mbps
In (a)	2Mbps≤DL throughput≤4Mbps
		Low and low	4Mbps＜DL throughput＜5Mbps
Normal state	DL throughput≥5Mbps

Wherein, the boundary value of each range value of the downlink throughput rate: the 2 megabits per second (million bits per second, mbps), 4Mbps, and 5Mbps are just examples, and the specific boundary values and the division of the network performance problem level are set according to actual needs, and are not limited herein.

Illustratively, table 3 is another network performance monitoring policy, which relates network performance problems to network performance data (original network performance data or target network performance data), i.e., user rate problems to a range of values of downstream throughput rate (downink throughput).

TABLE 3 Table 3

Network performance problems	DL through put range value
		Low user rate	DL throughput＜5Mbps
Normal state	DL throughput≥5Mbps

The boundary value of each range value of the downlink throughput rate is 5Mbps, which is only an example, and the specific boundary value and the division of the network performance problem are set according to actual needs, which is not limited herein.

Illustratively, table 4 is another network performance monitoring policy, which relates network performance problem level to network performance data (original network performance data or target network performance data), i.e., latency level to Latency (Latency) range value.

TABLE 4 Table 4

Network performance problem rating	Latency range value
		High height	Latency＞10ms
In (a)	5ms≤Latency≤10ms
		Low and low	1ms＜Latency＜5ms
Normal state	Latency≤1ms

Wherein the boundary values of the range values of the delay: the 1ms, 5ms, and 10ms are just examples, and specific boundary values and the classification of network performance problem levels are set according to actual needs, which are not limited herein.

In the embodiments of the present application, there are various other forms of network performance monitoring policies besides the above examples, and the specific embodiments are not limited herein.

206. The execution device acquires network performance distribution information according to the network performance subscription request.

The network performance distribution information in the embodiments of the present application includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe one or more of a location area, a time, a network performance class, and the like, and is not limited herein in particular. The target network includes a plurality of target objects.

In the embodiment of the application, the network performance distribution information includes at least one of network performance data distribution information and network performance problem distribution information; the target network performance includes at least one of target network performance data, network performance issues, and network performance issue levels. The network performance data may be target network performance data or original network performance data; network performance problems may be normal, abnormal, etc. network performance; the network performance problem level may be high, medium, low or first, second, third, etc., and is not specifically limited herein.

The classification manners of the original network performance data in the embodiments of the present application are various, for example: capacity class network performance data, overlay class network performance data, and quality class network performance data. The capacity-class network performance data includes uplink and downlink user throughput rate, traffic volume [ e.g.: physical resource blocks (physical resource block, PRBs), number of radio resource control (radio resource control, RRC) connections, and data radio bearers (data radio bearer, DRBs), number of terminals, number of active users, and the like. The coverage class network performance data includes: reference signal received power (reference signal receiving power, RSRP), reference signal received quality (reference signal receiving quality, RSRQ), signal to interference plus noise ratio (signal to interference plus noise ratio, SINR), and the like. The quality class network performance data includes: switching success rate, time delay, dropped call rate, jitter, packet loss rate, etc.

For convenience of description, the network performance data distribution information and the network performance problem distribution information are described below, respectively.

First kind: the network performance distribution information is network performance data distribution information.

After receiving the network performance subscription request, the executing device acquires the original network performance data. The executing device may collect the original network performance data from the base station side, or may obtain the original network performance data from other devices, which is not limited herein.

After the execution device acquires the original network performance data, determining a target object corresponding to the original network performance data. In the embodiment of the present application, the target object may be used to describe one or more of a location area, a time, a network performance class, and the like, which is not limited herein.

In this embodiment of the present application, there are various ways for the execution device to determine the target object associated with the original network performance data, and the following descriptions respectively apply to:

1. the execution means determines a target object associated with the original network performance data based on the location information.

Optionally, the execution means determine the location of the terminal device accessing the network when raw network performance data is generated, the raw network performance data being obtained by measuring the terminal device.

In this embodiment of the present application, there are various ways for the execution device to determine the location information of the original network performance data, and the following descriptions respectively are provided:

1. the execution device obtains the position information and/or time of the original network performance data in the target network according to the time stamp and/or the C-RNTI information (namely, the execution device can be applied to a scene of moving the terminal equipment and a scene of fixing the terminal equipment).

2. The terminal device reports the position information (namely, the scene which can be applied to the movement of the terminal device and the scene which can be applied to the fixation of the terminal device) to the execution device, and the execution device determines the position information of the terminal device and the time corresponding to the reported position information.

3. The terminal device reports the terminal device identification to the execution device, the execution device stores the corresponding relation between each terminal device and the position in advance, and the execution device determines the position information (which can be applied to the fixed scene of the terminal device) of the terminal device according to the terminal device identification.

It will be appreciated that the above 3 ways of determining the location information and/or time of the original network performance data by the executing device are merely examples, and other ways are possible in practical application, and are not limited herein.

After determining the location information (e.g., longitude and latitude) of the original network performance data, the executing device matches the geographic range information or the parameter information of the target object according to the location information corresponding to each piece of original network performance data, so as to determine the target object (e.g., grid) associated with each piece of original network performance data.

2. The execution means determines a target object associated with the original network performance data based on the location information and the time.

The method for executing the time of acquiring the original network performance data by the device is similar to the 3 methods for determining the location information, and will not be described herein.

3. The execution device determines a target object associated with the original network performance data according to the network performance category corresponding to the position information and the original network performance data.

After the execution device acquires the position information of the original network performance data, the execution device determines the network performance category corresponding to the original network performance data. And the execution device determines a target object associated with the original network performance data according to the preset association relation. The preset association relationship is set according to needs, and is not limited herein.

In an exemplary embodiment, when the executing device obtains an original network performance data as a traffic volume, according to the foregoing classification, the executing device may determine that a network performance class corresponding to the original network performance data is a capacity class.

The executing device matches the original network performance data to the target object in the upper left corner of the target network after determining that the original network performance data is the capacity class.

According to the difference of the original network performance data, the method can be divided into various cases, and the following description is given by taking 2 examples respectively:

after determining the target object corresponding to the original network performance data, the executing device analyzes all original network performance data associated with the target object to obtain target network performance data.

1. For time independent network performance data (e.g., RSRP, RSRQ, etc.).

Optionally, the executing device calculates an average value, a maximum value, a minimum value, or the like of all original network performance data associated with the target object to obtain target network performance data, and determines network performance data distribution information, where the network performance data distribution information includes the target network performance data and the target object associated with the target network performance data.

For example, after the execution device associates the target network performance data with the target object, the association relationship shown in fig. 5 is obtained, and fig. 5 illustrates that the target network performance data is RSRP, where the numerical value in the grid is the target network performance data (for example, the average value of all the original network performance data in the grid). Fig. 5 is only one representation of the association of the target network performance data with the target object, and the association may be in other forms: such as tables, histograms, and the like, are not particularly limited herein.

2. For time-dependent network performance data (e.g., traffic, etc.).

Of course, when the original network performance data of the time and the numerical value need to be recorded, the executing device may record all the original network performance data associated with the target object, and start time, end time, transmission duration, and the like corresponding to all the original network performance data, which are not limited herein.

For example, after the executing device associates the original network performance data with the target objects, an association relationship as shown in table 5 is obtained, and in this embodiment of the present application, the original network performance data corresponding to the three target objects and the original network performance data are illustrated by taking RSRP as an example. Table 5 is only one expression form of the association relationship between the target network performance data and the target object, and the association relationship can be other forms: such as a grid, a histogram, etc., and is not particularly limited herein.

TABLE 5

The starting time and specific values of RSRP shown in table 5 are only examples, and specific times are set according to needs, and are not limited herein.

Second kind: the network performance distribution information is network performance problem distribution information.

The method for the executing device to acquire the network performance monitoring policy is various, and the method for the executing device to specifically receive the network performance monitoring policy is not limited herein, and the network performance monitoring policy may be sent to the executing device by the monitoring device alone, or the network performance monitoring policy may be carried in a network performance subscription request.

The execution means determines network performance problem distribution information based on the network performance monitoring policy and the network performance data (either the original network performance data or the target network performance data). The network performance problem distribution information includes at least one target object and a network performance problem/network performance problem level associated with the at least one target object.

The executing device determines the network performance problem/network performance problem grade corresponding to the network performance data through the network performance monitoring strategy.

Illustratively, the RSRP value corresponding to the target network performance data of a target object is-85, and the executing device determines that the network performance problem level of the target object is high according to table 1.

Illustratively, the executing device determines network performance problems/network performance problem levels corresponding to the plurality of network performance data, resulting in network performance problem distribution information as shown in fig. 6. It will be appreciated that fig. 6 is merely an example, and the specific form of the network performance problem distribution information is not limited herein, and the network performance problem distribution information includes a target object and a network performance problem/network performance problem level associated with the target object.

Of course, if the network performance distribution information is network performance data of all the target networks, the execution device determines all the network performance data of the target networks through the above steps, and if the network performance distribution information is network performance data of a certain area or network performance data of a certain period of time, the execution device determines network performance data of a target network part through the above steps.

Optionally, in the embodiment of the present application, after the execution device divides the target network into a plurality of target objects, modeling may be performed for each target object, that is, one target object is an independent management object. The monitoring device may query for individual target objects and network performance (one or more of network performance data, network performance issues, and network performance issue levels) associated with the target objects.

207. The execution device sends the network performance distribution information to the monitoring device.

Optionally, the executing device sends the network performance data distribution information to the monitoring device after determining the association relationship between the target network performance data and the target object or the association relationship between the original network performance data, time and the target object (i.e. determining the target network performance data and the target object associated with the target network performance data).

Optionally, after the execution device determines the association relationship between the network performance problem/network performance problem level and the target object (i.e. determines the network performance and the target object associated with the network performance, where the network performance includes the network performance problem and/or the network performance problem level), the execution device sends the network performance problem distribution information to the monitoring device.

Alternatively, the executing apparatus may send the distribution information (network performance data distribution information or network performance problem distribution information) shown in table 1 or fig. 5 to the monitoring apparatus so that the monitoring apparatus can conveniently display the network performance of the target network.

In this embodiment of the present application, the monitoring device may send the construction information of the target object, the network performance subscription request, the network performance monitoring policy, and the like to the executing device, for example: the network performance subscription request carries construction information of a target object, a network performance monitoring strategy and the like; the monitoring device may also send the construction information of the target object, the network performance subscription request, the network performance monitoring policy, etc. to the execution device, which is not limited herein.

In the embodiment of the application, the target network is thinned into a plurality of target objects, the execution device acquires the network performance distribution information and reports the network performance distribution information to the monitoring device, so that the complex network networking information is shielded, and the problem that the monitoring device analyzes the target network to bring a large amount of different network performance data is avoided. And simultaneously, the network performance condition of the target network can be intuitively reflected.

The foregoing describes a method for monitoring network performance data in an embodiment of the present application, and the following describes an executing device in an embodiment of the present application, referring to fig. 7, in which an embodiment of the executing device includes:

The receiving unit 701 is configured to receive a network performance subscription request sent by the monitoring device, where the network performance subscription request is used to instruct the executing device to report network performance distribution information of a target network, and the network performance subscription request carries an identifier or area range information of the target network.

A determining unit 702, configured to determine network performance distribution information of the target network according to the network performance subscription request, where the network performance distribution information includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe at least one of a location area, a time, and a network performance class, and the target network is associated with at least one target object.

A transmitting unit 703, configured to transmit the network performance distribution information of the target network to the monitoring device.

In this embodiment, the operations performed by the units in the execution device are similar to those described in the embodiments shown in fig. 2 to 6, and are not repeated here.

In this embodiment, by reducing the target network into a plurality of target objects and determining the network performance distribution information by the determining unit 702, the sending unit 703 reports the network performance distribution information to the monitoring device, which is beneficial to improving the analysis efficiency of the network performance data and reducing the difficulty caused by the difference of the networking modes of the target network.

Referring to fig. 8, an execution device according to another embodiment of the present application may include:

a receiving unit 801, configured to receive a network performance subscription request sent by a monitoring device, where the network performance subscription request is used to instruct the executing device to report network performance distribution information of a target network, and the network performance subscription request carries an identifier or area range information of the target network.

A determining unit 802, configured to determine network performance distribution information of the target network according to the network performance subscription request, where the network performance distribution information includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe at least one of a location area, a time, and a network performance class, and the target network is associated with at least one target object.

A transmitting unit 803, configured to transmit the network performance distribution information of the target network to the monitoring apparatus.

The execution device in this embodiment further includes:

a generating unit 804, configured to generate at least one target object associated with the target network according to the construction information, where the construction information includes one or more of a target network identifier, a longitude and latitude of the target network, a size of the target object, and an administrative area code corresponding to the target network.

In this embodiment, by reducing the target network into multiple target objects and determining the network performance distribution information by the determining unit 802, the sending unit 803 reports the target object to the monitoring device, and the generating unit 804 may generate the target object of the target network according to the construction information sent by the monitoring device, which is beneficial to improving the analysis efficiency of the network performance data and reducing the difficulty caused by the difference of the networking modes of the target network. On the other hand, the monitoring device is beneficial to unifying the construction information of the target network.

Referring to fig. 9, another monitoring device in an embodiment of the present application may include:

a sending unit 901, configured to send a network performance subscription request to an executing device, where the network performance subscription request is used to instruct the executing device to report network performance distribution information of a target network, and the network performance subscription request carries an identifier or area range information of the target network.

A receiving unit 902, configured to receive the network performance distribution information sent by the executing device, where the network performance distribution information includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe at least one of a location area, a time, and a network performance class, and the target network includes at least one target object.

Optionally, the sending unit is further configured to send a network performance monitoring policy to the executing device, where the network performance monitoring policy is used to indicate an association relationship between the target network performance data and a network performance problem or a network performance problem level.

Optionally, the sending unit is further configured to send construction information of the target object to the executing device, so that the executing device generates at least one target object associated with the target network according to the construction information, where the construction information includes one or more of a target network identifier, a longitude and latitude of the target network, a size of the target object, and an administrative area code corresponding to the target network.

Optionally, the receiving unit is further configured to receive parameter information of the at least one target object sent by the executing device, where the parameter information includes coordinates of a center point of the target object.

Optionally, the receiving unit is specifically configured to receive the network performance problem distribution information sent by the executing device, where the network performance problem distribution information includes at least one target object and a network performance problem or a network performance problem level associated with the at least one target object.

In this embodiment, the operations performed by the units in the monitoring device are similar to those described in the embodiments shown in fig. 2 to 6, and are not repeated here.

In this embodiment, by reducing the target network into multiple target objects, the sending unit 901 sends a network performance subscription request to the execution device, and the receiving unit 902 receives the network performance distribution information reported by the execution device, which is beneficial to improving the analysis efficiency of the network performance data and reducing the difficulty caused by the difference of the networking modes of the target network.

Referring to fig. 10, another execution device in an embodiment of the present application may include:

the execution device 1000 may include one or more processors 1001 and memory 1004, with one or more applications or data stored in the memory 1004.

Wherein the memory 1004 may be volatile storage or persistent storage. The program stored in the memory 1004 may include one or more modules, each of which may include a series of instruction operations in the execution device 1000. Still further, the processor 1001 may be configured to communicate with the memory 1004 and execute a series of instruction operations in the memory 1004 on the execution device 1000.

The execution device 1000 may also include one or more power supplies 1002, one or more input-output interfaces 1003, and/or one or more operating systems, such as Windows ServerTM, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.

The processor 1001 may perform the operations performed by the performing device in the embodiments shown in fig. 2 to 6, which are not described herein.

Fig. 11 is a schematic structural diagram of a monitoring device provided in an embodiment of the present application, where the monitoring device 1100 may include one or more processors 1101 and a memory 1104, and one or more application programs or data are stored in the memory 1104.

Wherein the memory 1104 may be volatile storage or persistent storage. The program stored in the memory 1104 may include one or more modules, each of which may include a series of instruction operations in the monitoring device 1100. Still further, the processor 1101 may be arranged to communicate with the memory 1104 to execute a series of instruction operations in the memory 1104 on the monitoring device 1100.

The monitoring device 1100 may also include one or more power supplies 1102, one or more input-output interfaces 1103, and/or one or more operating systems, such as Windows ServerTM, mac OS XTM, unixTM, linuxTM, freeBSDTM, etc.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.

In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Claims

1. A method for monitoring network performance data, comprising:

the method comprises the steps that an execution device receives a network performance subscription request sent by a monitoring device, wherein the network performance subscription request is used for indicating the execution device to report network performance distribution information of a target network, and the network performance subscription request carries identification or regional range information of the target network;

the execution device generates at least one target object associated with the target network according to the network performance subscription request;

the execution device determines network performance distribution information of the target network according to the network performance subscription request, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance, the target object is used for describing at least one of a location area, time and a network performance category, and the target network is associated with at least one target object;

the executing device sends the network performance distribution information of the target network to the monitoring device.

2. The method of claim 1, wherein the network performance distribution information comprises at least one of network performance data distribution information and network performance problem distribution information;

The target network performance includes at least one of target network performance data, network performance issues, and a network performance issue level.

3. The method of claim 2, wherein the performing means for determining network performance distribution information for the target network based on the network performance subscription request comprises:

the executing device acquires original network performance data of the target network;

the execution device determines a target object associated with the original network performance data;

the execution device analyzes all original network performance data associated with the target object to obtain the target network performance data;

the executing device sending the network performance distribution information of the target network to the monitoring device, including:

the executing device sends the network performance data distribution information of the target network to the monitoring device.

4. A method according to claim 3, characterized in that the method further comprises:

the executing device receives a network performance monitoring policy sent by the monitoring device, wherein the network performance monitoring policy is used for representing the association relation between the target network performance data and a network performance problem or a network performance problem grade;

The executing device determines network performance distribution information of the target network according to the network performance subscription request, and the executing device comprises the following steps:

the executing device determines the network performance problem distribution information according to the network performance monitoring strategy and the target network performance data, wherein the network performance problem distribution information comprises at least one target object and a network performance problem or a network performance problem grade associated with the at least one target object;

the execution device sends the network performance problem distribution information to the monitoring device.

5. A method according to claim 3, wherein when the target object is used to describe a location area, the performing means determines the target object to which the original network performance data is associated, comprising:

the execution device determines the position information of the original network performance data, wherein the position information is the position information of the terminal equipment when the original network performance data is generated, and the original network performance data is obtained by measuring the terminal equipment;

The execution means determines the target object associated with the original network performance data according to the location information.

6. A method according to claim 3, wherein when the target object is used to describe a location area and a time, the performing means determines the target object associated with the original network performance data, comprising:

the execution device determines position information and time information of the original network performance data, wherein the position information is the position information of terminal equipment when the original network performance data are generated, the original network performance data are obtained by measuring the terminal equipment, and the time information is the time information generated by the original network performance data;

the execution means determines the target object associated with the original network performance data based on the location information and the time information.

7. A method according to any one of claims 3, wherein when the target object is used to describe a location area and a network performance class, the performing means determines the target object to which the original network performance data is associated, comprising:

the executing device determines position information and network performance category information of the original network performance data, wherein the position information is position information of terminal equipment when the original network performance data are generated, the original network performance data are obtained by measuring the terminal equipment, and the network performance category information comprises at least one of coverage class, capacity class, network quality class and service quality class;

The executing device determines the target object associated with the original network performance data according to the position information and the network performance category information.

8. The method according to any one of claims 1 to 6, further comprising:

the execution device receives the construction information of the target object sent by the monitoring device;

the execution device generates at least one target object associated with the target network according to the construction information, wherein the construction information comprises one or more of a target network identifier, longitude and latitude of the target network, size of the target object and administrative region codes corresponding to the target network.

9. The method of claim 8, wherein the method further comprises:

the executing device sends parameter information of the at least one target object to the monitoring device, wherein the parameter information comprises center point coordinates of the target object.

10. A method for monitoring network performance data, comprising:

the method comprises the steps that a monitoring device sends a network performance subscription request to an executing device, wherein the network performance subscription request is used for indicating the executing device to report network performance distribution information of a target network, and the network performance subscription request carries identification or regional range information of the target network; the network performance subscription is used for the execution device to generate at least one target object associated with the target network;

The monitoring device receives the network performance distribution information sent by the executing device, wherein the network performance distribution information comprises at least one target network performance and a target object associated with the at least one target network performance, the target object is used for describing at least one of a location area, time and a network performance category, and the target network comprises at least one target object.

11. The method of claim 10, wherein the network performance distribution information comprises at least one of network performance data distribution information and network performance problem distribution information;

12. The method of claim 11, wherein the target object is used to describe one or more of a location area, a time, or a network performance class.

13. The method according to any one of claims 10 to 12, further comprising:

the monitoring device sends a network performance monitoring policy to the executing device, wherein the network performance monitoring policy is used for representing the association relation between the target network performance data and a network performance problem or a network performance problem grade;

The monitoring device receives the network performance distribution information sent by the executing device, and the monitoring device comprises:

the monitoring device receives the network performance problem distribution information sent by the executing device, wherein the network performance problem distribution information comprises at least one target object and a network performance problem or a network performance problem grade associated with the at least one target object.

14. The method according to any one of claims 10 to 12, further comprising:

the monitoring device sends construction information of the target object to the execution device so that the execution device generates at least one target object associated with the target network according to the construction information, wherein the construction information comprises one or more of a target network identifier, longitude and latitude of the target network, size of the target object and administrative region codes corresponding to the target network.

15. The method according to any one of claims 10 to 12, further comprising:

the monitoring device receives parameter information of the at least one target object sent by the executing device, wherein the parameter information comprises center point coordinates of the target object.

16. An execution device, comprising:

the receiving unit is used for receiving a network performance subscription request sent by the monitoring device, wherein the network performance subscription request is used for indicating the executing device to report network performance distribution information of a target network, and the network performance subscription request carries identification or regional range information of the target network;

a determining unit, configured to generate at least one target object associated with the target network according to the network performance subscription request;

the determining unit is configured to determine network performance distribution information of the target network according to the network performance subscription request, where the network performance distribution information includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe at least one of a location area, a time, and a network performance class, and the target network is associated with at least one target object;

and the sending unit is used for sending the network performance distribution information of the target network to the monitoring device.

17. The execution apparatus according to claim 16, wherein the network performance distribution information includes at least one of network performance data distribution information and network performance problem distribution information;

18. The execution device according to claim 17, wherein the determination unit is specifically configured to:

acquiring original network performance data of the target network;

determining a target object associated with the original network performance data;

analyzing all original network performance data associated with the target object to obtain the target network performance data;

the sending unit is specifically configured to send the network performance data distribution information of the target network to the monitoring device.

19. The execution apparatus according to claim 18, wherein the receiving unit is further configured to receive a network performance monitoring policy sent by the monitoring apparatus, where the network performance monitoring policy is used to represent an association relationship between the target network performance data and a network performance problem or a network performance problem level;

the determining unit is specifically configured to determine, according to the network performance monitoring policy and the target network performance data, the network performance problem distribution information, where the network performance problem distribution information includes at least one target object and a network performance problem or a network performance problem level associated with the at least one target object;

The sending unit is specifically configured to send the network performance problem distribution information to the monitoring device.

20. The execution apparatus according to claim 18, wherein when the target object is used to describe a location area, the determining unit is specifically configured to:

determining the position information of the original network performance data, wherein the position information is the position information of the terminal equipment when the original network performance data is generated, and the original network performance data is obtained by measuring the terminal equipment;

and determining the target object associated with the original network performance data according to the position information.

21. The execution apparatus according to claim 18, wherein when the target object is used to describe a location area and a time, the determining unit is specifically configured to:

determining position information and time information of the original network performance data, wherein the position information is the position information of terminal equipment when the original network performance data is generated, the original network performance data is obtained by measuring the terminal equipment, and the time information is the time information generated by the original network performance data;

And determining the target object associated with the original network performance data according to the position information and the time information.

22. The execution arrangement according to any one of claims 18, wherein when the target object is used to describe a location area and a network performance class, the determining unit is specifically configured to:

determining position information and network performance category information of the original network performance data, wherein the position information is position information of terminal equipment when the original network performance data is generated, the original network performance data is obtained by measuring the terminal equipment, and the network performance category information comprises at least one of coverage class, capacity class, network quality class and service quality class;

and determining the target object associated with the original network performance data according to the position information and the network performance category information.

23. The apparatus according to any one of claims 16 to 21, wherein the receiving unit is further configured to receive the construction information of the target object sent by the monitoring apparatus;

the execution device further includes:

and the generation unit is used for generating at least one target object associated with the target network according to the construction information, wherein the construction information comprises one or more of a target network identifier, the longitude and latitude of the target network, the size of the target object and an administrative region code corresponding to the target network.

24. The apparatus according to claim 23, wherein the transmitting unit is further configured to transmit parameter information of the at least one target object to the monitoring apparatus, the parameter information including center point coordinates of the target object.

25. A monitoring device, comprising:

a sending unit, configured to send a network performance subscription request to an execution device, where the network performance subscription request is used to instruct the execution device to report network performance distribution information of a target network, and the network performance subscription request carries an identifier or area range information of the target network; the network performance subscription is used for the execution device to generate at least one target object associated with the target network;

and a receiving unit, configured to receive the network performance distribution information sent by the executing device, where the network performance distribution information includes at least one target network performance and a target object associated with the at least one target network performance, where the target object is used to describe at least one of a location area, a time, and a network performance class, and the target network includes at least one target object.

26. The monitoring device of claim 25, wherein the network performance distribution information includes at least one of network performance data distribution information and network performance problem distribution information;

the network performance includes at least one of network performance data, network performance problems, and network performance problem levels.

27. The monitoring device of claim 26, wherein the target object is used to describe one or more of a location area, a time, or a network performance class.

28. The monitoring device according to any one of claims 25 to 27, wherein the sending unit is further configured to send a network performance monitoring policy to the executing device, the network performance monitoring policy being configured to indicate an association between the target network performance data and a network performance problem or a network performance problem level;

the receiving unit is specifically configured to receive the network performance problem distribution information sent by the executing device, where the network performance problem distribution information includes at least one target object and a network performance problem or a network performance problem level associated with the at least one target object.

29. The monitoring device according to any one of claims 25 to 27, wherein the sending unit is further configured to send construction information of the target object to the executing device, so that the executing device generates at least one target object associated with the target network according to the construction information, where the construction information includes one or more of a target network identifier, a longitude and latitude of the target network, a size of the target object, and an administrative area code corresponding to the target network.

30. The monitoring device according to any one of claims 25 to 27, wherein the receiving unit is further configured to receive parameter information of the at least one target object sent by the executing device, the parameter information including coordinates of a center point of the target object.

31. An execution device comprising a processor coupled to a memory for storing a computer program or instructions, the processor for executing the computer program or instructions in memory such that the method of any one of claims 1 to 9 is performed.

32. A monitoring device comprising a processor coupled to a memory for storing a computer program or instructions, the processor for executing the computer program or instructions in the memory such that the method of any of claims 10 to 15 is performed.

33. A communication system comprising an execution device according to claim 31 and a monitoring device according to claim 32.

34. A computer storage medium, characterized in that a program or instructions for implementing the method of any one of claims 1 to 15 are stored.