EP2510650A1 - A method of and an operating support system for providing performance management in a mobile telecommunications system - Google Patents

A method of and an operating support system for providing performance management in a mobile telecommunications system

Info

Publication number
EP2510650A1
EP2510650A1 EP09793509A EP09793509A EP2510650A1 EP 2510650 A1 EP2510650 A1 EP 2510650A1 EP 09793509 A EP09793509 A EP 09793509A EP 09793509 A EP09793509 A EP 09793509A EP 2510650 A1 EP2510650 A1 EP 2510650A1
Authority
EP
European Patent Office
Prior art keywords
counter values
nodes
counter
unit
rops
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP09793509A
Other languages
German (de)
French (fr)
Other versions
EP2510650B1 (en
Inventor
Attila Bader
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telefonaktiebolaget LM Ericsson AB
Original Assignee
Telefonaktiebolaget LM Ericsson AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget LM Ericsson AB filed Critical Telefonaktiebolaget LM Ericsson AB
Publication of EP2510650A1 publication Critical patent/EP2510650A1/en
Application granted granted Critical
Publication of EP2510650B1 publication Critical patent/EP2510650B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/14—Network analysis or design
    • H04L41/142—Network analysis or design using statistical or mathematical methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/02—Arrangements for optimising operational condition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06—Management of faults, events, alarms or notifications
    • H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W24/00—Supervisory, monitoring or testing arrangements
    • H04W24/08—Testing, supervising or monitoring using real traffic

Definitions

  • the present invention relates to telecommunications and, in particular, to performance management in mobile telecommunications systems for monitoring and optimising system operation.
  • Performance Management, PM functions in a mobile telecommunications system are used for monitoring, trouble shooting and optimisation of the mobile telecommunications system.
  • the PM functions are based on events and counters generated by the several system elements of the mobile telecommunications system, among which radio access units or Base Stations, BS, radio network controllers and other system nodes and servers.
  • Events are used to monitor and investigate the elementary system operation. Relevant information of the operation of the system can be obtained from a long time observation of the events data.
  • Counters are used to obtain aggregate or statistical information of the system. Counters are implemented in the various system elements but can also be created from events and event parameters. There is a continuously increasing number of predefined counters that are recorded in the system elements.
  • Examples for the recording of events are the General Performance Event handler, GPEH, and User Equipment Traffic Recording, UETR, functions of system elements.
  • An example for collecting statistical counters is the STATS function of system elements in, for example, third generation, 3G, and Long Term Evolution, LTE, mobile telecommunications systems. Note that events data and counter values generated by a plurality of system elements may be collected by a common server or gateway instead of by the system elements themselves.
  • the events data and counter values may be forwarded directly, in real-time, to a management server or gateway, which is part of an Operating Support System, OSS, by using a streaming application, for example.
  • OSS Operating Support System
  • the events and counters may also be collected in files for a set period of time, called the Result Output Period, ROP, before forwarding thereof to the OSS.
  • ROP files are retrieved periodically from the system elements and processed in the OSS. Both, real-time events data and counter values as well as ROP files may be available for processing by the OSS.
  • An OSS implements several types of PM functions such as traffic monitoring, trouble-shooting, radio and transport network optimisation. From the processed events and counters Key Performance Indicators, KPIs, can be driven that are used for monitoring, trouble shooting and planning purposes. KPIs are used for high level monitoring and business planning functions. These functions are not necessarily part of the OSS.
  • An OSS may also include applications for user defined counters to be created from events or event combinations, which provides an extended observation possibility for telecommunications systems. Besides the above, the events data and counter values may be used by other applications as well.
  • LTE networks for example, implement a lot of auto-configuration functions and use default configurations which provide fast installation and stable operation in the initial phase of a systems setup.
  • monitoring of the overall operation of the large number of system elements requires a centralized management system. Exceptional conditions and operations should be observed by a performance monitoring OSS. Performance monitoring tools and functions are also needed in order to optimise the operation of LTE.
  • LTE performance monitoring is the plural numbers of nodes and cells, i.e. femto cells, that have to be monitored. These nodes, also called LTE eNodeB, generate larger numbers of events and counters that have to be processed compared to previous mobile Radio Access Network, RAN, systems, such as GSM RAN, for example. Scalability issues occur if the OSS has to communicate and collect events data and counter values directly for large numbers of system elements, such as the LTE eNodeBs. In particular in the absence of (intermediate) control nodes, which are also used for collecting and pre-processing PM data from the system elements in GSM and WCDMA RAN systems.
  • a first aspect comprises a method of system Performance Management, PM, by an Operating Support System, OSS, of a mobile telecommunications system.
  • the mobile telecommunications system comprising a plurality of nodes and radio access units servicing a plurality of cells generating a plurality of operational events data and counter values measured periodically for a first Result Output Period, ROP.
  • the method comprising the steps of: - collecting events data and counter values originating from the nodes and radio access units;
  • the aggregation of counter values for a second and further result output periods provides scalability and adequate time based statistics for the counters.
  • the aggregation periods are set corresponding to specific events and counters. That is, events and counters that relate to short term problems are aggregated for a correspondingly short result output period and events and counters that relate to long term problems are aggregated for a correspondingly long result output period, for example. Note that some events and counters should be observed and aggregated both in short and long time periods.
  • Events data which may include different parameters, are turned into further counter values that are not provided for by the counter values that are directly collected from the system elements, i.e. the nodes and radio access units of the mobile communications system.
  • further counters for specific events periodically, corresponding to a respective set aggregation period or time scale for the specific events, self-consistency of the performance data available as events and counters in the system is maintained such that the aggregated and further counter values may be commonly processed in relation to the different system elements for providing performance management information in accordance with the time scale relevant for the specific information.
  • larger numbers of events data and counter values compared to present performance management can be adequately handled and analysed, such as the large number of performance management data generated in LTE, for example.
  • the events and counters are monitored and aggregated for different time periods.
  • different second and further ROPs are set corresponding to time periods related to usage of the mobile telecommunications system.
  • the different second and further ROPs correspond to natural time periods of the human life and behaviour in relation to periods of communication traffic change and traffic load of the telecommunications system, such as five minutes, fifteen minutes, an hour, a day, a week, a month or a year.
  • the size of the collected events data and counter values may be as large as a few MByte, which does not allow storing them for a long time.
  • the aggregation method makes it possible to store the information in an aggregated way for a longer time.
  • the collected events data and counter values are stored for a period of time being a multiple of the respective second and further ROPs. For example, data aggregated for a period of 5 or 15 minutes need only to be stored for a few hours. Data aggregated for 1 hour can be dropped after a few days, etc. It will be appreciated that this is a significant advantage in the efficient use of and the provision of storage capacity.
  • Processing of the aggregated and further counter values corresponding to the originating nodes, radio access units and ROP comprises, among others, parsing of the aggregated and further counter values and extracting counter values for each counter per cell and node and storing them.
  • an adequate spatial statistics base serving as reference data for future analysis of the events and counters.
  • the spatial statistics may be created for extracted counter values after filtering thereof with respect to set filter criteria relating to the cells and nodes of the telecommunications system.
  • the filter criteria in fact specify the scope of monitoring and are also used to decrease the amount of data to be processed.
  • Input filtering for (a group of) cells for example, enables different analysis for rural and urban areas, for example.
  • Counters that are not of interest can be excluded from the analysis using the input filters as well. Filters can be added based on prior knowledge of the system or based on operational experience.
  • At least an average value and a standard deviation value of the counter value distributions of the thus created spatial statistics are calculated, among others to identify exceptional counter values.
  • Outlier cells and nodes are identified, for example, by sorting counter values for different cells and nodes.
  • mapping cause patterns with the identified outlier cells and nodes system operational performance indicia for the first and second and further ROPs are provided.
  • correlating the spatial statistics with time-based statistics more detailed results are derived.
  • the sensitivity of the OSS is tuned by settable factors f and g, such that outlier cells and nodes are automatically identified if a deviation from the average is larger than f times the standard deviation value and if a number of outlier counters for a same cell is larger than g.
  • typical error cases can be identified, for monitoring, trouble shooting and optimisation of the mobile telecommunications system.
  • the analysis is performed for different time scales which allows to identify the problems that may be visible in a short or in a long time scale, for example.
  • Another aspect comprises an Operating Support System, OSS, for providing Performance Management, PM, of a mobile telecommunications system comprising a plurality of nodes and radio access units for servicing a plurality of cells.
  • the nodes and radio access units are arranged for generating a plurality of operational events data and counter values measured periodically for a first Result Output Period, ROP.
  • the OSS comprising:
  • a collecting unit arranged for collecting events data and counter values originating from the nodes and radio access units;
  • an aggregating unit arranged for aggregating the collected counter values periodically for a second and further ROPs having a duration longer than the first ROP, wherein the first and second and further ROPs are set in relation to a specific operational event and counter;
  • a counter creating unit arranged for creating counter values from the collected events data periodically for the second and further ROPs
  • a processing and analysing unit for processing the aggregated and further counter values in relation to the originating nodes, radio access units and ROP, and for analysing the processed counter values for providing system operational performance indicia in different time scales, including the first and second and further ROPs.
  • the OSS may be comprised by software, hardware or a combination of software and hardware in a single node of a telecommunications system, by a plurality of collaborating nodes and even by a server, gateway or computer processing unit external to the telecommunications system.
  • the OSS comprises a unit for setting different second and further ROPs, wherein the aggregating unit and counter creating unit are arranged for operating with set different second and further ROPs.
  • the processing and analysing unit comprises a parser arranged for parsing the aggregated and further counter values for extracting counter values for each counter per cell and node, a storage unit arranged for storing the extracted counter values, a filter unit arranged for filtering extracted counter values with respect to set filter criteria relating to the cells and nodes, and a spatial statistics unit arranged for calculating spatial statistics comprising counter value distributions including an average value and a standard deviation value of the counter value distributions.
  • the processing and analysing unit further comprises a sorter unit, arranged for sorting counter values for different cells and nodes and for identifying outlier cells and nodes based on the calculated average value and standard deviation value of the sorted counter values.
  • the processing and analysing unit may further comprises a mapping unit, arranged for mapping cause patterns with the identified outlier cells and nodes, and a presentation unit for presenting system operational performance indicia based on this mapping.
  • FIG. 1 shows, in a very schematic and illustrative manner, a basic architecture of a mobile telecommunications system comprising an Operating Support System, OSS.
  • OSS Operating Support System
  • Figure 2 shows, in a schematic and illustrative manner, an example of an OSS in accordance with the present invention.
  • Figure 3 shows, in a schematic and illustrative manner, an example of the BSO of Figure 2, in accordance with the present invention.
  • Figure 4 illustrates an example of the method according to the invention.
  • a Radio Access Network, RAN, 2 of a mobile communications system 1 such as a Global System for Mobile communications, GSM, a General Packet Radio Service, GPRS, Wideband Code Division Multiple Access, WCDMA, Time Division-Synchronous Code Division Multiple Access, TD-SCDMA RAN or a Long Term Evolution, LTE, mobile telecommunications system supporting communication with mobile User Equipment, UE, 3 connecting via a wireless radio link 4 and radio access units 5 to the RAN 2.
  • GSM Global System for Mobile communications
  • GPRS General Packet Radio Service
  • WCDMA Wideband Code Division Multiple Access
  • TD-SCDMA RAN Time Division-Synchronous Code Division Multiple Access
  • LTE Long Term Evolution
  • the RAN 2 comprises several node and servers arranged as Radio Network Controller, RNC, 6 for supporting the communication with switching nodes, such as a Mobile switching centre, MSC, 8 and/or servers of an Internet Protocol I P Multimedia Subsystem, I MS, 9 which operatively connect 10 to the RAN 2.
  • RNC Radio Network Controller
  • MSC Mobile switching centre
  • I MS Internet Protocol
  • I MS Internet Protocol
  • the radio access units 5, called Radio Base Stations, RBSs, in a GSM system, for example, and eNodeBs in an LTE communications system, for example, provide service to U Es 3 in a restricted geographical area, called a cell 15, and connect operatively 7 to the RAN 2 for exchanging calls and data between the different U E 3 and other subscribers and users of the telecommunications system 1 .
  • RBSs Radio Base Stations
  • radio access units 5 and RNCs 6 of the telecommunications system 1 are communicatively connected to a central management or Operating Support System, OSS, 1 1 of the telecommunications system 1 , illustratively indicated by dashed lines 12.
  • the connections 12 may, for example, be streaming connections, for the real-time streaming of events data and counter values to the OSS 1 1.
  • the radio access units 5 and RNCs 6 are also termed system elements, SEs.
  • SEs 5, 6 generate internal and external events about their operation. Each event may include one or more parameters that are linked to the event.
  • several counters are implemented to obtain aggregate or statistical information of the system.
  • these events and counters are schematically indicated by reference numerals 13 and 14, respectively.
  • the counter values are measured by the SEs 5, 6 periodically for a time period, the first Result Output Period, ROP, and the result is stored in ROP files.
  • a basic first ROP is typically 5-15 min and is set corresponding to a specific counter.
  • the RNC nodes 6 may collect and store the events and most of the counters related to the controlled radio access units 5.
  • the ROP files and/or the events from the SEs 5, 6 are forwarded to the OSS 1 1.
  • FIG. 2 shows schematically an example of an OSS 20 in accordance with the present invention.
  • the OSS 20 includes several Performance Management, PM, functions performed by a data collecting unit, called Performance Management Gateway, PMG, 21 , a counter creating unit, called Event Based Applications, EBA, 22, an aggregating unit, called Counter Aggregation, CA, 23 and a processing and analysing unit, called Bulk Statistical Observation, BSO, 24.
  • the OSS 20 further comprises a unit 25 for setting different second and further ROPs, i.e. third, fourth, fifth, etc. ROPs, for use by the EBA 22 and the CA 23.
  • the events 13 generated by the several radio access units 5 and RNC 6 as shown in Figure 1 are either forwarded to the PMG 21 or to the other PM functions 22, 23, 24 of the OSS 20.
  • the counter values 14 and basic first ROP are collected by the PMG 21 and are a primary input of the CA 23.
  • the input counter values and ROP files are stored for a time period and periodically aggregated for a second and further ROPs having a duration longer than the first ROP.
  • the ROP are set in relation to specific operational events and counters.
  • the second and further ROPs are created for natural time periods, which corresponds to the periods of human life and behaviour in relation to the use of the telecommunications system 1 , for example ROPs of 1 hour, 1 day, 1 week, 1 month, 1 year.
  • Basic ROPs of 5 or 15 min are, for example, aggregated for 1 hour.
  • the 1 hour ROPs are aggregated for 1 day periods.
  • the 1 day ROPs are aggregated for 1 week periods, etc. It is assumed that these periods correspond to the periodic change of the traffic volume and composition, i.e. speech, multimedia data, internet related data, metering data, etc.
  • the CA 23 provides several ROP files as input to the BSO 24.
  • the EBA function 22 of the OSS 20 creates counters from the events and parameters included in the events collected by the PMG 21 , for the same time periods, i.e. the second and further ROPs as in the CA 23.
  • user defined counters can be specified, that are not implemented in the SEs 6, 7, for example.
  • the EBA function 22 can also be used to define counters or multiple events from different SEs 6, 7.
  • the thus created counter values are input to the BSO 24.
  • the BSO operational units and functions are displayed in Figure 3.
  • BSO 24 receives the first or basic ROP files 29 and the aggregated or second and further ROPs files 26, 27, 28) as input.
  • a parser unit 30 parses the counter files 26, 27, 28, 29 and extracts the counter values for each activated counter per cell 15.
  • the data are stored in a storage unit 31 , such as a RAM or a database.
  • the data are stored in the storage unit 31 in order make the data available for historical analysis. This makes it possible, for example, to compare actual collected and processed events and counter data with similar data of previous time periods. Depending on the size of the data and available DB capacity 10-100 ROP files are stored per accumulation periods ROP.
  • the data are further applied to a filter unit 32, thereby specifying the scope of monitoring and for decreasing the amount of data to be processed.
  • the filtering can be performed for a group or groups of cells 15, to prepare different analysis for rural and urban areas, for example. Counters that are not of interested for a particular analysis should be excluded from such analysis for which the filter unit 32 can be applied as well. By default all cells and parameters are included. Filters can be added based on prior knowledge of the system or based on operation experience, for example.
  • spatial statistics are created by a spatial statistics unit 33, which means that a statistical distribution of the counter values is created for the cells 15, or SEs 5, 6. From these statistics, the average and standard deviation are calculated for the different time scales, i.e. the first and second and further ROPs. Other quantities that characterize the distribution may also be obtained.
  • the counter values for the different cells are sorted per counter and outlier cells are identified by a sorter unit 34.
  • Another factor g to be set is the number of outlier counters for the same cell. For example, if the value of g>5 there are more than 5 parameters that have an extraordinary value and they should belong to the same root cause or root causes.
  • the parameters f and g are used to tune the sensitivity of the OSS system 20.
  • the actual values of the factors f and g may depend from the type and size of the mobile telecommunications system and/or the operator, for example.
  • cause patterns are fitted to the outlying counters by a mapping unit 35, which helps the operator to identify the problem and the root cause of the problem. If, for example, call drop or data packet loss for a certain service is high in a particular cell 15 and at the same time the signal strength level is relatively low, it can be concluded that the drop or loss is due to the week signal.
  • Predefined cause patters can be provided with the mapping function, however the mapping function and unit 35 provide the possibility to add new patterns by the operator based on operation experience.
  • the analysis is done for different time scales, that is different ROP, as illustrated by the several rows of arrows corresponding to a particular ROP file 26, 27, 28, 29. This makes it possible to observe different types of problems. A problem may be identified only at smaller time scale.
  • a first step 40 collecting events data and counter values originating from said nodes 6 and radio access units 5 are collected.
  • the collected counter values are periodically aggregated for a second and further ROPs having a duration longer than the first ROP, wherein the first and second and further ROPs are set corresponding to a specific operational event and counter.
  • counter values are created periodically for the second and further ROPs from the collected 40 events data.
  • an operator becomes a good overview of the system and network operation, which includes all available counters. It can be used for automatic monitoring and trouble-shooting as well. It provides a centralized performance monitoring method, i.e. an operators can avoid complex drive tests, etc. in order to obtain a full picture of the system operation.
  • the method and OSS system provided are able to monitor all available counters in a mobile communications system, as well as user defined counters.
  • the invention makes use of the self consistency of data instead of predefined thresholds and is self-adapting to different system deployment scenarios, traffic conditions, etc.. There is no not need for specific system or network knowledge to use the present performance management tool. On the other hand it has the flexibility to add such knowledge to processing and analysing unit BSO 24, for example, if required.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Algebra (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

A method of and an Operating Support System, OSS, system (20) for Performance Management, PM, of a mobile telecommunications system (1) comprising a plurality of nodes (6) and radio access units (5) servicing a plurality of cells (15) generating a plurality of operational events data (13) and counter values (14) measured periodically for a first Result Output Period, ROP. Events data (13) and counter values (14) originating from the nodes (6) and radio access units (5) are collected (21; 40), aggregated (23; 41 ) periodically for a second and further ROPs having a duration longer than the first ROP. From the collected events data (13) further counter values are created (22, 42) periodically for the second and further ROPs. The aggregated and further counter values are processed (24; 43) corresponding to the originating nodes (6), radio access units (5) and ROP, and the processed counter values are analysed (24; 44) for providing system operational performance indicia in different time scales.

Description

Title
A Method of and an Operating Support System for Providing Performance Management in a Mobile Telecommunications System.
Technical Field
The present invention relates to telecommunications and, in particular, to performance management in mobile telecommunications systems for monitoring and optimising system operation.
Background
Performance Management, PM, functions in a mobile telecommunications system are used for monitoring, trouble shooting and optimisation of the mobile telecommunications system. The PM functions are based on events and counters generated by the several system elements of the mobile telecommunications system, among which radio access units or Base Stations, BS, radio network controllers and other system nodes and servers.
Events are used to monitor and investigate the elementary system operation. Relevant information of the operation of the system can be obtained from a long time observation of the events data.
Counters are used to obtain aggregate or statistical information of the system. Counters are implemented in the various system elements but can also be created from events and event parameters. There is a continuously increasing number of predefined counters that are recorded in the system elements.
Examples for the recording of events are the General Performance Event handler, GPEH, and User Equipment Traffic Recording, UETR, functions of system elements. An example for collecting statistical counters is the STATS function of system elements in, for example, third generation, 3G, and Long Term Evolution, LTE, mobile telecommunications systems. Note that events data and counter values generated by a plurality of system elements may be collected by a common server or gateway instead of by the system elements themselves.
The events data and counter values may be forwarded directly, in real-time, to a management server or gateway, which is part of an Operating Support System, OSS, by using a streaming application, for example. However, the events and counters may also be collected in files for a set period of time, called the Result Output Period, ROP, before forwarding thereof to the OSS. ROP files are retrieved periodically from the system elements and processed in the OSS. Both, real-time events data and counter values as well as ROP files may be available for processing by the OSS.
An OSS implements several types of PM functions such as traffic monitoring, trouble-shooting, radio and transport network optimisation. From the processed events and counters Key Performance Indicators, KPIs, can be driven that are used for monitoring, trouble shooting and planning purposes. KPIs are used for high level monitoring and business planning functions. These functions are not necessarily part of the OSS.
An OSS may also include applications for user defined counters to be created from events or event combinations, which provides an extended observation possibility for telecommunications systems. Besides the above, the events data and counter values may be used by other applications as well.
LTE networks, for example, implement a lot of auto-configuration functions and use default configurations which provide fast installation and stable operation in the initial phase of a systems setup. However, monitoring of the overall operation of the large number of system elements requires a centralized management system. Exceptional conditions and operations should be observed by a performance monitoring OSS. Performance monitoring tools and functions are also needed in order to optimise the operation of LTE.
A problem of LTE performance monitoring is the plural numbers of nodes and cells, i.e. femto cells, that have to be monitored. These nodes, also called LTE eNodeB, generate larger numbers of events and counters that have to be processed compared to previous mobile Radio Access Network, RAN, systems, such as GSM RAN, for example. Scalability issues occur if the OSS has to communicate and collect events data and counter values directly for large numbers of system elements, such as the LTE eNodeBs. In particular in the absence of (intermediate) control nodes, which are also used for collecting and pre-processing PM data from the system elements in GSM and WCDMA RAN systems.
Another problem with newly deployed systems and system technology is the lack of reference data for the different parameters, to derive KPIs, for example. Current PM monitoring functions need a lot of prior knowledge of the system, or decent operational experience, which means more expensive implementations and increased operating expenses. This is in particular a problem for small system operators which are not able to invest in the implementation of such tools and do not have large experienced staff for evaluation and system operation.
Summary
It is an object of the present invention to provide performance management functions for a mobile telecommunications system that can be implemented in a central operating support system or as a separate performance management tool, and adapted to collect and process plural events data and counter values generated by plural system elements.
It is another object of the present invention to provide an expert tool for automatically extracting monitoring, trouble shooting and optimisation information from the performance management functions of the mobile telecommunications system, for use by a systems operator.
A first aspect comprises a method of system Performance Management, PM, by an Operating Support System, OSS, of a mobile telecommunications system. The mobile telecommunications system comprising a plurality of nodes and radio access units servicing a plurality of cells generating a plurality of operational events data and counter values measured periodically for a first Result Output Period, ROP. The method comprising the steps of: - collecting events data and counter values originating from the nodes and radio access units;
- aggregating the collected counter values periodically for a second and further ROPs having a duration longer than the first ROP, wherein the first and second and further ROPs are set corresponding to a specific operational event and counter;
- creating further counter values from the collected events data periodically for the second and further ROPs;
- processing the aggregated and further counter values corresponding to the originating nodes, radio access units and ROP, and
- analysing the processed counter values for providing system operational performance indicia in different time scales.
The aggregation of counter values for a second and further result output periods, i.e. for a second, third, fourth, etc. result output period, provides scalability and adequate time based statistics for the counters. For adequately identifying problems that occur on different time scales, the aggregation periods are set corresponding to specific events and counters. That is, events and counters that relate to short term problems are aggregated for a correspondingly short result output period and events and counters that relate to long term problems are aggregated for a correspondingly long result output period, for example. Note that some events and counters should be observed and aggregated both in short and long time periods.
Events data, which may include different parameters, are turned into further counter values that are not provided for by the counter values that are directly collected from the system elements, i.e. the nodes and radio access units of the mobile communications system. By creating such further counters for specific events periodically, corresponding to a respective set aggregation period or time scale for the specific events, self-consistency of the performance data available as events and counters in the system is maintained such that the aggregated and further counter values may be commonly processed in relation to the different system elements for providing performance management information in accordance with the time scale relevant for the specific information. In this manner, larger numbers of events data and counter values compared to present performance management can be adequately handled and analysed, such as the large number of performance management data generated in LTE, for example. The events and counters are monitored and aggregated for different time periods.
In a further example, for specific operational events and counters, different second and further ROPs are set corresponding to time periods related to usage of the mobile telecommunications system. The different second and further ROPs correspond to natural time periods of the human life and behaviour in relation to periods of communication traffic change and traffic load of the telecommunications system, such as five minutes, fifteen minutes, an hour, a day, a week, a month or a year.
The size of the collected events data and counter values may be as large as a few MByte, which does not allow storing them for a long time. The aggregation method makes it possible to store the information in an aggregated way for a longer time. Accordingly, in a further example, the collected events data and counter values are stored for a period of time being a multiple of the respective second and further ROPs. For example, data aggregated for a period of 5 or 15 minutes need only to be stored for a few hours. Data aggregated for 1 hour can be dropped after a few days, etc. It will be appreciated that this is a significant advantage in the efficient use of and the provision of storage capacity.
Processing of the aggregated and further counter values corresponding to the originating nodes, radio access units and ROP comprises, among others, parsing of the aggregated and further counter values and extracting counter values for each counter per cell and node and storing them.
By creating counter value distributions for the extracted counter values, an adequate spatial statistics base is provided serving as reference data for future analysis of the events and counters. The spatial statistics may be created for extracted counter values after filtering thereof with respect to set filter criteria relating to the cells and nodes of the telecommunications system. The filter criteria in fact specify the scope of monitoring and are also used to decrease the amount of data to be processed. Input filtering for (a group of) cells, for example, enables different analysis for rural and urban areas, for example. Counters that are not of interest can be excluded from the analysis using the input filters as well. Filters can be added based on prior knowledge of the system or based on operational experience.
In an example, at least an average value and a standard deviation value of the counter value distributions of the thus created spatial statistics are calculated, among others to identify exceptional counter values. Outlier cells and nodes are identified, for example, by sorting counter values for different cells and nodes. By mapping cause patterns with the identified outlier cells and nodes, system operational performance indicia for the first and second and further ROPs are provided. By correlating the spatial statistics with time-based statistics, more detailed results are derived.
The sensitivity of the OSS is tuned by settable factors f and g, such that outlier cells and nodes are automatically identified if a deviation from the average is larger than f times the standard deviation value and if a number of outlier counters for a same cell is larger than g.
That is, typical error cases can be identified, for monitoring, trouble shooting and optimisation of the mobile telecommunications system. The analysis is performed for different time scales which allows to identify the problems that may be visible in a short or in a long time scale, for example.
Another aspect comprises an Operating Support System, OSS, for providing Performance Management, PM, of a mobile telecommunications system comprising a plurality of nodes and radio access units for servicing a plurality of cells. The nodes and radio access units are arranged for generating a plurality of operational events data and counter values measured periodically for a first Result Output Period, ROP. The OSS comprising:
- a collecting unit, arranged for collecting events data and counter values originating from the nodes and radio access units;
- an aggregating unit, arranged for aggregating the collected counter values periodically for a second and further ROPs having a duration longer than the first ROP, wherein the first and second and further ROPs are set in relation to a specific operational event and counter;
- a counter creating unit, arranged for creating counter values from the collected events data periodically for the second and further ROPs, and - a processing and analysing unit, for processing the aggregated and further counter values in relation to the originating nodes, radio access units and ROP, and for analysing the processed counter values for providing system operational performance indicia in different time scales, including the first and second and further ROPs.
The OSS may be comprised by software, hardware or a combination of software and hardware in a single node of a telecommunications system, by a plurality of collaborating nodes and even by a server, gateway or computer processing unit external to the telecommunications system.
In an embodiment, the OSS comprises a unit for setting different second and further ROPs, wherein the aggregating unit and counter creating unit are arranged for operating with set different second and further ROPs. In a further embodiment, the processing and analysing unit comprises a parser arranged for parsing the aggregated and further counter values for extracting counter values for each counter per cell and node, a storage unit arranged for storing the extracted counter values, a filter unit arranged for filtering extracted counter values with respect to set filter criteria relating to the cells and nodes, and a spatial statistics unit arranged for calculating spatial statistics comprising counter value distributions including an average value and a standard deviation value of the counter value distributions.
For analysing spatial statistics for performance management purposes, in an other embodiment the processing and analysing unit further comprises a sorter unit, arranged for sorting counter values for different cells and nodes and for identifying outlier cells and nodes based on the calculated average value and standard deviation value of the sorted counter values.
The processing and analysing unit may further comprises a mapping unit, arranged for mapping cause patterns with the identified outlier cells and nodes, and a presentation unit for presenting system operational performance indicia based on this mapping.
The above-mentioned and other features and advantages of the invention will be best understood from the following description referring to the attached drawings. In the drawings, like reference numerals denote identical parts or parts performing an identical or comparable function or operation.
Brief Description of the Drawings
Figure 1 shows, in a very schematic and illustrative manner, a basic architecture of a mobile telecommunications system comprising an Operating Support System, OSS.
Figure 2 shows, in a schematic and illustrative manner, an example of an OSS in accordance with the present invention.
Figure 3 shows, in a schematic and illustrative manner, an example of the BSO of Figure 2, in accordance with the present invention. Figure 4 illustrates an example of the method according to the invention.
Detailed description
The present invention will now be illustrated by way of example and not by way of limitation in a Radio Access Network, RAN, 2 of a mobile communications system 1 , such as a Global System for Mobile communications, GSM, a General Packet Radio Service, GPRS, Wideband Code Division Multiple Access, WCDMA, Time Division-Synchronous Code Division Multiple Access, TD-SCDMA RAN or a Long Term Evolution, LTE, mobile telecommunications system supporting communication with mobile User Equipment, UE, 3 connecting via a wireless radio link 4 and radio access units 5 to the RAN 2. The RAN 2 comprises several node and servers arranged as Radio Network Controller, RNC, 6 for supporting the communication with switching nodes, such as a Mobile switching centre, MSC, 8 and/or servers of an Internet Protocol I P Multimedia Subsystem, I MS, 9 which operatively connect 10 to the RAN 2.
The radio access units 5, called Radio Base Stations, RBSs, in a GSM system, for example, and eNodeBs in an LTE communications system, for example, provide service to U Es 3 in a restricted geographical area, called a cell 15, and connect operatively 7 to the RAN 2 for exchanging calls and data between the different U E 3 and other subscribers and users of the telecommunications system 1 . For the purpose of the present invention, the manner of call handling and data exchange between the several subscribers and users of the telecommunications system is not of importance, such that this will not be further detailed herein. Also because this is knowledge which is fully within the reach of the person skilled in the art.
For the present invention it is important that several radio access units 5 and RNCs 6 of the telecommunications system 1 , and in particular the RAN 2, are communicatively connected to a central management or Operating Support System, OSS, 1 1 of the telecommunications system 1 , illustratively indicated by dashed lines 12. The connections 12 may, for example, be streaming connections, for the real-time streaming of events data and counter values to the OSS 1 1. In the present description and claims, the radio access units 5 and RNCs 6 are also termed system elements, SEs. The SEs 5, 6 generate internal and external events about their operation. Each event may include one or more parameters that are linked to the event. In the SEs 5, 6 several counters are implemented to obtain aggregate or statistical information of the system. In Figure 1 , these events and counters are schematically indicated by reference numerals 13 and 14, respectively. The counter values are measured by the SEs 5, 6 periodically for a time period, the first Result Output Period, ROP, and the result is stored in ROP files. A basic first ROP is typically 5-15 min and is set corresponding to a specific counter. Note that the RNC nodes 6 may collect and store the events and most of the counters related to the controlled radio access units 5. The ROP files and/or the events from the SEs 5, 6 are forwarded to the OSS 1 1.
Figure 2 shows schematically an example of an OSS 20 in accordance with the present invention. The OSS 20 includes several Performance Management, PM, functions performed by a data collecting unit, called Performance Management Gateway, PMG, 21 , a counter creating unit, called Event Based Applications, EBA, 22, an aggregating unit, called Counter Aggregation, CA, 23 and a processing and analysing unit, called Bulk Statistical Observation, BSO, 24. The OSS 20 further comprises a unit 25 for setting different second and further ROPs, i.e. third, fourth, fifth, etc. ROPs, for use by the EBA 22 and the CA 23. The events 13 generated by the several radio access units 5 and RNC 6 as shown in Figure 1 are either forwarded to the PMG 21 or to the other PM functions 22, 23, 24 of the OSS 20. The counter values 14 and basic first ROP are collected by the PMG 21 and are a primary input of the CA 23. Here the input counter values and ROP files are stored for a time period and periodically aggregated for a second and further ROPs having a duration longer than the first ROP. In the unit 25, the ROP are set in relation to specific operational events and counters. The second and further ROPs are created for natural time periods, which corresponds to the periods of human life and behaviour in relation to the use of the telecommunications system 1 , for example ROPs of 1 hour, 1 day, 1 week, 1 month, 1 year. Basic ROPs of 5 or 15 min are, for example, aggregated for 1 hour. The 1 hour ROPs are aggregated for 1 day periods. The 1 day ROPs are aggregated for 1 week periods, etc. It is assumed that these periods correspond to the periodic change of the traffic volume and composition, i.e. speech, multimedia data, internet related data, metering data, etc. The CA 23 provides several ROP files as input to the BSO 24.
The EBA function 22 of the OSS 20 creates counters from the events and parameters included in the events collected by the PMG 21 , for the same time periods, i.e. the second and further ROPs as in the CA 23. In the EBA function 22 user defined counters can be specified, that are not implemented in the SEs 6, 7, for example. The EBA function 22 can also be used to define counters or multiple events from different SEs 6, 7. The thus created counter values are input to the BSO 24. The BSO operational units and functions are displayed in Figure 3. BSO 24 receives the first or basic ROP files 29 and the aggregated or second and further ROPs files 26, 27, 28) as input. A parser unit 30 parses the counter files 26, 27, 28, 29 and extracts the counter values for each activated counter per cell 15. The data are stored in a storage unit 31 , such as a RAM or a database. The data are stored in the storage unit 31 in order make the data available for historical analysis. This makes it possible, for example, to compare actual collected and processed events and counter data with similar data of previous time periods. Depending on the size of the data and available DB capacity 10-100 ROP files are stored per accumulation periods ROP. The data are further applied to a filter unit 32, thereby specifying the scope of monitoring and for decreasing the amount of data to be processed. The filtering can be performed for a group or groups of cells 15, to prepare different analysis for rural and urban areas, for example. Counters that are not of interested for a particular analysis should be excluded from such analysis for which the filter unit 32 can be applied as well. By default all cells and parameters are included. Filters can be added based on prior knowledge of the system or based on operation experience, for example.
For each counter that passes the filter unit 32, spatial statistics are created by a spatial statistics unit 33, which means that a statistical distribution of the counter values is created for the cells 15, or SEs 5, 6. From these statistics, the average and standard deviation are calculated for the different time scales, i.e. the first and second and further ROPs. Other quantities that characterize the distribution may also be obtained. The counter values for the different cells are sorted per counter and outlier cells are identified by a sorter unit 34. The counter value is an outlier, for example, if the deviation from the average is larger than a factor f times the standard deviation value, where f=3 or another value to be set. Accordingly the value of f is used to control the number of outliers.
Another factor g to be set is the number of outlier counters for the same cell. For example, if the value of g>5 there are more than 5 parameters that have an extraordinary value and they should belong to the same root cause or root causes. The parameters f and g are used to tune the sensitivity of the OSS system 20. The actual values of the factors f and g may depend from the type and size of the mobile telecommunications system and/or the operator, for example.
Next, cause patterns are fitted to the outlying counters by a mapping unit 35, which helps the operator to identify the problem and the root cause of the problem. If, for example, call drop or data packet loss for a certain service is high in a particular cell 15 and at the same time the signal strength level is relatively low, it can be concluded that the drop or loss is due to the week signal. Predefined cause patters can be provided with the mapping function, however the mapping function and unit 35 provide the possibility to add new patterns by the operator based on operation experience. The analysis is done for different time scales, that is different ROP, as illustrated by the several rows of arrows corresponding to a particular ROP file 26, 27, 28, 29. This makes it possible to observe different types of problems. A problem may be identified only at smaller time scale. On the other hand in short time scale there can be many outliers that make it difficult to identify the problem. Long scale observation may identify problems that are due to long time traffic increase, aging of connectors, devices, etc, that are not visible in short time scale. This makes it possible to investigate the history of the values of different parameters.
This analysis assumes that the majority of the cells and SEs operate well. This is also a necessary criterion for a self configuration system like LTE, where automating functions ensure the proper settings and operation. The results may be presented in different ways. For each time scale the cells that have outlying counters are presented and listed. In another view the relevant counters can be selected, or they are selected automatically as the counters having outlying values and the corresponding cells are indicated. These performance indicia are presented by the presentation unit 36 of the processing and analysing unit 24. Figure 4 illustrates in a flow chart type diagram the steps of an example of performing the method of the invention, with reference to the a telecommunications system as outlined by Figure 1 and measured periodically for a first Result Output Period, ROP. In a first step 40, collecting events data and counter values originating from said nodes 6 and radio access units 5 are collected. In a second step 41 , the collected counter values are periodically aggregated for a second and further ROPs having a duration longer than the first ROP, wherein the first and second and further ROPs are set corresponding to a specific operational event and counter. In a further step 42 counter values are created periodically for the second and further ROPs from the collected 40 events data. By processing the aggregated and further counter values in step 43 corresponding to the originating nodes 6, radio access units 5 and ROP, and analysing 44 the processed counter values, system operational performance indicia in different time scales are provided 44. Further examples of the method are elucidated above with reference to the Figures 2 and 3.
With the present invention an operator becomes a good overview of the system and network operation, which includes all available counters. It can be used for automatic monitoring and trouble-shooting as well. It provides a centralized performance monitoring method, i.e. an operators can avoid complex drive tests, etc. in order to obtain a full picture of the system operation. The method and OSS system provided are able to monitor all available counters in a mobile communications system, as well as user defined counters.
The invention makes use of the self consistency of data instead of predefined thresholds and is self-adapting to different system deployment scenarios, traffic conditions, etc.. There is no not need for specific system or network knowledge to use the present performance management tool. On the other hand it has the flexibility to add such knowledge to processing and analysing unit BSO 24, for example, if required.
The result is analyzed in different time scales therefore it is possible to notice errors that occur slowly, e.g. due to oxidation of connectors, as well as short temporary problems like large traffic bursts, packet delays, variations in packet delays, etc.
The present invention is not limited to the embodiments as disclosed above, and can be modified and enhanced by those skilled in the art beyond the scope of the present invention as disclosed in the appended claims without having to apply inventive skills.

Claims

Claims
1 . A method of system Performance Management, PM, by an Operating Support System, OSS, (20) of a mobile telecommunications system (1 ), said mobile telecommunications system (1 ) comprising a plurality of nodes (6) and radio access units (5) servicing a plurality of cells (15) generating a plurality of operational events data (13) and counter values (14) measured periodically for a first Result Output Period, ROP, said method comprising the steps of:
- collecting (40) events data and counter values originating from said nodes (6) and radio access units (5);
- aggregating (41 ) said collected counter values periodically for a second and further ROPs having a duration longer than said first ROP, wherein said first and second and further ROPs are set corresponding to a specific operational event and counter;
- creating (42) further counter values from said collected events data periodically for said second and further ROPs;
- processing (43) said aggregated and further counter values corresponding to said originating nodes (6), radio access units (5) and ROP, and
- analysing (44) said processed counter values for providing system operational performance indicia in different time scales.
2. The method according to claim 1 , wherein for specific operational events and counters different second and further ROPs are set, (25), said second and further ROPs corresponding to time periods related to usage of said mobile telecommunications system
(1 )-
3. The method according to claim 1 or 2, wherein said collected (40) events data and counter values are stored (31 ) for a period of time being a multiple of the respective second and further ROPs.
4. The method according to claim 1 , 2 or 3, wherein events include parameters and wherein said further counter values are created (42) for different parameters of an event.
5. The method according to claim 1 , 2, 3 or 4, wherein said processing (43) comprises parsing (30) of said aggregated and further counter values (26 - 29) and extracting counter values for each counter per cell (15) and node (6) and storing same (31 ).
6. The method according to claim 5, wherein for said extracted counter values spatial statistics (33) are created comprising counter value distributions.
7. The method according to claim 6, wherein said spatial statistics are created (33) for extracted counter values after filtering (32) thereof with respect to set filter criteria relating to said cells (15) and nodes (6).
8. The method according to claim 6 or 7, wherein from said spatial statistics (33) at least an average value and a standard deviation value of said counter value distributions are calculated, wherein for different cells (15) and nodes (6) counter values are sorted (34) and wherein outlier cells and nodes are identified (34) based on said calculated average value and standard deviation value of said sorted (34) counter values.
9. The method according to claim 8, wherein outlier cells and nodes are identified
(34) if a deviation from said average is larger than a factor f times said standard deviation value and if a number of outlier counters for a same cell is larger than a factor g, wherein values of f and g are settable for tuning sensitivity of said OSS (20).
10. The method according to claim 8 or 9, wherein said analysing comprises mapping
(35) cause patterns with said identified (34) outlier cells and nodes, for providing said system operational performance indicia for the first and second and further ROPs.
1 1 . An Operating Support System, OSS, (20) for providing Performance Management, PM, of a mobile telecommunications system (1 ), said mobile telecommunications system (1 ) comprising a plurality of nodes (6) and radio access units (5) for servicing a plurality of cells (15) and arranged for generating a plurality of operational events data (13) and counter values (14) measured periodically for a first Result Output Period, ROP, said OSS (20) comprising:
- a collecting unit (21 ), arranged for collecting events data (13) and counter values (14) originating from said nodes (6) and radio access units (5);
- an aggregating unit (23), arranged for aggregating said collected counter values (14) periodically for a second and further ROPs having a duration longer than said first ROP, wherein said first and second and further ROPs are set in relation to a specific operational event and counter;
- a counter creating unit (22), arranged for creating counter values from said collected events data (13) periodically for said second and further ROPs, and
- a processing and analysing unit (24), for processing said aggregated and further counter values (25 - 28) in relation to said originating nodes (6), radio access units (5) and ROP, and for analysing said processed counter values for providing system operational performance indicia in different time scales, including the first and second and further ROPs.
12. The OSS (20) according to claim 1 1 , comprising a unit (25) for setting different second and further ROPs, wherein said aggregating unit (23) and counter creating unit (22) are arranged for operating with set different second and further ROPs.
13. The OSS (20) according to claim 1 1 or 12, wherein said processing and analysing unit (24) comprises a parser (30) arranged for parsing said aggregated and further counter values for extracting counter values for each counter per cell (15) and node (6), a storage unit (31 ) for storing said extracted counter values, a filter unit (32) arranged for filtering extracted counter values with respect to set filter criteria relating to said cells (15) and nodes (6), and a spatial statistics unit (33) arranged for calculating spatial statistics comprising counter value distributions including an average value and a standard deviation value of said counter value distributions.
14. The OSS (20) according to claim 13, wherein said processing and analysing unit (24) further comprises a sorter unit (34), arranged for sorting counter values for different cells (15) and nodes (6) and for identifying outlier cells and nodes based on said calculated average value and standard deviation value of said sorted counter values.
15. The OSS(20) according to claim 14, wherein said processing and analysing unit (24) further comprises a mapping unit (35) for mapping cause patterns with said identified outlier cells and nodes, and a presentation unit (36) for presenting system operational performance indicia based on said mapping.
EP09793509.2A 2009-12-10 2009-12-10 A method of and an operating support system for providing performance management in a mobile telecommunications system Active EP2510650B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2009/066806 WO2011069546A1 (en) 2009-12-10 2009-12-10 A method of and an operating support system for providing performance management in a mobile telecommunications system

Publications (2)

Publication Number Publication Date
EP2510650A1 true EP2510650A1 (en) 2012-10-17
EP2510650B1 EP2510650B1 (en) 2019-04-03

Family

ID=42021874

Family Applications (1)

Application Number Title Priority Date Filing Date
EP09793509.2A Active EP2510650B1 (en) 2009-12-10 2009-12-10 A method of and an operating support system for providing performance management in a mobile telecommunications system

Country Status (4)

Country Link
US (2) US8781463B2 (en)
EP (1) EP2510650B1 (en)
CN (1) CN102668454B (en)
WO (1) WO2011069546A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2819453B1 (en) * 2013-06-28 2015-08-19 Telefonaktiebolaget L M Ericsson (Publ) Method and apparatus for evaluating events in a telecommunication network
US9237463B2 (en) * 2013-11-20 2016-01-12 Verizon Patent And Licensing Inc. Performance pattern correlation
US9503919B2 (en) 2014-07-08 2016-11-22 P. I. Works TR Bilisim Hizm. San. ve Tic A.S. Wireless communication network using multiple key performance indicators and deviations therefrom
CN104811959B (en) * 2015-05-25 2019-02-15 中国联合网络通信有限公司成都市分公司 Mobile network user perception analysis system and method based on big data
CN105893538B (en) * 2016-03-31 2019-06-11 武汉邮电科学研究院有限公司 The LTE base station big data method for digging and device of mapped file based on memory
WO2017190808A1 (en) 2016-05-06 2017-11-09 Telefonaktiebolaget Lm Ericsson (Publ) Coding of network element performance data for transmission
EP3750278B1 (en) * 2018-03-08 2024-01-31 Huawei Technologies Co., Ltd. Network function for end-to-end communication services
KR20220015360A (en) * 2020-07-30 2022-02-08 지오 플랫폼즈 리미티드 System and method for hierarchical computation of key performance indicators

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6138121A (en) * 1998-05-29 2000-10-24 Hewlett-Packard Company Network management event storage and manipulation using relational database technology in a data warehouse
US20030064720A1 (en) 2001-10-03 2003-04-03 Daniel Valins System and method for generating communication network performance alarms
GB2382502B (en) * 2001-11-23 2005-10-19 Actix Ltd Network testing systems
WO2005071890A1 (en) * 2004-01-27 2005-08-04 Actix Limited Monitoring system for a mobile communication network for traffic analysis using a hierarchial approach
WO2006102915A1 (en) * 2005-03-31 2006-10-05 Telefonaktiebolaget Lm Ericsson (Publ) Large scale analysis of push-to-talk traffic
US20060274703A1 (en) * 2005-06-07 2006-12-07 Connelly Stephen P Method and apparatus of filtering and viewing real-time detail records based upon user specific criteria
WO2007091934A1 (en) * 2006-02-10 2007-08-16 Telefonaktiebolaget Lm Ericsson (Publ) Performance monitoring of location-based service in a mobile telecommunications network
PL2100408T3 (en) * 2006-12-05 2017-09-29 Telefonaktiebolaget Lm Ericsson (Publ) An arrangement and a method relating to performance management by distributed processing
US7941136B2 (en) * 2007-09-14 2011-05-10 Actix Limited Mobile phone network optimisation systems

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2011069546A1 *

Also Published As

Publication number Publication date
US20140227992A1 (en) 2014-08-14
CN102668454B (en) 2015-11-25
CN102668454A (en) 2012-09-12
US20120322438A1 (en) 2012-12-20
WO2011069546A1 (en) 2011-06-16
US8781463B2 (en) 2014-07-15
EP2510650B1 (en) 2019-04-03

Similar Documents

Publication Publication Date Title
EP2510650B1 (en) A method of and an operating support system for providing performance management in a mobile telecommunications system
US9154977B2 (en) Mobile phone network management systems
US9432865B1 (en) Wireless cell tower performance analysis system and method
US9491285B2 (en) Technique for performance management in a mobile communications network
EP1952657B1 (en) Base station system performance measurement system in a gsm radio communication network
CN105917625B (en) Classification of detected network anomalies using additional data
EP2196050A1 (en) Mobile phone network optimisation systems
CN102882745A (en) Method and device for monitoring business server
EP2934037B1 (en) Technique for Evaluation of a Parameter Adjustment in a Mobile Communications Network
US9386589B2 (en) Resource managing method, resource management device and apparatus for supporting operation of a radio communication network
US8442947B2 (en) Management of performance data
EP2819453B1 (en) Method and apparatus for evaluating events in a telecommunication network
CN102547789B (en) Early warning method, device and system for quality of peer-to-peer service
FI128647B (en) Automated network monitoring and control
CN101198134A (en) Real time telephone traffic and channel load monitoring method and system used for mobile network
US11026108B2 (en) Fault monitoring in a utility supply network
WO2011149443A1 (en) Self dimensioning and optimization of telecommunications networks (sdaotn)
US20240160835A1 (en) Key performance indicator performance report apparatus and method
Chain Accessibility Degradation Prediction on LTE/SAE Network Using Discrete Time Markov Chain (DTMC) Model
CN101217756A (en) A real-time telephone traffic and channel load monitoring method and corresponding system applied for mobile network

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20120607

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170313

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602009057747

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04L0012260000

Ipc: H04W0024020000

RIC1 Information provided on ipc code assigned before grant

Ipc: H04W 24/02 20090101AFI20181211BHEP

Ipc: H04W 24/08 20090101ALI20181211BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190118

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1117290

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190415

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602009057747

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1117290

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190803

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190703

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190703

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190704

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190803

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602009057747

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

26N No opposition filed

Effective date: 20200106

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191210

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191210

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

REG Reference to a national code

Ref country code: GB

Ref legal event code: 732E

Free format text: REGISTERED BETWEEN 20210617 AND 20210623

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20091210

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602009057747

Country of ref document: DE

Owner name: VIVO MOBILE COMMUNICATION CO., LTD., DONGGUAN, CN

Free format text: FORMER OWNER: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), STOCKHOLM, SE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190403

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230526

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20231116

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231102

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20231031

Year of fee payment: 15