WO2011045736A1 - Network management system and method for identifying and accessing quality of service issues within a communications network - Google Patents

Network management system and method for identifying and accessing quality of service issues within a communications network Download PDF

Info

Publication number
WO2011045736A1
WO2011045736A1 PCT/IB2010/054597 IB2010054597W WO2011045736A1 WO 2011045736 A1 WO2011045736 A1 WO 2011045736A1 IB 2010054597 W IB2010054597 W IB 2010054597W WO 2011045736 A1 WO2011045736 A1 WO 2011045736A1
Authority
WO
WIPO (PCT)
Prior art keywords
factor
service
service performance
records
communications network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2010/054597
Other languages
English (en)
French (fr)
Inventor
Gábor MAGYAR
András VERES
László KOVÁCS
Tamas Borsos
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Telefonaktiebolaget LM Ericsson AB
Original Assignee
Telefonaktiebolaget LM Ericsson AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Telefonaktiebolaget LM Ericsson AB filed Critical Telefonaktiebolaget LM Ericsson AB
Priority to EP10775903.7A priority Critical patent/EP2489156B1/en
Priority to JP2012533728A priority patent/JP5612696B2/ja
Priority to US13/501,407 priority patent/US9015312B2/en
Publication of WO2011045736A1 publication Critical patent/WO2011045736A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5003Managing SLA; Interaction between SLA and QoS
    • H04L41/5009Determining service level performance parameters or violations of service level contracts, e.g. violations of agreed response time or mean time between failures [MTBF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/091Measuring contribution of individual network components to actual service level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5032Generating service level reports

Definitions

  • the present invention relates to a network management system and a method for identifying and accessing Quality of Service (QoS) issues within a communications network.
  • QoS Quality of Service
  • QoS Quality of Serv ice
  • Modem network operators try to continuously monitor the performance of their communications network with respect to the individual services they offer by using service-centric management systems.
  • These service-centric management systems aim to detect changes (drops) in service quality and then the operator tries to find the reason and solution for the QoS degradation to please its customers and to avoid such further drops in service quality.
  • SQM service quality metrics
  • MOS mean opinion score
  • typical factors are for instance the current network load, i.e., the number of parallel active users in the same cell where the service is used, the type of user equipment participating in the service usage transaction, or the current physical radio conditions, which are measured through several factors such as tor instance channel quality information, signal strength, and the congestion situation on the transport links.
  • factors and effects which can come from outside of the network operator's domain, but their effect such as a loss on the internet side outside of the operator's core network can be detected as well.
  • the first and probably one of the most important issues for the performance monitoring module is to collect the correct performance data from inside the communication network that can later be used to assess the QoS in a reliable way. This means that the correct granularity, the detail level, all relevant data related to factors that can affect the final QoS should be carefully selected and included in the data collection.
  • these individual data pieces in a good performance management system should be correlated to each other, in order to put the pieces together to see ail the aspects affecting the performance of the communications network.
  • a network management system, a method, a factor scoring system, a factor strength analysis module, and a service performance unit are described in the independent claims of the present application.
  • Advantageous embodiments of the network management system, the method, the factor scoring system, the factor strength analysis module, and the service performance unit are described in the dependent claims.
  • the present invention provides a network management system for identifying and accessing QoS issues within a communications network.
  • the network management system comprises: (a) a service performance unit that (1) captures traffic and performance related data on interfaces in the communications network and at nodes in the communications network, (2) formats the captured traffic and performance related data into individual service usage transactions each including an identification field and a factor, where the factor describes an aspect of the communications network when the corresponding service usage transaction has taken place, and (3) correlates the individual service usage transactions based on the identification fields to create service performance records each including one of the identification fields, multiple factors, and a service quality metric; (b) a service performance database, coupled to the service performance unit, that stores the service performance records; (c) a factor scoring system, coupled to the service performance database, that computes a score for each factor in each service performance record, where the score indicates an influence the corresponding factor has on the corresponding service quality metric; (d) a factor score database, coupled to the factor scoring system, that stores the computed factor scores for each service performance record together with a reference to the corresponding service performance record; and (e) a tactor strength analysis module, coupled to
  • the present invention provides a method for identifying and accessing QoS issues within a communications network.
  • the method comprises the steps of: (a) creating service performance records by (I) capturing traffic and performance related data on interfaces in the communications network and at nodes in the communications network, (2) formatting the captured traffic and performance related data into individual service usage transactions each including an identification field and a factor, where the factor describes an aspect of the communications network when the corresponding service usage transaction has taken place, and (3) correlating the individual service usage transactions based on the identification fields to create the service performance records each including one of the identification fields, multiple factors, and a service quality metric; (b) storing the service performance records; (c) computing a score for each factor in each service performance record, where the score indicates an influence the corresponding factor has on the corresponding service quality metric; (d) storing the computed factor scores for each service performance record together with a reference to the corresponding service performance record; and (e) aggregating at least a subset of the service performance records together with the corresponding factor scores and using
  • the present invention provides a factor scoring system for identifying and accessing QoS issues within a communications network.
  • the factor scoring system comprises, (a) a processor; and (b) a non-transitory memory that stores processor-executable instructions wherein the processor interfaces with die non-transitory memory and executes the processor-executable instructions to: (i) retrieve a plur ality of service performance records each including an identification field, multiple factors, and a service quality metric; and (it) compute a score for each factor in each service performance record, where the score indicates an influence the corresponding factor has on the corresponding service qual ity metric .
  • the factor scoring system has an advantage in that it can analyze captured traffic and performance related data to obtain reliable knowledge that can be used to increase the QoS and improve the network performance.
  • the present invention provides a factor strength analysis module for identifying and accessing QoS issues within a communications network.
  • the factor strength analysis module comprises: (a) a processor; and (b) a non-transitory memory that stores processor-executable instructions wherein the processor interfaces with the non-transitory memory and executes the processor-executable instructions to: (i) retrieve a plurality of serv ice performance records each including an identification field, multiple factors, and a service quality metric; (ii) retrieve computed factor scores for each factor in each of the service performance records; (iii) aggregate the service performance records together with the corresponding factor scores and use a rule set to analyze the aggregated records to indicate a cause for a specific service quality degradation detected within the communications network.
  • the factor strength analysis module has an advantage in that it can analyze service performance records and computed factors to obtain reliable knowledge that can be used to increase the QoS and improve the network performance.
  • die present invention provides a service performance unit for identifying and accessing QoS issues within a communications network.
  • the service performance unit comprises: (a) a processor; and (b) a non-transitory memory that stores processor-executable instructions wherein the processor interfaces with the non-transitory memory and executes the processor-executable instructions to: (i) capture traffic and performance related data on interfaces in the communications network and at nodes in the communications network; (ii) format the captured traffic and performance related data into individual service usage transactions each including an identification field and a factor, where the factor describes an aspect of the communications network when the corresponding service usage transaction has taken place; and (iii) correlate die individual service usage transactions based on the identification fields to create service performance records each including one of the identification fields, multiple factors, and a service quality metric.
  • the service performance unit has an advantage in that it can capture, format, and correlate traffic and performance related data which can be analyzed to increase the QoS and improve the network performance.
  • FIGURE 1 is a block diagram that illustrates a network management system interfacing with the internet and two exemplary mobile data communications networks in accordance with an embodiment of the present invention
  • FIGURE 2 is a block diagram that illustrates in greater detail the components of the network management system in accordance with an embodiment of the present invention
  • FIGURE 3 is a flowchart that illustrates the steps of an exemplary method in accordance with an embodiment of the present invention
  • FIGURE 4 is a block diagram that illustrates an exemplary function of a service performance unit within the network management system in accordance with an embodiment of the present invention.
  • FIGURE 5 is a flowchart that depicts an exemplary continuous scoring function of a factor scoring module within the network management system in accordance with an embodiment of the present invention.
  • FIGURE 1 there is a block diagram that illustrates a new network management system 100 interfacing with the internet 102 and two exemplary mobile data communications networks 104 and 106 in accordance with an embodiment of the present invention.
  • the two exemplary mobile data communication networks .104 and 106 are well known to those skilled in the art hence a detailed description is not provided herein about their various structures and individual components.
  • the network management system 100 of the present invention can interface with any number and any type of communication system.
  • the network management system 100 functions to identify and access QoS issues within one or both of the exemplary mobile data communications networks 104 and 106.
  • the network management system 100 includes a service performance unit 108, a service performance database 11 0, a factor scoring system 11 2, a factor score database 11 4, and a factor strength analysis module 11 6.
  • a service performance unit 108 includes a service performance database 11 0, a factor scoring system 11 2, a factor score database 11 4, and a factor strength analysis module 11 6.
  • a detailed discussed about the network- management system 100 and each of these components 108, 110, 112, 11 4 and 11 6 is provided below with respect to FIGURES 2-5.
  • To aid in describing the network management system 100 and each of the components 108, 110, 11 2, 114 and 116 the following definitions/notations are provided:
  • Service usage transaction a logical entity that represents an individual transaction of the user for using a given service of the communications network 104 or 106.
  • Service quality metric a real value (denoted by SQM) that represents an objective evaluation of the service quality during a service usage transaction.
  • SQM for mobile broadband session is the throughput value in kbit/s.
  • Factor a real or nominal value (denoted by F) which is either a concrete measurement value or it is derived from several individual measurements (see FIGURE 4). By its value, a factor describes one particular aspect of the communications network 104 or 106 when the serv ice usage transaction has taken place.
  • F a real or nominal value
  • Service performance record a collection of factors with their values and the SQM, for a specific service usage transaction. Denoted by (F 1 , F 2 , .. F n , SQM), where m is the total number of factor values applied to the network management system 100.
  • Service Performance database 110 a collection of individual service performance records, with a total of n records, where the /-th record is denoted by: h, ⁇ (F i1 , F i2 , F in , SQM i ).
  • Empirical probability of SQM A mapping p(SQM;): H->R+ that gives the empirical probability of the occurrence a given SQM value SQM; among the SQM values belonging to a set of service performance records H.
  • Similarity function A mapping that returns a subset of service performance records (R 1 ) for which the value of k-th factor k ik is close to the value of F k .
  • the network management system 100 includes the service performance unit 108, the service performance database 11 0, the factor scoring system 11 2, the factor score database 114, and the factor strength analysis module 11 6.
  • the service performance unit 108 includes a processor 202 and a non-transitory memory 204 that stores processor-executable instructions wherein the processor 202 interfaces with the non-transitory memory 204 and executes the processor-executable instructions to: (1) capture traffic and performance related data on standardized interfaces (e.g., lu-PS, Gn, Gi in the 3G communications network 104 and/or X2, S1 -UP, S1-CP, S11, SGi in the LT E communications network 106) and at certain nodes that provide performance data collection features (e.g., NodeB, RNC, GGSN, SGSN in the 3G communications network 104 and/or eNodeB, MME, S-GW in the LTE communications network 106): (2) format the captured traffic and performance related data into individual service usage transactions each including an identification field and a factor, where the factor describes an aspect of the communications network when the corresponding service usage transaction has taken place, and (3) correlate the individual service usage transactions based on the identification fields to create
  • the service performance database 110 is coupled to the service performance unit 108 and functions to store the service performance records 206 (see step 304 in FIGURE 3).
  • the factor scoring system 11 2 is coupled to the service performance database 108 and includes a processor 208 and a non-transitory memory 210 that stores processor-executable instructions wherein the processor 208 interfaces with the non-transitory memory 210 and executes the processor-executable instructions to compute a score for each possible influencing network factor for each individual service performance record 206 in the service performance database 110.
  • the score indicates the possible influence of the given concrete factor value on the service quality metric of the given service performance record 206 (see step 306 in FIGURE 3).
  • the factor score database 114 is coupled to the factor scoring system 11 2 and functions to store the computed factor scores for each service performance record 206 together with a reference to the corresponding service performance record 206 (see step 308 in FIGURE 3).
  • the factor strength analysis module 11 6 is coupled to the factor score database 11 4 and the service performance database 110.
  • the factor strength analysis module 11 6 includes a processor 212 and a non-transitory memory 214 that stores processor-executable instructions wherein the processor 212 interfaces with the non-transitory memory 214 and executes the processor-executable instructions to aggregate at least a subset of the service performance records 206 (obtained from the service performance database 11 0) together with the corresponding factor scores (obtained from the factor score database 114) and uses a rule set to analyze the aggregated records to indicate a cause for a specific service quality degradation detected within the communications network(s) 104 and 106 (see step 310 in FIGUR E 3).
  • the factor strength analysis module 11 6 can aggregate the service performance records 206 and the factor score records on cell basis to identify one or more factors (root cause(s) ) which have an impact on cell performance quality of one or more cells in the communications network's) 104 and 106. Then, the factor strength analysis module 116 can generate alarms for the cell(s) with considerable service quality degradation. In another application, the factor strength analysis module 11 6 can aggregate the service performance records 206 and the factor score records for each user, taking into account ail the different service usage transactions of the same user, and then generate customer reports for a customer care system for users suffering significant service quality degradation. The customer reports can reveal the main reason for the QoS degradation for a given user.
  • the network management system 100 may have a single processor and a single non-transitory memory that can be used to implement the various functions of the service performance unit 108, the factor scoring system 112, and the factor strength analysis module 116.
  • the individual components 108, 110, 11 2, 11 4, and 11 6 associated with the network management system 100 will be described in detail to help further explain some of the features and advantages of the present invention.
  • the service performance unit 108 functions to pre-process the measurements obtained at individual data sources in the communications network(s) 104 and 106 by (i) capturing traffic and performance related data on interfaces in the communications network and at nodes in the communications network; (ii) formatting the captured traffic and performance related data into individual service usage transactions each including an identification field and a factor, where the factor describes an aspect of the communications network when the corresponding service usage transaction has taken place: and (iii) correlating the individual service usage transactions based on the identification fields to create service performance records 206 each including one of the identification fields, multiple factors, and a service quality metric.
  • FIGURE 4 there is a block diagram that illustrates one exemplary way that the service performance unit 108 can function to pre-process the measurements obtained at individual data sources in the communications network(s) 104 and 106 in accordance with an embodiment of the present invention.
  • the service performance unit 108 captures measurements 402 from different data sources and parses those measurements 402 using a parsing module 404 to form a measurement record 406.
  • the measurement records 406 (raw measurement data) are formatted by a formatting unit 408 to form extended measurement records 410 which have an identification field (ID) and a factor (Fl, F2,..).
  • a multi-factor correlation module 412 correlates the extended measurement records 410 based on their identification fields and a SQM calcuiation unit 414 computes a SQM for each transaction and this computed SQM is added to the correlated extended measurement records to form service performance records 206.
  • the main output from the service performance unit 108 is a set of service performance records 206 which are stored in the service performance database 11 0.
  • the factor scoring system 11 2 assigns a numeric value tor each factor of each service performance record 206 and then stores the factor scores together with a reference to the respective service performance record 206 in the factor score database 11 4.
  • the factor scoring system 11 2 computes a record "S i1 , S i2 , ... , S in " with a reference to the respective service performance record 206 and stores it within the factor score database 11 4.
  • the factor scoring system 112 For computing the S score values for an individual factor of a given service performance record 206, the factor scoring system 112 uses statistical information that can be obtained by analyzing the full set of the given factors and SQM values for all of the individual service performance records 206.
  • the factor scoring module 11 2 can implement either a discrete scoring process (rule based scoring process) or a continuous scoring process to assign a numeric value for each factor of each service performance record 206. These two exemplary scoring processes are described in detail next.
  • the discrete scoring process assigns a discrete score value S to a given factor of a service performance record 206 which is either 0 or 1.
  • the determination of the thresholds T can be based on the statistical properties of the service performance records 206.
  • the thresholds T can be set according to a specified percentage of the factor distribution, e.g. if the factor value falls into the upper or lower 10 percent of the factor value distribution then in this case this factor is considered to be an influencing factor.
  • Received Signal Code Power RSCP
  • RSCP Received Signal Code Power
  • the factor scoring module 11 2 would mark the RSCP as an influencing factor.
  • the thresholds T can be set according to observed SQM values as a function of the given factor where a threshold T is set in a way to ensure that for the "non-influencing" part of the corresponding factor's range that the average value of the SQM is acceptable.
  • the SQM values can be checked as a function of the RSCP values (see above example) where if the RSCP is observed to be above -80 and the average throughput (the SQM value) is above 1.5Mbps, which is acceptable for 3G networks. Then, the factor scoring module 11 2 would set the threshold for RSCP to -80.
  • An advantage of die discrete scoring approach is its simplicity, easy implementation, and the possibility to incorporate expert knowledge into the factor scoring module 11 2 when defining or computing the thresholds T for each factor.
  • a drawback of the discrete scoring approach lies in the discrete marking where a factor can get only 0 or 1 as a score, and often in the "real world" the transition from good to bad with respect to the factor value is not that discrete even though in many cases the discrete score is applicable.
  • FIGURE 5 there is a flowchart that depicts an exemplary continuous scoring process 500 that can be implemented by the factor scoring module 11 2 in accordance with an embodiment of the present invention.
  • the factor scoring module 112 obtains the service performance records 206.
  • the factor scoring module 112 computes an empirical distribution 506 of one of the SQMs for all of the service performance records 206.
  • the factor scoring module 11 2 selects one of the factors (F k , k-1,...m) in the selected service performance record 206.
  • the factor scoring module 11 2 computes an empirical distribution 414 of the one SQM for a subset of the service performance records 206 with a similar factor score value for the selected one factor (F i.k - (delta(F i.k ))).
  • the factor scoring module 112 computes the factor score 518 (Su) of the selected service performance record 206 by comparing the computed empirical distribution 506 of one of the SQMs ( SQM i ) for all of the service performance records 206 and the computed empirical distribution 514 of the one SQM (SQM,) for the subset of the service performance records 206 with a similar factor score value for the selected one factor.
  • the factor scoring module 11 2 determines if all factor scores have been calculated for the selected service performance record 206. If the result of step 520 is no. then the factor scoring module 11 2 returns to the second selecting step 510 to select the next factor in the selected service performance record 206. If the result of step 520 is yes, then the factor scoring module 11 2 at step 522 determines if all the service performance records 206 have been processed. If the result of step 522 is no, then the factor scoring module 112 returns to the first selecting step 508 to select the next service performance record 206. If the result of step 522 is yes, then the factor scoring module 11 2 at step 524 stops since the continuous score value has been assigned to each factor of each service performance record 206.
  • the factor score S ik of a given performance record R i is computed by comparing the empirical distribution of the SQM values among a subset of performance records ⁇ (F ik ), - i.e., where the factor value is the same or close to F ik - with the empirical distribution of SQM among all performance records (see step 516).
  • S ik will be the function of the two p(SQM,) values p ii and p all computed for the two sets of performance records mentioned above.
  • S ik : p ii / p all is a suitable function for meaningful score computation.
  • the factor strength analysis module 11 6 is responsible for providing reliable information for determining the reasons for specific QoS degradations detected in the communications network(s) 104 and 106.
  • the factor strength analysis module 116 performs this analysis based on the aggregation of the factor scores for a specified subset of the service performance records 206 and a rule set to determine the most influencing factors on the QoS.
  • the aggregation function can be e.g. the arithmetic or harmonic mean of the factor scores, and can be performed for each user or for a particular cell or for a given time period (e.g. busy hour). After the aggregation, the factor strength analysis module 116 applies the rule set to pinpoint the important factors.
  • a rule can be e.g. that if the aggregated factor score is greater than a predefined value, then the factor is marked as an influencing factor.
  • the factor strength analysis module 11 6 uses per-user aggregated records to generate customer reports for a customer care system identifying users suffering significant service quality degradation. The generated reports would identify the main factors having an significant effect on the user perceived service quality.
  • the factor strength analysis module 116 uses cell based aggregated records to generate cell based aggregation alarms for cells with considerable service quality degradation which are forwarded to the necessary network management systems. The generated cell based alarms can pinpoint the root cause(s) of the service quality degradation for the particular cell.
  • the network management system 300 of the present invention enables automatic selection of performance impacting factors related to performance degradation by utilizing a multifactor analysis and scoring process.
  • the measurement preprocessing function brings different forms of performance data into a common format in a way that enables the comparison of factors belonging to one specific service or application enabling unified handling of performance data as one factor vector.
  • the factor scoring function analyses the statistical properties of QoS values in relation to the variability found in different factors.
  • the factor scoring function enables the weighing of a multitude of performance impacting factors against each other thus providing valuable input to root-cause analysis functions.
  • the factor strength analysis function selects and aggregates a large number of weighed and scored factor records and can embody a multitude of performance management and customer care algorithms. As a result, OAM personnel can be provided simple, easy-io-understand reports that locus the attention to those customers, cells and performance degrading factors that have the most impact on the quality of the communication services.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
PCT/IB2010/054597 2009-10-16 2010-10-11 Network management system and method for identifying and accessing quality of service issues within a communications network Ceased WO2011045736A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP10775903.7A EP2489156B1 (en) 2009-10-16 2010-10-11 Network management system and method for identifying and accessing quality of service issues within a communications network
JP2012533728A JP5612696B2 (ja) 2009-10-16 2010-10-11 通信ネットワーク内のサービス品質結果の特定及びアクセスのためのネットワーク管理システム及び方法
US13/501,407 US9015312B2 (en) 2009-10-16 2010-10-11 Network management system and method for identifying and accessing quality of service issues within a communications network

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US25225509P 2009-10-16 2009-10-16
US61/252,255 2009-10-16

Publications (1)

Publication Number Publication Date
WO2011045736A1 true WO2011045736A1 (en) 2011-04-21

Family

ID=43404145

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2010/054597 Ceased WO2011045736A1 (en) 2009-10-16 2010-10-11 Network management system and method for identifying and accessing quality of service issues within a communications network

Country Status (4)

Country Link
US (1) US9015312B2 (enExample)
EP (1) EP2489156B1 (enExample)
JP (1) JP5612696B2 (enExample)
WO (1) WO2011045736A1 (enExample)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012176073A3 (en) * 2011-06-01 2013-05-02 Radvision Ltd. Systems, methods, and media for identifying degraded video call links
EP2763349A1 (en) * 2013-02-05 2014-08-06 Telefonaktiebolaget L M Ericsson AB (Publ) Methods and Apparatus for Determining Improved Mobile Network Key Performance Indicators
EP2887728A1 (en) 2013-12-19 2015-06-24 Telefonaktiebolaget L M Ericsson (publ) Technique for performance management in a mobile communications network
US9788223B2 (en) 2013-05-06 2017-10-10 Nokia Solutions And Networks Oy Processing customer experience events from a plurality of source systems

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9461891B2 (en) * 2012-02-06 2016-10-04 Telefonaktiebolaget L M Ericson Method for reporting service quality for over the top services in a communication network
US9558273B2 (en) * 2012-09-21 2017-01-31 Appinions Inc. System and method for generating influencer scores
US9917885B2 (en) 2013-07-30 2018-03-13 International Business Machines Corporation Managing transactional data for high use databases
US8966074B1 (en) * 2013-09-13 2015-02-24 Network Kinetix, LLC System and method for real-time analysis of network traffic
CN104901827B (zh) * 2014-03-07 2019-02-15 中国移动通信集团安徽有限公司 一种基于用户业务结构的网络资源评估方法及装置
GB2546118B (en) 2016-02-09 2018-11-14 Spatialbuzz Ltd Fault monitoring by assessing spatial distribution of queries in a utility supply network
GB2546120B (en) 2016-02-09 2018-02-14 Spatialbuzz Ltd Fault monitoring in a utility supply network
US10462220B2 (en) 2016-09-16 2019-10-29 At&T Mobility Ii Llc Cellular network hierarchical operational data storage
CN108154289A (zh) * 2017-12-10 2018-06-12 中科钢研节能科技有限公司 一种产品质量因素信息自动分析系统与自动分析方法
JP7198181B2 (ja) * 2019-09-02 2022-12-28 株式会社日立製作所 通信品質分析システム、通信品質分析方法
CN115022914A (zh) * 2021-03-05 2022-09-06 中兴通讯股份有限公司 用户感知评估方法、装置、终端及存储介质
CN119211051B (zh) * 2024-09-19 2025-11-14 中国电信股份有限公司 运营商网络的满意度确定方法、装置及非易失性存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050181835A1 (en) * 2004-02-13 2005-08-18 Richard Lau Service impact analysis and alert handling in telecommunications systems
US20080037443A1 (en) * 2006-06-28 2008-02-14 Nortel Networks Limited Method and system for automated call troubleshooting and resolution
US20080080376A1 (en) * 2006-09-28 2008-04-03 Akshay Adhikari Root Cause Analysis of Network Performance Based on Exculpation or Inculpation Sets
US20090181665A1 (en) * 2008-01-15 2009-07-16 At&T Mobility Ii Llc Systems and methods for real-time service assurance

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3344365B2 (ja) 1999-05-31 2002-11-11 日本電気株式会社 移動体通信システム及びそのサービスエリア品質情報収集方法
WO2003005279A1 (en) * 2001-07-03 2003-01-16 Altaworks Corporation System and methods for monitoring performance metrics
WO2003009140A2 (en) * 2001-07-20 2003-01-30 Altaworks Corporation System and method for adaptive threshold determination for performance metrics
JP2004327546A (ja) * 2003-04-22 2004-11-18 Tokyo Electron Ltd 半導体製造システム
JP2004349419A (ja) * 2003-05-21 2004-12-09 Tokyo Electron Ltd プラズマ処理装置の異常原因判定方法及び異常原因判定装置
JP4287338B2 (ja) * 2004-09-08 2009-07-01 日本電信電話株式会社 ユーザ体感品質監視装置および方法
JP2007006203A (ja) * 2005-06-24 2007-01-11 Nippon Telegr & Teleph Corp <Ntt> ユーザ体感品質推定モデル生成装置、品質管理装置、およびプログラム
US20080046266A1 (en) * 2006-07-07 2008-02-21 Chandu Gudipalley Service level agreement management
WO2009011065A1 (ja) * 2007-07-19 2009-01-22 Panasonic Corporation 無線通信エリア状況測定システム、無線通信エリア状況測定方法、及び基地局
JP4273359B2 (ja) * 2007-09-28 2009-06-03 Necソフト株式会社 年齢推定システム及び年齢推定方法
US20100162029A1 (en) * 2008-12-19 2010-06-24 Caterpillar Inc. Systems and methods for process improvement in production environments

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050181835A1 (en) * 2004-02-13 2005-08-18 Richard Lau Service impact analysis and alert handling in telecommunications systems
US20080037443A1 (en) * 2006-06-28 2008-02-14 Nortel Networks Limited Method and system for automated call troubleshooting and resolution
US20080080376A1 (en) * 2006-09-28 2008-04-03 Akshay Adhikari Root Cause Analysis of Network Performance Based on Exculpation or Inculpation Sets
US20090181665A1 (en) * 2008-01-15 2009-07-16 At&T Mobility Ii Llc Systems and methods for real-time service assurance

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Automatic root cause analysis in metrics dependency tree using multiple criteria ranking", IP.COM JOURNAL, IP.COM INC., WEST HENRIETTA, NY, US, 18 November 2008 (2008-11-18), XP013127044, ISSN: 1533-0001 *
MOURELATOU K ET AL: "An approach to identifying QoS problems", COMPUTER COMMUNICATIONS, ELSEVIER SCIENCE PUBLISHERS BV, AMSTERDAM, NL, vol. 17, no. 8, 1 August 1994 (1994-08-01), pages 563 - 570, XP026651162, ISSN: 0140-3664, [retrieved on 19940801], DOI: DOI:10.1016/0140-3664(94)90114-7 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012176073A3 (en) * 2011-06-01 2013-05-02 Radvision Ltd. Systems, methods, and media for identifying degraded video call links
US8483044B2 (en) 2011-06-01 2013-07-09 Radvision Ltd. Systems, methods, and media for identifying degraded video call links
EP2763349A1 (en) * 2013-02-05 2014-08-06 Telefonaktiebolaget L M Ericsson AB (Publ) Methods and Apparatus for Determining Improved Mobile Network Key Performance Indicators
US9788223B2 (en) 2013-05-06 2017-10-10 Nokia Solutions And Networks Oy Processing customer experience events from a plurality of source systems
EP2887728A1 (en) 2013-12-19 2015-06-24 Telefonaktiebolaget L M Ericsson (publ) Technique for performance management in a mobile communications network
US9491285B2 (en) 2013-12-19 2016-11-08 Telefonaktiebolaget Lm Ericsson (Publ) Technique for performance management in a mobile communications network

Also Published As

Publication number Publication date
EP2489156A1 (en) 2012-08-22
JP2013509016A (ja) 2013-03-07
JP5612696B2 (ja) 2014-10-22
US20120203788A1 (en) 2012-08-09
US9015312B2 (en) 2015-04-21
EP2489156B1 (en) 2015-12-23

Similar Documents

Publication Publication Date Title
US9015312B2 (en) Network management system and method for identifying and accessing quality of service issues within a communications network
US11483197B2 (en) Fault localization method and device
US10326640B2 (en) Knowledge base radio and core network prescriptive root cause analysis
US9774506B2 (en) Method and apparatus for analysis of the operation of a communication system using events
US8611228B2 (en) Anomaly detection method and system and maintenance method and system
US11122467B2 (en) Service aware load imbalance detection and root cause identification
US8838093B2 (en) Method and device for monitoring wireless terminal behavior according to terminal type
US20130176871A1 (en) Network Bottleneck Management
CN102546287A (zh) 基于二进制分类的分析及监视方法和系统
CN117858135A (zh) 网络异常检测方法、装置、电子设备及存储介质
CN118102372A (zh) 基于5g电力虚拟专网的通信终端无线质量检测方法及装置
CN119276710A (zh) 网络质量优化方法、装置、电子设备及存储介质
CN109525455B (zh) 一种水文实时监测网络状态综合评估方法
CN104363130B (zh) 通信网络中实现网络质量问题分析定位控制的系统及方法
CN114244737A (zh) 网络质量的评估方法、装置和系统
US20230292156A1 (en) Trajectory based performance monitoring in a wireless communication network
CN117856441B (zh) 一种智能电网传输时延优化方法和系统
US12302129B2 (en) Method and apparatus for scalable ML-based frameworks for resource planning in enterprise networks
CN117014348A (zh) 一种网络关键绩效指标阈值的确定方法以及相关设备
TW201513690A (zh) 遞迴式異常網路流量偵測方法
TWI533688B (zh) Network protocol television service network anomaly node judgment method
Bao et al. End-to-End Network Customer Experience Evaluation and Optimization Method
CN120223581A (zh) 一种基于物联网的分散式网络节点管理系统
CN120751413A (zh) 一种移动通信设备安全监测方法
CN117118805A (zh) 一种数据采集优化方法、装置及设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10775903

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2012533728

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2010775903

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13501407

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE