WO2003037019A1 - Method and system for optimising the performance of a network - Google Patents

Method and system for optimising the performance of a network Download PDF

Info

Publication number
WO2003037019A1
WO2003037019A1 PCT/IB2002/001962 IB0201962W WO03037019A1 WO 2003037019 A1 WO2003037019 A1 WO 2003037019A1 IB 0201962 W IB0201962 W IB 0201962W WO 03037019 A1 WO03037019 A1 WO 03037019A1
Authority
WO
WIPO (PCT)
Prior art keywords
network
cost function
parameters
values
performance
Prior art date
Application number
PCT/IB2002/001962
Other languages
French (fr)
Inventor
Adrian Flanagan
Tomas Novosad
Jaana Laiho
Albert HÖGLUND
Original Assignee
Nokia Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Corporation filed Critical Nokia Corporation
Priority to US10/493,633 priority Critical patent/US20040266442A1/en
Priority to EP02733097A priority patent/EP1442623A1/en
Publication of WO2003037019A1 publication Critical patent/WO2003037019A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/02Arrangements for optimising operational condition
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5003Managing SLA; Interaction between SLA and QoS
    • H04L41/5019Ensuring fulfilment of SLA
    • H04L41/5025Ensuring fulfilment of SLA by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q3/00Selecting arrangements
    • H04Q3/0016Arrangements providing connection between exchanges
    • H04Q3/0062Provisions for network management

Definitions

  • the invention relates to a method and system for optimising the performance of a network.
  • Telecommunications Management Network (TMN) model provides a widely accepted view about how the business of a service provider is to be managed.
  • the TMN model consists of four layers, usually arranged in a triangle or pyramid, with business management at the top, service man- agement the second layer, network management the third layer, and element management at the bottom. Management decisions at each layer are different but related to each other. Working from the top down, each layer imposes requirements on the layer below. Working from the bottom up, each layer provides important source of data to the layer above.
  • TMF TeleManagement Forum's
  • the 3GPP has adopted the same model. The scope of TMF is to find standardised way to define service quality, set requirements for networks in terms of quality of service (QoS) measurements, and make it possible to have QoS reports between providers and systems that implement the service.
  • QoS quality of service
  • the TMN model According to the TMN model the information from the upper level systems flows down, guaranteeing seamless operation and optimisation possibili- ties for the network.
  • the TMN model is depicted in Fig. 3.
  • the information flow from the business management layers all the way down to the service management and network management layers is essential since the business aspects have to be considered carefully in the optimisation and network development process.
  • the TMN model demonstrates the change of the abstraction level in the operator's daily work.
  • the business plan efficiency can be measured with capital and operational expenditure (CAPEX, OPEX) and revenue.
  • the wanted business scenario is then translated to offered services, service priorities and service QoS requirements.
  • On the lowest (network element) level of the TMN model the business related issues are converted into configuration parameter settings.
  • TMN's Business Management Systems Functions supported by TMN's Business Management Systems are, for example, to create an investment plan, to define the main QoS criteria for the proposed network and its services, to create a technical development path (expansion plan) to ensure that the anticipated growth in subscriber numbers is provided for.
  • Service Management Systems Functions supported by Service Management Systems are for example to take care of subscriber data, the provision of services and subscribers, to collect and rate bill offered services, to create, promote and monitor services.
  • NMS Network Management Systems
  • Element management systems can be considered as part of Network Element functionality with the responsibility to monitor the functioning of the equipment, to collect raw data (performance indicators), provide local graphical user interface (GUI) for site engineers, and to mediate towards the NMS system.
  • GUI graphical user interface
  • TOM Telecom Operations Map
  • Telecom and data service providers must apply a customer ori- ented service management approach using business process management methodologies to cost effectively manage their businesses and deliver the service and quality customers require.
  • TOM identifies a number of operations management processes covering Customer Care, Service Management and Network Management.
  • the Telecom Operations Map uses the layers of the TMN model as core business processes, but divides the service management layer into 2 parts: Customer Care and Service Development and Operations.
  • Customer Interface Management is separately delineated, because Customer Interface Management may be man- aged within the individual Customer Care sub-process or, in combination across one or more of the Customer Care sub-processes.
  • Fig. 4 shows the high-level structure of Network Management processes and the supporting Function Set Groups. According to the framework pro- vided by TOM it is possible to map each of the high level processes to a series of component functions (arranged in function set groups). Provided that:
  • NMS network management system
  • Fig. 4 the TOM and its components are presented.
  • the functionalities of the layers are the same as in Fig. 3 to indicate the corresponding management layers.
  • a network optimising process serves to improve the overall network quality as experienced by the mobile subscriber and to ensure an efficient use of the network resources.
  • the optimising process includes the analysis of the network and improvements in the network configuration and performance.
  • Statistics of key performance indicators (KPI) for the operational network are fed to a tool for analysing the network status and the radio resource management (RRM) parameters can be manually tuned for the better performance.
  • the key performance indicators (KPI) are defined in an initial phase of the optimisation process. They consist for example of measurements in the network management system (NMS) and of field measurement data or any other information, which can be used to determine the quality of service (QoS) of the network.
  • NMS network management system
  • QoS quality of service
  • quality of service QoS has consisted for example of dropped call statistics, dropped call cause analysis, handover statistics and measurements of successful call attempts, while for third generation systems with a greater variety of services new definitions of quality of service QoS for quality analysis must be generated.
  • This object is solved by a method for optimising the performance of a network according to claim 1 , a corresponding system according to claim 14.
  • the invention is based on the idea to optimise network resources by means of one centralised cost function rather than optimising the network resources separately.
  • radio resource management algorithms are parameterised separately: handover control, admission control, power control etc. parameter values are set independently and one can identify cases where for example hand over problems are due to wrong power control (CPICH) setting. Change in the admission control setting can result in a change in the quality of the packet data.
  • CPICH wrong power control
  • the relevant key performance indicators for a specific entity within the network as well as first parameters, which influence the key performance indica- tors, are determined.
  • a number of entities similar to said specific entity is selected, wherein relevant key performance indicators are associated to every entity.
  • the key performance indicators as well as the selected number of entities are used as elements in a first cost function, i.e. said first cost function is calculated on the basis of the KPI and the number of entities. Said first cost function is calculated in order to evaluate the network performance. Accordingly, since said first parameters directly relate to the key performance indicators, the network performance will be depend on first values of said first parameters.
  • the values of said first parameters are adjusted, so that a sec- ond set of values of said first parameters are obtained.
  • the key performance indicators are determined again but this time on the basis of the second values of said first parameters and said first cost function is recalculated on the basis of these key performance indicators.
  • the result of said first cost function calculated on the basis of said first values of said first parameters is compared to the result of said first cost function recalculated on the basis of said second values of said first parameters. This comparison is carried out to determine whether the network performance has improved.
  • said second values of said first parame- ters are adopted as permanent parameters.
  • the respective key performance indicators are weighted with different weight coefficients within said first cost function. Using different weight coefficients allows to allocate more influence of one or more key performance indicators on the first cost function.
  • reference values for the key performance indicators are set and the key performance indicators in the first cost function are replaced by the difference between the current key performance indicators and the respective reference values (to define the "cost” see equation (1 )).
  • the first cost function is now calcu- lated on the basis of the difference between the current key performance indicators and the respective reference of values. This allows to set quality of service targets based on the cost of the KPI(s) on the system.
  • said first cost func- tion is composed of a second and a third cost function, wherein said second cost function represents the quality requirements within the network and said third cost function represents the capacity requirements within the network.
  • Said second cost function is weighted with a second weight coefficient while said third cost function is weighted with a third weight co- efficient.
  • the second and third cost function are composed of the selected entities, wherein the determined key performance indicators are associated to each entity. This allows to incorporate a broad distribution of key performance indicators from across the network.
  • said entity can be represented by the cell or the user group within the network. Accordingly, the cost function can be calculated for example on the basis of a cell or a cluster of cells.
  • the steps for optimising the network performance are iterated, so that the optimising process can be automated.
  • the values of the KPI ' s together with the respective first parameters and the cor- responding result of the first cost function are stored to create a history database.
  • the current result of said first cost function is compared with previous results thereof stored in the history database in order to determine whether the network performance has improved within a predetermined time interval.
  • a respective notification is being issued. Issuing the notification when no improvements are detected for a predetermined time interval, can avoid the occurrence of deadlock during the automated process and point out to possible problems.
  • Fig. 1 shows a flow chart of an automated process for optimising the network performance
  • Fig. 2 shows an example of a KPI cost function
  • Fig. 3 shows a diagram of the telecommunications management network (TMN) model
  • Fig. 4 shows a diagram of the Telecom operation map (TOM)
  • Fig. 5 shows an illustration of the combination of monitoring and optimising functions to combine different management layers.
  • Fig 1 a flow chart of an automated process for optimising the network performance according to the first embodiment is shown.
  • step S1 those key performance indicators, which describe the performance of the part of interest of the network, are selected.
  • step S2 those configuration parameters, upon which the KPI ' s depend on, are determined.
  • step S3 the number of ceils, which are to be included into the optimising process, are selected, i.e. selecting a cluster of cells.
  • the current values of the KPI's are determined based on the respective configuration parameters in step S4.
  • the cost function is cal- culated on the basis of the current values of the KPI ' s and the number of cells.
  • the result of the cost function, the values of the KPI ' s and the configuration parameters are stored in a history database in step S6.
  • At least one value of the respective configuration parameters is adjusted in step S7, resulting in a new set of configuration parameters.
  • new KPI values are determined in step S4 and the cost function is re-calculated in step S5 on the basis of the new KPI values and the (unchanged) number of cells as selected in step S3.
  • the new result of the cost function, the new KPI and configura- tion parameter values are also stored in the history database in step S6.
  • the new result of the cost function - based on the new/adjusted set of configuration parameters - is compared to previous results of the cost function stored in the history database in step S8 in order to determine whether the network performance of interest has improved after adjusting the configuration parameters.
  • step S9 If the network performance has improved after adjusting the configuration parameters, the adjusted set of configuration parameters are adopted as permanent parameters in step S9. While, if it has been determined in step S8 that the network performance has not improved after adjusting the con- figuration parameters, the first set of configuration parameters, as stored in the history database in step S6, are adopted as permanent parameters in step S9.
  • step S10 is checked whether the network performance has improved within a predetermined time interval.
  • the network operator is notified in step S12 that a problem has occurred with the automated process for optimising the network performance. Since it is clear that many of the parameter values will not be auto-tuned, and that auto- tuning cannot always optimise the network, the operator can then check whether this problem is due to hardware problems or whether - under the current network conditions - it is not possible to automatically optimise the network performance. In such a case of the network operator will have to resume to manually optimise the network performance.
  • step S7 the configuration parameters are adjusted again in order to further optimise the network performance.
  • the flow will then continue as described above.
  • a second embodiment not only the relevant KPI's are selected in step S1 but also a set of QoS targets is determined, which is expressed in a set of reference KPI.
  • the automated process for optimising the network performance according to the second embodiment corresponds substantially to the optimising process according to the first embodiment. The only difference is that the difference between the KPI and the reference KPI is used instead of the KPI value when the calculating the cost function in step S5.
  • the operator sets capacity requirements for certain capacity KPIs denoted KPI__C with “ref” in the sub-index.
  • the operator sets quality requirements for certain KPl_Qs. The quality and capacity costs can then be calculated as in equation (1).
  • weight coefficients a and ⁇ Different cost functions can be combined or summed with weight coefficients a and ⁇ . By controlling or changing weight coefficients a and ⁇ a certain type of cost can be emphasised and the overall some.
  • the mathematical formulation of the task of optimising the network performance can be seen as to find a combination of air interface configuration parameters based on which the KPIs are as close to the desired area as possible.
  • Fig. 2 shows an example of a KPI cost function f.
  • the cost for KPI values higher than KPI_ref is increasing linearly.
  • the cost functions can also take other shapes.
  • the total cost function to be optimised, i.e. minimized, is presented in equation (3).
  • a trade-off between capacity and quality requirements can be accomplished using the parameter W.
  • the minimization is performed by adjusting the configuration parameters (2).
  • the KPI values also depend on the service distribution, e.g. different costs and parameter settings will be achieved depending on the service distribution.
  • KPI _Q j /(Configuration parameters, Service Distribution)
  • Factors that may affect the optimisation process are for example the traffic profile (service mix), traffic density, pricing of each service etc.
  • the ulti- mate goals when minimizing the total cost include to optimise the operators revenue, to minimise CAPEX and OPEX, as well as to maintain good reputation of the operator.
  • the optimisation challenge is to combine seamlessly all the different TOM management layers, wherein the fact, that the measurements (quality and cost indicators) from different layers use different language, should be taken into account.
  • Radio Access Network parameter settings
  • certain configured functional entity is monitored by certain set of measurements.
  • the performance of the entity is derived with a cost function utilising the defined measurements.
  • Fig. 5 shows an illustration of the combination of network monitoring and optimising functions which are used to combine different management layers within the network by mapping.
  • mapping is carried out from one layer to the next one by combining the network measurements, the performance indicators PI and/or the KPI with a cost function
  • GOS C(Service Availability) + C(Delay and Jittering) + C(Quality) + C(Dropping) + C(Se ⁇ tice Accessibility) + C(Equivalent Bitrate or User throughput)
  • the delay is composed of Service Access Delay and Queuing Transmission Delay.
  • Non real-time quality is influenced by packet loss, Radio Link Control RLC, Packet Data Convergence Protocol PDCP, i.e. by the bit error rate BER and the block error rate BLER.
  • the quality is bad if uplink UL block error rate BLER is significantly higher than the target BLER.
  • the real-time quality is influenced by the downlink DL connection power outage.
  • the input of the above cost function comprises capacity requests and traffic distribution.
  • the measurements of the total throughput is carried out in kbps/cell/MHz.
  • the spectral efficiency of the cost function equals to the throughput in kbps/cell/MHz when 98 % of the users are satisfied. This means that the service accessibility and the blocking probability is 2%.
  • the equivalent bit- rate is greater than 10 % of the bearer service data rate and 98% of a us- ers are not dropped. The motivation behind this approach is to metrically assess the benefits of the optimisation in terms of GOS.
  • This mapping has to be done for all services which are provided, i.e. services which are controlled with different parameter settings or other attrib- utes.
  • mapping is statistically correct. Due to the fact that the operation is carried out in statistical level the best location for the mapping functions is NMS. Fur- thermore, NMS implementation is also able to handle the Radio Network Controller RNC-RNC (or other network element) border areas.
  • RNC-RNC Radio Network Controller
  • the proposed cost function method is applied. In some of the cases the service QoS targets can cause conflict in the parameter settings, therefore a cost function is needed to solve the conflict. This can be carried out by providing different weight coefficients for the different elements in the cost function. This idea will gain importance when different customer classes (silver, bronze, gold, etc) are introduced into the network system.
  • the next major step when changing to the last management layer of TOM model is to perform the evaluation of the network optimisation, service prioritising as well as customer differentiation operation in terms of €, $ or £.
  • the billing and charging information from the Invoicing/Collecting subsystem in the customer care layer of the TOM is needed.
  • optimise the business case of the operator it is possible - on the basis of a cost function - to optimise the business case of the operator to the direction that is the most beneficial. It is worth noting that changing the customer priorities and offered QoS for business reasons will cause change in the customer behaviour and the business management level optimisation is thus iterative.
  • the operator to have flexible means to set the QoS target based on the system KPIs (key performance indicator) and/or a cost function derived from those.
  • the QoS targets may either be set for a cell cluster or per cell basis.
  • the QoS can be evaluated in terms of blocked calls due to hardware resources, "soft" blocked calls (in interference limited networks), dropped calls, bad quality calls, number of retransmissions and delay in case of packed data, diversity handover probability, hard handover success rate, loading situation (uplink UL or downlink DL), ratio of packed data to circuit switched services etc.
  • GSM-WCDMA Global System for Mobile Communications - Wideband Code Division Multiple access
  • KPI KPI
  • the quality manager QM i.e. the optimising process, provides a central monitoring function and monitors the status of the parameter values and identify automatically the problem situation by comparing the history information of the parameter values as stored in the history database.
  • E.g. GERAN and UMTS Terrestrial Radio Access Network UTRAN can be split into auto-tuning subsystems as small and independent as possible. Inter- dependencies between subsystems are taken into account in upper layers of quality manager, by providing weight coefficients for the KPI ' s of their respective subsystems.
  • the optimising process is carried out on the basis of user groups (like business users, free time uses etc.).
  • the initial parameter setting could be made less important.
  • the admission control and handover control could work with very "loose" limits admitting all the users to the network, based on the current QoS situation (KPIs at the operating service system OSS) and the set QoS targets the relevant parameters can be auto-tuned.
  • the new situation i.e.
  • the new KPI values is compared to the KPI history data and the "test" parameters are accepted if the change in the QoS performance (or the cost function of the QoS requirements) is improved.
  • the length of the history data depends on the amount of the traffic in the network (total number of samples should be high enough). It is important that the QoS cost function contains items from the whole RRM and multi-radio area.
  • the key parameters (in terms of optimum capacity and quality) are currently initially set to a "default" value, which in most cases guarantees operation of the network but not the optimum performance.
  • the optimising process according to the invention automatically changes the settings for the essential parameters to the optimum operating point in terms of overall QoS.
  • the adjustments of the configuration parameters can be constant increments or decrements. Alternatively, the increments or decrements can be made variable.
  • a cost function is used to optimize network resources centrally and provide a desired level of quality of service (QoS).
  • QoS quality of service
  • the cost C is a function of different KPI's of the network, for example
  • KPIj is the i-th key performance indicator and Fi is some positive function which can be used to transform, weight and/or scale the i-th KPI.
  • the network performance is optimized by minimizing this cost function C.
  • the third embodiment particularly relates to a simple but efficient algorithm to minimise the above cost function.
  • the optimisation of such a cost function is not straightforward in a real situation.
  • the main problems can be listed as follows:
  • ⁇ w C(w + ⁇ w) + C(w- ⁇ w) - 2C(w) (l g) ⁇ w ⁇
  • the effect of repeating the above algorithm is to average out the noise effects and the parameter converges to an average value.
  • This type of algorithm has been well studied in the area of stochastic optimisation for example in Kushner, H. J. and Clark, D. S. (1978), Stochastic Approxima- tion Methods for Constrained and Unconstrained Systems, volume 26 of Applied Mathematical Sciences, Springer-Verlag, New York, Heidelberg, Berlin.
  • the averaging out of the noise effects is also helped by allowing w to both increase and decrease over time. Also in a real network the noise effects will be reduced as normally the measurements are integrated over the ⁇ t time period.
  • the value of ⁇ t can be chosen appropriate for the parameter being optimised and may change during the optimisation process.
  • this algorithm can track changes in the opti- mum point of the network. Even when the parameter has reached an optimum point, the algorithm causes small fluctuations about this point. As long as the optimum point does not change then the fluctuations will average out to zero around the optimum point. If the optimum point changes then the algorithm can still track this change.
  • the value of a configuration parameter for the KPI ' s is adjusted, the cost function is recalculated, compared with the cost function based on the previous value of the configuration parameter and the newly adjusted value is adopted as new configuration parameter
  • the value of the configuration parameter is adjusted in two steps. First the value of the configuration parameter is increased and the cost function is re-calculated on the basis of the new value and the result is compared with previous results of the cost function. Then the value of the configuration parameter is decreased and the cost function is re-calculated on the basis of the new value and the result is compared with previous results of the cost function.
  • a small or zero change of the configuration parameter is preformed.
  • the cost function and its optimisation is described with regards to one specific network parameter, i.e. the specific problem of deriving and optimising a cost function based on the Key Performance Indicator (KPI), the Blocked Call Ratio (BKCR), is now discussed.
  • KPI Key Performance Indicator
  • BKCR Blocked Call Ratio
  • the WCDMA radio interface for third generation mobile networks can carry voice and data services with various data rates, traffic requirements, and quality-of-service targets.
  • the operating environments vary greatly from indoor cells to large macrocells. Efficient use of limited frequency band in the diverse conditions requires careful setting of numerous vital network and cell parameters.
  • the parameter setting is referred to as radio network planning and optimisation; Once a WCDMA network is built and launched, its operation and maintenance is largely monitoring of per- formance or quality characteristics and changing parameter values in order to improve performance.
  • the automated parameter control mechanism can be simple but it requires an objectively defined performance indicator, or in this case a cost function, that unambiguously tells whether performance is improving or deteriorating.
  • the goal of the optimisation is to minimize the total level of blocked calls in the network.
  • the specific parameter to be optimised is the soft handover parameter window add (wadd).
  • wadd soft handover parameter window add
  • Gains in performance based on soft handover have been studied in "Soft handover gains in a fast power controlled WCDMA uplink" Sipila, K.; Jasberg, M.; Laiho-Steffens, J.; Wacker, A. Vehicular Technology Conference, 1999 IEEE 49th , Volume: 2 , 1999 Page(s):1594-1598,vol.2.. It has been found that considerable care should be taken when defining the cost function to be minimized. Combining the terms in the wrong manner could lead to a cost function, which remains constant for any choice of parameters.
  • a second consideration in choosing an optimisation algorithm for the cost function is that the optimum operating point of the cost function may change. Hence the optimisation algorithm should be able to track any changes in the state of the cost function. It will be shown by analysis that the proposed algorithm can have a quadratic convergence to a minimum of the cost function as compared to the linear convergence of a standard gradient algorithm.
  • a quality manager is a logical unit in the radio network controller that collects statistics of various performance indicators. The quality manager calculates these statistics over a specified interval of time, which will be called qmlnterval. Some of the statistics made available by the quality manager include : - At every qmlnterval, interval, the quality manager goes through all connections of the sector and checks the call quality. The number of bad quality calls and the total number of calls are accumulated in two counters over the control period. The quality is ob- tained as the ratio of the counter values.
  • the value of window add is wadd
  • the value of the cost function c ⁇ - tV > can be evaluated from network measurements.
  • the value of wadd is changed to wadd + ⁇ wadd . 2
  • the value of window add is wadd+ ⁇ wadd _ the cost function value ( ' 2) can be evaluated directly from network measurements.
  • the value of window add is changed to wadd- ⁇ wadd _
  • the next stage in this fourth embodiment is to develop a cost function that can be minimized using the optimisation algorithm as described above.
  • KPI ' is the z "' KPI of the network and ⁇ ' is some function to be defined.
  • Each term of the cost function should be always positive and hence the cost function will always be positive.
  • the function ⁇ ' should scale KPI ⁇ such that in normal operation this term does not dominate the cost function. For example for a value of KPI > operating in a desired range which would ensure the correct quality of service then F ⁇ KPI i) should be in the range [0, 1].
  • BKCR blocked call ratio
  • ulBKCR is the uplink blocked call ratio
  • dlBKCR is the downlink blocked call ratio.
  • the cost function can be further modified to "punish" values of blocking significantly higher than this value. For example,
  • the algorithm according to the third embodiment can be extended to minimizing a cost function when several network parameters are to be optimised.
  • the multiple parameter case is performed by reducing it to the one parameter problem of the third embodiment.
  • This initial value may be randomly chosen as,
  • W 0 (w 0 ;i; w 0;2 ;...; W 0; N ) (28)
  • the N dimensional vector HO is a unit vector which initially once again has arbitrary direction and the factor A is a scalar variable.
  • the idea is to mini- mize the cost function along the line L 0 . This corresponds to finding the optimum value of ⁇ , which is a scalar value, and hence the algorithm described in the previous section can be used. Assuming that the optimum value is ⁇ _ and hence the new value of W is given by,
  • a further advantage of using this type of algorithm, especially when it is extended to higher dimensions is that by causing small fluctuations in the parameters, it may be possible to escape from local minima of the cost function.
  • the optimising method according to the first, second, third or fourth embodiment may be based not only on the last two results of the cost function but also on a previous history of measurements of the cost function. Accordingly, at a time t, the change effected to the parameters may be a function of the cost function and the respective parameter values at different times t, t-1 , t-2, t-3 , t-n. Therefore, the parameters can be updated or adopted as a function of the previous measurements.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

When optimising the performance of the network, first of all, the relevant key performance indicators for a specific entity within the network as well as first parameters, which influence the key performance indicators, are determined. A number of entities similar to said specific entity is selected, wherein relevant key performance indicators are associated to every en-tity. The key performance indicators as well as the selected number of en-tities are used as elements in a first cost function, i.e. said first cost func-tion is calculated on the basis of the KPI and the number of entities. Said first cost function is calculated in order to evaluate the network perform-ance. Accordingly, since said first parameters directly relate to the key per-formance indicators, the network performance will depend on the values of said first parameters. Thereafter the values of said first parameters are adjusted, so that a sec-ond set of values of said first parameters are obtained. The key perform-ance indicators are determined again but this time on the basis of the sec-ond values of said first parameters and said first cost function is re-calculated on the basis of these key performance indicators. The result of said first cost function calculated on the basis of said first values of said first parameters is compared to the result of said first cost function re-calculated on the basis of said second values of said first parameters. This comparison is carried out to determine whether the network performance has improved. When the network performance has improved due to the adjusting of said first parameters, said second values of said first parame-ters are adopted as permanent parameters.

Description

Method and system for optimising the performance of a network
FIELD OF THE INVENTION
The invention relates to a method and system for optimising the performance of a network.
BACKGROUND OF THE INVENTION
Telecommunications Management Network (TMN) model provides a widely accepted view about how the business of a service provider is to be managed. The TMN model consists of four layers, usually arranged in a triangle or pyramid, with business management at the top, service man- agement the second layer, network management the third layer, and element management at the bottom. Management decisions at each layer are different but related to each other. Working from the top down, each layer imposes requirements on the layer below. Working from the bottom up, each layer provides important source of data to the layer above. The TeleManagement Forum's (TMF) TMN sets the guidelines for the optimisation functionalities and processes. The 3rd Generation Partnership Project (3GPP) has adopted the same model. The scope of TMF is to find standardised way to define service quality, set requirements for networks in terms of quality of service (QoS) measurements, and make it possible to have QoS reports between providers and systems that implement the service.
According to the TMN model the information from the upper level systems flows down, guaranteeing seamless operation and optimisation possibili- ties for the network. The TMN model is depicted in Fig. 3. The information flow from the business management layers all the way down to the service management and network management layers is essential since the business aspects have to be considered carefully in the optimisation and network development process. The TMN model demonstrates the change of the abstraction level in the operator's daily work. The business plan efficiency can be measured with capital and operational expenditure (CAPEX, OPEX) and revenue. The wanted business scenario is then translated to offered services, service priorities and service QoS requirements. On the lowest (network element) level of the TMN model the business related issues are converted into configuration parameter settings.
Functions supported by TMN's Business Management Systems are, for example, to create an investment plan, to define the main QoS criteria for the proposed network and its services, to create a technical development path (expansion plan) to ensure that the anticipated growth in subscriber numbers is provided for.
Functions supported by Service Management Systems are for example to take care of subscriber data, the provision of services and subscribers, to collect and rate bill offered services, to create, promote and monitor services.
Functions supported by Network Management Systems (NMS) are to plan the network, to collect information from the underlying networks and pre/post-process the raw data, to analyse and distribute information, to optimise network capacity and quality.
Element management systems can be considered as part of Network Element functionality with the responsibility to monitor the functioning of the equipment, to collect raw data (performance indicators), provide local graphical user interface (GUI) for site engineers, and to mediate towards the NMS system.
In addition to TMN, the TMF also defines a Telecom Operations Map (TOM). Telecom and data service providers must apply a customer ori- ented service management approach using business process management methodologies to cost effectively manage their businesses and deliver the service and quality customers require. TOM identifies a number of operations management processes covering Customer Care, Service Management and Network Management. The Telecom Operations Map uses the layers of the TMN model as core business processes, but divides the service management layer into 2 parts: Customer Care and Service Development and Operations. Customer Interface Management is separately delineated, because Customer Interface Management may be man- aged within the individual Customer Care sub-process or, in combination across one or more of the Customer Care sub-processes.
Fig. 4 shows the high-level structure of Network Management processes and the supporting Function Set Groups. According to the framework pro- vided by TOM it is possible to map each of the high level processes to a series of component functions (arranged in function set groups). Provided that:
• Network performance management (PM) provides adequate measurements; • Network configuration management supports the whole TMF frame work;
• There is intelligence in network management system (NMS) to combine these two information.
It then identifies relationships and information flows between them. In Fig. 4 the TOM and its components are presented. The functionalities of the layers are the same as in Fig. 3 to indicate the corresponding management layers.
A detailed description of the TMN model and the TOM can be found on the homepage of the TMF (see http://www.tmforum.org). In current cellular systems the radio resources are handled with numerous parameters, wherein the parameter value settings are fixed even in changing conditions. The task of an operator is to manually tune the parameter settings to meet the right operating point in terms of quality of service. Often the objective when doing optimising has been "just to get it working". This tuning has been relatively straightforward in simple GSM networks with pure speech services. In the case of WCDMA the complexity of these parameter settings is manifold: multiple services, service classes, even multi-radio environment. The WCDMA based cellular systems will offer variability of packet and circuit switched services and therefore are more complicated to plan and control than today's networks. The strong coupling of the cells adds the complexity. For an operator it is essential to utilise all possible resources to improve the capacity and Quality of Ser- vice (QoS) of the radio network.
A network optimising process serves to improve the overall network quality as experienced by the mobile subscriber and to ensure an efficient use of the network resources. The optimising process includes the analysis of the network and improvements in the network configuration and performance. Statistics of key performance indicators (KPI) for the operational network are fed to a tool for analysing the network status and the radio resource management (RRM) parameters can be manually tuned for the better performance. The key performance indicators (KPI) are defined in an initial phase of the optimisation process. They consist for example of measurements in the network management system (NMS) and of field measurement data or any other information, which can be used to determine the quality of service (QoS) of the network. For a second generation systems quality of service QoS has consisted for example of dropped call statistics, dropped call cause analysis, handover statistics and measurements of successful call attempts, while for third generation systems with a greater variety of services new definitions of quality of service QoS for quality analysis must be generated.
To optimise the overall revenue of a network operator or a service provider reducing the costs of the operation and maintenance of a network system has prompted the need for process automation in said network system.
SUMMARY OF THE INVENTION
It is therefore an object of the invention to improve the process of optimising network resources.
This object is solved by a method for optimising the performance of a network according to claim 1 , a corresponding system according to claim 14.
The invention is based on the idea to optimise network resources by means of one centralised cost function rather than optimising the network resources separately.
Currently the radio resource management algorithms are parameterised separately: handover control, admission control, power control etc. parameter values are set independently and one can identify cases where for example hand over problems are due to wrong power control (CPICH) setting. Change in the admission control setting can result in a change in the quality of the packet data.
Therefore, when optimising the performance of the network, first of all, the relevant key performance indicators for a specific entity within the network as well as first parameters, which influence the key performance indica- tors, are determined. A number of entities similar to said specific entity is selected, wherein relevant key performance indicators are associated to every entity. The key performance indicators as well as the selected number of entities are used as elements in a first cost function, i.e. said first cost function is calculated on the basis of the KPI and the number of entities. Said first cost function is calculated in order to evaluate the network performance. Accordingly, since said first parameters directly relate to the key performance indicators, the network performance will be depend on first values of said first parameters.
Thereafter the values of said first parameters are adjusted, so that a sec- ond set of values of said first parameters are obtained. The key performance indicators are determined again but this time on the basis of the second values of said first parameters and said first cost function is recalculated on the basis of these key performance indicators. The result of said first cost function calculated on the basis of said first values of said first parameters is compared to the result of said first cost function recalculated on the basis of said second values of said first parameters. This comparison is carried out to determine whether the network performance has improved. When the network performance has improved due to the adjusting of said first parameters, said second values of said first parame- ters are adopted as permanent parameters.
Setting separate parameters based on many algorithms rather than optimising a parameter set with a central control function can cause oscillations in the parameter values, since cases may occur where changing one parameter to optimise a KPI may adversely affect other KPI's. Therefore, it is advantageous to monitor the radio resource management as a whole by a centralised cost function rather than individual functions, in order to coordinate the changing of the respective parameters.
According to a development of the invention, the respective key performance indicators are weighted with different weight coefficients within said first cost function. Using different weight coefficients allows to allocate more influence of one or more key performance indicators on the first cost function.
According to a further development of the invention, reference values for the key performance indicators are set and the key performance indicators in the first cost function are replaced by the difference between the current key performance indicators and the respective reference values (to define the "cost" see equation (1 )). Hence, the first cost function is now calcu- lated on the basis of the difference between the current key performance indicators and the respective reference of values. This allows to set quality of service targets based on the cost of the KPI(s) on the system.
According to a preferred development of the invention, said first cost func- tion is composed of a second and a third cost function, wherein said second cost function represents the quality requirements within the network and said third cost function represents the capacity requirements within the network. Said second cost function is weighted with a second weight coefficient while said third cost function is weighted with a third weight co- efficient. Providing the second and third cost function in connection with their respective weight coefficients makes it possible to incorporate the trade-off between capacity and quality within the first cost function.
According to a further preferred development of the invention, the second and third cost function are composed of the selected entities, wherein the determined key performance indicators are associated to each entity. This allows to incorporate a broad distribution of key performance indicators from across the network.
According to a further development of the invention, said entity can be represented by the cell or the user group within the network. Accordingly, the cost function can be calculated for example on the basis of a cell or a cluster of cells.
According to a further preferred development of the invention, the steps for optimising the network performance are iterated, so that the optimising process can be automated.
According to still a further preferred development of the invention, the values of the KPI's together with the respective first parameters and the cor- responding result of the first cost function are stored to create a history database. The current result of said first cost function is compared with previous results thereof stored in the history database in order to determine whether the network performance has improved within a predetermined time interval. However, if no improvements of the network perform- ance have been made within said predetermined time interval a respective notification is being issued. Issuing the notification when no improvements are detected for a predetermined time interval, can avoid the occurrence of deadlock during the automated process and point out to possible problems.
BRIEF DESCRIPTION OF THE DRAWINGS
In the following, the present invention will be described in greater detail on the basis of preferred embodiments with reference to the accompanying drawings, in which:
Fig. 1 shows a flow chart of an automated process for optimising the network performance
Fig. 2 shows an example of a KPI cost function; Fig. 3 shows a diagram of the telecommunications management network (TMN) model;
Fig. 4 shows a diagram of the Telecom operation map (TOM), and
Fig. 5 shows an illustration of the combination of monitoring and optimising functions to combine different management layers.
DESCRIPTION OF THE PREFERRED EMBODIMENT
In Fig 1 a flow chart of an automated process for optimising the network performance according to the first embodiment is shown. First of all, in the step S1 , those key performance indicators, which describe the performance of the part of interest of the network, are selected. Then, in step S2 those configuration parameters, upon which the KPI's depend on, are determined. In step S3 the number of ceils, which are to be included into the optimising process, are selected, i.e. selecting a cluster of cells. The current values of the KPI's are determined based on the respective configuration parameters in step S4. Thereafter, in step S5 the cost function is cal- culated on the basis of the current values of the KPI's and the number of cells. The result of the cost function, the values of the KPI's and the configuration parameters are stored in a history database in step S6.
At least one value of the respective configuration parameters is adjusted in step S7, resulting in a new set of configuration parameters. Based on this new set of configuration parameters new KPI values are determined in step S4 and the cost function is re-calculated in step S5 on the basis of the new KPI values and the (unchanged) number of cells as selected in step S3. The new result of the cost function, the new KPI and configura- tion parameter values are also stored in the history database in step S6. Subsequently, the new result of the cost function - based on the new/adjusted set of configuration parameters - is compared to previous results of the cost function stored in the history database in step S8 in order to determine whether the network performance of interest has improved after adjusting the configuration parameters.
If the network performance has improved after adjusting the configuration parameters, the adjusted set of configuration parameters are adopted as permanent parameters in step S9. While, if it has been determined in step S8 that the network performance has not improved after adjusting the con- figuration parameters, the first set of configuration parameters, as stored in the history database in step S6, are adopted as permanent parameters in step S9.
In step S10 is checked whether the network performance has improved within a predetermined time interval. When the network performance has not improved during the predetermined time interval, i.e. the KPI history has not improved even though auto-tuning is performed, the network operator is notified in step S12 that a problem has occurred with the automated process for optimising the network performance. Since it is clear that many of the parameter values will not be auto-tuned, and that auto- tuning cannot always optimise the network, the operator can then check whether this problem is due to hardware problems or whether - under the current network conditions - it is not possible to automatically optimise the network performance. In such a case of the network operator will have to resume to manually optimise the network performance.
On the other side when the network performance has improved during the predetermined time interval the flow jumps to step S7 where the configuration parameters are adjusted again in order to further optimise the network performance. The flow will then continue as described above. In a second embodiment not only the relevant KPI's are selected in step S1 but also a set of QoS targets is determined, which is expressed in a set of reference KPI. The automated process for optimising the network performance according to the second embodiment corresponds substantially to the optimising process according to the first embodiment. The only difference is that the difference between the KPI and the reference KPI is used instead of the KPI value when the calculating the cost function in step S5.
Accordingly, the operator sets capacity requirements for certain capacity KPIs denoted KPI__C with "ref" in the sub-index. Correspondingly, the operator sets quality requirements for certain KPl_Qs. The quality and capacity costs can then be calculated as in equation (1).
Quality Cost = ∑ ∑ at * f(KPI _ β - KPI_ Q,ref ) cellseCLUSTER i Capacity Cost = ∑ β *f{KPI _Ct - KPI_ C,ref) <1> cellseCLUSTER i
Different cost functions can be combined or summed with weight coefficients a and β. By controlling or changing weight coefficients a and β a certain type of cost can be emphasised and the overall some.
The mathematical formulation of the task of optimising the network performance can be seen as to find a combination of air interface configuration parameters based on which the KPIs are as close to the desired area as possible.
Fig. 2 shows an example of a KPI cost function f. In this example, the cost for KPI values higher than KPI_ref is increasing linearly. However, the cost functions can also take other shapes. The total cost function to be optimised, i.e. minimized, is presented in equation (3). A trade-off between capacity and quality requirements can be accomplished using the parameter W. The minimization is performed by adjusting the configuration parameters (2). The KPI values also depend on the service distribution, e.g. different costs and parameter settings will be achieved depending on the service distribution.
KPI _Ci - f (Configuration parameters , Service Distribution)
(2) KPI _Qj = /(Configuration parameters, Service Distribution)
Total COST = W * Quality Cos t + (\ - W) * Capacity Cost (3)
Factors that may affect the optimisation process are for example the traffic profile (service mix), traffic density, pricing of each service etc. The ulti- mate goals when minimizing the total cost include to optimise the operators revenue, to minimise CAPEX and OPEX, as well as to maintain good reputation of the operator.
A specific example of the cost function TOTAL COST can be calculated according to equations (4) to (8) as follows:
(4) TOTAL COST = C(Queuing Ratio) + C( BAD Quality Ratio) + C(Dropping Ratio) + C(Blocking Ratio)
with
(5) C(Queuing Ratio) = 0.05 * Dev (Queuing Ratio - allowed Queuing Ratio)
(6) C(Bad Quality Ratio) = 0.2 * Dev (Bad Quality Ratio - allowed Bad Quality Ratio) (6) (7) C(Dropping Ratio) = 1 * Dev (Dropping Ratio - allowed Dropping Ratio)
(8) C(Blocking Ratio) = 0.10 * Dev (Blocking Ratio - allowed Blocking Ratio)
The optimisation challenge is to combine seamlessly all the different TOM management layers, wherein the fact, that the measurements (quality and cost indicators) from different layers use different language, should be taken into account.
When the optimising process is implemented in the NMS of a network, the operators' decision on the customer care and service management layers are supported. To be able to do this a derivation of cost functions including configuration and (PM) measurements performed on the lower layer are translated to "language" on the layer above. This can be carried out by:
Performing a technical translation (mapping) from Radio Access Network parameter (settings) to service related quality expectations/targets. In practise this means correlating the configuration management and per- formance management. I.e. certain configured functional entity is monitored by certain set of measurements. The performance of the entity is derived with a cost function utilising the defined measurements.
In practise the following means translation of measurements of larger en- tity (i.e. cell, traffic class, etc.) to user level entity be able to statistically conclude the quality of individual users. Also this step is performed with a with weighted cost function(s). Furthermore, it is possible to combine these individual translations with cost function to achieve wanted end user quality indication. 1 ) A technical translation (mapping) from Radio Access Network measurements (network performance) to end user flow level grade of service (experienced quality).
2) A technical translation from aggregate level (UMTS traffic classes) parameters settings to end user flow level grade of service (experienced quality),
3) A technical mapping from measurements per traffic class to settings to end user flow level grade of service (experienced quality),
and/or a combination function of traffic class and flow level information (parameters and settings) with a cost function to support the parameteris- ing and monitoring of end user GOS.
Fig. 5 shows an illustration of the combination of network monitoring and optimising functions which are used to combine different management layers within the network by mapping.
The mapping is carried out from one layer to the next one by combining the network measurements, the performance indicators PI and/or the KPI with a cost function
And cost function for the grade of service GOS as experienced by the subscriber can be calculated as described in equation (9):
(9) GOS = C(Service Availability) + C(Delay and Jittering) + C(Quality) + C(Dropping) + C(Seπtice Accessibility) + C(Equivalent Bitrate or User throughput) Wherein the delay is composed of Service Access Delay and Queuing Transmission Delay. Non real-time quality is influenced by packet loss, Radio Link Control RLC, Packet Data Convergence Protocol PDCP, i.e. by the bit error rate BER and the block error rate BLER. Regarding the realtime quality the quality is bad if uplink UL block error rate BLER is significantly higher than the target BLER. The real-time quality is influenced by the downlink DL connection power outage. The input of the above cost function comprises capacity requests and traffic distribution. The measurements of the total throughput is carried out in kbps/cell/MHz.
The spectral efficiency of the cost function equals to the throughput in kbps/cell/MHz when 98 % of the users are satisfied. This means that the service accessibility and the blocking probability is 2%. The equivalent bit- rate is greater than 10 % of the bearer service data rate and 98% of a us- ers are not dropped. The motivation behind this approach is to metrically assess the benefits of the optimisation in terms of GOS.
This mapping has to be done for all services which are provided, i.e. services which are controlled with different parameter settings or other attrib- utes.
Although, each translation is causing degradation in accuracy, the mapping is statistically correct. Due to the fact that the operation is carried out in statistical level the best location for the mapping functions is NMS. Fur- thermore, NMS implementation is also able to handle the Radio Network Controller RNC-RNC (or other network element) border areas. In each of these translations the proposed cost function method is applied. In some of the cases the service QoS targets can cause conflict in the parameter settings, therefore a cost function is needed to solve the conflict. This can be carried out by providing different weight coefficients for the different elements in the cost function. This idea will gain importance when different customer classes (silver, bronze, gold, etc) are introduced into the network system.
Furthermore, the next major step when changing to the last management layer of TOM model is to perform the evaluation of the network optimisation, service prioritising as well as customer differentiation operation in terms of €, $ or £. At this stage the billing and charging information from the Invoicing/Collecting subsystem in the customer care layer of the TOM is needed. When utilizing the knowledge of the customer base/profiles and behaviour of those profiles it is possible - on the basis of a cost function - to optimise the business case of the operator to the direction that is the most beneficial. It is worth noting that changing the customer priorities and offered QoS for business reasons will cause change in the customer behaviour and the business management level optimisation is thus iterative.
To guarantee the optimum performance of a cellular network, it is preferable for the operator to have flexible means to set the QoS target based on the system KPIs (key performance indicator) and/or a cost function derived from those. The QoS targets may either be set for a cell cluster or per cell basis. The QoS can be evaluated in terms of blocked calls due to hardware resources, "soft" blocked calls (in interference limited networks), dropped calls, bad quality calls, number of retransmissions and delay in case of packed data, diversity handover probability, hard handover success rate, loading situation (uplink UL or downlink DL), ratio of packed data to circuit switched services etc.
In multi-radio environments (GSM-WCDMA Global System for Mobile Communications - Wideband Code Division Multiple access) it is important to have the possibility to pool the resources of both of the networks for op- timised capacity, coverage and quality. This requires an over all control functionality (quality manager) on higher (KPI) level, i.e. the optimising process according to the invention can be implemented as the quality manager.
The quality manager QM, i.e. the optimising process, provides a central monitoring function and monitors the status of the parameter values and identify automatically the problem situation by comparing the history information of the parameter values as stored in the history database. E.g. GERAN and UMTS Terrestrial Radio Access Network UTRAN can be split into auto-tuning subsystems as small and independent as possible. Inter- dependencies between subsystems are taken into account in upper layers of quality manager, by providing weight coefficients for the KPI's of their respective subsystems.
In another embodiment, the optimising process is carried out on the basis of user groups (like business users, free time uses etc.).
Summarising it can be said that, currently for all the parameter values default value are proposed. Up till now was the operator's task to optimise the network cell by cell (trying to take the multi-cell environment into ac- count). However, by using the method and/or the system for optimising the network performance according to the invention the initial parameter setting could be made less important. For example in the beginning of the network operation the admission control and handover control could work with very "loose" limits admitting all the users to the network, based on the current QoS situation (KPIs at the operating service system OSS) and the set QoS targets the relevant parameters can be auto-tuned. After the parameter change the new situation, i.e. the new KPI values, is compared to the KPI history data and the "test" parameters are accepted if the change in the QoS performance (or the cost function of the QoS requirements) is improved. The length of the history data depends on the amount of the traffic in the network (total number of samples should be high enough). It is important that the QoS cost function contains items from the whole RRM and multi-radio area.
The key parameters (in terms of optimum capacity and quality) are currently initially set to a "default" value, which in most cases guarantees operation of the network but not the optimum performance. The optimising process according to the invention automatically changes the settings for the essential parameters to the optimum operating point in terms of overall QoS.
The adjustments of the configuration parameters can be constant increments or decrements. Alternatively, the increments or decrements can be made variable.
According to a third embodiment of the present invention a cost function is used to optimize network resources centrally and provide a desired level of quality of service (QoS). The cost C is a function of different KPI's of the network, for example
C = ∑E;(RP/,) (1 1 ) ι'=l
where KPIj is the i-th key performance indicator and Fi is some positive function which can be used to transform, weight and/or scale the i-th KPI. The network performance is optimized by minimizing this cost function C. The minimum of the cost is achieved by a proper choice of different network parameters W = (w-,; w2;..., WN) which would be considered the optimum value of the parameters. The cost function approach, implicitly assumes that the value of the KPI's are functions of the network parameters, that is, KPIj = KPIj(w1; w2;..., wN) V j (12) and hence the cost function C is also a function of the network parameters, and can be rewritten as direct function of the parameters as,
Figure imgf000021_0001
where the gι are some functions which may vary with time t.
The third embodiment particularly relates to a simple but efficient algorithm to minimise the above cost function. However, the optimisation of such a cost function is not straightforward in a real situation. The main problems can be listed as follows:
1. In a real network there is much variation in traffic types, user distribu- tions and load. These factors are not controllable by the network and can be considered as random external noise sources. Any optimisation algorithm should be insensitive to such external random influences.
2. Because of the variations in the load etc. at different times, the optimum choice of parameters for any given network can evolve over time (i.e. the functions gι of equation (13) vary with time). Any optimisation algorithm should be able to adapt to such variations in the optimum operating point of a network and be able to track these changes.
3. Generating a model of the network which can be used for optimisation in every different situation may not be feasible. This means that the functions gi of equation (13) are not known. The alternative, and the approach taken in the third embodiment, is not to assume any model for the network but to base the optimisation uniquely on network measurements. The optimisation algorithm to be used in the minimization of the cost function is described and derived from first principles. Consider the general case of a cost function C to be minimized with respect to a parameter denoted w. Let Wo be the value of w which minimizes C. Evaluating C(w0) using the Taylor series expansion about any value of w gives,
(w0 -wf
C(w0) = C(w) + (wϋ - w)*C'(w) + C"(w) (14)
where C'(w) is the first order differential of C with respect to w and C"(w) the second order differential. As C(w0) is a minimum point of C then differentiating equation (14) with respect to Wo and letting the result equal 0, gives,
w ^- (15)
C"(w) '
which is a classic Gauss-Newton algorithm optimisation algorithm with a rapid convergence. In the case where C is a quadratic function of w, then there is a one step convergence to the optimum point w0. In the case where C is not quadratic then convergence is guaranteed so long as C"(w) is always positive. In the case where it is not then it can be made positive and equation (15) resolves to a standard gradient algorithm. However as the minimum point of C is approached then the quadratic approximation becomes more accurate and the convergence speed is high.
The problem is now considered in terms of the WCDMA cost function. As mentioned above, since we do not have a model of the network, it is difficult to find a value for C'(w) and C"(w) hence equation (15) is difficult to use. Nevertheless according to the third embodiment the values of C'(w) and C"(w) are evaluated from network measurements allowing the use of equation (15).
Consider a small change w > 0 in the value of the parameter w to give a new parameter value w + w. The value of the cost function can then be approximated as,
2
C(w + δw) = C(w) + δw* C'(w) + — C"( w) (16)
similarly an expression for C(w-δw) can be derived as
2
C(w - δw) = C(w) - δw* C'(w) + — C"(w) (17)
Adding these two expressions and rearranging the terms results in the ex- pression for c wadd) ancj subtracting the two terms and rearranging the expression leads to the expression for c'(wadd) .
C(w + δw) - C(w - δw)
C'(w) (18) 2 *δw
σ{w) = C(w + δw) + C(w-δw) - 2C(w) (l g) δw~
Hence it is possible to derive values or approximations to the values of C'(w) and C"(w) from equations (18), (19) by knowing the values of C(w + δw) and C(w - Jw). The next question is how to evaluate these values at any particular time. This is performed according to the following steps: 1. At time t1 the parameter value is w and the value of the cost function C(w; t1 ) is evaluated from equation (11 ) based on network measurements of the appropriate KPI's at time t1.
2. At time t1 the value of w is changed to w + δw.
3. At time t2 = t1 + δt, δt > 0, the value of the cost function is evaluated from equation (11 ) based on network measurements of the appropriate KPI's to give C(w + δw; t2).
4. At time t2 the parameter w is changed to w - δw.
5. At time t3 = t2 + δt the cost function is evaluated from equation (11 ) based on network measurements of the appropriate KPI's to give C(w - <5w; t3).
6. At time t3 a new value of w is calculated using equation (15) with C'(w) and C"(w) respectively given by equations (18), (19) and the values of C(w), C(w + δw) and C(w - δw) given respectively by the measurements C(t1 ); C(t2); C(t3).
These steps constitute one cycle of the algorithm and the cycle can be repeated over. Consider now the point discussed above concerning the noise fluctuations which would appear in the different network measure- ments. Although this algorithm is derived for a cost function with no noise term it can also be applied to a noisy cost function.
The effect of repeating the above algorithm is to average out the noise effects and the parameter converges to an average value. This type of algorithm has been well studied in the area of stochastic optimisation for example in Kushner, H. J. and Clark, D. S. (1978), Stochastic Approxima- tion Methods for Constrained and Unconstrained Systems, volume 26 of Applied Mathematical Sciences, Springer-Verlag, New York, Heidelberg, Berlin. The averaging out of the noise effects is also helped by allowing w to both increase and decrease over time. Also in a real network the noise effects will be reduced as normally the measurements are integrated over the δt time period. The value of δt can be chosen appropriate for the parameter being optimised and may change during the optimisation process.
Furthermore it is evident how this algorithm can track changes in the opti- mum point of the network. Even when the parameter has reached an optimum point, the algorithm causes small fluctuations about this point. As long as the optimum point does not change then the fluctuations will average out to zero around the optimum point. If the optimum point changes then the algorithm can still track this change.
While in the first embodiment the value of a configuration parameter for the KPI's is adjusted, the cost function is recalculated, compared with the cost function based on the previous value of the configuration parameter and the newly adjusted value is adopted as new configuration parameter, according to the second embodiment the value of the configuration parameter is adjusted in two steps. First the value of the configuration parameter is increased and the cost function is re-calculated on the basis of the new value and the result is compared with previous results of the cost function. Then the value of the configuration parameter is decreased and the cost function is re-calculated on the basis of the new value and the result is compared with previous results of the cost function. However even if the results of the cost function of the two previous changes do not improve, a small or zero change of the configuration parameter is preformed. Altematively, in a fourth embodiment based on the third embodiment, the cost function and its optimisation is described with regards to one specific network parameter, i.e. the specific problem of deriving and optimising a cost function based on the Key Performance Indicator (KPI), the Blocked Call Ratio (BKCR), is now discussed.
The WCDMA radio interface for third generation mobile networks can carry voice and data services with various data rates, traffic requirements, and quality-of-service targets. Moreover, the operating environments vary greatly from indoor cells to large macrocells. Efficient use of limited frequency band in the diverse conditions requires careful setting of numerous vital network and cell parameters. The parameter setting is referred to as radio network planning and optimisation; Once a WCDMA network is built and launched, its operation and maintenance is largely monitoring of per- formance or quality characteristics and changing parameter values in order to improve performance. The automated parameter control mechanism can be simple but it requires an objectively defined performance indicator, or in this case a cost function, that unambiguously tells whether performance is improving or deteriorating.
The goal of the optimisation is to minimize the total level of blocked calls in the network. The specific parameter to be optimised is the soft handover parameter window add (wadd). Gains in performance based on soft handover have been studied in "Soft handover gains in a fast power controlled WCDMA uplink" Sipila, K.; Jasberg, M.; Laiho-Steffens, J.; Wacker, A. Vehicular Technology Conference, 1999 IEEE 49th , Volume: 2 , 1999 Page(s):1594-1598,vol.2.. It has been found that considerable care should be taken when defining the cost function to be minimized. Combining the terms in the wrong manner could lead to a cost function, which remains constant for any choice of parameters. Some factors that affect the performance of the network cannot be controlled directly by adjusting the network parameters. For example the number of users, user distribution and the type of traffic. Changes in these external parameters result in fluctuations of the cost function. This means any optimisation algorithm used to minimize the cost function should be robust and lead to a convergence even in the presence of random fluctuations. Such algorithms have been well studied in the area of stochastic approximation Kushner and Clark, "Stochastic Approximation Methods for Constrained and Unconstrained Systems, Springer-Veriag, New York, Heidelberg, 1978. The relevant result from these studies to the cost function optimisation problem here is that even in a noisy environment the optimisation problem can be treated as a noise free optimisation when applied repeatedly averages out the noise fluctuations in the system. This approach is used here and an optimisation algorithm is derived to optimize a deterministic cost function and in practice is applied to minimize a noisy cost function.
A second consideration in choosing an optimisation algorithm for the cost function is that the optimum operating point of the cost function may change. Hence the optimisation algorithm should be able to track any changes in the state of the cost function. It will be shown by analysis that the proposed algorithm can have a quadratic convergence to a minimum of the cost function as compared to the linear convergence of a standard gradient algorithm.
A quality manager is a logical unit in the radio network controller that collects statistics of various performance indicators. The quality manager calculates these statistics over a specified interval of time, which will be called qmlnterval. Some of the statistics made available by the quality manager include : - At every qmlnterval, interval, the quality manager goes through all connections of the sector and checks the call quality. The number of bad quality calls and the total number of calls are accumulated in two counters over the control period. The quality is ob- tained as the ratio of the counter values.
- The ratio of the blocked calls to the total number of admission requests during the previous qmlnterval.
- The ratio of calls ended by dropping to the total number of ended calls during the previous qmlnterval.
Here only the blocking ratio was used, however the methods and simulations could be extended to include the other statistics returned by the qual- ity manager.
Consider the general case of a cost function C (cf. equation 11) to be minimized with respect to the handover parameter, window add denoted wadd. Let waddo be the value of window add which minimizes C. Evaluating C(wαdd0) using the Taylor series expansion about wadd gives,
C(wαdd0 ) = C(wαdd) + (wαddQ - wαdd) * C'(wαdd)
+ (wαdd0 - wαddf σ(wαdd) (20)
where C" is the first order differential of C.with respect to wαdd and " the second order differential. As cAαd _) s a mjnjmum then differentiating equation (1 ) with respect to wαdd° and letting the result equal 0, gives, waddn = wadd
° C"(wadd) (2 )
which is a classic Gauss-Newton algorithm, with a rapid convergence. The values of σ and c" must be known at wadd . It is now shown how these values can be estimated from the network. Please note that equation (20) and (21 ) correspond to equations (14) and (15) relating the more general form of said equations.
Consider a change of window add by δwadd to wadd + wadd ancj the corre- sponding value of the cost function c(wadd+δwadd) _ similarly consider a change of window add to wadd-δwadd ancj the corresponding value c(wadd - δwadd) 0f fl-,e cos function, then it is possible to show by some algebraic manipulation that c'(w dd) and c"(wadd) can be given as,
„,, , ,. Ciwadd + δwadd) - C(wadd - δwadd)
C (wadd) = — - 2*δwadd
(22)
„„, . .. C(wadd + δwadd) + C(wadd- δwadd)- 2* C(wadd) C (wadd) = wadd
if C is quadratic and hence there is one step convergence. If C is not quadratic then the expressions in equation (22) are an approximation, but there is still a rapid convergence compared to a standard gradient algorithm. Closer to wadd° the approximation to quadratic becomes more accurate. In the real case the algorithm is implemented as follows :
1 ) At time t1 the value of window add is wadd , and the value of the cost function c{-tV> can be evaluated from network measurements. At time t1 , the value of wadd is changed to wadd + δwadd . 2) At time t2(>t1 ), the value of window add is wadd+δwadd _ the cost function value ('2)can be evaluated directly from network measurements. At time t2 the value of window add is changed to wadd-δwadd _
5 3) At time t3(>t2), the value of window add is wadd-δwadd t the cost function value c( 3) can be evaluated directly from network measurements. At time t3, the value of wadd s updated using equation (20), and equations (21 ), (22) with
C(wadd) = C(t\) C(wadd + δwadd) = C(t2) -| Q C(wadd- δwadd) = C(/3) (23)
This process is repeated over, leading to a minimization of the cost function. A point worth noting is that two goals are achieved by alternately increasing and decreasing the value of window add. The first being as de-
15 scribed above, is to estimate c and c" . The second goal is more implicit. Consider the case where the algorithm has converged to the minimum of the cost function. At this point the gradient of the function is zero and the optimisation is over. However over time the optimum point of the network and hence the cost function may change. By alternating the value of wadd
20 as described above, any such changes can be detected and followed by the algorithm.
The next stage in this fourth embodiment is to develop a cost function that can be minimized using the optimisation algorithm as described above. In
25 the first most general case the cost function can be described by equation
(11) where KPI' is the z"' KPI of the network and ^' is some function to be defined. Each term of the cost function should be always positive and hence the cost function will always be positive. Also the function ^'should scale KPIϊ such that in normal operation this term does not dominate the cost function. For example for a value of KPI> operating in a desired range which would ensure the correct quality of service then F^KPIi) should be in the range [0, 1].
In the fourth embodiment we are interested only in the blocking rate. The aim is to minimize the blocked call ratio (BKCR) as a function of window add. BKCR is very dependent on the value of window add. In this case the most obvious cost function to minimize would be a simple sum of the blocking ratios. However for several reasons a better choice of cost func- tion in this case is
C = ιtlBKCR2 +dlBKCR2 (24)
where ulBKCR is the uplink blocked call ratio and dlBKCR is the downlink blocked call ratio. However in any real network for an acceptable level of service the blocked call ratio must be less than a certain value, for example 5%. The cost function can be further modified to "punish" values of blocking significantly higher than this value. For example,
C = f(ulBKCR)2 + f(dlBKCR)2 (25)
where,
/"(x) = exp(jc * 12)- l (2β)
The choice of this function means that for a value of 5% uplink blocking the value of f(ulBKCR)=1.0. For values less than 5% the function is almost linear. However for values greater than 5% the function increases exponentially. The usefulness of the function f is more obvious when there are more terms in the cost function. Another important characteristic of the function f is that it is continuously differentiable function and hence there is no problem when deriving the derivatives of the cost function used in the optimisation algorithm.
In a fifth embodiment the algorithm according to the third embodiment can be extended to minimizing a cost function when several network parameters are to be optimised. The multiple parameter case is performed by reducing it to the one parameter problem of the third embodiment. Consider the vector W of N parameters Wj to be optimised,
W = (wι; w2, ... ; wN) (27)
Consider an initial value of these parameters from which the optimisation is to begin. This initial value may be randomly chosen as,
W0 = (w0;i; w0;2;...; W0;N ) (28)
Define a line in the N dimensional parameter space which contains this initial point W0 as
L. = W + λϊϊo (29)
The N dimensional vector HO is a unit vector which initially once again has arbitrary direction and the factor A is a scalar variable. The idea is to mini- mize the cost function along the line L0. This corresponds to finding the optimum value of λ, which is a scalar value, and hence the algorithm described in the previous section can be used. Assuming that the optimum value is λ_ and hence the new value of W is given by,
Wι = Wo + λ.n. (30) Define another line Li as
Figure imgf000033_0001
where now is a conjugate direction to no . The optimisation of the cost function is repeated along this newly defined line once again using the algorithm of the third embodiment. In theory in a noiseless system the optimisation along a line would have to be repeated N times along N conjugate directions (no, in, UN - \) . In the case of a noisy cost function more cycles would have to be repeated to cancel out noise effects. There are many well known methods to generate the conjugate directions at each step of the optimisation. A better minimization of the cost function can be achieved by simultaneously optimising several network parameters as compared to optimising them separately.
A further advantage of using this type of algorithm, especially when it is extended to higher dimensions is that by causing small fluctuations in the parameters, it may be possible to escape from local minima of the cost function.
The optimising method according to the first, second, third or fourth embodiment may be based not only on the last two results of the cost function but also on a previous history of measurements of the cost function. Accordingly, at a time t, the change effected to the parameters may be a function of the cost function and the respective parameter values at different times t, t-1 , t-2, t-3 , t-n. Therefore, the parameters can be updated or adopted as a function of the previous measurements.

Claims

Claims
1. A method for optimising the performance of a network, in particular a radio network performance, comprising the steps of: - determining relevant key performance indicators for an entity within the network and first parameters, upon which said key performance indicators depend on,
- selecting a number of similar entities,
- calculating a first cost function on the basis of the determined key performance indicators and the selected number of entities, in order to evaluate the network performance on the basis of first values of said first parameters, wherein said first values of said first parameters represent the current values of said first parameters,
- adjusting the values of said first parameters resulting in second values of said first parameters,
- re-calculating said first cost function on the basis of the key performance indicators as determined according to said second values of said first parameters to evaluate the network performance,
- comparing the result of said first cost function according to said first values of said first parameters with the result of said first cost function according to said second values of said first parameters to determine whether the network performance has improved,
- adopt said second values of said first parameters as permanent parameters if the network performance on the basis of said second values of said first parameters has improved.
2. A method according to claim 1 , wherein the respective determined key performance indicators are weighted with different weight coefficients within said first cost function.
3. A method according to claim 1 or 2, wherein reference values for the key performance indicators are set, and the difference between the current key performance indicators and the respective reference values thereof are determined and are used as elements in said first cost function.
4. A method according to any one of the preceding claims, wherein said first cost function is composed of a second cost function representing the quality requirements within the network and a third cost function representing the capacity requirements within the network, wherein said second cost function is weighted with a second weight coefficient and said third cost function is weighted with a third weight coefficient.
5. A method according to claim 4, wherein said third weight coefficient equals to said second weight coefficient subtracted from one.
6. A method according to any one of the preceding claims, wherein said second and third cost functions comprise the determined key performance indicators for each selected entity as elements.
7. A method according any one of the preceding claims, wherein said entity within the network is represented by a cell or a user group within said network.
8. A method according to any of the preceding claims, wherein the steps for optimising the network performance are iterated.
9. A method according to any of the preceding claims, comprising the step of:
- storing the values of the key performance indicators together with the respective first parameters and the corresponding result of the first cost function in order to create a history database.
10. A method according to any of the preceding claims, wherein the comparing step includes the steps of:
- comparing the results of said first cost function with stored previous results of the first cost function in said history database in order to determine whether the network performance has improved within the predetermined time interval, and - notifying if no improvements of the network performance has been made in said predetermined time interval.
11. A method according to claim 8, wherein said step of adjusting the values of said first parameter is performed by increasing and decreasing said values alternately.
12. A method according to claim 11 , wherein said steps of increasing and decreasing said values of said first parameters are performed successively before performing said adopting step.
13. A method according to any preceding claims, wherein quality of service indications for services and/or individual subscribers are derived from measurements and/or configurations of low management layers within the network.
14. A system for optimising the performance of a network, in particular a radio network performance, comprising: a) means for determining a relevant key performance indicator for an entity within said network and a first parameter, upon which said key performance indicator depends on, b) means for selecting at least one similar entity, c) means for calculating a first cost function on the basis of said determined key performance indicator and said selected at least one entity, in order to evaluate the network performance on the basis of a first value of said first parameter, wherein said first value of said first parameter represents a current value of said first parameter, d) means for adjusting said first value of said first parameter to obtain a second value of said first parameter, e) means for re-calculating said first cost function on the basis of said relevant key performance indicator determined according to said second value of said first parameter to evaluate the network performance, f) means for comparing the result of said first cost function according to said first value of said first parameter with the result of said first cost function according to said second value of said first parameter to deter- mine whether the network performance has improved, and g) means for adopting said second value of said first parameter as permanent parameters if the network performance on the basis of said second value of said first parameters has improved.
15. A Computer program product comprising computer program code means for causing a computer to perform the steps of the method as claimed in 1 to 10 when said computer program is run on a computer.
PCT/IB2002/001962 2001-10-25 2002-05-31 Method and system for optimising the performance of a network WO2003037019A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US10/493,633 US20040266442A1 (en) 2001-10-25 2002-05-31 Method and system for optimising the performance of a network
EP02733097A EP1442623A1 (en) 2001-10-25 2002-05-31 Method and system for optimising the performance of a network

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EPPCT/EP01/12374 2001-10-25
PCT/EP2001/012374 WO2003037018A1 (en) 2001-10-25 2001-10-25 Method and system for optimising the performance of a network

Publications (1)

Publication Number Publication Date
WO2003037019A1 true WO2003037019A1 (en) 2003-05-01

Family

ID=8164652

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/EP2001/012374 WO2003037018A1 (en) 2001-10-25 2001-10-25 Method and system for optimising the performance of a network
PCT/IB2002/001962 WO2003037019A1 (en) 2001-10-25 2002-05-31 Method and system for optimising the performance of a network

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/012374 WO2003037018A1 (en) 2001-10-25 2001-10-25 Method and system for optimising the performance of a network

Country Status (2)

Country Link
CN (1) CN100348071C (en)
WO (2) WO2003037018A1 (en)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006058500A1 (en) * 2004-12-04 2006-06-08 Huawei Technologies Co., Ltd. A method for acquiring network key performance indicators and the key performance indicators groupware thereof
WO2008121062A1 (en) * 2007-03-29 2008-10-09 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for evaluating services in communication networks
WO2008155440A1 (en) * 2007-06-19 2008-12-24 Aito Technologies Oy An arrangement and a related method for providing business assurance in communication networks
WO2009008783A1 (en) * 2007-07-11 2009-01-15 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for determining service performance.
US7716592B2 (en) 2006-03-30 2010-05-11 Microsoft Corporation Automated generation of dashboards for scorecard metrics and subordinate reporting
US7716571B2 (en) 2006-04-27 2010-05-11 Microsoft Corporation Multidimensional scorecard header definition
CN1604040B (en) * 2003-09-29 2010-05-26 国际商业机器公司 Dynamic transaction control method and system within a host transaction processing system
US7769850B2 (en) 2004-12-23 2010-08-03 International Business Machines Corporation System and method for analysis of communications networks
US7840896B2 (en) 2006-03-30 2010-11-23 Microsoft Corporation Definition and instantiation of metric based business logic reports
US8081607B2 (en) * 2004-12-31 2011-12-20 Alcatel Lucent Method and system for operating a mobile communication network
EP2345942A3 (en) * 2010-01-06 2012-01-04 Yokogawa Electric Corporation Plant analysis system
WO2012062373A1 (en) * 2010-11-11 2012-05-18 Nokia Siemens Networks Oy Network management
US8190992B2 (en) 2006-04-21 2012-05-29 Microsoft Corporation Grouping and display of logically defined reports
US8261181B2 (en) 2006-03-30 2012-09-04 Microsoft Corporation Multidimensional metrics-based annotation
US8321805B2 (en) 2007-01-30 2012-11-27 Microsoft Corporation Service architecture based metric views
US8495663B2 (en) 2007-02-02 2013-07-23 Microsoft Corporation Real time collaboration using embedded data visualizations
EP2763349A1 (en) * 2013-02-05 2014-08-06 Telefonaktiebolaget L M Ericsson AB (Publ) Methods and Apparatus for Determining Improved Mobile Network Key Performance Indicators
WO2014202676A1 (en) * 2013-06-21 2014-12-24 Abb Technology Ag Commissioning system and method
US9058307B2 (en) 2007-01-26 2015-06-16 Microsoft Technology Licensing, Llc Presentation generation using scorecard elements
EP3301974A1 (en) * 2012-03-25 2018-04-04 Intucell Ltd. System and method for optimizing performance of a communication network
US20200059805A1 (en) * 2015-06-29 2020-02-20 Cisco Technology, Inc. Association rule analysis and data visualization for mobile networks

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7694307B2 (en) * 2003-05-15 2010-04-06 Sap Ag Analytical task invocation
US7360215B2 (en) 2003-05-15 2008-04-15 Sap Ag Application interface for analytical tasks
US7373633B2 (en) 2003-06-03 2008-05-13 Sap Ag Analytical application framework
US7370316B2 (en) 2003-06-03 2008-05-06 Sap Ag Mining model versioning
AU2003267894A1 (en) 2003-09-30 2005-04-14 Telefonaktiebolaget Lm Ericsson (Publ) Performance management of cellular mobile packet data networks
EP1530389A1 (en) * 2003-11-05 2005-05-11 Mitsubishi Electric Information Technology Centre Europe B.V. Method for optimization of a parameter or a set of parameters of a telecommunication network
CN1301624C (en) * 2004-01-15 2007-02-21 中兴通讯股份有限公司 Method of cellular mobile communication network performance data processing
FR2880506B1 (en) * 2005-01-06 2007-05-04 Evolium Sas Soc Par Actions Si METHOD AND SYSTEM FOR OPERATING A MOBILE COMMUNICATION CELLULAR NETWORK
FR2883446B1 (en) * 2005-03-17 2007-05-04 Evolium Sas Soc Par Actions Si WORKING STATION FOR ANALYZING AND OPTIMIZING A CELLULAR MOBILE TELECOMMUNICATION NETWORK
GB2430330B (en) * 2005-09-19 2010-03-10 Agilent Technologies Inc Allocation of a performance indicator among cells in a cellular communication system
FR2893476B1 (en) * 2005-11-14 2008-01-25 Radiotelephone Sfr METHOD AND SYSTEM FOR SIMULATION AND RESOURCE MANAGEMENT OF A MOBILE TELEPHONY NETWORK.
US8600384B1 (en) 2007-08-29 2013-12-03 Optimi Corporation Optimization of interlayer handovers in multilayer wireless communication networks
CN101420714B (en) * 2007-10-26 2012-05-30 摩托罗拉移动公司 Method for scheduling indicator for collecting key performance from communication network
DE102009054883A1 (en) * 2009-12-17 2011-06-22 Endress + Hauser Process Solutions Ag Method for optimization of connection parameter of transmission path between periphery-field access units and remotely arranged management system in process and fabrication system, involves providing parameter set to field access units
CN102801556B (en) * 2012-07-23 2015-02-18 中国联合网络通信集团有限公司 Network performance optimization method and device
CN102801586B (en) * 2012-08-28 2014-11-05 盛科网络(苏州)有限公司 Method and device for automatically testing quality of service (QoS) granularity and precision
CN107465526B (en) * 2016-06-03 2020-05-15 德科仕通信(上海)有限公司 Internet video CDN server quality monitoring system and method
CN108876078B (en) * 2017-05-10 2023-06-20 株式会社日立制作所 Method for calculating energy consumption system performance improvement strategy and energy consumption system monitoring device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5598532A (en) * 1993-10-21 1997-01-28 Optimal Networks Method and apparatus for optimizing computer networks
US5809282A (en) * 1995-06-07 1998-09-15 Grc International, Inc. Automated network simulation and optimization system
EP0889656A2 (en) * 1997-06-12 1999-01-07 Nortel Networks Corporation Real time control architecture for admission control in communications network
EP1098546A2 (en) * 1999-11-04 2001-05-09 Lucent Technologies Inc. Methods and apparatus for derivative based optimization of wireless network performance
EP1098544A2 (en) * 1999-11-04 2001-05-09 Lucent Technologies Inc. Road-based evaluation and interpolation of wireless network parameters

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5598532A (en) * 1993-10-21 1997-01-28 Optimal Networks Method and apparatus for optimizing computer networks
US5809282A (en) * 1995-06-07 1998-09-15 Grc International, Inc. Automated network simulation and optimization system
EP0889656A2 (en) * 1997-06-12 1999-01-07 Nortel Networks Corporation Real time control architecture for admission control in communications network
EP1098546A2 (en) * 1999-11-04 2001-05-09 Lucent Technologies Inc. Methods and apparatus for derivative based optimization of wireless network performance
EP1098544A2 (en) * 1999-11-04 2001-05-09 Lucent Technologies Inc. Road-based evaluation and interpolation of wireless network parameters

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1604040B (en) * 2003-09-29 2010-05-26 国际商业机器公司 Dynamic transaction control method and system within a host transaction processing system
CN100440796C (en) * 2004-12-04 2008-12-03 华为技术有限公司 Method for obtaining network key property indication and key property indication module
WO2006058500A1 (en) * 2004-12-04 2006-06-08 Huawei Technologies Co., Ltd. A method for acquiring network key performance indicators and the key performance indicators groupware thereof
US7769850B2 (en) 2004-12-23 2010-08-03 International Business Machines Corporation System and method for analysis of communications networks
US8081607B2 (en) * 2004-12-31 2011-12-20 Alcatel Lucent Method and system for operating a mobile communication network
US7716592B2 (en) 2006-03-30 2010-05-11 Microsoft Corporation Automated generation of dashboards for scorecard metrics and subordinate reporting
US7840896B2 (en) 2006-03-30 2010-11-23 Microsoft Corporation Definition and instantiation of metric based business logic reports
US8261181B2 (en) 2006-03-30 2012-09-04 Microsoft Corporation Multidimensional metrics-based annotation
US8190992B2 (en) 2006-04-21 2012-05-29 Microsoft Corporation Grouping and display of logically defined reports
US7716571B2 (en) 2006-04-27 2010-05-11 Microsoft Corporation Multidimensional scorecard header definition
US9058307B2 (en) 2007-01-26 2015-06-16 Microsoft Technology Licensing, Llc Presentation generation using scorecard elements
US8321805B2 (en) 2007-01-30 2012-11-27 Microsoft Corporation Service architecture based metric views
US9392026B2 (en) 2007-02-02 2016-07-12 Microsoft Technology Licensing, Llc Real time collaboration using embedded data visualizations
US8495663B2 (en) 2007-02-02 2013-07-23 Microsoft Corporation Real time collaboration using embedded data visualizations
WO2008121062A1 (en) * 2007-03-29 2008-10-09 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for evaluating services in communication networks
WO2008155440A1 (en) * 2007-06-19 2008-12-24 Aito Technologies Oy An arrangement and a related method for providing business assurance in communication networks
GB2467236A (en) * 2007-07-11 2010-07-28 Ericsson Telefon Ab L M Method and apparatus for determining service performance
WO2009008783A1 (en) * 2007-07-11 2009-01-15 Telefonaktiebolaget Lm Ericsson (Publ) Method and apparatus for determining service performance.
GB2467236B (en) * 2007-07-11 2011-08-17 Ericsson Telefon Ab L M Method and apparatus for determining service performance
EP2345942A3 (en) * 2010-01-06 2012-01-04 Yokogawa Electric Corporation Plant analysis system
WO2012062373A1 (en) * 2010-11-11 2012-05-18 Nokia Siemens Networks Oy Network management
JP2013545409A (en) * 2010-11-11 2013-12-19 ノキア シーメンス ネットワークス オサケユキチュア Network management
CN103190173B (en) * 2010-11-11 2017-03-22 诺基亚通信公司 Network management
CN103190173A (en) * 2010-11-11 2013-07-03 诺基亚西门子通信公司 Network management
KR101535138B1 (en) 2010-11-11 2015-07-24 노키아 솔루션스 앤드 네트웍스 오와이 Network management
US9198226B2 (en) 2010-11-11 2015-11-24 Nokia Solutions And Networks Oy Network management
EP3301974A1 (en) * 2012-03-25 2018-04-04 Intucell Ltd. System and method for optimizing performance of a communication network
US10440603B2 (en) 2012-03-25 2019-10-08 Cisco Technology, Inc. System and method for optimizing performance of a communication network
US10791478B2 (en) 2012-03-25 2020-09-29 Cisco Technology, Inc. System and method for optimizing performance of a communication network
EP2763349A1 (en) * 2013-02-05 2014-08-06 Telefonaktiebolaget L M Ericsson AB (Publ) Methods and Apparatus for Determining Improved Mobile Network Key Performance Indicators
WO2014202676A1 (en) * 2013-06-21 2014-12-24 Abb Technology Ag Commissioning system and method
US20200059805A1 (en) * 2015-06-29 2020-02-20 Cisco Technology, Inc. Association rule analysis and data visualization for mobile networks

Also Published As

Publication number Publication date
CN1575614A (en) 2005-02-02
CN100348071C (en) 2007-11-07
WO2003037018A1 (en) 2003-05-01

Similar Documents

Publication Publication Date Title
WO2003037019A1 (en) Method and system for optimising the performance of a network
US20040266442A1 (en) Method and system for optimising the performance of a network
US6226266B1 (en) End-to-end delay estimation in high speed communication networks
EP1499152B1 (en) Method and apparatus for adaptive and online assignment in hierarchical overlay networks
US8897795B2 (en) Method and apparatus for planning mobile switching centers in a wireless network
US7142523B1 (en) Methods and apparatus for design, adjustment or operation of wireless networks using pre-frequency-assignment optimization
US20100087195A1 (en) Adaptive Handover Apparatus And Method In A Heterogeneous Network Environment
US11997505B2 (en) Method and apparatus for CBRS network planning and operating in an enterprise network
US10098006B2 (en) Method and apparatus for planning base station controllers in a wireless network
Bakmaz et al. Network selection algorithm for heterogeneous wireless environment
Vassilakis et al. Quality of service differentiation in heterogeneous CDMA networks: a mathematical modelling approach
Asuquo et al. Analytic hierarchy process for QoS evaluation of mobile data networks
US8913497B2 (en) Method and apparatus for planning serving general packet radio service support nodes in a wireless network
EP1442623A1 (en) Method and system for optimising the performance of a network
Lindemann et al. Adaptive performance management for universal mobile telecommunications system networks
EP1561350A1 (en) A means and a method relating to optimization of network operation and planning
Samaan et al. Prediction-based policy adaptation for QoS management in wireless networks
Aguiar et al. A framework for the evaluation of converged mobile and wireless communication systems
Shu et al. FARIMA model based admission control to support QoS service in the networks with WiFi access
Chatterjee et al. Differentiated services in wireless data networks
UNG’AI Optimization of Handover Decisions for Multimedia Network Services Through Fuzzy Logic
Lawabni et al. Congestion relief in wireless LANs
Asuquo et al. Nov 7615cnc09
Fong Adaptive QoS resource management by using hierarchical distributed classification for future generation networks
Hamalainen et al. Statistical bandwidth allocation for multiservice networks

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2002733097

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 10493633

Country of ref document: US

Ref document number: 20028211200

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2002733097

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP