CN102904755B - Method and device for measuring quality of user experience of mobile-internet services - Google Patents

Method and device for measuring quality of user experience of mobile-internet services Download PDF

Info

Publication number
CN102904755B
CN102904755B CN201210374568.0A CN201210374568A CN102904755B CN 102904755 B CN102904755 B CN 102904755B CN 201210374568 A CN201210374568 A CN 201210374568A CN 102904755 B CN102904755 B CN 102904755B
Authority
CN
China
Prior art keywords
measured values
quality measured
type
key performance
performance indicator
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201210374568.0A
Other languages
Chinese (zh)
Other versions
CN102904755A (en
Inventor
寿国础
罗意
胡怡红
郭志刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN201210374568.0A priority Critical patent/CN102904755B/en
Publication of CN102904755A publication Critical patent/CN102904755A/en
Application granted granted Critical
Publication of CN102904755B publication Critical patent/CN102904755B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a method and a device for measuring quality of user experience of mobile-internet services. The method provided by the invention comprises the steps of setting at least three kinds of key performance indexes, wherein the key performance index belonging to the first type indicates the performance of a terminal; the key performance index belonging to the second type indicates the performance of a network; and the key performance index belonging to the third type indicates the performance of application services. The method comprises the steps of collecting at least three kinds of key performance indexes of a target mobile-internet service; respectively obtaining the quality measuring value of the corresponding type by using the collected key performance index of each type; and calculating the value of quality of user experience of the target mobile-internet service according to the quality measuring value of each type. According to the technical scheme provided by the invention, the value reflecting the quality of user experience of the mobile-internet services is measured accurately.

Description

A kind of mobile Internet business quality measurement of user experience method and apparatus
Technical field
The present invention relates to communication technical field, particularly relate to a kind of mobile Internet business user experience quality evaluating method and device.
Background technology
In recent years, along with development of Mobile Internet technology is fast-developing, mobile Internet business emerges in an endless stream, and has penetrated into the various aspects of people's life.Along with the fierceness day by day of mobile Internet application competition, the user experience quality (QoE, Quality ofExperience) for evaluating mobile Internet application quality quality is more and more subject to the attention of Virtual network operator and developer.
At present, the evaluating method of QoE mainly contains subjective evaluation method and method for objectively evaluating.Wherein, subjective evaluation method is wanted, directly from user awareness, to evaluate business exactly; But because subjective evaluation method will consider too many factor, at substantial time and manpower, be not thus used widely.In addition, existing method for objectively evaluating, great majority all concentrate in the research to network service, and most QoE method of measurement is set up for voice and video traffic, do not have general applicability for the application of general mobile Internet.And there is deviation in existing method of measurement, not accurate enough between the measured value measured and actual value, can not evaluate according to the user experience quality of measured value with regard to a certain mobile Internet business.
In sum, the objective evaluating method scope of application of existing QoE is narrower and can not accurately measure the numerical value of the user experience quality that can reflect mobile Internet business.
Summary of the invention
The invention discloses a kind of mobile Internet business quality measurement of user experience method, the method can accurately measure the numerical value of the user experience quality that can reflect various mobile Internet business.
The invention provides a kind of mobile Internet business quality measurement of user experience method, wherein, the Key Performance Indicator KPI of at least three types is set, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type, described method comprises:
Gather the Key Performance Indicator of the described at least three types of target mobile Internet business;
Quality measured values under utilizing the Key Performance Indicator under the every type collected to obtain respective type respectively, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value;
According to described all types of under quality measured values calculate the numerical value of the user experience quality of target mobile Internet business.
The invention also discloses a kind of mobile Internet business quality measurement of user experience device, this device can accurately measure the numerical value of the user experience quality that can reflect mobile Internet business.
Present invention also offers a kind of mobile Internet business quality measurement of user experience device, this device comprises: arrange module, Key Performance Indicator acquisition module, quality measured values computing module and user experience quality computing module; Wherein,
Module is set, for arranging the Key Performance Indicator of at least three types, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type;
Key Performance Indicator acquisition module, for gathering the Key Performance Indicator of at least three types described in target mobile Internet business and sending to quality measured values computing module;
Quality measured values computing module, for receiving the Key Performance Indicator that Key Performance Indicator acquisition module sends, the quality measured values under respective type is obtained respectively according to the Key Performance Indicator under the every type collected, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value;
User experience quality computing module, for calculating the numerical value of the user experience quality of target mobile Internet business according to the quality measured values under each type described.
In sum, technical scheme provided by the invention is by arranging polytype Key Performance Indicator, polytype Key Performance Indicator set by gathering when measuring also calculates corresponding quality measured values, calculated the technological means of the user experience quality numerical value of mobile Internet business by quality measured values, the numerical value of the user experience quality of reflection mobile Internet business can be accurately measured.
The embodiment of the present invention can the user experience quality of the current mobile Internet business of aspect entirety reflection such as from end side, network side and application service side, the measurement result obtained by the present invention and actual Consumer's Experience are closely, thus the measurement result that this programme can be utilized to obtain improves the correlated performance of mobile Internet business, improve user experience quality.
Accompanying drawing explanation
Fig. 1 is the flow chart of a kind of mobile Internet business user experience quality assessment method in the present invention;
Fig. 2 is the detail flowchart of a kind of quality measurement of user experience method in the present invention;
Fig. 3 is a kind of flow chart calculating nondimensionalization KPI weighted value in the present invention;
Fig. 4 is the level schematic diagram of the quality measurement of user experience in the present invention in a kind of specific embodiment;
Fig. 5 is the total weight value schematic diagram of the Key Performance Indicator in a kind of specific embodiment of the present invention;
Fig. 6 is a kind of mobile Internet business quality measurement of user experience device schematic diagram in the present invention.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with accompanying drawing, embodiment of the present invention is described further in detail.
A kind of mobile Internet business quality measurement of user experience scheme provided by the invention, the method evaluates and tests user experience quality by many factors such as integrated terminal performance, network performance and application service performances comprehensively.The numerical value of the user experience quality obtained by this programme measurement can reflect user in a network to the overall experience of concrete mobile Internet business.Virtual network operator and developer from the angle of self, can carry out QoE evaluation and test according to the present invention, improve the user experience quality of mobile Internet business, thus obtain advantage in keen competition.
In the embodiment of the present invention, the overall recognition degree of user to mobile Internet business is decided by QoE.Mobile Internet business QoE comprises QoT(Quality of Terminal), QoS(Quality ofService) and QoD(Quality of Development), the respectively Key Quality Indicator (KQI) of the terminal capabilities of map network, network performance and service end performance.
QoS represents the overall quality of service of the mobile network environment that Virtual network operator provides.QoS is the index evaluating universe network service quality from application point, depends on the network performance that Virtual network operator provides.Such as, send success rate, service building success rate etc. and all belong to QoS category.
QoD is the index weighing application performance.Relevant with the developer of application, different application developer for being different with a Develop Application System quality, thus causes user being different for user experience quality during different application programs.QoD comprises programming, algorithm, hardware etc.
QoT represents the intelligent terminal performance to QoE generation effect.QoT depends on the intelligent terminal performance that user uses, such as, and hardware performance, operating system etc.
Fig. 1 is the flow chart of a kind of mobile Internet business user experience quality assessment method in the present invention; As shown in Figure 1,
Step 101, the Key Performance Indicator of at least three types is set, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type.
Step 102, gathers the Key Performance Indicator of the described at least three types of target mobile Internet business.
Step 103, quality measured values under utilizing the Key Performance Indicator under the every type collected to obtain respective type respectively, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value.
Step 104, according to described all types of under quality measured values calculate the numerical value of the user experience quality of target mobile Internet business.
The method of measurement of a kind of user experience quality provided by the invention by measuring various types of Key Performance Indicator respectively, and calculates corresponding weighted value, draws the quality measured values of corresponding types; Calculate the weighted value corresponding with it according to described quality measured values, finally draw the measured value of the user experience quality of mobile Internet business.The invention provides the numerical value that method of measurement has the close actual user experience quality of the measured value got, and for different mobile Internet businesss, every Key Performance Indicator does not need to adjust, and only needs the weighted value adjusting some Key Performance Indicator, has more versatility.
In step 103 as described in Figure 1, the quality measured values under utilizing the Key Performance Indicator under the every type collected to obtain respective type respectively, can be specially: the KPI collected is converted to nondimensionalization KPI by nondimensionalization computing; According to step analysis mode, the weighted value of each nondimensionalization KPI under utilizing nondimensionalization KPI to calculate every type; The weighted value of nondimensionalization KPI and nondimensionalization KPI under every type is utilized to calculate corresponding quality measured values.
Under the every type of above-mentioned utilization, the weighted value of nondimensionalization KPI and nondimensionalization KPI calculates corresponding quality measured values, is specially: according to formula KQI i=ω 1× KPI 1+ ω 2× KPI 2+ ... + ω n× KPI ncalculate corresponding quality measured values; Wherein, KQI irepresent the quality measured values under the i-th type; KPI 1be the 1st nondimensionalization KPI, ω under the i-th type 1for with KPI 1corresponding weighted value; KPI 2be the 2nd nondimensionalization KPI, ω under the i-th type 2for with KPI 2corresponding weighted value; KPI nbe the n-th nondimensionalization KPI, ω under the i-th type nfor with KPI ncorresponding weighted value.
In step 104 as shown in Figure 1, calculate the numerical value of the user experience quality of target mobile Internet business according to the quality measured values under described all kinds, be specially: according to step analysis mode, calculate the weighted value of each quality measured values; The weighted value of described quality measured values and described quality measured values is utilized to calculate the numerical value of described user experience quality.
Calculate the numerical value of described user experience quality at the above-mentioned weighted value of described quality measured values and described quality measured values that utilizes, be specially: according to formula QoE=w 1× KQI 1+ w 2× KQI 2+ ... + w i× KQI icalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1for the quality measured values of the first kind, w 1for with KQI 1corresponding weighted value; KQI 2for the quality measured values of Second Type, w 2for with KQI 1corresponding weighted value; KQI ibe the quality measured values of the i-th type, w ifor with KQI icorresponding weighted value.
In specific embodiment in the present invention, described according to step analysis mode, utilize nondimensionalization KPI to calculate the weighted value of each nondimensionalization KPI under all kinds and comprise:
According to set deposit index table, by the nondimensionalization KPI of each type being compared respectively between two the performance index judgment matrix set up under described type, wherein, described deposit index table indicates the comparative result of two nondimensionalization KPI and the corresponding relation of judgment rule angle value, and described performance index judgment matrix is obtained by deposit index value;
Calculate the characteristic vector of described performance index judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as described all types of under the weighted value of nondimensionalization KPI;
In specific embodiment in the present invention, described according to step analysis mode, the weighted value calculating each quality measured values comprises:
According to set deposit index table, quality measured values judgment matrix is set up by being compared between two respectively by each quality measured values, wherein, described deposit index table indicates the comparative result of two quality measured values and the corresponding relation of judgment rule angle value, and described quality measured values judgment matrix is obtained by deposit index value;
Calculate the characteristic vector of described quality measured values judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of each quality measured values.
Normalization characteristic is vectorial in the weighted value of each element respectively as the nondimensionalization KPI under described all kinds before, described method also comprises:
Calculate the eigenvalue of maximum of described performance index judgment matrix;
Eigenvalue of maximum according to described performance index judgment matrix calculates Consistency Ratio, judges whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determines described normalization characteristic vector in each element be the weighted value of each nondimensionalization KPI under the type; If not, then not by described normalization characteristic vector in each element as the weighted value of nondimensionalization KPI each under the type;
Normalization characteristic is vectorial in the weighted value of each element respectively as each quality measured values before, described method also comprises:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix;
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, judges whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determines described normalization characteristic vector in each element be the weighted value of each quality measured values; If not, then not by described normalization characteristic vector in each element as the weighted value of each quality measured values.
In many mobile Internet businesss, instant messaging business has in real time, transmit the characteristics such as data type is many, interactivity is strong, user data is huge, representative in mobile Internet business.Hereafter using instant messaging as specific embodiment, the mode measured from terminal, network and application service performance three user experience qualities of aspect to instant messaging service describes idiographic flow of the present invention in detail.
Fig. 2 is the detail flowchart of a kind of quality measurement of user experience method in the present invention, as shown in Figure 2,
Step 201, arranges the Key Performance Indicator of three types.
In step 201, set three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type.
Wherein, the Key Performance Indicator belonging to terminal capabilities comprises: the cpu performance of terminal, i.e. the arithmetic speed of the CPU of this terminal.The memory consumption of terminal, namely uses the memory consumption ratio of terminal during the application software relevant to described mobile Internet business.The response time of terminal, when namely using terminal, by lower keyboard to time of screen display.The screen resolution of terminal, i.e. screen resolution.The operating system performance of terminal, the i.e. operating system that uses of terminal.
The Key Performance Indicator belonging to network performance comprises: send success rate, and the IM information that namely success sends accounts for the ratio of attempting transmission information.Message Time Delay, namely receives the time of IM information from source terminal transmission IM information to object terminal.Service building success rate, the successful number that namely user initiates to set up accounts for the ratio of sum.Business setup delay, namely user initiates to establish a connection to the time of successfully setting up.Message transmission rate, the i.e. speed of message when transmitting.
The Key Performance Indicator belonging to application service performance comprises: EMS memory occupation amount, namely serves user's mean consumption amount of ram.Service end maximum number of connections, the i.e. maximum number of connections that can support of server end.Server cpu performance, the i.e. arithmetic speed of server CPU.Critical task operation step, namely user completes the number of steps needed for mission critical.Data transfer overhead, the i.e. network traffics of unit of transfer's data consumes.
By tabulating as shown in table 1 after above-mentioned all types of Key Performance Indicator label:
Table 1
Step 202, gathers the Key Performance Indicator of indicating terminal performance, gathers the Key Performance Indicator of indication network performance, gathers the Key Performance Indicator of instruction application service performance.
In step 202., according to the every Key Performance Indicator shown in table 1, every Key Performance Indicator is measured, gather the measured value measured and draw Key Performance Indicator.
The various types of KPI collected are converted to nondimensionalization KPI by nondimensionalization computing by step 203.
In step 203, the actual measured value of the every KPI under the every type collected is converted to nondimensionalization KPI by nondimensionalization computing.
Described nondimensionalization computing comprises: linear nondimensionalization, curve nondimensionalization and broken line compound nondimensionalization.Linear nondimensionalization method refer to desired value and evaluation of estimate linear.Curve nondimensionalization method refers to desired value and the curved relation of evaluation of estimate.Wherein, linear nondimensionalization method comprises: standardization method, efficiency coefficient method and extremum method etc.
In a particular embodiment of the present invention, the mode of broken line compound nondimensionalization is adopted to carry out nondimensionalization computing.Be described for KPI-3, KPI-6, KPI-7, KPI-9 in table 1:
First, set up the nondimensionalization table of comparisons, in the described nondimensionalization table of comparisons, it is interval that the different measuring value interval for each KPI arranges corresponding hundred-mark system.As shown in table 2;
Table 2
According to nondimensionalization conversion formula: Q f = Q L + ( Q R - Q L ) × | P T - P L | P R - P L KPI under all kinds is converted to nondimensionalization KPI.Wherein, Q frepresent the value of nondimensionalization KPI, Q lthe left margin in hundred-mark system interval, nondimensionalization KPI place, Q rit is the right margin in hundred-mark system interval, nondimensionalization KPI place; P lthe left margin between the KPI location that collects, P rit is the right margin between the KPI location that collects; P tthe KPI collected.
Such as: the measured value of the response time collected is 35ms, then the nondimensionalization conversion formula of foundation table 2 and correspondence, can obtain Q f = Q L + ( Q R - Q L ) × | P T - P L | P R - P L = 70 + ( 80 - 70 ) × | 35 - 50 | 50 - 10 = 73.75 . Therefore, be the response time of 35ms for measured value, the value of the nondimensionalization KPI obtained through nondimensionalization computing is 73.75.
Step 204, according to step analysis mode, the weighted value of each nondimensionalization KPI under utilizing nondimensionalization KPI to calculate every type.
In step 204, first, according to set deposit index table, by the nondimensionalization KPI of each type being compared respectively between two the performance index judgment matrix set up under described type, wherein, described deposit index table indicates the comparative result of two nondimensionalization KPI and the corresponding relation of judgment rule angle value, and described performance index judgment matrix is obtained by deposit index value.
Secondly, the characteristic vector of described performance index judgment matrix is calculated
Again, to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of the nondimensionalization KPI under described all kinds.
After using step analysis mode to calculate weighted value, need the normalization characteristic vector to calculating carry out compatibility judgement.
In an embodiment of the present invention, to normalization characteristic vector the process of carrying out compatibility judgement is specially:
First, the eigenvalue of maximum of described performance index judgment matrix is calculated;
Then calculate Consistency Ratio according to the eigenvalue of maximum of described performance index judgment matrix, judge whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determine described normalization characteristic vector in each element be the weighted value of each nondimensionalization KPI under the type; If not, then not by described normalization characteristic vector in each element as the weighted value of nondimensionalization KPI each under the type.
Step 205, calculates corresponding quality measured values according to the weighted value of nondimensionalization KPI and nondimensionalization KPI.
In step 205, be specially according to formula KQI i=ω 1× KPI 1+ ω 2× KPI 2+ ... + ω n× KPI ncalculate corresponding quality measured values; Wherein, KQI irepresent the quality measured values under the i-th type; KPI 1be the 1st nondimensionalization KPI, ω under the i-th type 1for with KPI 1corresponding weighted value; KPI 2be the 2nd nondimensionalization KPI, ω under the i-th type 2for with KPI 2corresponding weighted value; KPI nbe the n-th nondimensionalization KPI, ω under the i-th type nfor with KPI ncorresponding weighted value.
For the every KPI listed by table 1, at KQI 1in, KPI 1be KPI-1, KPI 5be KPI-5; At KQI 2in, KPI 1for KPI-6, KPI 5be KPI-10; At KQI 3in, KPI 1be KPI-11, KPI 5be KPI-15.
According to above-mentioned formula, calculate the KQI of indicating terminal performance respectively 1, the KQI of indication network performance 2and the KQI of instruction application service performance 3.
Step 206, according to step analysis mode, calculates the weighted value of each quality measured values.
In step 206, first, according to set deposit index table, quality measured values judgment matrix is set up by being compared between two respectively by quality measured values, wherein, described deposit index table indicates the comparative result of two quality measured values and the corresponding relation of judgment rule angle value, and described quality measured values judgment matrix is obtained by deposit index value.
Secondly, the characteristic vector of described quality measured values judgment matrix is calculated to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of each quality measured values.
Step 207, calculates the numerical value of described user experience quality according to the weighted value of described quality measured values and quality measured values.
In step 207, according to formula QoE=w 1× KQI 1+ w 2× KQI 2+ w 3× KQI 3calculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1for the quality measured values of terminal capabilities, w 1for with KQI 1corresponding weighted value; KQI 2for the quality measured values of network performance, w 2for with KQI 1corresponding weighted value; KQI 3for the quality measured values of application service performance, w 3for with KQI 3corresponding weighted value.
Corresponding normalization characteristic vector is calculated in use step analysis mode afterwards, the normalization characteristic vector to calculating is needed carry out compatibility judgement.
In an embodiment of the present invention, to normalization characteristic vector carry out compatibility to judge to be specially:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix.
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, judges whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determines described normalization characteristic vector in each element be the weighted value of each quality measured values; If not, then not by described normalization characteristic vector in each element as the weighted value of each quality measured values.
Calculate in the process of the weighted value of every KPI in step 204 as shown in Figure 2, the weighted value needing to calculate respectively the KPI belonging to terminal capabilities, the weighted value belonging to the KPI of network performance and belong to the weighted value of KPI of service performance.
Be described in detail to calculate the weighted value that belongs to the KPI of network performance for specific embodiment below.
Fig. 3 is a kind of flow chart calculating nondimensionalization KPI weighted value in the present invention; As described in Figure 3,
Step 301, according to set deposit index table, sets up performance index judgment matrix by being compared between two respectively by the nondimensionalization KPI belonging to network performance, and wherein, table 3 is a kind of deposit index table in the present invention.It is as shown in table 3,
Table 3
Deposit index Definition Deposit index Definition
1 For H, a iAnd a jNo less important 7 For H, a iCompare a jMuch important
3 For H, a iCompare a jImportant a little 9 For H, a iCompare a jDefinitely important
5 For H, a iCompare a jImportant 2，4，6，8 Between above-mentioned two deposit index
The Key Performance Indicator being used to indicate network performance according to listed in table 1: send success rate, Message Time Delay, service building success rate, business setup delay and message transmission rate, using every Key Performance Indicator as X-axis and Y-axis, compare between two according to table 3, obtain table 4.Table 4 represents every Key Performance Indicator significance level between any two.Such as: for instant messaging, Message Time Delay is 4 relative to sending the judgement numerical value of success rate, namely Message Time Delay relative to the significance level sending success rate between important a little and important.
Table 4
Send success rate Message Time Delay Service building success rate Business setup delay Message transmission rate
Send success rate 1 4 3 5 4
Message Time Delay 1/4 1 1/2 4 3
Service building success rate 1/3 2 1 5 3
Business setup delay 1/5 1/4 1/5 1 1/3
Message transmission rate 1/4 1/3 1/3 3 1
Corresponding judgment matrix A is obtained according to table 4:
A = | 1 4 3 5 4 1 / 4 1 1 / 2 4 3 1 / 3 2 1 5 3 1 / 5 1 / 4 1 / 5 1 1 / 3 1 / 4 1 / 3 1 / 3 3 1 |
Step 302, according to performance index judgment matrix calculated characteristics vector.
In step 302, matrix A is described performance index judgment matrix; Contrast each element in this performance index judgment matrix, according to formula calculate characteristic vector wherein, i=1,2 ... n; Wherein, n is line number or the columns of matrix A, namely belongs to the quantity of the KPI of every type, in this embodiment, and n=5; The characteristic vector calculated ω → ( 0 ) = ( 2.9926,1.0844,1.5849,0.3196,0.6084 ) T .
Step 303, to characteristic vector be normalized and obtain normalization characteristic vector
In step 303, to vector ω → ( 0 ) = ( 2.9926,1.0844,1.5849,0.3196,0.6084 ) T Obtain after being normalized ω → ( 0 ) = ( 0 . 4541 , 0.1646,0.2405,0 . 0485 , 0.0923 ) T . Wherein, this normalization characteristic vector in element be followed successively by and send weighted value corresponding to success rate, Message Time Delay, service building success rate, business setup delay and message transmission rate.
Step 304, calculates eigenvalue of maximum according to performance index judgment matrix.
In step 304, according to formula λ max = 1 n [ Σ j = 1 n a 1 j ω j ω 1 + Σ j = 1 n a 2 j ω j ω 2 + . . . + Σ j = 1 n a nj ω j ω n ] Calculate corresponding eigenvalue of maximum, obtain eigenvalue of maximum λ max=5.2883.Wherein, n is line number or the columns of matrix A, namely belongs to the quantity of the KPI of every type, in this embodiment, and n=5
Step 305, calculates Consistency Ratio corresponding to this normalization characteristic vector according to the eigenvalue of maximum of described performance index judgment matrix, judges whether described Consistency Ratio is greater than predetermined threshold value.
In step 305, according to formula calculate corresponding Consistency Ratio C.I, judge whether Consistency Ratio is greater than predetermined threshold value, wherein, predetermined threshold value is 0.1.The actual Consistency Ratio obtained C . I = &lambda; max - n n - 1 = 0.2883 / 4 = 0.0721 < 0.10 . Because the value calculating C.I is greater than predetermined threshold value, then this normalization characteristic vector &omega; &RightArrow; = ( 0.4541,0.1646,0.2105,0.0485,0.0923 ) T In each element be the weighted value of each nondimensionalization KPI under the type.Namely for the Key Performance Indicator of indication network performance, wherein, the weighted value ω of success rate is sent 1=0.4541, the weighted value ω of Message Time Delay 2=0.1646, the weighted value ω of service building success rate 3=0.2405, the weighted value ω of business setup delay 3=0.0485, message transmission rate ω 5=0.0923.
By the weighted value of the KPI of workflow management indicating terminal performance as shown in Figure 3, below omit detailed process, show that the characteristic vector of the weighted value of the KPI of indicating terminal performance is: &omega; &RightArrow; = ( 0.3089,0.0930,0.3594,0.0730,0.1657 ) T
By the weighted value of the KPI of workflow management instruction application service performance as shown in Figure 3, below omit detailed process, show that the characteristic vector of the weighted value of the KPI of instruction application service performance is: &omega; &RightArrow; ( 0.0543,0.0879,0.1800,0.4083,0.2694 ) T
The weighted value of each quality measured values is indicated by workflow management as shown in Figure 3, below omit detailed process, show that the characteristic vector of the weighted value of the quality measured values of the quality measured values of indicating terminal performance, indication network performance and the quality measured values of instruction application service is: namely the weighted value of the quality measured values of terminal capabilities is 0.1365; The weighted value of the quality measured values of network performance is 0.6250; The weighted value of the quality measured values of application service is 0.2385.According to formula QoE=w 1× KQI 1+ w 2× KQI 2+ w 3× KQI 3calculate should the user experience quality of instant messaging.
Fig. 4 is the level schematic diagram of the quality measurement of user experience in the present invention in a kind of specific embodiment.As shown in Figure 4, in the concrete mobile Internet business of instant messaging, the user experience quality for this mobile Internet business comprises the quality measured values of the quality measured values of terminal capabilities, the quality measured values of network performance and application service performance.Wherein, the quality measured values of described terminal capabilities, is calculated by Key Performance Indicators such as cpu performance, memory consumption, response time, screen resolution, operating system performances; The quality measured values of described network performance, calculates by sending the Key Performance Indicators such as success rate, descending time delay, service building success rate, business setup delay, message transmission rate; The quality measured values of application service performance is calculated by Key Performance Indicators such as EMS memory occupation amount, service end maximum number of connections, server cpu performance, critical task operation step, data transfer overhead.
By the total weight value that the weighted value of Key Performance Indicator every in table 1 and the weighted value of type belonging to it obtain after being multiplied, described total weight value is depicted as block diagram, as shown in Figure 5.Fig. 5 is the total weight value schematic diagram of the Key Performance Indicator in a kind of specific embodiment of the present invention.In Figure 5, X-axis represents the numbering of every KPI in table 1, and Y-axis is the total weight value corresponding with every KPI; Described total weight value to be multiplied with the weighted value of quality measured values belonging to this KPI by the weighted value of every KPI and to obtain.Total weight value as KPI-1 is ω 1× w 1.In Figure 5, can find out that namely KPI-6 sends the total weight value of success rate the highest, namely can be understood as instant messaging, send success rate for the most important Consumer's Experience.
In use, the present invention carries out in the process of quality measurement of user experience, can according to the total weight value of the every Key Performance Indicator calculated, improve the user experience quality of a certain business targetedly, if namely want to improve the user experience quality with a certain mobile Internet business, can by improving the large Key Performance Indicator of total weight value, the mode then optimizing other Key Performance Indicators improves.Namely by improving the mode of the high Key Performance Indicator of weighted value, with less cost, significantly user experience quality is improved.
When using the present invention to carry out the measurement of the user experience quality of mobile Internet business, the actual mass of current mobile Internet business can be understood according to the numerical value measuring the user experience quality obtained.The user experience quality of the current mobile Internet business reflected by this numerical value is not simply outstanding or good, but from always reflecting the user experience quality of current mobile Internet business on the whole.
In addition, in other embodiments of the invention, for different mobile Internet businesss, only need, by adjusting the weighted value between each KPI, realize operating the measurement of the user experience quality of different mobile Internet business.Such as, for the Mobile solution that terminal dependence is not strong, as speech business, short message service etc., can be set to 0 by the weighted value of indicating terminal performance.For the Mobile solution that mesh dependence is not strong, as single-play game, local video player etc., the weighted value of indication network performance can be set to 0.Namely the present invention can adjust corresponding weighted value according to mobile Internet business for the different degrees of dependence of terminal, network and application service respectively, and what make mobile Internet business quality measurement of user experience method provided by the present invention has versatility.
Present invention also offers a kind of mobile Internet business quality measurement of user experience device, see Fig. 6, this device comprises: arrange module 601, Key Performance Indicator acquisition module 602, quality measured values computing module 603 and user experience quality computing module 604; Wherein,
Module 601 is set, for arranging the Key Performance Indicator of at least three types, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type;
Key Performance Indicator acquisition module 602, for gathering the Key Performance Indicator of at least three types described in target mobile Internet business and sending to quality measured values computing module 603;
Quality measured values computing module 603, for receiving the Key Performance Indicator that Key Performance Indicator acquisition module 602 sends, the quality measured values under respective type is obtained respectively according to the Key Performance Indicator under the every type collected, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value;
User experience quality computing module 604, for calculating the numerical value of the user experience quality of target mobile Internet business according to the quality measured values under each type described.
In said apparatus, quality measured values computing module 603, is converted to nondimensionalization KPI for collecting KPI by nondimensionalization computing; According to step analysis mode, the weighted value of each nondimensionalization KPI under utilizing nondimensionalization KPI to calculate every type; According to following formula, the weighted value of nondimensionalization KPI and nondimensionalization KPI under every type is utilized to calculate described quality measured values:
KQI i=ω 1× KPI 1+ ω 2× KPI 2+ ... + ω n× KPI ncalculate corresponding quality measured values; Wherein, KQI irepresent the quality measured values under the i-th type; KPI 1be the 1st nondimensionalization KPI, ω under the i-th type 1for with KPI 1corresponding weighted value; KPI 2be the 2nd nondimensionalization KPI, ω under the i-th type 2for with KPI 2corresponding weighted value; KPI nbe the n-th nondimensionalization KPI, ω under the i-th type nfor with KPI ncorresponding weighted value;
User experience quality computing module 604, for according to step analysis mode, calculates the weighted value of each quality measured values; According to following formula, the weighted value of described quality measured values and quality measured values is utilized to calculate the numerical value of described user experience quality:
QoE=w 1× KQI 1+ w 2× KQI 2+ ... + w i× KQI icalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1for the quality measured values of the first kind, w 1for with KQI 1corresponding weighted value; KQI 2for the quality measured values of Second Type, w 2for with KQI 1corresponding weighted value; KQI ibe the quality measured values of the i-th type, w ifor with KQI icorresponding weighted value.
In said apparatus, quality measured values computing module 603, for according to set deposit index table, by the nondimensionalization KPI of each type being compared respectively between two the performance index judgment matrix set up under described type, wherein, described performance index deposit index table indicates the comparative result of two nondimensionalization KPI and the corresponding relation of judgment rule angle value, and described performance index judgment matrix is obtained by deposit index value; Calculate the characteristic vector of described performance index judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as described all types of under the weighted value of nondimensionalization KPI;
User experience quality computing module 604, for according to set deposit index table, judgment matrix is set up by being compared between two respectively by each quality measured values, wherein, described deposit index table indicates the comparative result of two quality measured values and the corresponding relation of judgment rule angle value, and described quality measured values judgment matrix is obtained by deposit index value; Calculate the characteristic vector of described quality measured values judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of each quality measured values.
In apparatus of the present invention embodiment, the specific works mode of each module see the related content of embodiment of the method for the present invention, can not repeat them here.
In sum, technical scheme provided by the invention is by arranging polytype Key Performance Indicator, polytype Key Performance Indicator set by gathering when measuring also calculates corresponding quality measured values, calculated the technological means of the user experience quality numerical value of mobile Internet business by quality measured values, the numerical value of the user experience quality of reflection mobile Internet business can be accurately measured.
The embodiment of the present invention can the user experience quality of the current mobile Internet business of aspect entirety reflection such as from end side, network side and application service side, the measurement result obtained by the present invention and actual Consumer's Experience are closely, thus the measurement result that this programme can be utilized to obtain improves the correlated performance of mobile Internet business, improve user experience quality.
The foregoing is only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.

Claims (9)

1. a mobile Internet business quality measurement of user experience method, it is characterized in that, the Key Performance Indicator of at least three types is set, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type, described method comprises:
Gather the Key Performance Indicator of the described at least three types of target mobile Internet business;
Quality measured values under utilizing the Key Performance Indicator under the every type collected to obtain respective type respectively, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value;
According to described all types of under quality measured values calculate the numerical value of the user experience quality of target mobile Internet business;
The quality measured values that Key Performance Indicator under every type that described utilization collects obtains under respective type respectively comprises:
The Key Performance Indicator collected is converted to nondimensionalization Key Performance Indicator by nondimensionalization computing;
According to step analysis mode, the weighted value of each nondimensionalization Key Performance Indicator under utilizing nondimensionalization Key Performance Indicator to calculate every type;
The weighted value of nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator under every type is utilized to calculate described quality measured values;
Described according to step analysis mode, under utilizing nondimensionalization Key Performance Indicator to calculate every type, the weighted value of each nondimensionalization Key Performance Indicator comprises:
According to set deposit index table, by the nondimensionalization Key Performance Indicator of each type being compared respectively between two the performance index judgment matrix set up under described type, wherein, described deposit index table indicates the comparative result of two nondimensionalization Key Performance Indicators and the corresponding relation of judgment rule angle value, and described performance index judgment matrix is obtained by deposit index value;
Calculate the characteristic vector of described performance index judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as described all types of under the weighted value of nondimensionalization Key Performance Indicator.
2. method according to claim 1, is characterized in that, under the every type of described utilization, the weighted value of nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator calculates described quality measured values and comprises:
According to formula KQI i=ω 1× KPI 1+ ω 2× KPI 2+ ... + ω n× KPI ncalculate corresponding quality measured values; Wherein, KQI irepresent the quality measured values under the i-th type; KPI 1be the 1st nondimensionalization Key Performance Indicator under the i-th type, ω 1for with KPI 1corresponding weighted value; KPI 2be the 2nd nondimensionalization Key Performance Indicator under the i-th type, ω 2for with KPI 2corresponding weighted value; KPI nbe the n-th nondimensionalization Key Performance Indicator under the i-th type, ω nfor with KPI ncorresponding weighted value.
3. method according to claim 1, is characterized in that, the described numerical value calculating the user experience quality of target mobile Internet business according to the quality measured values under all types of comprises:
According to step analysis mode, calculate the weighted value of each quality measured values;
The weighted value of described quality measured values and described quality measured values is utilized to calculate the numerical value of described user experience quality.
4. method according to claim 3, is characterized in that, the described numerical value utilizing the weighted value of described quality measured values and described quality measured values to calculate described user experience quality comprises:
According to formula QoE=w 1× KQI 1+ w 2× KQI 2+ ... + w i× KQI icalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1for the quality measured values of the first kind, w 1for with KQI 1corresponding weighted value; KQI 2for the quality measured values of Second Type, w 2for with KQI 1corresponding weighted value; KQI ibe the quality measured values of the i-th type, w ifor with KQI icorresponding weighted value.
5. method according to claim 3, is characterized in that,
Described according to step analysis mode, the weighted value calculating each quality measured values comprises:
According to set deposit index table, quality measured values judgment matrix is set up by being compared between two respectively by each quality measured values, wherein, described deposit index table indicates the comparative result of two quality measured values and the corresponding relation of judgment rule angle value, and described quality measured values judgment matrix is obtained by deposit index value;
Calculate the characteristic vector of described quality measured values judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of each quality measured values.
6. method according to claim 5, is characterized in that,
Normalization characteristic is vectorial in each element respectively as described all types of under nondimensionalization Key Performance Indicator weighted value before, described method also comprises:
Calculate the eigenvalue of maximum of described performance index judgment matrix;
Eigenvalue of maximum according to described performance index judgment matrix calculates Consistency Ratio, judges whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determines described normalization characteristic vector in each element be the weighted value of each nondimensionalization Key Performance Indicator under the type; If not, then not by described normalization characteristic vector in each element as the weighted value of nondimensionalization Key Performance Indicator each under the type;
Normalization characteristic is vectorial in the weighted value of each element respectively as each quality measured values before, described method also comprises:
Calculate the eigenvalue of maximum of described quality measured values judgment matrix;
Eigenvalue of maximum according to described quality measured values judgment matrix calculates Consistency Ratio, judges whether the numerical value of described Consistency Ratio is greater than predetermined threshold, if so, determines described normalization characteristic vector in each element be the weighted value of each quality measured values; If not, then not by described normalization characteristic vector in each element as the weighted value of each quality measured values.
7. a mobile Internet business quality measurement of user experience device, is characterized in that, this device comprises: arrange module, Key Performance Indicator acquisition module, quality measured values computing module and user experience quality computing module; Wherein,
Module is set, for arranging the Key Performance Indicator of at least three types, described three types comprises the first kind, Second Type and the 3rd type, belong to the Key Performance Indicator indicating terminal performance of the first kind, belong to the Key Performance Indicator indication network performance of Second Type, belong to the Key Performance Indicator instruction application service performance of the 3rd type;
Key Performance Indicator acquisition module, for gathering the Key Performance Indicator of at least three types described in target mobile Internet business and sending to quality measured values computing module;
Quality measured values computing module, for receiving the Key Performance Indicator that Key Performance Indicator acquisition module sends, the quality measured values under respective type is obtained respectively according to the Key Performance Indicator under the every type collected, wherein, quality measured values under the first kind got is terminal quality measured value, quality measured values under the Second Type got is network quality measured value, and the quality measured values under the 3rd type got is application service quality measured value;
User experience quality computing module, for calculating the numerical value of the user experience quality of target mobile Internet business according to the quality measured values under each type described;
Described quality measured values computing module, is converted to nondimensionalization Key Performance Indicator for collecting Key Performance Indicator by nondimensionalization computing; According to step analysis mode, the weighted value of each nondimensionalization Key Performance Indicator under utilizing nondimensionalization Key Performance Indicator to calculate every type;
And for according to set deposit index table, by the nondimensionalization Key Performance Indicator of each type being compared respectively between two the performance index judgment matrix set up under described type, wherein, described performance index deposit index table indicates the comparative result of two nondimensionalization Key Performance Indicators and the corresponding relation of judgment rule angle value, and described performance index judgment matrix is obtained by deposit index value; Calculate the characteristic vector of described performance index judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as described all types of under the weighted value of nondimensionalization Key Performance Indicator.
8. device according to claim 7, is characterized in that,
Described quality measured values computing module, according to following formula, utilizes the weighted value of nondimensionalization Key Performance Indicator and nondimensionalization Key Performance Indicator under every type to calculate described quality measured values:
KQI i=ω 1× KPI 1+ ω 2× KPI 2+ ... + ω n× KPI ncalculate corresponding quality measured values; Wherein, KQI irepresent the quality measured values under the i-th type; KPI 1be the 1st nondimensionalization Key Performance Indicator under the i-th type, ω 1for with KPI 1corresponding weighted value; KPI 2be the 2nd nondimensionalization Key Performance Indicator under the i-th type, ω 2for with KPI 2corresponding weighted value; KPI nbe the n-th nondimensionalization Key Performance Indicator under the i-th type, ω nfor with KPI ncorresponding weighted value;
Described user experience quality computing module, for according to step analysis mode, calculates the weighted value of each quality measured values; According to following formula, the weighted value of described quality measured values and quality measured values is utilized to calculate the numerical value of described user experience quality:
QoE=w 1× KQI 1+ w 2× KQI 2+ ... + w i× KQI icalculate the numerical value of corresponding user experience quality; Wherein, QoE represents the numerical value of user experience quality; KQI 1for the quality measured values of the first kind, w 1for with KQI 1corresponding weighted value; KQI 2for the quality measured values of Second Type, w 2for with KQI 1corresponding weighted value; KQI ibe the quality measured values of the i-th type, w ifor with KQI icorresponding weighted value.
9. device according to claim 8, is characterized in that,
User experience quality computing module, for according to set deposit index table, judgment matrix is set up by being compared between two respectively by each quality measured values, wherein, described deposit index table indicates the comparative result of two quality measured values and the corresponding relation of judgment rule angle value, and described quality measured values judgment matrix is obtained by deposit index value; Calculate the characteristic vector of described quality measured values judgment matrix to characteristic vector be normalized and obtain normalization characteristic vector by normalization characteristic vector in each element respectively as the weighted value of each quality measured values.
CN201210374568.0A 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services Expired - Fee Related CN102904755B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210374568.0A CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210374568.0A CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Publications (2)

Publication Number Publication Date
CN102904755A CN102904755A (en) 2013-01-30
CN102904755B true CN102904755B (en) 2015-03-11

Family

ID=47576804

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210374568.0A Expired - Fee Related CN102904755B (en) 2012-09-27 2012-09-27 Method and device for measuring quality of user experience of mobile-internet services

Country Status (1)

Country Link
CN (1) CN102904755B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3863223A4 (en) * 2018-10-17 2021-12-08 Wangsu Science & Technology Co., Ltd. Method and device for training service quality evaluation model

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101561420B1 (en) * 2014-09-04 2015-10-22 주식회사 케이티 Internet Connection Test Device And Method thereof
CN104394027B (en) * 2014-10-20 2018-05-15 上海海旭软件有限公司 A kind of network quality detection method and device based on metadata
CN107666403B (en) * 2016-07-29 2022-01-28 中兴通讯股份有限公司 Index data acquisition method and device
CN108270606B (en) * 2016-12-31 2021-06-04 中国移动通信集团湖北有限公司 Service quality prediction method and service quality prediction device
CN108334440A (en) * 2017-01-19 2018-07-27 阿里巴巴集团控股有限公司 A kind of processing method and processing device, client obtaining application performance test result
CN106899448B (en) * 2017-01-22 2019-06-28 中国人民解放军信息工程大学 Suitable for network state and the integrated dynamic weight index appraisal procedure of performance measurement
CN111626640A (en) * 2020-06-08 2020-09-04 中煤科工集团重庆研究院有限公司 Coal mine safety comprehensive risk evaluation method and system based on neutral reference object

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104900A (en) * 2011-01-27 2011-06-22 大唐移动通信设备有限公司 Method and equipment for analyzing user perception
CN102143507A (en) * 2010-11-23 2011-08-03 北京中创信测科技股份有限公司 Method and system for monitoring service quality, and analytical method and system therefor
CN102457399A (en) * 2010-10-20 2012-05-16 中兴通讯股份有限公司 Service quality monitoring method based on QOE and system thereof
CN102685790A (en) * 2012-05-22 2012-09-19 北京东方文骏软件科技有限责任公司 Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102457399A (en) * 2010-10-20 2012-05-16 中兴通讯股份有限公司 Service quality monitoring method based on QOE and system thereof
CN102143507A (en) * 2010-11-23 2011-08-03 北京中创信测科技股份有限公司 Method and system for monitoring service quality, and analytical method and system therefor
CN102104900A (en) * 2011-01-27 2011-06-22 大唐移动通信设备有限公司 Method and equipment for analyzing user perception
CN102685790A (en) * 2012-05-22 2012-09-19 北京东方文骏软件科技有限责任公司 Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3863223A4 (en) * 2018-10-17 2021-12-08 Wangsu Science & Technology Co., Ltd. Method and device for training service quality evaluation model

Also Published As

Publication number Publication date
CN102904755A (en) 2013-01-30

Similar Documents

Publication Publication Date Title
CN102904755B (en) Method and device for measuring quality of user experience of mobile-internet services
CN101572623B (en) Method for comprehensively evaluating network performance based on subjective and objective combination evaluation
CN104023232B (en) Based on the mobile video method for evaluating quality of step analysis and multiple linear regression
CN105357691A (en) LTE (Long Term Evolution) wireless network user sensitive monitoring method and system
CN102685790B (en) Method for evaluating QoE (Quality of Experience) of mobile streaming media service perception experience by simulating user behaviors
CN108337656B (en) Mobile crowd sensing excitation method
CN102685791B (en) Method for evaluating user quality of experience (QoE) of WAP (Wireless Application Protocol) services by simulating user behavior
CN105207821B (en) A kind of network synthesis performance estimating method of service-oriented
CN104618924B (en) User experience quality index system and measurement method based on wireless ubiquitous network
CN105050125A (en) Method and device for evaluating mobile data service quality oriented to user experience
CN104378220A (en) Method, device, user terminal and network server for evaluating user experience quality
CN108495329A (en) A kind of evaluation method and device of base station reliability
CN103152599A (en) Mobile video service user experience quality evaluation method based on ordinal regression
CN111586729A (en) Three-network signal detection method and system based on metering terminal communication
CN106656603A (en) Cloud service trust evaluation method based on multi-parameter interval number multi-attribute decision-making
CN111861246B (en) Rail transit energy-saving assessment method and system based on space-time big data
CN110035393A (en) The recognition methods of mobile terminal relationship
CN114240031A (en) 5G network bearing quality evaluation method facing power service
CN109982368A (en) The azimuthal check method of cell, device, equipment and medium
US7797136B2 (en) Metrics to evaluate process objects
CN105678456B (en) Method and system for automatically evaluating running state of electric energy metering device
CN110147966A (en) Enterprise operation data quality management method
CN102930346B (en) A kind of SOA service MTBF Forecasting Methodology
CN105898766A (en) Base station planning method and apparatus
WO2019239004A1 (en) Method for determining a performance indicator of a wireless telecommunications network

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150311

Termination date: 20210927