WO2016101464A1

WO2016101464A1 - Quality of experience estimation method, device, terminal and server

Info

Publication number: WO2016101464A1
Application number: PCT/CN2015/077428
Authority: WO
Inventors: 张琳; 望育梅; 向彬; 尹彦龙; 任志远; 陈池; 周娜
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-12-26
Filing date: 2015-04-24
Publication date: 2016-06-30
Also published as: CN105791046A

Abstract

Provided are a quality of experience (QoE) estimation method, device, terminal and server, the method comprising: acquiring an estimation parameter configured to estimate the QoE, the estimation parameter comprising at least one of the following information: a network data packet generated by an application in a terminal during the use thereof, an index parameter of the application in a network layer and an application layer, attribute information of the terminal, related social attribute information of the user and an opinion score for the application; transmitting the obtained estimation parameter to a server configured to establish a QoE estimation model; acquiring the QoE estimation model transmitted by the server and established according to the estimation parameter; and estimating the QoE of the application according to the QoE estimation model. The present invention addresses the problems in the related technology of high complexity of estimation, low accuracy and poor user experience caused by an existing QoE estimation method, thus simplifying estimation for QoE, providing more accurate QoE estimation and improving user experiences.

Description

User experience quality QoE evaluation method, device, terminal and server

Technical field

The present invention relates to the field of communications, and in particular, to a user experience quality QoE evaluation method, apparatus, terminal, and server.

Background technique

In recent years, the technology of mobile Internet has developed rapidly, and mobile terminal applications have emerged one after another. When they bring convenience to users, they also bring a certain degree of pressure to the mobile network, which makes the quality of terminal applications decline. In order to support the rapidly growing variety of end applications, application developers' development investments and operators' investments in network infrastructure deployments have increased. How to maintain the efficiency of network investment while improving the user experience to obtain a larger user base has become an important topic.

Intense market competition has made developers, network operators and service providers aware that improving end-user satisfaction is the key to expanding user size and achieving profitability. Therefore, it is a key step to evaluate the user's satisfaction with the mobile terminal application and ensure that the service can be recognized by the user. The International Telecommunication Union Standardization Organization defines an indicator that measures the user's subjective feelings, namely Quality of Experience (QoE), which refers to “the overall acceptability of an application or service perceived by the end user”. QoE measurement of mobile Internet services is highly valued by network operators and service providers. Accurately evaluating the QoE of related applications has guiding significance for network optimization and development and adjustment of terminal applications. The end result is a better experience for users and greater profits for operators and service providers.

However, there are many problems in evaluating the user QoE of the terminal application in the mobile network environment. In related technologies and theories, the evaluation of QoE is for the evaluation of a certain business, ignoring the evaluation of mobile applications. In its evaluation system, the evaluation indicators involved are all parameter indicators of the network layer. However, the network layer indicators have limitations on the evaluation of user QoE. It is necessary to obtain more indicators of application characteristics, so that QoE evaluation can be closer to the user experience.

At the same time, in the relevant technologies and theories, the evaluation of the main QoE is carried out in a fixed-line environment. Due to the differences in the QoE evaluation indicators between the mobile network environment and the fixed network and the large differences in user data collection, the existing Many of the QoE evaluation models are not directly usable.

There are several evaluation schemes in the related technologies, which are 1) QoE evaluation algorithm for a certain business scenario [201410301467.X, mobile video quality assessment based on analytic hierarchy process and multiple linear regression) Method], 2) Make relevant QoE analysis from the network level for different services in the fixed network environment [201310057840.7, network QoS and QoE measurement and mapping relationship analysis platform], 3) for some specific services, through artificial simulation services The environment to experimentally analyze the QoE of a specific service [201310045069.1, the user experience quality evaluation method of mobile video service based on ordered regression], but the above solutions in the related art respectively have the following problems:

1) Propose relevant evaluation algorithms for certain business scenarios, and only consider improving the performance of QoE analysis through algorithm design. In fact, the most important influencing factor is QoE evaluation index. At the same time, most of the algorithms are too complicated, the accuracy is low, the performance improvement space is small, the flexibility is poor, and the scalability is not strong.

2) Only the fixed network environment is considered, and the mobile network environment is not analyzed. At the same time, only QoE analysis from the network level can only reflect the underlying network performance, and can not truly reflect the user's actual experience perception.

3) Experimental analysis for specific services only stays at the level of simulation and cannot be used for passive monitoring and analysis of real application scenarios.

The QoE evaluation method existing in the related technology may have problems of complicated evaluation, low accuracy, and low user experience, and no effective solution has been proposed yet.

Summary of the invention

The embodiment of the present invention provides a user experience quality QoE evaluation method, device, terminal, and server, so as to solve at least the problem that the QoE evaluation method existing in the related technology has a complicated evaluation, low accuracy, and low user experience.

According to an embodiment of the present invention, a user experience quality QoE evaluation method is provided, including: acquiring an evaluation parameter set to evaluate a QoE, wherein the evaluation parameter includes at least one of the following information: an application in the terminal is a network data packet generated during use, a network layer of the application, and an indicator parameter in the application layer, attribute information of the terminal, user related social attribute information, and a rating of the application; the evaluation to be obtained The parameter is sent to a server set up to establish a QoE evaluation model; the QoE evaluation model sent by the server according to the evaluation parameter is obtained; and the application is QoE evaluated according to the QoE evaluation model.

When the evaluation parameter includes an indicator parameter in the network layer and the application layer of the application, sending the obtained evaluation parameter to the server configured to establish the QoE evaluation model includes: from a network layer of the application The key indicator parameters affecting the QoE are extracted from the indicator parameters in the application layer; and the extracted key indicator parameters are sent to the server.

The indicator parameters in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, a traffic, and an indicator in the application layer. The parameters include at least one of the following: page load delay, rich media load delay, page blank latency, resource popularity, inventory usage, battery consumption rate, application security factor, and transaction latency.

According to another embodiment of the present invention, a user experience quality QoE evaluation method is further provided, comprising: receiving, by the terminal, an evaluation parameter set to evaluate the QoE, wherein the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal, an indicator parameter in the network layer and the application layer of the application, attribute information of the terminal, user related social attribute information, and a rating of the application; The received evaluation parameter establishes a QoE evaluation model set to perform QoE evaluation on the application; the established QoE evaluation model is sent to the terminal.

After the receiving terminal sends the evaluation parameter set to evaluate the QoE, it further includes at least one of: classifying and storing the received evaluation parameter; and backing up the evaluation parameter.

According to another embodiment of the present invention, a user experience quality QoE evaluation apparatus is provided, including: a first acquisition module, configured to acquire an evaluation parameter set to evaluate a QoE, wherein the evaluation parameter includes at least the following information: One: a network data packet generated by an application in the terminal during use, an indicator parameter in a network layer and an application layer of the application, attribute information of the terminal, user related social attribute information, and an opinion on the application a first sending module, configured to send the obtained evaluation parameter to a server configured to establish a QoE evaluation model, and a second obtaining module configured to acquire the QoE generated by the server according to the evaluation parameter An evaluation model; an evaluation module configured to perform a QoE assessment of the application based on the QoE assessment model.

When the evaluation parameter includes an indicator parameter in the network layer and the application layer of the application, the first sending module includes: an extracting unit, configured to extract from an indicator parameter in a network layer and an application layer of the application A key indicator parameter affecting the QoE; the sending unit is configured to send the extracted key indicator parameter to the server.

The indicator parameters set in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transfer protocol HTTP response delay, a network speed, and a traffic; the application The indicator parameters in the layer include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, and transaction delay.

According to another embodiment of the present invention, there is provided a terminal comprising the apparatus of any of the above.

According to another embodiment of the present invention, there is also provided a user experience quality QoE evaluation apparatus, comprising: a receiving module, configured to receive an evaluation parameter sent by the terminal and configured to evaluate the QoE, wherein the evaluation parameter includes the following: At least one of the information: a network data packet generated by the application in the terminal during use, an indicator parameter in the network layer and the application layer of the application, attribute information of the terminal, user-related social attribute information, and the application a rating module; a setting module configured to establish a QoE evaluation model set to perform QoE evaluation on the application according to the received evaluation parameter; and a second sending module configured to send the established QoE evaluation model to the terminal.

The user experience quality QoE evaluation apparatus further includes at least one of the following: a storage module configured to classify and store the received evaluation parameters; and a backup module configured to back up the evaluation parameters.

According to another embodiment of the present invention, there is provided a server comprising the apparatus of any of the above.

According to an embodiment of the present invention, an evaluation parameter that is set to evaluate the QoE is obtained, where the evaluation parameter includes at least one of the following information: a network data packet generated by an application in the terminal during use, and a network of the application. An indicator parameter in the layer and the application layer, attribute information of the terminal, user-related social attribute information, and a rating of the application; and the obtained evaluation parameter is sent to a server set to establish a QoE evaluation model; Determining, by the server, the QoE evaluation model established according to the evaluation parameter; performing QoE evaluation on the application according to the QoE evaluation model, and solving the QoE evaluation method existing in the related technology, the evaluation is complicated, the accuracy is low, and The problem of low user experience has achieved the effect of reducing QoE evaluation complexity and improving QoE evaluation accuracy and user experience.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flowchart of a first user experience quality QoE evaluation method according to an embodiment of the present invention;

2 is a flowchart of a second user experience quality QoE evaluation method according to an embodiment of the present invention;

3 is a structural block diagram of a first user experience quality QoE evaluation apparatus according to an embodiment of the present invention;

FIG. 4 is a structural block diagram of a first sending module 34 in a first user experience quality QoE evaluation apparatus according to an embodiment of the present invention;

FIG. 5 is a structural block diagram of a terminal according to an embodiment of the present invention; FIG.

6 is a second user experience quality QoE evaluation apparatus according to an embodiment of the present invention;

7 is a block diagram showing a preferred structure of a second user experience quality QoE evaluation apparatus according to an embodiment of the present invention;

FIG. 8 is a structural block diagram of a server according to an embodiment of the present invention; FIG.

9 is a flowchart of a user QoE evaluation method for a mobile terminal application according to an embodiment of the present invention;

FIG. 10 is a structural block diagram of a mobile terminal system according to an embodiment of the present invention; FIG.

11 is a block diagram showing the structure of a server system according to an embodiment of the present invention;

12 is a mobile application based user QoE evaluation method in accordance with an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In this embodiment, a user experience quality QoE evaluation method is provided. FIG. 1 is a flowchart of a first user experience quality QoE evaluation method according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102: Acquire an evaluation parameter that is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, a network layer of the application, and an indicator in the application layer. Parameters, attribute information of the terminal, user-related social attribute information, and rating of the application;

Step S104: Send the obtained evaluation parameter to a server set to establish a QoE evaluation model;

Step S106, acquiring a QoE evaluation model established by the server according to the evaluation parameter;

Step S108, performing QoE evaluation on the application according to the QoE evaluation model.

The user-related social attribute information includes at least information about the user's gender, age, occupation, hobbies, and the like. Through the above steps, the above evaluation parameters are fully considered in evaluating the QoE, and the above evaluation method can be applied to any network. Therefore, the QoE evaluation method existing in the related technology can effectively solve the problem of complicated evaluation, low accuracy, and low user experience, thereby achieving the effect of reducing QoE evaluation complexity, improving QoE evaluation accuracy and user experience.

When the foregoing evaluation parameters include the indicator parameters in the network layer and the application layer of the application, sending the obtained evaluation parameters to the server set to establish the QoE evaluation model includes: extracting influences from the indicator parameters in the application network layer and the application layer QoE key indicator parameters; the extracted key indicator parameters are sent to the server. That is to say, after obtaining the indicator parameters in the network side and the application layer of the application, the indicator parameters may be selectively sent instead of all the indicator parameters, and the selection of the indicator parameters may have a greater impact on the QoE evaluation. The indicator parameters can effectively alleviate the transmission pressure of network data.

The indicator parameters in the network layer may include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic; and an indicator parameter in the foregoing application layer. Including at least one of the following: page load delay, rich media loading delay, page blank latency, resource popularity, inventory usage, battery consumption rate, application security factor, transaction latency.

FIG. 2 is a flowchart of a second user experience quality QoE evaluation method according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:

Step S202: The evaluation parameter sent by the terminal is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, a network layer of the application, and an application layer. Indicator parameters in the indicator, attribute information of the terminal, user-related social attribute information, and opinion scores on the application;

Step S204, establishing a QoE evaluation model set to perform QoE evaluation on the application according to the received evaluation parameter;

Step S206, the established QoE evaluation model is sent to the terminal.

Through the above steps, the QoE evaluation method in the related technology can effectively solve the problem of complicated evaluation, low accuracy, and low user experience, thereby achieving the effect of reducing QoE evaluation complexity, improving QoE evaluation accuracy and user experience.

In an optional embodiment, after the evaluation parameter sent by the receiving terminal is set to evaluate the QoE, at least one of the following operations may be performed: classifying the received evaluation parameters; and backing up the evaluation parameters.

A user experience quality QoE evaluation device is also provided in the embodiment, and the device is configured to implement the foregoing embodiments and preferred embodiments, and details are not described herein. As used below, the term "module" may implement a combination of software and/or hardware of a predetermined function. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

3 is a structural block diagram of a first user experience quality QoE evaluation apparatus according to an embodiment of the present invention. As shown in FIG. 3, the apparatus includes a first acquisition module 32, a first transmission module 34, a second acquisition module 36, and an evaluation. Module 38, the device will be described below.

The first obtaining module 32 is configured to obtain an evaluation parameter that is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, a network layer of the application, and The indicator parameter in the application layer, the attribute information of the terminal, the user-related social attribute information, and the opinion score of the application; the first sending module 34 is connected to the first obtaining module 32, and is configured to send the obtained evaluation parameter to the set a server that establishes a QoE evaluation model. The second obtaining module 36 is connected to the first sending module 34, and is configured to obtain a QoE evaluation model that is sent by the server according to the evaluation parameter. The evaluation module 38 is connected to the second acquiring module 36. Set to QoE assessment of the application based on the QoE evaluation model.

FIG. 4 is a structural block diagram of a first sending module 34 in a first user experience quality QoE evaluation apparatus according to an embodiment of the present invention. As shown in FIG. 4, when the evaluation parameter includes an indicator parameter in a network layer and an application layer of an application, FIG. The first sending module 34 includes an extracting unit 42 and a transmitting unit 44, and the first transmitting module 34 will be described below.

The extracting unit 42 is configured to extract key parameter parameters affecting QoE from the index parameters in the network layer and the application layer of the application; the sending unit 44 is connected to the extracting unit 42 and configured to send the extracted key indicator parameters to the server. .

The indicator parameter in the network layer may include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic; The indicator parameters in the layer may include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, and transaction delay.

FIG. 5 is a structural block diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 5, the terminal 52 includes the first QoE evaluation device 54 of any of the above.

6 is a second user experience quality QoE evaluation apparatus according to an embodiment of the present invention. As shown in FIG. 6, the apparatus includes a receiving module 62, an establishing module 64, and a second transmitting module 66. The apparatus will be described below.

The receiving module 62 is configured to receive, by the terminal, an evaluation parameter that is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, and a network layer of the application. And the indicator parameter in the application layer, the attribute information of the terminal, the user-related social attribute information, and the opinion score of the application; the establishing module 64 is connected to the receiving module 62, and is configured to establish a setting according to the received evaluation parameter to perform QoE on the application. The QoE evaluation model is evaluated; the second sending module 66 is connected to the above-mentioned establishing module 64, and is configured to send the established QoE evaluation model to the terminal.

The indicator parameter in the network layer may include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic; The indicator parameters may include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, and transaction delay.

FIG. 7 is a block diagram showing a preferred structure of a second user experience quality QoE evaluation apparatus according to an embodiment of the present invention. As shown in FIG. 7, the apparatus includes a storage module 72 and a backup module in addition to all the modules shown in FIG. 74. The device will be described below.

The storage module 72 is connected to the receiving module 62, and is configured to classify and store the received evaluation parameters. The backup module 74 is connected to the receiving module 62 and configured to back up the evaluation parameters.

FIG. 8 is a structural block diagram of a server according to an embodiment of the present invention. As shown in FIG. 8, the server 82 includes a second user experience quality QoE evaluation device 84 of any of the above.

The present invention will now be described in terms of a system including a terminal and a server.

In one embodiment of the present invention, the user experience quality (QoE) is evaluated based on the mobile terminal application. First, in order to accurately measure the user's experience in using a specific terminal application, it is necessary to find a performance factor that can evaluate the application and The network factors that it depends on, and then based on the user's actual experience perception, use these factors to conduct correlation analysis, find out the qualitative and quantitative relationship between them, and finally use the extracted relationship to As shown in FIG. 9 , FIG. 9 is a flowchart of a method for evaluating a user QoE of a mobile terminal application according to an embodiment of the present invention. The flowchart includes the following steps:

Step S902, the relevant impact indicators are proposed from the underlying network, including a DNS resolution delay, a TCP connection delay, an HTTP response delay, a network speed, and a traffic.

In step S904, a key indicator affecting the user QoE is proposed from the application characteristic level of the mobile terminal: an overall page load delay, a rich media loading delay, a webpage blank delay, and the like are proposed for the webpage browsing application; and the resource hotness and advertisement are proposed for the video application. Indicators such as resource occupancy and battery consumption rate; indicators such as safety factor and transaction delay for social and trading applications;

Step S906, implementing network data collection and analysis functions of the mobile terminal application: when the user experiences a specific terminal application, the system acquires all network data packets in the background and saves them in the system for later analysis;

Step S908, implementing analysis and extraction of various terminal application characteristic indicators: calculating parameters representing characteristics of each index according to usage patterns of specific terminal applications and underlying network data;

Step S910: The remote server implements data collection, and the mobile terminal software is responsible for acquiring and reporting user data: the data includes analyzing specific parameters of the extracted various applications, and the user part information includes the basic social attributes of the user, and the user completes the terminal application experience. Subjective opinion scores and user equipment related information;

Step S912, based on the extracted index parameters and obtaining user feedback information, performing analysis of the influence relationship of each index on the user QoE and establishing a mathematical model, and realizing user QoE evaluation of different terminal applications: first analyzing various types of indicators including terminal application characteristics The parameters and the underlying parameters of the network affect the user QoE, and then establish an evaluation model and use the historical data to generate training data sets to train the model to achieve user QoE evaluation of the mobile terminal application.

FIG. 10 is a structural block diagram of a mobile terminal system according to an embodiment of the present invention. The main functions of the terminal shown in FIG. 10 include the following parts:

Collecting network data packets generated by the user during the terminal application process, and collecting application, terminal equipment, and user-related social attribute information;

Analyze the collected network data packets, design related algorithms and procedures, and extract the key indicator parameters that affect the user QoE at the network layer and application feature layer;

Reporting the actual experience value (MOS, average subjective opinion score), equipment, application, user related information, and related indicator values reported by the user to the server;

The QoE evaluation mathematical model of the training completion is periodically requested from the server, and the model is utilized in the process of using the terminal application by the user, and the QoE prediction is performed according to the extracted related indicators.

11 is a structural block diagram of a server system according to an embodiment of the present invention, wherein the server may include a meta-end server and a local server, and the main functions of the server shown in FIG. 11 include the following parts:

The server collects data uploaded by the mobile terminal and performs classified storage;

Pull the data down to the local server for backup, and complete the analysis of the data and the training of the relevant evaluation model on the local server;

The trained model is pushed to the remote server, and the remote server sends the relevant model information to the client according to the request of the client.

In order to clearly illustrate the specific inventive implementation flow, in an optional embodiment, a specific application of the mobile terminal, a Web browser application, is taken as an example to introduce the specific steps of the present invention, and FIG. 12 is implemented according to the present invention. An example of a mobile application-based user QoE evaluation method includes the following steps:

In step S1202, a key indicator affecting the user QoE is proposed from the web application feature level of the mobile terminal, where the network layer indicator includes: a DNS delay, a TCP connection delay, a response delay, and a transmission delay. Application layer indicators include: overall page load delay, rich media load delay, web page blank delay, etc.

Step S1204: Implementing a network data collection function of the mobile terminal application: when the user experiences a specific web application, the system acquires all network data packets in the background and saves them in the system for later analysis; and implements various terminal application characteristic indicators. Analytical extraction function: Calculate parameters that characterize each indicator according to the usage mode of the specific terminal application and the underlying network data;

Step S1206, based on the extracted index parameters and obtaining user feedback information, performing analysis of the influence relationship of each index on the user QoE and establishing a mathematical model, and implementing user QoE evaluation of different terminal applications: first analyzing various types of indicators including terminal applications The relationship between the characteristic parameters and the underlying parameters of the network on the QoE of the user, and then the user's QoE evaluation of the mobile terminal application is implemented through the established evaluation model.

The implementation method and extraction algorithm of the application layer indicator parameters can be as follows:

The battery consumption rate is divided according to the amount of power consumed by the user when using the browser and the time of use, and the rate of consumption of the battery is obtained;

The page load delay is calculated by an algorithm by means of capturing packets in the background. The algorithm includes, in the browser, issuing a domain name of a Uniform Resource Locator (URL). The server (Domain Name Server, referred to as DNS) starts to calculate the time after the request, until the target URL stops all the data transmission, and the obtained delay is recorded as the page loading delay;

The rich media load delay is based on the data captured in the background and is calculated by an algorithm. The algorithm includes: matching the received data rich media data type to each field of the HTTP by the data packet captured in the background, obtaining all the ports of the rich media transmission; calculating the time stamp and delay of transmitting the rich media on each port, and Matches whether each delay interval has a coincidence; adds all delays and subtracts the overlapping delay to obtain the final rich media total transmission delay.

The advantages of the above embodiments of the present invention are that, from a new perspective, the terminal application re-evaluates the evaluation of the user QoE, and proposes key indicators affecting the user QoE from the terminal application feature level, and realizes various application characteristic indicators and network underlying performance. Extraction of indicator parameters. By integrating various parameters and collecting user subjective opinion scores, and analyzing the relationship between different indicator parameters on QoE, a mathematical model is established to achieve an accurate and comprehensive evaluation of the user QoE of the terminal application. In addition, the above embodiments of the present invention can also achieve the following effects: realizing user experience quality evaluation of mobile terminal applications; supporting evaluation of various terminal applications; integrating QoS and QoE measurement, which is beneficial to application developers and networks. Optimize the application, network and service of operators and service providers; analyze QoE indicators comprehensively for various applications, and have high evaluation accuracy, which can be used as a basic reference; applicable to QoE evaluation under various terminal networks; evaluation model Regular training updates will be made based on the amount of data collected, improving the accuracy of the assessment.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

As described above, the user experience quality QoE evaluation method, apparatus, terminal, and server provided by the embodiments of the present invention have the following beneficial effects: the QoE evaluation method existing in the related technology is solved. Estimating the complexity, low accuracy, and low user experience, and thus reducing the complexity of QoE assessment, improving the accuracy of QoE assessment and user experience.

Claims

A user experience quality QoE evaluation method, including:

Acquiring an evaluation parameter set to evaluate the QoE, wherein the evaluation parameter includes at least one of the following: a network data packet generated by the application in the terminal during use, a network layer of the application, and an indicator in the application layer a parameter, attribute information of the terminal, user-related social attribute information, and a rating of the application;

Sending the obtained evaluation parameter to a server set to establish a QoE evaluation model;

Obtaining, by the server, the QoE evaluation model established according to the evaluation parameter;

The application is QoE evaluated according to the QoE assessment model.
The method according to claim 1, wherein when the evaluation parameter includes an indicator parameter in a network layer and an application layer of the application, the acquired evaluation parameter is sent to a setting to establish the QoE evaluation model. The server includes:

Extracting key parameter parameters affecting the QoE from indicator parameters in the network layer and the application layer of the application;

The extracted key indicator parameters are sent to the server.
The method of claim 1 wherein

The indicator parameters in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic;

The indicator parameters in the application layer include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, transaction delay .
A user experience quality QoE evaluation method, including:

The evaluation parameter sent by the receiving terminal is an evaluation parameter for evaluating the QoE, wherein the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, a network layer of the application, and an application layer The indicator parameter in the indicator, the attribute information of the terminal, the user-related social attribute information, and the opinion score on the application;

Establishing a QoE evaluation model set to perform QoE evaluation on the application according to the received evaluation parameter;

The established QoE evaluation model is sent to the terminal.
The method of claim 4, wherein

The indicator parameters in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic;

The indicator parameters in the application layer include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, transaction delay .
The method according to claim 4, wherein after the evaluation parameter sent by the receiving terminal set to evaluate the QoE, at least one of the following is further included:

Classifying and storing the received evaluation parameters;

Back up the evaluation parameters.
A user experience quality QoE evaluation device, including:

The first obtaining module is configured to obtain an evaluation parameter that is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, the network of the application Index parameters in the layer and the application layer, attribute information of the terminal, user-related social attribute information, and a rating on the application;

a first sending module, configured to send the obtained evaluation parameter to a server set to establish a QoE evaluation model;

a second obtaining module, configured to acquire the QoE evaluation model that is sent by the server according to the evaluation parameter;

An evaluation module configured to perform a QoE evaluation of the application based on the QoE evaluation model.
The apparatus according to claim 7, wherein, when the evaluation parameter includes an indicator parameter in a network layer and an application layer of the application, the first sending module includes:

An extracting unit, configured to extract key parameter parameters affecting the QoE from indicator parameters in the network layer and the application layer of the application;

And a sending unit, configured to send the extracted key indicator parameters to the server.
The apparatus according to claim 7, wherein

The indicator parameters in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic;

The indicator parameters in the application layer include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, transaction delay .
A terminal comprising the apparatus of any one of claims 7 to 9.
A user experience quality QoE evaluation device, including:

a receiving module, configured to receive, by the terminal, an evaluation parameter that is set to evaluate the QoE, where the evaluation parameter includes at least one of the following information: a network data packet generated by the application in the terminal during use, the application Index parameters in the network layer and the application layer, attribute information of the terminal, user-related social attribute information, and opinion scores on the application;

Establishing a module, configured to establish a QoE evaluation model set to perform QoE evaluation on the application according to the received evaluation parameter;

And a second sending module, configured to send the established QoE evaluation model to the terminal.
The apparatus according to claim 11, wherein

The indicator parameters in the network layer include at least one of the following: a domain name service DNS resolution delay, a transmission control protocol TCP connection delay, a hypertext transmission protocol HTTP response delay, a network speed, and a traffic;

The indicator parameters in the application layer include at least one of the following: page load delay, rich media loading delay, webpage blank delay, resource popularity, inventory occupancy, battery consumption rate, application security factor, transaction delay .
The apparatus according to claim 11, further comprising at least one of the following:

a storage module, configured to classify and store the received evaluation parameters;

A backup module, set to back up the evaluation parameters.
A server comprising the apparatus of any one of claims 11 to 13.