CN114945191A

CN114945191A - User perception determining method and device for 5G mobile service and electronic equipment

Info

Publication number: CN114945191A
Application number: CN202210681181.3A
Authority: CN
Inventors: 赵振桥; 刘喜卿; 周诗雨; 程新洲; 乔金剑; 赫欣
Original assignee: China United Network Communications Group Co Ltd
Current assignee: China United Network Communications Group Co Ltd
Priority date: 2022-06-15
Filing date: 2022-06-15
Publication date: 2022-08-26

Abstract

The disclosure relates to a method and a device for determining user perception of a 5G mobile service and electronic equipment, relates to the technical field of 5G, and solves the problem of low accuracy of a user perception result determined by a related technology. The method comprises the following steps: acquiring local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area; determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data; determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data; and determining a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

Description

User perception determining method and device for 5G mobile service and electronic equipment

Technical Field

The present disclosure relates to the field of 5G technologies, and in particular, to a method and an apparatus for determining user perception of a 5G mobile service, and an electronic device.

Background

With the development of 5G technology (5th generation mobile communication technology), 5G mobile services are no longer limited to providing voice services (such as voice call services) for users by using 5G technology, but also provide data services (such as web browsing services, game services, live broadcast services, and download services) for users by using 5G technology, so as to meet the increasing usage requirements of multiple scenes and multiple services for users. Therefore, it is very important to reflect the operation condition of the 5G mobile service (e.g., the service is failed or the service is operating normally) through the perception that the user uses the 5G mobile service, i.e., the user perception.

However, the accuracy of the user sensing result determined by the related art is low, that is, the user sensing result cannot accurately reflect the operation condition of the 5G mobile service.

Disclosure of Invention

The disclosure provides a method and a device for determining user perception of a 5G mobile service and electronic equipment, which are used for at least solving the problem of low accuracy of a user perception result determined by a related technology. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a method for determining user perception of a 5G mobile service, where the 5G mobile service includes a voice service and a data service, the method including: acquiring local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area; determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data; determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data; and determining a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

In one possible implementation, determining a first user perception result corresponding to a voice service according to local voice service data and roaming voice service data includes: determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a local user from local voice service data; determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a roaming user from roaming voice service data; and determining a first user perception result corresponding to the voice service according to one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the local user and one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the roaming user.

In another possible implementation, determining a second user sensing result corresponding to the data service according to the local data service data and the roaming data service data includes: determining one or more items of web browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a local user from the local data service data; determining one or more of webpage browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a roaming user from the roaming data service data; and determining a second user perception result corresponding to the data service according to one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user and one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user.

In another possible implementation, the web browsing service data includes a page display success rate and/or a page average display duration; the game service data comprises RTT uplink average time delay and/or RTT downlink average time delay; the video service data comprises video card pause frequency and/or video average initial cache time delay; the live broadcast service data comprises live broadcast card pause frequency and/or live broadcast average initial play time delay; the FTP download service data comprises an FTP average download rate.

In another possible embodiment, the method further comprises: when the user comprehensive perception result corresponding to the 5G mobile service is smaller than the user comprehensive perception threshold value, determining the 5G mobile service as a comprehensive fault service; or when the user comprehensive perception result corresponding to the 5G mobile service is larger than the user comprehensive perception threshold and the first user perception result is smaller than the user voice perception threshold, determining the 5G mobile service as a voice fault service; or, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user comprehensive perception threshold and the second user perception result is less than the user data service perception threshold, determining the 5G mobile service as the data failure service.

In another possible embodiment, the method further comprises: according to the identification of the target area, the local user and the roaming user are separated from the XDR data.

According to a second aspect of the embodiments of the present disclosure, there is provided a user perception determining apparatus for 5G mobile services, where the 5G mobile services include voice services and data services, the apparatus includes: an acquisition unit configured to perform acquisition of local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area; a first determining unit configured to perform determining a first user perception result corresponding to a voice service according to the local voice service data and the roaming voice service data; a second determining unit configured to determine a second user sensing result corresponding to the data service according to the local data service data and the roaming data service data; and the third determining unit is configured to determine a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

In a possible implementation, the first determining unit is configured to specifically perform: determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a local user from local voice service data; determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a roaming user from roaming voice service data; and determining a first user perception result corresponding to the voice service according to one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the local user and one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the roaming user.

In a possible implementation, the second determining unit is configured to specifically perform: determining one or more items of web browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a local user from the local data service data; determining one or more items of webpage browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a roaming user from the roaming data service data; and determining a second user perception result corresponding to the data service according to one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user and one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user.

In one possible implementation, the web browsing service data includes a page display success rate and/or a page average display duration; the game service data comprises RTT uplink average time delay and/or RTT downlink average time delay; the video service data comprises video pause frequency and/or video average initial cache time delay; the live broadcast service data comprises live broadcast card pause frequency and/or live broadcast average initial play time delay; the FTP download service data comprises an FTP average download rate.

In one possible embodiment, the apparatus further comprises: an early warning unit configured to perform: when the user comprehensive perception result corresponding to the 5G mobile service is smaller than the user comprehensive perception threshold value, determining the 5G mobile service as a comprehensive fault service; or when the user comprehensive perception result corresponding to the 5G mobile service is larger than the user comprehensive perception threshold and the first user perception result is smaller than the user voice perception threshold, determining the 5G mobile service as a voice fault service; or, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user comprehensive perception threshold and the second user perception result is less than the user data service perception threshold, determining the 5G mobile service as the data failure service.

In one possible embodiment, the apparatus further comprises: a separation unit configured to perform: according to the identification of the target area, the local user and the roaming user are separated from the XDR data.

According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor and a memory for storing processor-executable instructions; wherein the processor is configured to execute executable instructions to implement the user perception determination method as described in the first aspect and any one of its possible implementations.

According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a user perception determination method as in the first aspect and any one of its possible implementations; or when executed by user perception determination means, enable the user perception determination means to perform a user perception determination method as in the first aspect and any of its possible implementations.

According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program or instructions for execution by a processor of a user perception determination method as in the first aspect and any one of its possible implementations.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects: by the user perception determining method, the first user perception result of the voice service by the comprehensive users (namely, the local users and the roaming users) in the target area can be determined, and compared with the first user perception result determined by the voice service data of a single type of user, the first user perception result determined by the voice service data of the comprehensive users is more accurate. Meanwhile, second user perception results of the local user and the roaming user in the target area on the data service can be determined, and compared with the method for determining the second user perception results by using the data service data of a single type of user, the second user perception results determined by using the data service data of the comprehensive user are more accurate. Further, the user comprehensive perception result of the 5G mobile service of the comprehensive service type obtained by the comprehensive user is more accurate through the first user perception result and the second user perception result. Therefore, the user perception determining method not only considers the application scenes (such as voice service and data service) of multiple service types of the 5G mobile service, but also considers that different types of users using the 5G mobile service in the target area have different influences on the user comprehensive perception result of the 5G mobile service, so that the obtained user comprehensive perception result can more accurately reflect the operation condition of the 5G mobile service.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

FIG. 1 is a schematic diagram illustrating a user perception determination system according to an exemplary embodiment;

FIG. 2 is a flow diagram illustrating a user perception determination method according to an example embodiment;

FIG. 3 is a flow diagram illustrating another user perception determination method according to an example embodiment;

FIG. 4 is a flow diagram illustrating another user perception determination method according to an example embodiment;

FIG. 5 is a flow diagram illustrating another user perception determination method according to an example embodiment;

FIG. 6 is a flow diagram illustrating another user perception determination method according to an example embodiment;

FIG. 7 is a flow diagram illustrating another user perception determination method in accordance with an exemplary embodiment;

FIG. 8 is a flow diagram illustrating another user perception determination method in accordance with an exemplary embodiment;

fig. 9 is a schematic diagram illustrating a failure determination process for 5G mobile services in accordance with an exemplary embodiment;

FIG. 10 is a block diagram illustrating a user perception determination method apparatus according to an example embodiment;

FIG. 11 is a block diagram illustrating a user perception determination method apparatus according to an example embodiment;

FIG. 12 is a block diagram illustrating another user perception determination method apparatus in accordance with an exemplary embodiment;

FIG. 13 is a schematic diagram illustrating an electronic device in accordance with an exemplary embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

Before describing the user perception determining method provided by the embodiment of the present disclosure in detail, the application scenario and the implementation environment related to the embodiment of the present disclosure are briefly described.

First, a brief description is given of an application scenario to which the present disclosure relates.

With the development of 5G technology (5th generation mobile communication technology), 5G mobile services are no longer limited to providing voice services (such as voice call services) for users by using 5G technology, but also provide data services (such as web browsing services, game services, live broadcast services, and download services) for users by using 5G technology, so as to meet the increasing usage requirements of multiple scenes and multiple services for users. Therefore, it is very important to reflect the operation condition of the 5G mobile service (e.g., the service is failed or the service is normally operated) through the user's perception of using the 5G mobile service, i.e., the user's perception.

However, the related art does not consider a multi-service scenario in the 5G mobile service, so that the accuracy of the user perception result obtained by the above method is low, that is, the user perception result cannot accurately reflect the operation condition of the 5G mobile service.

In view of the above problems, the present disclosure provides a method for determining user perception of a 5G mobile service, where the 5G mobile service includes a voice service and a data service. The server first obtains service data (i.e., local voice service data and local data service data) of the 5G mobile service of the local user in the target area and service data (i.e., roaming voice service data and roaming data service data) of the 5G mobile service of the roaming user, respectively. And the server determines a first user perception result of the local user and the roaming user of the target area to the voice service according to the acquired local voice service data and the roaming voice service data. Meanwhile, the server also determines a second user perception result of the data service of the local user and the roaming user in the target area according to the acquired local data service data and the roaming data service data. And finally, the server also determines the user comprehensive perception result of the local user and the roaming user in the target area to the 5G mobile service according to the determined first user perception result and the second user perception result.

By the user perception determining method, the first user perception result of the voice service by the comprehensive users (namely, the local users and the roaming users) in the target area can be determined, and compared with the first user perception result determined by the voice service data of a single type of user, the first user perception result determined by the voice service data of the comprehensive users is more accurate. Meanwhile, second user perception results of the local user and the roaming user in the target area on the data service can be determined, and compared with the method for determining the second user perception results by using the data service data of a single type of user, the second user perception results determined by using the data service data of the comprehensive user are more accurate. Furthermore, the user comprehensive perception result of the 5G mobile service of the comprehensive service type obtained by the comprehensive user is more accurate through the first user perception result and the second user perception result. Therefore, the user perception determining method not only considers the application scenes of multiple service types (such as voice service and data service) of the 5G mobile service, but also considers that different types of users using the 5G mobile service in the target area have different influences on the user comprehensive perception result of the 5G mobile service, so that the obtained user comprehensive perception result can more accurately reflect the operation condition of the 5G mobile service.

Next, the implementation architecture related to the present disclosure is briefly described below.

Fig. 1 is a schematic diagram of a user perception determination system 10 provided by the present disclosure. As shown in fig. 1, the user perception determination system 10 includes at least one server 102 and a plurality of terminal devices 101. The terminal apparatus 101 is connected to the server 102. The terminal apparatus 101 communicates with the server 102 by a wired communication method or a wireless communication method.

Service data generated when a user performs a 5G mobile service using a terminal device. The server firstly acquires service data generated when a plurality of terminal devices in a target area execute 5G mobile services. The server separates the local service data (i.e. service data generated by the local user) and the roaming service data (i.e. service data generated by the roaming user) from the service data. Furthermore, local voice service data generated when the local user uses the voice service of the 5G mobile service and local data service data generated when the local user uses the data service of the 5G mobile service are screened out from the service data generated by the local user; and roaming voice service data generated when the roaming subscriber uses the voice service of the 5G mobile service and roaming data service data generated when the roaming subscriber uses the data service of the 5G mobile service from the service data generated by the roaming subscriber. The server determines a perception evaluation result of the user in the target area to the voice service, namely a first user perception result, based on the obtained local voice service data and roaming voice service data, and determines a perception evaluation result of the user in the target area to the data service, namely a second user perception result, based on the obtained local data service data and roaming data service data. And finally, the server determines a user comprehensive perception result capable of reflecting the running condition of the 5G mobile service according to the first user perception result and the second user perception result.

In an implementation, the terminal device 101 may be any one of computer devices, where the computer device includes, but is not limited to, a mobile phone, a tablet computer, a desktop computer, a notebook computer, a vehicle-mounted terminal, a palm terminal, an Augmented Reality (AR) device, a Virtual Reality (VR) device, and the like, which can be installed and used in a content community application (such as a express way), and the specific form of the terminal device 101 is not particularly limited in the embodiment of the present disclosure. The system can perform man-machine interaction with a user account in one or more modes such as a keyboard, a touch pad, a touch screen, a remote controller, voice interaction or handwriting equipment.

In another embodiment, the server 102 may be a server, or may also be a server cluster composed of multiple servers or a cloud computing service center, and the present disclosure does not limit the specific implementation manner of the server. The server 102 is mainly configured to store data related to a content community application installed on the terminal device 101, and may send corresponding data to the terminal device 101 when receiving a data acquisition request sent by the terminal device 101.

It is understood that the terminal device 101 and the server 102 may be provided independently or integrated in a single device, and the disclosure is not limited thereto.

The user perception determining method provided by the embodiment of the present disclosure may be applied to the user perception determining system in the implementation architecture shown in fig. 1. For ease of understanding, the user perception determination method provided by the present disclosure is specifically described below with reference to the accompanying drawings.

Fig. 2 is a flowchart illustrating a user perception determining method according to an exemplary embodiment, where the user perception determining method may be used in a server of the user perception determining system as shown in fig. 2, and includes the following steps.

Step S21, obtaining the local voice service data and the local data service data of the local user in the target area, and the roaming voice service data and the roaming data service data of the roaming user in the target area.

The local user refers to a user who uses the user equipment and has the same registration area registered for the 5G mobile service as the target area. The roaming user refers to a user who uses a user equipment and has a registered area registered for the 5G mobile service different from a target area. The 5G mobile service includes a voice service and a data service. The local voice service data refers to service data generated when a local user performs a voice service using user equipment. The local data service data refers to service data generated when a local user performs a data service using user equipment. Roaming voice service data refers to service data generated when a roaming user performs a voice service using user equipment. The roaming data service data refers to service data generated when a roaming user performs a data service using user equipment.

The voice service may be understood as a voice call service. For example, a telephony service established using 5G traffic.

The data service may be understood as a data service executed using 5G traffic, and specifically may include: web browsing service, game service, video service, live broadcast service, and FTP download service.

In some embodiments, a roaming user may also be referred to as a nomadic user. The embodiment of the present disclosure does not specially limit the specific names of the local user and the roaming user, and only needs to distinguish the two user types.

The target area may be a province, a city, a district, or the like. The range of the target area is specifically limited in the embodiments of the present disclosure, and the target area may be specifically set according to the requirements of a specific area.

Step S22, determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data.

The first user perception result refers to a perception evaluation result of the user using the voice service in the target area on the voice service. The first user perception result can also be understood as a voice service perception evaluation result.

As an embodiment, as shown in fig. 3, step S22 may be embodied by the following step S22A and step S22B.

Step S22A, determining the local user voice service perception result of the local user to the voice service according to the local voice service data; and determining a roaming user voice service perception result of the roaming user to the voice service according to the roaming voice service data.

Step S22B, calculating a first user sensing result according to the local user voice service sensing result, the first weight value corresponding to the local user voice service sensing result, and the second weight value corresponding to the roaming user voice service sensing result and the roaming user voice service sensing result.

And the sum of the first weight value and the second weight value is 1. The first weight value and the second weight value may be specifically set according to different proportions of the local user and the roaming user in the target area, and the disclosure is not specifically limited herein.

Illustratively, if the first weighted value is 0.8, the second weighted value is 0.2, the voice service perception result of the local user is 80 points, and the voice service perception result of the roaming user is 70 points; the first user perception result is 80 points 0.8+70 points 0.2 points 78 points.

And step S23, determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data.

The second user perception result refers to a perception evaluation result of the data service by the user using the data service in the target area.

Alternatively, as an embodiment, as shown in fig. 4, step S23 may be specifically implemented by the following steps S231 and S232.

Step S231, determining a local user data service perception result of the local user to the data service according to the local data service data; and determining the data service perception result of the roaming user for the data service according to the data of the roaming data service.

Step S232, calculating a second user sensing result according to the local user data service sensing result, the third weight value corresponding to the local user data service sensing result, and the fourth weight value corresponding to the roaming user data service sensing result and the roaming user data service sensing result.

And the sum of the third weight value and the fourth weight value is 1. The third weight value and the fourth weight value may be specifically set according to different proportions of the local user and the roaming user in the target area, and the disclosure is not specifically limited herein.

Illustratively, if the third weight value is 0.8 and the fourth weight value is 0.2, the data service perception result of the local user is 90 points, and the data service perception result of the roaming user is 80 points; the second user perception result is 90 points 0.8+80 points 0.2 points 88 points.

And step S24, determining a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

It should be noted that the comprehensive user perception result corresponding to the 5G mobile service refers to a perception evaluation result of the 5G mobile service by the user using the 5G mobile service in the target area. The comprehensive perception result of the user reflects the running condition of the 5G mobile service.

As an implementation manner, the comprehensive user perception result is calculated according to the first user perception result, the fifth weight value of the voice service, the second user perception result and the sixth weight value of the data service.

It can be understood that the fifth weight value of the voice service is the weight of the first user perception result, and the sixth weight value of the data service is the weight of the second user perception result.

And the sum of the fifth weight value and the sixth weight value is 1. The fifth weight value and the sixth weight value may be specifically set according to the importance and tolerance of the comprehensive perception influence on the 5G mobile service, and/or the difference between actual service proportions of the two services, which is not specifically limited in this disclosure.

Illustratively, the first user perception result is 78 points and the second user perception result is 88 points based on the above example. If the fifth weight value is 0.4 and the sixth weight value is 0.6, the integrated perception result of the user is 78 points by 0.4+88 points by 0.6 points by 84 points. Generally, the comprehensive perception result of the user is 84 minutes, and the perception evaluation of the 5G mobile service by the user using the 5G mobile service in the characterization target area is good.

In some embodiments, the degree of the perception evaluation of the 5G mobile service by the user in the target area, such as excellent, good, general (passing), poor, etc., is determined according to the score segment to which the user comprehensive perception result belongs, so as to reflect the operation condition of the 5G mobile service in the target area. For example, the comprehensive perception result of the user is excellent, which indicates that the 5G mobile service operates well in the target area without optimizing the service. When the user comprehensive perception result is good, the 5G mobile service is better operated in the target area, but certain risks exist. When the comprehensive perception result of the user is general or poor, the operation of the 5G mobile service in the target area is poor, and the operation optimization is needed.

In the above embodiment, the server first obtains the service data of the 5G mobile service of the local user (i.e., the local voice service data and the local data service data) and the service data of the 5G mobile service of the roaming user (i.e., the roaming voice service data and the roaming data service data) in the target area, respectively. And the server determines a first user perception result of the local user and the roaming user of the target area to the voice service according to the acquired local voice service data and the roaming voice service data. Meanwhile, the server also determines a second user perception result of the data service of the local user and the roaming user in the target area according to the acquired local data service data and roaming data service data. And finally, the server also determines the user comprehensive perception result of the local user and the roaming user in the target area to the 5G mobile service according to the determined first user perception result and the second user perception result.

Through the user perception determining method, the server can determine the first user perception result of the voice service by the comprehensive users (namely, the local users and the roaming users) in the target area, and compared with the first user perception result determined by the voice service data of a single type of user, the first user perception result determined by the voice service data of the comprehensive users is more accurate.

Meanwhile, second user perception results of the local user and the roaming user in the target area on the data service can be determined, and compared with the method for determining the second user perception results by using the data service data of a single type of user, the second user perception results determined by using the data service data of the comprehensive user are more accurate. Further, the user comprehensive perception result of the 5G mobile service of the comprehensive service type obtained by the comprehensive user is more accurate through the first user perception result and the second user perception result. Therefore, the user perception determining method not only considers the application scene of the multiple service types of the 5G mobile service, but also considers that different types of users using the 5G mobile service in the target area have different influences on the user comprehensive perception result of the 5G mobile service, so that the obtained user comprehensive perception result can more accurately reflect the operation condition of the 5G mobile service.

Alternatively, as shown in fig. 5, the step S22 may be specifically implemented by the following steps S221 to S223.

Step S221, determining one or more of the voice connection success rate, the average call setup duration, the voice call drop rate and the average voice quality value of the local user from the local voice service data.

Step S222, determining one or more of a voice connection success rate, an average call setup duration, a voice call drop rate, and an average voice quality value of the roaming user from the roaming voice service data.

The following is a detailed description of embodiments of each specific voice service data related to step S221 and step S222. The users of the target area are referred to as roaming users and home users of the target area using voice services.

First, the voice connection success rate refers to the success probability that the user in the target area hears the ringing tone after initiating the 5G call. The voice call success rate can also be understood as a voice call success rate.

Specifically, the voice connection success rate is determined according to the voice connection success times and the voice call times, wherein the voice connection success rate is positively correlated with the voice connection success times, and the voice connection success rate is negatively correlated with the voice call times.

Illustratively, the voice connection success rate is the number of voice connection successes/the number of voice calls.

It should be noted that the number of successful voice connection times is the sum of the total number of successful voice connection times of 5G VoNR (5th generation mobile communication technology voice over new radio, new air interface of fifth generation mobile communication technology) and the total number of successful voice connection times of EPS FB (evolved packet system floor); the voice call times are the sum of the total 5G VoNR voice call times and the total EPS FB voice call times.

It is understood that the EPS FB means that in the case that 5G does not have the VoNR condition, the voice traffic falls back from 5G to 4G to ensure the continuity of the voice traffic.

As shown in table 1, the user perception score criteria for the established speech turn-on success rate. The user perception scoring standard of the voice connection success rate (x) of the local user and the user perception scoring standard of the voice connection success rate (x) of the roaming user are introduced respectively.

In detail, when the voice connection success rate x of the local user is greater than or equal to 98%, the voice connection success rate score of the local user corresponding to the voice connection success rate x of the local user greater than or equal to 98% (i.e., the user perception score of the voice connection success rate (x) of the local user) is 100; by analogy, the score of the local user voice connection success rate corresponding to the voice connection success rate of the local user with the ratio of 98% > x being more than or equal to 95% is 80; the score of the local user voice connection success rate corresponding to the local user voice connection success rate of 95% > x ≥ 93%; the score of the local user voice connection success rate corresponding to the voice connection success rate of the local user with x < 93% is 0.

When the voice connection success rate x of the roaming user is more than or equal to 96%, the voice connection success rate score of the roaming user (namely, the user perception score of the voice connection success rate x of the roaming user) corresponding to the voice connection success rate x of the roaming user which is more than or equal to 96% is 100; by analogy, the score of the voice connection success rate of the roaming user corresponding to the voice connection success rate of the roaming user with the speed of 96% > x being more than or equal to 93% is 80; the score of the roaming user voice connection success rate corresponding to the voice connection success rate of the roaming user with the ratio of 93% > x being more than or equal to 90% is 60; the score of the roaming user voice connection success rate corresponding to the voice connection success rate of the roaming user with x being less than 90 percent is 0.

TABLE 1

Secondly, the average call setup duration refers to the duration from the time when the user in the target area initiates a 5G call to the time when the ringing tone is heard. Specifically, the average call setup time duration is determined according to the total call setup time duration and the total number of times of call setup success. The average call setup duration is positively correlated with the total call setup duration, and the average call setup duration is negatively correlated with the total number of successful call setups.

Illustratively, the average call setup duration is the total call setup duration/total number of successful call setups.

It should be noted that the total call setup duration refers to a sum of a duration sum from when the user initiates a 5G VoNR call to when the user hears a ring and a duration sum from when the user initiates an EPS FB call to when the user hears a ring within a period of time; the call setup success number is the sum of the number of rings heard by the user after the user initiates a 5G VoNR call and the number of rings heard by the user after the user initiates an EPS FB call within a period of time.

As shown in table 2, the average call setup duration score criteria was established. The user perception scoring standard of the average call setup time (y) of the local user and the user perception scoring standard of the average call setup time (y) of the roaming user are introduced respectively.

In detail, when the average call setup duration y of the local user is less than or equal to 4s, the average call setup duration score of the local user corresponding to the average call setup duration of the local user with y less than or equal to 4s (that is, the user perception score of the average call setup duration (y) of the local user) is 100; by analogy, the average call establishment duration score of the local user corresponding to the average call establishment duration of the local user with y being more than 4s and less than or equal to 6s is 80; the average call establishment duration score of the local user corresponding to the average call establishment duration of the local user with the time of 6s less than or equal to y less than or equal to 8s is 60; and the average call establishment duration score of the local user corresponding to the average call establishment duration of the local user with y being greater than 8s is 0.

When the average call setup time y of the roaming user is less than or equal to 6s, the average call setup time score of the roaming user corresponding to the average call setup time y of the roaming user less than or equal to 6s (i.e. the user perception score of the average call setup time (y) of the roaming user) is 100; by analogy, the average call setup time score of the roaming user corresponding to the average call setup time of the roaming user with y being more than 6s and less than or equal to 8s is 80; the average call setup duration score of the roaming user corresponding to the average call setup duration of the roaming user with y being more than 8s and less than or equal to 10s is 60; and the average call setup time score of the roaming user corresponding to the average call setup time of the roaming user with y being more than 10s is 0.

TABLE 2

Thirdly, the voice call drop rate refers to the probability that the user in the target area is interrupted in the 5G call process.

Specifically, the voice call drop rate is determined according to the total call drop times and the total user response times in the user call process. The voice call drop rate is positively correlated with the total call drop times in the user call process, and the voice call drop rate is negatively correlated with the total user response times.

Illustratively, the voice call drop rate is the total number of dropped calls/total number of answered calls of the user during the user's call.

It should be noted that the total dropped call times in the user call process refers to the sum of the total dropped call times in the call process of the VoNR call user and the total dropped call times in the call process of the EPS FB call user, that is, the total dropped call times in the user call process is the total dropped call times in the call process of the VoNR call user plus the total dropped call times in the call process of the EPS FB call user; the total number of times of the user call refers to the sum of the total number of times of answering by the VoNR calling user and the total number of times of answering by the EPS FB calling user, that is, the total number of times of the user call is the total number of times of answering by the VoNR calling user + the total number of times of answering by the EPS FB calling user.

As shown in table 3, the established voice drop rate scoring criteria. A user perception scoring standard of a voice call drop rate (z) of a local user and a user perception scoring standard of a voice call drop rate (z) of a roaming user are introduced respectively.

In detail, when the voice call drop rate z of the local user is less than or equal to 0.1%, the voice call drop rate score of the local user corresponding to the voice call drop rate of the local user with z less than or equal to 0.1% (i.e., the user perception score of the voice call drop rate (z) of the local user) is 100; by analogy, the voice call drop rate of the local user corresponding to the voice call drop rate of the local user with the ratio of 0.1% < z less than or equal to 0.15% is scored as 80; the local user voice call drop rate score corresponding to the local user voice call drop rate of 0.15% < z ≦ 0.18% is 60; and the voice call drop rate of the local user corresponding to the voice call drop rate of the local user with z > 0.18% is scored as 0.

When the voice call drop rate z of the roaming user is less than or equal to 0.1%, the voice call drop rate score of the roaming user corresponding to the voice call drop rate of the roaming user with the z less than or equal to 0.1% (namely, the user perception score of the voice call drop rate (z) of the roaming user) is 100; by analogy, the voice call drop rate score of the roaming user corresponding to the voice call drop rate of the roaming user with the value of 0.1% < z less than or equal to 0.15% is 80; the voice call drop rate score of the roaming user corresponding to the voice call drop rate of the roaming user with the ratio of 0.15% < z not more than 0.18% is 60; and the voice call drop rate score of the roaming user corresponding to the voice call drop rate of the roaming user with z >0.18 percent is 0.

TABLE 3

Fourthly, the average speech quality value is also called an average speech MOS (mean opinion score) value, which is an average value of the user speech perception quality test results of the target area.

Specifically, the average voice MOS value is determined according to the summation of all MOS values and the number of all MOS values in the first preset time. The average voice MOS value is positively correlated with the sum of all the MOS values in the first preset time, and the average voice MOS value is positively correlated with the number of all the MOS values in the first preset time.

Illustratively, the average voice MOS value is the sum of all MOS values in a first preset time and/or the number of all MOS values in the first preset time.

As shown in table 4, the established average voice MOS value scoring criteria. The user perception scoring standard of the average voice MOS value (m) of the local user and the user perception scoring standard of the average voice MOS value (m) of the roaming user are introduced respectively.

In detail, when the average voice MOS value m of the local user is greater than or equal to 3.8, the local user average voice MOS value score corresponding to the average voice MOS value m of the local user, which is greater than or equal to 3.8 (i.e., the user perception score of the average voice MOS value (m) of the local user) is 100; by analogy, the average voice MOS value of the local user corresponding to the average voice MOS value of the local user with the length of 3.8 m being more than or equal to 3.5 is scored as 80; the local user average voice MOS value score corresponding to the local user average voice MOS value with the m being more than or equal to 3 is 60; and the local user average voice MOS value corresponding to the local user average voice MOS value with m <3 is scored as 0.

When the average voice MOS value m of the roaming user is larger than or equal to 3.8, the average voice MOS value score of the roaming user corresponding to the average voice MOS value m of the roaming user with the average voice MOS value m larger than or equal to 3.8 (namely, the user perception score of the average voice MOS value (m) of the roaming user) is 100; by analogy, the average voice MOS value of the roaming user corresponding to the average voice MOS value of the roaming user with the size of 3.8 m being more than or equal to 3.5 is scored as 80; the average voice MOS value score of the roaming user corresponding to the average voice MOS value of the roaming user with the m of more than 3.5 and more than 3 is 60; and the average voice MOS value score of the roaming user corresponding to the average voice MOS value of the roaming user with m <3 is 0.

TABLE 4

Step S223, determining a first user perception result corresponding to the voice service according to one or more of the voice connection success rate, the average call setup duration, the voice drop rate, and the average voice quality value of the local user, and one or more of the voice connection success rate, the average call setup duration, the voice drop rate, and the average voice quality value of the roaming user.

As an implementation manner, the scores corresponding to the voice service data are obtained by combining the step S22A and the step S22B and the queries of the above tables 1 to 4, and the first user perception result is determined.

Specifically, the server determines a local user voice service perception result of the local user for the voice service according to the score corresponding to each voice service data of the local voice service data, and determines a roaming user voice service perception result of the roaming user for the voice service according to the score corresponding to each voice service data of the roaming voice service data.

In detail, the local user voice service perception result is determined according to the local user voice connection success rate score, the local user average call setup duration score, the local user voice call-off rate score and the local user average voice MOS value score, as well as the weight corresponding to the local user voice connection success rate, the weight corresponding to the local user average call setup duration, the weight corresponding to the local user voice call-off rate and the weight corresponding to the local user average voice MOS value.

And determining a roaming user voice service perception result according to the roaming user voice connection success rate score, the roaming user average call setup duration score, the roaming user voice drop rate score and the roaming user average voice MOS value score, as well as the weight corresponding to the roaming user voice connection success rate, the weight corresponding to the roaming user average call setup duration, the weight corresponding to the roaming user voice drop rate and the weight corresponding to the roaming user average voice MOS value.

Illustratively, the following weights are taken as examples: as shown in table 5, the weight corresponding to the local user voice connection success rate is 0.1, the weight corresponding to the local user average call setup time is 0.35, the weight corresponding to the local user voice call drop rate is 0.25, and the weight corresponding to the local user average voice MOS value is 0.3, the weight corresponding to the roaming user voice connection success rate is 0.2, the weight corresponding to the roaming user average call setup time is 0.3, the weight corresponding to the roaming user voice call drop rate is 0.3, and the weight corresponding to the roaming user average voice MOS value is 0.2. The voice service perception result of the local user is 0.1, the voice connection success rate score of the local user +0.35, the average call establishment duration score of the local user +0.25, the voice call drop rate score of the local user +0.3, and the average voice MOS value score of the local user. And the voice service perception result of the roaming user is 0.2, the voice call success rate score of the roaming user +0.3, the average call establishment duration score of the roaming user +0.3, the voice call drop rate score of the roaming user +0.2, the average voice MOS value score of the roaming user.

TABLE 5

It should be noted that, the above-mentioned score of success rate of voice connection of the local user, the score of average call setup duration of the local user, the score of voice dropped call rate of the local user, the score of average voice MOS value of the local user, the score of success rate of voice call of the roaming user, the score of average call setup duration of the roaming user, the score of voice dropped call rate of the roaming user, and the score of average voice MOS value of the roaming user can all obtain corresponding scores by querying the associated tables 1 to 4 after obtaining each voice service data (such as the success rate of voice connection, average call setup duration, voice dropped call rate, and average voice MOS value).

Furthermore, the server calculates a first user perception result according to the local user voice service perception result, a first weight value corresponding to the local user voice service perception result, and a second weight value corresponding to the roaming user voice service perception result and the roaming user voice service perception result.

For example, the first weight value is a1 and the second weight value is a 2. The first user perception result is a1 local user voice service perception result + a2 roaming user voice service perception result.

Alternatively, with reference to fig. 2, as shown in fig. 6, the step S23 may be specifically implemented by the following steps S23A to S23B.

Step S23A, determining one or more items of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user from the local data service data.

Step S23B, determining one or more items of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user from the roaming data service data.

The webpage browsing service data comprises a page display success rate and/or a page average display duration; the game service data comprises RTT uplink average time delay and/or RTT downlink average time delay; the video service data comprises video card pause frequency and/or video average initial cache time delay; the live broadcast service data comprises live broadcast card pause frequency and/or live broadcast average initial play time delay; the FTP download service data comprises an FTP average download rate.

The following is a detailed description of embodiments of each specific data service data related to step S23A and step S23B, and the following includes five aspects of a data service scenario.

And firstly, determining a webpage browsing service perception result of a user in a target area to the webpage browsing service according to the page display success rate and the page average display duration aiming at the webpage browsing service scene.

The page display success rate in the webpage browsing service data refers to the page display success probability when the user in the target area uses the 5G WEB service.

The average display duration of the page in the WEB browsing service data refers to an average delay of successful display of all pages when the user in the target area uses the 5G WEB service. The page display duration refers to the duration between the last data packet of the page and the first packet of the page request when the WEB service is used.

In detail, the page display success rate is determined according to the total page display success times and the total page request times, wherein the page display success rate is positively correlated with the total page display success times, and the page display success rate is negatively correlated with the total page request times.

Illustratively, the page display success rate is 100% of the total number of page display successes/the total number of page requests.

In some embodiments, the total number of times of initiating the page request when the WEB service is used is accumulated, and the total number of times of successfully displaying the page when the WEB service is used is accumulated, so as to obtain the total number of times of requesting the page and the total number of times of successfully displaying the page.

In detail, the average page display duration is determined according to the sum of the page display duration and the total number of page requests. The average page display duration is positively correlated with the page display duration, and the average page display duration is negatively correlated with the total page request times.

In some embodiments, the average page display duration is a ratio of the cumulative sum of the page display durations and the cumulative sum of the page request times when the WEB service is used, within a statistical second preset time period.

Illustratively, the average page display duration is the sum of the page display duration and/or the total number of page requests.

As shown in tables 6 and 7, page display success rates and page average display duration scoring criteria were established. And determining the proportion of the user perception score of the page display success rate and the user perception score of the page average display duration according to the page display success rate and the page average display duration to the usage proportion of the web browsing service. For example, the ratio of the user perception score of the page display success rate and the user perception score of the page average display time length in tables 6 and 7 below is 6 to 4.

Table 6 shows the user perception score criteria for the page display success rate of the local user and the page display success rate of the roaming user.

In detail, when the page display success rate a of the local user is greater than or equal to 98%, the page display success rate score of the local user corresponding to the page display success rate a of the local user greater than or equal to 98% (i.e., the user perception score of the page display success rate a of the local user) is 60; by analogy, the page display success rate score of the local user corresponding to the page display success rate of the local user with 98% > a being more than or equal to 95% is 48; the page display success rate score of the local user corresponding to the page display success rate of the local user with the content of 95% > a being more than or equal to 93% is 36; and the page display success rate score of the local user corresponding to the page display success rate of the local user with a being less than 93 percent is 0.

When the page display success rate a of the roaming user is more than or equal to 98%, the page display success rate score of the roaming user (namely, the user perception score of the page display success rate a of the roaming user) corresponding to the page display success rate a of the roaming user which is more than or equal to 98% is 60; by analogy, the page display success rate score of the roaming user corresponding to the page display success rate of the roaming user with the ratio of 98% > a being more than or equal to 95% is 48; the page display success rate score of the roaming user corresponding to the page display success rate of the roaming user with the ratio of 95% > a being more than or equal to 93%; and the page display success rate score of the roaming user corresponding to the page display success rate of the roaming user with the a being less than 93 percent is 0.

Table 7 shows the user perception score criteria of the average page display duration of the local user and the user perception score criteria of the average page display duration of the roaming user, respectively.

In detail, when the page average display duration b of the local user is less than or equal to 1s, the page average display duration score of the local user corresponding to the page average display duration b of the local user with b less than or equal to 1s (i.e., the user perception score of the page average display duration b of the local user) is 40; by analogy, the average page display duration score of the local user corresponding to the average page display duration of the local user with 1s < b < 2s is 32; the average page display duration score of the local user corresponding to the average page display duration of the local user with the b being more than or equal to 2s and less than or equal to 3s is 24; and b is greater than 3s, and the page average display duration score of the local user corresponding to the page average display duration of the local user is 0.

In detail, when the average page display duration b of the roaming user is less than or equal to 1s, the average page display duration score of the roaming user (i.e., the user perception score of the average page display duration b of the roaming user) corresponding to the average page display duration of the roaming user with b less than or equal to 1s is 40; by analogy, the average page display duration score of the roaming user corresponding to the average page display duration of the roaming user with the b being more than 1s and less than or equal to 2s is 32; the average page display duration score of the roaming user corresponding to the average page display duration of the roaming user with the b being more than 2s and less than or equal to 3s is 24; and b is greater than 3s, and the page average display duration score of the roaming user corresponding to the page average display duration of the roaming user is 0.

TABLE 6

TABLE 7

It should be noted that, after acquiring each web browsing service data, the server may obtain the corresponding home user page display success rate score, home user page average display duration score, roaming user page display success rate score, and roaming user page average display duration score by querying the associated tables 6 to 7.

And further, the server calculates the webpage browsing service perception result according to the local user page display success rate score, the local user page average display duration score, the roaming user page display success rate score and the roaming user page average display duration score.

For example, the third weight value is b1 and the fourth weight value is b 2. The server determines a local user web browsing service sensing result and a roaming user web browsing service sensing result, namely, the local user web browsing service sensing result is the local user page display success rate score plus the local user page average display duration score; and the sensing result of the webpage browsing service of the roaming user is the page display success rate score of the roaming user plus the average page display duration score of the roaming user.

The server further determines a web browsing service sensing result, that is, the web browsing service sensing result is b1 + b 2.

In some embodiments, the server determines the web browsing business perception result by setting the following model. The web browsing service perception result is b1 (the score of the display success rate of the local user page + the score of the average display duration of the local user page) + b2 (the score of the display success rate of the roaming user page + the score of the average display duration of the roaming user page).

Second, for game business scenarios. And determining a game service perception result of the user in the target area to the game service according to the RTT uplink average time delay of the game service data and the RTT downlink average time delay of the game service data.

The RTT uplink average time delay of the game service data refers to an average time delay between an uplink payload packet and a corresponding downlink ACK packet in a TCP flow when the user uses the 5G game service. The RTT downlink average time delay of game service data refers to the average time delay between a downlink payload packet in a TCP stream and its corresponding uplink ACK packet when a user uses a 5G game service.

Optionally, the RTT uplink average delay is determined according to a delay accumulation between an uplink payload packet and a corresponding downlink ACK packet in the game service TCP flow, and a time of the delay accumulation, where the RTT uplink average delay is positively correlated with the delay accumulation between the uplink payload packet and the corresponding downlink ACK packet in the game service TCP flow, and the RTT uplink average delay is negatively correlated with the time of the delay accumulation.

Illustratively, the RTT average delay is equal to the delay accumulation/delay accumulation number between an uplink payload packet and a corresponding downlink ACK packet in the TCP stream of the game service.

In some embodiments, the time delay between an uplink payload packet and a corresponding downlink ACK packet in a game service TCP stream is counted within a second preset time period, and the time delay between the TCP uplink payload packet and the downlink corresponding ACK packet is counted to obtain an RTT downlink average time delay.

Optionally, the RTT downlink average delay is determined according to a delay accumulation between a downlink payload packet and a corresponding uplink ACK packet in the game service TCP flow, and a delay accumulation frequency, where the RTT downlink average delay is positively correlated to the delay accumulation between the downlink payload packet and the corresponding uplink ACK packet in the game service TCP flow, and the RTT downlink average delay is negatively correlated to the delay accumulation frequency.

Illustratively, the RTT is the average delay in the downstream direction, which is the delay accumulation/delay accumulation number between a downstream payload packet and a corresponding upstream ACK packet in a TCP stream of a game service.

In another embodiment, the time delay between the downlink payload packet and the corresponding uplink ACK packet in the game service TCP flow is counted in the second preset time period, and the time delay between the TCP downlink payload packet and the uplink corresponding ACK packet is counted to obtain the downlink average time delay of RTT.

As shown in tables 8 and 9, the established RTT uplink average delay and RTT downlink average delay score criteria of the game service data.

It should be noted that the server may determine the proportion of the user perception score of the RTT uplink average time delay to the user perception score of the RTT downlink average time delay according to the usage proportion of the RTT uplink average time delay and the RTT downlink average time delay of the game service data to the game service. For example, the user perception score of the RTT uplink average delay and the user perception score of the RTT downlink average delay in tables 8 and 9 below are 5 to 5.

Table 8 shows user perception score criteria for RTT uplink average delay of the local user and user perception score criteria for RTT uplink average delay of the roaming user.

In detail, when the RTT uplink average delay c of the local user is less than or equal to 50ms, the RTT uplink average delay score (i.e., the user perception score of the RTT uplink average delay c of the local user) of the local user corresponding to the RTT uplink average delay c of the local user of which c is less than or equal to 50ms is 50; by analogy, the uplink average time delay score of the local user RTT corresponding to the uplink average time delay of the RTT of the local user with the c being more than 50ms and less than or equal to 80ms is 40; the RTT uplink average time delay score of the local user corresponding to the RTT uplink average time delay of the local user with the time of 80ms to c being less than or equal to 120ms is 30; and c, the RTT uplink average time delay score of the local user corresponding to the RTT uplink average time delay of the local user with the time length of more than 120ms is 0.

When the RTT uplink average delay c of the roaming user is less than or equal to 50ms, the RTT uplink average delay score (i.e., the user perception score of the RTT uplink average delay c of the roaming user) corresponding to the RTT uplink average delay of the roaming user of which c is less than or equal to 50ms is 50; by analogy, the uplink average time delay score of the RTT of the roaming user corresponding to the uplink average time delay of the RTT of the roaming user with the time of 50ms to c being less than or equal to 80ms is 40; the average time delay score of the RTT uplink of the roaming user corresponding to the average time delay of the RTT uplink of the roaming user with the time of 80ms to c being less than or equal to 120ms is 30; and c, the uplink average time delay score of the RTT of the roaming user corresponding to the uplink average time delay of the RTT of the roaming user with the time length of more than 120ms is 0.

Table 9 introduces user perception score criteria of RTT uplink average delay of the local user and user perception score criteria of RTT uplink average delay of the roaming user, respectively.

In detail, when the RTT downlink average delay d of the local user is less than or equal to 50ms, the local user RTT downlink average delay score (i.e., the user perception score of the RTT downlink average delay d of the local user) corresponding to the RTT downlink average delay of the local user with d less than or equal to 50ms is 50; by analogy, the downlink average delay score of the local user RTT corresponding to the downlink average delay of the RTT of the local user with d being more than 50ms and less than or equal to 80ms is 40; the RTT downlink average time delay score of the local user corresponding to the RTT downlink average time delay of the local user with the d being more than 80ms and less than or equal to 120ms is 30; and d, the RTT downlink average delay score of the local user corresponding to the RTT downlink average delay of the local user with the ms of more than 120ms is 0.

When the RTT downlink average delay d of the roaming user is less than or equal to 50ms, the RTT downlink average delay score (i.e., the user perception score of the RTT downlink average delay d of the roaming user) corresponding to the RTT downlink average delay of the roaming user with d less than or equal to 50ms is 50; by analogy, the roaming user RTT downlink average delay score corresponding to the RTT downlink average delay of the roaming user with d being more than 50ms and less than or equal to 80ms is 40; the downlink average time delay score of the roaming user RTT corresponding to the downlink average time delay of the RTT of the roaming user with the d being more than 80ms and less than or equal to 120ms is 30; and d, the downlink average time delay score of the RTT of the roaming user corresponding to the downlink average time delay of the RTT of the roaming user with the length of more than 120ms is 0.

TABLE 8

TABLE 9

After obtaining the game service data, the server may obtain corresponding local user RTT uplink average delay score, local user RTT downlink average delay score, roaming user RTT uplink average delay score, and roaming user RTT downlink average delay score by querying associated tables 8 to 9.

And secondly, the server calculates the game service sensing result according to the RTT uplink average time delay score of the local user, the RTT downlink average time delay score of the local user, the RTT uplink average time delay score of the roaming user and the RTT downlink average time delay score of the roaming user.

For example, the third weight value is b1 and the fourth weight value is b 2. The server determines a local user game service sensing result and a roaming user game service sensing result, namely, the local user game service sensing result is equal to a local user RTT uplink average delay score plus a local user RTT downlink average delay score; and the game service perception result of the roaming user is equal to the RTT uplink average time delay score of the roaming user plus the RTT downlink average time delay score of the roaming user.

The server further determines the game service sensing result, i.e., the game service sensing result is b1, the local user game service sensing result + b2, the roaming user game service sensing result.

In some embodiments, the server determines the game business perception result by setting the following model. The game service sensing result is b1 (average time delay score of local user RTT uplink + average time delay score of local user RTT downlink) + b2 (average time delay score of roaming user RTT uplink + average time delay score of roaming user RTT downlink).

And thirdly, determining a video service perception result of the target user to the video service according to the video frequency of video card pause of the video service data and the video average initial cache time delay of the video service data in the video service scene.

The video pause frequency of the video service data refers to the average video playing pause times of a single user per hour when the user uses the 5G video service. The video average initial caching delay of the video service data refers to the average delay of starting playing of the video downloading first package and the video file when the user uses the 5G video service and the video playing is successful.

Optionally, the video blocking frequency is determined according to the total number of times that the video playing is blocked when the video service is used, the total number of users using the video service, and the total video playing duration using the video service, where the video blocking frequency is positively correlated with the total number of times that the video playing is blocked when the video service is used, the video blocking frequency is negatively correlated with the total number of users using the video service, and the video blocking frequency is negatively correlated with the total video playing duration using the video service.

For example, the video pause frequency is the total number of times the video playing card pauses when the video service is used/the total number of users using the video service/the total playing time length of the video using the video service.

In some embodiments, the total number of times of video playing stuck when the video service is used, the total number of users using the video service, and the total video playing time length (e.g., hours) using the video service are obtained by counting the total number of times of video playing stuck when the video service is used, the total number of users using the video service, and the total video playing time length using the video service in the second preset time period.

Specifically, the number of times the statistical play buffer amount is 0 is taken as the video morton number.

Optionally, in other embodiments, the average time delay of starting playing the video download initial packet and the video file when the video is successfully played in the second preset time period is counted, so as to obtain the average initial buffering time delay of the video.

As shown in table 10 and table 11, the video stuck frequency and the video average initial buffering delay score criteria of the video service data are established.

It should be noted that the server may determine the proportion of the user perception score of the video frequency of video blocking and the user perception score of the video average initial cache delay according to the video frequency of video blocking and the video average initial cache delay of the video service data. For example, the user perception scores for video frequency of katon and the user perception scores for average initial buffering delay of video in tables 10 and 11 below are 6 to 4.

The user perception score criteria for the video frequency of the home user and the video frequency of the roaming user are presented in table 10, respectively.

In detail, when the video stuck frequency e of the local user is less than or equal to 2, the video stuck frequency score of the local user corresponding to the video stuck frequency e of the local user with e less than or equal to 2 (i.e. the user perception score of the video stuck frequency e of the local user) is 60; by analogy, the video blocking frequency score of the local user corresponding to the video blocking frequency of the local user with 2< e >4 is 48; the video blocking frequency score of the local user corresponding to the video blocking frequency of the local user with the value of 4< e < 6 is 36; and e >6, the video blocking frequency score of the local user corresponding to the video blocking frequency of the local user is 0.

When the video blocking frequency e of the roaming user is less than or equal to 3, the video blocking frequency score of the roaming user corresponding to the video blocking frequency e of the roaming user with e less than or equal to 3 (namely, the user perception score of the video blocking frequency e of the roaming user) is 60; by analogy, the video blocking frequency score of the roaming user corresponding to the video blocking frequency of the roaming user with 3< e < 5 is 48; the video frequency score of the roaming user corresponding to the video frequency of the roaming user with the e being more than or equal to 5 and less than or equal to 7 is 36; and e >7, the video blocking frequency score of the roaming user corresponding to the video blocking frequency of the roaming user is 0.

Table 11 introduces the user-perceived rating criteria for the average initial video buffering delay of the local user and the user-perceived rating criteria for the average initial video buffering delay of the roaming user.

In detail, when the average initial video caching delay f of the local user is less than or equal to 2s, the average initial video caching delay score of the local user (i.e. the user perception score of the average initial video caching delay f of the local user) corresponding to the average initial video caching delay f of the local user, which is less than or equal to 2s, is 40; by analogy, the average initial cache time delay score of the local user video corresponding to the average initial cache time delay of the local user video with the f being more than 2s and less than or equal to 3s is 32; the average initial cache time delay score of the local user video corresponding to the average initial cache time delay of the local user video with the f being more than 3s and less than or equal to 4s is 24; and f is greater than 4s, and the average initial caching time delay score of the video of the local user corresponding to the average initial caching time delay of the video of the local user is 0.

When the average initial video caching delay f of the roaming user is less than or equal to 3s, the average initial video caching delay score of the roaming user (namely, the user perception score of the average initial video caching delay f of the roaming user) corresponding to the average initial video caching delay f of the roaming user, which is less than or equal to 3s, is 40; by analogy, the average initial cache time delay score of the video of the roaming user corresponding to the average initial cache time delay of the video of the roaming user with f being more than 3s and less than or equal to 4s is 32; the average initial cache time delay score of the video of the roaming user corresponding to the average initial cache time delay of the video of the roaming user with the f being more than 4s and less than or equal to 5s is 24; and f is greater than 5s, and the average initial cache delay score of the video of the roaming user corresponding to the average initial cache delay of the video of the roaming user is 0.

Watch 10

TABLE 11

After obtaining each video service data, the server may obtain the corresponding local user video stuck frequency score, local user video average initial caching delay score, roaming user video stuck frequency score and roaming user video average initial caching delay score by querying the associated tables 8 to 9.

And further, the server calculates a video service perception result according to the local user video card pause frequency score, the local user video average initial cache delay score, the roaming user video card pause frequency score and the roaming user video average initial cache delay score.

For example, the third weight value is b1 and the fourth weight value is b 2. The server determines a local user video service sensing result and a roaming user video service sensing result, namely, the local user video service sensing result is local user video frequency-on-card grading + local user video average initial caching delay grading; and the video service perception result of the roaming user is the video card pause frequency score of the roaming user and the average initial caching delay score of the video of the roaming user.

The server further determines a video service sensing result, that is, the video service sensing result is b1 × local user video service sensing result + b2 × roaming user video service sensing result.

In some embodiments, the server determines the video traffic awareness result by setting the following model. The video service perception result is b1 ═ b (local user video frequency on card score + local user video average initial cache time delay score) + b2 × (roaming user video frequency on card score + roaming user video average initial cache time delay score).

And fourthly, determining a live broadcast service perception result of the user in the target area to the live broadcast service according to the live broadcast card pause frequency of the live broadcast service data and the live broadcast average initial play time delay of the live broadcast service data aiming at the live broadcast service scene.

The live broadcast card pause frequency of the live broadcast service data refers to the average live broadcast card pause times of a single user per hour when the user uses the 5G live broadcast service. The live broadcast average initial play time delay of the live broadcast service data refers to the average waiting time from the time of clicking to the time of starting playing of a video when a user uses a 5G live broadcast service.

Optionally, the live broadcast card pause frequency is determined according to the total number of live broadcast card pause times during live broadcast service, the total number of users using live broadcast service, and the total live broadcast time length during live broadcast service, wherein the live broadcast card pause frequency is positively correlated with the total number of live broadcast card pause times during live broadcast service, the live broadcast card pause frequency is negatively correlated with the total number of users using live broadcast service, and the live broadcast card pause frequency is negatively correlated with the total live broadcast time length during live broadcast service.

In some embodiments, the total number of times of live broadcast card pause, the total number of users using the live broadcast service, and the total live broadcast duration using the live broadcast service in the second preset time period are counted, so as to obtain the total number of times of live broadcast card pause, the total number of users using the live broadcast service, and the total live broadcast duration (e.g., hours) using the live broadcast service.

Specifically, the number of times that the statistical play buffer amount is 0 is taken as the live broadcast stuck number.

The live broadcast card pause frequency is the total number of live broadcast card pauses when using the live broadcast service/the total number of users using the live broadcast service/the total playing time of live broadcast using the live broadcast service.

In other embodiments, the average waiting time from the time of clicking the live broadcast resource to the time of starting playing in the second preset time period is counted, and the average waiting time is used as the average initial playing time delay of the live broadcast.

As shown in table 12 and table 13, the live broadcast katton frequency and the live broadcast average initial play delay scoring criteria of the live broadcast service data are established.

It should be noted that the server may determine the proportion of the user perception score of the live broadcast stuck frequency and the user perception score of the live broadcast average initial play delay according to the influence ratio of the live broadcast stuck frequency and the live broadcast average initial play delay of the live broadcast service data on the live broadcast service. For example, the user perceived scores for the live morton frequency and the live average initial play latency in tables 12 and 13 below are 6 to 4.

The user perception score criteria for the home user's live morton frequency and the roaming user's live morton frequency are presented in table 12, respectively.

In detail, when the live broadcast stuck frequency g of the local user is less than or equal to 2, the live broadcast stuck frequency score of the local user corresponding to the live broadcast stuck frequency g of the local user with g less than or equal to 2 (i.e. the user perception score of the live broadcast stuck frequency g of the local user) is 60; by analogy, the live broadcast stuck frequency score of the local user corresponding to the live broadcast stuck frequency of the local user with the g being more than or equal to 2 and less than or equal to 4 is 48; the local user live broadcast card pause frequency score corresponding to the local user live broadcast card pause frequency score of 4< g < 6 is 36; and g, the live broadcast and blockage frequency score of the local user corresponding to the live broadcast and blockage frequency of the local user with the frequency of 6 is 0.

When the live broadcast card pause frequency g of the roaming user is less than or equal to 3, the live broadcast card pause frequency score of the roaming user corresponding to the live broadcast card pause frequency g of the roaming user with g less than or equal to 3 (namely, the user perception score of the live broadcast card pause frequency g of the roaming user) is 60; by analogy, the score of the live broadcast card pause frequency of the roaming user corresponding to the live broadcast card pause frequency of the roaming user with the g being more than 3 and less than or equal to 5 is 48; the score of the live broadcast card pause frequency of the roaming user corresponding to the live broadcast card pause frequency of the roaming user with the g being more than or equal to 5 and less than or equal to 7 is 36; and g, the score of the live broadcast card pause frequency of the roaming user corresponding to the live broadcast card pause frequency of the roaming user is 0.

Table 13 shows the user perception score criteria of the local user's live broadcast average initial play delay and the user perception score criteria of the roaming user's live broadcast average initial play delay, respectively.

In detail, when the live broadcast average initial play time delay h of the local user is less than or equal to 2s, the live broadcast average initial play time delay score of the local user corresponding to the live broadcast average initial play time delay h of the local user with h less than or equal to 2s (i.e. the user perception score of the live broadcast average initial play time delay h of the local user) is 40; by analogy, the score of the local user live broadcast average initial broadcast time delay corresponding to the local user live broadcast average initial broadcast time delay of 2s < h < 3s is 32; the score of the local user live broadcast average initial broadcast time delay corresponding to the local user live broadcast average initial broadcast time delay of 3s < h < 4s is 24; and the score of the live broadcast average initial broadcast time delay of the local user corresponding to the live broadcast average initial broadcast time delay of the local user with h >4s is 0.

When the live broadcast average initial play time delay h of the roaming user is less than or equal to 3s, the live broadcast average initial play time delay score of the roaming user corresponding to the live broadcast average initial play time delay of the roaming user with h less than or equal to 3s (namely, the user perception score of the live broadcast average initial play time delay h of the roaming user) is 40; by analogy, the roaming user live broadcast average initial broadcast time delay corresponding to the roaming user live broadcast average initial broadcast time delay of the roaming user with h being more than 3s and less than or equal to 4s is scored as 32; the score of the roaming user live broadcast average initial broadcast time delay corresponding to the roaming user live broadcast average initial broadcast time delay of 4s < h < 5s is 24; and the score of the roaming user live broadcast average initial broadcast time delay corresponding to the live broadcast average initial broadcast time delay of the roaming user with h being more than 5s is 0.

TABLE 12

Watch 13

After acquiring each live broadcast service data, the server may obtain a corresponding local user live broadcast stuck frequency score, a local user live broadcast average initial play delay score, a roaming user live broadcast stuck frequency score, and a roaming user live broadcast average initial play delay score by querying the associated tables 12 to 13.

And secondly, the server calculates a live broadcast service sensing result according to the live broadcast card pause frequency score of the local user, the live broadcast average initial play time delay score of the local user, the live broadcast card pause frequency score of the roaming user and the live broadcast average initial play time delay score of the roaming user.

For example, the third weight value is b1 and the fourth weight value is b 2. The server determines a local user live broadcast service sensing result and a roaming user live broadcast service sensing result, namely, the local user live broadcast service sensing result is the local user live broadcast card pause frequency score plus the local user live broadcast average initial play time delay score; and the perception result of the roaming user live broadcast service is the live broadcast card pause frequency score of the roaming user plus the live broadcast average initial broadcast time delay score of the roaming user.

The server further determines a live broadcast service sensing result, that is, the live broadcast service sensing result is b1 and the local user live broadcast service sensing result + b2 and the roaming user live broadcast service sensing result.

In some embodiments, the server determines the live traffic awareness result by setting the following model. And b1 (local user live broadcast frequency score + local user live broadcast average initial play time delay score) + b2 (roaming user live broadcast frequency score + roaming user live broadcast average initial play time delay score).

And the fifth is for FTP download traffic. And taking the average FTP download rate as an evaluation index of FTP download service perception. The average downloading rate of the FTP downloading service data refers to the average downloading rate of the 5G FTP downloading service used by the user.

Optionally, the FTP average download rate is determined according to the size of the downloaded file in the FTP service and the download time of the downloaded file in the FTP service, where the FTP average download rate is positively correlated with the size of the downloaded file in the FTP service, and the FTP average download rate is negatively correlated with the download time of the downloaded file in the FTP service.

Illustratively, the average FTP download rate is the downloaded file size in the FTP service/the downloaded download time in the FTP service.

As shown in table 14, the user-perceived rating criteria for the average FTP download rate of the home user and the average FTP download rate of the roaming user are respectively described.

In detail, when the average FTP download rate i of the local user is greater than or equal to 30MB/s, the average local user FTP download rate score (i.e. the user perception score of the average local user FTP download rate g) corresponding to the average local user FTP download rate i of the local user is greater than or equal to 30MB/s is 100; by analogy, the local user FTP average download rate score corresponding to the local user FTP average download rate of 30MB/s > i ≥ 20MB/s is 80; the average download rate score of the FTP of the local user corresponding to the average download rate of the FTP of the local user with 20MB/s i being more than or equal to 10MB/s is 60; and the average FTP download rate score of the local user corresponding to the average FTP download rate of the local user with i <10MB/s is 0.

When the average FTP download rate i of the roaming user is more than or equal to 25MB/s, the average FTP download rate score of the roaming user (namely, the user perception score of the average FTP download rate g of the roaming user) corresponding to the average FTP download rate i of the roaming user which is more than or equal to 25MB/s is 100; by analogy, the average download rate score of the FTP of the roaming user corresponding to the average download rate of the FTP of the roaming user with the average download rate of more than 25MB/s and i more than or equal to 15MB/s is 80; the average download rate score of the FTP of the roaming user corresponding to the average download rate of the FTP of the roaming user with the i of more than 15MB/s and more than or equal to 10MB/s is 60; the average download rate score of the FTP of the roaming user corresponding to the average download rate of the FTP of the roaming user with i <10MB/s is 0.

TABLE 14

After acquiring each FTP download service data, the server can obtain the corresponding local user FTP average download rate score and roaming user FTP average download rate score by querying the associated table 14.

And further, the server calculates the FTP download service perception result according to the local user FTP average download rate score and the roaming user FTP average download rate score.

For example, the third weight value is b1 and the fourth weight value is b 2.

In some embodiments, the server determines the FTP download service awareness result by setting the following model. FTP download service perception result b1 local user FTP average download rate score + b2 roaming user FTP average download rate score.

Step S23C, determining a second user sensing result corresponding to the data service according to one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user, and one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user.

As an implementation manner, a second user perception result corresponding to the data service is obtained by combining the web browsing service perception result, the game service perception result, the video service perception result, the live broadcast service perception result, the FTP download service perception result, and the web browsing service weight, the game service weight, the video service weight, the live broadcast service weight, and the FTP download service weight obtained by the implementation manners of the first service scenario to the fifth service scenario. The web browsing service weight d1, the game service weight d2, the video service weight d3, the live broadcast service weight d4 and the FTP download service weight d5 may correspond to usage ratios of the data services.

For example, the weight of the web browsing service is 0.1, the weight of the game service is 0.2, the weight of the video service is 0.3, the weight of the live broadcast service is 0.3, and the weight of the FTP download service is 0.1. And the second user perception result corresponding to the data service is 0.1 × web browsing service perception result +0.2 × game service perception result +0.3 × video service perception result +0.3 × live broadcast service perception result +0.1 × FTP downloading service perception result.

With reference to the above embodiment, the step S24 can be embodied according to the following model. The fifth weight value of the voice service is c1, and the sixth weight of the data service is c 2.

The integrated user sensing result corresponding to the 5G mobile service is c1 (a1 + a2 + roaming user voice service sensing result) + c2 (d1 + web browsing service sensing result + d2 + game service sensing result + d3 + video service sensing result + d 4+ live service sensing result + d5 FTP download service sensing result).

As an embodiment, as shown in fig. 7, after determining the user integrated sensing result, the server may further perform the following step S71 to determine the fault type (e.g., integrated fault service, voice fault service, data fault service) of the 5G mobile service according to the user integrated sensing result.

And step S71, comparing the user comprehensive perception result with the user comprehensive perception threshold value.

And step S72, when the user comprehensive perception result corresponding to the 5G mobile service is smaller than the user comprehensive perception threshold, determining the 5G mobile service as a comprehensive fault service.

And step S73, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user comprehensive perception threshold and the first user perception result is less than the user voice perception threshold, determining the 5G mobile service as the voice fault service.

Step S74, when the user comprehensive perception result corresponding to the 5G mobile service is larger than the user comprehensive perception threshold and the second user perception result is smaller than the user data service perception threshold, the 5G mobile service is determined as the data failure service.

In some embodiments, when the 5G mobile service is determined to be a comprehensive failure service, an early warning of the comprehensive failure service is issued, and it is necessary to process the voice service and the data service at the same time. And when the 5G mobile service is determined to be the voice fault service, sending the voice fault service, and only processing the voice service. And when the 5G mobile service is determined to be the data failure service, sending out early warning of the data failure service, and only processing the data service.

In the embodiment, different fault types can be determined, so that different early warnings can be sent according to different fault types, different types of faults can be processed in a targeted manner, and the speed of processing fault services is guaranteed.

As an embodiment, in conjunction with fig. 2, as shown in fig. 8, before step S21, step S81 may separate the home user and the roaming user in the following manner.

Step S81, according to the identifier of the target area, the home subscriber and the roaming subscriber are separated from the XDR data.

Wherein the identification of the target area may be obtained from the MSISDN field.

In detail, the MSISDN is composed of CC, NDC, and SN, that is, MSISDN is CC + NDC + SN, such as 86185H 0H1H2H3ABCD, where CC is an area code and the area code of a country is 86, i.e., a domestic user and an international roaming user can be distinguished according to the area code; NDC: a code indicating a domestic destination, which is assigned to each network operator by a communication administration of each region; the SN is a client number, is allocated by an operator, generally adopts the first four digits H0H1H2H3 of the SN to represent a home city of a user, and can separate a local user from a roaming user according to the MSISDN field and a home table of the number segment of the home city of the operator.

Specifically, according to a target area (province, city, etc.) perceived by the 5G mobile service, the MSISDN field in the XDR data and the operator city number segment attribution table are combined to separate the users of the target area, and the users of the target area are divided into local users and roaming users.

Illustratively, when the CC area code is not equal to 86 in the MSISDN field in the XDR data, marking as an international roaming user, and rejecting the XDR record of the user; and matching the NDC and the first four digits of SN H0H1H2H3 in the MSISDN field with the result of the affiliation table of the local number section of the operator, wherein the matched result is marked as a local user, and the unmatched result is marked as a roaming user.

In one embodiment, as shown in fig. 9, the failure determination process for the 5G mobile service is as follows:

(1) and (6) acquiring data. Specifically, the server periodically acquires data from the stored XDR ticket.

(2) And (4) screening data. Specifically, data service data and voice service data associated with the 5G mobile service are screened from data acquired from an XDR ticket.

(3) And (6) separating data. Specifically, the data service data in (2) is separated into local user data service data and roaming user data service data; and separating the voice service data in the step (2) into the local user voice service data and the roaming user voice service data.

(4) Evaluating data traffic and evaluating voice traffic. Specifically, a first user perception result is determined according to local user data service data and roaming user data service data; and determining a second user perception result according to the local user voice service data and the roaming user voice service data.

(5) And comprehensively evaluating the 5G mobile service. Specifically, a user comprehensive perception result is determined according to a first user perception result and a second user perception result.

(6) And automatically early warning 5G mobile services. Specifically, the fault type to which the 5G mobile service belongs is checked according to the comprehensive perception result of the user.

In order to implement the above functions, the user perception determining means includes hardware structures and/or software modules corresponding to the respective functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative algorithm steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

The embodiment of the present disclosure further provides a user perception determining apparatus 11 for 5G mobile services as shown in fig. 10, where the 5G mobile services include a voice service and a data service, and the apparatus includes: an acquisition unit 111, a first determination unit 112, a second determination unit 113, and a third determination unit 114.

An obtaining unit 111 configured to perform obtaining local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area; a first determining unit 112 configured to perform determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data; a second determining unit 113 configured to perform determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data; and a third determining unit 114 configured to determine a user comprehensive sensing result corresponding to the 5G mobile service according to the first user sensing result and the second user sensing result.

In a possible implementation, the first determining unit 112 is configured to specifically perform: determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a local user from local voice service data; determining one or more items of a voice connection success rate, an average call setup duration, a voice call drop rate and an average voice quality value of a roaming user from roaming voice service data; and determining a first user perception result corresponding to the voice service according to one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the local user and one or more of the voice connection success rate, the average call establishment duration, the voice drop rate and the average voice quality value of the roaming user.

In a possible implementation, the second determining unit 113 is configured to specifically perform: determining one or more items of web browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a local user from the local data service data; determining one or more items of webpage browsing service data, game service data, video service data, live broadcast service data and FTP download service data of a roaming user from the roaming data service data; and determining a second user perception result corresponding to the data service according to one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user and one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user.

In one possible implementation, the web browsing service data includes a page display success rate and/or a page average display duration; the game service data comprises RTT uplink average time delay and/or RTT downlink average time delay; the video service data comprises video card pause frequency and/or video average initial cache time delay; the live broadcast service data comprises live broadcast card pause frequency and/or live broadcast average initial play time delay; the FTP download service data comprises an FTP average download rate.

In a possible implementation manner, an embodiment of the present disclosure further provides a user perception determining apparatus for a 5G mobile service as shown in fig. 11, where the apparatus further includes: an early warning unit 115 configured to perform: when the user comprehensive perception result corresponding to the 5G mobile service is smaller than the user comprehensive perception threshold value, determining the 5G mobile service as a comprehensive fault service; or when the user comprehensive perception result corresponding to the 5G mobile service is larger than the user comprehensive perception threshold and the first user perception result is smaller than the user voice perception threshold, determining the 5G mobile service as a voice fault service; or, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user perception threshold and the second user perception result is less than the user data service perception threshold, determining the 5G mobile service as the data failure service.

In a possible implementation manner, an embodiment of the present disclosure further provides a user perception determining apparatus for a 5G mobile service as shown in fig. 12, where the apparatus further includes: a separation unit 116 configured to perform: according to the identification of the target area, the local user and the roaming user are separated from the XDR data.

With regard to the apparatus in the above-described embodiment, the specific manner in which each unit module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated herein.

Fig. 13 is a schematic diagram of an electronic device provided by the present disclosure. As in fig. 13, the electronic device 50 may include at least one processor 501 and a memory 503 for storing processor-executable instructions. Wherein the processor 501 is configured to execute instructions in the memory 503 to implement the user perception determination method in the following embodiments.

Additionally, the electronic device 50 may also include a communication bus 502, at least one communication interface 504, an input device 506, and an output device 505.

The processor 501 may be a Central Processing Unit (CPU), a micro-processing unit, an ASIC, or one or more integrated circuits for controlling the execution of programs according to the present disclosure.

The communication bus 502 may include a path that conveys information between the aforementioned components.

The communication interface 504 may be any device, such as a transceiver, for communicating with other devices or communication networks, such as an ethernet, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), etc.

An input device 506 is used to receive input signals and an output device 505 is used to output signals.

The memory 503 may be, but is not limited to, a read-only memory (ROM) or other type of static storage device that may store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that may store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be self-contained and connected to the processing unit by a bus. The memory may also be integrated with the processing unit.

The memory 503 is used for storing instructions for executing the disclosed solution, and is controlled by the processor 501. The processor 501 is configured to execute instructions stored in the memory 503 to implement the functions in the disclosed methods.

In particular implementations, processor 501 may include one or more CPUs such as CPU0 and CPU1 in fig. 13 as an example.

In particular implementations, electronic device 10 may include multiple processors, such as processor 501 and processor 507 in FIG. 13, for example, as an example. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor herein may refer to one or more devices, circuits, and/or processing cores that process data (e.g., computer program instructions).

The electronic device includes, as shown in fig. 13: a processor 501 and a memory 503 for storing instructions executable by the processor 501; wherein the processor 501 is configured to execute executable instructions to implement the user perception determination method as described in any one of the possible embodiments above. And the same technical effect can be achieved, and in order to avoid repetition, the description is omitted here.

Embodiments of the present disclosure also provide a computer-readable storage medium, where instructions of the computer-readable storage medium, when executed by a processor of a user perception determining apparatus or an electronic device, enable the user perception determining apparatus or the electronic device to perform the user perception determining method according to any one of the above possible embodiments. And the same technical effect can be achieved, and in order to avoid repetition, the description is omitted.

Embodiments of the present disclosure also provide a computer program product, which includes a computer program or instructions, and the computer program or instructions are executed by a processor to perform the user perception determination method according to any one of the above possible embodiments. And the same technical effect can be achieved, and in order to avoid repetition, the description is omitted.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for determining user perception of 5G mobile services, wherein the 5G mobile services include voice services and data services, the method comprising:

acquiring local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area;

determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data;

determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data;

and determining a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

2. The method of claim 1, wherein the determining a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data comprises:

determining one or more of the voice connection success rate, the average call setup duration, the voice call drop rate and the average voice quality value of the local user from the local voice service data;

determining one or more of the voice connection success rate, the average call setup duration, the voice call drop rate and the average voice quality value of the roaming user from the roaming voice service data;

and determining a first user perception result corresponding to the voice service according to one or more of the voice connection success rate, the average call setup duration, the voice drop rate and the average voice quality value of the local user and one or more of the voice connection success rate, the average call setup duration, the voice drop rate and the average voice quality value of the roaming user.

3. The method according to claim 1, wherein the determining a second user awareness result corresponding to the data service according to the local data service data and the roaming data service data includes:

determining one or more items of web browsing service data, game service data, video service data, live broadcast service data and FTP download service data of the local user from the local data service data;

determining one or more of web browsing service data, game service data, video service data, live broadcast service data and FTP download service data of the roaming user from the roaming data service data;

and determining a second user perception result corresponding to the data service according to one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the local user and one or more of the web browsing service data, the game service data, the video service data, the live broadcast service data and the FTP download service data of the roaming user.

4. The method according to claim 3, wherein the web browsing service data includes a page display success rate and/or a page average display duration; the game service data comprises RTT uplink average time delay and/or RTT downlink average time delay; the video service data comprises video pause frequency and/or video average initial cache time delay; the live broadcast service data comprises live broadcast pause frequency and/or live broadcast average initial play time delay; the FTP downloading service data comprises an FTP average downloading rate.

5. The method of determining user perception according to any of claims 1 to 4, further comprising:

when the user comprehensive perception result corresponding to the 5G mobile service is smaller than a user comprehensive perception threshold value, determining the 5G mobile service as a comprehensive fault service;

or, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user comprehensive perception threshold and the first user perception result is less than the user voice perception threshold, determining the 5G mobile service as a voice fault service;

or, when the user comprehensive perception result corresponding to the 5G mobile service is greater than the user comprehensive perception threshold and the second user perception result is less than the user data service perception threshold, determining the 5G mobile service as a data failure service.

6. The method of determining user perception according to any of claims 1 to 4, further comprising:

and separating the local user and the roaming user from XDR data according to the identification of the target area.

7. An apparatus for determining user perception of a 5G mobile service, wherein the 5G mobile service includes a voice service and a data service, the apparatus comprising:

the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire local voice service data and local data service data of a local user in a target area, and roaming voice service data and roaming data service data of a roaming user in the target area;

a first determining unit configured to determine a first user perception result corresponding to the voice service according to the local voice service data and the roaming voice service data;

a second determining unit configured to perform determining a second user perception result corresponding to the data service according to the local data service data and the roaming data service data;

and the third determining unit is configured to determine a user comprehensive perception result corresponding to the 5G mobile service according to the first user perception result and the second user perception result.

8. An electronic device, comprising:

a processor and a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions to implement the user perception determination method as claimed in any one of claims 1 to 6.

9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the user perception determination method of any of claims 1-6.

10. A computer program product comprising a computer program or instructions, characterized in that the computer program or instructions, when executed by a processor, implement the user perception determination method of any of claims 1 to 6.