CN118337653A - Service quality evaluation method and device, electronic equipment and storage medium - Google Patents

Abstract

The application provides a service quality evaluation method, a device, electronic equipment and a storage medium, relates to the technical field of communication, and solves the technical problem that the accuracy of service quality evaluation is low because the network quality of a certain data stream is used for evaluating the network quality of a service. The method comprises the following steps: determining a packet sending rule of a target service based on historical parameters of the target service; the packet sending rule is used for characterizing a rule that the first equipment sends a test data packet to the second equipment; transmitting the packing rule to the first device; acquiring test data of the target service; and determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

Description

Service quality evaluation method and device, electronic equipment and storage medium

Technical Field

The present application relates to the field of communications technologies, and in particular, to a method and apparatus for evaluating service quality, an electronic device, and a storage medium.

Background

Currently, when evaluating the network quality of a service, the network quality of the service may be evaluated according to the network quality of a certain data flow in the data transmission process of the service.

However, in the above method, in the service transmission process, the network quality of the data flows with different data sizes may be different, and the accuracy of the service quality assessment may be lower when the network quality of the service is assessed based on the network quality of a certain data flow.

Disclosure of Invention

The application provides a service quality evaluation method, a device, electronic equipment and a storage medium, which solve the technical problem that the accuracy of service quality evaluation is low because the network quality of a certain data stream is used for evaluating the network quality of the service.

In a first aspect, the present application provides a method for evaluating quality of service, including: determining a packet sending rule of a target service based on historical parameters of the target service; wherein the history parameter comprises at least one of: parameters of the historical data packet and Service Level Agreement (SLA) parameters; the packet sending rule is used for characterizing a rule that the first equipment sends a test data packet to the second equipment; transmitting the packing rule to the first device; acquiring test data of the target service, wherein the test data of the target service is the test data for testing the test data packet sent by the first equipment to the second equipment; and determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

Optionally, the history parameter includes a parameter of the history data packet, where the parameter of the history data packet includes a size of the history data packet, an average packet sending interval of the history data packet, and a packet sending duration of the history data packet, and the determining the packet sending rule of the target service based on the history parameter of the target service specifically includes: determining at least one data quantity and a packet sending duration corresponding to the at least one data quantity respectively based on the size of the historical data packet, wherein the at least one data quantity comprises the data quantity of the largest data packet, the data quantity of the smallest data packet and the average data quantity of the historical data packet in the historical data packet; the method further includes determining the packing rule based on the at least one data volume, a packing duration corresponding to each of the at least one data volume, and the average packing interval.

Optionally, the evaluation index of the target service includes at least one of the following: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate.

Optionally, the test data of the target service includes at least one of the following: the packet loss number, the packet receiving number, the packet sending time of each test data packet, the packet returning time of each test data packet, the packet receiving time of each test data packet, the video duration, the video blocking duration and the video blocking times.

Optionally, before determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service, the method further includes: and determining an evaluation index of the target service based on the service type of the target service.

Optionally, determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service specifically includes: determining a value of each evaluation index based on the test data; and determining the service quality of the target service based on the value of each evaluation index.

Optionally, the method further comprises: acquiring the signal quality of a transmitting end of the target service; and transmitting the signal quality of the transmitting end to the first device, so that the first device transmits the test data packet to the second device based on the signal quality of the transmitting end.

In a second aspect, the present application provides a service quality assessment apparatus, including: the device comprises a determining module, a sending module and an obtaining module; the determining module is used for determining a packet sending rule of the target service based on the historical parameters of the target service; wherein the history parameter comprises at least one of: parameters of the historical data packet and SLA parameters; the packet sending rule is used for characterizing a rule that the first equipment sends a test data packet to the second equipment; the sending module is used for sending the packet sending rule to the first equipment; the acquisition module is used for acquiring the test data of the target service, wherein the test data of the target service is the test data for testing the test data packet sent by the first equipment to the second equipment; the determining module is further configured to determine a service quality of the target service based on the test data of the target service and an evaluation index of the target service.

Optionally, the above-mentioned history parameter includes a parameter of the history data packet, where the parameter of the history data packet includes a size of the history data packet, an average packet sending interval of the history data packet, and a packet sending duration of the history data packet, and the determining module is specifically configured to determine at least one data amount and a packet sending duration corresponding to the at least one data amount respectively based on the size of the history data packet, where the at least one data amount includes a data amount of a maximum data packet, a data amount of a minimum data packet, and an average data amount of the history data packet in the history data packet; the determining module is further specifically configured to determine the packet sending rule based on the at least one data amount, the packet sending duration corresponding to the at least one data amount, and the average packet sending interval.

Optionally, the evaluation index of the target service includes at least one of the following: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate.

Optionally, the test data of the target service includes at least one of the following: the packet loss number, the packet receiving number, the packet sending time of each test data packet, the packet returning time of each test data packet, the packet receiving time of each test data packet, the video duration, the video blocking duration and the video blocking times.

Optionally, the determining module is further configured to determine an evaluation index of the target service based on the service type of the target service.

Optionally, the determining module is specifically configured to determine a value of each evaluation index based on the test data; the determining module is further specifically configured to determine a service quality of the target service based on the value of each evaluation index.

Optionally, the acquiring module is further configured to acquire signal quality of a transmitting end of the target service; the sending module is further configured to send the signal quality of the sending end to the first device, so that the first device sends the test data packet to the second device based on the signal quality of the sending end.

In a third aspect, the present application provides an electronic device comprising: a processor and a memory configured to store processor-executable instructions; wherein the processor is configured to execute the instructions to implement any of the above-described optional quality of service assessment methods of the first aspect.

In a fourth aspect, the present application provides a computer readable storage medium having instructions stored thereon which, when executed by an electronic device, enable the electronic device to perform any one of the above-described optional quality of service assessment methods.

In a fifth aspect, the application provides a computer program product comprising computer instructions which, when run on a processor of an electronic device, enable the electronic device to perform the selectable model update method of any one of the first aspects above.

According to the service quality evaluation method, the device, the electronic equipment and the storage medium, the electronic equipment can determine the packet sending rule of the target service based on the historical parameters of the target service; and sending the packing rule to the first device; and then acquiring test data of the target service, and determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service. In the application, because the packet sending rule is determined based on the historical parameters of the target service, and the historical parameters comprise parameters of historical data packets and/or SLA parameters, after the electronic equipment sends the packet sending rule to the first equipment, the first equipment can accurately simulate the data packet generated by the target service based on the packet sending rule to obtain more accurate test data, and because the evaluation index of the target service is an index for evaluating the service quality of the target service, the electronic equipment can accurately evaluate the service quality of the target service based on the more accurate test data and the evaluation index of the target service, thereby improving the service evaluation accuracy.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a schematic diagram of a network architecture of a service quality evaluation system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

Fig. 3 is a flow chart of a method for evaluating service quality according to an embodiment of the present application;

fig. 4 is a flow chart of another method for evaluating quality of service according to an embodiment of the present application;

fig. 5 is a flow chart of another method for evaluating quality of service according to an embodiment of the present application;

fig. 6 is a flow chart of another method for evaluating quality of service according to an embodiment of the present application;

Fig. 7 is a schematic structural diagram of a service quality evaluation device according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of another service quality evaluation device according to an embodiment of the present application.

Detailed Description

The method, the device, the electronic equipment and the storage medium for evaluating the service quality provided by the embodiment of the application are described in detail below with reference to the accompanying drawings.

The terms "first" and "second" and the like in the description and in the drawings of the present application are used for distinguishing between different objects and not for describing a particular sequential order of objects, e.g., a first device and a second device, etc. are used for distinguishing between different devices and not for describing a particular sequential order of devices.

Furthermore, references to the terms "comprising" and "having" and any variations thereof in the description of the present application are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed but may optionally include other steps or elements not listed or inherent to such process, method, article, or apparatus.

It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment of the present application is not to be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

The term "and/or" in the present application includes the use of either or both of these methods.

In the description of the present application, unless otherwise indicated, the meaning of "a plurality" means two or more.

The following explains some concepts related to a service quality evaluation method, a device, an electronic device and a storage medium provided by the embodiments of the present application.

With the development of intelligent manufacturing, more and more industry applications use a mobile network mainly based on 5G as a transmission medium to meet the performance requirements of large bandwidth, low time delay, high reliability and wireless connection.

The 5G technology and standard considers the communication requirements of industry such as high bandwidth, high real-time, high reliability and high safety at the beginning of design. In the early days, 5G industry applications were primarily large bandwidth data transfer type applications, such as real-time image and video type applications. The 3GPP freezes the second version R16 and the third version R17 of 5G respectively in 7 months 2020 and 6 months 2022, and further enhances the application capability of the 5G service industry, wherein the characteristic of 5G ultra-reliable low-delay communication URLLC is continuously mature, and related applications gradually start to enter the man-machine interface control and the field real-time control of the industrial automation control from the man-machine remote control of a single link. Ext> withext> theext> continuedext> evolutionext> ofext> theext> subsequentext> versionsext> ofext> theext> 3ext> GPPext> standardsext>,ext> theext> capabilitiesext> ofext> theext> mobileext> networkext> serviceext> industriesext>,ext> suchext> asext> 5ext> Gext> /ext> 5ext> Gext> -ext> Aext> /ext> 6ext> Gext>,ext> willext> continueext> toext> increaseext>.ext>

Ext> withext> theext> rapidext> developmentext> ofext> mobileext> communicationext> technologiesext> suchext> asext> 5ext> Gext> /ext> 5ext> Gext> -ext> Aext> /ext> 6ext> Gext> andext> theext> likeext> andext> gradualext> commercialext> deploymentext> andext> popularizationext> ofext> privateext> networksext> inext> theext> 5ext> Gext> industryext>,ext> theext> appealext> ofext> industryext> usersext> toext> 5ext> Gext> networkext> servicesext> hasext> beenext> changedext> fromext> purelyext> focusingext> onext> newext> technologyext> innovationext> andext> testext> pointext> applicationext> toext> focusingext> onext> howext> toext> ensureext> theext> realext> landingext> ofext> 5ext> G+ext> industryext> applicationext> andext> theext> experienceext> guaranteeext> ofext> actualext> commercialext> perceptionext>.ext>

In evaluating network quality for 5g+ industry applications, it is often necessary to perform evaluation in conjunction with the perception of an actual service SLA, for example, for low latency class services, accurate measurement and accurate evaluation of latency have become an important issue. The current industry application has strict requirements on time delay, reliability and bandwidth, while the planning and construction of the traditional ToC network are insensitive to time delay and the like, and the network quality index system and the evaluation method of the traditional ToC are not suitable for network quality evaluation for the industry application. Aiming at business characteristics of industry application, a new network quality index system and an evaluation method are required to be introduced, and whether an associated mobile network applied to 5G+ industry can provide a load bearing requirement meeting business is evaluated.

Based on the description in the background art, since the related art evaluates the network quality of the service based on the network quality of a certain data flow, the accuracy of the service quality evaluation may be low. Based on this, the embodiment of the application provides a service quality evaluation method, a device, an electronic device and a storage medium, because the packet sending rule is determined based on the historical parameters of the target service, and the historical parameters include the parameters of the historical data packet and/or the SLA parameters, after the electronic device sends the packet sending rule to the first device, the first device can accurately simulate the data packet generated by the target service based on the packet sending rule to obtain more accurate test data, and because the evaluation index of the target service is the index for evaluating the service quality of the target service, the electronic device can accurately evaluate the service quality of the target service based on the more accurate test data and the evaluation index of the target service, thereby improving the accuracy of service evaluation.

The method, the device, the electronic equipment and the storage medium for evaluating the service quality provided by the embodiment of the application can be applied to a service quality evaluation system, and as shown in fig. 1, the service quality evaluation system comprises equipment 101, equipment 102 and equipment 103. In general, in practical application, the connection between the above devices may be a wireless connection, and for convenience and intuitionistic representation of the connection relationship between the devices, a solid line is used in fig. 1 to illustrate.

Wherein device 101 may determine a packing rule for a target service based on historical parameters of the target service and send the packing rule to device 102. Device 102 may send test data packets to device 102 based on the packet sending rules sent by device 101 and generate test data. Device 103 may receive test packets sent by device 102. The device 101 may also determine the quality of service of the target service based on the test data and the evaluation index of the target service.

As shown in fig. 2, in an implementation manner of the embodiment of the present application, an electronic device executing the service quality evaluation method provided by the embodiment of the present application may include an application information management module, a test configuration module, a result statistics module, a result display module, and a comprehensive evaluation module.

Specifically, the application information management module is configured to store a service class, a service scenario, location information of a sending end device, location information of a receiving end device, and SLA parameters of a target service.

The test configuration module is used for determining a packing rule of the target service, determining an evaluation index of the target service and determining deployment of the first equipment and the second equipment.

The result statistics module is used for obtaining the test data of the target service and determining the value of each evaluation index.

The result display module is used for displaying the test data and the value of each evaluation index.

The comprehensive evaluation module is used for evaluating the service quality of the target service, the service quality of the transmitting terminal equipment and the service quality of the service scene based on the value of the evaluation index.

The service quality evaluation method, the device, the electronic equipment and the storage medium provided by the embodiment of the application are applied to a scene of service quality evaluation, and when the service quality of one service needs to be evaluated, the electronic equipment can determine the packet sending rule of the target service based on the historical parameters of the target service; and sending the packing rule to the first device; then obtaining test data for testing the test data packet sent by the first equipment to the second equipment; and finally, determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

As shown in fig. 3, the service quality evaluation method provided in the embodiment of the present application may include S301-S304.

S301, the electronic equipment determines a packing rule of the target service based on the historical parameters of the target service.

Wherein the history parameter comprises at least one of: parameters of the historical data packet and SLA parameters; the packet sending rule is used for characterizing a rule that the first device sends a test data packet to the second device.

It should be understood that the historical parameter of the target service is a parameter when the target service transmits data in a historical time period, the parameter of the historical data packet is a parameter of a data packet included in the data stream when the target service transmits data, and the SLA parameter is a parameter included in a service requirement corresponding to a service level of the target service.

Alternatively, the parameters of the historical data packet may include the size of the historical data packet, the packet-sending time interval of the historical data packet, the packet-sending time period of the historical data stream, and so on.

Optionally, the SLA parameters may include uplink user rate, downlink user rate, latency reliability, and the like.

It should be understood that the packet sending rule of the target service is a rule that the electronic device sends a data packet when performing a simulation test on the service quality of the target service.

In an alternative implementation, the electronic device may obtain the historical parameters of the target service based on the service identification of the target service.

S302, the electronic device sends a package sending rule to the first device.

It should be understood that the first device is a device that tests the target traffic.

It should be understood that after the first device receives the packet sending rule, a test data packet may be sent to the second device based on the packet sending rule, and the test data of the current test may be obtained.

It may be understood that the target service is a service performed between a sending end device (e.g. a user device) and a receiving end device (e.g. a cloud end device), where the first device is used to simulate the sending end device of the target service, and the second device is used to simulate the receiving end device of the target service.

In the embodiment of the application, the first equipment and the second equipment support mu s-level clock synchronization and ms-level packet transmission simulation, and the test data are the test data recorded by the first equipment and the test data recorded by the second equipment.

In one implementation manner of the embodiment of the present application, the electronic device may acquire the location information of the sending end device and the location information of the receiving end device, the first device may be disposed at the location information of the sending end device, the second device may be disposed at the location information of the receiving end device, and then the first device may send a test data packet to the second device.

In an alternative implementation, the first device may initiate a ping service to the second device first to verify whether the network can ping; and testing the target service under the condition of network ping.

Optionally, in the case that the network cannot be ping enabled, the first device may issue an alarm message and no longer continue to test the target service.

S303, the electronic equipment acquires test data of the target service.

The test data of the target service is the test data for testing the test data packet sent by the first device to the second device.

It should be appreciated that the electronic device may obtain the test data from the first device as well as the second device.

Optionally, the test data may further include a time when the first device sends the test data packet, a time when the second device receives each test data packet, and a time when the first device receives a packet corresponding to each test data packet of the second device.

S304, the electronic equipment determines the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

It should be understood that the evaluation index of the target service is an index for evaluating the service quality of the target service, and the electronic device may determine the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

The technical scheme provided by the embodiment at least has the following beneficial effects: as known from S301-S304, the electronic device may determine a packing rule of the target service based on the historical parameters of the target service; and sending the packing rule to the first device; and then acquiring test data of the target service, and determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service. In the embodiment of the application, because the packet sending rule is determined based on the historical parameters of the target service, and the historical parameters comprise the parameters of the historical data packet and/or the SLA parameters, after the electronic equipment sends the packet sending rule to the first equipment, the first equipment can accurately simulate the data packet generated by the target service based on the packet sending rule to obtain more accurate test data, and because the evaluation index of the target service is the index for evaluating the service quality of the target service, the electronic equipment can accurately evaluate the service quality of the target service based on the more accurate test data and the evaluation index of the target service, thereby improving the accuracy of service evaluation.

In one implementation manner of the embodiment of the present application, the evaluation index of the target service includes at least one of the following: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate.

It can be understood that, based on the evaluation index, the electronic device can evaluate the service quality of the target service in terms of delay, reliability, katon and the like, and particularly can accurately evaluate the delay of the target service from multiple angles, thereby improving the effectiveness of service quality evaluation of low-delay services.

In an implementation manner of the embodiment of the present application, the test data of the target service includes at least one of the following: the packet loss number, the packet sending time of each test data packet, the packet returning time of each test data packet, the packet receiving time of each test data packet, the video duration, the video blocking duration and the video blocking times.

In the embodiment of the present application, a transmitting probe and a receiving probe may be deployed in the first device and the second device, where the transmitting probe in the first device may record a time when each test data packet is sent out, the receiving probe in the first device may record a time when each return packet is received, the receiving probe in the second device may record a time when each test data packet is received, and the transmitting probe in the second device may record a time when each return packet of each test data packet is sent out.

Optionally, the first device may record the time of receiving the packet of each test data packet, when the packet of each test data packet is not received within a preset time period, the first device may determine that the transmission of the current test data packet fails, at this time, the first device may determine that the packet loss number is increased by one, and when the packet of each test data packet is received within the preset time period, the first device may determine that the transmission of the current test data packet is successful, and determine that the packet receiving number is increased by one.

Alternatively, the first device may notify the packet loss counter to increment, or notify the received packet counter to increment.

Alternatively, the packet loss counter and the received packet counter may be disposed on the electronic device.

Optionally, the preset duration may be a preset duration included in the packet-sending rule.

It can be understood that, when the target service is a video service, the test data packet is used for playing a video, and at this time, the electronic device may further record a playing duration, a playing start time, a playing end time, a video clip duration, a video clip number, and the like of the video.

It can be understood that the electronic device can calculate the value corresponding to the evaluation index of the target service based on the test data.

In an implementation manner of the embodiment of the present application, the history parameter includes a parameter of the history data packet, where the parameter of the history data packet includes a size of the history data packet, an average packet sending interval of the history data packet, and a packet sending duration of the history data packet, and the step S301 may be specifically implemented through steps a to B.

And step A, the electronic equipment determines at least one data volume and at least one packet sending duration corresponding to the data volume respectively based on the size of the historical data packet.

Wherein the at least one data amount includes a maximum data amount of the historical data packets, a minimum data amount of the historical data packets, and an average data amount of the historical data packets.

It should be appreciated that the number of historical data packets is plural, and the electronic device may determine the data amount of each historical data packet and then determine the maximum, minimum, and average of the plurality of historical data packets.

Optionally, the electronic device may further determine a data amount of the first n bits, and then determine the data amount as one of the at least one data amount, where n is a positive integer.

Optionally, the electronic device may further determine the value of n based on the traffic distribution period of the target service, where the value of n is greater (e.g., greater than 100) and where the traffic distribution period of the target service is a period of high traffic concentration, where the value of n is less (e.g., less than 50).

In the embodiment of the application, when the target service is tested, the data packets with the at least one data volume can be tested respectively, and the electronic equipment can determine the packet sending duration corresponding to each data volume.

In an alternative implementation manner, the electronic device may determine to perform a short-time test on a test data packet with a maximum value, a minimum value, and an average value of data amounts, and perform a long-time test on a test data packet corresponding to the data amount of the first n bits.

Illustratively, the short test may be 30 minutes and the long test may be 8 hours.

And B, the electronic equipment determines a package sending rule based on at least one data volume, the package sending duration corresponding to the at least one data volume and the average package sending interval.

It should be appreciated that the packet-issuing rule is configured to instruct the first device to send the test data packet to the second device based on the at least one data volume, the packet-issuing duration corresponding to each of the at least one data volume, and the average packet-issuing interval.

It will be appreciated that one data volume corresponds to one data stream, and the first device may determine the data packet size of each data stream, the packet duration of each data stream, and the packet interval of each data stream based on the packet transmission rule.

Based on the methods provided in the above steps a and B, the first device may test the maximum data amount, the minimum data amount, and the average data amount generated in the target service based on the packet sending rule, to obtain test data corresponding to each data amount, and further based on the test data, may evaluate the service quality of the target service more accurately.

In one implementation manner of the embodiment of the present application, the history parameter includes an SLA parameter, and the step S301 may be specifically implemented through step C to step D.

And C, the electronic equipment determines a preset duration based on the SLA parameters.

It should be understood that the preset duration is used for determining whether to receive the packet of the test data packet, and when the packet of the test data packet is received in the preset duration, the packet of the test data packet is determined to be received, and when the packet of the test data packet is not received in the preset duration, the packet of the test data packet is determined to not be received.

In an alternative implementation, the SLA parameter includes a service level, and the electronic device may determine the preset duration based on a level threshold correspondence.

Illustratively, table 1 is an example of a rank threshold correspondence.

TABLE 1

Service class	Preset time (ms)
		SLA1	100
SLA2	50
		SLA3	20
SLA4	10
		SLA5	4

For example, as shown in table 1, assuming that the service level of the target service is SLA2, the electronic device may determine that the preset duration is 50ms.

Optionally, the electronic device may also determine a delay interval corresponding to the service class of the target service based on the class delay corresponding relationship, and then determine an upper limit of the delay interval as the preset duration.

Illustratively, table 2 is an example of a class delay correspondence.

TABLE 2

Service class	Time delay section (ms)
		SLA1	[50，100)
SLA2	[20，50)
		SLA3	[10，20)
SLA4	[4，10)
		SLA5	[0，4)

For example, as shown in table 2, assuming that the service level of the target service is SLA2, the electronic device may determine that the delay interval is [20, 50 ], and the electronic device may determine that the preset duration is 50ms.

In another optional implementation manner, the SLA parameter may include a delay interval, and the electronic device may directly determine an upper limit of the delay interval as the preset duration.

And D, the electronic equipment determines a package sending rule based on the preset duration.

It will be appreciated that the packet-issuing rule is used to instruct the first device to count test packets sent to the second device based on the predetermined duration.

Based on the step C and the step D, the preset time length is determined based on the SAL parameter, and the test data packet sent in the test process can be accurately counted, so that the time delay and the packet loss rate of the target service under the service requirement of the target service are determined.

Referring to fig. 3, as shown in fig. 4, before the electronic device determines the service quality of the target service based on the test data of the target service and the evaluation index of the target service, the service quality evaluation method further includes S401.

S401, the electronic equipment determines an evaluation index of the target service based on the service type of the target service.

In the embodiment of the application, when evaluating the service quality of different service types, the used evaluation indexes are different, and the electronic equipment can determine the evaluation index of the target service based on the service type of the target service.

In an alternative implementation manner, a type index corresponding relation may be stored in the electronic device, where the type index corresponding relation includes a plurality of service types and evaluation indexes corresponding to the plurality of service types.

Optionally, the service type may include a remote control class, a video real-time class, and an information collection class.

For example, the evaluation index corresponding to the service of the remote control class may include: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, and minimum round trip delay; the evaluation indexes corresponding to the video real-time service can comprise: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, and minimum round trip delay; the evaluation indexes corresponding to the information acquisition type service can comprise: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, and minimum round trip delay.

In the embodiment of the application, the electronic equipment configures different evaluation indexes for different service types, and can evaluate the service quality of the target service more accurately based on the different evaluation indexes.

Referring to fig. 3, as shown in fig. 5, the determining, by the electronic device, the quality of service of the target service based on the test data of the target service and the evaluation index of the target service may specifically include S501-S502.

S501, the electronic equipment determines the value of each evaluation index based on the test data.

In connection with the description of the above embodiments, the evaluation index comprises at least one of the following: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate; the test data includes at least one of: the number of lost packets, the packet sending time of each test data packet, the packet returning time of each test data packet, the packet receiving time of each test data packet, the video duration, the video blocking duration and the video blocking times, it should be understood that the electronic device may determine the value of the at least one evaluation index based on at least one test data, respectively.

For example, assuming that the transmission time of the first device for transmitting the first test packet is t0, the reception time of the second device for receiving the first test packet is t1, and the packet returning time of the first device for receiving the first test packet is t2, the electronic device may determine: single round trip delay = t2-t0; single uplink delay = t1-t0; single downlink delay = t2-t1.

And the electronic device can determine the sending time, the receiving time and the packet returning time of each test packet, and determine the average round trip delay, the maximum round trip delay and the minimum round trip delay in the round trip delays of a plurality of test data packets.

Optionally, the electronic device may also determine a difference between the maximum round trip delay and the minimum round trip delay as a delay jitter.

Alternatively, the electronic device may determine the sum of the number of received packets and the number of lost packets as the total number of transmitted packets, and determine the ratio between the number of lost packets and the total number of transmitted packets as the packet loss rate.

Optionally, the electronic device may determine a ratio of a number of delays less than a maximum guaranteed delay threshold to a total number of packets, and determine the ratio as a delay reliability.

Optionally, the electronic device may determine a difference between the video duration and the video pause duration as a video fluency duration, and then determine a ratio between the video fluency duration and the total video duration as a video fluency duration ratio.

Optionally, the electronic device may determine, based on the time length of each video clip, a number of times that the video does not have a clip, and then determine, as the video fluency, a ratio between the number of times that the video does not have a clip and the total number of times.

S502, the electronic equipment determines the service quality of the target service based on the value of each evaluation index.

It may be appreciated that the electronic device may determine, from the values of each evaluation index, the value of the evaluation index corresponding to each data amount, that is, the value of the evaluation index corresponding to each data flow, then determine the quality score of each data flow based on the value of the evaluation index corresponding to each data flow, and determine the quality score of the service of the target service based on the quality score of each data flow.

It should be appreciated that the quality of service score may be mapped on the space of [0, 100], which may be used to characterize the quality of service of the target service.

Optionally, the electronic device may set a quality of service score interval corresponding to the quality of service level, and then determine the quality of service of the target service based on the quality of service score of the target service.

Illustratively, table 3 is an example of a quality of service score interval corresponding to a quality of service class.

TABLE 3 Table 3

Quality of service class	Quality of service score interval
		Excellent (excellent)	[80，100]
Good grade (good)	[60，80)
		Difference of difference	[0，60)

As shown in table 3, assuming that the quality of service score of the target service is 85, the electronic device may determine that the quality of service of the target service is superior.

In an alternative implementation, the electronic device may determine the quality of service of the target service based on the quality score of each data stream and the weight of each data stream.

Optionally, the electronic device determines that the quality of service score of the target service satisfies the following formula:

Where St represents the quality of service score of the target service, Q _m represents the weight of the mth data stream, sf _m represents the quality score of the mth data stream, and M represents the number of data streams.

In an alternative implementation manner, the electronic device may normalize the value of the evaluation index to obtain a normalized score of each evaluation index, determine a weight of each evaluation index, and then determine a quality score corresponding to each data stream based on the weight of each evaluation index and the normalized score of each evaluation index.

Optionally, the electronic device determines that the mass fraction of the target data stream satisfies the following formula:

Where St represents the quality score of the target data stream, W _k represents the weight of the kth evaluation index, X _k represents the normalized score of the kth evaluation index, and K represents the number of evaluation indexes of the target service.

In an alternative implementation manner, the sending end device may correspond to a plurality of services, and the electronic device may determine the quality of service score of the sending end device based on the quality score of each data stream in the data streams corresponding to the plurality of services and the weight corresponding to each data stream.

In another alternative implementation manner, the electronic device may determine the service quality of a service scenario based on the service quality score of each transmitting end device and the weight corresponding to each transmitting end device, where the plurality of transmitting end devices correspond to one service scenario.

In an alternative implementation manner, the electronic device may further display the value of the evaluation index in a form of a line graph, graphically display the distribution condition of the value of the evaluation index of the current test in a form of a gamma distribution cumulative distribution function CDF, and summarize detailed time delay statistics in a form of a table.

Optionally, the electronic device may further display a test progress, send a prompt message when the test is ended, and automatically save the test data.

In the embodiment of the application, the electronic equipment calculates the value of each evaluation index based on the test data, and then determines the service quality of the target service based on the value of each evaluation index, so that the service quality can be accurately evaluated.

Referring to fig. 3, as shown in fig. 6, the quality of service evaluation method further includes S601-S602.

S601, the electronic equipment acquires the signal quality of a sending end of the target service.

It should be understood that the signal quality of the transmitting end is a signal quality that can be received by the location of the transmitting end device, where the signal quality can be indicative of the network environment in which the transmitting end device is located.

In the embodiment of the present application, the signal quality of the transmitting end may include reference signal received power RSRP and signal-to-noise ratio SINR.

S602, the electronic device sends the signal quality of the sending end to the first device, so that the first device sends the test data packet to the second device based on the signal quality of the sending end.

It will be appreciated that the first device may simulate the signal quality of the transmitting end and then send test packets to the second device.

In the embodiment of the application, the electronic equipment sends the signal quality of the sending end of the target service to the first equipment, so that the first equipment can simulate the network environment of the position of the sending end without disposing the first equipment on the position information of the first equipment, and the testing efficiency can be improved while the testing accuracy is ensured.

The embodiment of the application can divide the functional modules of the electronic equipment and the like according to the method example, for example, each functional module can be divided corresponding to each function, and two or more functions can be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.

In the case of dividing the respective functional modules with the respective functions, fig. 7 shows a schematic diagram of one possible configuration of the service quality evaluation device involved in the above-described embodiment, and as shown in fig. 7, the service quality evaluation device 70 may include: a determining module 701, a transmitting module 702 and an acquiring module 703.

A determining module 701, configured to determine a packet sending rule of a target service based on a history parameter of the target service; wherein the history parameter comprises at least one of: parameters of the historical data packet and SLA parameters; the packet sending rule is used for characterizing a rule that the first device sends a test data packet to the second device.

A sending module 702 is configured to send the packet sending rule to the first device.

The acquiring module 703 is configured to acquire test data of the target service, where the test data of the target service is test data for testing the test data packet sent by the first device to the second device.

The determining module 701 is further configured to determine a quality of service of the target service based on the test data of the target service and an evaluation index of the target service.

Optionally, the historical parameter includes a parameter of the historical data packet, and the parameter of the historical data packet includes a size of the historical data packet, an average packet interval of the historical data packet, and a packet duration of the historical data packet.

The determining module 701 is specifically configured to determine at least one data amount and a packet sending duration corresponding to the at least one data amount, where the at least one data amount includes a data amount of a largest data packet, a data amount of a smallest data packet, and an average data amount of the historical data packets in the historical data packets, based on a size of the historical data packet.

The determining module 701 is further specifically configured to determine the packing rule based on the at least one data amount, a packing duration corresponding to each of the at least one data amount, and the average packing interval.

Optionally, the target service evaluation index includes at least one of the following: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate.

Optionally, the test data of the target service includes at least one of: the packet loss number, the packet receiving number, the packet sending time of each test data packet, the packet returning time of each test data packet, the packet receiving time of each test data packet, the video duration, the video blocking duration and the video blocking times.

Optionally, the determining module 701 is further configured to determine an evaluation index of the target service based on the service type of the target service.

Optionally, the determining module 701 is specifically configured to determine the value of each evaluation index based on the test data.

The determining module 701 is further specifically configured to determine a service quality of the target service based on the value of each evaluation index.

Optionally, the acquiring module 703 is further configured to acquire a signal quality of a sending end of the target service.

The sending module 702 is further configured to send the signal quality of the sending end to the first device, so that the first device sends the test data packet to the second device based on the signal quality of the sending end.

In case of an integrated unit, fig. 8 shows a schematic diagram of one possible structure of the service quality assessment device involved in the above embodiment. As shown in fig. 8, the quality of service evaluation device 80 may include: a processing module 801 and a communication module 802. The processing module 801 may be configured to control and manage the operation of the quality of service assessment apparatus 80. The communication module 802 may be used to support communication of the quality of service assessment device 80 with other entities. Optionally, as shown in fig. 8, the quality of service evaluation device 80 may further comprise a storage module 803 for storing program code and data of the quality of service evaluation device 80.

Wherein the processing module 801 may be a processor or controller. The communication module 802 may be a transceiver, a transceiver circuit, a communication interface, or the like. The storage module 803 may be a memory.

Where the processing module 801 is a processor, the communication module 802 is a transceiver, and the storage module 803 is a memory, the processor, the transceiver, and the memory may be connected through a bus. The bus may be a peripheral component interconnect standard (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, or the like. The buses may be divided into address buses, data buses, control buses, etc.

It should be understood that, in various embodiments of the present application, the sequence numbers of the foregoing processes do not mean the order of execution, and the order of execution of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present application.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber terminal line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device including one or more servers, data centers, etc. that can be integrated with the medium. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk (Solid STATE DISK, SSD)), etc.

The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (11)

1. A method for quality of service assessment, comprising:

Determining a packing rule of a target service based on historical parameters of the target service; wherein the history parameter comprises at least one of: parameters of the historical data packet and parameters of the service level agreement SLA; the packet sending rule is used for characterizing a rule that the first equipment sends a test data packet to the second equipment;

transmitting the packing rule to the first device;

Acquiring test data of the target service, wherein the test data of the target service is the test data for testing the test data packet sent by the first equipment to the second equipment;

And determining the service quality of the target service based on the test data of the target service and the evaluation index of the target service.

2. The method of claim 1, wherein the history parameters include parameters of the history data packet including a size of the history data packet, an average packet interval of the history data packet, and a packet duration of the history data packet, and wherein determining the packet rule of the target service based on the history parameters of the target service comprises:

Determining at least one data amount and a packet sending duration corresponding to the at least one data amount respectively based on the sizes of the historical data packets, wherein the at least one data amount comprises the data amount of the largest data packet, the data amount of the smallest data packet and the average data amount of the historical data packets in the historical data packets;

and determining the packet sending rule based on the at least one data volume, the packet sending duration corresponding to the at least one data volume and the average packet sending interval.

3. The method of claim 1, wherein the target traffic evaluation metrics include at least one of: packet loss rate, single round trip delay, single uplink delay, single downlink delay, average round trip delay, maximum round trip delay, minimum round trip delay, delay jitter, delay reliability, video fluency duration duty ratio, and video fluency rate.

4. The method of any of claims 1, wherein the test data of the target service comprises at least one of: the method comprises the steps of packet loss number, packet receiving number, packet sending time of each test data packet, packet returning time of each test data packet, packet receiving time of each test data packet, video duration, video blocking duration and video blocking times.

5. The method according to any of claims 1-4, wherein prior to determining the quality of service of the target service based on the test data of the target service and the evaluation index of the target service, the method further comprises:

and determining an evaluation index of the target service based on the service type of the target service.

6. The method according to any one of claims 1-4, wherein the determining the quality of service of the target service based on the test data of the target service and the evaluation index of the target service comprises:

determining the value of each evaluation index based on the test data;

and determining the service quality of the target service based on the value of each evaluation index.

7. The method according to any one of claims 1-4, further comprising:

Acquiring the signal quality of a transmitting end of the target service;

And transmitting the signal quality of the transmitting end to the first device, so that the first device transmits the test data packet to the second device based on the signal quality of the transmitting end.

8. A quality of service assessment apparatus, comprising: the device comprises a determining module, a sending module and an obtaining module;

the determining module is used for determining a packet sending rule of the target service based on the historical parameters of the target service; wherein the history parameter comprises at least one of: parameters of the historical data packet and parameters of the service level agreement SLA; the packet sending rule is used for characterizing a rule that the first equipment sends a test data packet to the second equipment;

The sending module is used for sending the packet sending rule to the first equipment;

the acquisition module is used for acquiring the test data of the target service, wherein the test data of the target service is the test data for testing the test data packet sent by the first equipment to the second equipment;

The determining module is further configured to determine a service quality of the target service based on the test data of the target service and an evaluation index of the target service.

9. An electronic device, the electronic device comprising:

A processor;

a memory configured to store the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the quality of service assessment method according to any one of claims 1-7.

10. A computer readable storage medium having instructions stored thereon, which, when executed by an electronic device, cause the electronic device to perform the quality of service assessment method according to any of claims 1-7.

11. A computer program product comprising computer instructions which, when run on a processor of an electronic device, enable the electronic device to perform the quality of service assessment method according to any one of claims 1-7.