CN113079522A - OTT service quality testing method, OTT service quality testing device, electronic equipment and storage medium - Google Patents
OTT service quality testing method, OTT service quality testing device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113079522A CN113079522A CN202010006385.8A CN202010006385A CN113079522A CN 113079522 A CN113079522 A CN 113079522A CN 202010006385 A CN202010006385 A CN 202010006385A CN 113079522 A CN113079522 A CN 113079522A
- Authority
- CN
- China
- Prior art keywords
- service
- ott
- network
- network data
- tested
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 238000012372 quality testing Methods 0.000 title description 14
- 238000012360 testing method Methods 0.000 claims abstract description 117
- 230000008859 change Effects 0.000 claims abstract description 60
- 230000008054 signal transmission Effects 0.000 claims description 19
- 230000002159 abnormal effect Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 10
- 238000005457 optimization Methods 0.000 abstract description 11
- 238000012544 monitoring process Methods 0.000 abstract description 10
- 230000009286 beneficial effect Effects 0.000 abstract description 6
- 238000004141 dimensional analysis Methods 0.000 abstract description 4
- 230000006872 improvement Effects 0.000 abstract description 4
- 230000000875 corresponding effect Effects 0.000 description 30
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 2
- 238000010219 correlation analysis Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003012 network analysis Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
Abstract
The embodiment of the invention provides a method, a device, electronic equipment and a storage medium for testing OTT service quality, which are used for acquiring network data and service change data monitored when a service in a certain service project to be tested runs. And obtaining a test result reflecting the service quality of the service project according to the monitored network data and the service change data. The network data is monitored during the operation of the service in the service project, the monitored network data is related to the service project, whether the network condition is related to the service in the service project or not can be reflected, the network problem of specific service operation can be positioned, and further, the network problem of the specific service provider can be positioned through the service provider corresponding to the specific service. The refinement of network data monitoring is beneficial to multi-dimensional analysis of network problems, rapid and accurate positioning of network problems, deep optimization of networks and improvement of OTT service quality.
Description
Technical Field
The present invention relates to the field of network optimization technologies, and in particular, to a method and an apparatus for testing OTT service quality, an electronic device, and a storage medium.
Background
OTT (application service provided by a service provider to a user through The internet, Over The Top) service is directly provided for The user by a third party (i.e. The service provider) outside The service and charging, and The service provider serves as a simple "transmission pipeline". In OTT, a service provider transmits multimedia contents through an IP (Internet Protocol) network, and does not have much limitation in development in a network having an infrastructure, and does not need to establish a private network as in an operator. After the user installs the application of the service provider in the smart phone, the services such as voice and video call, file transmission, content playing and the like can be carried out.
In particular, OTT is a method for providing rich, high-quality content to users through terminals and wireless communication networks, reducing the cost of content production and interaction, such as WeChat, buffalo, Youkou, and the like. Under the condition of high-speed internet access of 4G (the 4th-Generation mobile communication technology)/5G (the 5th-Generation mobile communication technology), the products of internet OTT manufacturers obtain a great amount of users due to the inherent abundant application functions of platformization, openness, playability and the like. Therefore, there is a need to monitor and optimize OTT quality of service.
However, the existing method only monitors the network state of the terminal in actual operation, and cannot locate the network problem of specific services or the network problem of specific service providers, which is not favorable for deeply optimizing the network and improving the OTT service quality.
Disclosure of Invention
Embodiments of the present invention provide a method and an apparatus for testing OTT service quality, an electronic device, and a storage medium, so as to solve a problem in the prior art that a network problem existing in a specific service cannot be located, or a network problem existing in a specific service provider is not conducive to deep optimization of a network, and the OTT service quality is improved.
In view of the above technical problems, in a first aspect, an embodiment of the present invention provides an OTT service quality testing method, including:
acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet;
acquiring network data and service change data monitored by a terminal when a service in the service project runs;
and determining a test result for testing the service quality of the service item according to the network data and the service change data.
In a second aspect, an embodiment of the present invention provides an OTT service quality testing apparatus, including:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a service item to be tested, and the service item comprises at least one service in an application service OTT provided for a user through the Internet;
the second acquisition module is used for acquiring network data and service change data monitored by the terminal when the service in the service project runs;
and the determining module is used for determining a test result for testing the service quality of the service item according to the network data and the service change data.
In a third aspect, an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the steps of the OTT service quality testing method when executing the program.
In a fourth aspect, an embodiment of the present invention provides a non-transitory readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the OTT service quality testing method described in any one of the above.
Embodiments of the present invention provide a method, an apparatus, an electronic device, and a storage medium for testing OTT service quality, which are used to obtain network data and service change data monitored when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service project according to the monitored network data and the service change data. The network data is monitored during the operation of the service in the service project, the monitored network data is related to the service project, whether the network condition is related to the service in the service project or not can be reflected, the network problem of specific service operation can be positioned, and further, the network problem of the specific service provider can be positioned through the service provider corresponding to the specific service. The refinement of network data monitoring is beneficial to multi-dimensional analysis of network problems, rapid and accurate positioning of network problems, deep optimization of networks and improvement of OTT service quality.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an OTT service quality testing method according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a principle of monitoring OTT services to improve quality of service according to another embodiment of the present invention;
fig. 3 is a schematic diagram illustrating an implementation process of an OTT qos testing method according to another embodiment of the present invention;
FIG. 4 is a schematic diagram of a network data interface for monitoring during video playback according to another embodiment of the present invention;
fig. 5 is a block diagram of an OTT qos testing apparatus according to another embodiment of the present invention;
fig. 6 is a physical structure diagram of an electronic device according to another embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
At present, network data are monitored according to the actual operation condition of a current terminal, and the network data obtained by the monitoring mode cannot reflect the network condition of a certain service provider or a certain service, so that the network problem cannot be positioned to a specific service provider or a specific service. When optimizing the network, the network problem cannot be quickly and accurately associated with the service provider or the specific service, which is not beneficial to quickly and accurately positioning the network problem and improving the service quality.
To solve the technical problem, fig. 1 is a schematic flow chart of an OTT service quality testing method provided in this embodiment, where the method is executed by any device, and the device may be a terminal, a server (for example, a certain server of a service provider cloud platform), or another device independent of the terminal or the server, and this embodiment is not limited in this embodiment. Referring to fig. 1, the method includes:
step 101: acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet.
The service item is at least one service in an application service OTT provided by a service provider, for example, the OTT is WeChat, the service item is WeChat voice, or the service item is a combination of WeChat voice and WeChat sending information. When the service item is a combination of multiple services, the terminal needs to be controlled so that the multiple services are all in an operating state. The service items to be tested can be obtained through a predetermined test list or can be temporarily designated test items by testers.
Step 102: and acquiring network data and service change data monitored by the terminal when the service in the service project operates.
Since the service quality of a specific service needs to be improved, and the network data at the terminal side is data reflecting the actual network usage, the network data at the terminal side needs to be monitored. Specifically, the network data monitored at the terminal may be determined through a log of the terminal.
Further, the network data includes signal strength, signal transmission rate, signal transmission delay, network data reception success rate, packet loss rate, network jitter, signal interference information, and the like, and as long as the network data can reflect the network condition, the network data is beneficial to optimizing the network, and data for improving the service quality can be monitored, which is not listed in this embodiment. Similarly, the service change data includes service running time, service status, and the like, which are not listed in this embodiment.
It should be noted that the terminal in this embodiment may be a mobile phone, a computer, and the like, and this embodiment is not limited to this specifically.
Step 103: and determining a test result for testing the service quality of the service item according to the network data and the service change data.
Further, still include: and saving the test result.
Further, still include: displaying the test result according to the acquired display setting information; the display setting information includes displaying a test result corresponding to a certain service item, displaying test results corresponding to all service items of a certain OTT, and displaying test results corresponding to each service item of a certain service provider.
If the display setting information is to display the test result corresponding to a certain service item, the displayed content only comprises the test result corresponding to each service in the service item; if the display setting information is to display the test results corresponding to all the service items of a certain OTT, the displayed content includes the test results corresponding to each service under each service item in the OTT. If the display setting information is to display the test result corresponding to each service item of a certain service provider, the displayed content includes the test result corresponding to each service under each service item of the service provider.
Based on the network data and the service change data, the network data may be analyzed from multiple dimensions of the service change data, such as changes in the network data at different service runtime times, changes in the network data at different service states, changes in the network data at different kinds of services (i.e., service types, e.g., WeChat voice and WeChat video belonging to different service types), and so on. Because the test result shows the change of the network data aiming at a certain service project from a plurality of angles, the service quality of the service project can be analyzed through the test result, the network problem is positioned, and the network problem is effectively optimized.
The embodiment provides an OTT service quality testing method, which is used for acquiring network data and service change data monitored when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service project according to the monitored network data and the service change data. The network data is monitored during the operation of the service in the service project, the monitored network data is related to the service project, whether the network condition is related to the service in the service project or not can be reflected, the network problem of specific service operation can be positioned, and further, the network problem of the specific service provider can be positioned through the service provider corresponding to the specific service. The refinement of network data monitoring is beneficial to multi-dimensional analysis of network problems, rapid and accurate positioning of network problems, deep optimization of networks and improvement of OTT service quality.
In order to reduce the degree of influence of other factors on the network data, so that the network data more accurately reflects the real network state of the service item, further, on the basis of the above embodiment, the method further includes:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close OTTs except the OTT to be tested, opening the OTT to be tested, and only operating the service in the service project through the OTT to be tested.
The OTT corresponding to the service item, for example, the OTT corresponding to the wechat voice is an application service of the wechat. After the control terminal closes the OTT to be tested, the OTT to be tested is opened, and only the service in the service project in the OTT to be tested is enabled to operate, so that the influence of other service providers and other services on network data is facilitated, and whether the network problem is related to the service project or not is accurately analyzed.
According to the embodiment, the application service and the service which are irrelevant to the service in the service project are closed through the control terminal, so that the network data can more accurately reflect whether the network problem is relevant to the service project or not, and network optimization is facilitated.
Further, on the basis of the foregoing embodiments, the acquiring a service item to be tested includes:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list comprises service items to be tested and OTTs corresponding to the service items.
Further, the operation of acquiring any service item to be tested from the test list and determining the test result for testing the service quality of the service item is executed in a loop until each test item in the test list is traversed.
The test list is issued through a cloud platform or actively set by a tester. The service items included in the test list include, for example, automatic dialing and answering of WeChat voice, video call, automatic playing of jittering short video, YY live broadcast, Yokoku on demand, and the like.
In the embodiment, each test item to be tested is added into the test list, so that the test of each test item is realized.
Fig. 2 is a schematic diagram of the principle that the service quality is improved by monitoring the OTT service according to this embodiment, and referring to fig. 2, in the process, for a certain OTT, OTT service data (i.e., service change data) and network side data (i.e., network data) are collected by a mobile phone terminal. And determining a test result by decoding the data at the network side and combining the OTT service data and the analysis statistics of the data at the network side. Further recording statistics, playback and presentation of the test results. Specifically, the OTT service quality of the mobile phone is monitored, and terminal network data and data of related applications are collected through monitoring; analyzing to obtain service time and service type, and generating quality indexes such as success rate, speed rate, time delay and the like; and the cloud platform is uploaded, and the service quality is further analyzed from each dimension through big data, so that the network optimization is more conveniently and accurately carried out.
Further, on the basis of the foregoing embodiments, the determining, according to the network data and the service change data, a test result of testing the service quality of the service item includes:
for each service in the service project, generating a first change relation of network data monitored by the service along with service running time, a second change relation of the network data monitored by the service along with service state, a first comparison graph formed by the first change relations corresponding to various services in the service project, and/or a second comparison graph formed by the second change relations corresponding to various services in the service project;
taking the generated first variation relation, the second variation relation, the first comparison map, and/or the second comparison map as the test result;
the network data comprises signal intensity, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
It should be noted that the service running time refers to a time during which a certain service runs, for example, a certain period of running time or a whole running time from the beginning of switching on the wechat voice, during switching on the wechat voice, and during the whole process of ending the wechat voice. The traffic state refers to a state of the traffic in a different process, for example, a waiting-to-connect state before the wechat voice is connected, a state in the wechat voice connection, and a state corresponding to a time when the wechat voice ends. Different kinds of services, i.e. services of different service types, e.g. WeChat voice and WeChat video belong to different kinds of services.
For example, if the service included in the test item is WeChat voice, the network data is monitored for the whole process from the waiting for the WeChat voice to the end of the WeChat voice. If the monitored network data is signal strength, generating a first change relation of the signal strength along with service running time in the whole WeChat voice process; generating a second variation relation of signal strength varying with selected moments at selected moments in the whole process of the WeChat voice (for example, the selected moments include a certain moment when the WeChat voice waits for the connection state, a certain moment in the connection state, a moment when the WeChat voice ends, and other moments selected in the connection state); and taking the generated first variation relation and the second variation relation as the test result of the test item.
For another example, when the service included in the test item is two services, namely, the wechat voice and the wechat video, in addition to generating a first change relationship and a second change relationship for the wechat voice and the wechat video, a first comparison graph may be generated, where in the first comparison graph, an abscissa is service running time, an ordinate is signal strength, and the first comparison graph includes two curves, which are the first change relationship of the wechat voice and the first change relationship of the wechat video. It should be noted that, in order to better reflect the comparison between the two curves, the service operation time on the abscissa may be processed, for example, the abscissa represents the time interval relative to the transition time of the service from waiting to be turned on to the on state (for example, the value of the abscissa corresponding to the transition time is 0; the service operation time before the transition time is a negative value, and the absolute value is larger as the time interval with the transition time is larger; the service operation time after the transition time is a positive value, and the value is larger as the time interval with the transition time is larger).
In addition, a second comparison graph can be generated, wherein the abscissa of the second comparison graph is the service state, the ordinate of the second comparison graph is the signal strength, and the second comparison graph comprises two curves which are respectively a second change relation of the WeChat voice and a second change relation of the WeChat video.
In this embodiment, the test report generated for the service item, that is, the change relationship presented by the network data when the service item changes according to different dimensions, can intuitively understand the network conditions of different service items through the test report.
In order to analyze the network data of the service item, on the basis of the foregoing embodiments, the method further includes:
if the test result has abnormal network data, the service quality of the service item is unqualified;
the abnormal network data comprises signal strength smaller than or equal to a first threshold, signal transmission rate smaller than or equal to a second threshold, signal transmission delay larger than or equal to a third threshold, network data receiving success rate smaller than or equal to a fourth threshold, packet loss rate larger than or equal to a fifth threshold, network jitter larger than or equal to a sixth threshold and a result of signal interference.
The first threshold, the second threshold, the third threshold, the fourth threshold, the fifth threshold and the sixth threshold are all set values.
For example, if the monitored network data includes signal strength, the test report includes a first variation relationship and a second variation relationship corresponding to the WeChat voice. If the signal intensity of a certain point in the first change relation is smaller than the first threshold, abnormal network data exists in the first change relation. The service quality of the service item containing the WeChat voice is unqualified.
In the embodiment, the service items with unqualified service quality are screened out by judging whether the abnormal network data exists in the test result, and the service items required to be considered for network optimization are accurately positioned.
Further, on the basis of the above embodiments, the method further includes:
the method comprises the steps of taking service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as an OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTTs provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
Further, if the first ratio is greater than the first reference ratio, the network anomaly is eliminated, the influence of the OTT to be analyzed on the network is considered when the network is optimized, if the second ratio is greater than the second reference ratio, the service provider with the second ratio greater than the second reference ratio is taken as the service provider to be analyzed, the network anomaly is eliminated, and the influence of the service provided by the service provider to be analyzed on the network is considered when the network is optimized. The network problems can be associated with specific services, service items and service providers through the network data monitored in the service operation process of different service items, so that the network problems can be accurately and quickly positioned, network abnormity is eliminated, and optimization is better performed.
When network optimization is carried out, the network condition corresponding to each OTT or the network condition corresponding to a service provider can be considered, network abnormity caused by accidental factors can be avoided through the first proportion and the second proportion, and the accuracy of network positioning problem is improved.
Fig. 3 is a schematic diagram of an implementation process of the OTT service quality testing method provided in this embodiment, and referring to fig. 3, the process includes the following contents:
passively collecting terminal network side data, decoding data streams in the terminal network side data, recording, analyzing, counting and displaying related code stream information;
and issuing through a cloud platform or actively setting an automatic test list by a tester to actively carry out a series of OTT service tests. Such as automatic dialing and answering WeChat voice, video telephone, automatic playing of jittering short video, YY live broadcast, Yokoku on demand, etc. Collecting various parameter indexes such as time delay, jitter and the like in the OTT service process;
and performing correlation analysis on the acquired data through the terminal and the cloud platform to generate OTT-related service quality indexes. Various parameters and analysis results can be checked in real time on the terminal and the cloud platform, visual data playback can be carried out, and the problem solving efficiency of network analysis personnel is greatly improved.
Specifically, the OTT service quality testing method provided by the present embodiment includes a "testing portion" and an "analysis display portion".
Wherein, the functions realized by the test part comprise:
and issuing through a cloud platform or actively setting an automatic test list by a tester to actively carry out a series of OTT service tests. Monitoring information such as an OTT application interface state, server delay, data volume and the like through auxiliary service in a test process, synchronously acquiring relevant data of a mobile phone network side and decoding, wherein the information comprises the following steps: cell information, neighbor cells, throughput, transmit power, air interface signaling, etc. And storing the data to the local and uploading the data to the cloud platform.
The functions realized by the "analysis display portion" include:
performing correlation analysis on the acquired data through the terminal and the cloud platform; associating the collected and decoded network side data with OTT application side records, wherein the same service testing time, IP and the like are the same, so that associated records can be generated; and taking the service time, the service type and the OTT application state as dimensions, and counting the parameter quality under the dimensions, namely indexes such as signal intensity, interference, speed, time delay and the like. The OTT service quality can be monitored simply through the data. The data and the analysis result can be displayed and played back on the terminal and the cloud platform. Fig. 4 is a schematic diagram of a network data interface monitored during video playing according to this embodiment, and referring to fig. 4, during video playing, monitored network data includes a real-time rate (signal transmission rate), and monitored service change data includes a video resolution.
In this embodiment, data on the network side of the terminal and related data of the OTT service are automatically acquired by combining the cloud platform, so that analysis and statistics on the OTT service quality are realized. Because the contents of the network side signaling plane and the user side OTT service plane are analyzed and correlated at the same time, the OTT service quality can be conveniently monitored from various aspects such as service time, IP, PORT (PORT), route, service type and the like. And the problem node can be positioned more quickly for network analysts.
Fig. 5 is a block diagram of a structure of an OTT qos testing apparatus provided in this embodiment, referring to fig. 5, the apparatus includes a first obtaining module 501, a second obtaining module 502, and a determining module 503, wherein,
a first obtaining module 501, configured to obtain a service item to be tested, where the service item includes at least one service in an application service OTT provided to a user through the internet;
a second obtaining module 502, configured to obtain network data and service change data monitored by a terminal when a service in the service item runs;
a determining module 503, configured to determine, according to the network data and the service change data, a test result of testing the service quality of the service item.
The OTT qos testing apparatus provided in this embodiment is suitable for the OTT qos testing method provided in the above embodiment, and is not described herein again.
The embodiment provides an OTT service quality testing apparatus, which is used for acquiring network data and service change data monitored when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service project according to the monitored network data and the service change data. The network data is monitored during the operation of the service in the service project, the monitored network data is related to the service project, whether the network condition is related to the service in the service project or not can be reflected, the network problem of specific service operation can be positioned, and further, the network problem of the specific service provider can be positioned through the service provider corresponding to the specific service. The refinement of network data monitoring is beneficial to multi-dimensional analysis of network problems, rapid and accurate positioning of network problems, deep optimization of networks and improvement of OTT service quality.
Preferably, the second obtaining module is further configured to:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close OTTs except the OTT to be tested, opening the OTT to be tested, and only operating the service in the service project through the OTT to be tested.
Preferably, the first obtaining module is further configured to:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list comprises service items to be tested and OTTs corresponding to the service items.
Preferably, the determining module is further configured to:
for each service in the service project, generating a first change relation of network data monitored by the service along with service running time, a second change relation of the network data monitored by the service along with service state, a first comparison graph formed by the first change relations corresponding to various services in the service project, and/or a second comparison graph formed by the second change relations corresponding to various services in the service project;
taking the generated first variation relation, the second variation relation, the first comparison map, and/or the second comparison map as the test result;
the network data comprises signal intensity, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
Preferably, the determining module is further configured to:
if the test result has abnormal network data, the service quality of the service item is unqualified;
the abnormal network data comprises signal strength smaller than or equal to a first threshold, signal transmission rate smaller than or equal to a second threshold, signal transmission delay larger than or equal to a third threshold, network data receiving success rate smaller than or equal to a fourth threshold, packet loss rate larger than or equal to a fifth threshold, network jitter larger than or equal to a sixth threshold and a result of signal interference.
Preferably, the determining module is further configured to:
the method comprises the steps of taking service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as an OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTTs provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
Fig. 6 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 6: a processor (processor)601, a communication Interface (Communications Interface)602, a memory (memory)603 and a communication bus 604, wherein the processor 601, the communication Interface 602 and the memory 603 complete communication with each other through the communication bus 604. The processor 601 may call logic instructions in the memory 603 to perform the following method: acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when a service in the service project runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
In addition, the logic instructions in the memory 603 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Further, embodiments of the present invention disclose a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, which when executed by a computer, the computer is capable of performing the methods provided by the above-mentioned method embodiments, for example, comprising: acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when a service in the service project runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
In another aspect, an embodiment of the present invention further provides a non-transitory readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the transmission method provided in the foregoing embodiments when executed by a processor, for example, the method includes: acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when a service in the service project runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (14)
1. An OTT qos testing method, comprising:
acquiring a service item to be tested, wherein the service item comprises at least one service in an application service OTT provided for a user through the Internet;
acquiring network data and service change data monitored by a terminal when a service in the service project runs;
and determining a test result for testing the service quality of the service item according to the network data and the service change data.
2. The OTT qos testing method according to claim 1, further comprising:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close OTTs except the OTT to be tested, opening the OTT to be tested, and only operating the service in the service project through the OTT to be tested.
3. The OTT qos testing method according to claim 1, wherein the obtaining of the service items to be tested comprises:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list comprises service items to be tested and OTTs corresponding to the service items.
4. The OTT qos testing method according to claim 1, wherein the determining, according to the network data and the traffic change data, a test result of testing the qos of the service item comprises:
for each service in the service project, generating a first change relation of network data monitored by the service along with service running time, a second change relation of the network data monitored by the service along with service state, a first comparison graph formed by the first change relations corresponding to various services in the service project, and/or a second comparison graph formed by the second change relations corresponding to various services in the service project;
taking the generated first variation relation, the second variation relation, the first comparison map, and/or the second comparison map as the test result;
the network data comprises signal intensity, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
5. The OTT qos testing method according to claim 1, further comprising:
if the test result has abnormal network data, the service quality of the service item is unqualified;
the abnormal network data comprises signal strength smaller than or equal to a first threshold, signal transmission rate smaller than or equal to a second threshold, signal transmission delay larger than or equal to a third threshold, network data receiving success rate smaller than or equal to a fourth threshold, packet loss rate larger than or equal to a fifth threshold, network jitter larger than or equal to a sixth threshold and a result of signal interference.
6. The OTT qos testing method according to claim 5, further comprising:
the method comprises the steps of taking service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as an OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTTs provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
7. An OTT quality of service testing apparatus, comprising:
the system comprises a first acquisition module, a second acquisition module and a third acquisition module, wherein the first acquisition module is used for acquiring a service item to be tested, and the service item comprises at least one service in an application service OTT provided for a user through the Internet;
the second acquisition module is used for acquiring network data and service change data monitored by the terminal when the service in the service project runs;
and the determining module is used for determining a test result for testing the service quality of the service item according to the network data and the service change data.
8. The OTT qos testing apparatus according to claim 7, wherein the second obtaining module is further configured to:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close OTTs except the OTT to be tested, opening the OTT to be tested, and only operating the service in the service project through the OTT to be tested.
9. The OTT qos testing apparatus according to claim 7, wherein the first obtaining module is further configured to:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list comprises service items to be tested and OTTs corresponding to the service items.
10. The OTT qos testing apparatus according to claim 7, wherein the determining module is further configured to:
for each service in the service project, generating a first change relation of network data monitored by the service along with service running time, a second change relation of the network data monitored by the service along with service state, a first comparison graph formed by the first change relations corresponding to various services in the service project, and/or a second comparison graph formed by the second change relations corresponding to various services in the service project;
taking the generated first variation relation, the second variation relation, the first comparison map, and/or the second comparison map as the test result;
the network data comprises signal intensity, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
11. The OTT qos testing apparatus according to claim 7, wherein the determining module is further configured to:
if the test result has abnormal network data, the service quality of the service item is unqualified;
the abnormal network data comprises signal strength smaller than or equal to a first threshold, signal transmission rate smaller than or equal to a second threshold, signal transmission delay larger than or equal to a third threshold, network data receiving success rate smaller than or equal to a fourth threshold, packet loss rate larger than or equal to a fifth threshold, network jitter larger than or equal to a sixth threshold and a result of signal interference.
12. The OTT qos testing apparatus according to claim 11, wherein the determining module is further configured to:
the method comprises the steps of taking service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as an OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTTs provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the OTT quality of service testing method according to any of claims 1 to 6 are implemented when the processor executes the program.
14. A non-transitory readable storage medium having stored thereon a computer program, which when executed by a processor implements the steps of the OTT quality of service testing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010006385.8A CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010006385.8A CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113079522A true CN113079522A (en) | 2021-07-06 |
| CN113079522B CN113079522B (en) | 2024-04-05 |
Family
ID=76608525
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010006385.8A Active CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113079522B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115357518A (en) * | 2022-10-20 | 2022-11-18 | 深圳市国佳高鑫科技有限公司 | Method for realizing software service based on cloud service, client and cloud server |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024781A (en) * | 2012-12-30 | 2013-04-03 | 广西深睿科技有限公司 | Method for processing abnormalities in stage when mobile communication system cellphone accesses to network |
| CN104539556A (en) * | 2014-12-29 | 2015-04-22 | 南京邮电大学 | Method for providing satisfaction service quality for users under heterogeneous network environment |
| WO2017054553A1 (en) * | 2015-09-29 | 2017-04-06 | 华为技术有限公司 | Video quality detection method and apparatus, and service quality management centre |
| CN106993308A (en) * | 2016-01-20 | 2017-07-28 | 上海大唐移动通信设备有限公司 | A kind of QoS of voice monitoring method, equipment and the system of VoLTE networks |
| CN107172420A (en) * | 2017-06-23 | 2017-09-15 | 天津市德力电子仪器有限公司 | IPTV and OTT set-top box quality automatic method of testing |
| WO2018054385A1 (en) * | 2016-09-26 | 2018-03-29 | 中兴通讯股份有限公司 | Network switching method and device |
| EP3484101A1 (en) * | 2017-11-10 | 2019-05-15 | Netscout Systems, Inc. | Automatically determining over-the-top applications and services |
-
2020
- 2020-01-03 CN CN202010006385.8A patent/CN113079522B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024781A (en) * | 2012-12-30 | 2013-04-03 | 广西深睿科技有限公司 | Method for processing abnormalities in stage when mobile communication system cellphone accesses to network |
| CN104539556A (en) * | 2014-12-29 | 2015-04-22 | 南京邮电大学 | Method for providing satisfaction service quality for users under heterogeneous network environment |
| WO2017054553A1 (en) * | 2015-09-29 | 2017-04-06 | 华为技术有限公司 | Video quality detection method and apparatus, and service quality management centre |
| CN106993308A (en) * | 2016-01-20 | 2017-07-28 | 上海大唐移动通信设备有限公司 | A kind of QoS of voice monitoring method, equipment and the system of VoLTE networks |
| WO2018054385A1 (en) * | 2016-09-26 | 2018-03-29 | 中兴通讯股份有限公司 | Network switching method and device |
| CN107172420A (en) * | 2017-06-23 | 2017-09-15 | 天津市德力电子仪器有限公司 | IPTV and OTT set-top box quality automatic method of testing |
| EP3484101A1 (en) * | 2017-11-10 | 2019-05-15 | Netscout Systems, Inc. | Automatically determining over-the-top applications and services |
Non-Patent Citations (2)
| Title |
|---|
| JIE JIANG ET.AL: ""Assessing unreliability in OTT video QoE subjective evaluations using clustering with idealized data"", 《2016 DIGITAL MEDIA INDUSTRY & ACADEMIC FORUM (DMIAF)》, 26 September 2016 (2016-09-26) * |
| 张杰鑫等: ""拟态构造Web服务器的服务质量量化方法"", 《计算机科学》, 21 August 2019 (2019-08-21) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115357518A (en) * | 2022-10-20 | 2022-11-18 | 深圳市国佳高鑫科技有限公司 | Method for realizing software service based on cloud service, client and cloud server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113079522B (en) | 2024-04-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110365503B (en) | Index determination method and related equipment thereof | |
| CN105357699B (en) | Quality of wireless network monitors system and method | |
| CN106952657B (en) | Voice quality detection method and device | |
| EP3860121A1 (en) | Video service quality assessment method, apparatus and device, and readable storage medium | |
| CN102045222A (en) | Real-time overall test method of network system | |
| CN111327471A (en) | Network quality analysis method and device, computer equipment and storage medium | |
| CN111327539B (en) | Service scheduling method, device and equipment | |
| CN106535240B (en) | Mobile APP centralized performance analysis method based on cloud platform | |
| CN108513313A (en) | One germplasm difference cell determining method and equipment | |
| KR101846386B1 (en) | Method and system for checking video call quality of mobile device | |
| CN108076197B (en) | Method and device for detecting terminal network performance degradation | |
| CN113079522B (en) | OTT service quality testing method and device, electronic equipment and storage medium | |
| CN113411825B (en) | 5G cell positioning method and device, electronic equipment and storage medium | |
| CN110875825B (en) | Fault judgment method and device | |
| CN109994128B (en) | Voice quality problem positioning method, device, equipment and medium | |
| CN116719750B (en) | Software testing method and device, server equipment and storage medium | |
| CN107018088B (en) | Transmission link selection method and device | |
| CN110896544B (en) | Fault delimiting method and device | |
| CN109474940B (en) | Service quality detection method and device | |
| CN101834749B (en) | Method and device for acquiring data, method and device for monitoring business service quality | |
| CN108271202B (en) | Method and device for positioning network fault based on short-frequency call ticket data | |
| CN113225222A (en) | Broadband quality monitoring method | |
| CN111901206A (en) | Network card testing method, device and related equipment | |
| CN114640600A (en) | Network service quality analysis method, system and storage medium | |
| CN111541585A (en) | Access equipment inspection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |