CN113079522B - OTT service quality testing method and device, electronic equipment and storage medium - Google Patents
OTT service quality testing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113079522B CN113079522B CN202010006385.8A CN202010006385A CN113079522B CN 113079522 B CN113079522 B CN 113079522B CN 202010006385 A CN202010006385 A CN 202010006385A CN 113079522 B CN113079522 B CN 113079522B
- Authority
- CN
- China
- Prior art keywords
- service
- ott
- network
- network data
- item
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 238000000034 method Methods 0.000 title abstract description 43
- 238000012372 quality testing Methods 0.000 title abstract description 22
- 238000012360 testing method Methods 0.000 claims abstract description 109
- 230000008859 change Effects 0.000 claims abstract description 77
- 230000008054 signal transmission Effects 0.000 claims description 19
- 230000002159 abnormal effect Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004458 analytical method Methods 0.000 abstract description 10
- 238000012544 monitoring process Methods 0.000 abstract description 10
- 238000005457 optimization Methods 0.000 abstract description 10
- 230000009286 beneficial effect Effects 0.000 abstract description 6
- 230000006872 improvement Effects 0.000 abstract description 4
- 230000000875 corresponding effect Effects 0.000 description 29
- 238000004891 communication Methods 0.000 description 13
- 230000008569 process Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 10
- 230000007704 transition Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000010295 mobile communication Methods 0.000 description 4
- 206010044565 Tremor Diseases 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012098 association analyses Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000001276 controlling effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides an OTT service quality testing method, an OTT service quality testing device, electronic equipment and a storage medium, wherein monitored network data and service change data are obtained when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service item according to the monitored network data and the monitored service change data. The network data is monitored when the business in the service project runs, the monitored network data is related to the service project, whether the network condition is related to the business in the service project can be reflected, the network problem of the specific business running can be positioned, and further, the network problem of the specific business can be positioned through the service provider corresponding to the specific business. The refinement of network data monitoring is beneficial to multidimensional analysis of network problems, quick and accurate positioning of network problems, deep optimization of network and improvement of OTT service quality.
Description
Technical Field
The present invention relates to the field of network optimization technologies, and in particular, to an OTT service quality testing method, an OTT service quality testing device, an electronic device, and a storage medium.
Background
OTT (application service provided by a service provider to a user through The internet), the Over Top service is directly provided with services and billing for The user by a third party outside The operation (i.e., the service provider), and The operator acts as a mere "transport pipe". In OTT, a service provider transmits multimedia contents through an IP (internet protocol ) network, and there is not much restriction in developing a network with infrastructure, and there is no need to build a private network as in the case of an operator. After the user of the intelligent mobile phone installs the application of the service provider, services such as voice and video call, file transmission, content playing and the like can be performed.
Specifically, OTT is a method for providing rich, high quality content to users through terminals and wireless communication networks, reducing costs of content production and interaction, such as WeChat, tremble, and the like. Under the condition of high-speed internet surfing of 4G (fourth generation mobile communication technology, the 4th-Generation mobile communication technology)/5G (fifth generation mobile communication technology, the 5th-Generation mobile communication technology), the products of internet OTT manufacturers obtain a great user quantity due to inherent rich application functions such as platformization, openness, playability and the like. Therefore, there is a need to monitor and optimize OTT quality of service.
However, the existing method only monitors the network state when the terminal actually operates, and cannot locate the network problem existing in the specific service or the network problem existing in the specific service provider, which is not beneficial to deeply optimizing the network and improving the OTT service quality.
Disclosure of Invention
The embodiment of the invention provides an OTT service quality testing method, an OTT service quality testing device, electronic equipment and a storage medium, which are used for solving the problems that in the prior art, network problems existing in specific services cannot be positioned or network problems existing in specific service providers are unfavorable for deeply optimizing a network and improving OTT service quality.
In view of the above technical problems, in a first aspect, an embodiment of the present invention provides an OTT service quality testing method, including:
acquiring a service item to be tested, wherein the service item comprises at least one service in application service OTT provided for a user through the Internet;
acquiring network data and service change data monitored by a terminal when the service in the service item runs;
and determining a test result for testing the service quality of the service item according to the network data and the service change data.
In a second aspect, an embodiment of the present invention provides an OTT service quality testing device, including:
the first acquisition module is used for acquiring a service item to be tested, wherein the service item comprises at least one service in application services OTT provided for a user through the Internet;
the second acquisition module is used for acquiring network data and service change data monitored by the terminal when the service in the service item runs;
and the determining module is used for determining a test result for testing the service quality of the service item according to the network data and the service change data.
In a third aspect, an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the steps of the OTT quality of service testing method described above are implemented when the processor executes the program.
In a fourth aspect, embodiments of the present invention provide a non-transitory readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the OTT quality of service testing method of any of the above.
The embodiment of the invention provides an OTT service quality testing method, an OTT service quality testing device, electronic equipment and a storage medium, wherein monitored network data and service change data are obtained when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service item according to the monitored network data and the monitored service change data. The network data is monitored when the business in the service project runs, the monitored network data is related to the service project, whether the network condition is related to the business in the service project can be reflected, the network problem of the specific business running can be positioned, and further, the network problem of the specific business can be positioned through the service provider corresponding to the specific business. The refinement of network data monitoring is beneficial to multidimensional analysis of network problems, quick and accurate positioning of network problems, deep optimization of network and improvement of OTT service quality.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of an OTT service quality testing method provided in an embodiment of the present invention;
FIG. 2 is a schematic diagram of monitoring OTT services to improve service quality according to another embodiment of the present invention;
fig. 3 is a schematic diagram of an implementation process of an OTT service quality testing method according to another embodiment of the present invention;
FIG. 4 is a schematic diagram of a network data interface for monitoring video playback according to another embodiment of the present invention;
FIG. 5 is a block diagram illustrating an OTT QoS test apparatus according to another embodiment of the present invention;
fig. 6 is a physical structure diagram of an electronic device according to another embodiment of the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
At present, network data is monitored according to the actual running condition of a current terminal, and the network data obtained by the monitoring mode cannot reflect the network condition of a certain service provider or a certain service, so that network problems cannot be positioned to a specific service provider or a specific service. When the network is optimized, the network problem cannot be quickly and accurately related to a service provider or specific service, which is not beneficial to quickly and accurately positioning the network problem and improving the service quality.
In order to solve this technical problem, fig. 1 is a flow chart of an OTT service quality testing method provided in this embodiment, where the method is executed by any device, and the device may be a terminal, a server (for example, a certain server of a server cloud platform), or other devices independent of the terminal or the server, which is not specifically limited in this embodiment. Referring to fig. 1, the method includes:
step 101: and acquiring a service item to be tested, wherein the service item comprises at least one service in application services OTT provided for a user through the Internet.
The service item is at least one service in the application service OTT provided by the service provider, for example, OTT is a WeChat, the service item is a WeChat voice, or the service item is a combination of WeChat voice and WeChat sending information. When the service item is a combination of multiple services, the terminal needs to be controlled so that the multiple services are all in an operation state. The service items to be tested can be obtained through a predetermined test list, or can be test items temporarily designated by a tester.
Step 102: and when the service in the service item runs, acquiring network data and service change data monitored by the terminal.
Because the service quality of a specific service needs to be improved, the network data of the terminal side is the data reflecting the actual network use condition, so the network data of the terminal side needs to be monitored. Specifically, the network data monitored at the terminal may be determined through a log of the terminal.
Further, the network data includes signal strength, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter, signal interference information, etc., so long as the network condition can be reflected, the network can be optimized, and the data for improving the service quality can be monitored, which is not listed in this embodiment any more. Similarly, the service change data includes service running time, service status, and the like, which are not listed in this embodiment.
It should be noted that, the terminal in this embodiment may be a mobile phone, a computer, etc., which is not particularly limited in this embodiment.
Step 103: and determining a test result for testing the service quality of the service item according to the network data and the service change data.
Further, the method further comprises the following steps: and storing the test result.
Further, the method further comprises the following steps: displaying a test result according to the acquired display setting information; the display of the setting information includes displaying a test result corresponding to a certain service item, displaying test results corresponding to all service items of a certain OTT, and displaying test results corresponding to each service item of a certain service provider.
If the display setting information is that the test result corresponding to a certain service item is displayed, the displayed content only comprises the test result corresponding to each service in the service item; if the display setting information is to display the test results corresponding to all the service items of a certain OTT, the displayed content includes the test results corresponding to each service item in the OTT. If the display setting information is to display the test results corresponding to the service items of a certain service provider, the displayed content comprises the test results corresponding to the businesses under the service items of the service provider.
Based on the network data and the service change data, the network data may be analyzed from multiple dimensions of the service change data, for example, a change in the network data under different service operation times, a change in the network data under different service states, a change in the network data under different kinds of services (i.e., service types, for example, weChat voice and WeChat video belong to different service types), and so on. The test result shows the change of the network data aiming at a certain service item from multiple angles, so that the service quality of the service item can be analyzed through the test result, the network problem is positioned, and the network problem is effectively optimized.
The embodiment provides an OTT service quality testing method, which obtains monitored network data and service change data when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service item according to the monitored network data and the monitored service change data. The network data is monitored when the business in the service project runs, the monitored network data is related to the service project, whether the network condition is related to the business in the service project can be reflected, the network problem of the specific business running can be positioned, and further, the network problem of the specific business can be positioned through the service provider corresponding to the specific business. The refinement of network data monitoring is beneficial to multidimensional analysis of network problems, quick and accurate positioning of network problems, deep optimization of network and improvement of OTT service quality.
In order to reduce the influence degree of other factors on the network data, so that the network data more accurately reflects the real network state of the service item, further, on the basis of the above embodiment, the method further includes:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close the OTT except the OTT to be tested, opening the OTT to be tested, and only running the service in the service item through the OTT to be tested.
OTT corresponding to the service item, for example, OTT corresponding to WeChat voice, serves the WeChat application. After the OTT to be tested is closed by the control terminal, the OTT to be tested is opened, and only the service in the service project is operated in the OTT to be tested, so that the influence of other service providers and other services on the network data is favorable for accurately analyzing whether the network problem is related to the service project.
According to the embodiment, the control terminal closes the application service and the business which are irrelevant to the business in the service project, so that the network data can more accurately reflect whether the network problem is relevant to the service project or not, and the network optimization is facilitated accurately.
Further, on the basis of the above embodiments, the obtaining a service item to be tested includes:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list includes service items to be tested and OTTs corresponding to the service items.
Further, the operation of "obtaining any service item to be tested from the test list, determining a test result of testing the service quality of the service item" is performed in a loop until each test item in the test list is traversed.
The test list is issued through the cloud platform or actively set by a tester. Service items included in the test list, such as automatic call answering micro-message voice, video call, automatic play of tremble audio short video, YY live broadcast, and cool on demand.
In the embodiment, each test item to be tested is added into the test list, so that the test of each test item is realized.
Fig. 2 is a schematic diagram of the principle of improving service quality by monitoring OTT service provided in this embodiment, referring to fig. 2, the process collects OTT service data (i.e. service change data) and network side data (i.e. network data) for a certain OTT through a mobile phone terminal. And determining a test result by decoding the network side data and combining the OTT service data with analysis statistics of the network side data. Statistics, playback, and presentation of these test results were further recorded. Specifically, monitoring the OTT service quality of the mobile phone, and monitoring and collecting network data of a terminal and data of related applications; analyzing to obtain service time and service type, and generating quality indexes such as success rate, speed, time delay and the like; and uploading the cloud platform, and further analyzing the service quality from each dimension through big data so as to more conveniently and accurately perform network optimization.
Further, on the basis of the foregoing embodiments, the determining, according to the network data and the service change data, a test result for testing the service quality of the service item includes:
generating a first change relation of network data monitored by the service along with service running time, a second change relation of network data monitored by the service along with service state, a first comparison chart formed by the first change relation corresponding to various services in the service item, and/or a second comparison chart formed by the second change relation corresponding to various services in the service item for each service in the service item;
the generated first change relation, the second change relation, the first comparison graph and/or the second comparison graph are used as the test result;
the network data comprises signal strength, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
The service operation time refers to a time when a certain service is operated, for example, a certain period of operation time or the whole operation time from the start of the micro communication voice, the micro communication voice on process, and the whole process of the micro communication voice end. The service state refers to a state of the service in different processes, for example, a waiting on state before the micro communication voice is on, a state in the micro communication voice is on, and a state corresponding to a time when the micro communication voice is ended. Different kinds of services, i.e. different service types, e.g. WeChat speech and WeChat video belong to different kinds of services.
For example, if the service included in the test item is a WeChat voice, the network data is monitored for the entire process from waiting for the connection to ending of the WeChat voice. If the monitored network data is the signal intensity, generating a first change relation of the signal intensity along with the service running time in the whole WeChat voice process; generating a second change relation of signal strength according to the change of each selected time in the whole process of the micro-message voice (for example, the selected time comprises a certain time when the micro-message voice waits for a switch-on state, a certain time when the micro-message voice is switched on, a time when the micro-message voice is ended, and other times selected in the switch-on state); and taking the generated first change relation and second change relation as a test result of the test item.
For another example, when the services included in the test item are two services of WeChat voice and WeChat video, a first comparison graph can be generated in which the abscissa is the service running time and the ordinate is the signal strength, and the first comparison graph includes two curves, which are the first change relationship of WeChat voice and the first change relationship of WeChat video, respectively, besides the first change relationship and the second change relationship of WeChat voice and WeChat video. For better contrast between the two curves, for example, the abscissa represents a time interval with respect to a transition time of the service from the waiting on state to the on state (for example, a value of the abscissa corresponding to the transition time is 0, the service running time before the transition time is a negative value, the larger the time interval from the transition time is, the larger the absolute value is, and the service running time after the transition time is a positive value, and the larger the time interval from the transition time is, the larger the value is).
In addition, a second comparison chart can be generated, wherein in the second comparison chart, the abscissa is a service state, the ordinate is signal strength, and the second comparison chart comprises two curves which are respectively a second change relation of WeChat voice and a second change relation of WeChat video.
In this embodiment, a test report generated for a service item, that is, a change relation presented by network data when the service item is generated to change according to different dimensions, can intuitively understand the network conditions of different service items through the test report.
In order to analyze the network data of the service item, further, on the basis of the above embodiments, the method further includes:
if abnormal network data exist in the test result, the service quality of the service item is unqualified;
the abnormal network data comprises the results of signal strength smaller than or equal to a first threshold value, signal transmission rate smaller than or equal to a second threshold value, signal transmission delay larger than or equal to a third threshold value, network data receiving success rate smaller than or equal to a fourth threshold value, packet loss rate larger than or equal to a fifth threshold value, network jitter larger than or equal to a sixth threshold value and signal interference.
The first threshold value, the second threshold value, the third threshold value, the fourth threshold value, the fifth threshold value and the sixth threshold value are all set values.
For example, if the monitored network data includes signal strength, the test report includes a first change relationship and a second change relationship corresponding to the WeChat voice. If a certain point exists in the first change relation, the signal strength is smaller than a first threshold value, and abnormal network data exists in the first change relation. The service quality of the service item containing the WeChat voice is disqualified.
In this embodiment, by testing whether abnormal network data exists in the results, service items with unqualified service quality are screened out, and service items to be considered in network optimization are accurately located.
Further, on the basis of the above embodiments, the method further includes:
and taking the service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as the OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTT provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
Further, if the first proportion is greater than the first reference proportion, the influence of the OTT to be analyzed on the network is considered when the network is optimized by eliminating network anomalies, and if the second proportion is greater than the second reference proportion, the service provider with the second proportion greater than the second reference proportion is used as the service provider to be analyzed, and the influence of the service provided by the service provider to be analyzed on the network is considered when the network is optimized by eliminating network anomalies. Through the network data monitored in the service operation process in different service projects, the network problems can be associated with specific services, service projects and service providers, so that the network problems can be accurately and rapidly positioned, network anomalies can be eliminated, and optimization can be better performed.
When the network optimization is performed, the network condition corresponding to each OTT or the network condition corresponding to the service provider can be considered, network abnormality caused by accidental factors can be avoided through the first proportion and the second proportion, and accuracy of positioning the network problem is improved.
Fig. 3 is a schematic diagram of an implementation process of the OTT service quality testing method provided in this embodiment, referring to fig. 3, the process includes the following contents:
passively acquiring terminal network side data, decoding data streams therein, recording, analyzing, counting and displaying relevant code stream information;
and issuing by a cloud platform or actively setting an automatic test list by a tester, and actively performing a series of OTT service tests. Such as automatically dialing and receiving WeChat voice and video telephone, automatically playing tremble audio and short video, YY live broadcast, and requesting cool broadcast. Various parameter indexes in the OTT service process, such as time delay, jitter and the like, are collected;
and carrying out association analysis on the acquired data through the terminal and the cloud platform to generate OTT related service quality indexes. The method can check various parameters and analysis results in real time at the terminal and the cloud platform, and can perform visual data playback, so that the efficiency of network analysts in solving problems is greatly improved.
Specifically, the OTT service quality testing method provided in the present embodiment includes a "testing section" and an "analysis display section".
Wherein the functions implemented by the "test part" include:
and issuing by a cloud platform or actively setting an automatic test list by a tester, and actively performing a series of OTT service tests. In the test process, information such as interface state, server delay, data volume and the like of OTT application is monitored through auxiliary service, and related data of a mobile phone network side are synchronously collected and decoded, for example: cell information, neighbor cells, throughput, transmit power, air interface signaling, etc. Saving to the local and uploading to the cloud platform.
The functions implemented by the "analysis display portion" include:
carrying out association analysis on the acquired data through the terminal and the cloud platform; correlating the acquired and decoded network side data with OTT application side records, wherein the service time, IP and the like are the same in the same test, so that correlation records can be generated; and taking service time, service type and OTT application state as dimensions, and counting parameter quality under the dimensions, namely indexes such as signal strength, interference, speed, time delay and the like. The OTT service quality can be monitored very simply by means of these data. And the data and the analysis result can be displayed and played back on the terminal and the cloud platform. Fig. 4 is a schematic diagram of a network data interface monitored during video playing provided in this embodiment, referring to fig. 4, during video playing, monitored network data includes a real-time rate (signal transmission rate), and monitored service change data includes a video resolution.
According to the embodiment, the cloud platform is combined to automatically collect the terminal network side data and the related data of OTT service, so that analysis and statistics of OTT service quality are realized. Because the contents of the two aspects of the signaling plane at the network side and the OTT service plane at the user side are analyzed and correlated at the same time, OTT service quality can be conveniently monitored from various aspects such as service time, IP, PORT (PORT), route, service type and the like. The problem node can be positioned more quickly for network analysts.
Fig. 5 is a block diagram of an OTT service quality testing device provided in this embodiment, referring to fig. 5, the device includes a first obtaining module 501, a second obtaining module 502 and a determining module 503, where,
the first obtaining module 501 is configured to obtain a service item to be tested, where the service item includes at least one service in an application service OTT provided to a user through the internet;
a second obtaining module 502, configured to obtain network data and service change data monitored at a terminal when a service in the service item runs;
a determining module 503, configured to determine a test result of testing the service quality of the service item according to the network data and the service variation data.
The OTT service quality testing device provided in this embodiment is applicable to the OTT service quality testing method provided in the foregoing embodiment, and will not be described herein.
The embodiment provides an OTT service quality testing device, which acquires monitored network data and service change data when a service in a certain service item to be tested runs. And obtaining a test result reflecting the service quality of the service item according to the monitored network data and the monitored service change data. The network data is monitored when the business in the service project runs, the monitored network data is related to the service project, whether the network condition is related to the business in the service project can be reflected, the network problem of the specific business running can be positioned, and further, the network problem of the specific business can be positioned through the service provider corresponding to the specific business. The refinement of network data monitoring is beneficial to multidimensional analysis of network problems, quick and accurate positioning of network problems, deep optimization of network and improvement of OTT service quality.
Preferably, the second acquisition module is further configured to:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close the OTT except the OTT to be tested, opening the OTT to be tested, and only running the service in the service item through the OTT to be tested.
Preferably, the first acquisition module is further configured to:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list includes service items to be tested and OTTs corresponding to the service items.
Preferably, the determining module is further configured to:
generating a first change relation of network data monitored by the service along with service running time, a second change relation of network data monitored by the service along with service state, a first comparison chart formed by the first change relation corresponding to various services in the service item, and/or a second comparison chart formed by the second change relation corresponding to various services in the service item for each service in the service item;
the generated first change relation, the second change relation, the first comparison graph and/or the second comparison graph are used as the test result;
the network data comprises signal strength, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
Preferably, the determining module is further configured to:
if abnormal network data exist in the test result, the service quality of the service item is unqualified;
the abnormal network data comprises the results of signal strength smaller than or equal to a first threshold value, signal transmission rate smaller than or equal to a second threshold value, signal transmission delay larger than or equal to a third threshold value, network data receiving success rate smaller than or equal to a fourth threshold value, packet loss rate larger than or equal to a fifth threshold value, network jitter larger than or equal to a sixth threshold value and signal interference.
Preferably, the determining module is further configured to:
and taking the service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as the OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTT provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
Fig. 6 illustrates a physical schematic diagram of an electronic device, as shown in fig. 6, which may include: processor 601, communication interface (Communications Interface) 602, memory 603 and communication bus 604, wherein processor 601, communication interface 602, memory 603 complete the communication between each other through communication bus 604. The processor 601 may call logic instructions in the memory 603 to perform the following method: acquiring a service item to be tested, wherein the service item comprises at least one service in application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when the service in the service item runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
Further, the logic instructions in the memory 603 described above may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Further, embodiments of the present invention disclose a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the methods provided by the above-described method embodiments, for example comprising: acquiring a service item to be tested, wherein the service item comprises at least one service in application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when the service in the service item runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
In another aspect, an embodiment of the present invention further provides a non-transitory readable storage medium having stored thereon a computer program that is implemented when executed by a processor to perform the transmission method provided in the above embodiments, for example, including: acquiring a service item to be tested, wherein the service item comprises at least one service in application service OTT provided for a user through the Internet; acquiring network data and service change data monitored by a terminal when the service in the service item runs; and determining a test result for testing the service quality of the service item according to the network data and the service change data.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (12)
1. An OTT quality of service testing method, comprising:
acquiring a service item to be tested, wherein the service item comprises at least one service in application service OTT provided for a user through the Internet;
acquiring network data and service change data monitored by a terminal when the service in the service item runs;
determining a test result for testing the service quality of the service item according to the network data and the service change data;
the determining a test result for testing the service quality of the service item according to the network data and the service change data comprises the following steps:
generating a first change relation of network data monitored by the service along with service running time, a second change relation of network data monitored by the service along with service state, a first comparison chart formed by the first change relation corresponding to various services in the service item, and/or a second comparison chart formed by the second change relation corresponding to various services in the service item for each service in the service item;
the generated first change relation, the second change relation, the first comparison graph and/or the second comparison graph are used as the test result;
the network data comprises signal strength, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
2. The OTT quality of service testing method of claim 1, further comprising:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close the OTT except the OTT to be tested, opening the OTT to be tested, and only running the service in the service item through the OTT to be tested.
3. The OTT quality of service testing method of claim 1, wherein the obtaining a service item to be tested includes:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list includes service items to be tested and OTTs corresponding to the service items.
4. The OTT quality of service testing method of claim 1, further comprising:
if abnormal network data exist in the test result, the service quality of the service item is unqualified;
the abnormal network data comprises the results of signal strength smaller than or equal to a first threshold value, signal transmission rate smaller than or equal to a second threshold value, signal transmission delay larger than or equal to a third threshold value, network data receiving success rate smaller than or equal to a fourth threshold value, packet loss rate larger than or equal to a fifth threshold value, network jitter larger than or equal to a sixth threshold value and signal interference.
5. The OTT quality of service testing method of claim 4, further comprising:
and taking the service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as the OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTT provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
6. An OTT quality of service testing device, comprising:
the first acquisition module is used for acquiring a service item to be tested, wherein the service item comprises at least one service in application services OTT provided for a user through the Internet;
the second acquisition module is used for acquiring network data and service change data monitored by the terminal when the service in the service item runs;
the determining module is used for determining a test result for testing the service quality of the service item according to the network data and the service change data;
the determining module is further configured to:
generating a first change relation of network data monitored by the service along with service running time, a second change relation of network data monitored by the service along with service state, a first comparison chart formed by the first change relation corresponding to various services in the service item, and/or a second comparison chart formed by the second change relation corresponding to various services in the service item for each service in the service item;
the generated first change relation, the second change relation, the first comparison graph and/or the second comparison graph are used as the test result;
the network data comprises signal strength, signal transmission rate, signal transmission delay, network data receiving success rate, packet loss rate, network jitter and signal interference information.
7. The OTT quality of service testing device of claim 6, wherein the second acquisition module is further configured to:
determining OTT corresponding to the service item as OTT to be tested;
and controlling the terminal to close the OTT except the OTT to be tested, opening the OTT to be tested, and only running the service in the service item through the OTT to be tested.
8. The OTT quality of service testing device of claim 6, wherein the first acquisition module is further configured to:
downloading a test list or acquiring a preset test list through a cloud platform, and acquiring any service item to be tested from the test list;
the test list includes service items to be tested and OTTs corresponding to the service items.
9. The OTT quality of service testing device of claim 6, wherein the determination module is further configured to:
if abnormal network data exist in the test result, the service quality of the service item is unqualified;
the abnormal network data comprises the results of signal strength smaller than or equal to a first threshold value, signal transmission rate smaller than or equal to a second threshold value, signal transmission delay larger than or equal to a third threshold value, network data receiving success rate smaller than or equal to a fourth threshold value, packet loss rate larger than or equal to a fifth threshold value, network jitter larger than or equal to a sixth threshold value and signal interference.
10. The OTT quality of service testing device of claim 9, wherein the determination module is further configured to:
and taking the service items with unqualified service quality as abnormal service items, determining a first proportion occupied by the abnormal service items in the service items corresponding to each OTT, taking the OTT with the first proportion larger than a preset proportion as the OTT to be analyzed, determining a second proportion occupied by the OTT to be analyzed in the OTT provided by each service provider, and optimizing the network according to the first proportion and/or the second proportion.
11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor performs the steps of the OTT quality of service testing method according to any one of claims 1 to 5 when the program is executed.
12. A non-transitory readable storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of the OTT quality of service testing method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010006385.8A CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010006385.8A CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113079522A CN113079522A (en) | 2021-07-06 |
| CN113079522B true CN113079522B (en) | 2024-04-05 |
Family
ID=76608525
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010006385.8A Active CN113079522B (en) | 2020-01-03 | 2020-01-03 | OTT service quality testing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113079522B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115357518B (en) * | 2022-10-20 | 2023-02-10 | 深圳市国佳高鑫科技有限公司 | Method for realizing software service based on cloud service, client and cloud server |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024781A (en) * | 2012-12-30 | 2013-04-03 | 广西深睿科技有限公司 | Method for processing abnormalities in stage when mobile communication system cellphone accesses to network |
| CN104539556A (en) * | 2014-12-29 | 2015-04-22 | 南京邮电大学 | Method for providing satisfaction service quality for users under heterogeneous network environment |
| WO2017054553A1 (en) * | 2015-09-29 | 2017-04-06 | 华为技术有限公司 | Video quality detection method and apparatus, and service quality management centre |
| CN106993308A (en) * | 2016-01-20 | 2017-07-28 | 上海大唐移动通信设备有限公司 | A kind of QoS of voice monitoring method, equipment and the system of VoLTE networks |
| CN107172420A (en) * | 2017-06-23 | 2017-09-15 | 天津市德力电子仪器有限公司 | IPTV and OTT set-top box quality automatic method of testing |
| WO2018054385A1 (en) * | 2016-09-26 | 2018-03-29 | 中兴通讯股份有限公司 | Network switching method and device |
| EP3484101A1 (en) * | 2017-11-10 | 2019-05-15 | Netscout Systems, Inc. | Automatically determining over-the-top applications and services |
-
2020
- 2020-01-03 CN CN202010006385.8A patent/CN113079522B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103024781A (en) * | 2012-12-30 | 2013-04-03 | 广西深睿科技有限公司 | Method for processing abnormalities in stage when mobile communication system cellphone accesses to network |
| CN104539556A (en) * | 2014-12-29 | 2015-04-22 | 南京邮电大学 | Method for providing satisfaction service quality for users under heterogeneous network environment |
| WO2017054553A1 (en) * | 2015-09-29 | 2017-04-06 | 华为技术有限公司 | Video quality detection method and apparatus, and service quality management centre |
| CN106993308A (en) * | 2016-01-20 | 2017-07-28 | 上海大唐移动通信设备有限公司 | A kind of QoS of voice monitoring method, equipment and the system of VoLTE networks |
| WO2018054385A1 (en) * | 2016-09-26 | 2018-03-29 | 中兴通讯股份有限公司 | Network switching method and device |
| CN107172420A (en) * | 2017-06-23 | 2017-09-15 | 天津市德力电子仪器有限公司 | IPTV and OTT set-top box quality automatic method of testing |
| EP3484101A1 (en) * | 2017-11-10 | 2019-05-15 | Netscout Systems, Inc. | Automatically determining over-the-top applications and services |
Non-Patent Citations (2)
| Title |
|---|
| "Assessing unreliability in OTT video QoE subjective evaluations using clustering with idealized data";Jie Jiang et.al;《2016 Digital Media Industry & Academic Forum (DMIAF)》;20160926;全文 * |
| "拟态构造Web服务器的服务质量量化方法";张杰鑫等;《计算机科学》;20190821;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113079522A (en) | 2021-07-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Aggarwal et al. | Prometheus: Toward quality-of-experience estimation for mobile apps from passive network measurements | |
| EP2130326B1 (en) | Method and apparatus for evaluating services in communication networks | |
| CN113094239B (en) | Method for determining reason of live broadcast abnormity and server | |
| CN106952657B (en) | Voice quality detection method and device | |
| WO2014029291A1 (en) | Method, network element and system for evaluating voice quality | |
| CN108428459A (en) | A kind of VoLTE speech quality assessment methods and system | |
| CN111327471A (en) | Network quality analysis method and device, computer equipment and storage medium | |
| CN100372320C (en) | Method and system for detecting service quality in next generation network | |
| CN109982293A (en) | Flow product method for pushing, system, electronic equipment and storage medium | |
| CN113079522B (en) | OTT service quality testing method and device, electronic equipment and storage medium | |
| CN112134846A (en) | Method, system, device and medium for analyzing signaling data of communication network | |
| US11349731B2 (en) | Data collection for the evaluation of the quality of experience of a service over a communications network | |
| CN109994128B (en) | Voice quality problem positioning method, device, equipment and medium | |
| CN116719750B (en) | Software testing method and device, server equipment and storage medium | |
| Szilágyi et al. | Network side lightweight and scalable YouTube QoE estimation | |
| WO2010052695A1 (en) | Method and apparatus for assessing communication quality | |
| CN109474940B (en) | Service quality detection method and device | |
| CA3150367A1 (en) | System and method for classifying and handling voice over ip traffic | |
| CN114640600A (en) | Network service quality analysis method, system and storage medium | |
| CN111541585A (en) | Access equipment inspection method and device | |
| Colarieti et al. | QoE provisioning over mobile networks: The CASPER perspective | |
| Bernardo et al. | Evaluation of video transmission energy consumption and quality | |
| Wilches-Cortina et al. | A VoIP call classifier for carrier grade based on Support Vector Machines | |
| CN113676373B (en) | Session test method, session test device, computer equipment and storage medium | |
| CN111614623B (en) | VoLTE user perception information processing method, system and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |