CN114071232B

CN114071232B - Audio and video quality visualization method and device, equipment, medium and product thereof

Info

Publication number: CN114071232B
Application number: CN202111301949.1A
Authority: CN
Inventors: 林绪虹; 李凌; 赵显宁
Original assignee: Guangzhou Huaduo Network Technology Co Ltd
Current assignee: Guangzhou Huaduo Network Technology Co Ltd
Priority date: 2021-11-04
Filing date: 2021-11-04
Publication date: 2023-07-21
Anticipated expiration: 2041-11-04
Also published as: CN114071232A

Abstract

The application relates to an audio and video processing technology and discloses an audio and video quality visualization method and a device, equipment, medium and product thereof, wherein the method comprises the following steps: pushing audio and video streams to different terminal devices running the same application program, wherein different network simulation configuration information is applied to the different terminal devices, and the network simulation configuration information is used for dynamically controlling the transmission quality of the audio and video streams received by the terminal devices; sampling data uploaded by the application program on corresponding terminal equipment are collected, and the sampling data are used for describing the transmission quality of the corresponding terminal equipment when acquiring the audio and video stream; invoking a preset evaluation interface to quantitatively analyze the audio and video quality of the sampling data collected by the network simulation configuration information, and obtaining corresponding quality evaluation data; and generating a visual chart page to output and display according to the quality evaluation data. The method and the device realize an integrated solution for quality evaluation of the on-line transmission quality of the audio and video stream.

Description

Audio and video quality visualization method and device, equipment, medium and product thereof

Technical Field

The present disclosure relates to audio and video processing technologies, and in particular, to an audio and video quality visualization method, and corresponding apparatus, computer device, computer readable storage medium, and computer program product.

Background

In audio and video applications (such as live broadcast, video conference, etc.), the transmission quality of the audio and video streams of the online users needs to be closely focused, and the encoding and transmission strategies are quickly adjusted by monitoring the transmission quality of the audio and video streams received by the online users. In order to realize quality monitoring of audio and video streams, a large amount of end-to-end full-link data are reported, the data are very complicated and have undefined physical meaning, and the data are greatly influenced by disturbance factors such as regions, time, networks, participators, user equipment, SDK versions and the like, so that effective analysis of the data is difficult.

The existing general evaluation method for various quality indexes of audio and video in the industry mainly evaluates quality distribution through description data such as median, quartile and the like, so that a good quality result is obtained, the evaluation method has the problems of single dimension of a quantized index, poor robustness and the like, the distribution condition of the index at a specific time point cannot be described, and the more real quality condition of the index cannot be shown.

How to analyze the online data and finally deduce the transmission quality of the audio and video stream, so that the audio and video quality is more visual, and the method becomes a difficult problem to be solved in the industry.

Disclosure of Invention

It is a primary object of the present application to solve at least one of the above problems and provide an audio/video quality visualization method and corresponding apparatus, computer device, computer readable storage medium, computer program product.

In order to meet the purposes of the application, the application adopts the following technical scheme:

an audio and video quality visualization method provided in accordance with one of the purposes of the present application includes the following steps:

pushing audio and video streams to different terminal devices running the same application program, wherein different network simulation configuration information is applied to the different terminal devices, and the network simulation configuration information is used for dynamically controlling the transmission quality of the audio and video streams received by the terminal devices;

sampling data uploaded by the application program on corresponding terminal equipment are collected, and the sampling data are used for describing the transmission quality of the corresponding terminal equipment when acquiring the audio and video stream;

invoking a preset evaluation interface to quantitatively analyze the audio and video quality of the sampling data collected by the network simulation configuration information, and obtaining corresponding quality evaluation data;

And generating a visual chart page to output and display according to the quality evaluation data.

In a deepened embodiment, an audio and video stream is pushed to different terminal devices running the same application program, and different network simulation configuration information is applied to the different terminal devices, including the following steps:

starting to push audio and video streams to different terminal devices running different versions of application programs;

and in the pushing process of the audio and video stream, calling preset network simulation configuration information to dynamically change the transmission quality of the audio and video stream in different time periods, wherein the network simulation configuration information comprises network transmission quality configuration parameters which change along a time axis.

In a deepened embodiment, a preset evaluation interface is called to perform quantitative analysis on audio and video quality of the sampled data collected by the network simulation configuration information, so as to obtain corresponding quality evaluation data, and the evaluation interface performs the following steps:

acquiring a plurality of pieces of sampling data respectively representing different transmission quality of the audio and video stream, and respectively calculating index data corresponding to the same quality index under each transmission quality according to each piece of sampling data;

calculating corresponding density distribution data for index data of each quality index by applying a target distribution function preset for the quality index to obtain each group of statistical characteristic values corresponding to each density distribution data;

And calculating relative scoring information related to all quality indexes among all transmission qualities by applying a preset quality evaluation algorithm and adopting all groups of statistical characteristic values corresponding to the quality indexes.

In a further embodiment, before acquiring a plurality of pieces of sampling data respectively representing different transmission qualities of an audio/video stream, the method includes the following pre-steps:

acquiring a sample data set corresponding to a quality index for evaluating the transmission quality of an audio/video stream, and calculating index data of each group of sampling data pre-acquired in the sample data set;

performing nuclear density estimation on the index data with a preset step length to obtain corresponding density distribution data;

adopting a plurality of preset distribution functions, respectively carrying out data fitting on the index data with the preset step length, and selecting a target distribution function with the highest fitting degree for the corresponding quality index;

a corresponding quality evaluation algorithm is constructed to calculate a relative score in which the respective transmission quality is associated with the corresponding quality index using statistical eigenvalues of the density distribution data of the different quality indexes calculated from the target distribution function.

In a specific embodiment, a sample data set corresponding to a quality index for evaluating transmission quality of an audio/video stream is obtained, and index data of each set of sampling data pre-collected in the sample data set is calculated, including the following steps:

Acquiring a calculation formula and evaluation dimension information preset for quality indexes of an audio and video stream, wherein the evaluation dimension information comprises classification dimensions and quantization dimensions of the quality indexes;

extracting a plurality of groups of sampling data with the classifying dimension from a sample database to form a sample data set;

carrying out data cleaning on the sample data set according to a preset rule, and removing abnormal samples to obtain a final sample data set;

and applying the calculation formula to calculate corresponding index data of each item of sampling data corresponding to the quantization dimension in each group of sampling data in the final sample data set.

In a further embodiment, a plurality of preset distribution functions are adopted, the data fitting is performed on the index data according to the preset step length, and the target distribution function with the highest fitting degree is selected for the corresponding quality index, including the following steps:

adopting a plurality of preset distribution functions to perform data fitting on all index data of the quality index respectively with the preset step length to obtain density distribution data corresponding to each distribution function;

calculating a corresponding first group of statistical characteristic values according to the density distribution data obtained by the nuclear density estimation;

Calculating a second group of statistical characteristic values corresponding to each distribution function according to the density distribution data corresponding to each distribution function;

and respectively comparing the second group of statistical characteristic values of each distribution function with the first group of statistical characteristic values to obtain the distribution function with the optimal comparison result as the target distribution function with the highest fitting degree.

In a further embodiment, a preset quality evaluation algorithm is applied, and relative scoring information associated with all quality indexes among the transmission qualities is calculated by adopting each group of statistical feature values corresponding to the quality indexes, including the following steps:

calculating relative scoring information corresponding to each quality index according to each group of statistical characteristic values corresponding to each quality index, wherein the relative scoring information represents relative scores related to the quality index among transmission qualities;

and carrying out weighted summation on the relative scoring information corresponding to each quality index to obtain the relative scoring information associated with all the quality indexes among the transmission quality.

An audio/video quality visualization apparatus provided in accordance with one of the objects of the present application, comprising: the system comprises a media pushing module, a data acquisition module, a quality evaluation module and an output display module, wherein the media pushing module is used for pushing audio and video streams to different terminal devices running the same application program, and different network simulation configuration information is applied to the different terminal devices and used for dynamically controlling the transmission quality of the audio and video streams received by the terminal devices; the data acquisition module is used for acquiring sampling data uploaded by the application program at the corresponding terminal equipment, and the sampling data are used for describing the transmission quality of the corresponding terminal equipment when acquiring the audio and video stream; the quality evaluation module is used for calling a preset evaluation interface to quantitatively analyze the audio and video quality of the sampling data acquired by the network simulation configuration information so as to obtain corresponding quality evaluation data; and the output display module is used for generating visual chart page output display according to the quality evaluation data.

In a further embodiment, the media pushing module includes: the pushing sub-module is used for starting to push audio and video streams to different terminal devices running different versions of application programs; and the simulation weakening sub-module is used for adapting to each terminal device, and in the pushing process of the audio and video stream, the preset network simulation configuration information is called to dynamically change the transmission quality of the audio and video stream in different time periods, wherein the network simulation configuration information comprises network transmission quality configuration parameters which change along a time axis.

In a further embodiment, the evaluation interface comprises: the index calculation module is used for acquiring a plurality of sampling data respectively representing different transmission quality of the audio and video stream, and respectively calculating index data corresponding to the same quality index under each transmission quality according to each sampling data; the statistical analysis module is used for applying a target distribution function preset for the quality index, calculating corresponding density distribution data for the index data of each quality index, and obtaining each group of statistical characteristic values corresponding to each density distribution data; and the quality scoring module is used for applying a preset quality evaluation algorithm and calculating relative scoring information which is related to all quality indexes among all transmission qualities by adopting all groups of statistical characteristic values corresponding to the quality indexes.

In a further embodiment, the evaluation interface further comprises: the sample preparation module is used for acquiring a sample data set corresponding to a quality index for evaluating the transmission quality of the audio and video stream and calculating index data of each group of sampling data pre-acquired in the sample data set; the original statistics module is used for carrying out kernel density estimation on the index data with a preset step length to obtain corresponding density distribution data; the trial calculation statistical module is used for adopting a plurality of preset distribution functions, respectively carrying out data fitting on the index data according to the preset step length, and selecting a target distribution function with the highest fitting degree for the corresponding quality index; and the evaluation construction module is used for constructing a corresponding quality evaluation algorithm to calculate the relative scores related to the corresponding quality indexes among the transmission quality by using the statistical characteristic values of the density distribution data of the different quality indexes calculated by the target distribution function.

In a specific embodiment, the sample preparation module comprises: the data preparation sub-module is used for acquiring a calculation formula and evaluation dimension information preset for the quality index of the audio and video stream, wherein the evaluation dimension information comprises a classification dimension and a quantization dimension of the quality index; the data extraction sub-module is used for extracting a plurality of groups of sampling data with the classifying dimension from a sample database to form a sample data set; the data cleaning sub-module is used for cleaning the data of the sample data set according to a preset rule and removing abnormal samples to obtain a final sample data set; and the index calculation sub-module is used for applying the calculation formula and calculating corresponding index data of each item of sampling data corresponding to the quantization dimension in each group of sampling data in the final sample data set.

In a further embodiment, the trial run statistics module includes: the trial calculation statistics sub-module is used for carrying out data fitting on all index data of the quality index by adopting a plurality of preset distribution functions respectively with the preset step length to obtain density distribution data corresponding to each distribution function; the first statistical sub-module is used for calculating a corresponding first group of statistical characteristic values according to the density distribution data obtained by the nuclear density estimation; the second statistical sub-module is used for calculating a second group of statistical characteristic values corresponding to each distribution function according to the density distribution data corresponding to each distribution function; and the statistical comparison sub-module is used for comparing the second group of statistical characteristic values of each distribution function with the first group of statistical characteristic values respectively to obtain the distribution function with the optimal comparison result as the target distribution function with the highest fitting degree.

In a further embodiment, the quality evaluation module includes: the score calculating sub-module is used for calculating relative score information corresponding to each quality index according to each group of statistical characteristic values corresponding to each quality index, and the relative score information represents the relative score associated with the quality index between each transmission quality; and the scoring fusion sub-module is used for carrying out weighted summation on the relative scoring information corresponding to each quality index to obtain the relative scoring information associated with all the quality indexes among the transmission quality.

A computer device provided in accordance with one of the objects of the present application includes a central processor and a memory, the central processor being configured to invoke the steps of running a computer program stored in the memory to perform the audio video quality visualization method described herein.

A computer readable storage medium adapted to another object of the present application stores a computer program implemented according to the audio/video quality visualization method in the form of computer readable instructions, which when invoked by a computer, performs the steps comprised by the method.

A computer program product is provided adapted for another object of the present application, comprising a computer program/instruction which, when executed by a processor, carries out the steps of the method described in any of the embodiments of the present application.

Compared with the prior art, the method has the following advantages:

according to the method, the device and the system, the transmission quality of the terminal equipment receiving the audio and video stream is controlled through the network simulation configuration information to acquire the sampling data describing each transmission quality, then the standardized evaluation interface is called to perform standardized evaluation on each transmission quality, and finally the evaluation result is output in a visual form, so that the service flow of standardized test, analysis and observation of the corresponding transmission quality of the audio and video stream is realized, and the evaluation efficiency of the quality of the audio and video stream can be improved.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a flow chart of an exemplary embodiment of an audio/video quality visualization method of the present application;

FIG. 2 is a schematic flow chart of business logic of an evaluation interface in an embodiment of the present application;

FIG. 3 is a flow chart illustrating a process of determining a target distribution function and a quality evaluation algorithm according to an embodiment of the present application;

FIG. 4 is a flowchart illustrating a process of calculating index data according to an embodiment of the present application;

FIG. 5 is a flow chart illustrating a process for determining an objective distribution function according to an embodiment of the present application;

FIG. 6 is a schematic block diagram of an audio video quality visualization device of the present application;

fig. 7 is a schematic structural diagram of a computer device used in the present application.

Detailed Description

Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of illustrating the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless expressly stated otherwise, as understood by those skilled in the art. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. The term "and/or" as used herein includes all or any element and all combination of one or more of the associated listed items.

It will be understood by those skilled in the art that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs unless defined otherwise. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As used herein, "client," "terminal device," and "terminal device" are understood by those skilled in the art to include both devices that include only wireless signal receivers without transmitting capabilities and devices that include receiving and transmitting hardware capable of two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device such as a personal computer, tablet, or the like, having a single-line display or a multi-line display or a cellular or other communication device without a multi-line display; a PCS (Personal Communications Service, personal communication system) that may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant ) that can include a radio frequency receiver, pager, internet/intranet access, web browser, notepad, calendar and/or GPS (Global Positioning System ) receiver; a conventional laptop and/or palmtop computer or other appliance that has and/or includes a radio frequency receiver. As used herein, "client," "terminal device" may be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or adapted and/or configured to operate locally and/or in a distributed fashion, at any other location(s) on earth and/or in space. As used herein, a "client," "terminal device," or "terminal device" may also be a communication terminal, an internet terminal, or a music/video playing terminal, for example, a PDA, a MID (Mobile Internet Device ), and/or a mobile phone with music/video playing function, or may also be a device such as a smart tv, a set top box, or the like.

The hardware referred to by the names "server", "client", "service node" and the like in the present application is essentially an electronic device having the performance of a personal computer, and is a hardware device having necessary components disclosed by von neumann's principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device, and a computer program is stored in the memory, and the central processing unit calls the program stored in the external memory to run in the memory, executes instructions in the program, and interacts with the input/output device, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application is equally applicable to the case of a server farm. The servers should be logically partitioned, physically separate from each other but interface-callable, or integrated into a physical computer or group of computers, according to network deployment principles understood by those skilled in the art. Those skilled in the art will appreciate this variation and should not be construed as limiting the implementation of the network deployment approach of the present application.

One or several technical features of the present application, unless specified in the plain text, may be deployed either on a server to implement access by remotely invoking an online service interface provided by the acquisition server by a client, or directly deployed and run on the client to implement access.

The neural network model cited or possibly cited in the application can be deployed on a remote server and used for implementing remote call on a client, or can be deployed on a client with sufficient equipment capability for direct call unless specified in a clear text, and in some embodiments, when the neural network model runs on the client, the corresponding intelligence can be obtained through migration learning so as to reduce the requirement on the running resources of the hardware of the client and avoid excessively occupying the running resources of the hardware of the client.

The various data referred to in the present application, unless specified in the plain text, may be stored either remotely in a server or in a local terminal device, as long as it is suitable for being invoked by the technical solution of the present application.

Those skilled in the art will appreciate that: although the various methods of the present application are described based on the same concepts so as to be common to each other, the methods may be performed independently, unless otherwise indicated. Similarly, for each of the embodiments disclosed herein, the concepts presented are based on the same inventive concept, and thus, the concepts presented for the same description, and concepts that are merely convenient and appropriately altered although they are different, should be equally understood.

The various embodiments to be disclosed herein, unless the plain text indicates a mutually exclusive relationship with each other, the technical features related to the various embodiments may be cross-combined to flexibly construct a new embodiment, so long as such combination does not depart from the inventive spirit of the present application and can satisfy the needs in the art or solve the deficiencies in the prior art. This variant will be known to the person skilled in the art.

An audio/video quality visualization method of the present application may be programmed as a computer program product, deployed to be executed in a client or a server, for example, in a network live application scenario of the present application, typically deployed to be executed in the server, so that the method may be executed by accessing an interface that is opened after the computer program product is executed, and performing man-machine interaction with a process of the computer program product through a graphical user interface.

Referring to fig. 1, in an exemplary embodiment, the audio/video quality visualization method of the present application includes the following steps:

step S3100, pushing audio and video streams to different terminal devices running the same application program, where different network emulation configuration information is applied to different terminal devices, where the network emulation configuration information is used to dynamically control the transmission quality of the audio and video streams received by the terminal devices:

In general, different versions of the same application are installed in different terminal devices for use, or may be run sequentially on the same terminal device during a test phase, so that during the running phase of the application, the server pulls a stream according to the service logic inherent to the application, and then pushes a corresponding audio/video stream to the corresponding terminal device, which is received and played by the application running on the terminal device.

Different terminal devices play the received audio and video streams and the obtained audio and video streams have different quality because the influence of disturbance factors of the regional, time, network, number of participants, user equipment, SDK version and other environmental conditions is relatively large. However, in the case of the same or similar environmental conditions, the difference in quality of the audio and video streams may be less obvious, so that the processing of weakening the transmission quality can be performed on the data communication link between the audio and video streams from the server to the terminal device through the network emulation technology, so as to meet the requirements of testing the running performance between different versions of the application program.

In one embodiment, the network simulation technology can be implemented in a parameter simulation mode, the network simulation capability is integrated into a service node supporting the service operation of an application program, corresponding network simulation configuration information is applied, network parameters of an audio and video stream transmitted by the service node are dynamically set to simulate various network conditions, and automatic network simulation test is realized to improve the test efficiency. Accordingly, the network emulation configuration information generally includes an instruction set formed by a plurality of control instructions, each instruction encapsulates a corresponding respective associated network configuration parameter at a different time, and when the corresponding time of an instruction is reached, the network configuration parameter corresponding to the instruction is applied to the data communication link to automatically weaken the network condition.

In another embodiment, the network simulation technology can adopt a device simulation mode, and through a network injury instrument, corresponding network simulation configuration information is applied to set network parameters such as code rate, delay, jitter, sine packet loss or cosine packet loss, etc., so as to simulate the network condition and realize the adjustment of transmission quality. This approach is relatively inefficient and costly.

In yet another embodiment, the network simulation technique may be implemented in a data simulation manner to implement equivalent replacement of parameter simulation, by collecting real network parameters of the user to generate a network data model of the user, and by generating the network simulation configuration information through the model to perform simulation.

After the network simulation configuration information is applied, the quality of the audio and video stream reaching the terminal equipment is controlled to change under the control of the network simulation configuration information, so that the transmission quality which changes in time and is different from each other is displayed on different terminal equipment.

Different terminal devices can apply different network simulation modes to realize weak network control of transmission quality, or can also apply different network simulation configuration information to realize weak network control based on the same network simulation mode, and finally, different data communication links can display different transmission quality.

Step S3200, collecting sampling data uploaded by the application program at a corresponding terminal device, where the sampling data is used to describe transmission quality when the corresponding terminal device obtains the audio/video stream:

in order to collect various sampling data describing transmission quality on a terminal device receiving the audio/video stream, a corresponding embedded point code is usually preset in the application program, and when the embedded point code starts to operate, the corresponding sampling data can be obtained, so that the specific sampling data obtained by a person skilled in the art can be flexibly implemented according to the requirement.

When the method is implemented, the specific type of the sampled data can be determined by examining the full link characteristics of the data communication link for receiving the audio and video stream in advance, and the statistical mode, the reporting period, the reporting mode, the reporting time and the like of the sampled data can be predefined, and finally the method is implemented by using buried point codes. In order to control the data statistics precision, the statistics period can be flexibly configured according to the index characteristics, and the reporting mode and the reporting timer are also flexible. In addition, a plurality of relevant sampling data for determining the quality index can be acquired in association with each preset quality index, so that the sampling data can be acquired by taking the quality index as a unit.

In order to facilitate reporting and statistics by taking the quality index as a unit, the quality index is classified first, for example, service connection correlation, multicast correlation, audio and video speed correlation, audio and video uplink correlation, audio and video downlink correlation and the like are included. All the sampled data related to the quality indexes are finally reflected on the transmission quality of the terminal equipment, and from the perspective of user experience of the terminal equipment, several quality indexes which are more interesting can be: video delay (delay), video frame rate (fps), video rate (rate), video fluency (fluency), audio-video synchronization difference (diff), etc.

The relevant embedded point codes used for collecting the sampling data relevant to each quality index can be embedded in each node of the whole data communication link of the audio and video stream, and the embedded point codes comprise a service node, an intermediate node, a terminal device and the like which are embedded in the service node for providing the push service of the audio and video stream and are used for receiving the audio and video stream, so that the transmission quality is more comprehensively examined and analyzed through the sampling data formed by multiple nodes.

The data communication link, in particular the sampled data uploaded by the terminal device, may be persisted and stored in a corresponding database for subsequent quality assessment.

When the sampled data is stored in the database, the relevant sampled data can be organized and stored according to evaluation information dimensions, wherein the evaluation information dimensions can comprise a classifying dimension and a quantization dimension, the classifying dimension is generally used for indicating the source and the object of the sampled data, such as indicating which terminal equipment or which application version the sampled data originates from, and the quantization dimension is generally used for corresponding to specific types of sampled data, such as video frame rate, video delay, video code rate, video fluency, audio-video synchronization difference and the like, so that index data of quality indexes can be calculated according to the index data.

Step S3300, call a preset evaluation interface to perform quantitative analysis on audio and video quality of the sampled data collected by the network simulation configuration information, so as to obtain each corresponding quality evaluation data:

the evaluation interface is specially used for evaluating the quality according to the acquired data, and can quantitatively analyze different situations such as among a plurality of terminal devices, among a plurality of application programs, among a plurality of regions, among a plurality of transmission qualities and the like along the space dimension, quantitatively analyze the same transmission quality along the time dimension, and comprehensively analyze the space dimension and the time dimension. The higher frequency requirement is a comparative analysis.

According to the requirements of comparison analysis, the evaluation interface can conduct quantitative analysis on audio and video quality of the sampling data collected by the network simulation configuration information, after the quantitative analysis, corresponding quality evaluation data are generated, wherein the quality evaluation data can be relative score information generated by analysis on the basis of index data related to one or more quality indexes between two transmission qualities corresponding to two different application program versions, or can also comprise relative score information generated by analysis on the basis of index data related to each quality index between the two transmission qualities, corresponding relative scores can be given to the relative score information, and the quality evaluation data can be packaged into various chart and list forms so that terminal equipment receiving the quality evaluation data can display the quality evaluation data in a visual mode.

The specific process of implementing the quantitative analysis of audio and video quality by the evaluation interface will be further disclosed in various embodiments later in the application, and is not listed here. Of course, the evaluation interface may also be implemented as other related functions, which may be flexibly designed and implemented by those skilled in the art as needed, and the focus is on using the sampled data collected in the present application to implement quantitative analysis related to various statistical purposes.

Step S3400, generating a visual chart page output display according to the quality evaluation data:

after the quality evaluation data are generated by the evaluation interface, the quality evaluation data encapsulate specific data related to the visual chart, so that a corresponding visual image can be generated according to the quality evaluation data, embedded into a page and pushed to a terminal device for executing the technical scheme of the application for display, so that a related management user obtains visual quality evaluation information.

According to the disclosure of the present exemplary embodiment, it may be understood that, in the present application, the transmission quality of a terminal device receiving an audio/video stream is controlled by using network emulation configuration information to obtain sampling data describing each transmission quality, and then a standardized evaluation interface is called to perform standardized evaluation on each transmission quality, and finally an evaluation result is output in a visual form, so that a service flow for standardized testing, analysis and observation of the corresponding transmission quality of the audio/video stream is implemented, and an evaluation efficiency of the quality of the audio/video stream can be improved.

The application of the method realizes the automatic business logic of the audio and video streaming quality test, can well process various sampling data acquired by the audio and video application program, can well evaluate the quality change condition of the application program product corresponding to various quality indexes by processing the sampling data, gives early warning to the product quality change, provides improved help to the business strategy, helps developers to find problems in time, positions reasons, and solves the problems efficiently so as to improve the operation efficiency and user experience of the product, and can also guide the operation deployment, guide the routing strategy and the strategy adjustment of acquisition, playing, encoding and decoding, transmission and the like.

In a deepened embodiment, the step S3100 of pushing the audio and video streams to different terminal devices running the same application program, where different terminal devices are applied with different network simulation configuration information, includes the following steps:

step S3110, starting to push audio and video streams to different terminal devices running different versions of application programs:

the embodiment is suitable for carrying out targeted processing on sampling data generated by terminal equipment with different versions of the same application program so as to comprehensively evaluate the processing capability of the audio and video streams of the two different versions of the application program according to the sampling data, so that the audio and video streams can be pushed to the different terminal equipment with different versions of the same application program in a targeted manner when the application is applied. The sampling data can be collected and uploaded automatically by embedded point codes built in the application program as described above.

Step S3120, adapting to each terminal device, in the process of pushing the audio/video stream, calling preset network simulation configuration information to dynamically change the transmission quality of the audio/video stream in different time periods, wherein the network simulation configuration information comprises network transmission quality configuration parameters which change along a time axis:

As described above, the network emulation configuration information generally includes an instruction set formed by a plurality of control instructions, each instruction encapsulates a corresponding respective associated network configuration parameter at a different time, and when the corresponding time of an instruction is reached, the network configuration parameter corresponding to the instruction is applied to the data communication link to automatically weaken the network condition. Therefore, for each terminal device, after the network simulation configuration information is applied in the pushing process of the audio/video stream, under the action of the control instruction of the network simulation configuration information, which changes along the time axis, different control instructions can be executed in different time periods, and relevant network configuration parameters of the data communication link corresponding to the terminal device are correspondingly modified, so that the transmission quality of the data communication link is dynamically changed, and the terminal device is enabled to continuously acquire relevant sampling data under various transmission qualities.

The technical scheme of the embodiment can be further used for testing the transmission quality of the audio and video streams of different versions of the application program, and product quality detection is conveniently and efficiently carried out.

Referring to fig. 2, in a further embodiment, the evaluation interface is implemented to execute the following business process, which includes the following steps:

Step S2100, obtaining multiple pieces of sampling data respectively representing different transmission qualities of the audio and video stream, and respectively calculating index data corresponding to the same quality index under each transmission quality according to each piece of sampling data:

taking an example of a live webcast application scenario, audio and video streams are pushed to different online users, whereby there are multiple data communication links for transmitting the audio and video streams. For reasons of user terminal equipment, application version, network transmission conditions, etc., different data communication links will show different transmission quality for the transmission of the same audio and video stream.

As described above, in this application, the online user accesses through an application program running in the terminal device thereof, in order to obtain the transmission quality performance data of the audio and video stream transmitted to the terminal device, a corresponding embedded point code may be preset in the application program, and in a listening state when the embedded point code is invoked, and when the user triggers an event for listening to the embedded point code or triggers according to a timing rule, for example, the audio and video stream is received, the embedded point code may collect data corresponding to the transmission quality as sampling data, and report the sampling data to a server corresponding to this application. The sampled data may be persisted in a background server for invocation.

The sampling data, including but not limited to video delay, video frame rate, video code rate, video fluency, audio and video synchronization difference, packet loss rate, etc. of the audio and video stream can be flexibly determined by those skilled in the art. A plurality of such sample data can be collected as a whole sample data at each moment in time for reporting, and each specific sample data essentially corresponds to a quantization dimension of transmission quality performance data, and can be used as evaluation dimension information required for quality evaluation in the present application.

As described above, the manner of acquiring such sampling data from the terminal device after the embedded point code is operated is flexible, and can be flexibly implemented by a person skilled in the art, for example, the video frame rate and the video smoothness can be determined by analyzing between two adjacent frames of images of the screen recorded video of the audio/video stream by calling the image analysis interface by the embedded point code. Similarly, other sampling data can flexibly realize the data acquisition mode according to the data characteristics.

In order to realize the orderly organization of the sampled data at the background server, a classifying dimension can be further arranged for the sampled data, wherein the classifying dimension is used for realizing the differentiation of different sampled data sources, such as, but not limited to, a version dimension and a terminal equipment dimension, which are respectively used for representing specific unique application program versions and terminal equipment, and the implementation can be flexibly organized by a person skilled in the art.

The transmission quality of an audio-video stream can be examined from several aspects, each of which can be provided with a corresponding quality indicator, each quality indicator being computationally quantized according to one or more of said quantization dimensions, which can be determined by a person skilled in the art according to the definition of the quality indicator. For this purpose, a corresponding algorithm may be set for each quality index in advance, and then, for each transmission quality unit, a plurality of pre-collected sampling data are called according to the algorithm to perform calculation of the relevant quality index, so as to determine corresponding index data under the same quality index for each transmission quality.

It can be understood that the quality index may be single or multiple, and the corresponding index data can be obtained by respectively performing corresponding calculation on the multiple quality indexes.

Step S2200, applying a target distribution function preset for quality indexes, calculating corresponding density distribution data for index data of each quality index, and obtaining each group of statistical characteristic values corresponding to each density distribution data:

in the application, a target distribution function is fitted in advance for each quality index, and is used for counting the index data to calculate density distribution data of the corresponding quality index, and the density distribution data can be correspondingly converted into a density distribution map so as to facilitate visual investigation. The statistical analysis methods adopted by the target distribution functions corresponding to different quality indexes can be different, and the density distribution data is obtained by respectively examining the distribution characteristics of the index data, and the examined distribution includes but is not limited to: uniform distribution, exponential distribution, beta distribution, T distribution, logistic distribution, normal distribution, gamma distribution, chi-square distribution, F distribution, binomial distribution, etc. The corresponding target distribution function for which the distribution is applicable for a particular quality indicator may be determined in advance by one skilled in the art or, as disclosed in the subsequent embodiments of the present application, may be fitted in an automated manner. It will be appreciated that in general, the target distribution function to which a quality indicator is applied is the best performing among a plurality of possible distribution functions.

The target distribution function can know the meaning of the target distribution function to the quality index according to the mathematical meaning of the target distribution function and can be realized according to the algorithm corresponding to the statistics principle of the distribution under investigation, so that when the density distribution data is counted by applying the corresponding target distribution function to one quality index, the index data is taken as input, and the corresponding index data of the quality index generated according to each sampling data is counted in a segmented mode according to the default counting step length, so that the density distribution data corresponding to the quality index can be obtained.

For each target distribution function, after the density distribution data is counted for one quality index, a corresponding set of statistical features are generated, and the statistical features are statistically considered features including, but not limited to, expectation, variance, skewness, kurtosis, median, and the like. By examining these statistical features, the distribution of the density distribution data can be further examined. The principle and application of these statistical features are understood by those skilled in the art and will not be repeated. Accordingly, a person skilled in the art can flexibly determine the relevant investigation characteristics required by a set of statistical characteristics according to needs, so that a corresponding set of statistical characteristic values can be obtained for each piece of density distribution data.

Step S2300, a preset quality evaluation algorithm is applied, and relative scoring information related to all quality indexes among all transmission qualities is calculated by adopting all groups of statistical characteristic values corresponding to the quality indexes:

the quality evaluation algorithm is used for calculating the relative information among the transmission qualities according to the statistical characteristic values of the quality indexes. The quality evaluation algorithm may be designed by those skilled in the art using statistical principles, adapting to the relevant statistical features, or may be automatically generated as disclosed in the subsequent embodiments of the present application.

For example, for the evaluation of a single quality index or multiple quality indexes, the evaluation may be examined according to the above-mentioned statistical characteristic values corresponding to the quality indexes, especially the expected statistical characteristic values, variance, skewness, kurtosis and the like. The statistical feature values can be converted into corresponding scoring information through a preset normalization formula, when quality indexes corresponding to a plurality of transmission qualities are required to be compared in quality, the quantitative scores of the quality indexes are calculated for the transmission qualities by improving the quality evaluation algorithm, and then the quantitative scores among the transmission qualities are compared to finally obtain corresponding normalized relative scores. During actual output, each transmission quality, each quality index, each quantization score, the relative score and the like can be packaged into relative score information, so that a management user can grasp comprehensive statistical information conveniently.

It can be understood that, up to this embodiment, the present application is directed to different transmission quality that audio and video streams are being pushed to different users, sample data corresponding to each transmission quality is calculated for each quality index by using sample data collected by different transmission quality, so as to obtain index data corresponding to each quality index, accordingly, density distribution data corresponding to index data of each quality index is obtained first by a preset target distribution function instead of a respective statistical method, then statistical feature values represented by density distribution data of each quality index are utilized, a preset quality evaluation algorithm is applied to comprehensively evaluate each transmission quality, finally, relative scoring information under different transmission quality is obtained, it is visible, the present application realizes standardization of transmission quality evaluation for audio and video stream sample data, can adapt to each quality index, and use a target distribution function and a quality evaluation algorithm preset for each quality index to normalize and examine corresponding statistical features, thereby, normalized relative scoring information can be obtained, quality indexes under different transmission quality levels can be kept high consistently, and better than conventional stability, good stability and reliability are provided for a mass-sensing and quality evaluation method under a good-quality line, and a full-scale of product is developed.

When the method is applied to online service of audio and video, aggregation analysis is conveniently carried out on the data nodes, the user transmission quality grading information can be displayed in a data form, so that a service side can observe the overall quality generated by online service from two angles of dosage and quality, and the distribution situation corresponding to different quality indexes, thereby effectively helping a management layer to quickly analyze strategies for making decisions, carrying out real-time pulse corresponding products and services, helping operators to dynamically control the overall process of projects, and improving the quality of the products.

Referring to fig. 3, in an extended embodiment, before obtaining multiple pieces of sampled data respectively representing different transmission qualities of an audio/video stream, step S2100 includes the following pre-steps:

step S1100, acquiring a sample data set corresponding to a quality index for evaluating the transmission quality of an audio/video stream, and calculating index data of each set of pre-acquired sample data in the sample data set:

as described above, the sample data corresponding to the streaming quality of the audio and video acquired from the terminal device is stored in the background server in a persistent manner, and thus, the sample data can be acquired therefrom for use as a sample data set in the present embodiment.

The sample data set, in this embodiment, refers to the final sample data set obtained after data cleaning, where this sample data set generally corresponds to a specific classification dimension and includes data of a specific quantization dimension, so as to be used for calculating index data of a quality index.

In this regard, in the manner disclosed in the exemplary embodiment of the present application, a preset calculation formula corresponding to each quality index is applied, and the specific sampling data of the quantization dimension corresponding to each quality index is used to calculate the index data corresponding to each quality index.

Step 1200, performing kernel density estimation on the index data with a preset step length to obtain corresponding density distribution data:

for the core density estimation, a statistical step length required for segmenting the index data may be preset, for example, when the number of sampled data generated by the index data reaches more than 1000, the preset step length may be set to 30, so that the core density estimation may be performed on the index data corresponding to each quality index.

The result of the nuclear density estimation is density distribution data corresponding to a quality index, and the density distribution data can be mapped into a density distribution map correspondingly, so that an intuitive analysis result is obtained. In this regard, those skilled in the art can know that it is not repeated.

Step 1300, adopting a plurality of preset distribution functions, respectively performing data fitting on the index data with the preset step length, and selecting a target distribution function with the highest fitting degree for the corresponding quality index:

in order to determine a target distribution function suitable for the quality index to which the density distribution data belongs from the density distribution data, a plurality of optional known distribution functions may be preset. Referring to the description of the target distribution function in the exemplary embodiment of the present application, it may be understood that in this embodiment, a corresponding distribution function may be pre-configured according to each distribution to be inspected, and a plurality of distribution functions corresponding to the plurality of inspected distributions may be configured as a plurality of preset distribution functions in this embodiment, where each distribution function performs data fitting on index data applied by a quality index with the same preset step size when estimating the kernel density, to obtain corresponding density distribution data, and similarly may be mapped and converted into a density distribution map. By superposing the density distribution diagram obtained by nuclear density estimation and the density distribution diagram obtained by nuclear density estimation in the same coordinate, whether the distribution function used by nuclear density estimation is matched with the result obtained by nuclear density estimation can be intuitively analyzed, and therefore, theoretically, the distribution function corresponding to the condition that the difference between the two density distribution diagrams is minimum should be determined as the target distribution function of the corresponding quality index.

It should be appreciated that for each quality indicator, the target distribution function thereof needs to be determined independently, and the target distribution functions used by different quality indicators may be different or the same, depending on the data fitting result.

At the program processing level, the data fitting result may be determined in the following manner, so as to select an optimal distribution function for each quality index as a target distribution function, including the following manners:

in one of the ways, typically given the type of distribution, the dominant observed characteristics of a distribution can be reflected by statistical characteristics, where expectations, variances, skewness and kurtosis are important. If the fitted distribution function and the above statistical characteristics of the sample are substantially identical, then this distribution function may be considered to be highly approximate, and thus may be identified as the target distribution function.

In a second mode, the clutch path between the fitted distribution function and the kernel density estimation (Gaussian kernel density function) is calculatedThe degree is used for selecting a target distribution function, and the clutch degree calculation formula is as follows:where k is the density value of the kernel density estimate, d is the distribution function calculated density value, and i is the abscissa axis coordinate represented in the density profile for calculation. The overall clutch value between the fitted distribution function and the actual distribution can be calculated through the formula, the fitting degree is inversely proportional to the value, the smaller the value is, namely the lower the clutch degree is, the higher the fitting degree is, and the distribution function with the highest fitting degree is determined to be the target distribution function.

The statistical features have respective meanings in the quality index, for example:

step S1400, constructing a corresponding quality evaluation algorithm to calculate a relative score associated with the corresponding quality index between the transmission qualities by using the statistical feature values of the density distribution data of the different quality indexes calculated by the objective distribution function:

to facilitate quality assessment, quality assessment algorithms required for various application requirements can be constructed by those skilled in the art based on statistical principles. The implementation of the quality evaluation algorithm is very flexible, and different quality evaluation algorithms can be constructed for different data investigation purposes. The basis for constructing the quality evaluation algorithm is mainly the statistical characteristics, including expectation, variance, skewness, kurtosis, median and the like, and can be flexibly selected by a person skilled in the art according to the statistical principle to realize the quality evaluation algorithm.

The comparison between the individual quality indexes under different transmission quality can be realized by a person skilled in the art by adopting various statistical principles, the comparison process is constructed as the quality evaluation algorithm, the comparison mode is realized according to the known statistical knowledge, for example, the comparison is performed according to the median value, the comparison is performed by using the confidence interval, the comparison is performed by using the probability density, and the like, and the comparison can be flexibly realized as required.

For the case that a plurality of quality index aggregation statistics are required to be combined for comparison, the comparison results between the individual quality indexes can be aggregated for comparison, and the adopted method is that the respective quality indexes are weighted and summed after the comparison scores are calculated by applying respective quality evaluation algorithms. Of course, those skilled in the art may implement a quality evaluation algorithm that better conforms to a priori knowledge and actual measurement to achieve a comparison between transmission quality based on multiple quality indicators.

The quality evaluation algorithm is used for comparing the transmission quality with the same quality index, so that corresponding relative scores can be obtained, and the relative scores can be used for evaluating the quality of different transmission qualities, so that after the quality evaluation algorithm is constructed, the comparison of different transmission qualities of audio and video streams can be realized.

In this embodiment, the objective distribution function and the quality evaluation algorithm corresponding to the quality index are modeled individually by using the prepared sample data set, so that the subsequent quality evaluation of the sampled data of the audio and video stream can be realized in a standardized manner, the automation and the intellectualization of the whole evaluation system are realized, the standard deviation is avoided, and the method is beneficial to wide application in a large platform.

Referring to fig. 4, in a deepened embodiment, the step S1100 of obtaining a sample data set corresponding to a quality index for evaluating transmission quality of an audio/video stream, and calculating index data of each set of pre-collected sample data in the sample data set includes the following steps:

step S1110, acquiring a calculation formula and evaluation dimension information preset for a quality index of an audio/video stream, where the evaluation dimension information includes a classification dimension and a quantization dimension of the quality index:

the calculation formula for calculating the index data of the quality index can be customized in advance by a person skilled in the art, and the acquisition can be directly invoked when needed. In addition, specific sampling data required for calculating index data of various quality indexes can be standardized in advance, so that corresponding evaluation dimension information is standardized. The evaluation dimension information includes a categorization dimension and a quantization dimension of the quality index.

The classifying dimension is used for dividing granularity of the quality index, for example, the adopted sampling data can be determined to be a specific application program version through the version classifying dimension, and for example, the adopted sampling data can be determined to be provided for specific terminal equipment through the equipment classifying dimension, so that the data sources and the production objects can be conveniently determined during testing.

The quantization dimensions are used to provide specific sample data required by the calculation formula of the quality index, and are generally descriptive information of transmission quality, such as parameters for describing video delay, video frame rate, video code rate, and the like.

It will thus be appreciated that each sample data set in the sample data set typically contains specific sample data corresponding to the classification dimension and quantization dimension, as provided by the application acquisition of the terminal device.

Step S1120, extracting a plurality of groups of sampling data with the classifying dimension from the sample database to form a sample data set:

as described above, the sample data corresponding to the transmission quality of the audio/video stream provided by the terminal device is stored in the database in advance and is regarded as a sample database in this embodiment, so that, as required by the application, multiple groups of sample data with specified classification dimensions can be extracted from the sample database, and the sample data are regarded as the sample data set.

Step S1130, performing data cleaning on the sample data set according to a preset rule, and removing the abnormal sample to obtain a final sample data set:

the person skilled in the art can combine the conventional data cleaning means to perform data cleaning on the sample data set, so as to remove abnormal samples therein, so as to improve the scientificity of the statistical result, for example, remove the sampled data containing negative abnormal values, remove the sampled data containing extreme values, and the like, so as to obtain the final sample data set after data cleaning.

Step S1140, applying the calculation formula, and calculating corresponding index data for each sample data corresponding to the quantization dimension in each group of sample data in the final sample data set:

after the final sample data set is obtained, for each set of sample data, calculating index data by applying a calculation formula corresponding to a corresponding quality index to each set of sample data corresponding to the quantization dimension, and finally obtaining the index data corresponding to the quality index for subsequent kernel density estimation and distribution function selection.

According to the embodiment, the sample data set is optimized, so that the data according to which the distribution function data fitting is performed later is more representative, the data fitting effect can be improved, and the target distribution function can be determined accurately.

Referring to fig. 5, in a deepened embodiment, in step S1300, a plurality of preset distribution functions are adopted, the index data are respectively subjected to data fitting with the preset step length, and a target distribution function with the highest fitting degree is selected for the corresponding quality index, including the following steps:

step 1310, performing data fitting on all index data of the quality index by using a plurality of preset distribution functions respectively with the preset step length to obtain density distribution data corresponding to each distribution function:

When a distribution function of one quality index is selected, a plurality of distribution functions are adopted to perform data fitting on index data corresponding to the same quality index, so as to obtain density distribution data corresponding to each distribution function.

Step S1320, calculating a corresponding first group of statistical characteristic values according to the density distribution data obtained by the nuclear density estimation:

since the density distribution data corresponding to each quality index is obtained by using the kernel density estimation, the first set of statistical feature values corresponding to each quality index can be calculated according to the density distribution data, including but not limited to the expected, variance, skewness, kurtosis, median and the like, which can be flexibly selected by those skilled in the art according to practical situations.

Step S1330, calculating a second set of statistical feature values corresponding to each distribution function according to the density distribution data corresponding to each distribution function:

similarly, the density distribution data generated by each distribution function for the index data of the same quality index can also be used to calculate a second set of statistical feature values corresponding to the distribution function, where the second set of statistical feature values corresponds to the first set of statistical feature values, so as to perform comparison calculation subsequently.

Step S1340, comparing the second set of statistical characteristic values of each distribution function with the first set of statistical characteristic values, respectively, to obtain a distribution function with the optimal comparison result as a target distribution function with the highest fitting degree:

in this embodiment, the second statistical characteristic value of each distribution function may be compared with the first set of statistical characteristic values one by one, so as to ensure whether the two values are close to each other, and the distribution function with the closest value is determined as the target distribution function with the highest fitting degree. Alternative comparison means please refer to the description of the present application in the previous step S1300, referring to the description, in a preferred way, the present step can be decomposed into the following steps:

step S1341, comparing and calculating the density value in the second set of statistical feature values and the density value in the first set of statistical feature values corresponding to each distribution function to obtain amplitude data representing the clutch degree of the density distribution data of the second set of statistical feature values and the first set of statistical feature values;

step S1342, comparing the amplitude data corresponding to each distribution function, and determining the distribution function with the smallest amplitude data as the optimal distribution function, which is the target distribution function with the highest fitting degree.

The embodiment gives a specific process of determining the target distribution function of the quality index through data fitting, and can be seen that the implementation process is simple and easy to implement, and the corresponding target distribution function is convenient and rapid to determine.

In a deepened embodiment, the step S2300 of applying a preset quality evaluation algorithm and calculating relative scoring information associated with all quality indexes between each transmission quality by using each group of statistical feature values corresponding to the quality indexes includes the following steps:

step S2310, calculating relative scoring information corresponding to each quality index according to each group of statistical feature values corresponding to each quality index, wherein the relative scoring information represents relative scoring between transmission quality and associated with the quality index:

as described above, when the quality evaluation algorithm is applied to determine the relative score information between the transmission qualities, according to the quality evaluation algorithm implemented in an embodiment of the present application, the relative score information corresponding to each quality index may be calculated first, and the calculation of the relative score information of each quality index, which may be described in the related embodiments above, may refer to the calculation of the corresponding relative scores of the sampled data of different transmission qualities based on the same quality index, and finally determine the relative score information corresponding to the same quality index for different transmission qualities, and when the relative score information between different transmission qualities needs to be obtained for a plurality of quality indexes, determine the relative score information corresponding to each quality index one by one.

Step S2320, performing weighted summation on the relative score information corresponding to each quality index, to obtain relative score information associated with all quality indexes between each transmission quality:

when the relative score information is calculated for each quality index between different transmission qualities, the relative score information can be weighted and summed, the corresponding weight can be determined by a person skilled in the art according to priori knowledge or measured data, and the comprehensive result of the relative score information of a plurality of quality indexes is obtained through weighted and summed, and is also expressed as one relative score information, but the relative score information is calculated and obtained by correlating all quality indexes and is used for representing the relative quality among a plurality of transmission qualities. In particular, when the present application is processed for two transmission quality applications, the obtained relative scoring information is the relative scoring information of the audio/video stream quality between the two data communication links.

As described in the foregoing related embodiments, the relative evaluation information may be further packaged with other statistical feature values, and output to a database or a terminal device of the management user, and finally may be visually reproduced when the management user calls.

Referring to fig. 6, an audio/video quality visualization device provided for adapting to one of the purposes of the present application is a functional embodiment of an audio/video quality visualization method of the present application, and the device includes: the system comprises a media pushing module 1100, a data acquisition module 1200, a quality evaluation module 1300 and an output display module 1400, wherein the media pushing module 1100 is used for pushing audio and video streams to different terminal devices running the same application program, and different network simulation configuration information is applied to the different terminal devices and used for dynamically controlling the transmission quality of the audio and video streams received by the terminal devices; the data acquisition module 1200 is configured to acquire sampling data uploaded by the application program at a corresponding terminal device, where the sampling data is used to describe transmission quality when the corresponding terminal device acquires the audio/video stream; the quality evaluation module 1300 is configured to invoke a preset evaluation interface to perform quantitative analysis on audio and video quality on the sampled data collected by the network simulation configuration information, so as to obtain respective corresponding quality evaluation data; the output display module 1400 is configured to generate a visual chart page output display according to the quality evaluation data.

In a further embodiment, the media push module 1100 includes: the pushing sub-module is used for starting to push audio and video streams to different terminal devices running different versions of application programs; and the simulation weakening sub-module is used for adapting to each terminal device, and in the pushing process of the audio and video stream, the preset network simulation configuration information is called to dynamically change the transmission quality of the audio and video stream in different time periods, wherein the network simulation configuration information comprises network transmission quality configuration parameters which change along a time axis.

In a further embodiment, the quality evaluation module 1300 includes: the score calculating sub-module is used for calculating relative score information corresponding to each quality index according to each group of statistical characteristic values corresponding to each quality index, and the relative score information represents the relative score associated with the quality index between each transmission quality; and the scoring fusion sub-module is used for carrying out weighted summation on the relative scoring information corresponding to each quality index to obtain the relative scoring information associated with all the quality indexes among the transmission quality.

In order to solve the technical problems, the embodiment of the application also provides computer equipment. As shown in fig. 7, the internal structure of the computer device is schematically shown. The computer device includes a processor, a computer readable storage medium, a memory, and a network interface connected by a system bus. The computer readable storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store a control information sequence, and when the computer readable instructions are executed by a processor, the processor can realize an audio and video quality visualization method. The processor of the computer device is used to provide computing and control capabilities, supporting the operation of the entire computer device. The memory of the computer device may store computer readable instructions that, when executed by the processor, cause the processor to perform the audio-video quality visualization method of the present application. The network interface of the computer device is for communicating with a terminal connection. It will be appreciated by those skilled in the art that the structure shown in fig. 7 is merely a block diagram of some of the structures associated with the present application and is not limiting of the computer device to which the present application may be applied, and that a particular computer device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

The processor in this embodiment is configured to execute specific functions of each module and its sub-module in fig. 6, and the memory stores program codes and various data required for executing the above modules or sub-modules. The network interface is used for data transmission between the user terminal or the server. The memory in this embodiment stores program codes and data required for executing all modules/sub-modules in the audio/video quality visualization apparatus of the present application, and the server can call the program codes and data of the server to execute the functions of all sub-modules.

The present application also provides a storage medium storing computer readable instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of the audio-video quality visualization method of any of the embodiments of the present application.

The present application also provides a computer program product comprising computer programs/instructions which when executed by one or more processors implement the steps of the method described in any of the embodiments of the present application.

Those skilled in the art will appreciate that implementing all or part of the above-described methods of embodiments of the present application may be accomplished by way of a computer program stored on a computer readable storage medium, which when executed, may comprise the steps of embodiments of the methods described above. The storage medium may be a computer readable storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a random access Memory (Random Access Memory, RAM).

In summary, the present application implements an integrated solution for quality evaluation of online transmission quality of an audio/video stream, and can provide transmission quality evaluation data in a standardized manner.

Those of skill in the art will appreciate that the various operations, methods, steps in the flow, actions, schemes, and alternatives discussed in the present application may be alternated, altered, combined, or eliminated. Further, other steps, means, or steps in a process having various operations, methods, or procedures discussed in this application may be alternated, altered, rearranged, split, combined, or eliminated. Further, steps, measures, schemes in the prior art with various operations, methods, flows disclosed in the present application may also be alternated, altered, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for a person skilled in the art, several improvements and modifications can be made without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims

1. The audio and video quality visualization method is characterized by comprising the following steps of:

Pushing audio and video streams to different terminal devices running the same application program, wherein different network simulation configuration information is applied to the different terminal devices, the network simulation configuration information is used for dynamically controlling the transmission quality of the audio and video streams received by the terminal devices, and the application programs running by the different terminal devices contain different versions;

invoking a preset evaluation interface to quantitatively analyze the audio and video quality based on the space dimension and/or the time dimension of the sampling data acquired by the network simulation configuration information, and obtaining corresponding quality evaluation data; the method comprises the following steps: acquiring a plurality of pieces of sampling data respectively representing different transmission quality of the audio and video stream, and respectively calculating index data corresponding to the same quality index under each transmission quality according to each piece of sampling data; calculating corresponding density distribution data of index data of each quality index by applying a preset target distribution function to obtain each group of statistical characteristic values corresponding to each density distribution data; applying a preset quality evaluation algorithm, and calculating relative scoring information associated with all quality indexes among all transmission qualities by adopting all groups of statistical characteristic values corresponding to the quality indexes;

2. The audio and video quality visualization method according to claim 1, wherein the audio and video streams are pushed to different terminal devices running the same application, the different terminal devices being applied with different network emulation configuration information, comprising the steps of:

3. The audio-video quality visualization method according to claim 1, characterized by comprising the following pre-steps before acquiring a plurality of pieces of sample data respectively representing different transmission qualities of an audio-video stream:

4. An audio-visual quality visualization method according to claim 3, wherein acquiring a sample data set corresponding to a quality index for evaluating transmission quality of an audio-visual stream, calculating index data of each set of sample data pre-collected in the sample data set, comprises the steps of:

5. An audio and video quality visualization method according to claim 3, wherein a plurality of preset distribution functions are adopted, the index data are respectively subjected to data fitting with the preset step length, and a target distribution function with the highest fitting degree is selected for the corresponding quality index, and the method comprises the following steps:

6. The audio-video quality visualization method according to claim 1, wherein the step of calculating relative scoring information associated with all quality indicators between each transmission quality by applying a preset quality evaluation algorithm and using each set of statistical feature values corresponding to the quality indicators, comprises the steps of:

7. A computer device comprising a central processor and a memory, characterized in that the central processor is arranged to invoke a computer program stored in the memory for performing the steps of the method according to any of claims 1 to 6.

8. A computer-readable storage medium, characterized in that it stores in the form of computer-readable instructions a computer program implemented according to the method of any one of claims 1 to 6, which, when invoked by a computer, performs the steps comprised by the corresponding method.