CN108810522B - Method and device for evaluating streaming media data - Google Patents
Method and device for evaluating streaming media data Download PDFInfo
- Publication number
- CN108810522B CN108810522B CN201710281530.1A CN201710281530A CN108810522B CN 108810522 B CN108810522 B CN 108810522B CN 201710281530 A CN201710281530 A CN 201710281530A CN 108810522 B CN108810522 B CN 108810522B
- Authority
- CN
- China
- Prior art keywords
- time
- streaming media
- media data
- target interval
- data frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
Abstract
The invention provides a method and a device for evaluating streaming media data, wherein the method comprises the following steps: calculating target interval time of received/sent streaming media data in a period time, wherein the target interval time is the continuous playing time of the same type of data frames; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time. In the smooth state, the continuous playing time of the data frame of the streaming media data received/sent within the cycle time is basically consistent with the cycle time, so that the fluency of the streaming media data can be evaluated according to the relation between the target interval time of the streaming media data received/sent within the cycle time and the cycle time, and the fluency evaluation accuracy of the streaming media data is improved.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method and an apparatus for evaluating streaming media data.
Background
As is well known, fluency is an important index affecting user experience, and how to evaluate fluency of streaming media also becomes a difficult problem. The existing method for evaluating fluency in the industry mainly adopts an objective quality evaluation system to carry out objective evaluation, and the integral original video frame is generally required to be compared with the video frame of a playing end in the objective quality evaluation system, so as to obtain the fluency of video playing; in the field of live video, original video frames cannot be obtained, so that an objective quality evaluation system cannot be applied to the field of live video. In the existing video live broadcast field, the video is generally subjectively evaluated through human eye observation, and the method has strong subjectivity and low accuracy.
Disclosure of Invention
The embodiment of the invention provides a method and a device for evaluating streaming media data, which aim to solve the problem of low accuracy of evaluating the streaming media data.
In a first aspect, an embodiment of the present invention provides a method for evaluating streaming media data, including:
calculating target interval time of received or sent streaming media data in a period time, wherein the target interval time is the continuous playing time of the same type of data frames;
and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time.
In a second aspect, an embodiment of the present invention further provides an apparatus for evaluating streaming media data, where the apparatus includes:
the device comprises a calculation module, a display module and a display module, wherein the calculation module is used for calculating target interval time of streaming media data received or sent in a cycle time, and the target interval time is the continuous playing time of data frames of the same type;
and the processing module is used for evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time.
In this way, in the embodiment of the present invention, by calculating the target interval time of the streaming media data received or sent within the cycle time, the target interval time is the continuous playing time of the same type of data frame; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time. In the smooth state, the continuous playing time of the data frame of the streaming media data received or sent within the period time is basically consistent with the period time, so that the fluency of the streaming media data can be evaluated according to the relation between the target interval time of the streaming media data received or sent within the period time and the period time, and the fluency evaluation accuracy of the streaming media data is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a flowchart of an evaluation method of streaming media data according to an embodiment of the present invention;
fig. 2 is a structural diagram of a streaming media data transmission system to which an embodiment of the present invention is applied;
fig. 3 is a flowchart of an evaluation method of streaming media data according to another embodiment of the present invention;
FIG. 4 is a timing diagram of a period time and a data frame in the method for evaluating streaming media data according to another embodiment of the present invention;
fig. 5 is a flowchart of an evaluation method of streaming media data according to another embodiment of the present invention;
fig. 6 is a schematic diagram of a first waveform reflecting a change in a period time in a method for evaluating streaming media data according to another embodiment of the present invention;
fig. 7 is a schematic diagram of a second waveform reflecting a change in a target interval time in a method for evaluating streaming media data according to another embodiment of the present invention;
fig. 8 is a block diagram of an apparatus for evaluating streaming media data according to an embodiment of the present invention;
fig. 9 is a block diagram of an apparatus for evaluating streaming media data according to another embodiment of the present invention;
fig. 10 is a block diagram of an apparatus for evaluating streaming media data according to another embodiment of the present invention;
fig. 11 is a block diagram of an apparatus for evaluating streaming media data according to another embodiment of the present invention;
fig. 12 is a block diagram of an apparatus for evaluating streaming media data according to another embodiment of the present invention;
fig. 13 is a block diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides an evaluation method of streaming media data, which can be applied to network side equipment and also can be applied to a user terminal. As shown in fig. 1, the method for evaluating streaming media data includes:
The method for evaluating streaming media data provided by the embodiment of the invention is mainly applied to monitoring and evaluating the transmission of streaming media data, for example, the method can be used for monitoring and evaluating the streaming media data of audio and video live broadcast and also can be used for monitoring and evaluating the streaming media data of non-live broadcast on-line audio and video broadcast. In the following embodiments, streaming media data of audio and video live broadcast is taken as an example for detailed description.
Specifically, referring to fig. 2, in a process of transmitting streaming media data of audio/video live broadcast, first, a first terminal 01 (i.e., a stream pushing end of the streaming media data) records audio/video in real time to generate streaming media data; then, the generated streaming media data is uploaded to the server 02, and the server 02 performs playing of the streaming media data through a CDN (Content Delivery Network) or directly pushing the streaming media data to the second terminal 03 (i.e., a playing end of the streaming media data).
In the process of transmitting streaming media data of audio and video live broadcast, the target interval time of the streaming media data received or sent within the calculation cycle time may include any one of the following situations:
in the first case, the target interval time of the streaming media data sent in the periodic time in the process of sending the streaming media data to the server 02 by the first terminal 01 is calculated;
in the second case, the target interval time of the received streaming media data within the cycle time is calculated in the process that the server 02 receives the streaming media data sent by the first terminal 01;
in the third situation, the target interval time of the streaming media data sent within the cycle time in the process that the server 02 sends the streaming media data to the second terminal 03 is calculated;
in the fourth case, the target cycle time of the streaming media data received within the cycle time in the process of receiving the streaming media data sent by the server 02 by the second terminal 03 is calculated.
The interval time of the cycle time may be set according to actual needs, and is not further limited herein, and may be, for example, 5 seconds.
Alternatively, for different target interval times, the calculation may be performed on the corresponding terminal or server 02, for example, for the first case, the first terminal 01 may record the transmission condition of the data frame in each period time, and perform the calculation on the first terminal 01, for the second case and the third case, the server 02 may record the reception or transmission condition of the data frame in each period time, and perform the calculation on the server 02, for the fourth case, the second terminal 03 may record the reception condition of the data frame in each period time, and perform the calculation on the second terminal 03. In addition, the server 02 may perform a unified calculation to reduce the load of the terminals, for example, for the first case and the fourth case, the first terminal 01 and the second terminal 03 may report the recorded corresponding data to the server 02, and then the server 02 performs the calculation.
It should be understood that each data frame has a corresponding playing time, and the target interval time is a continuous playing time of the same type of data frame, which refers to an interval time between a playing time of a first frame data frame and a playing time of a last frame data frame in the period time. The playing time refers to a time value relative to an initial playing time. The data frames comprise audio frames and/or video frames, and when the audio frames and the video frames exist in the same period time, the audio frames and the video frames have corresponding target interval time.
And 102, evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time.
In this step, according to the cycle time and the corresponding target interval time, the manner of evaluating the fluency of the streaming media data may be set according to actual needs. For example, in this embodiment, the fluency may be evaluated according to the magnitude of the absolute value of the difference between the cycle time and the corresponding target interval time; and the fluency can be evaluated according to the ratio of the cycle time to the corresponding target interval time. It should be understood that the evaluation result obtained by evaluating the fluency of the streaming media data may be graded by adopting a preset grading, a specific evaluation value may be calculated by adopting a percentage, and a curve of the evaluation may be displayed in a form of a drawing.
The manner in which the fluency assessment is performed in terms of the magnitude of the absolute value of the difference between the cycle time and the corresponding target cycle interval time will be described in detail below.
For example, in this embodiment, the magnitude of the absolute value of the difference between each period time and the corresponding target period interval time may be calculated, and then the fluency of the current period time may be determined according to the absolute value calculated by the current period time (to implement real-time fluency calculation), or the overall fluency of the streaming media data in multiple period times may be determined according to the absolute values calculated by multiple period times. Other calculation methods may be used, and are not listed here.
In this way, in the embodiment of the present invention, by calculating the target interval time of the streaming media data received or sent within the cycle time, the target interval time is the continuous playing time of the same type of data frame; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time. In the smooth state, the continuous playing time of the data frame of the streaming media data received or sent within the period time is basically consistent with the period time, so that the fluency of the streaming media data can be evaluated according to the relation between the target interval time of the streaming media data received or sent within the period time and the period time, and the fluency evaluation accuracy of the streaming media data is improved.
It should be noted that the method for evaluating streaming media data is mainly applied to the field of audio and video live broadcast, and for the field of non-live broadcast, the method is mainly used for monitoring the fluency of the sent data frames.
Optionally, referring to fig. 3, a manner of calculating a target interval time of streaming media data received or sent within a cycle time may be set according to actual needs, and in this embodiment, the step 101 includes:
In this step, when generating each data frame of the streaming media data, the first terminal marks a timestamp on the data frame, so as to determine the playing time of each data frame when playing the streaming media data. In this embodiment, the corresponding timestamps of the first data frame and the last data frame in the cycle time in the streaming media data may be obtained. Specifically, the timestamps corresponding to the first video frame and the last video frame in the period time and the timestamps corresponding to the first audio frame and the last audio frame may be obtained. And then obtaining the target interval time corresponding to the cycle time according to the difference value of the time stamp of the last data frame and the time stamp of the first data frame.
It should be understood that, in this embodiment, if a data frame is not received within one cycle time, the target interval time is defaulted to 0, if only one data frame is received within one cycle time, the target interval time may be half of the cycle time, or the target interval time may be determined according to a boundary value between the received or transmitted time and the cycle time, for example, if the received or transmitted data frame time is 1.5 seconds of the cycle time, the target interval time may be determined to be 1.5 seconds or 3.5 seconds.
Taking the server receiving video frames as an example, it is assumed that the number of video frames normally received in one cycle time lts is 5 frames, where the timestamp of the first video frame is vt1, the timestamp of the second video frame is vt2, the timestamp of the third video frame is vt3, the timestamp of the fourth video frame is vt4, and the timestamp of the fifth video frame is vt 5. The target interval vts of video frames within a period time is normally vt5-vt1, when the size of vts is substantially the same as the size of lts. As shown in fig. 4, if there is one less frame in the middle due to network fluctuation, the server receives one less video frame. This is the target interval time for video frames in the calculation cycle time lts, which is vts ═ vt4-vt 1; generally, in the next period, if the network is normal, 6 video frames vt5-vt 10 are received, and at this time, the target interval time of the video frames in the next period lts is vts ═ vt 10-vt 5. Therefore, the fluency of the video frame can be reflected by the target interval time.
It can be understood that, since the data frames transmitted by the network fluctuation in the previous period are reduced, in order to achieve smooth playing, the data frames reduced in the previous period need to be supplemented in the next period as much as possible, so that the data frames transmitted in the next period are relatively increased, and the absolute values of the difference values between the target interval time and the period time in the previous and next period periods are relatively large. It should be noted that, if the target interval time in the cycle time is smaller than the cycle time, it indicates that the fluency in the cycle time is poor, and if the target interval time in the cycle time is greater than the cycle time, it indicates that the fluency in the previous cycle time is poor.
Optionally, because the streaming media data may be evaluated in different evaluation manners, and execution manners of corresponding evaluation operations are also different, specifically, this is described in detail in the following embodiments:
referring to fig. 5, in an evaluation mode, the step 102 includes:
In this embodiment, the time setting manner of the preset time period may be set according to actual needs, for example, the absolute value of the difference between the cycle time and the corresponding target interval time may be calculated within each cycle time from the start time of sending or receiving the streaming media data; or calculating the absolute value of the difference between each period time and the corresponding target interval time in the previous period of time by taking the current time point as a reference. The following description will take the example of calculating the absolute value of the difference between the period time and the corresponding target interval time in each period time from the start time of transmitting or receiving the streaming media data.
Specifically, all cycle times lts and corresponding target interval times vts may be subtracted and the absolute values taken and then added to obtain a sum, and the sum is divided by the sum of all cycle times lts to arrive at fluency. For example, the following formula can be used to calculate the video fluency a:
where i represents the ith cycle time and n represents a total of n cycle times.
It should be noted that, in other embodiments, the evaluation value of fluency may also be obtained by calculation in a manner of averaging, or increasing the calculation weight according to the time sequence.
With combined reference to fig. 6 and 7, in another evaluation mode, evaluation of fluency can also be realized in a graphical manner. Specifically, the step 102 includes:
drawing a first oscillogram reflecting the change of the period time according to each period time;
and drawing a second oscillogram reflecting the change of the target interval time according to the target interval time of each data frame of the same type.
In fig. 6 and 7, the abscissa represents the elapsed time of the machine, and the ordinate represents the interval time in milliseconds (ms). Referring to fig. 6 and 7, a one-cycle time variation waveform may be plotted and formed according to the time data of each cycle time, and a target interval time variation waveform may be plotted and formed according to the time data of the target interval time corresponding to each cycle time. As shown in fig. 6, since the terminal or the server generally has a slight fluctuation in the determination of the time when performing the operation, the truly statistical cycle time may have a slight fluctuation, but is substantially close to 5 seconds. According to the comparison between fig. 5 and fig. 6, the greater the coincidence of the two waveforms, the smoother the streaming media data is, and the smaller the coincidence of the two waveforms, the more the streaming media data is stuck.
Optionally, when the method for evaluating streaming media data is applied to a server, before step 101, the method further includes:
receiving the cycle time reported by a first terminal and data frame information sent in the cycle time, wherein the first terminal is a terminal for pushing the streaming media data to the server, and the data frame information is used for calculating the target interval time of the streaming media data sent by the first terminal in the cycle time;
or receiving the cycle time reported by a second terminal and data frame information sent within the cycle time, where the second terminal is a terminal that receives the streaming media data pushed by the server, and the data frame information is used to calculate a target interval time of the streaming media data received by the second terminal within the cycle time.
In this embodiment, the first terminal may record data frame information sent in each period of time, where the data frame information may include a timestamp of a first data frame and a timestamp of a last data frame, and may also include the number of data frames, and the like, and report the period of time and the data frame information to the server at regular intervals (for example, one period of time), and may also trigger the first terminal to report by a condition (for example, receiving a reporting instruction sent by the server or completing sending of streaming media data, and the like).
The second terminal may record data frame information received in each period of time, where the data frame information may include a timestamp of a first data frame and a timestamp of a last data frame, and may also include the number of data frames, and the like, and report the period of time and the data frame information to the server at regular intervals (for example, one period of time), and may also trigger the first terminal to report by a condition (for example, receiving a reporting instruction sent by the server or completing the sending of streaming media data, and the like).
Referring to fig. 8, the present invention further provides an apparatus for evaluating streaming media data, including:
a calculating module 801, configured to calculate a target interval time of streaming media data received or sent within a cycle time, where the target interval time is a continuous playing time of a data frame of the same type;
a processing module 802, configured to evaluate the fluency of the streaming media data according to the cycle time and the corresponding target interval time.
Optionally, referring to fig. 9, the calculation module 801 includes:
an obtaining sub-module 8011, configured to obtain, for each cycle time, timestamps corresponding to a first data frame and a last data frame received or sent in the cycle time; the first data frame and the last data frame are the same type of data frame;
the calculating sub-module 8012 is configured to calculate a difference between the timestamp of the last data frame and the timestamp of the first data frame, so as to obtain the target interval time.
Optionally, referring to fig. 10, the processing module 802 includes:
the counting submodule 8021 is configured to count a sum of absolute values of differences between all the cycle times and the corresponding target interval time within a preset time period to obtain a sum;
the determining sub-module 8022 is configured to determine the estimated value of the fluency of the streaming media data according to a ratio of the sum to the time length of the preset time period.
Optionally, referring to fig. 11, the processing module 802 includes:
a first drawing submodule 8023, configured to draw a first waveform diagram reflecting a change in cycle time according to each cycle time;
the second drawing submodule 8024 is configured to draw a second waveform diagram reflecting the target interval time variation according to the target interval time of each data frame of the same type.
Optionally, referring to fig. 12, when the method for evaluating streaming media data is applied to a server, the apparatus further includes:
a receiving module 803, configured to receive the cycle time reported by a first terminal and data frame information sent within the cycle time, where the first terminal is a terminal that pushes the streaming media data to the server, and the data frame information is used to calculate a target interval time of the streaming media data sent by the first terminal within the cycle time; or receiving the cycle time reported by a second terminal and data frame information sent within the cycle time, where the second terminal is a terminal that receives the streaming media data pushed by the server, and the data frame information is used to calculate a target interval time of the streaming media data received by the second terminal within the cycle time.
In the embodiment of the invention, the target interval time of the received or sent streaming media data in the cycle time is calculated, wherein the target interval time is the continuous playing time of the same type of data frames; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time. In the smooth state, the continuous playing time of the data frame of the streaming media data received or sent within the period time is basically consistent with the period time, so that the fluency of the streaming media data can be evaluated according to the relation between the target interval time of the streaming media data received or sent within the period time and the period time, and the fluency evaluation accuracy of the streaming media data is improved.
Referring to fig. 13, fig. 13 is a structural diagram of an electronic device according to an embodiment of the present invention, and the electronic device shown in fig. 13 includes: at least one processor 1301, memory 1302, at least one network interface 1304, and a user interface 1303. The various components in the electronic device are coupled together by a bus system 1305. It is understood that the bus system 1305 is used to implement connective communication between these components. The bus system 1305 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled in FIG. 13 as the bus system 1305.
The user interface 1303 may include, among other things, a display, a keyboard or a pointing device (e.g., a mouse, track ball, touch pad or touch screen, etc.).
It is to be understood that the memory 1302 in embodiments of the present invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable PROM (EEPROM), or a flash Memory. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration, and not limitation, many forms of RAM are available, such as Static random access memory (Static RAM, SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic random access memory (Synchronous D RAM, SDRAM), Double Data Rate Synchronous Dynamic random access memory (ddr Data Rate SD RAM, ddr SDRAM), Enhanced Synchronous SD RAM (ESDRAM), Synchronous link Dynamic random access memory (Synchronous link D RAM, SLDRAM), and Direct memory bus random access memory (DRRAM). The memory 1302 of the systems and methods described herein is intended to comprise, without being limited to, these and any other suitable types of memory.
In some embodiments, memory 1302 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof: an operating system 13021 and application programs 13022.
The operating system 13021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application programs 13022 include various application programs such as a Media Player (Media Player), a Browser (Browser), etc. for implementing various application services. A program for implementing the method of an embodiment of the present invention may be included in the application 13022.
In the embodiment of the present invention, the processor 1301 is configured to, by calling a program or an instruction stored in the memory 1302, specifically, a program or an instruction stored in the application 13022: calculating target interval time of received or sent streaming media data in a period time, wherein the target interval time is the continuous playing time of the same type of data frames; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time.
Optionally, the processor 1301 is further configured to: for each period time, acquiring timestamps corresponding to a first data frame and a last data frame received or sent in the period time; the first data frame and the last data frame are the same type of data frame; and calculating the difference value of the time stamp of the last data frame and the time stamp of the first data frame to obtain the target interval time.
Optionally, the processor 1301 is further configured to: counting the sum of absolute values of the difference values of all the cycle time and the corresponding target interval time within a preset time period to obtain a sum value; and determining the evaluation value of the fluency of the streaming media data according to the ratio of the sum value to the time length of the preset time period.
Optionally, the processor 1301 is further configured to: drawing a first oscillogram reflecting the change of the period time according to each period time; and drawing a second oscillogram reflecting the change of the target interval time according to the target interval time of each data frame of the same type.
Optionally, the processor 1301 is further configured to: receiving the cycle time reported by a first terminal and data frame information sent in the cycle time, wherein the first terminal is a terminal for pushing the streaming media data to the server, and the data frame information is used for calculating the target interval time of the streaming media data sent by the first terminal in the cycle time; or receiving the cycle time reported by a second terminal and data frame information sent within the cycle time, where the second terminal is a terminal that receives the streaming media data pushed by the server, and the data frame information is used to calculate a target interval time of the streaming media data received by the second terminal within the cycle time.
In the embodiment of the invention, the target interval time of the received or sent streaming media data in the cycle time is calculated, wherein the target interval time is the continuous playing time of the same type of data frames; and evaluating the fluency of the streaming media data according to the cycle time and the corresponding target interval time. In the smooth state, the continuous playing time of the data frame of the streaming media data received or sent within the period time is basically consistent with the period time, so that the fluency of the streaming media data can be evaluated according to the relation between the target interval time of the streaming media data received or sent within the period time and the period time, and the fluency evaluation accuracy of the streaming media data is improved.
Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the method for evaluating streaming media data in any one of the above method embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
Claims (11)
1. A method for evaluating streaming media data, comprising:
calculating target interval time of received or sent streaming media data in a period time, wherein the target interval time is the continuous playing time of the same type of data frames;
wherein, the continuous playing time is the interval time between the playing time of the first frame data frame and the playing time of the last frame data frame in the period time;
drawing a first oscillogram reflecting the change of the period time according to the period time;
drawing a second oscillogram reflecting the change of the target interval time according to the target interval time of the data frames of the same type;
the coincidence degree of the first waveform diagram and the second waveform diagram is used for representing the fluency of the streaming media data, wherein the higher the coincidence degree is, the higher the fluency of the streaming media data is, and the lower the coincidence degree is, the lower the fluency of the streaming media data is.
2. The method of claim 1, wherein the step of calculating the target interval time of the received or transmitted streaming media data within the cycle time comprises:
for each period time, acquiring timestamps corresponding to a first data frame and a last data frame received or sent in the period time; the first data frame and the last data frame are the same type of data frame;
and calculating the difference value of the time stamp of the last data frame and the time stamp of the first data frame to obtain the target interval time.
3. The method of claim 1, further comprising:
counting the sum of absolute values of the difference values of all the cycle time and the corresponding target interval time within a preset time period to obtain a sum value;
and determining the evaluation value of the fluency of the streaming media data according to the ratio of the sum value to the time length of the preset time period.
4. The method according to any one of claims 1 to 3, wherein before the step of calculating the target interval time of the received or transmitted streaming media data within the cycle time when the streaming media data evaluation method is applied to the server, the method further comprises:
receiving the cycle time reported by a first terminal and data frame information sent in the cycle time, wherein the first terminal is a terminal for pushing the streaming media data to the server, and the data frame information is used for calculating the target interval time of the streaming media data sent by the first terminal in the cycle time;
or receiving the cycle time reported by a second terminal and data frame information sent within the cycle time, where the second terminal is a terminal that receives the streaming media data pushed by the server, and the data frame information is used to calculate a target interval time of the streaming media data received by the second terminal within the cycle time.
5. An apparatus for evaluating streaming media data, comprising:
the device comprises a calculation module, a display module and a display module, wherein the calculation module is used for calculating target interval time of streaming media data received or sent in a cycle time, and the target interval time is the continuous playing time of data frames of the same type;
wherein, the continuous playing time is the interval time between the playing time of the first frame data frame and the playing time of the last frame data frame in the period time;
the processing module is used for drawing a first oscillogram reflecting the change of the period time according to the period time;
drawing a second oscillogram reflecting the change of the target interval time according to the target interval time of the data frames of the same type;
the coincidence degree of the first waveform diagram and the second waveform diagram is used for representing the fluency of the streaming media data, wherein the higher the coincidence degree is, the higher the fluency of the streaming media data is, and the lower the coincidence degree is, the lower the fluency of the streaming media data is.
6. The apparatus of claim 5, wherein the computing module comprises:
the acquisition submodule is used for acquiring timestamps corresponding to a first data frame and a last data frame received or sent in the cycle time for each cycle time; the first data frame and the last data frame are the same type of data frame;
and the calculating submodule is used for calculating the difference value of the time stamp of the last data frame and the time stamp of the first data frame to obtain the target interval time.
7. The apparatus of claim 5, wherein the processing module comprises:
the counting submodule is used for counting the sum of absolute values of differences between all the periodic time and the corresponding target interval time within a preset time period to obtain a sum value;
and the determining submodule is used for determining the evaluation value of the fluency of the streaming media data according to the ratio of the sum value to the time length of the preset time period.
8. The apparatus of claim 5, wherein the processing module comprises:
the first drawing submodule is used for drawing a first oscillogram reflecting the change of the period time according to each period time;
and the second drawing submodule is used for drawing a second oscillogram reflecting the change of the target interval time according to the target interval time of each data frame of the same type.
9. The apparatus according to any one of claims 5 to 8, wherein when the method for evaluating streaming media data is applied to a server, the apparatus further comprises:
a receiving module, configured to receive the cycle time reported by a first terminal and data frame information sent within the cycle time, where the first terminal is a terminal that pushes the streaming media data to the server, and the data frame information is used to calculate a target interval time of the streaming media data sent by the first terminal within the cycle time; or receiving the cycle time reported by a second terminal and data frame information sent within the cycle time, where the second terminal is a terminal that receives the streaming media data pushed by the server, and the data frame information is used to calculate a target interval time of the streaming media data received by the second terminal within the cycle time.
10. An electronic device, comprising:
a memory for storing a computer program;
a processor, connected to the memory, for implementing the method for evaluating streaming media data according to any one of claims 1 to 4 by executing the computer program.
11. A computer storage medium storing a computer program; the computer program is capable of performing the method of evaluating streaming media data according to any one of claims 1 to 4 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710281530.1A CN108810522B (en) | 2017-04-26 | 2017-04-26 | Method and device for evaluating streaming media data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710281530.1A CN108810522B (en) | 2017-04-26 | 2017-04-26 | Method and device for evaluating streaming media data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108810522A CN108810522A (en) | 2018-11-13 |
| CN108810522B true CN108810522B (en) | 2021-07-09 |
Family
ID=64068853
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710281530.1A Active CN108810522B (en) | 2017-04-26 | 2017-04-26 | Method and device for evaluating streaming media data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108810522B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110418170B (en) * | 2019-07-03 | 2021-11-19 | 腾讯科技（深圳）有限公司 | Detection method and device, storage medium and electronic device |
| CN111711867A (en) * | 2020-05-19 | 2020-09-25 | 腾讯科技（深圳）有限公司 | Index collection method, device, medium and electronic equipment of streaming media service |
| CN114513385B (en) * | 2022-03-24 | 2024-04-02 | 深圳市元征科技股份有限公司 | Data transmission method, device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103001961A (en) * | 2012-12-03 | 2013-03-27 | 华为技术有限公司 | Method and device for obtaining streaming media caching parameters |
| WO2013130474A1 (en) * | 2012-02-27 | 2013-09-06 | Qualcomm Incorporated | Improved dash client and receiver with playback rate selection |
| CN105188079A (en) * | 2015-10-20 | 2015-12-23 | 武汉虹信技术服务有限责任公司 | Streaming media quality evaluation and mobile network quality lifting system and method |
-
2017
- 2017-04-26 CN CN201710281530.1A patent/CN108810522B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013130474A1 (en) * | 2012-02-27 | 2013-09-06 | Qualcomm Incorporated | Improved dash client and receiver with playback rate selection |
| CN103001961A (en) * | 2012-12-03 | 2013-03-27 | 华为技术有限公司 | Method and device for obtaining streaming media caching parameters |
| CN105188079A (en) * | 2015-10-20 | 2015-12-23 | 武汉虹信技术服务有限责任公司 | Streaming media quality evaluation and mobile network quality lifting system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108810522A (en) | 2018-11-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109618565B (en) | Method and system for automatically measuring experience quality of streaming video user | |
| EP1924101B1 (en) | Video communication quality estimation device, method, and program | |
| CN108810522B (en) | Method and device for evaluating streaming media data | |
| US9419875B2 (en) | Video quality assessment method and apparatus | |
| CN103379358B (en) | Method and device for assessing multimedia quality | |
| CN108721898B (en) | Frame rate determination method and apparatus, storage medium, and electronic apparatus | |
| EP3125550A1 (en) | Method and apparatus for obtaining video quality parameter, and electronic device | |
| Cherif et al. | A_PSQA: Efficient real-time video streaming QoE tool in a future media internet context | |
| JP4308227B2 (en) | Video quality estimation device, video quality management device, video quality estimation method, video quality management method, and program | |
| EP3313073A1 (en) | Method for assessing the perceived quality of adaptive video streaming | |
| US20060136578A1 (en) | Monitoring the performance of a streaming media server using server-side and client-side measurements | |
| EP3393125A1 (en) | Audio/visual quality estimation device, method for estimating audio/visual quality, and program | |
| CN108390775B (en) | User experience quality evaluation method and system based on SPICE | |
| CN103385000A (en) | Method and apparatus for measuring video quality | |
| CN103428523B (en) | Method and device for estimating video quality | |
| CN113094284A (en) | Application fault detection method and device | |
| CN109753423A (en) | A kind of method and device for assessing Caton degree | |
| CN105744304B (en) | A kind of processing method and processing device of EPG data | |
| CN106326097B (en) | Method and device for testing page perception performance | |
| Xu et al. | Error resilience of haptic data in interactive systems | |
| US20060136927A1 (en) | Models for monitoring of streaming server performance | |
| JP7431514B2 (en) | Method and system for measuring quality of video call service in real time | |
| CN114222169A (en) | Video stream transmission method and device and communication equipment | |
| JP2007329778A (en) | Apparatus, method and program for estimating user's sensory quality | |
| CN109756730B (en) | Evaluation processing method and device based on video, intelligent equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |