CN114866763A - Video quality evaluation method and device, terminal equipment and storage medium - Google Patents
Video quality evaluation method and device, terminal equipment and storage medium Download PDFInfo
- Publication number
- CN114866763A CN114866763A CN202210363205.0A CN202210363205A CN114866763A CN 114866763 A CN114866763 A CN 114866763A CN 202210363205 A CN202210363205 A CN 202210363205A CN 114866763 A CN114866763 A CN 114866763A
- Authority
- CN
- China
- Prior art keywords
- data packet
- video data
- video
- determining
- quality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 59
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 238000013441 quality evaluation Methods 0.000 title description 24
- 230000005540 biological transmission Effects 0.000 claims abstract description 60
- 238000011156 evaluation Methods 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 18
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 5
- 238000001303 quality assessment method Methods 0.000 description 5
- 230000009471 action Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012372 quality testing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Databases & Information Systems (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a method and a device for evaluating video quality, a terminal device and a storage medium, wherein the method comprises the following steps: acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and an apparatus for evaluating video quality, a terminal device, and a storage medium.
Background
With the rapid development of networks and multimedia, multimedia application layer services in the networks are increasing, such as multimedia services of video conferences, video on demand, remote education, telemedicine and the like. Since the video data volume is large, in a specific application, the network transmission performance affects the service quality of a video service, and therefore, research on the video quality of video transmission in a network is required.
The video quality evaluation methods mainly include subjective quality evaluation and objective quality evaluation methods. Subjective quality evaluation is a relatively accurate image quality evaluation method because subjective quality evaluation directly reflects the perception of human eyes, but the subjective evaluation results obtained are different because the evaluation criteria of each person are different. If an objective quality evaluation method is adopted, the current video quality testing tool such as evalVid only considers the influence of data packet loss and video quality when the network is congested, does not consider the influence of network delay on the video quality, and how to comprehensively evaluate the video quality of transmitted video data is a problem which is urgently needed to be solved at present.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a video quality evaluation method, apparatus, terminal device and storage medium that overcome or at least partially solve the above problems.
In a first aspect, an embodiment of the present invention provides a method for evaluating video quality, where the method includes:
acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters;
and determining the video quality of the first video data packet according to the video information.
Optionally, the network transmits parameter video information, including packet loss rate and/or delay time.
Optionally, the determining, according to the first video data packet and the second video data packet, a network transmission parameter for transmitting the first video data packet includes:
determining the packet loss rate of transmitting the first video data packet according to the first number of the first video data packets and the second number of the second video data packets;
and/or
And determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet.
Optionally, the determining, according to the first number of the first video data packets and the second number of the second video data packets, a packet loss rate for transmitting the first video data packets includes:
acquiring a first number of first video data packets sent within a preset time period;
acquiring a second number of received second video data packets;
and calculating the difference value between the first quantity and the second quantity, and determining the packet loss rate according to the ratio of the difference value to the first quantity.
Optionally, the determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet includes:
acquiring the sending time of sending the first video data packet;
acquiring the receiving time of the receiving end equipment for receiving the first video data packet;
and determining the delay time for sending the first video data packet according to the difference value between the sending time and the receiving time.
Optionally, the determining, according to the first video data packet and the second video data packet, a structural similarity parameter for transmitting the first video data packet includes:
respectively carrying out brightness contrast, contrast and structure contrast on the first video data packet and the second video data packet by adopting a structure similarity model;
and determining the structural similarity parameters of the first video data packet and the second video data packet according to the comparison result.
Optionally, the determining the video quality of the first video data packet according to the video information includes:
acquiring normal time for sending a first video data packet to receiving end equipment;
determining the transmission efficiency of the first video data packet in transmission according to the normal time and the delay time;
and determining the video quality of the first video data packet according to the transmission efficiency, the packet loss rate and the structural similarity parameter.
In a second aspect, an embodiment of the present invention provides an apparatus for evaluating video quality, including:
the acquisition module is used for acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
a determining module, configured to determine video information of the first video data packet according to the first video data packet and the second video data packet, respectively, where the video information at least includes a network transmission parameter and/or a structural similarity parameter;
and the evaluation module is used for determining the video quality of the first video data packet according to the video information.
Optionally, the network transmission parameter includes a packet loss rate and/or a delay time.
Optionally, the determining module is configured to:
determining the packet loss rate of transmitting the first video data packet according to the first number of the first video data packets and the second number of the second video data packets;
and/or
And determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet.
Optionally, the determining module is configured to obtain a first number of first video data packets sent within a preset time period;
acquiring a second number of received second video data packets;
and calculating the difference value between the first quantity and the second quantity, and determining the packet loss rate according to the ratio of the difference value to the first quantity.
Optionally, the determining module is configured to:
acquiring the sending time of sending the first video data packet;
acquiring the receiving time of the receiving end equipment for receiving the first video data packet;
and determining the delay time for sending the first video data packet according to the difference value between the sending time and the receiving time.
Optionally, the determining module is configured to:
respectively carrying out brightness contrast, contrast and structure contrast on the first video data packet and the second video data packet by adopting a structure similarity model;
and determining the structural similarity parameters of the first video data packet and the second video data packet according to the comparison result.
Optionally, the evaluation module is configured to:
acquiring normal time for sending a first video data packet to receiving end equipment;
determining the transmission efficiency of the first video data packet in transmission according to the normal time and the delay time;
and determining the video quality of the first video data packet according to the transmission efficiency, the packet loss rate and the structural similarity parameter.
In a third aspect, an embodiment of the present invention provides a terminal device, including: at least one processor and memory;
the memory stores a computer program; the at least one processor executes the computer program stored by the memory to implement the method for evaluating video quality provided by the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed, the method for evaluating video quality provided in the first aspect is implemented.
The embodiment of the invention has the following advantages:
according to the method, the device, the terminal equipment and the storage medium for evaluating the video quality, a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet are obtained; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of a first video data packet according to the first video data packet and a second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
Drawings
FIG. 1 is a flow chart illustrating the steps of an embodiment of a method for evaluating video quality according to the present invention;
FIG. 2 is a flow chart of steps in another embodiment of a method for evaluating video quality of the present invention;
FIG. 3 is a flow chart of steps for a structural similarity embodiment of the present invention;
FIG. 4 is a block diagram of an embodiment of a video quality assessment system according to the present invention;
FIG. 5 is a flow chart of steps in yet another embodiment of a method for evaluating video quality of the present invention;
FIG. 6 is a block diagram of an embodiment of an apparatus for evaluating video quality according to the present invention;
fig. 7 is a schematic structural diagram of a terminal device of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description thereof.
The video networking is an important milestone of network development, is a real-time network, can realize high-definition video real-time transmission, and pushes a plurality of Internet applications to high-definition video, and high definition is face-to-face.
The video networking adopts a real-time high-definition video exchange technology, can integrate required services such as dozens of services of video, voice, pictures, characters, communication, data and the like on a system platform on a network platform, such as high-definition video conference, video monitoring, intelligent monitoring analysis, emergency command, digital broadcast television, delayed television, network teaching, live broadcast, VOD on demand, television mail, Personal Video Recorder (PVR), intranet (self-office) channels, intelligent video broadcast control, information distribution and the like, and realizes high-definition quality video broadcast through a television or a computer.
The nouns are explained as follows:
(1) and (3) video networking: an underlying communications protocol that is different from the internet.
(2) Dithering: the variation of the time delay and the IP network jitter depend on the dynamic routing of the network, the time delay of the network equipment caused by congestion and other factors. The general audio/video decoder mainly aims at the stable code stream, if the code stream after line transmission has large jitter and exceeds the bearing range of the decoder, the decoder discards (or performs a large amount of cache), and finally shows packet loss (or delay), thereby finally influencing the final quality of the audio/video.
(3) Packet loss: the percentage of lost messages in the network transmission process, the message loss caused by network equipment congestion in the actual IP network environment, and when there is network packet loss, the audio and video quality will be affected, for example: the images generate screens or mosaics, the sound is intermittent, and the like, and even the conference is interrupted when the images are serious.
(4) Latency is an important indicator in network transmission and measures the time required for data to travel from one endpoint to another. In network transmission, the delay is typically in milliseconds and may vary due to a number of factors, including the location of the endpoint, the size of the packet, and the size of the traffic.
(5) SSIM: structural similarity, i.e., an assessment method based on structural distortion.
(6) QoE Quality of Experience, video Quality.
An embodiment of the present invention provides a method for evaluating video quality, which is used for evaluating quality of video data transmitted in a video network. The execution main body of the embodiment is an evaluation device of video quality, which is arranged on a terminal device which is added in the video network in advance, wherein the terminal device can be a computer, a tablet computer, a mobile phone terminal and the like.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a method for evaluating video quality according to the present invention is shown, and the method may specifically include the following steps:
s101, acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
specifically, the embodiment of the present invention provides a terminal device, where video quality assessment software is installed on the terminal device, and the video quality assessment software is used to perform quality assessment on transmitted video data. The terminal equipment acquires the preset video YUV file, codes and compresses the preset video YUV file to generate an H264 file, then subpackages the compressed video file, records the serial number and the subpackage quantity of each subpackage, and sends the obtained subpackage.
The original video packet, i.e. the preset video packet, i.e. the first video data packet, obtained in the embodiment of the present invention is in the form of a YUV data stream, and then the original video packet is subjected to encoding processing, for example, h.264, MPEG video codec.
Specifically, YUV format, divided into three components, "Y" represents brightness (Luma), i.e., a gray value; "U" and "V" denote Chroma (Chroma) which describes the color and saturation of an image and is used to specify the color of a pixel. It separates the brightness information (Y) and the color information (UV), and it can display the complete image without UV information, but it is black and white, and YUV does not require three independent video signals to transmit at the same time like RGB, so it uses YUV mode to transmit and occupy little bandwidth.
In addition, the terminal device may also split the original data packet, determine the split sub-packet as a first video data packet, and acquire the first video data packet to be sent within a preset time period;
specifically, the terminal device sends the first video data packet to the receiving terminal device through the video network, the receiving terminal device forwards the first video data packet and sends the first video data packet to the terminal device, and the terminal device decodes the received video data packet and converts the video data packet into a distorted YUV file to obtain a second video data packet, namely an actual data packet received by the receiving terminal.
S102, respectively determining video information of a first video data packet according to the first video data packet and a second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; network transmission parameter video information including packet loss rate and/or delay time
Specifically, the terminal device determines the packet loss rate according to the number of first video data packets sent and the number of second video data packets received within a preset time period, determines the delay time by acquiring the sending time of the first video data packets and the receiving time of the second video data packets, and calculates the structural similarity parameter of the first video data packets and the second video data packets to obtain the structural similarity parameter.
S103, determining the video quality of the first video data packet according to the video information.
Specifically, in a specific implementation process, the terminal device may calculate the video quality for transmitting the first video data packet according to one or more of the packet loss rate, the delay time, and the structural similarity parameter.
For example, the video quality for transmitting the first video data packet may be determined according to a packet loss rate, may also be calculated according to a delay time, and may also be calculated according to a packet loss rate and a structural similarity parameter.
According to the method for evaluating the video quality provided by the embodiment of the invention, a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet are obtained; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
The present invention further provides a supplementary description of the method for evaluating video quality provided by the above embodiments.
As shown in fig. 2, a flow chart of steps of another embodiment of the method for evaluating video quality of the present invention is shown, and the method for evaluating video quality includes:
s201, compressing and encoding preset YUV format video data to obtain a compressed video file;
specifically, the terminal device obtains preset video data in a YUV format, and performs H264 coding on the video data to obtain a coded and compressed video file.
S202, splitting the compressed video file to obtain a first video data packet.
And the terminal equipment splits the compressed video file to obtain a plurality of sub-packets, and determines the obtained sub-packets as the first video file.
S203, receiving a second video data packet forwarded by the receiving end equipment; the second video data packet is obtained by the receiving end equipment by forwarding the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
the terminal equipment sends the first video data packet to the receiving end equipment, and the receiving end equipment forwards the first video data packet to the terminal equipment and determines the forwarded first video data packet as a second video data packet.
S204, respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters.
Specifically, the terminal device may determine, according to the first video data packet and the second video data packet, a network transmission parameter for transmitting the first video data packet, where the network transmission parameter includes a packet loss rate and/or a delay time, and may also calculate a structural similarity parameter of the first video data packet and the second video data packet,
as an alternative implementation, determining a network transmission parameter for transmitting the first video data packet according to the first video data packet and the second video data packet includes:
determining the packet loss rate of transmitting the first video data packets according to the first number of the first video data packets and the second number of the second video data packets;
the method specifically comprises the following steps:
step A1, acquiring a first number of first video data packets sent out within a preset time period;
step A2, obtaining a second number of the received second video data packets;
step a3, calculating a difference between the first quantity and the second quantity, and determining the packet loss rate according to a ratio of the difference to the first quantity.
That is, the packet loss rate is (first number-second number)/first number.
And/or
And determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet.
The method comprises the following steps:
step B1, acquiring the sending time of the first video data packet;
step B2, acquiring the receiving time of the receiving end equipment for receiving the first video data packet;
and step B3, determining the delay time for sending the first video data packet according to the difference value between the sending time and the receiving time.
As another alternative embodiment: determining a structural similarity parameter for transmitting the first video data packet according to the first video data packet and the second video data packet, comprising:
step C1, adopting a structural similarity model to respectively carry out brightness contrast, contrast and structural contrast on the first video data packet and the second video data packet;
and step C2, determining the structural similarity parameters of the first video data packet and the second video data packet according to the comparison result.
As shown in fig. 3, Structural Similarity (SSIM) is a fully-referenced image quality evaluation index, which measures image similarity from three aspects of brightness, contrast, and structure.
First, the average gray scale is taken as an estimate of the luminance measurement:
the brightness contrast function l (x, y) is related to
As a function of (c).
Then, it is known by the measurement system to remove the mean gray value from the signal, for discrete signals x- μ i The standard deviation can be used as a contrast estimator.
The contrast function c (x, y) is
As a function of (c).
Next, the signal is divided by its standard deviation and the structural contrast function is defined as
And
are all functions.
Finally, three comparison modules are combined into a complete similarity measurement function:
S(x.y)＝f(l(x.y).x(x.y).x(x.y)) (3)
brightness contrast function:
constant C 1 To avoid the use of
Approaching 0 causes instability of the system.
In particular, selection C 1 ＝(K 1 L) 2 L is the number of image gray levels, for 8-bit gray image, L255, K 1 < 1. The formula (4) satisfies the above three conditions.
Contrast function:
constant C 2 ＝(K 2 L) 2 And K is 2 < 1. The formula (5) still satisfies the above three conditions.
Structure comparison function:
wherein the content of the first and second substances,
and finally combining the three functions to obtain an SSIM exponential function:
SSIM(x.y)＝|l(x.y) n |x(x.y)] 3 |x(x.y)] - (8)
here, the
For adjusting the importance of the three modules.
To obtain a simplified form, let
Obtaining:
C 1 、C 2 、C 3 is constant, and C is usually taken to avoid the case where the denominator is 0 1 ＝(K 1 *L)^2，C 2 ＝(K 2 *L)^2，C 3 ＝C 2 /2, in generalK 1 ＝0.01，K 2 When L is 255, SSIM is in the range of 0, 1]The larger the value, the smaller the image distortion.
S205, acquiring the normal time for sending the first video data packet to the receiving end equipment;
s206, determining the transmission efficiency of the first video data packet in transmission according to the normal time and the delay time;
specifically, the terminal device obtains a normal use time for sending the first video data to the receiving end device, where the normal use time may be obtained by a test under a condition that the network quality is good, or may be an empirical value.
The delay time is the time when the receiving end equipment receives the first video data, if the time for receiving the first video data is longer than the normal time, the time is determined as the delay time, and the transmission efficiency of the first video data packet in the transmission process is determined according to the normal time and the delay time.
And S207, determining the video quality of the first video data packet according to the transmission efficiency, the packet loss rate and the structural similarity parameter.
The embodiment of the invention provides an improved SSIM video quality assessment data model, which is used for determining the video quality of a first video data packet transmitted by combining the packet loss rate and the delay time of network transmission on the basis of calculating the SSIM values of an original video and a distorted video, and comprises the following specific calculation formula:
video quality QoE ═ (normal use time-delay time)/normal use time-packet loss rate + SSIM 4;
in the embodiment of the present invention, the video quality may be divided into 5 quality levels, which are specifically shown in table 1:
TABLE 1
Fig. 4 is a block diagram of a video quality evaluation system according to an embodiment of the present invention, and as shown in fig. 4, a video quality evaluation terminal, i.e., the above-mentioned terminal device, may be used for video encoding and video transmission, and also used for video reception, and decodes received video data; the embodiment of the invention is used for carrying out quality evaluation on video data of a video network, and the terminal is used for forwarding the video, and the specific steps are as follows:
1. the video quality evaluation terminal encodes and compresses the preset video YUV file to generate an H264 file for subpackaging, and then sends a first video data packet after subpackaging to the terminal.
2. And the terminal forwards the received video packet to the video quality evaluation terminal.
3. And the video quality evaluation terminal receives the data packet to perform packet header analysis, counts the packet loss rate and delay of the video, decodes the video data and converts the video data into a distorted YUV file, namely a second video data packet.
4. And counting the SSIM values of the source YUV file (the first video data packet) and the distorted YUV file (the second video data packet) by using an SSIM evaluation method.
5. And calculating the QoE of the video according to the parameters such as the packet loss rate, the delay time, the SSIM and the like acquired.
Fig. 5 is a flowchart illustrating steps of another embodiment of a video quality assessment method according to the present invention, and as shown in fig. 5, the video quality assessment terminal includes obtaining a video data packet, performing statistical analysis on video information, and displaying data of the obtained result.
1) The video quality evaluation terminal obtains original video data, stores the original video data, encodes and compresses a preset video YUV file, generates an H264 file, subpackages the H264 file, obtains a first video data packet, and sends the first video data packet to receiving terminal equipment. According to the requirement of the video network, in the process of splitting the data after the coding compression, various parameters such as a serial number, size, time and the like are marked on the packet header.
2) And the terminal immediately forwards the received video packet to the video quality evaluation terminal.
3) And the video quality evaluation terminal receives the data, performs packet header analysis, counts the packet loss rate and delay time of the video, decodes the video data, and converts the video data into a distorted YUV file, namely second video data.
4) The video data packet header contains the total number of the data of each frame, the serial number and the like, and the data packet loss rate is calculated. There is a time record at the time of transmission and a time record at the time of packet reception, so that the two time differences are delay times.
5) And counting SSIM values of the source YUV file and the distorted YUV file by using an SSIM evaluation method.
6) And calculating the QoE through the packet loss rate, the delay time, the SSIM and the like of each acquisition.
7) The current video quality value can be evaluated by SSIM of the packet loss rate, the delay calculation and the video quality of the video packet data in the collected video network. The current network condition can be reflected, and the video coding can be dynamically adjusted.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
According to the method for evaluating the video quality provided by the embodiment of the invention, a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet are obtained; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
Another embodiment of the present invention provides an apparatus for evaluating video quality, which is used to perform the method for evaluating video quality provided by the foregoing embodiments.
Referring to fig. 6, a block diagram of an embodiment of the apparatus for evaluating video quality according to the present invention is shown, and the apparatus may be applied in a video network, and specifically may include the following modules: an obtaining module 601, a determining module 602, and an evaluating module 603, wherein:
the obtaining module 601 is configured to obtain a first video data packet transmitted within a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
the determining module 602 is configured to determine video information of a first video data packet according to the first video data packet and a second video data packet, where the video information at least includes a network transmission parameter and/or a structural similarity parameter;
the evaluation module 603 is configured to determine the video quality of the first video data packet based on the video information.
The evaluation device for video quality provided by the embodiment of the invention obtains a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
The present invention further provides a supplementary explanation for the video quality evaluation device provided in the above embodiment.
Optionally, the network transmission parameter includes a packet loss rate and/or a delay time.
Optionally, the determining module is configured to:
determining the packet loss rate of transmitting the first video data packets according to the first number of the first video data packets and the second number of the second video data packets;
and/or
And determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet.
Optionally, the determining module is configured to obtain a first number of first video data packets sent within a preset time period;
acquiring a second number of received second video data packets;
and calculating the difference value between the first quantity and the second quantity, and determining the packet loss rate according to the ratio of the difference value to the first quantity.
Optionally, the determining module is configured to:
acquiring the sending time for sending the first video data packet;
acquiring the receiving time of receiving the first video data packet by the receiving end equipment;
and determining the delay time for sending the first video data packet according to the difference value between the sending time and the receiving time.
Optionally, the determining module is configured to:
respectively carrying out brightness contrast, contrast and structure contrast on the first video data packet and the second video data packet by adopting a structure similarity model;
and determining the structural similarity parameters of the first video data packet and the second video data packet according to the comparison result.
Optionally, the evaluation module is to:
acquiring normal time for sending a first video data packet to receiving end equipment;
determining the transmission efficiency of the first video data packet in transmission according to the normal time and the delay time;
and determining the video quality of the first video data packet according to the transmission efficiency, the packet loss rate and the structural similarity parameter.
It should be noted that the respective implementable modes in the present embodiment may be implemented individually, or may be implemented in combination in any combination without conflict, and the present application is not limited thereto.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The evaluation device for video quality provided by the embodiment of the invention obtains a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
Still another embodiment of the present invention provides a terminal device, configured to execute the video quality evaluation method provided in the foregoing embodiment.
Fig. 7 is a schematic structural diagram of a terminal device of the present invention, and as shown in fig. 7, the terminal device includes: at least one processor 701 and memory 702;
the memory stores a computer program; at least one processor executes a computer program stored in a memory to implement the method for evaluating video quality provided by the above-described embodiments.
In the terminal device provided in this embodiment, a first video data packet transmitted within a preset time period and a second video data packet corresponding to the first video data packet are obtained; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
Yet another embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed, the method for evaluating video quality provided in any of the above embodiments is implemented.
According to the computer-readable storage medium of the embodiment, a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet are acquired; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end; respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters; the video quality of the first video data packet is determined according to the video information, and the quality of the transmitted video file is evaluated according to the video information in the video transmission process, so that the video quality of the video file is evaluated from multiple aspects, and the accuracy of video evaluation is improved.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, electronic devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing electronic device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing electronic device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing electronic devices to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing electronic device to cause a series of operational steps to be performed on the computer or other programmable electronic device to produce a computer implemented process such that the instructions which execute on the computer or other programmable electronic device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or electronic device that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or electronic device. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or electronic device that comprises the element.
The above detailed description is provided for a video quality evaluation method and a video quality evaluation device, and the principle and the implementation of the present invention are explained by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A method for evaluating video quality, the method comprising:
acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
respectively determining video information of the first video data packet according to the first video data packet and the second video data packet, wherein the video information at least comprises network transmission parameters and/or structural similarity parameters;
and determining the video quality of the first video data packet according to the video information.
2. The method according to claim 1, wherein the network transmission parameters include packet loss rate and/or delay time.
3. The method of claim 2, wherein determining the network transmission parameters for transmitting the first video data packet according to the first video data packet and the second video data packet comprises:
determining the packet loss rate of transmitting the first video data packet according to the first number of the first video data packets and the second number of the second video data packets;
and/or
And determining the delay time of the first video data packet according to the sending time of the first video data packet and the receiving time of the second video data packet.
4. The method of claim 3, wherein determining the packet loss rate for transmitting the first video data packet according to the first number of the first video data packets and the second number of the second video data packets comprises:
acquiring a first number of first video data packets sent within a preset time period;
acquiring a second number of received second video data packets;
and calculating the difference value between the first quantity and the second quantity, and determining the packet loss rate according to the ratio of the difference value to the first quantity.
5. The method of claim 3, wherein determining the delay time of the first video data packet according to the transmission time of the first video data packet and the reception time of the second video data packet comprises:
acquiring the sending time of sending the first video data packet;
acquiring the receiving time of the receiving end equipment for receiving the first video data packet;
and determining the delay time for sending the first video data packet according to the difference value between the sending time and the receiving time.
6. The method according to any one of claims 1 to 5, wherein determining the structural similarity parameter for transmitting the first video data packet according to the first video data packet and the second video data packet comprises:
respectively carrying out brightness contrast, contrast and structure contrast on the first video data packet and the second video data packet by adopting a structure similarity model;
and determining the structural similarity parameters of the first video data packet and the second video data packet according to the comparison result.
7. The method according to any of claims 2 to 5, wherein said determining the video quality of the first video data packet based on the video information comprises:
acquiring normal time for sending a first video data packet to receiving end equipment;
determining the transmission efficiency of the first video data packet in transmission according to the normal time and the delay time;
and determining the video quality of the first video data packet according to the transmission efficiency, the packet loss rate and the structural similarity parameter.
8. An apparatus for evaluating video quality, the apparatus comprising:
the acquisition module is used for acquiring a first video data packet transmitted in a preset time period and a second video data packet corresponding to the first video data packet; the first video data packet is an original data packet sent by a sending end, and the second video data packet is an actual data packet received by a receiving end;
a determining module, configured to determine video information of the first video data packet according to the first video data packet and the second video data packet, respectively, where the video information at least includes a network transmission parameter and/or a structural similarity parameter;
and the evaluation module is used for determining the video quality of the first video data packet according to the video information.
9. A terminal device, comprising: at least one processor and memory;
the memory stores a computer program; the at least one processor executes the computer program stored by the memory to implement the method of assessing video quality as claimed in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which when executed implements the method of evaluating video quality of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210363205.0A CN114866763A (en) | 2022-04-08 | 2022-04-08 | Video quality evaluation method and device, terminal equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210363205.0A CN114866763A (en) | 2022-04-08 | 2022-04-08 | Video quality evaluation method and device, terminal equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114866763A true CN114866763A (en) | 2022-08-05 |
Family
ID=82630167
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210363205.0A Pending CN114866763A (en) | 2022-04-08 | 2022-04-08 | Video quality evaluation method and device, terminal equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114866763A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115942010A (en) * | 2022-11-11 | 2023-04-07 | 北京奇艺世纪科技有限公司 | Quality evaluation result acquisition method and device, server and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105224A (en) * | 2017-03-24 | 2017-08-29 | 深圳信息职业技术学院 | Method, device and system that a kind of quality of experience of video is assessed |
| CN107105226A (en) * | 2017-06-22 | 2017-08-29 | 上海迪爱斯通信设备有限公司 | A kind of video quality evaluation device |
| CN110505472A (en) * | 2019-07-15 | 2019-11-26 | 武汉大学 | A kind of H.265 ultra high-definition method for evaluating video quality |
| US20200162725A1 (en) * | 2018-11-21 | 2020-05-21 | Huawei Technologies Co., Ltd. | Video Quality Assessment Method and Apparatus |
| CN111355950A (en) * | 2020-03-13 | 2020-06-30 | 随锐科技集团股份有限公司 | Video transmission quality detection method and system in real-time video communication |
| CN113923441A (en) * | 2020-07-08 | 2022-01-11 | 钉钉控股（开曼）有限公司 | Video quality evaluation method and device and electronic equipment |
-
2022
- 2022-04-08 CN CN202210363205.0A patent/CN114866763A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107105224A (en) * | 2017-03-24 | 2017-08-29 | 深圳信息职业技术学院 | Method, device and system that a kind of quality of experience of video is assessed |
| CN107105226A (en) * | 2017-06-22 | 2017-08-29 | 上海迪爱斯通信设备有限公司 | A kind of video quality evaluation device |
| US20200162725A1 (en) * | 2018-11-21 | 2020-05-21 | Huawei Technologies Co., Ltd. | Video Quality Assessment Method and Apparatus |
| CN110505472A (en) * | 2019-07-15 | 2019-11-26 | 武汉大学 | A kind of H.265 ultra high-definition method for evaluating video quality |
| CN111355950A (en) * | 2020-03-13 | 2020-06-30 | 随锐科技集团股份有限公司 | Video transmission quality detection method and system in real-time video communication |
| CN113923441A (en) * | 2020-07-08 | 2022-01-11 | 钉钉控股（开曼）有限公司 | Video quality evaluation method and device and electronic equipment |
| WO2022007874A1 (en) * | 2020-07-08 | 2022-01-13 | 钉钉控股（开曼）有限公司 | Video quality assessment method and apparatus, and electronic device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115942010A (en) * | 2022-11-11 | 2023-04-07 | 北京奇艺世纪科技有限公司 | Quality evaluation result acquisition method and device, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8558868B2 (en) | Conference participant visualization | |
| US7852948B2 (en) | Moving picture real-time communications terminal, control method for moving picture real-time communications terminal, and control program for moving picture real-time communications terminal | |
| US9049340B2 (en) | Method and apparatus for adjusting site bandwidth, conferencing terminal, and media control server | |
| US20140337871A1 (en) | Method to measure quality of experience of a video service | |
| US20050244070A1 (en) | Moving picture distribution system, moving picture distribution device and method, recording medium, and program | |
| US20070280129A1 (en) | System and method for calculating packet loss metric for no-reference video quality assessment | |
| CN1788494A (en) | System and method for transmission of a multitude of video sequences | |
| WO2008094092A1 (en) | Method and arrangement for video telephony quality assessment | |
| JP5882320B2 (en) | Method and apparatus for evaluating the quality of a video signal during encoding or compression of the video signal | |
| CN111147860B (en) | Video data decoding method and device | |
| US10506006B2 (en) | Method and system for flow-rate regulation in a content-controlled streaming network | |
| US20170142029A1 (en) | Method for data rate adaption in online media services, electronic device, and non-transitory computer-readable storage medium | |
| CN111741248B (en) | Data transmission method, device, terminal equipment and storage medium | |
| CN111225254B (en) | Video transmission method, device, terminal equipment and storage medium | |
| KR20150003316A (en) | Method and device for evaluating media quality | |
| CN114339445B (en) | Real-time video stream self-adaptive coordination system and method | |
| CN114866763A (en) | Video quality evaluation method and device, terminal equipment and storage medium | |
| Pinson et al. | Video performance requirements for tactical video applications | |
| Yunus et al. | Optimum parameters for MPEG-4 data over wireless sensor network | |
| CN116962613A (en) | Data transmission method and device, computer equipment and storage medium | |
| Martínez et al. | Objective video quality metrics: A performance analysis | |
| CN114025171A (en) | Video processing method and device, terminal equipment and storage medium | |
| JP2018537885A (en) | Method and system for flow rate adjustment in a content-controlled streaming network | |
| KR101795958B1 (en) | Adaptive control method, apparatus and user device for providing video in real time network cameras | |
| JP2010171876A (en) | Communication device and communication system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |