CN113949899A - Video quality evaluation method and device - Google Patents
Video quality evaluation method and device Download PDFInfo
- Publication number
- CN113949899A CN113949899A CN202111205034.0A CN202111205034A CN113949899A CN 113949899 A CN113949899 A CN 113949899A CN 202111205034 A CN202111205034 A CN 202111205034A CN 113949899 A CN113949899 A CN 113949899A
- Authority
- CN
- China
- Prior art keywords
- video
- evaluated
- original
- video frame
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013441 quality evaluation Methods 0.000 title claims abstract description 57
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000012545 processing Methods 0.000 claims abstract description 48
- 238000001303 quality assessment method Methods 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 6
- 238000011156 evaluation Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a video quality evaluation method and a video quality evaluation device, wherein the video quality evaluation method comprises the following steps: acquiring an original video and a video to be evaluated corresponding to the original video; determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video; under the condition that the frame rate to be evaluated is not consistent with the original frame rate, processing the original video based on a preset video frame processing strategy to obtain a target original video frame set, wherein the target original video frame set comprises at least one target original video frame; and determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set. The video quality evaluation method scores the video to be evaluated based on the target original video frame set and the video frame set to be evaluated so as to obtain a more accurate evaluation result of the video to be evaluated.
Description
Technical Field
The application relates to the technical field of internet, in particular to a video quality evaluation method. The application also relates to a video quality assessment device, a computing device and a computer readable storage medium.
Background
With the continuous development of computer technology, transcoding processing is performed on an original video in the video industry, for example, the original video is transcoded to obtain videos with different definitions, so that a user can select the definitions conveniently based on actual conditions; however, the original video is transcoded, and then the video image quality is inevitably affected, and in order to ensure the video quality of the transcoded video, the transcoded video needs to be evaluated.
Therefore, how to improve the accuracy of the video evaluation result becomes a problem to be solved urgently by related technical staff.
Disclosure of Invention
In view of this, the present application provides a video quality evaluation method. The application also relates to a video evaluation device, a computing device and a computer readable storage medium, which are used for solving the problem of low accuracy of video quality evaluation in the prior art.
According to a first aspect of embodiments of the present application, there is provided a video quality assessment method, including:
acquiring an original video and a video to be evaluated corresponding to the original video;
determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video;
under the condition that the frame rate to be evaluated is not consistent with the original frame rate, processing the original video based on a preset video frame processing strategy to obtain a target original video frame set, wherein the target original video frame set comprises at least one target original video frame;
and determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set.
According to a second aspect of embodiments of the present application, there is provided a video quality evaluation apparatus including:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is configured to acquire an original video and a video to be evaluated corresponding to the original video;
a first determining module configured to determine a to-be-evaluated frame rate of the to-be-evaluated video and an original frame rate of the original video;
the processing module is configured to process the original video based on a preset video frame processing strategy to obtain a target original video frame set under the condition that the frame rate to be evaluated is inconsistent with the original frame rate, wherein the target original video frame set comprises at least one target original video frame;
a second determining module configured to determine a video score of the video to be evaluated according to the target original video frame set and a video frame set to be evaluated corresponding to the target original video frame set.
According to a third aspect of embodiments herein, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of the video quality assessment method when executing the computer instructions.
According to a fourth aspect of embodiments of the present application, there is provided a computer-readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the video quality assessment method.
The video quality evaluation method provided by the application obtains an original video and a video to be evaluated corresponding to the original video; determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video; under the condition that the frame rate to be evaluated is not consistent with the original frame rate, processing the original video based on a preset video frame processing strategy to obtain a target original video frame set, wherein the target original video frame set comprises at least one target original video frame; and determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set. According to the video quality evaluation method, the original video is processed through the preset video frame processing strategy to obtain the target original video frame set, and the video to be evaluated is scored based on the target original video frame set and the corresponding video frame set to be processed, so that a more accurate evaluation result for the video to be evaluated is obtained.
Drawings
Fig. 1 is a flowchart of a first video quality assessment method according to an embodiment of the present application;
fig. 2 is a flowchart of a second video quality assessment method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating a video quality assessment method applied to a game video according to an embodiment of the present application;
fig. 4 is a process flow diagram of a video quality assessment method applied to movie video according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of a video quality assessment apparatus according to an embodiment of the present application;
fig. 6 is a block diagram of a computing device according to an embodiment of the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
The terminology used in the one or more embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present application. As used in one or more embodiments of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application is intended to encompass any and all possible combinations of one or more of the associated listed items.
It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments of the present application to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first aspect may be termed a second aspect, and, similarly, a second aspect may be termed a first aspect, without departing from the scope of one or more embodiments of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
First, the noun terms to which one or more embodiments of the present application relate are explained.
Frame: each picture in a video or animation.
Video frame rate (fps): the number of frames displayed per second while the video is played.
Variable frame rate: the frame rates of the video at different times are not exactly the same and may be subject to fluctuations.
Constant frame rate: the frame rate of the video at all times is some constant value.
Rendering the time stamp: the video plays the presentation time of each frame.
YUV: the data format of a commonly used original video is divided into three components, Y represents brightness (Luma), that is, a gray value; u and V represent Chrominance (or Chroma) and are used to describe the color and saturation of an image for specifying the color of a pixel.
ffmpeg: is a set of open source computer programs which can be used to record, convert digital audio and video and convert them into streams.
VMAF: VMAF (video Multi-method Assessment fusion) is developed and sourced by Netflix, a large amount of subjective data is used as a training set, and algorithms of different Assessment dimensions are subjected to 'fusion' through a machine learning means, so that an image quality Assessment standard capable of accurately reflecting subjective will is obtained.
VMAF score: and (3) the score of the VMAF standard evaluation, wherein the higher the score is, the more similar the video to be evaluated and the original video is, 100 is the highest score, and 0 is the lowest score.
In the video industry, the original film of a user can be transcoded, so that different definitions can be generated through transcoding, the user can conveniently select the original film, some parameters of the video are regulated, and the adaptability of the player is improved. However, transcoding necessarily results in a loss of video picture quality, and video quality evaluation criteria and tools are required. The video quality evaluation requires that the frame rates of two videos to be compared are consistent, otherwise, because the timestamps of the compared video frames are inconsistent, the VMAF score is lower, and the actual look and feel of the videos are greatly different. However, the frame rate of many transcoded videos to be evaluated is not consistent with that of the original video, and the error of directly using the VMAF to evaluate the video quality is large.
In order to solve the problem of low accuracy of video quality evaluation caused by different video frame rates, the present application provides a video quality evaluation method, and the present application also relates to a video quality evaluation apparatus, a computing device, and a computer readable storage medium, which are described in detail in the following embodiments one by one.
Fig. 1 shows a flowchart of a first video quality assessment method according to an embodiment of the present application, which specifically includes the following steps:
step 102: and acquiring an original video and a video to be evaluated corresponding to the original video.
The video platform generally adjusts the video played by the platform, and the video platform refers to a server for processing the video, and specifically includes: the server receives the original video and adjusts partial parameters of the original video, thereby improving the adaptability of the player. However, the adjustment process necessarily results in loss of video picture quality, so the video quality of the adjusted video needs to be evaluated based on the original video.
Wherein, the original video refers to the video which is not adjusted; the video to be evaluated refers to a video obtained by adjusting an original video.
In a specific embodiment of the present application, taking the video a as an example, after a video publishing user publishes the video a to a video platform, the video platform adjusts the video a to obtain an adjusted video a1, and in order to evaluate the quality of the video a1, the video a and the video a1 are obtained for subsequent evaluation of the video a 1.
In practical application, the method for acquiring an original video and a video to be evaluated corresponding to the original video comprises the following steps:
receiving an original video;
and transcoding the original video to obtain a video to be evaluated corresponding to the original video.
Specifically, the original video after transcoding can be obtained by transcoding the original video, and the transcoded original video can be used as a video to be evaluated, where video transcoding refers to converting a video code stream which has been compressed and encoded into another video code stream, so as to adapt to different network bandwidths, different terminal processing capabilities, and different user requirements.
In a specific embodiment of the present application, taking a movie video as an example, the movie video is received, the movie video with a video frame rate of 30fps is transcoded into a video with a video frame rate of 24fps, and then the video with the video frame rate of 24fps obtained by transcoding can be used as a video to be evaluated corresponding to the movie video.
Step 104: and determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video.
The frame rate to be evaluated refers to the video frame rate of the video to be evaluated; the original frame rate refers to the video frame rate of the original video; the video frame rate refers to the number of frames displayed per second when a video is played, and generally, the video frame rate of an original video may be a constant frame rate (that is, the frame rate of the video in all times is a certain constant value), or may be a variable frame rate (that is, the frame rates of the video in different times are not completely consistent and may fluctuate).
Specifically, the video frame rate of the original video is extracted from the video attribute information of the original video as the original frame rate; and extracting the video frame rate of the video to be evaluated from the video attribute information of the video to be evaluated as the frame rate to be evaluated.
In a specific embodiment of the present application, taking an original video as an animation video as an example, a video frame rate of 25fps (fps refers to the number of frames displayed per second when a video is played) of the animation video is extracted from video attribute information of the animation video, and a video frame rate of 30fps of a video to be evaluated is extracted from video attribute information of the video to be evaluated.
By determining the video frame rate of the original video and the video frame rate of the video to be evaluated, different video quality evaluation modes can be determined conveniently based on the video frame rate.
Step 106: and under the condition that the frame rate to be evaluated is not consistent with the original frame rate, processing the original video based on a preset video frame processing strategy to obtain a target original video frame set, wherein the target original video frame set comprises at least one target original video frame.
The preset video frame processing strategy is a strategy for obtaining a target original video frame set according to the processing of an original video; in this embodiment, the target original video frame set refers to a set composed of target original video frames.
The specific method for processing the original video based on the preset video processing strategy to obtain the target original video frame set comprises the following steps:
and adjusting the video frame number of the original video based on a preset video frame adjustment strategy to obtain a target original video, wherein the target original frame rate of the target original video frame is consistent with the frame rate to be evaluated.
Comparing the frame rate to be evaluated determined in step 104 with the original frame rate, and adjusting the video frame rate of the original video, i.e. the original frame rate, based on a preset video frame adjustment strategy under the condition that the frame rate to be evaluated is inconsistent with the original frame rate, so as to obtain the target original video.
The target original video refers to a video with the video frame rate being consistent with the frame rate to be evaluated, wherein the video frame rate is obtained by adjusting the video frame rate of the original video; the target original frame rate refers to the video frame rate of the target original video; the preset video frame adjustment strategy refers to a strategy for adjusting the number of video frames of the original video.
The video frame rate of the original video is automatically adjusted to be consistent with the video to be evaluated, and the video to be evaluated is subsequently evaluated based on the adjusted original video, so that the evaluation result of the video to be evaluated is more accurate, and the actual impression of the video is better met.
In a specific embodiment of the application, taking an animation video as an example, a user uploads the animation video to a video platform, and the video platform transcodes the animation video to obtain a video to be evaluated, wherein the video to be evaluated is different from an original frame rate of the animation video; and comparing the frame rate to be evaluated with the original frame rate, namely comparing the video frame rate of the animation video with the video frame rate of the video to be evaluated, and adjusting the animation video based on the preset video frame to obtain the target animation video after the frame rates are determined to be inconsistent.
In practical application, the specific method for adjusting the original video based on the preset video frame adjustment strategy comprises the following steps:
determining a preset video frame adjustment strategy;
and adjusting the number of original video frames of the original video based on the preset video frame adjustment strategy and the frame rate to be evaluated.
The number of original video frames refers to the total number of video frames contained in the original video.
Specifically, based on a preset video frame adjustment strategy and the frame rate to be evaluated, the original frame rate of the original video is adjusted to be consistent with the frame rate to be evaluated, that is, the number of video frames played by the original video per second is adjusted to be consistent with the number of video frames played by the video to be evaluated per second.
In a specific embodiment of the present application, still taking an animation video as an example, determining a preset video frame adjustment policy is to adjust the number of video frames of an original video; and adjusting the number of the video frames of the animation video according to a preset video frame adjustment strategy and the frame rate to be evaluated of the video to be evaluated until the video frame rate of the animation video is consistent with the video frame rate of the video to be evaluated.
In practical application, the adjusting the number of original video frames of the original video based on the preset video frame adjustment policy and the frame rate to be evaluated comprises:
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and adding the target original video frame to the original video;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining a target original video frame in an original video according to a video frame selection rule, and deleting the target original video frame from the original video.
The video frame selection rule is a rule for selecting a target original video frame from an original video; the target original video frame refers to a video frame selected from an original video according to a video frame selection rule.
Specifically, under the condition that the video frame rate of the original video is less than the video frame rate of the video to be evaluated, a video frame needs to be added to the original video, so that the video frame rate of the original video is increased to be consistent with the video frame rate of the video to be evaluated; when the video frame rate of the original video is greater than the video frame rate of the video to be evaluated, part of video frames in the original video need to be deleted, so that the video frame rate can be reduced to be consistent with the video frame rate of the video to be evaluated.
In a specific embodiment of the present application, taking an original frame rate of an original video as 25fps as an example, in this embodiment, the original frame rate of the original video is 25fps, and a frame rate to be evaluated of a video to be evaluated is 30fps, determining a target original video frame in the original video based on a preset selection rule, and adding the target original video frame to the original video.
In another specific embodiment of the present application, still taking the original frame rate of the original video as 25fps as an example, in this embodiment, the original frame rate is 25fps, and the frame rate to be evaluated is 24fps, then determining a target original video frame in the original video based on the video frame selection rule, and deleting the determined target original video frame from the original video.
By adjusting the video frame rate of the original video to be consistent with the video frame rate of the video to be evaluated, more accurate quality evaluation can be conveniently carried out on the video to be evaluated subsequently based on the adjusted original video and the video to be evaluated.
In practical application, determining a target original video frame in the original video according to a video frame selection rule includes:
calculating video frame intervals according to the original frame rate and the frame rate to be evaluated;
determining at least one set of video frames in the original video based on the video frame interval;
and determining a target original video frame corresponding to each video frame interval in each video frame set according to the video frame selection rule.
The video frame interval refers to the number of video frames calculated according to the original frame rate and the frame rate to be evaluated; a set of video frames refers to a set of video frames in the original video that are determined based on the video frame interval. The calculation method for calculating the video frame interval comprises the following steps: under the condition that the number of video frames played by the original video in a certain second is smaller than that of the video frames of the video to be evaluated, dividing the number of the video frames played by the original video in the second by the difference value between the number of the video frames of the original video in the second and the number of the video frames of the video to be evaluated to obtain a video frame interval, wherein if the original frame rate is z and the frame rate to be evaluated is x, the video frame interval is z/(x-z); under the condition that the number of video frames played by the original video in a certain second is greater than that of the video frames of the video to be evaluated, dividing the number of the video frames played by the original video in the second by the difference value between the number of the video frames of the video to be evaluated in the second and the number of the video frames of the original video to obtain the video frame interval, wherein if the original frame rate is z and the frame rate to be evaluated is x, the video frame interval is z/(z-x).
Specifically, video frame intervals are calculated and obtained based on an original frame rate and a frame rate to be evaluated, namely, one video frame is deleted or added every several video frames, and a video frame set is determined in an original video based on the calculated video frame intervals; and selecting a video frame from each determined video frame set according to a video frame selection rule as a target original video frame corresponding to each video frame interval.
In a specific embodiment of the present application, taking a video frame rate of an original video as 24fps as an example, determining a video frame number played by the original video per second to be 24, determining a video frame number played by a video to be evaluated per second to be 25, calculating to obtain a value of a video frame interval to be 24 according to a video frame interval calculation method, and then forming a video frame time interval by every 24 video frames, and forming a video frame set by every 24 video frames in the original video according to the video frame interval to obtain a plurality of video frame sets; and determining a target original video frame corresponding to each video frame interval in each video frame set according to a preset video frame selection rule.
By determining the target original video in the original video, the video frame rate of the original video is adjusted based on the target original video, so that the video frame rate of the original video is consistent with the video frame rate of the video to be evaluated.
In practical application, the specific method for determining the target original video frame corresponding to each video frame interval in each video frame set according to the video frame selection rule comprises the following steps:
determining a video frame to be evaluated of the video to be evaluated, and determining an original video frame set in the original video based on timestamp information of the video frame to be evaluated;
obtaining an original video frame score of each original video frame to be processed in the original video frame set based on the video frame to be evaluated and the original video frame set;
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining an original video frame to be processed with the highest original video frame score in the video frame set as a target original video frame;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining the original video frame to be processed with the lowest original video frame score in the video frame set as a target original video frame.
The video frame to be evaluated refers to a video frame determined in the video to be evaluated; the timestamp information refers to the display time of each frame of video playing, namely a rendering timestamp; the original video frame set refers to a set consisting of original video frames, and the original video frames refer to video frames determined in an original video; the original video frame to be processed refers to a video frame in the original video frame set; raw video frame score refers to the quality score of the raw video frame obtained based on the video frame to be evaluated and the set of raw video frames.
In a specific embodiment of the present application, taking a video to be evaluated as a news video as an example, a video frame rate of the news video is 25fps, and a video frame rate of an original video is 24fps in this embodiment; the news video includes a news video frame set { E1, E2,. En }, each video frame in the news video frame set is used as a video frame to be evaluated, for example, the news video frame E2 is used as a video frame to be evaluated, timestamp information of the news video frame E2 is determined to be 1 minute and 25 seconds, 3 original video frames around 1 minute and 25 seconds are acquired from the original video based on the timestamp information to form an original video frame set, video frame scores of the news video frame 2 and each original video frame in the original video frame set are respectively calculated to obtain a video frame score set {92, 93, 96}, and similarly, a plurality of original video frame sets are determined according to the timestamp information of each news video frame in the news video frame set and a video frame score of each original video frame is calculated, and the calculated video frame score of each original video is shown in table 1 below.
TABLE 1
| C1 | C2 | C3 | C4 | C5 | ... | Cn | |
| E1 | 92 | 93 | 96 | 0 | 0 | ... | 0 |
| E2 | 0 | 93 | 97 | 93 | 0 | 0 | |
| E3 | 0 | 0 | 94 | 95 | 93 | 0 | |
| ... | ... | ||||||
| En | 0 | 0 | 0 | 0 | 0 | ... | n |
Where E1, E2.. En represent news video frames and C1, C2... Cn represent original video frames. The video frame rate 24fps of the original video is smaller than the video frame rate 25fps of the news video, the video frame interval 24 is calculated, the video frame set is determined to be { C1, C2,. C24} according to the video frame interval, the video frame score 97 of the original video frame C3 in the video frame set is determined to be the highest video frame score in the video frame set, and then the original video frame C3 is taken as a target original video frame.
In practical application, after the video frame rate of an original video is adjusted to be consistent with a video to be evaluated, corresponding modification needs to be performed on timestamp information, specifically, the original video is adjusted based on a preset video frame adjustment strategy, and the method for obtaining a target original video includes:
adjusting the original video based on a preset video frame adjustment strategy to obtain an original video to be adjusted, wherein the video frame rate of the original video to be adjusted is consistent with the frame rate to be evaluated;
and adjusting the timestamp information in the original video to be adjusted according to the video to be evaluated to obtain a target original video.
The original video to be adjusted refers to a video whose video frame rate is adjusted but whose timestamp information is not adjusted.
In a specific embodiment of the application, taking an animation video as an example, adjusting a video frame rate of the animation video to be consistent with a frame rate to be evaluated, and obtaining the animation video to be adjusted; and adjusting the timestamp information of the animation video to be adjusted based on the timestamp information of the video to be evaluated to obtain the adjusted animation video.
The video frame rate and the timestamp information of the original video are adjusted to obtain the target original video, and the quality score of the video to be evaluated can be calculated more accurately based on the target original video and the video to be evaluated.
Step 108: and determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set.
The video score refers to the quality score of the video to be evaluated.
Specifically, in this embodiment, the video score of the video to be evaluated is determined according to the target original video corresponding to the target original video frame set and the video to be evaluated corresponding to the video frame set to be evaluated.
In practical application, the method for calculating the video score of the video to be evaluated based on the target original video comprises the following steps:
acquiring a target original video stream of the target original video and a to-be-evaluated video stream of the to-be-evaluated video;
and inputting the target original video stream and the video stream to be evaluated into a video quality evaluation module, and acquiring the video score of the video to be evaluated output by the video quality evaluation module.
The target original video stream refers to a video stream obtained by decoding an original video, for example, a YUV video stream obtained by decoding the original video; the video stream to be evaluated is a video stream obtained by decoding a video to be evaluated; the video quality evaluation module is a module for evaluating the quality of a video, for example, a YUV video stream of a target original video and a YUV video stream of a video to be evaluated are uploaded to a fft integrated VMAF for quality evaluation, so as to obtain a video score of the video to be evaluated.
In a specific embodiment of the application, taking a target original video as a target animation video as an example, decoding the target animation video to obtain a YUV video stream of the target animation video, and decoding a video to be evaluated to obtain a YUV video stream of the video to be evaluated; and uploading the YUV video stream of the target animation video and the YUV video stream of the video to be evaluated to the FFmpeg integrated VMAF for quality evaluation, and obtaining the video score of the video to be evaluated.
By decoding the original video and the video to be processed, the video evaluation module can conveniently evaluate the quality of the decoded video stream.
In practical application, after determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video, comparing and determining that the frame rate to be evaluated is consistent with the original frame rate, and if the frame rates are consistent, the method for processing the video to be evaluated comprises the following steps:
under the condition that the frame rate to be evaluated is consistent with the original frame rate, acquiring a video stream to be evaluated of the video to be evaluated and an original video stream of the original video;
and inputting the video stream to be evaluated and the original video stream to a video quality evaluation module, and acquiring the video score of the video to be evaluated, which is output by the video quality evaluation module.
The original video stream refers to a video stream obtained by decoding an original video.
In a specific embodiment of the application, an original video is taken as an animation video as an example, the animation video is decoded to obtain a YUV video stream of the animation video, and a video to be evaluated is decoded to obtain a YUV video stream of the video to be evaluated; uploading the YUV video stream of the animation video and the YUV video stream of the video to be evaluated to the FFmpeg integrated VMAF for quality evaluation, and outputting the VMAF score by the video quality evaluation module, namely obtaining the video score of the video to be evaluated.
According to the video quality evaluation method, the video frame rate of the original video is adjusted to be consistent with the video frame rate of the video to be evaluated, and the video quality of the video to be evaluated is calculated based on the adjusted original video, so that the accuracy of evaluation of the video to be evaluated is improved, the videos with different frame rates are compared, and an on-demand transcoding video quality evaluation system is optimized.
Fig. 2 is a flowchart illustrating a second video quality assessment method according to an embodiment of the present application, which specifically includes the following steps:
step 202: and acquiring an original video and a video to be evaluated corresponding to the original video.
Specifically, an original video is determined, and the original video is transcoded to obtain a video to be evaluated, which corresponds to the original video.
Step 204: and determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video.
Specifically, the video frame rate of the video to be evaluated and the video frame rate of the original video are determined, that is, the number of video frames played per second of the video to be evaluated and the number of video frames played per second of the original video are determined.
Step 206: and under the condition that the frame rate to be evaluated is not consistent with the original frame rate, determining a video frame to be evaluated in the video to be evaluated, and determining a target original video frame set corresponding to the video frame to be evaluated in the original video based on timestamp information of the video frame to be evaluated.
Specifically, the frame rate to be evaluated of the obtained video to be evaluated is compared with the original frame rate of the original video, and a video frame to be evaluated is selected from the video frame to be evaluated under the condition that the frame rate to be evaluated is not consistent with the original frame rate; and determining time stamp information of the video frames to be evaluated, and determining original video frames near the time stamp information in the original video to form a target original video frame set based on the time stamp information. The target original video frame set in the present embodiment refers to a video frame set composed of original video frames determined in an original video based on timestamp information.
In practical application, the method for determining the target original video frame set in the original video based on the timestamp information of the video frame to be evaluated comprises the following steps:
determining at least one original video frame in the original video based on a preset video frame quantity threshold value and the timestamp information of the video frame to be evaluated;
and forming a target original video frame set by the at least one original video frame.
The preset video frame number threshold refers to a predetermined number of original video frames obtained from an original video, for example, 3 original video frames are selected from the original video.
In a specific embodiment of the present application, taking a preset video frame number threshold 2 as an example, if the timestamp information of the video to be evaluated is 3 points and 10 minutes, two original video frames near the time point of 3 points and 10 minutes are determined in the original video according to the timestamp information to form a target original video frame set.
Step 208: and calculating the video frame score of each video frame to be evaluated based on each video frame to be evaluated in the video to be evaluated and the target original video frame set corresponding to each video frame to be evaluated.
The video frame score of the video frame to be evaluated refers to the quality score of the video frame to be evaluated, which is calculated based on the original video frame and the video frame to be evaluated.
In practical application, the method for obtaining the video frame score of the video frame to be evaluated based on the video frame to be evaluated and the target original video frame set comprises the following steps:
calculating the video frame score of each video frame to be evaluated and each original video frame in the target original video frame set corresponding to each video frame to be evaluated to form a video frame score set;
and selecting a target video frame score from the video frame score set as a video frame score of the video frame to be evaluated.
The video frame score set refers to a set formed by video frame scores of original video frames; the target video frame score refers to one of the video frame scores of the original video in the video frame score set, and the video frame score with the highest score can be directly selected from the video frame score set based on actual requirements or directly selected as the video frame score of the video frame to be evaluated.
In a specific embodiment of the application, taking a video frame score of a target original video frame as an example of a highest video frame score in a video frame frequency division set, calculating a video frame score of each original video in a video frame to be evaluated and a { original video frame 1, an original video frame 2.. original video frame n } in the target original video frame set, and obtaining a video frame score set {95, 93.. n }; and determining that the video frame score 95 of the original video frame 1 is the highest video frame score in the video frame score set, and taking the video frame score of the original video frame 1 as the video frame score of the video frame to be evaluated.
Step 210: and calculating the video score of the video to be evaluated according to the video frame score of each video frame to be evaluated.
The video score refers to a video quality score of a video to be evaluated.
Specifically, each video frame in the video to be evaluated is taken as a video frame to be evaluated, and the video frame score of each video frame to be evaluated is calculated and determined; and calculating the video frame score of the video to be evaluated based on the video frame score of each video frame to be evaluated.
In practical application, calculating the video score of the video to be evaluated according to the video frame score of each video frame to be evaluated in the video to be evaluated comprises the following steps:
counting the video frame scores of each video frame to be evaluated to form a video frame score set to be evaluated;
and calculating the video score of the video to be evaluated based on a preset video scoring rule and the video frame scoring set to be evaluated.
The video frame score set to be evaluated is a set formed by video frame scores of each video frame to be evaluated in the video to be evaluated; the preset video scoring rule refers to a preset video scoring rule, for example, an average value of video frame scores in a to-be-evaluated video frame scoring set is calculated, and the calculated average value is used as a video scoring rule of a to-be-evaluated video.
In a specific embodiment of the application, taking a video to be evaluated as an example of an animation video, the animation video includes a video frame set { video frame 1, video frame 2.. video frame n }, and a video frame score of each video frame in the video frame set is counted to form a video frame score set {93, 95.. n }; and presetting a video scoring rule, namely taking the average value of the video frame scores in the video frame score set to be evaluated as the video score of the video to be evaluated, calculating the average value of the video frame scores to be 95 based on the video frame score set {93, 95.. n } to be evaluated, and taking the average value as the video score of the animation video.
According to the video quality evaluation method, the video frame score set is obtained by calculating the video frame score of each video to be evaluated in the video to be evaluated, and the score of the video to be evaluated is determined based on the video frame score set, so that the accuracy of scoring the video to be evaluated is improved.
The following description will further describe the video quality evaluation method with reference to fig. 3 by taking the application of the video evaluation method provided by the present application to game video as an example. Fig. 3 shows a processing flow chart of a video quality assessment method applied to a game video according to an embodiment of the present application, which specifically includes the following steps:
step 302: and receiving an original video, and coding the original video to obtain a video to be evaluated corresponding to the original video.
In a specific embodiment of the application, an original video is taken as a game video as an example, the game video is received, and the game video is transcoded to obtain a game video to be evaluated corresponding to the original game video.
Step 304: and determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video.
In a specific embodiment of the present application, following the above example, the video frame rate of the game video is obtained as 24fps in the video attribute information of the game video, and the video frame rate of the game video to be evaluated is determined as 25fps in the video attribute information of the game video to be evaluated.
Step 306: and comparing the frame rate to be evaluated with the original frame rate, and adjusting the original frame rate under the condition that the frame rate to be evaluated is inconsistent with the original frame rate.
Comparing a frame rate to be evaluated with an original frame rate, and adjusting the number of original video frames of an original video based on a preset video frame adjustment strategy and the frame rate to be evaluated under the condition that the frame rate to be evaluated is inconsistent with the original frame rate, wherein the specific mode is as follows: under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and adding the target original video frame to the original video; and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and deleting the target original video frame from the original video.
The specific method for determining the target original video frame in the original video comprises the following steps: calculating video frame intervals according to the original frame rate and the frame rate to be evaluated; determining at least one set of video frames in the original video based on the video frame interval; determining a video frame to be evaluated in the video to be evaluated, and determining an original video frame set in the original video based on timestamp information of the video frame to be evaluated; obtaining an original video frame score of each original video frame to be processed in the original video frame set based on the video frame to be evaluated and the original video frame set; under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining an original video frame to be processed with the highest original video frame score in the video frame set as a target original video frame; and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining the original video frame to be processed with the lowest original video frame score in the video frame set as a target original video frame.
In a specific embodiment of the application, following the above example, the video frame rate of the game video is 24fps and the video frame rate of the game video to be evaluated is 25fps, and if the video frame rate of the game video is determined to be less than the video frame rate of the game video to be evaluated, a target game video frame is determined in the video frames of the game video according to a video frame selection rule, and if the video frame interval is 24 calculated based on the video frames of the game video and the video frame rate of the game video to be evaluated, one target game video frame is copied to the game video every 24 game video frames in the game video. The method for determining the target game video frame in the original video specifically comprises the following steps: the video frame interval 24 is calculated and a set of video frames, including { X1, X2,. X24}, { X25, X26,. X48}, etc., is determined in the game video based on the video frame interval 24. Determining each video frame in the video to be evaluated as a game video frame to be evaluated, and determining a game video frame set corresponding to each video frame to be evaluated in the game video based on each video frame to be evaluated; acquiring a video frame score of each game video frame in the game video frame set based on each video frame to be evaluated and the game video frame set corresponding to each video frame to be evaluated; determining a game video frame with the highest video frame score as a target game video frame in 24 game video frames every 24 game video frames in the game video, copying the target game video frame and adding the target game video frame into the game video frame, and after the video frame is added into the game video, adjusting the video frame rate of the game video to be consistent with the video frame rate of the game video to be evaluated to obtain the game video to be adjusted.
Step 308: and adjusting the timestamp information in the original video to be adjusted according to the video to be evaluated to obtain the target original video.
In a specific embodiment of the present application, following the above example, the timestamp information of the to-be-evaluated game video is modified based on the timestamp information of the to-be-evaluated game video, so that the corresponding relationship between the timestamp information of the to-be-evaluated game video and the video frame is consistent with the corresponding relationship between the timestamp information of the to-be-evaluated game video and the video frame, and the target game video, that is, the game video with the video frame rate consistent with the to-be-evaluated game video, is obtained.
Step 310: acquiring a target original video stream of the target original video and a to-be-evaluated video stream of the to-be-evaluated video; and inputting the target original video stream and the video stream to be evaluated into a video quality evaluation module, and acquiring the video score of the video to be evaluated output by the video quality evaluation module.
In a specific embodiment of the application, following the above example, a target game video is decoded to obtain a target game video stream, and a game video to be evaluated is decoded to obtain a game video stream to be evaluated; and uploading the target game video stream and the game video stream to be evaluated to the FFmpeg integrated VMAF for quality evaluation, and obtaining the video score of the game video to be evaluated.
According to the video quality evaluation method, the video frame rate of the original video is automatically adjusted to be consistent with the video frame rate of the video to be evaluated, and then the quality of the video to be evaluated is evaluated, so that a more accurate evaluation result is obtained.
The following description will further describe the video quality evaluation method with reference to fig. 4 by taking an application of the video quality evaluation method provided by the present application to movie video as an example. Fig. 4 shows a processing flow chart of a video quality assessment method applied to a movie video according to an embodiment of the present application, which specifically includes the following steps:
step 402: and acquiring an original video and a video to be evaluated corresponding to the original video.
In a specific embodiment of the application, taking a movie video as an example, the movie video is acquired and transcoded to obtain a movie video to be evaluated corresponding to the movie video.
Step 404: and determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video.
In a specific embodiment of the present application, the video frame rate of the movie video is determined to be 25fps, and the video frame rate of the video to be evaluated is determined to be 30 fps.
Step 406: and under the condition that the frame rate to be evaluated is not consistent with the original frame rate, determining video frames to be evaluated in the video to be evaluated, and determining a target original video frame set in the original video based on a preset video frame quantity threshold and the timestamp information of the video frames to be evaluated.
In a specific embodiment of the application, following the above example, a movie video frame to be evaluated is determined in a movie video to be evaluated, timestamp information of the movie video frame to be evaluated is determined for 5 minutes and 12 seconds, and a game video frame set is formed by determining 3 game video frames near a time corresponding to the timestamp information in a game video according to the timestamp information.
Step 408: calculating the video frame scores of the video frame to be evaluated and each original video frame in the target original video frame set to form a video frame score set; and selecting a target video frame score from the video frame score set as a video frame score of the video to be evaluated.
In a specific embodiment of the application, following the above example, calculating a video frame score of each game video in a set { game video frame 1, game video frame 2, game video frame 3} of a movie video frame to be evaluated and a game video frame to obtain a video frame score set {95, 93, 97 }; the highest video frame score 97 is selected from the set of video frame scores as the video frame score for the movie video frame to be evaluated.
Step 410: counting the video frame scores of each video frame to be evaluated to form a video frame score set to be evaluated; and calculating the video score of the video to be evaluated based on a preset video scoring rule and the video frame scoring set to be evaluated.
In a specific embodiment of the present application, following the above example, the video frame score of each game video in the game video to be evaluated is calculated according to step 408 to form a game video frame score set to be evaluated; and calculating the average value of the video frame scores in the game video frame score set to be evaluated, and taking the average value as the game score of the game video to be evaluated.
According to the video quality evaluation method, the original video frames near the timestamp information in the original video are determined to be subjected to video frame scoring based on the timestamp information of the video frames to be evaluated, the highest video frame score is selected as the video frame score of the video frames to be evaluated, the average value of the video frame scores of all the video frames in the video to be evaluated is calculated as the video score of the video frames to be evaluated, and therefore accuracy in video quality evaluation of videos with different frame rates is improved.
Corresponding to the above method embodiment, the present application further provides an embodiment of a video quality assessment apparatus, and fig. 5 shows a schematic structural diagram of a video quality assessment apparatus provided in an embodiment of the present application. As shown in fig. 5, the apparatus includes:
an obtaining module 502 configured to obtain an original video and a video to be evaluated corresponding to the original video;
a first determining module 504, configured to determine a to-be-evaluated frame rate of the to-be-evaluated video and an original frame rate of the original video;
a processing module 506, configured to, when the frame rate to be evaluated is inconsistent with the original frame rate, process the original video based on a preset video frame processing policy to obtain a target original video frame set, where the target original video frame set includes at least one target original video frame;
a second determining module 508 configured to determine a video score of the video to be evaluated according to the target original video frame set and a video frame set to be evaluated corresponding to the target original video frame set.
In a specific embodiment of the present application, the processing module 506 is further configured to:
and adjusting the number of video frames of the original video based on a preset video frame adjustment strategy to obtain a target original video, wherein the target original frame rate of the target original video is consistent with the frame rate to be evaluated.
Optionally, the obtaining module 502 is further configured to:
receiving an original video;
and transcoding the original video to obtain a video to be evaluated corresponding to the original video.
Optionally, the processing module 506 is further configured to:
determining a preset video frame adjustment strategy;
and adjusting the number of original video frames of the original video based on the preset video frame adjustment strategy and the frame rate to be evaluated.
Optionally, the processing module 506 is further configured to:
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and adding the target original video frame to the original video;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and deleting the target original video frame from the original video.
Optionally, the processing module 506 is further configured to:
calculating video frame intervals according to the original frame rate and the frame rate to be evaluated;
determining at least one set of video frames in the original video based on the video frame interval;
and determining a target original video frame corresponding to each video frame interval in each video frame set according to the video frame selection rule.
Optionally, the processing module 506 is further configured to:
determining a video frame to be evaluated in the video to be evaluated, and determining an original video frame set in the original video based on timestamp information of the video frame to be evaluated;
obtaining an original video frame score of each original video frame to be processed in the original video frame set based on the video frame to be evaluated and the original video frame set;
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining an original video frame to be processed with the highest original video frame score in the video frame set as a target original video frame;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining the original video frame to be processed with the lowest original video frame score in the video frame set as a target original video frame.
Optionally, the processing module 506 is further configured to:
adjusting the original video based on a preset video frame adjustment strategy to obtain an original video to be adjusted, wherein the video frame rate of the original video to be adjusted is consistent with the frame rate to be evaluated;
and adjusting the timestamp information in the original video to be adjusted according to the video to be evaluated to obtain a target original video.
Optionally, the second determining module 508 is further configured to:
acquiring a target original video stream of the target original video and a to-be-evaluated video stream of the to-be-evaluated video;
and inputting the target original video stream and the video stream to be evaluated into a video quality evaluation module, and acquiring the video score of the video to be evaluated output by the video quality evaluation module.
The apparatus further includes an acquisition submodule configured to:
under the condition that the frame rate to be evaluated is consistent with the original frame rate, acquiring a video stream to be evaluated of the video to be evaluated and an original video stream of the original video;
and inputting the video stream to be evaluated and the original video stream to a video quality evaluation module, and acquiring the video score of the video to be evaluated, which is output by the video quality evaluation module.
Optionally, the processing module 506 is further configured to:
determining a video frame to be evaluated in the video to be evaluated;
and determining a target original video frame set corresponding to the video frame to be evaluated in the original video based on the timestamp information of the video frame to be evaluated.
Optionally, the second determining module 508 is further configured to:
calculating a video frame score of each video frame to be evaluated based on each video frame to be evaluated in the video to be evaluated and a target original video frame set corresponding to each video frame to be evaluated;
and calculating the video score of the video to be evaluated according to the video frame score of each video frame to be evaluated.
Optionally, the processing module 506 is further configured to: :
determining at least one original video frame in the original video based on a preset video frame quantity threshold value and the timestamp information of the video frame to be evaluated;
and forming a target original video frame set by the at least one original video frame.
Optionally, the processing module 506 is further configured to: :
calculating the video frame score of each video frame to be evaluated and each original video frame in the target original video frame set corresponding to each video frame to be evaluated to form a video frame score set;
and selecting a target video frame score from the video frame score set as a video frame score of the video to be evaluated.
Optionally, the second determining module 508 is further configured to:
counting the video frame scores of each video frame to be evaluated to form a video frame score set to be evaluated;
and calculating the video score of the video to be evaluated based on a preset video scoring rule and the video frame scoring set to be evaluated.
The video quality evaluation device comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring an original video and a video to be evaluated corresponding to the original video; the first determining module is used for determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video; the processing module is used for processing the original video based on a preset video frame processing strategy to obtain a target original video frame set under the condition that the frame rate to be evaluated is inconsistent with the original frame rate, wherein the target original video frame set comprises at least one target original video frame; and the second determining module is used for determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set. According to the video quality evaluation device, the original video is processed through the preset video frame processing strategy to obtain the target original video frame set, and the video to be evaluated is scored based on the target original video frame set and the corresponding video frame set to be processed, so that a more accurate evaluation result for the video to be evaluated is obtained
The above is a schematic scheme of a video quality evaluation apparatus of the present embodiment. It should be noted that the technical solution of the video quality evaluation apparatus and the technical solution of the video quality evaluation method belong to the same concept, and details that are not described in detail in the technical solution of the video quality evaluation apparatus can be referred to the description of the technical solution of the video quality evaluation method.
Fig. 6 illustrates a block diagram of a computing device 600 provided according to an embodiment of the present application. The components of the computing device 600 include, but are not limited to, a memory 610 and a processor 620. The processor 620 is coupled to the memory 610 via a bus 630 and a database 650 is used to store data.
Computing device 600 also includes access device 640, access device 640 enabling computing device 600 to communicate via one or more networks 660. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 640 may include one or more of any type of network interface (e.g., a Network Interface Card (NIC)) whether wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present application, the above-described components of computing device 600, as well as other components not shown in FIG. 6, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 6 is for purposes of example only and is not limiting as to the scope of the present application. Those skilled in the art may add or replace other components as desired.
Computing device 600 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 600 may also be a mobile or stationary server.
Wherein the processor 620, when executing the computer instructions, performs the steps of the video quality assessment method.
The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the video quality assessment method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the video quality assessment method.
An embodiment of the present application further provides a computer readable storage medium, which stores computer instructions, and the computer instructions, when executed by a processor, implement the steps of the video quality assessment method as described above.
The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the above-mentioned video quality evaluation method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the above-mentioned video quality evaluation method.
The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.
The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
The preferred embodiments of the present application disclosed above are intended only to aid in the explanation of the application. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the application and its practical applications, to thereby enable others skilled in the art to best understand and utilize the application. The application is limited only by the claims and their full scope and equivalents.
Claims (18)
1. A method for video quality assessment, comprising:
acquiring an original video and a video to be evaluated corresponding to the original video;
determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video;
under the condition that the frame rate to be evaluated is not consistent with the original frame rate, processing the original video based on a preset video frame processing strategy to obtain a target original video frame set, wherein the target original video frame set comprises at least one target original video frame;
and determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set.
2. The method of claim 1, wherein processing the original video based on a predetermined video frame processing policy to obtain a target original video frame set comprises:
and adjusting the number of video frames of the original video based on a preset video frame adjustment strategy to obtain a target original video, wherein the target original frame rate of the target original video is consistent with the frame rate to be evaluated.
3. The method for evaluating video quality according to claim 1, wherein obtaining an original video and a video to be evaluated corresponding to the original video comprises:
receiving an original video;
and transcoding the original video to obtain a video to be evaluated corresponding to the original video.
4. The video quality assessment method of claim 2, wherein adjusting the number of video frames of the original video based on a preset video frame adjustment policy comprises:
determining a preset video frame adjustment strategy;
and adjusting the number of original video frames of the original video based on the preset video frame adjustment strategy and the frame rate to be evaluated.
5. The video quality assessment method of claim 4, wherein adjusting the number of original video frames of the original video based on the preset video frame adjustment policy and the frame rate to be assessed comprises:
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and adding the target original video frame to the original video;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining a target original video frame in the original video according to a video frame selection rule, and deleting the target original video frame from the original video.
6. The video quality assessment method of claim 5, wherein determining a target original video frame in said original video according to a video frame selection rule comprises:
calculating video frame intervals according to the original frame rate and the frame rate to be evaluated;
determining at least one set of video frames in the original video based on the video frame interval;
and determining a target original video frame corresponding to each video frame interval in each video frame set according to the video frame selection rule.
7. The method of claim 6, wherein determining the target original video frame corresponding to each video frame interval in each video frame set according to the video frame selection rule comprises:
determining a video frame to be evaluated in the video to be evaluated, and determining an original video frame set in the original video based on timestamp information of the video frame to be evaluated;
obtaining an original video frame score of each original video frame to be processed in the original video frame set based on the video frame to be evaluated and the original video frame set;
under the condition that the original frame rate is smaller than the frame rate to be evaluated, determining an original video frame to be processed with the highest original video frame score in the video frame set as a target original video frame;
and under the condition that the original frame rate is greater than the frame rate to be evaluated, determining the original video frame to be processed with the lowest original video frame score in the video frame set as a target original video frame.
8. The method of claim 2, wherein the adjusting the number of video frames of the original video based on a preset video frame adjustment policy to obtain a target original video comprises:
adjusting the original video based on a preset video frame adjustment strategy to obtain an original video to be adjusted, wherein the video frame rate of the original video to be adjusted is consistent with the frame rate to be evaluated;
and adjusting the timestamp information in the original video to be adjusted according to the video to be evaluated to obtain a target original video.
9. The method of claim 2, wherein determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set comprises:
acquiring a target original video stream of the target original video and a to-be-evaluated video stream of the to-be-evaluated video;
and inputting the target original video stream and the video stream to be evaluated into a video quality evaluation module, and acquiring the video score of the video to be evaluated output by the video quality evaluation module.
10. The method according to any one of claims 1 to 8, wherein after determining the frame rate to be evaluated of the video to be evaluated and the original frame rate of the original video, the method further comprises:
under the condition that the frame rate to be evaluated is consistent with the original frame rate, acquiring a video stream to be evaluated of the video to be evaluated and an original video stream of the original video;
and inputting the video stream to be evaluated and the original video stream to a video quality evaluation module, and acquiring the video score of the video to be evaluated, which is output by the video quality evaluation module.
11. The method of claim 1, wherein processing the original video based on a predetermined video frame processing policy to obtain a target original video frame set comprises:
determining a video frame to be evaluated in the video to be evaluated;
and determining a target original video frame set corresponding to the video frame to be evaluated in the original video based on the timestamp information of the video frame to be evaluated.
12. The method of claim 11, wherein determining the video score of the video to be evaluated according to the target original video frame set and the video frame set to be evaluated corresponding to the target original video frame set comprises:
calculating a video frame score of each video frame to be evaluated based on each video frame to be evaluated in the video to be evaluated and a target original video frame set corresponding to each video frame to be evaluated;
and calculating the video score of the video to be evaluated according to the video frame score of each video frame to be evaluated.
13. The method of claim 11, wherein determining a target original video frame set corresponding to the video frame to be evaluated in the original video based on the timestamp information of the video frame to be evaluated comprises:
determining at least one original video frame in the original video based on a preset video frame quantity threshold value and the timestamp information of the video frame to be evaluated;
and forming a target original video frame set by the at least one original video frame.
14. The method of claim 12, wherein calculating the video frame score of each video frame to be evaluated based on each video frame to be evaluated in the video to be evaluated and a target original video frame set corresponding to each video frame to be evaluated comprises:
calculating the video frame score of each video frame to be evaluated and each original video frame in the target original video frame set corresponding to each video frame to be evaluated to form a video frame score set;
and selecting a target video frame score from the video frame score set as a video frame score of the video to be evaluated.
15. The video quality assessment method of claim 12, wherein calculating the video score of the video to be assessed from the video frame score of each video frame to be assessed comprises:
counting the video frame scores of each video frame to be evaluated to form a video frame score set to be evaluated;
and calculating the video score of the video to be evaluated based on a preset video scoring rule and the video frame scoring set to be evaluated.
16. A video quality assessment apparatus, comprising:
the system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is configured to acquire an original video and a video to be evaluated corresponding to the original video;
a first determining module configured to determine a to-be-evaluated frame rate of the to-be-evaluated video and an original frame rate of the original video;
the processing module is configured to process the original video based on a preset video frame processing strategy to obtain a target original video frame set under the condition that the frame rate to be evaluated is inconsistent with the original frame rate, wherein the target original video frame set comprises at least one target original video frame;
a second determining module configured to determine a video score of the video to be evaluated according to the target original video frame set and a video frame set to be evaluated corresponding to the target original video frame set.
17. A computing device comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1-15 when executing the computer instructions.
18. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111205034.0A CN113949899B (en) | 2021-10-15 | 2021-10-15 | Video quality assessment method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111205034.0A CN113949899B (en) | 2021-10-15 | 2021-10-15 | Video quality assessment method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113949899A true CN113949899A (en) | 2022-01-18 |
| CN113949899B CN113949899B (en) | 2024-03-12 |
Family
ID=79330877
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111205034.0A Active CN113949899B (en) | 2021-10-15 | 2021-10-15 | Video quality assessment method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113949899B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114760506A (en) * | 2022-04-11 | 2022-07-15 | 北京字跳网络技术有限公司 | Video transcoding evaluation method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016096396A (en) * | 2014-11-12 | 2016-05-26 | 日本電信電話株式会社 | Video quality identity determination device, method, and program |
| CN109743591A (en) * | 2019-01-04 | 2019-05-10 | 广州虎牙信息科技有限公司 | The method of video frame alignment |
| CN110290421A (en) * | 2019-08-01 | 2019-09-27 | 北京达佳互联信息技术有限公司 | Frame per second method of adjustment, device, computer equipment and storage medium |
| CN112714309A (en) * | 2020-12-22 | 2021-04-27 | 北京百度网讯科技有限公司 | Video quality evaluation method, device, apparatus, medium, and program product |
-
2021
- 2021-10-15 CN CN202111205034.0A patent/CN113949899B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016096396A (en) * | 2014-11-12 | 2016-05-26 | 日本電信電話株式会社 | Video quality identity determination device, method, and program |
| CN109743591A (en) * | 2019-01-04 | 2019-05-10 | 广州虎牙信息科技有限公司 | The method of video frame alignment |
| CN110290421A (en) * | 2019-08-01 | 2019-09-27 | 北京达佳互联信息技术有限公司 | Frame per second method of adjustment, device, computer equipment and storage medium |
| CN112714309A (en) * | 2020-12-22 | 2021-04-27 | 北京百度网讯科技有限公司 | Video quality evaluation method, device, apparatus, medium, and program product |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114760506A (en) * | 2022-04-11 | 2022-07-15 | 北京字跳网络技术有限公司 | Video transcoding evaluation method, device, equipment and storage medium |
| CN114760506B (en) * | 2022-04-11 | 2024-02-09 | 北京字跳网络技术有限公司 | Video transcoding evaluation method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113949899B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3793142B2 (en) | Moving image processing method and apparatus | |
| JP2020010331A (en) | Method for improving image quality | |
| US10771789B2 (en) | Complexity adaptive rate control | |
| Yu et al. | Predicting the quality of compressed videos with pre-existing distortions | |
| Lee et al. | A subjective and objective study of space-time subsampled video quality | |
| CN110225340B (en) | Control method and device for video coding, computing equipment and storage medium | |
| US11259029B2 (en) | Method, device, apparatus for predicting video coding complexity and storage medium | |
| Zhang et al. | Satisfied-user-ratio modeling for compressed video | |
| US20220188357A1 (en) | Video generating method and device | |
| CN111182300B (en) | Method, device and equipment for determining coding parameters and storage medium | |
| US20240031609A1 (en) | Pixel Filtering for Content | |
| CN113748683A (en) | System and method for preserving in-band metadata in compressed video files | |
| CN112435244A (en) | Live video quality evaluation method and device, computer equipment and storage medium | |
| Wen et al. | Subjective and objective quality assessment of mobile gaming video | |
| CN113949899B (en) | Video quality assessment method and device | |
| CN113079406A (en) | Video processing method and device | |
| CN116170650A (en) | Video frame inserting method and device | |
| Göring et al. | Cencro-speedup of video quality calculation using center cropping | |
| CN110545418A (en) | Self-adaptive video coding method based on scene | |
| CN114554211A (en) | Content adaptive video coding method, device, equipment and storage medium | |
| CN114363703A (en) | Video processing method, device and system | |
| CN114173160A (en) | Live broadcast stream pushing method and device | |
| CN113316001B (en) | Video alignment method and device | |
| Sinno et al. | Quality measurement of images on mobile streaming interfaces deployed at scale | |
| Saha et al. | Perceptual Video Quality Assessment: The Journey Continues! |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |