CN113055667B - Video quality detection method and device, electronic equipment and storage medium - Google Patents
Video quality detection method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113055667B CN113055667B CN202110347955.4A CN202110347955A CN113055667B CN 113055667 B CN113055667 B CN 113055667B CN 202110347955 A CN202110347955 A CN 202110347955A CN 113055667 B CN113055667 B CN 113055667B
- Authority
- CN
- China
- Prior art keywords
- video
- picture
- stage
- video frame
- recording
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention discloses a video quality detection method, a device, electronic equipment and a storage medium, wherein the method comprises the following steps: setting a marking mode for a video playing system; obtaining a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage of a media stream corresponding to a video source in a marking mode; and detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream. The method has the advantages that the corresponding pictures of the same marked video frame in the video source in the recording stage, the conversion stage and the transmission stage are detected, the video quality detection result is directly obtained, a large amount of manpower is not required to be consumed, whether the video has problems or not is determined by looking back the video file, and even if the video has problems, the reasons for the problems can be directly obtained according to the video quality detection result, so that the time cost is saved.
Description
Technical Field
The embodiment of the invention relates to the technical field of data processing, in particular to a video quality detection method, a video quality detection device, electronic equipment and a storage medium.
Background
At present, the distributed memory can record multiple paths of video sources at the same time so as to realize the functions of meeting playback, backtracking and monitoring sites and the like. Fig. 1 is a schematic diagram of a recording system of a multi-channel video source based on a distributed storage system, a terminal transmits a set video recording scheme to a central server, the distributed storage server records a target video after acquiring the video recording scheme notified by the central server, and generates a video file according to a recorded and acquired media stream and stores the video file, and the terminal acquires the video file according to a storage address notified by the central server and plays the video file.
However, in the recording scheme in the prior art, only the video file is played back completely through the terminal, the video quality of the video is detected in a subjective judgment mode after the video file is observed manually, and whether a problem occurs is determined, so that a large amount of labor cost is consumed; and when it is determined that the video quality of the video file is problematic, the causes of the problem need to be checked one by one, thereby consuming a great deal of time and cost. Thus, the existing recording scheme consumes large labor cost and time cost when detecting video quality.
Disclosure of Invention
The embodiment of the invention provides a video quality detection method, a video quality detection device, electronic equipment and a storage medium, so as to realize rapid detection of video quality.
In a first aspect, an embodiment of the present invention provides a video quality detection method, including: setting a marking mode for a video playing system, wherein the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal;
obtaining a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage respectively according to the marking mode of the media stream corresponding to the video source;
and detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
In a second aspect, an embodiment of the present invention provides a video quality detection apparatus, including:
the system comprises a marking mode setting module, a marking mode setting module and a marking module, wherein the marking mode setting module is used for setting a marking mode for a video playing system, the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal;
the image acquisition module is used for acquiring a first image, a second image and a third image corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage respectively according to the media stream corresponding to the video source in the marking mode;
the video quality detection module is used for detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
In a third aspect, an embodiment of the present invention provides an electronic device, including:
one or more processors;
storage means for storing one or more programs,
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the methods as described above.
In a fourth aspect, embodiments of the present invention provide a computer readable storage medium having stored thereon a computer program, characterized in that the program when executed by a processor implements a method as described above.
According to the technical scheme provided by the embodiment of the invention, the corresponding pictures of the same marked video frame in the video source in the recording stage, the conversion stage and the transmission stage are detected, so that the video quality detection result is directly obtained, a large amount of manpower is not required to be consumed, whether the video has a problem or not is determined by looking back the video file, and even if the video has the problem, the reason for the problem can be directly obtained according to the video quality detection result, so that the time cost is saved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a prior art recording system for multiple video sources based on a distributed storage system;
fig. 2 is a flowchart of a video quality detection method according to a first embodiment of the present invention;
fig. 3 is a schematic view of an application scenario of video quality detection according to a first embodiment of the present invention;
fig. 4 is a flowchart of a video quality detection method according to a second embodiment of the present invention;
fig. 5 is a schematic structural diagram of a video quality detecting apparatus according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
It should be further noted that, for convenience of description, only some, but not all of the matters related to the present invention are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, software implementations, hardware implementations, etc.
Example 1
Fig. 2 is a flowchart of a video quality detection method according to an embodiment of the present invention, where the embodiment is applicable to a case of detecting video quality transmitted by a distributed storage system, the method may be performed by a video quality detection apparatus according to an embodiment of the present invention, and the apparatus may be implemented in software and/or hardware. As shown in fig. 2, the method specifically includes the following operations:
step S101, a marking mode is set for a video playing system.
The video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal. The video quality detection device in this embodiment may be specifically installed on a central server in a video playback system.
Optionally, setting a marking mode for the video playing system may include: acquiring a video recording mode sent by a terminal, wherein the video recording mode comprises the duration of recording a specified video source by a distributed storage system; and determining a marking mode according to the video recording mode, wherein the marking mode comprises the interval time of adding marks to the video frames.
Specifically, the video quality detection device installed on the central server in this embodiment can monitor the recording system of the multi-channel video source based on the distributed storage system shown in fig. 1 in real time. The terminal may set a recording mode, for example, when the video source includes four cameras, the set recording mode may specifically be to record the video for 24 hours on the camera 1, the camera 2, the camera 3 and the camera 4 in the video source, and the terminal sends the set recording mode to the central server. After the video quality detection device obtains the video recording mode sent by the terminal, a marking mode is determined according to the video recording mode, for example, the marking mode is specifically to add marks to video frames in a corresponding media stream in a video source every half an hour after determining that the distributed storage server starts video recording according to the video recording mode, and the specific interval time for adding the marks is not limited in this embodiment.
Step S102, a first picture, a second picture and a third picture corresponding to the same marked video frame in a recording stage, a conversion stage and a transmission stage of a media stream corresponding to a video source are obtained in a marking mode.
Optionally, obtaining, according to a marking manner, a first picture, a second picture, and a third picture corresponding to a video frame with a mark added in the same recording stage, the conversion stage, and the transmission stage, where the first picture, the second picture, and the third picture correspond to a video frame with a mark added in the same manner, may include: in a recording stage of recording a video source by a distributed storage server, adding marks to a recorded and acquired media stream according to a marking mode, and decoding each marked video frame in the media stream into a first picture; in a conversion stage of converting the marked media stream into a complete video file by the distributed storage server, decoding a sub video file corresponding to each marked video frame in the complete video file into a second picture; and in the transmission stage that the distributed storage server sends the complete video file to the terminal, acquiring the complete received file of the terminal, and decoding the sub-received file corresponding to each marked video frame in the complete received file into a third picture.
Optionally, in a recording stage of the video source recorded by the distributed storage server, adding a mark to the recorded and obtained media stream according to a marking mode may include: in the recording stage of the video source recorded by the distributed storage server, determining a designated video frame according to the interval time; and adding marks to the appointed video frames in the media stream, wherein each mark corresponds to a different adding moment respectively.
Specifically, as shown in fig. 3, which is a schematic diagram of an application scenario of video quality detection, it can be seen that three stages, namely a recording stage, a conversion stage and a transmission stage, are required for displaying a media stream of a video source to a terminal. When the video quality detection device monitors that the distributed storage server starts recording according to the video recording mode sent by the terminal, namely, in the recording stage shown in fig. 3, marks are added to the recorded and acquired media stream according to the set marking mode, specifically, specified video frames are determined according to the interval time, marks are added to the specified video frames in the media stream, and each mark corresponds to different adding moments. For example, every half an hour of tagging video frames in a corresponding media stream in a video source, as a, b, c, d, e and f in fig. 3 represent tagged video frames in the media stream, respectively, and tagged video frames may appear in all three phases described above, each tagged video frame in the media stream being decoded as a first picture, e.g., tagged video frame a being decoded as a first picture.
After the distributed storage server is monitored to convert the marked media stream into the complete video file, the video quality detection device decodes a sub video file corresponding to each marked video frame in the complete video file into a second picture, for example, decodes a sub video file corresponding to the marked video frame a into the second picture.
The distributed storage server stores the obtained video files after the conversion stage is completed, the central server transmits the playing addresses of the video files to the terminal, and the terminal obtains the video files from the received playing addresses. Therefore, when the video quality detection device monitors that the video quality detection device is currently in the transmission stage of the distributed storage server transmitting the complete video file to the terminal, the complete receiving file of the terminal is obtained, and the sub receiving file corresponding to each marked video frame in the complete receiving file is decoded into a third picture, for example, the sub receiving file corresponding to the marked video frame a is decoded into the third picture.
It should be noted that, since each specified video frame is already marked during the recording stage, each mark corresponds to a different adding time, i.e. a time stamp, and the time stamp marked by each specified video frame during the subsequent transmission and processing remains unchanged. The video quality detection device installed on the central server can monitor each stage of the recording system of the multi-channel video source in real time, can acquire a picture processing result of each stage, and can acquire a first picture, a second picture and a third picture which respectively correspond to the same video frame in different stages according to the timestamp carried in the processing result of each stage.
Step S103, detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
Optionally, detecting the first picture, the second picture, and the third picture corresponding to the same tagged video frame to obtain a video quality detection result corresponding to the media stream may include: calculating structural similarity SSIM characteristic values of a first picture, a second picture and a third picture corresponding to the same marked video frame; determining a distortion stage of each tagged video frame according to the SSIM feature values, wherein the distortion stage comprises a conversion stage or a transmission stage; and obtaining a video quality detection result corresponding to the media stream according to the distortion stage of each marked video frame.
Optionally, the recording stage, the converting stage and the transmitting stage are respectively sequentially adjacent stages; determining a distortion stage for each tagged video frame based on the SSIM feature values, comprising: determining that the SSIM characteristic value of the picture corresponding to each adjacent stage of the video frame added with the mark is equal to a preset threshold value, and determining that the video frame added with the mark has no image distortion; and determining that the SSIM characteristic values of pictures corresponding to the same marked video frame in two adjacent stages are smaller than a preset threshold, and determining that the distortion stage of the marked video frame is the later stage in the adjacent stages.
The preset threshold in this embodiment may be specifically set to a value of 1, so determining, according to the SSIM feature value, a distortion stage of each tagged video frame may include: when the SSIM characteristic values of the first picture and the second picture are determined to be 1 and the SSIM characteristic values of the second picture and the third picture are determined to be 1, determining that the marked video frame has no image distortion; when the SSIM characteristic values of the first picture and the second picture are determined to be 1 and the SSIM characteristic values of the second picture and the third picture are determined to be less than 1, determining a distortion stage of the video frame added with the mark as a transmission stage; when the SSIM characteristic values of the first picture and the second picture are less than 1 and the SSIM characteristic values of the second picture and the third picture are 1, determining a distortion stage of the video frame added with the mark as a conversion stage; and when the SSIM characteristic values of the first picture and the second picture are smaller than 1 and the SSIM characteristic values of the second picture and the third picture are smaller than 1, determining that the distortion stage of the video frame added with the mark is a transmission stage and a conversion stage.
Optionally, the video quality detection result includes: and the first picture, the SSIM characteristic value and the distortion stage corresponding to each marked video frame are added.
Specifically, in the process of obtaining the video quality detection result corresponding to the media stream in this embodiment, the video quality detection result corresponding to the media stream is obtained by comparing pictures obtained by decoding video frames added with the same mark at different stages, and specifically by calculating a Structural similarity (Structural SIMilarity, SSIM) feature value between the pictures, determining a distortion stage of each video frame added with the mark according to the SSIM feature value, and specifically obtaining the video quality detection result corresponding to the media stream according to the distortion stage of each video frame added with the mark. And specifically calculates SSIM eigenvalues between two images using the following formula (1):
wherein SSIM (x, y) is the characteristic value of structural similarity between the images x and y, mu x Sum mu y Sigma, the mean of the images x and y x Sum sigma y Sigma, the standard deviation of images x and y xy Covariance between images x and y. And the SSIM feature value is a number between 0 and 1, the larger the difference between the two images is smaller, namely the better the image quality is, and when the two images are identical, the SSIM value is 1.
For example, when determining the distortion stage of the video frame to which the mark a is added based on the SSIM feature value obtained in the formula (1), it may include: when it is determined that the SSIM feature value of the first picture and the second picture corresponding to the video frame added with the mark a is 1, and the SSIM feature value of the second picture and the third picture corresponding to the video frame added with the mark a is 1, that is, the pictures corresponding to the video frame added with the mark a between the recording stage and the conversion stage and between the conversion stage and the transmission stage in the adjacent stage are identical, it can be determined that the video frame added with the mark a has no image distortion.
When it is determined that the SSIM feature value of the first picture and the second picture corresponding to the video frame added with the mark a is 1 and the SSIM feature value of the second picture and the third picture corresponding to the video frame added with the mark a is less than 1, it is determined that the pictures corresponding to the video frame added with the mark a between the recording stage and the conversion stage of the adjacent stage are identical, but the pictures corresponding to the video frame added with the mark a between the conversion stage and the transmission stage of the adjacent stage are different, so that it is determined that the distortion stage of the video frame added with the mark a is the transmission stage.
When it is determined that the SSIM feature value of the first picture and the second picture corresponding to the video frame added with the mark a is smaller than 1 and the SSIM feature value of the second picture and the third picture corresponding to the video frame added with the mark a is 1, it is determined that the pictures corresponding to the video frame added with the mark a between the recording stage and the conversion stage of the adjacent stage are different, but the pictures corresponding to the video frame added with the mark a between the conversion stage and the transmission stage of the adjacent stage are the same, so that it can be determined that the distortion stage of the video frame added with the mark a is the conversion stage.
When it is determined that the SSIM feature value of the first picture and the second picture corresponding to the video frame added with the mark a is smaller than 1 and the SSIM feature value of the second picture and the third picture corresponding to the video frame added with the mark a is also smaller than 1, it is determined that the pictures corresponding to the video frame added with the mark a between the recording stage and the conversion stage in the adjacent stage are different and the pictures corresponding to the video frame added with the mark a between the conversion stage and the transmission stage in the adjacent stage are the same, so that it is determined that the distortion stage of the video frame added with the mark a is the transmission stage and the conversion stage.
It should be noted that, the foregoing is merely illustrative of an example in which the video frame added with the mark a is compared with the picture obtained by decoding at different stages to obtain the distortion stage, and the manner of determining the distortion stage for the video frame added with other marks is substantially the same as that, which is not described in detail in this embodiment. When the video quality detection result corresponding to the media stream is obtained, specifically, determining a first picture, an SSIM feature value and a distortion stage corresponding to each marked video frame, for example, when the media stream includes two marked video frames, namely, a marked video frame a and a marked video frame B, the name of the first picture corresponding to the marked video frame a is an a picture, and the name of the first picture corresponding to the marked video frame B is a B picture, the video frame quality detection result corresponding to the media stream can be obtained: a picture a, SSIM1<1, ssim2=1, and the distortion stage is a conversion stage; b pictures, SSIM1<1, ssim2=1, distortion stage is the transition stage. Wherein, SSIM1 represents the structural similarity feature value between the pictures obtained in the recording stage and the converting stage, and SSIM2 represents the structural similarity feature value between the pictures obtained in the converting stage and the transmitting stage. A user can more intuitively and rapidly acquire whether a media stream corresponding to a video source has a problem or not and a specific cause of the problem by checking a video quality detection result.
According to the technical scheme provided by the embodiment of the invention, the corresponding pictures of the same marked video frame in the video source in the recording stage, the conversion stage and the transmission stage are detected, so that the video quality detection result is directly obtained, a large amount of manpower is not required to be consumed, whether the video has a problem or not is determined by looking back the video file, and even if the video has the problem, the reason for the problem can be directly obtained according to the video quality detection result, so that the time cost is saved.
Example two
Fig. 4 is a flowchart of a video quality detection method according to an embodiment of the present invention, where the embodiment is based on the above embodiment, after obtaining a video quality detection result corresponding to a media stream, the video quality detection result may be further checked, and an alarm prompt is performed when an abnormality is determined. The method of the embodiment specifically comprises the following operations:
in step S201, a marking mode is set for a video playing system, where the video playing system includes a central server, a distributed storage server connected with the central server, a video source and a terminal.
Optionally, setting a marking mode for the video playing system may include: acquiring a video recording mode sent by a terminal, wherein the video recording mode comprises the duration of recording a specified video source by a distributed storage system; and determining a marking mode according to the video recording mode, wherein the marking mode comprises the interval time of adding marks to the video frames.
Step S202, a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage of a media stream corresponding to a video source are obtained according to a marking mode.
Optionally, obtaining, according to a marking manner, a first picture, a second picture, and a third picture corresponding to a video frame with a mark added in the same recording stage, the conversion stage, and the transmission stage, where the first picture, the second picture, and the third picture correspond to a video frame with a mark added in the same manner, may include: in a recording stage of recording a video source by a distributed storage server, adding marks to a recorded and acquired media stream according to a marking mode, and decoding each marked video frame in the media stream into a first picture; in a conversion stage of converting the marked media stream into a complete video file by the distributed storage server, decoding a sub video file corresponding to each marked video frame in the complete video file into a second picture; and in the transmission stage that the distributed storage server sends the complete video file to the terminal, acquiring the complete received file of the terminal, and decoding the sub-received file corresponding to each marked video frame in the complete received file into a third picture.
Optionally, in a recording stage of the video source recorded by the distributed storage server, adding a mark to the recorded and obtained media stream according to a marking mode may include: in the recording stage of the video source recorded by the distributed storage server, determining a designated video frame according to the interval time; and adding marks to the appointed video frames in the media stream, wherein each mark corresponds to a different adding moment respectively.
Step S203, detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
Optionally, detecting the first picture, the second picture, and the third picture corresponding to the same tagged video frame to obtain a video quality detection result corresponding to the media stream may include: calculating structural similarity SSIM characteristic values of a first picture, a second picture and a third picture corresponding to the same marked video frame; determining a distortion stage of each tagged video frame according to the SSIM feature values, wherein the distortion stage comprises a conversion stage or a transmission stage; and obtaining a video quality detection result corresponding to the media stream according to the distortion stage of each marked video frame.
Optionally, the video quality detection result includes: and the first picture, the SSIM characteristic value and the distortion stage corresponding to each marked video frame are added.
Step S204, checking the video quality detection result, and carrying out alarm prompt under the condition of abnormality determination.
Specifically, after the video quality detection result is obtained, the detection result is also checked, and when the video quality detection result includes: the name of the first picture corresponding to the video frame added with the mark a is an A picture, SSIM1 is less than 1, SSIM2=1, the distortion stage is a conversion stage, a user can determine the playing time corresponding to the video frame added with the mark a according to a marking mode, and by watching the playing content on the terminal, when the terminal plays normally at the playing time, the video quality detection result is determined to be inconsistent with the actual situation, so that the obtained video quality detection result can be determined to be abnormal in verification; in addition, when a disorder code exists in the video quality detection result, the obtained video quality detection result is also described as abnormal in verification. The reason for the verification exception may be that the data processing process is incorrect, for example, SSIM eigenvalue calculation is incorrect; or the data transmission process is wrong, for example, the media stream cannot be accurately acquired through monitoring due to the network communication terminal. When the condition of abnormal verification is determined, an alarm prompt can be timely generated, particularly a voice prompt or a picture prompt can be adopted, the specific form of the alarm prompt is not limited in the embodiment, and a user is reminded to carry out fault detection or carry out video quality detection again so as to ensure the accuracy of video detection.
According to the technical scheme provided by the embodiment of the invention, the corresponding pictures of the same marked video frame in the video source in the recording stage, the conversion stage and the transmission stage are detected, so that the video quality detection result is directly obtained, a large amount of manpower is not required to be consumed, whether the video has a problem or not is determined by looking back the video file, and even if the video has the problem, the reason for the problem can be directly obtained according to the video quality detection result, so that the time cost is saved. By checking the video quality detection result, the alarm is timely given under the condition of abnormality determination, thereby ensuring the accuracy of video detection.
Example III
Fig. 5 is a schematic structural diagram of a video quality detection apparatus according to an embodiment of the present invention, where the apparatus includes: the system comprises a marking mode setting module 310, a picture acquisition module 320 and a video quality detection module 330.
The marking mode setting module 310 is configured to set a marking mode for a video playing system, where the video playing system includes a central server, a distributed storage server connected with the central server, a video source and a terminal;
the image obtaining module 320 is configured to obtain, according to a marking manner, a first image, a second image, and a third image corresponding to a video frame to which a mark is added in the same manner in a recording stage, a conversion stage, and a transmission stage, respectively, of a media stream corresponding to a video source;
the video quality detection module 330 is configured to detect a first picture, a second picture, and a third picture corresponding to the same marked video frame, and obtain a video quality detection result corresponding to the media stream.
Optionally, the picture obtaining module 320 includes: the first picture acquisition module is used for adding marks to the recorded and acquired media stream according to a marking mode in a recording stage of a video source recorded by the distributed storage server, and decoding each marked video frame in the media stream into a first picture;
the second picture acquisition module is used for decoding the sub video files corresponding to each marked video frame in the complete video file into a second picture in the conversion stage of converting the marked media stream into the complete video file by the distributed storage server;
and the third picture acquisition module is used for acquiring the complete receiving file of the terminal in a transmission stage of transmitting the complete video file to the terminal by the distributed storage server, and decoding the sub receiving file corresponding to each marked video frame in the complete receiving file into a third picture.
Optionally, the marking mode setting module 310 is configured to obtain a video recording mode sent by the terminal, where the video recording mode includes a duration of recording the specified video source by the distributed storage system;
and determining a marking mode according to the video recording mode, wherein the marking mode comprises the interval time of adding marks to the video frames.
Optionally, the first image obtaining module includes a marking sub-module, configured to determine, at a recording stage of the video source recorded by the distributed storage server, a specified video frame according to an interval time;
and adding marks to the appointed video frames in the media stream, wherein each mark corresponds to a different adding moment respectively.
Optionally, the video quality detection module 330 is configured to calculate structural similarity SSIM feature values of the first picture, the second picture, and the third picture corresponding to the same tagged video frame;
determining a distortion stage of each tagged video frame according to the SSIM feature values, wherein the distortion stage comprises a conversion stage or a transmission stage;
and obtaining a video quality detection result corresponding to the media stream according to the distortion stage of each marked video frame.
Optionally, the recording stage, the converting stage and the transmitting stage are respectively sequentially adjacent stages; the video quality detection module 330 is further configured to determine that the SSIM feature value of the picture corresponding to each adjacent stage of the video frame added with the mark is equal to a preset threshold, and determine that no image distortion exists in the video frame added with the mark;
and determining that the SSIM characteristic values of pictures corresponding to the same marked video frame in two adjacent stages are smaller than a preset threshold, and determining that the distortion stage of the marked video frame is the later stage in the adjacent stages.
Optionally, the video quality detection result includes:
and the first picture, the SSIM characteristic value and the distortion stage corresponding to each marked video frame are added.
The device can execute the video quality detection method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method. Technical details not described in detail in this embodiment may be found in the method provided by any embodiment of the present invention.
Example IV
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention. Fig. 6 illustrates a block diagram of an exemplary electronic device 412 suitable for use in implementing embodiments of the invention. The electronic device 412 shown in fig. 6 is only an example and should not be construed as limiting the functionality and scope of use of embodiments of the invention.
As shown in fig. 6, the electronic device 412 is in the form of a general purpose computing device. Components of electronic device 412 may include, but are not limited to: one or more processors 416, a memory 428, a bus 418 that connects the various system components (including the memory 428 and the processor 416).
A program/utility 440 having a set (at least one) of program modules 442 may be stored in, for example, memory 428, such program modules 442 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 442 generally perform the functions and/or methodologies in the described embodiments of the invention.
The electronic device 412 may also communicate with one or more external devices 414 (e.g., keyboard, pointing device, display 424, etc.), one or more devices that enable a user to interact with the electronic device 412, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 412 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 422. Also, the electronic device 412 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through the network adapter 420. As shown, network adapter 420 communicates with other modules of electronic device 412 over bus 418. It should be appreciated that although not shown in fig. 6, other hardware and/or software modules may be used in connection with electronic device 412, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processor 416 executes instructions stored in the memory 428 to perform various functional applications and data processing, such as implementing the video quality detection methods provided by embodiments of the present invention: setting a marking mode for a video playing system, wherein the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal; obtaining a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage of a media stream corresponding to a video source in a marking mode; and detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
Example five
Embodiments of the present invention provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements a video quality detection method as provided by all inventive embodiments of the present application:
setting a marking mode for a video playing system, wherein the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal; obtaining a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage of a media stream corresponding to a video source in a marking mode; and detecting the first picture, the second picture and the third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream.
Any combination of one or more computer readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (9)
1. A method for detecting video quality, comprising:
setting a marking mode for a video playing system, wherein the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal;
obtaining a first picture, a second picture and a third picture corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage respectively according to the marking mode of the media stream corresponding to the video source;
detecting a first picture, a second picture and a third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream;
the method for setting the marking mode for the video playing system comprises the following steps: acquiring a video recording mode sent by a terminal, wherein the video recording mode comprises the duration of recording a specified video source by the distributed storage server;
and determining a marking mode according to the video recording mode, wherein the marking mode comprises the interval time of adding marks to the video frames.
2. The method of claim 1, wherein the obtaining, according to the marking manner, the first picture, the second picture, and the third picture corresponding to the same marked video frame in the recording stage, the converting stage, and the transmitting stage, respectively, includes:
in the recording stage of the video source recorded by the distributed storage server, adding marks to the recorded and acquired media stream according to the marking mode, and decoding each marked video frame in the media stream into a first picture;
in a conversion stage of converting the marked media stream into a complete video file by the distributed storage server, decoding a sub video file corresponding to each marked video frame in the complete video file into a second picture;
and in a transmission stage of the distributed storage server for transmitting the complete video file to the terminal, acquiring the complete received file of the terminal, and decoding a sub-received file corresponding to each marked video frame in the complete received file into a third picture.
3. The method according to claim 2, wherein the adding a mark to the recorded and obtained media stream according to the marking mode in the recording stage of the video source recorded by the distributed storage server includes:
recording the video source in the distributed storage server, and determining a designated video frame according to the interval time;
and adding marks to the appointed video frames in the media stream, wherein each mark corresponds to a different adding moment respectively.
4. The method of claim 2, wherein detecting the first picture, the second picture, and the third picture corresponding to the same tagged video frame to obtain the video quality detection result corresponding to the media stream comprises:
calculating structural similarity SSIM characteristic values of a first picture, a second picture and a third picture corresponding to the same marked video frame;
determining a distortion stage of each tagged video frame according to the SSIM feature values, wherein the distortion stage comprises a conversion stage or a transmission stage;
and obtaining a video quality detection result corresponding to the media stream according to the distortion stage of each marked video frame.
5. The method of claim 4, wherein the recording phase, the converting phase, and the transmitting phase are each sequentially adjacent phases;
the determining a distortion stage of each tagged video frame according to the SSIM feature value includes:
determining that the SSIM characteristic value of the picture corresponding to each adjacent stage of the video frame added with the mark is equal to a preset threshold value, and determining that the video frame added with the mark has no image distortion;
and determining that the SSIM characteristic values of pictures corresponding to the same marked video frame in two adjacent stages are smaller than a preset threshold, and determining that the distortion stage of the marked video frame is the later stage in the adjacent stages.
6. The method of claim 3, wherein the video quality detection result comprises:
and the first picture, the SSIM characteristic value and the distortion stage corresponding to each marked video frame are added.
7. A video quality detection apparatus, comprising:
the system comprises a marking mode setting module, a marking mode setting module and a marking module, wherein the marking mode setting module is used for setting a marking mode for a video playing system, the video playing system comprises a central server, a distributed storage server connected with the central server, a video source and a terminal;
the image acquisition module is used for acquiring a first image, a second image and a third image corresponding to a video frame with the same added mark in a recording stage, a conversion stage and a transmission stage respectively according to the media stream corresponding to the video source in the marking mode;
the video quality detection module is used for detecting a first picture, a second picture and a third picture corresponding to the same marked video frame to obtain a video quality detection result corresponding to the media stream;
the marking mode setting module is used for obtaining a video recording mode sent by the terminal, wherein the video recording mode comprises the duration of recording a specified video source by the distributed storage server;
and determining a marking mode according to the video recording mode, wherein the marking mode comprises the interval time of adding marks to the video frames.
8. An electronic device, the electronic device comprising:
one or more processors;
storage means for storing one or more programs,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-6.
9. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110347955.4A CN113055667B (en) | 2021-03-31 | 2021-03-31 | Video quality detection method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110347955.4A CN113055667B (en) | 2021-03-31 | 2021-03-31 | Video quality detection method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113055667A CN113055667A (en) | 2021-06-29 |
| CN113055667B true CN113055667B (en) | 2023-05-05 |
Family
ID=76516595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110347955.4A Active CN113055667B (en) | 2021-03-31 | 2021-03-31 | Video quality detection method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113055667B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113724225B (en) * | 2021-08-31 | 2024-04-09 | 北京达佳互联信息技术有限公司 | Method and device for determining transmission quality of application program |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108012119A (en) * | 2017-12-13 | 2018-05-08 | 苏州华兴源创电子科技有限公司 | A kind of transmission method of real-time video, Transmission system and a kind of readable storage medium storing program for executing |
| CN111355950A (en) * | 2020-03-13 | 2020-06-30 | 随锐科技集团股份有限公司 | Video transmission quality detection method and system in real-time video communication |
| WO2020140665A1 (en) * | 2019-01-04 | 2020-07-09 | 深圳壹账通智能科技有限公司 | Method and apparatus for quality detection of double-recorded video, and computer device and storage medium |
| CN111953939A (en) * | 2020-07-31 | 2020-11-17 | 中标慧安信息技术股份有限公司 | Method and system for improving monitoring video evidence storage accuracy |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113873226A (en) * | 2021-09-13 | 2021-12-31 | 深圳市欢太科技有限公司 | Encoding and decoding quality testing method and device, computer equipment and storage medium |
-
2021
- 2021-03-31 CN CN202110347955.4A patent/CN113055667B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108012119A (en) * | 2017-12-13 | 2018-05-08 | 苏州华兴源创电子科技有限公司 | A kind of transmission method of real-time video, Transmission system and a kind of readable storage medium storing program for executing |
| WO2020140665A1 (en) * | 2019-01-04 | 2020-07-09 | 深圳壹账通智能科技有限公司 | Method and apparatus for quality detection of double-recorded video, and computer device and storage medium |
| CN111355950A (en) * | 2020-03-13 | 2020-06-30 | 随锐科技集团股份有限公司 | Video transmission quality detection method and system in real-time video communication |
| CN111953939A (en) * | 2020-07-31 | 2020-11-17 | 中标慧安信息技术股份有限公司 | Method and system for improving monitoring video evidence storage accuracy |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113055667A (en) | 2021-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110764945B (en) | Crash log processing method, device, equipment and storage medium | |
| US8060795B2 (en) | Solution for automatically incorporating diagnostic data within screen capture images | |
| US8527950B2 (en) | Verification of software applications | |
| US20100057405A1 (en) | Automated software testing environment | |
| CN110267083B (en) | Audio and video synchronization detection method, device, equipment and storage medium | |
| CN111796978B (en) | Interface detection method, device, system, equipment and storage medium | |
| CN108874665A (en) | A kind of test result method of calibration, device, equipment and medium | |
| CN111949509B (en) | Response time testing method, device and equipment of application software and storage medium | |
| CN111812545B (en) | Line defect detection method, device, equipment and medium | |
| CN110990842A (en) | Recurrence method and device of small probability event, storage medium and electronic equipment | |
| CN113055667B (en) | Video quality detection method and device, electronic equipment and storage medium | |
| CN112422849A (en) | Welding abnormal data acquisition method and device, electronic equipment and storage medium | |
| CN114003473A (en) | Page operation behavior backtracking method and device and electronic equipment | |
| CN113824987B (en) | Method, medium, device and computing equipment for determining time consumption of first frame of live broadcasting room | |
| CN111274130A (en) | Automatic testing method, device, equipment and storage medium | |
| US20140289710A1 (en) | Monitoring software execution | |
| CN108399128A (en) | A kind of generation method of user data, device, server and storage medium | |
| CN113252678A (en) | Appearance quality inspection method and equipment for mobile terminal | |
| CN113160726B (en) | Power-on self-detection method and power-on self-detection device | |
| CN113068021B (en) | Delay testing method, device, equipment and storage medium | |
| CN110134601A (en) | A kind of software pressure surveys coverage measure method, system, medium and electronic equipment | |
| CN110806981B (en) | Application program testing method, device, equipment and storage medium | |
| CN111262727B (en) | Service capacity expansion method, device, equipment and storage medium | |
| CN116820946B (en) | Method and device for automatically testing compatibility of target software | |
| CN111562974A (en) | Method, device and equipment for acquiring offline data and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |