CN111263189B - Video quality detection method and device and computer equipment - Google Patents
Video quality detection method and device and computer equipment Download PDFInfo
- Publication number
- CN111263189B CN111263189B CN202010120954.1A CN202010120954A CN111263189B CN 111263189 B CN111263189 B CN 111263189B CN 202010120954 A CN202010120954 A CN 202010120954A CN 111263189 B CN111263189 B CN 111263189B
- Authority
- CN
- China
- Prior art keywords
- detection result
- duration
- time length
- audio quality
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 248
- 230000002159 abnormal effect Effects 0.000 claims abstract description 70
- 238000000034 method Methods 0.000 claims abstract description 26
- 238000012544 monitoring process Methods 0.000 claims abstract description 20
- 238000004590 computer program Methods 0.000 claims description 25
- 230000005856 abnormality Effects 0.000 claims description 9
- 238000013075 data extraction Methods 0.000 claims description 5
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 230000001360 synchronised effect Effects 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The application relates to a video quality detection method, a video quality detection device, a computer device and a storage medium. Based on an audio detection technique, the method comprises: when the beginning of video recording is detected, acquiring a to-be-detected video segment with preset recording duration in real time; extracting audio data contained in a video segment to be detected; detecting the duration of the audio data according to the format information of the audio data; carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain a time length detection result; analyzing the audio data to obtain pulse code modulation data; performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result; and monitoring video recording according to the time length detection result and the audio quality detection result. The abnormal condition of recording can be timely reminded, adjustment can be timely made, the problem that the quality of video recording is poor, so that the video is recorded again is avoided, and the video recording efficiency is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a video quality detection method and apparatus, a computer device, and a storage medium.
Background
With the continuous development of the computer field, it is also very convenient for users to record videos, and videos can be recorded only by one mobile phone, so that many short videos are applied in many fields, such as: the user can record and share things happening nearby. When information acquisition is needed, the video acquisition can be completed in a mode that the short video is uploaded by the acquired person.
However, when a user records a video at present, due to the version of each software or the problem of a terminal system, the video picture and the audio data in the video are not aligned, and even the problem that the audio data is not recorded occurs. If the user does not click to check whether the recorded video is normal before uploading, the problem of the quality of the video is difficult to find.
At present, a user can only click to play to check after recording a video, and if the video is abnormal, the whole video is recorded again, so that the video recording efficiency is generally low.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a video quality detection method, apparatus, computer device and storage medium for improving efficiency of video recording.
A video quality detection method, the method comprising:
when the beginning of video recording is detected, acquiring a to-be-detected video segment with preset recording duration in real time;
extracting audio data contained in the video segment to be detected;
detecting the duration of the audio data according to the format information of the audio data;
carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length abnormity;
analyzing the audio data to obtain pulse code modulation data;
performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity;
and monitoring video recording according to the duration detection result and the audio quality detection result.
In one embodiment, the step of performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, where the audio quality detection result includes an audio quality abnormality and an audio quality abnormality includes:
carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data;
detecting the volume information according to a preset decibel range;
when the decibel value of the volume information is within the preset decibel range, determining that the audio quality detection result is that the audio quality is normal;
and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
In one embodiment, the step of detecting a volume of the pulse code modulation data to obtain volume information corresponding to the pulse code modulation data includes:
segmenting the pulse code modulation data to obtain pulse code modulation data segments;
and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
In one embodiment, the performing duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain a duration detection result, where the duration detection result includes a duration anomaly and a duration anomaly step, and includes:
analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference;
when the time length difference is within a preset time length difference range, determining that the time length detection result is that the time length is normal;
and when the time length difference is not within the preset time length difference range, determining that the time length detection result is abnormal in time length.
In one embodiment, the step of monitoring video recording according to the duration detection result and the audio quality detection result includes:
when the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality, triggering a recording abnormity reminding instruction;
and controlling a recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
In one embodiment, the method further comprises:
when the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality, triggering a recording pause instruction;
and controlling the recording terminal to pause video recording according to the recording pause instruction.
In one embodiment, after the step of controlling the recording terminal to perform video recording exception reminding according to the recording exception reminding instruction, the method further includes:
marking the video segment with the detected time length detection result of abnormal time length or the detected audio quality detection result of abnormal audio quality;
when the recorded video is played, the mark is displayed on the progress bar.
A video quality detection apparatus, the apparatus comprising:
the recording start detection module is used for acquiring a to-be-detected video segment with preset recording duration in real time when the video recording start is detected;
the audio data extraction module is used for extracting audio data contained in the video segment to be detected;
the audio data duration acquisition module is used for detecting the duration of the audio data according to the format information of the audio data;
the duration detection module is used for carrying out duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain a duration detection result, and the duration detection result comprises duration abnormity and duration abnormity;
the audio data analysis module is used for analyzing the audio data to obtain pulse code modulation data;
the audio quality detection module is used for carrying out audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, and the audio quality detection result comprises audio quality abnormity and audio quality abnormity;
and the video recording monitoring module is used for monitoring video recording according to the duration detection result and the audio quality detection result.
A computer device comprising a memory storing a computer program and a processor implementing the steps of the method when executing the computer program.
A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method.
According to the video quality detection method, the video quality detection device, the computer equipment and the storage medium, the recorded video segments are obtained in real time in the video recording process; and carrying out time length detection and audio quality detection on audio data in the video clips, judging whether the recorded video is synchronous with picture or not according to a time length detection result, judging whether the volume is abnormal or not according to an audio quality detection result, and monitoring the video recording in real time. The abnormal condition of recording can be timely reminded, adjustment can be timely made, the problem that the quality of video recording is poor, so that the video recording is caused again is avoided, and the video recording efficiency is improved.
Drawings
FIG. 1 is a diagram illustrating an exemplary embodiment of a video quality detection method;
FIG. 2 is a flow diagram of a video quality detection method in accordance with one embodiment;
FIG. 3 is a block diagram showing the structure of a video quality detection apparatus according to an embodiment;
FIG. 4 is a block diagram showing the construction of a video quality detection apparatus according to another embodiment;
FIG. 5 is a diagram of the internal structure of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.
The video quality detection method provided by the application can be applied to the application environment shown in fig. 1. The video quality detection method relates to the recording terminal 102 and may also relate to the server 104, wherein the recording terminal 102 communicates with the server 104 through a network. When the terminal 102 is involved, the recording terminal 102 acquires a to-be-detected video segment with a preset recording duration in real time when detecting that video recording starts; extracting audio data contained in a video segment to be detected; detecting the duration of the audio data according to the format information of the audio data; carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length abnormity; analyzing the audio data to obtain pulse code modulation data; performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity; and monitoring video recording according to the time length detection result and the audio quality detection result.
When the recording terminal 102 and the server 104 are involved, the server 104 acquires a to-be-detected video segment with a preset recording duration from the recording terminal 102 in real time when detecting that video recording starts; the server 104 extracts audio data of a video segment to be detected to acquire the audio data in the video segment to be detected; extracting audio data contained in a video segment to be detected; detecting the duration of the audio data according to the format information of the audio data; carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length abnormity; analyzing the audio data to obtain pulse code modulation data; performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity; the server 104 monitors the video recording according to the duration detection result and the audio quality detection result. The recording terminal 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 104 may be implemented by an independent server or a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a video quality detection method is provided, which is described by taking the method as an example applied to the server in fig. 1, and includes the following steps:
step S220, when the beginning of video recording is detected, the video segment to be detected with the preset recording duration is obtained in real time.
The video recording start detection may be that the video recording start is judged when a recording instruction is received, the video recording start is judged when a video recording function of the recording terminal is detected to be started, and the video recording start is judged when a video segment is acquired after the recording instruction is received. The preset recording duration is used for determining the time point of acquiring the video segment to be detected, and the preset recording duration can be set according to the detection accuracy and rationality, such as: the preset recording time length is set to be 2 seconds, and when the recorded video reaches 2 seconds, the video of 2 seconds is obtained to be used as the video segment to be detected.
In one scene, when a user triggers a video shooting instruction of a video collection platform through a recording terminal, the recording terminal is controlled to start video shooting, after the video shooting is started, video recording starts, a server corresponding to the video collection platform records a currently recorded video frame in real time, and when the video duration reaches a preset recording duration, the video with the preset recording duration is used as a video segment to be detected.
Step S240, extracting the audio data included in the video segment to be detected.
The audio data contained in the video segment to be detected refers to digitized sound data in the video segment to be detected, and the audio data in the video segment to be detected can be extracted by calling an audio data extraction tool to obtain the audio data in the video segment to be detected. Such as: mediaCoder (media conversion software), AVI MPEG WMV RM o MP3 Converter (software for converting video format to audio file), and the like.
Step S260, detecting the duration of the audio data according to the format information of the audio data.
The duration of the audio data can be analyzed based on the format information of the audio file to obtain the duration of the audio data, wherein the header part of the original data of the audio data stores the format information of the audio file, the bit depth, the sampling bit number and the channel number of the current audio can be obtained through the information, and the data size per second is obtained through calculation, such as: the data size per second = sampling frequency × sampling number of bits × number of channels, and the audio data duration is obtained by the total data size of the audio data/data size per second.
Step S280, carrying out duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain duration detection results, wherein the duration detection results comprise duration abnormity and duration abnormity.
And the duration of the video segment to be detected is the preset recording duration of the video segment to be detected. The duration of the audio data can be compared with the duration of the video segment to be detected, and the duration detection result can be judged according to the comparison result. The comparison result may be determined according to the time length difference between the time length of the audio data and the time length of the video segment to be detected, for example: and when the time length difference exceeds a certain range, judging that the time length detection result is abnormal, and when the time length difference is within the range, judging that the time length detection result is normal.
And step S300, analyzing the audio data to obtain pulse code modulation data.
The pulse code modulation data, namely, PCM data, is data obtained after the process of sampling, quantizing the amplitude of the sample, and encoding the audio data. The audio data is analyzed, namely the audio data is sampled firstly, and then the amplitude of the sample value is quantized and then encoded to obtain pulse code modulation data. The sampling of the audio data may be a periodic scanning of a temporally continuous signal into a temporally discrete signal. The quantization disperses the amplitude of the sampled instantaneous value to obtain a quantized pulse amplitude modulation signal. The encoding may be to represent each quantized value having a fixed level by a set of binary codes, to obtain binary codes, i.e., PCM data.
Step S320, performing audio quality detection on the pulse code modulation data based on the preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity.
The audio quality detection can be volume detection, the volume value of the sliced data can be calculated by slicing pulse code modulation data, the audio quality detection is carried out according to the volume value, when the volume value is within a preset decibel range, the audio quality detection result is that the audio quality is normal, and when the volume value is not within the preset decibel range, the audio quality detection result is that the audio quality is abnormal.
And step S340, monitoring video recording according to the time length detection result and the audio quality detection result.
Whether the recorded video is out of synchronization of voice or not can be judged according to the time length detection result, and whether the volume in the recorded video is too large or too small can be judged according to the audio quality detection result. The user can be reminded of the abnormality when the detected time length detection result is abnormal. Or when the audio quality detection result is detected to be abnormal, the user is reminded of the abnormality.
In the video quality detection method, the recorded video segments are obtained in real time in the video recording process; and carrying out time length detection and audio quality detection on audio data in the video clip, judging whether the recorded video is synchronous with the voice or not according to a time length detection result, judging whether the volume is abnormal or not according to an audio quality detection result, and monitoring the video recording in real time. The abnormal condition of recording can be timely reminded, adjustment can be timely made, the problem that the quality of video recording is poor, so that the video recording is caused again is avoided, and the video recording efficiency is improved.
In one embodiment, the step of performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, where the audio quality detection result includes an audio quality abnormality and an audio quality abnormality includes:
carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data; detecting the volume information according to a preset decibel range; when the decibel value of the volume information is within a preset decibel range, determining that the audio quality detection result is that the audio quality is normal; and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
The volume information of the pcm data refers to a decibel value of the audio data, i.e., a volume value. The method for detecting the volume of the pulse code modulation data may be to segment the obtained pulse code modulation data (PCM data) to obtain pulse code modulation data segments (PCM data segments), and analyze the size end of each segment data to obtain the volume information of the pulse code modulation data. The audio quality is further detected, the condition that the volume is low or noise occurs when the video is shot at present can be timely reminded, and a user is timely informed to adjust the audio quality.
In one embodiment, the step of detecting the volume of the pulse code modulation data to obtain the volume information of the pulse code modulation data includes: segmenting the pulse code modulation data to obtain pulse code modulation data segments; and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
The method specifically comprises the following steps of analyzing the size end of each segment of the pulse code modulation data fragment: analyzing the symbol (signed/unsigned) of each segment data, obtaining the data of each sampling point according to the bit depth (8/16 bits), calculating the average value of the sampling points, and based on a dBFS formula, taking the maximum value (16 bits with the symbol 32767 and without the symbol 65535) calculated by the bit depth as a denominator (Pref), taking the value of the sampling point as a numerator (Prms), calculating the decibel by the formula, wherein the calculated number is a negative value, and 0 is a maximum value. The 16 bit signed is-93-0, and the 16 bit unsigned bit is-90-0. And (3) carrying out decibel conversion by taking the decibel calculated by the dBFS formula as a negative number range, mapping the result into 0-120 db in an equal ratio manner, and obtaining a corresponding decibel value, namely the volume information of the pulse code modulation data. The audio quality is further detected, the condition that the volume is low or noise occurs when the video is shot at present can be timely reminded, and a user is timely informed to adjust the audio quality.
In one embodiment, the step of performing duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain a duration detection result, wherein the duration detection result includes a duration anomaly and a duration anomaly, includes: analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference; when the time length difference is within the preset time length difference range, determining that the time length detection result is that the time length is normal; and when the time length difference is not within the preset time length difference range, determining that the time length detection result is abnormal in time length.
The duration difference is obtained by analyzing the duration difference according to the duration of the audio data and the duration of the video segment to be detected, the duration difference can be obtained by subtracting the duration of the video segment to be detected from the duration of the audio data, the obtained difference is the duration difference, the duration difference can also be obtained by subtracting the duration of the audio data from the duration of the video segment to be detected, and the obtained difference is the duration difference. The preset time difference range can be determined according to the accuracy degree of the audio and the picture in the video, the higher the accuracy is, the smaller the preset time difference range is, the preset time difference range can be 0, if the time difference is 0, the time detection result is normal, and other values are abnormal. An interval may be, for example, 0 to 2 seconds, 0 to 2 milliseconds, 0 to 10 milliseconds, or the like. The condition that the picture and the sound are not synchronous when the video is shot at present can be timely reminded through the duration detection, and a user is timely informed of adjustment.
In one embodiment, the step of monitoring video recording according to the duration detection result and the audio quality detection result includes: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering a recording abnormity reminding instruction; and controlling the recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
The recording abnormity reminding instruction is used for triggering a reminding mechanism of the server, so that the recording terminal is controlled to carry out video recording abnormity reminding. The corresponding reminding message can be obtained by triggering a reminding mechanism of the server and sent to the recording terminal. By timely reminding of monitoring of abnormal conditions, a user can timely make adjustment, the problem that video recording is poor in quality and results in re-recording is avoided, and video recording efficiency is improved.
In one embodiment, the video quality detection method further comprises:
when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering a recording pause instruction; and controlling the recording terminal to pause video recording according to the recording pause instruction.
The recording pause instruction is used for triggering a pause mechanism of the server, so that the recording terminal is controlled to pause video recording. The corresponding pause instruction can be generated by triggering a pause mechanism of the server and sent to the recording terminal, so that the recording terminal pauses video recording. The recording terminal is controlled to pause recording in time by monitoring abnormal conditions, so that the occupation of memory space can be saved, the analysis amount of a server can be reduced, the operation efficiency is improved, the attention of a user can be attracted, adjustment can be made in time, the problem of re-recording caused by poor video recording quality is avoided, and the video recording efficiency is improved.
In one embodiment, after the step of controlling the recording terminal to perform the video recording exception reminding according to the recording exception reminding instruction, the method further includes: marking the video segments of which the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality; when the recorded video is played, the mark is displayed on the progress bar.
When the user sees the reminding abnormity, after the reminding abnormity is adjusted, and then records on the basis of pause, the video segment with the detected time length abnormity or the audio quality abnormity is marked, and when the recorded video is played, the mark is displayed on the progress bar, so that the user can find the abnormal video segment in time, and the abnormal video segment can be efficiently processed.
It should be understood that, although the steps in the flowchart of fig. 2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a portion of the steps in fig. 2 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 3, there is provided a video quality detection apparatus including: a recording start detection module 310, an audio data extraction module 320, an audio data duration acquisition module 330, a duration detection module 340, an audio data parsing module 350, an audio quality detection module 360, and a video recording monitoring module 370, wherein:
a recording start detection module 310, configured to obtain a to-be-detected video segment with a preset recording duration in real time when a video recording start is detected;
the audio data extraction module 320 is configured to extract audio data included in the video segment to be detected;
an audio data duration obtaining module 330, configured to detect a duration of the audio data according to format information of the audio data;
the duration detection module 340 is configured to perform duration detection according to the duration of the audio data and the duration of the video segment to be detected, and obtain a duration detection result, where the duration detection result includes a duration anomaly and a duration anomaly;
the audio data analysis module 350 is configured to analyze the audio data to obtain pulse code modulation data;
the audio quality detection module 360 is configured to perform audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, where the audio quality detection result includes an audio quality abnormality and an audio quality abnormality;
and a video recording monitoring module 370, configured to monitor video recording according to the duration detection result and the audio quality detection result.
In one embodiment, the audio quality detection module 360 is further configured to: carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data; detecting the volume information according to a preset decibel range; when the decibel value of the volume information is within a preset decibel range, determining that the audio quality detection result is that the audio quality is normal; and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
In one embodiment, the audio quality detection module 360 is further configured to: segmenting the pulse code modulation data to obtain a pulse code modulation data segment; and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
In one embodiment, the duration detection module 340 is further configured to: analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference; when the time length difference is within the preset time length difference range, determining that the time length detection result is that the time length is normal; and when the time length difference is not within the preset time length difference range, determining that the time length detection result is abnormal in time length.
In one embodiment, the video recording monitoring module 370 is further configured to: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering and recording an abnormal reminding instruction; and controlling the recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
In one embodiment, referring to fig. 4, the video quality detection apparatus further includes a control module 380: the recording pause instruction is triggered when the detected duration detection result is abnormal duration or the detected audio quality detection result is abnormal audio quality; and controlling the recording terminal to pause video recording according to the recording pause instruction.
In one embodiment, the video quality detection apparatus further comprises a marking module 390: the video segment marking device is used for marking the video segment with the detected time length detection result of abnormal time length or the detected audio quality detection result of abnormal audio quality; when the recorded video is played, the mark is displayed on the progress bar.
For specific limitations of the video quality detection apparatus, reference may be made to the above limitations of the video quality detection method, which are not described herein again. The modules in the video quality detection apparatus may be wholly or partially implemented by software, hardware, or a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 5. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing video data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a video quality detection method.
Those skilled in the art will appreciate that the architecture shown in fig. 5 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, there is provided a computer device comprising a memory storing a computer program and a processor implementing the following steps when the processor executes the computer program:
when the beginning of video recording is detected, acquiring a to-be-detected video segment with preset recording duration in real time; extracting audio data contained in a video segment to be detected; detecting the duration of the audio data according to the format information of the audio data; carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length abnormity; analyzing the audio data to obtain pulse code modulation data; performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity; and monitoring video recording according to the time length detection result and the audio quality detection result.
In one embodiment, the processor, when executing the computer program, further performs the steps of: carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data; detecting the volume information according to a preset decibel range; when the decibel value of the volume information is within a preset decibel range, determining that the audio quality detection result is that the audio quality is normal; and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
In one embodiment, the processor when executing the computer program further performs the steps of: segmenting the pulse code modulation data to obtain pulse code modulation data segments; and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
In one embodiment, the processor, when executing the computer program, further performs the steps of: analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference; when the time length difference is within the preset time length difference range, determining that the time length detection result is that the time length is normal; and when the duration difference is not within the preset duration difference range, determining that the duration detection result is abnormal in duration.
In one embodiment, the processor, when executing the computer program, further performs the steps of: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering and recording an abnormal reminding instruction; and controlling the recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
In one embodiment, the processor, when executing the computer program, further performs the steps of: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering a recording pause instruction; and controlling the recording terminal to pause video recording according to the recording pause instruction.
In one embodiment, the processor, when executing the computer program, further performs the steps of: marking the video segment with the detected time length detection result of abnormal time length or the detected audio quality detection result of abnormal audio quality; when the recorded video is played, the mark is displayed on the progress bar.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
when the beginning of video recording is detected, acquiring a to-be-detected video segment with preset recording duration in real time; extracting audio data contained in a video segment to be detected; detecting the duration of the audio data according to the format information of the audio data; carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length abnormity; analyzing the audio data to obtain pulse code modulation data; performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality abnormity; and monitoring video recording according to the time length detection result and the audio quality detection result.
In one embodiment, the computer program when executed by the processor further performs the steps of: carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data; detecting the volume information according to a preset decibel range; when the decibel value of the volume information is within a preset decibel range, determining that the audio quality detection result is that the audio quality is normal; and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
In one embodiment, the computer program when executed by the processor further performs the steps of: segmenting the pulse code modulation data to obtain pulse code modulation data segments; and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
In one embodiment, the computer program when executed by the processor further performs the steps of: analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference; when the time length difference is within the preset time length difference range, determining that the time length detection result is that the time length is normal; and when the duration difference is not within the preset duration difference range, determining that the duration detection result is abnormal in duration.
In one embodiment, the computer program when executed by the processor further performs the steps of: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering and recording an abnormal reminding instruction; and controlling the recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
In one embodiment, the computer program when executed by the processor further performs the steps of: when the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality, triggering a recording pause instruction; and controlling the recording terminal to pause video recording according to the recording pause instruction.
In one embodiment, the computer program when executed by the processor further performs the steps of: marking the video segments of which the detected time length detection result is abnormal time length or the detected audio quality detection result is abnormal audio quality; when the recorded video is played, the mark is displayed on the progress bar.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, and these are all within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A video quality detection method, the method comprising:
when the beginning of video recording is detected, acquiring a to-be-detected video segment with preset recording duration in real time;
extracting audio data contained in the video segment to be detected;
detecting the duration of the audio data according to the format information of the audio data;
carrying out time length detection according to the time length of the audio data and the time length of the video segment to be detected to obtain time length detection results, wherein the time length detection results comprise time length abnormity and time length normality;
analyzing the audio data to obtain pulse code modulation data;
performing audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, wherein the audio quality detection result comprises audio quality abnormity and audio quality normality;
monitoring video recording according to the duration detection result and the audio quality detection result;
when the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality, triggering a recording abnormity reminding instruction;
and controlling a recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
2. The method according to claim 1, wherein the step of performing audio quality detection on the pcm data based on a preset db range to obtain an audio quality detection result, wherein the audio quality detection result includes audio quality abnormality and audio quality normality, comprises:
carrying out volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data;
detecting the volume information according to a preset decibel range;
when the decibel value of the volume information is within the preset decibel range, determining that the audio quality detection result is that the audio quality is normal;
and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
3. The method according to claim 2, wherein the step of detecting the volume of the pulse code modulation data to obtain the volume information of the pulse code modulation data comprises:
segmenting the pulse code modulation data to obtain pulse code modulation data segments;
and analyzing the size end of each segment of the pulse code modulation data segment to obtain the volume information of the pulse code modulation data.
4. The method according to claim 1, wherein the step of performing duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain a duration detection result, wherein the duration detection result includes a duration abnormal step and a duration normal step, includes:
analyzing the time difference according to the time length of the audio data and the time length of the video segment to be detected to obtain the time difference;
when the time length difference is within a preset time length difference range, determining that the time length detection result is that the time length is normal;
and when the duration difference is not within the preset duration difference range, determining that the duration detection result is abnormal in duration.
5. The method of claim 1, further comprising:
when the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality, triggering a recording pause instruction;
and controlling the recording terminal to pause video recording according to the recording pause instruction.
6. The method according to claim 1, wherein after the step of controlling the recording terminal to perform the video recording abnormity prompting according to the recording abnormity prompting instruction, the method further comprises the following steps:
marking the video segments of which the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality;
when the recorded video is played, the mark is displayed on the progress bar.
7. A video quality detection apparatus, characterized in that the apparatus comprises:
the recording start detection module is used for acquiring a to-be-detected video segment with preset recording duration in real time when the video recording start is detected;
the audio data extraction module is used for extracting audio data contained in the video segment to be detected;
the audio data duration acquisition module is used for detecting the duration of the audio data according to the format information of the audio data;
the duration detection module is used for carrying out duration detection according to the duration of the audio data and the duration of the video segment to be detected to obtain a duration detection result, and the duration detection result comprises duration abnormity and duration normality;
the audio data analysis module is used for analyzing the audio data to obtain pulse code modulation data;
the audio quality detection module is used for carrying out audio quality detection on the pulse code modulation data based on a preset decibel range to obtain an audio quality detection result, and the audio quality detection result comprises audio quality abnormity and audio quality normality;
the video recording monitoring feedback module is used for monitoring video recording according to the duration detection result and the audio quality detection result; when the detected time length detection result is abnormal time length or the audio quality detection result is abnormal audio quality, triggering a recording abnormity reminding instruction; and controlling a recording terminal to carry out video recording abnormity reminding according to the recording abnormity reminding instruction.
8. The apparatus according to claim 7, wherein the audio quality detection module is further configured to perform volume detection on the pulse code modulation data to obtain volume information of the pulse code modulation data; detecting the volume information according to a preset decibel range; when the decibel value of the volume information is within the preset decibel range, determining that the audio quality detection result is that the audio quality is normal; and when the decibel value of the volume information is not within the preset decibel range, determining that the audio quality detection result is abnormal audio quality.
9. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor when executing the computer program performs the steps of the method according to any of claims 1 to 6.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010120954.1A CN111263189B (en) | 2020-02-26 | 2020-02-26 | Video quality detection method and device and computer equipment |
| PCT/CN2021/071066 WO2021169632A1 (en) | 2020-02-26 | 2021-01-11 | Video quality detection method and apparatus, and computer device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010120954.1A CN111263189B (en) | 2020-02-26 | 2020-02-26 | Video quality detection method and device and computer equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111263189A CN111263189A (en) | 2020-06-09 |
| CN111263189B true CN111263189B (en) | 2023-03-07 |
Family
ID=70954595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010120954.1A Active CN111263189B (en) | 2020-02-26 | 2020-02-26 | Video quality detection method and device and computer equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111263189B (en) |
| WO (1) | WO2021169632A1 (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111263189B (en) * | 2020-02-26 | 2023-03-07 | 深圳壹账通智能科技有限公司 | Video quality detection method and device and computer equipment |
| CN114554004A (en) * | 2020-11-27 | 2022-05-27 | 北京小米移动软件有限公司 | Video recording method and device, electronic equipment and storage medium |
| CN113660393A (en) * | 2021-07-08 | 2021-11-16 | 上海途悠信息科技有限公司 | Service window double-recording system |
| US11968417B2 (en) * | 2021-12-30 | 2024-04-23 | Comcast Cable Communications, Llc | Systems, methods, and apparatuses for buffer management |
| CN114422772B (en) * | 2022-01-24 | 2024-08-09 | 腾讯科技（深圳）有限公司 | Multimedia playing quality evaluation method and device, electronic equipment and storage medium |
| CN114500996A (en) * | 2022-01-27 | 2022-05-13 | 中央广播电视总台 | Material detection method and device, computer equipment and readable storage medium |
| CN114745497A (en) * | 2022-02-23 | 2022-07-12 | 浪潮金融信息技术有限公司 | Audio and video double recording method, system and medium based on visual library |
| CN117793339A (en) * | 2023-12-28 | 2024-03-29 | 广州市维博网络信息科技有限公司 | Video quality diagnosis system based on artificial intelligence |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007128097A1 (en) * | 2006-05-05 | 2007-11-15 | Mariner Partners, Inc. | Transient video anomaly analysis and reporting system |
| CN102103855A (en) * | 2009-12-16 | 2011-06-22 | 北京中星微电子有限公司 | Method and device for detecting audio clip |
| CN105187909A (en) * | 2015-09-09 | 2015-12-23 | 深圳Tcl数字技术有限公司 | Method and device used for detecting loss of audio and video recorded at terminal |
| CN107371053A (en) * | 2017-08-31 | 2017-11-21 | 北京鹏润鸿途科技股份有限公司 | Audio and video streams comparative analysis method and device |
| CN108877837A (en) * | 2018-06-12 | 2018-11-23 | 北京小米移动软件有限公司 | Audio signal abnormality recognition method, device and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534980B (en) * | 2016-11-15 | 2019-12-06 | 广州华多网络科技有限公司 | abnormity detection method of audio processing system, log recording method and device |
| JP2019100756A (en) * | 2017-11-29 | 2019-06-24 | 富士通株式会社 | Abnormality detection apparatus, abnormality detection method and abnormality detection computer program |
| CN111263189B (en) * | 2020-02-26 | 2023-03-07 | 深圳壹账通智能科技有限公司 | Video quality detection method and device and computer equipment |
-
2020
- 2020-02-26 CN CN202010120954.1A patent/CN111263189B/en active Active
-
2021
- 2021-01-11 WO PCT/CN2021/071066 patent/WO2021169632A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007128097A1 (en) * | 2006-05-05 | 2007-11-15 | Mariner Partners, Inc. | Transient video anomaly analysis and reporting system |
| CN102103855A (en) * | 2009-12-16 | 2011-06-22 | 北京中星微电子有限公司 | Method and device for detecting audio clip |
| CN105187909A (en) * | 2015-09-09 | 2015-12-23 | 深圳Tcl数字技术有限公司 | Method and device used for detecting loss of audio and video recorded at terminal |
| CN107371053A (en) * | 2017-08-31 | 2017-11-21 | 北京鹏润鸿途科技股份有限公司 | Audio and video streams comparative analysis method and device |
| CN108877837A (en) * | 2018-06-12 | 2018-11-23 | 北京小米移动软件有限公司 | Audio signal abnormality recognition method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021169632A1 (en) | 2021-09-02 |
| CN111263189A (en) | 2020-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111263189B (en) | Video quality detection method and device and computer equipment | |
| CN109087632B (en) | Speech processing method, device, computer equipment and storage medium | |
| CN105376335B (en) | Collected data uploading method and device | |
| CN105049917B (en) | The method and apparatus of recording audio/video synchronized timestamp | |
| CN109788224B (en) | Video recording method, video recording device, network camera and storage medium | |
| CN112511818B (en) | Video playing quality detection method and device | |
| CN111241938A (en) | Face recognition method and device based on image verification and computer equipment | |
| WO2018039547A1 (en) | Audio transmission with compensation for speech detection period duration | |
| CN112954434A (en) | Subtitle processing method, system, electronic device and storage medium | |
| CN115951824A (en) | Sampling data processing method, device and nonvolatile storage medium | |
| US9916846B2 (en) | Method and system for speech detection | |
| US7164755B1 (en) | Voice storage device and voice coding device | |
| CN109308778B (en) | Mobile detection alarm method, device, acquisition equipment and storage medium | |
| CN111046006A (en) | Data backup system and data backup method | |
| CN111723017A (en) | System capacity testing method and device, computer equipment and storage medium | |
| CN110765869B (en) | Lip language living body detection method, system and computer equipment for collecting data by channels | |
| CN112423121A (en) | Video test file generation method and device and player test method and device | |
| CN111385637B (en) | Media data encoding method and device and electronic equipment | |
| CN108924665B (en) | Method and device for reducing video playing delay, computer equipment and storage medium | |
| CN113593570B (en) | Voice abnormality diagnosis method, device, equipment and storage medium | |
| CN112866745B (en) | Streaming video data processing method, device, computer equipment and storage medium | |
| CN112151069B (en) | Voice data processing method, device, computer equipment and storage medium | |
| CN115292246A (en) | Document transcoding method and device and electronic equipment | |
| US11398091B1 (en) | Repairing missing frames in recorded video with machine learning | |
| CN115334333A (en) | Live video processing method and device, live server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |