CN115002520B - Video stream data processing method, device, equipment and storage medium - Google Patents
Video stream data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN115002520B CN115002520B CN202210392401.0A CN202210392401A CN115002520B CN 115002520 B CN115002520 B CN 115002520B CN 202210392401 A CN202210392401 A CN 202210392401A CN 115002520 B CN115002520 B CN 115002520B
- Authority
- CN
- China
- Prior art keywords
- video
- evaluation information
- replacement logic
- determining
- logic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 40
- 238000013441 quality evaluation Methods 0.000 claims abstract description 135
- 238000011156 evaluation Methods 0.000 claims description 86
- 238000000034 method Methods 0.000 claims description 35
- 230000004044 response Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 abstract description 8
- 238000001303 quality assessment method Methods 0.000 description 17
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- AYFVYJQAPQTCCC-GBXIJSLDSA-N L-threonine Chemical compound C[C@@H](O)[C@H](N)C(O)=O AYFVYJQAPQTCCC-GBXIJSLDSA-N 0.000 description 7
- 230000008859 change Effects 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004927 fusion Effects 0.000 description 3
- 238000013097 stability assessment Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Abstract
The embodiment of the application provides a video stream data processing method, device, equipment and storage medium. According to the technical scheme provided by the embodiment of the application, the estimated replacement logic is determined according to the video quality evaluation information corresponding to the transcoded video obtained by transcoding the source stream video, the current target replacement logic is determined according to the comparison result of the estimated replacement logic and the target replacement logic determined last time, when the current target replacement logic is the replacement video, the transcoded video is utilized to replace the source stream video for video issuing, the bandwidth occupation of video transmission is reduced on the premise of guaranteeing the video watching experience of a user, the video playing smoothness is effectively improved, and the video playing quality is guaranteed.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a video stream data processing method, a device, equipment and a storage medium.
Background
In the video transcoding system, transcoded videos with different resolutions and code rate gears can be obtained by transcoding source stream videos, then video with proper gears is issued to the user side according to resolution selection and actual bandwidth conditions of the user side, and the user is ensured to see clearer videos on the basis of smooth playing.
In general, since the quality of the source video is the best, the code rate is the highest, and the user will generally select the source video to play. However, in the video distribution process, the bandwidth occupied by the source stream video is correspondingly increased, which easily results in the decrease of the video playing fluency and influences the video playing quality.
Disclosure of Invention
The embodiment of the application provides a video stream data processing method, device, equipment and storage medium, which are used for solving the technical problems that in the prior art, the occupation of source stream video bandwidth is high, the video playing fluency is easy to be reduced, and the video playing quality is influenced, and guaranteeing the video playing quality under the condition of effectively improving the video playing fluency.
In a first aspect, an embodiment of the present application provides a video stream data processing method, including:
determining estimated replacement logic according to video quality evaluation information of a transcoding video, wherein the transcoding video is obtained by transcoding a source stream video;
judging whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determining the current target replacement logic based on a judging result;
and under the condition that the current target replacement logic is a replacement video, replacing the source stream video by the transcoding video for video delivery.
In a second aspect, an embodiment of the present application provides a video stream data processing apparatus, including a logic estimation module, a logic determination module, and a video replacement module, where:
the logic estimation module is configured to determine estimated replacement logic according to video quality evaluation information of a transcoded video, wherein the transcoded video is obtained by transcoding a source stream video;
the logic determination module is configured to judge whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determine the current target replacement logic based on a judgment result;
and the video replacing module is configured to replace the source stream video with the transcoding video to perform video delivery under the condition that the current target replacing logic is a replacing video.
In a third aspect, an embodiment of the present application provides a video stream data processing apparatus, including: a memory and one or more processors;
the memory is used for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the video stream data processing method as described in the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium storing computer executable instructions which, when executed by a computer processor, are for performing the video stream data processing method according to the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product comprising a computer program stored in a computer readable storage medium, from which at least one processor of a device reads and executes the computer program, causing the device to perform the video stream data processing method as described in the first aspect.
According to the embodiment of the application, the estimated replacement logic is determined according to the video quality evaluation information corresponding to the transcoded video obtained by transcoding the source stream video, the current target replacement logic is determined according to the comparison result of the estimated replacement logic and the target replacement logic determined last time, when the current target replacement logic is the replacement video, the transcoded video is utilized to replace the source stream video for video issuing, the bandwidth occupation of video transmission is reduced on the premise of guaranteeing the video watching experience of a user, the video playing smoothness is effectively improved, and the video playing quality is guaranteed.
Drawings
Fig. 1 is a flowchart of a video stream data processing method provided in an embodiment of the present application;
FIG. 2 is a flowchart of another video stream data processing method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a determination flow of target replacement logic based on a determination result according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a target replacement logic determination flow based on stability assessment according to an embodiment of the present application;
fig. 5 is a schematic flow chart of performing stability evaluation on video quality evaluation information according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a video stream data processing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a video stream data processing apparatus according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the following detailed description of specific embodiments thereof is given with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present application are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The above-described process may be terminated when its operations are completed, but may have additional steps not included in the drawings. The processes described above may correspond to methods, functions, procedures, subroutines, and the like.
Fig. 1 is a flowchart of a video stream data processing method according to an embodiment of the present application, where the video stream data processing method according to the embodiment of the present application may be performed by a video stream data processing apparatus, and the video stream data processing apparatus may be implemented by hardware and/or software and integrated in a video stream data processing device (e.g., a server).
The following description will be made taking as an example a video stream data processing method performed by the video stream data processing apparatus. Referring to fig. 1, the video stream data processing method includes:
s110: and determining pre-estimated replacement logic according to video quality evaluation information of the transcoded video, wherein the transcoded video is obtained by transcoding the source stream video.
The source stream video is provided by a first user side (such as a main broadcasting side), and the first user side sends the source stream video to the video stream data processing device after the video is acquired. When the video stream data processing device starts content adaptive coding (CAE, content Adaptive Encoding), the video stream data processing device transcodes the source stream video to obtain transcoded video with different definition and/or code rate, and sends a proper video stream to the second user terminal according to the selection of the definition and/or code rate by the second user terminal (e.g. the audience terminal) and the actual bandwidth condition of the second user terminal, so as to ensure that the second user terminal can play clearer video on the basis of smooth playing.
It can be understood that the quality of the source stream video is the highest and the code rate is the highest. In one possible embodiment, the transcoded video obtained by transcoding may be full High Definition (FHD, full High Definition) video, high Definition (HD) video, or the like, and this embodiment is described taking FHD video as the transcoded video for transmission in place of source stream video. It should be explained that, because the human eyes are sensitive to the low-frequency region of the video image and are lower in sensitivity to the high-frequency region (wherein, the texture of the low-frequency region of the video image is single relative to the texture of the high-frequency region), when the video quality of the full-high-definition video is better, the difference between the full-high-definition video and the source stream video is mainly and difficultly perceived by the human eyes, but the code rate of the full-high-definition video is obviously lower than that of the source stream video.
Illustratively, after receiving the source stream video sent by the first user terminal, transcoding the source stream video to obtain a transcoded video. The method comprises the steps of transcoding a source stream video to obtain a plurality of videos with different code rates (the videos with different code rates can be sent to a second user side according to the selection and bandwidth conditions of the second user side), and the scheme takes the video with the highest code rate obtained by transcoding as a transcoded video sent to a user by a subsequent replacement source stream video (namely, the transcoded video is the highest definition transcoded video or the highest code rate transcoded video obtained by the source stream video).
After the transcoded video is obtained, video quality evaluation is carried out on the transcoded video, and video quality evaluation information of the transcoded video is determined. The determination of the video quality evaluation information may be performed according to a set time interval, and the video quality evaluation may be performed by transcoding the video within the set time interval, and the corresponding video quality evaluation information may be average video quality evaluation information of each transcoding video, or may be video quality evaluation information of the transcoding video obtained when the set time interval is reached.
In one possible embodiment, the video quality assessment information may be obtained by a combination of one or more of Peak Signal-To-Noise Ratio (PSNR), video multi-method assessment fusion (VMAF, video Multimethod ASeSment Fusion), and video quality assessment value (VQA, video Quality ASeSment), wherein the higher the Peak Signal-To-Noise Ratio PSNR or video multi-method assessment fusion VMAF, or the lower the video quality assessment value VQA, the higher the corresponding video quality, and the better the playback display effect.
The replacement logic (including the pre-estimated replacement logic and the target replacement logic) provided in this embodiment is used to indicate whether the source stream video needs to be replaced by the transcoded video for video delivery. Wherein the replacement logic includes a replacement video and a non-replacement video. It will be appreciated that when the replacement logic is a replacement video, it indicates that video delivery is required to replace the source stream video with the transcoded video (when the second user receiving the source stream video originally receives the transcoded video), and when the replacement logic is a non-replacement video, it indicates that video delivery is not required to replace the source stream video with the transcoded video (when the second user receiving the source stream video originally receives the still source stream video).
Illustratively, after determining video quality rating information for the transcoded video, pre-estimated replacement logic is determined based on the video quality rating information. For example, comparing the video quality assessment information with a set quality requirement for replacing the source stream video with the transcoded video, determining the pre-estimated replacement logic as a replacement video when the video quality assessment information meets the set quality requirement, and otherwise determining the pre-estimated replacement logic as not replacing the video.
S120: and judging whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determining the current target replacement logic based on a judging result.
It should be explained that the last determined target replacement logic provided by the scheme is the last determined target replacement logic in the last execution of the video stream data processing method. Correspondingly, the current target replacement logic determined by the video stream data processing method executed at the present time is taken as the target replacement logic determined last time corresponding to the video stream data processing method executed at the next time.
Illustratively, the estimated replacement logic determined from the video quality assessment information is compared with the last determined target replacement logic, and the current target replacement logic is determined based on the comparison result. For example, when the predicted replacement logic is consistent with the last determined target replacement logic, the current target replacement logic is maintained as the last determined target replacement logic. In one possible embodiment, the current target replacement logic may be determined as the predicted replacement logic when the predicted replacement logic is inconsistent with the last determined target replacement logic. In a possible embodiment, when the estimated replacement logic is inconsistent with the target replacement logic determined last time, the stability of the video quality evaluation information may be determined when the estimated replacement logic is inconsistent with the target replacement logic determined last time, when the stability of the video quality evaluation information meets the set stability requirement, the current target replacement logic is determined as the estimated replacement logic, and when the stability of the video quality evaluation information does not meet the set stability requirement, the current target replacement logic is kept as the target replacement logic determined last time, so that the situations that the estimated replacement logic determined each time is different due to insufficient stability of the video quality evaluation information, and the replacement logic is frequently changed, and the video viewing experience of a user is affected are reduced.
S130: and in the case that the current target replacement logic is the replacement video, replacing the source stream video with the transcoding video for video delivery.
When determining that the current target replacement logic is the replacement video, when issuing the video stream to the second user side, for the second user side which originally determines to issue the source stream video according to the user selection and/or the bandwidth condition, the transcoded video obtained by transcoding is used for issuing the source stream video to the second user side instead of the source stream video until the target replacement logic is determined to be the non-replacement video next time, and then the source stream video is issued to the second user side, so that the video playing effect is ensured.
It can be understood that, when the transcoded video obtained by transcoding replaces the source stream video and is sent to the second user side, the video stream received by the second user side is the transcoded video, and the video quality evaluation information of the transcoded video stream reaches the set quality requirement, so that the difference between the display effect of playing the transcoded video and the display effect of playing the source stream video by human eyes is not large, the video watching experience of the user can be ensured, and the code rate of the transcoded video is lower than that of the source stream video, the smoothness of playing the transcoded video by the player is higher, the bandwidth occupied by transmitting the transcoded video is lower, the video transmission is smoother, and the bandwidth cost is effectively saved.
And for the second user side which originally determines the video after the down-conversion (including the video with the highest definition or code rate and the video obtained by the conversion of other definition or code rate) according to the user selection and/or the bandwidth condition, the determined video after the down-conversion is kept.
In one possible embodiment, if the current target replacement logic is not to replace video, then there is no need to replace the source stream video with transcoded video for delivery. Based on the above, the video stream data processing method provided by the present scheme further includes: and in the case that the current target replacement logic is not to replace the video, video issuing is carried out by utilizing the source stream video.
In an exemplary embodiment, when it is determined that the current target replacement logic is not to replace the video, the video type (including the source stream video and the transcoded video) sent to the second user side is determined directly according to the user selection and/or the bandwidth condition, so that the situation that the transcoded video with the video quality evaluation information not meeting the set quality requirement is sent instead of the source stream video, resulting in reduced video playing quality and affecting the user video viewing experience is reduced.
In one possible embodiment, to ensure reliability of video replacement delivery, it may be determined whether replacement logic is needed when the frame rate of the source stream video reaches a set frame rate requirement. Based on this, before determining the pre-estimated replacement logic according to the video quality evaluation information of the transcoded video, further comprising: and determining frame rate information of the source stream video, and determining that estimated replacement logic is required to be determined according to video quality evaluation information of the transcoded video under the condition that the frame rate information of the source stream video reaches a set frame rate threshold.
In an exemplary embodiment, after receiving the source stream video provided by the first user side, determining frame rate information of the source stream video, comparing the frame rate information of the source stream video with a set frame rate threshold, determining that the pre-estimated replacement logic needs to be determined according to video quality evaluation information of the transcoded video when the frame rate information of the source stream video reaches the set frame rate threshold, and continuing a subsequent video stream data processing flow. And when the frame rate information of the source stream video does not reach the set frame rate threshold value, judging that the estimated replacement logic is not required to be determined according to the video quality evaluation information of the transcoded video, and ending the current video stream data processing flow.
It should be explained that, in the video transcoding process, a delay of a certain number of frames is introduced into the transcoded stream (source stream video), so that the lower the frame rate of the source stream video is, the longer the time of the transcoding delay of the source stream video is, and the longer the delay time is, on one hand, the influence on the use of users (such as interaction between audience and anchor), and on the other hand, the fluency of switching the video transmission gear (i.e. switching the down-source stream video or transcoding video) is also influenced. According to the method and the device, when the frame rate of the source stream video does not reach the set frame rate threshold, the subsequent video stream data processing flow is not carried out, the situation that video playing is delayed due to overlarge transcoding delay of the source stream video is reduced, and video watching experience of a user is guaranteed.
In one possible embodiment, to ensure reliability of video replacement delivery, it may be determined whether replacement logic needs to be determined when the transcoding duration of the source stream video is within a set duration threshold. Based on this, before determining the pre-estimated replacement logic according to the video quality evaluation information of the transcoded video, further comprising: and determining a transcoding time length corresponding to the transcoded video obtained by transcoding the source stream video, and determining a pre-estimated replacement logic according to video quality evaluation information of the transcoded video under the condition that the transcoding time length is smaller than a set time length threshold.
After receiving the source stream video provided by the first user side, determining a transcoding duration corresponding to the transcoded video (for example, an average transcoding duration corresponding to each source stream video transcoding in a set time period) by transcoding the source stream video, comparing the transcoding duration with a set duration threshold, determining that pre-estimated replacement logic is required to be determined according to video quality evaluation information of the transcoded video when the transcoding duration is smaller than the set duration threshold, and continuing a subsequent video stream data processing flow. And when the transcoding time length is greater than or equal to the set time length threshold, determining that the estimated replacement logic is not required to be determined according to the video quality evaluation information of the transcoded video, and ending the current video stream data processing flow.
It should be explained that when transcoding (especially soft transcoding) source video, the transcoding service consumes a large amount of computing resources, and there is a case that real-time transcoding cannot be performed due to insufficient computing resources. According to the scheme, when the transcoding duration is greater than or equal to the set duration threshold, the subsequent video stream data processing flow is not performed, the situation that video playing is delayed or fails due to the fact that real-time transcoding of source stream video cannot be performed is reduced, and video watching experience of a user is guaranteed. In one possible embodiment, different set duration thresholds may be set for source stream video at different frame rates, more precisely determining the timing of the replacement logic determination.
According to the method, the estimated replacement logic is determined according to the video quality evaluation information corresponding to the transcoded video obtained by transcoding the source stream video, the current target replacement logic is determined according to the comparison result of the estimated replacement logic and the target replacement logic determined last time, when the current target replacement logic is the replacement video, the transcoded video is utilized to replace the source stream video for video issuing, the bandwidth occupation of video transmission is reduced on the premise of guaranteeing the video watching experience of a user, the video playing smoothness is effectively improved, and the video playing quality is guaranteed. Meanwhile, when the current target replacement logic is not used for replacing the video, the situation that the transcoding video is not used for replacing the source stream video to carry out video distribution is determined, the source stream video is directly used for carrying out video distribution, the situation that the transcoding video which does not meet the set quality requirement of video quality evaluation information is used for replacing the source stream video to carry out distribution is reduced, the video playing quality is reduced, the user video watching experience is affected, and the user video watching experience is guaranteed.
On the basis of the above embodiments, fig. 2 shows a flowchart of another video stream data processing method according to an embodiment of the present application, where the video stream data processing method is specific to the above video stream data processing method. Referring to fig. 2, the video stream data processing method includes:
s210: and acquiring the transcoded video in a set time period, and determining video quality evaluation information of the transcoded video, wherein the transcoded video is obtained by transcoding the source stream video.
For example, whether to replace the source stream video with the transcoded video is determined according to a set time interval (for example, 1 minute), that is, after the video stream is delivered to the second user side for the set time interval, the transcoded video obtained by transcoding the source stream video in the set time interval (for example, a time interval corresponding to the time interval) is obtained, and the average video quality of the transcoded video in the set time interval is calculated, so as to determine the video quality evaluation information. According to the scheme, the replacement logic is determined according to the time interval corresponding to the set time period, the situation that video playing is blocked due to frequent switching of the replacement logic is reduced, and video watching experience of a user is guaranteed.
In one possible embodiment, the peak signal-to-noise ratio can reflect the objective distortion size of the image under the criterion of minimum mean square error MSE (Mean Squared Error), and the calculation complexity is relatively low, and the peak signal-to-noise ratio can be used to reflect the video quality evaluation information, that is, obtain the transcoded videos in a set period of time, and take the average peak signal-to-noise (average PSNR) ratio of these transcoded videos as the video quality evaluation information.
S220: and comparing the video quality evaluation information with a set quality threshold value, and determining estimated replacement logic according to a comparison result.
For example, after determining video quality evaluation information corresponding to the transcoded video within the set period of time, the video quality evaluation information is compared with a set quality threshold, and a pre-estimated replacement logic is determined according to the comparison result. For example, when the video quality evaluation information reaches the set quality threshold, the replacement logic is estimated to replace the video, and when the video quality evaluation information does not reach the set quality threshold, the replacement logic is estimated to not replace the video.
In one possible embodiment, when determining the pre-estimated replacement logic based on the comparison result, the method includes: determining that the estimated replacement logic is a replacement video in response to a comparison result that the video quality evaluation information is greater than or equal to a set quality threshold; and determining that the estimated replacement logic is not to replace the video in response to the comparison result that the video quality evaluation information is smaller than the set quality threshold.
For example, when the comparison result of the video quality evaluation information and the set quality threshold is that the video quality evaluation information is greater than or equal to the set quality threshold, since the viewing effect of the transcoded video is close to the viewing effect of the source stream video at this time, it may be determined that the estimated replacement logic is a replacement video. When the comparison result of the video quality evaluation information and the set quality threshold is that the video quality evaluation information is smaller than the set quality threshold, the estimated replacement logic needs to be determined to not replace the video because the watching effect of the transcoded video is greatly different from the watching effect of the source stream video at the moment, so that the watching experience of the user video is ensured.
In one possible embodiment, the set quality threshold for comparison with the video quality assessment information may be dynamically determined for different subjective assessments of the transcoded video, based on which the present solution further comprises, prior to comparing the video quality assessment information with the set quality threshold: and determining subjective evaluation information of the transcoded video, and determining a set quality threshold according to the subjective evaluation information.
Illustratively, after the transcoded videos within a set period of time are acquired, an average video quality assessment value (average VQA) of these transcoded videos is calculated, and the average video quality assessment value is used as subjective assessment information of the transcoded videos. The average video quality assessment VQA is a reference-free video assessment method, and uses a computational model (machine learning) to predict the video quality that accords with the perception of the human visual system (HVS, human Visual System), and can be applied to videos of different scenes because VQA is a reference-free video assessment method.
In one possible embodiment, different set quality thresholds may be determined in advance based on the range of subjective assessment information that is not used. The video quality evaluation value and the video quality evaluation information are in approximately inverse proportion, and the larger the subjective evaluation information range is, the smaller the corresponding set quality threshold value is.
After the subjective evaluation information of the transcoded video is determined, a corresponding set quality threshold value is determined according to the subjective evaluation information range where the subjective evaluation information is located, and then estimated replacement logic is determined according to the comparison result of the video quality evaluation information and the set quality threshold value. The present approach may utilize the average video quality assessment VQA to determine the set quality threshold to use, more accurately to determine the pre-estimated replacement logic.
S230: and judging whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determining the current target replacement logic based on a judging result.
After the estimated replacement logic is determined, comparing the estimated replacement logic with the target replacement logic determined last time, judging whether the replacement logic is consistent or not, and determining the current target replacement logic according to a judging result. In one possible embodiment, as shown in a schematic diagram of a target replacement logic determination flow based on a determination result provided in fig. 3, when determining whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determining the current target replacement logic based on the determination result, the method includes steps S231-S232:
s231: and judging whether the estimated replacement logic is consistent with the target replacement logic determined last time.
S232: and responding to the judging result of the consistency of the replacement logic, and taking the last determined target replacement logic as the current target replacement logic.
In an exemplary embodiment, when the determination result is that the estimated replacement logic is consistent with the target replacement logic determined last time, the replacement logic is not changed, and the current target replacement logic is kept as the target replacement logic determined last time. I.e. the last time the determined target replacement logic was a replacement video or not, the current target replacement logic is still a replacement video or not. Before the next replacement logic determination period (set period) is reached, the video stream will be delivered according to the currently determined target replacement logic.
S233: and responding to the judging result of inconsistent replacement logic, and determining the current target replacement logic from the estimated replacement logic and the target replacement logic determined last time.
For example, when the judgment result is that the estimated replacement logic is inconsistent with the target replacement logic determined last time, determining one replacement logic from the estimated replacement logic and the target replacement logic determined last time as the current target replacement logic. When the current target replacement logic is determined from the estimated replacement logic and the target replacement logic determined last time, the stability of the video quality evaluation information can be used as a selection basis, when the stability of the video quality evaluation information reaches the set stability requirement, the determined estimated replacement logic can be considered to be the current target replacement logic without frequent change, when the stability of the video quality evaluation information does not reach the set stability requirement, the determined estimated replacement logic can be considered to be the frequent change, the target replacement logic determined last time needs to be kept, and the situation that video playing is blocked due to frequent change of the replacement logic is reduced.
In one possible embodiment, as shown in a schematic diagram of a target replacement logic determination flow based on stability evaluation provided in fig. 4, the present scheme includes steps S2331-S2333 when determining a current target replacement logic from the estimated replacement logic and the target replacement logic determined last time:
s2331: and carrying out stability evaluation on video quality evaluation information of the transcoded video.
For example, when the estimated replacement logic is inconsistent with the target replacement logic determined last time, stability evaluation needs to be performed on video quality evaluation information of the transcoded video, and the replacement logic of the current target replacement logic is determined according to the stability evaluation result. Wherein, when the stability evaluation result indicates that the video quality evaluation information is stable, jumping to step S2332; when the stability evaluation result indicates that the video quality evaluation information is unstable, the process goes to step S2333.
In one possible embodiment, as shown in a flow chart of stability evaluation of video quality evaluation information provided in fig. 5, the method includes steps S23311-S23314 when stability evaluation of video quality evaluation information of transcoded video is performed:
s23311: and judging whether a first difference between the video quality evaluation information and the set quality threshold is larger than a first set difference threshold.
The method includes the steps of calculating video quality evaluation information of transcoded video in a current time period and a first difference of a set quality threshold, comparing the first difference with the set quality threshold, and determining a judgment result of the first difference and the first set quality threshold. When the first gap is greater than the first set gap threshold, the process goes to step S23312, and when the first gap is less than or equal to the first set gap threshold, the process goes to step S23313. Wherein the first gap between the video quality assessment information and the set quality threshold may be an absolute value of a difference between the video quality assessment information and the set quality threshold. For example, assume that video quality evaluation information is PSNR i Setting the quality threshold as PSNR thre Then the first gap is: abs (PSNR) i -PSNR thre ) Where abs () is the absolute value operation.
S23312: and responding to the judgment result that the first gap is larger than the first set gap threshold value, and determining that the stability evaluation result is that the video quality evaluation information is stable.
For example, when the first difference is greater than the first set difference threshold as a result of the determination, it may be determined that the stability evaluation result of the video quality evaluation information is that the video quality evaluation information is stable. After determining the stability evaluation result, the process goes to step S23314.
S23313: and determining a stability evaluation result according to the weighted average evaluation information, the video quality evaluation information and the set quality threshold value which are determined last time in response to the judgment result that the first gap is smaller than or equal to the first set gap threshold value.
For example, when the first difference is less than or equal to the first set difference threshold as the judgment result, it is necessary to comprehensively judge whether the video quality evaluation information is stable according to the weighted average evaluation information, the video quality evaluation information, and the set quality threshold determination stability evaluation result determined last time. For example, when the difference between the weighted average evaluation information and the set quality threshold value is within the set range and the weighted average evaluation information and the video quality evaluation information agree with each other with respect to the judgment of the set quality threshold value, the video quality evaluation information is considered to be stable, otherwise the video quality evaluation information is considered to be unstable. After determining the stability evaluation result, the process goes to step S23314.
The weighted average evaluation information is obtained by performing weighted operation on the basis of video quality evaluation information obtained by historical calculation, and the weighted average evaluation information is taken as consideration of a stability evaluation result to effectively evaluate the stability of the current video quality evaluation information relative to the latest video quality evaluation information. The weighted average evaluation information determined last time is the weighted average evaluation information determined in the previous video stream data processing method flow, and correspondingly, the weighted average evaluation information updated in the subsequent step S23314 will be used as the weighted average evaluation information determined last time used in the next video stream data processing method flow to determine the stability evaluation result.
In one possible embodiment, when determining the stability evaluation result according to the weighted average evaluation information, the video quality evaluation information, and the set quality threshold value that were determined last time, the method includes:
judging whether the second difference between the weighted average evaluation information determined last time and the set quality threshold is larger than the second set difference threshold, and judging whether the size of the video quality evaluation information is consistent with the size of the set quality threshold; responding to the judgment result that the second difference is larger than a second set difference threshold value and the size judgment result is consistent, and determining that the stability evaluation result is stable in video quality evaluation information; and responding to the judgment result that the second difference is smaller than or equal to a second set difference threshold value and/or the size judgment result is inconsistent, and determining that the stability evaluation result is unstable in video quality evaluation information.
In an exemplary embodiment, when the first difference is less than or equal to the first set difference threshold as a result of the determination, a second difference between the weighted average evaluation information determined last time and the set quality threshold is calculated, and whether the second difference is greater than the second set difference threshold is determined. Wherein the second gap may be an absolute value of a difference between the weighted average evaluation information determined last time and the set quality threshold. For example, assume that the weighted average evaluation information determined last time is WPSNR i-1 Setting the quality threshold as PSNR thre Then the second gap is: abs (WPSNR) i-1 -PSNR thre )。
And simultaneously, determining the size judgment results of the video quality evaluation information and the set quality threshold, determining the size judgment results of the weighted average evaluation information determined last time and the set quality threshold, and judging whether the two size judgment results are consistent. And judging whether the video quality evaluation information and the weighted average evaluation information determined last time are both larger than or smaller than a set quality threshold, and judging whether the video quality evaluation information and the weighted average evaluation information determined last time are both larger than or smaller than the set quality threshold or not, if not, judging that the two size judgment results are consistent, otherwise, judging that the two size judgment results are inconsistent.
Judging whether the second gap is larger than a second set gap threshold value or not, judging whether the two size judgment results are consistent or not, and determining that the stability evaluation result is stable in video quality evaluation information when the second gap is larger than the second set gap threshold value and the two size judgment results are consistent. And when the second difference is smaller than or equal to a second set difference threshold value and/or the two size judgment results are inconsistent, determining that the stability evaluation result is unstable in video quality evaluation information. Wherein the first set difference is greater than the second set difference threshold.
S23314: the current weighted average rating information is determined based on the set weighting coefficient, the weighted average rating information determined last time, and the video quality rating information.
Illustratively, the current weighted average rating information is calculated according to the set weighting coefficient, the last determined weighted average rating information and the video quality rating information, and the current weighted average rating information is used as the last determined weighted average rating information in the flow of the next video stream data processing method.
S2332: and responding to a stability evaluation result of the stability of the video quality evaluation information, and taking the estimated replacement logic as the current target replacement logic.
S2333: and responding to the stability evaluation result of unstable video quality evaluation information, and taking the last determined target replacement logic as the current target replacement logic.
In an exemplary embodiment, when the stability evaluation result indicates that the video quality evaluation information is stable, the estimated replacement logic is used as the current target replacement logic, and when the stability evaluation result indicates that the video quality evaluation information is unstable, the target replacement logic determined last time is used as the current target replacement logic, so that the situation that the type of the video stream is frequently changed to the second user side, resulting in playing stuck and affecting the video playing experience is reduced.
For example, at time i, assume that the quality threshold is set to PSNR thre The currently determined video quality evaluation information is PSNR i The weighted average evaluation information determined last time is WPSNR i-1 The estimated replacement logic isThe last time (i-1 time) the target replacement logic was determined to be D i-1 The first set gap threshold value is α, the second set gap threshold value is β, the set weighting coefficient is λ, and the first set gap threshold value α=1.0, the second set gap threshold value β=0.5, the set weighting coefficient λ=0.8 are assumed.
According toVideo quality evaluation information determination pre-estimated replacement logic for transcoded videoThen, judging the estimated replacement logic as +.>And the last target replacement logic is D i-1 Whether or not it is consistent, if->Then the current target replacement logic D is determined i ＝D i-1 . If->Further judging video quality evaluation information PSNR i Whether abs (PSNR) is satisfied i -PSNR thre )>Alpha, if yes, determining the current target replacement logic +.>If not, it is further determined whether abs (WPSNR i-1 -PSNR thre )>Beta, and the video quality rating information is PSNR i And weighted average evaluation information is WPSNR i-1 Are all greater than or all less than the set quality threshold as PSNRthre, if so, determining the current target replacement logic +.>If not, determining the current target replacement logic D i ＝D i-1 。
In determining the current target replacement logic D i Thereafter, the current weighted average evaluation information WPSNR is calculated i ＝λWPSNR i-1 +(1-λ)PSNR i 。
S240: and in the case that the current target replacement logic is the replacement video, replacing the source stream video with the transcoding video for video delivery.
According to the method, the estimated replacement logic is determined according to the video quality evaluation information corresponding to the transcoded video obtained by transcoding the source stream video, the current target replacement logic is determined according to the comparison result of the estimated replacement logic and the target replacement logic determined last time, when the current target replacement logic is the replacement video, the transcoded video is utilized to replace the source stream video for video issuing, the bandwidth occupation of video transmission is reduced on the premise of guaranteeing the video watching experience of a user, the video playing smoothness is effectively improved, and the video playing quality is guaranteed. And meanwhile, a set quality threshold value is determined according to subjective evaluation information, and then estimated replacement logic is more accurately determined according to a comparison result of video quality evaluation information and the set quality threshold value. And the current target replacement logic is determined according to the stability evaluation result of the stability of the video quality evaluation information, so that the situation that the video quality evaluation information is wander near a set quality threshold to cause frequent replacement of the target replacement logic, thereby causing play jam and affecting video play experience is reduced, the change frequency of the target replacement logic is reduced, and the video play fluency is ensured.
Fig. 6 is a schematic structural diagram of a video stream data processing apparatus according to an embodiment of the present application. Referring to fig. 6, the video stream data processing apparatus includes a logic estimation module 61, a logic determination module 62, and a video replacement module 63.
The logic predicting module 61 is configured to determine a predicting replacement logic according to video quality evaluation information of the transcoded video, wherein the transcoded video is obtained by transcoding the source stream video; the logic determining module 62 is configured to determine whether the estimated replacement logic is consistent with the target replacement logic determined last time, and determine the current target replacement logic based on the determination result; the video replacement module 63 is configured to replace the source stream video with the transcoded video for video delivery in case the current target replacement logic is a replacement video.
According to the method, the estimated replacement logic is determined according to the video quality evaluation information corresponding to the transcoded video obtained by transcoding the source stream video, the current target replacement logic is determined according to the comparison result of the estimated replacement logic and the target replacement logic determined last time, when the current target replacement logic is the replacement video, the transcoded video is utilized to replace the source stream video for video issuing, the bandwidth occupation of video transmission is reduced on the premise of guaranteeing the video watching experience of a user, the video playing smoothness is effectively improved, and the video playing quality is guaranteed.
In one possible embodiment, the logic predictor module 61, when determining the predictor replacement logic from video quality assessment information for the transcoded video, is configured to:
acquiring a transcoding video in a set time period, and determining video quality evaluation information of the transcoding video;
comparing the video quality evaluation information with a set quality threshold;
determining that the estimated replacement logic is a replacement video in response to a comparison result that the video quality evaluation information is greater than or equal to a set quality threshold;
and determining that the estimated replacement logic is not to replace the video in response to the comparison result that the video quality evaluation information is smaller than the set quality threshold.
In a possible embodiment, the video stream data processing apparatus further comprises a threshold determining module configured to determine subjective rating information of the transcoded video and to determine the set quality threshold based on the subjective rating information before the comparison of the video quality rating information and the set quality threshold by the logic pre-estimating module 61.
In one possible embodiment, the logic determination module 62, when determining the current target replacement logic based on the determination result, is configured to:
responding to the judgment result of the consistency of the replacement logic, and taking the last determined target replacement logic as the current target replacement logic;
And responding to the judging result of inconsistent replacement logic, and determining the current target replacement logic from the estimated replacement logic and the target replacement logic determined last time.
In one possible embodiment, the logic determination module 62, when determining the current target replacement logic from the pre-estimated replacement logic and the last determined target replacement logic, is configured to:
performing stability evaluation on video quality evaluation information of the transcoded video;
responding to a stability evaluation result of video quality evaluation information stability, and taking the estimated replacement logic as the current target replacement logic;
and responding to the stability evaluation result of unstable video quality evaluation information, and taking the last determined target replacement logic as the current target replacement logic.
In one possible embodiment, logic determination module 62, when performing stability assessment of video quality assessment information of the transcoded video, is configured to:
judging whether a first difference between the video quality evaluation information and the set quality threshold is larger than a first set difference threshold;
responding to the judgment result that the first gap is larger than the first set gap threshold value, and determining that the stability evaluation result is that the video quality evaluation information is stable;
Determining a stability evaluation result according to the weighted average evaluation information, the video quality evaluation information and the set quality threshold value which are determined last time in response to the judgment result that the first gap is smaller than or equal to the first set gap threshold value;
the current weighted average rating information is determined based on the set weighting coefficient, the weighted average rating information determined last time, and the video quality rating information.
In one possible embodiment, the logic determination module 62, when determining the stability assessment result from the weighted average assessment information, the video quality assessment information, and the set quality threshold value, is configured to:
judging whether the second difference between the weighted average evaluation information determined last time and the set quality threshold is larger than the second set difference threshold, and judging whether the size of the video quality evaluation information is consistent with the size of the set quality threshold;
responding to the judgment result that the second difference is larger than a second set difference threshold value and the size judgment result is consistent, and determining that the stability evaluation result is stable in video quality evaluation information;
and responding to the judgment result that the second difference is smaller than or equal to a second set difference threshold value and/or the size judgment result is inconsistent, and determining that the stability evaluation result is unstable in video quality evaluation information.
In a possible embodiment, the video stream data processing apparatus further comprises a video holding module configured to utilize the source stream video for video delivery in case the current target replacement logic is not replacing video.
In one possible embodiment, the video stream data processing apparatus further includes a frame rate judging module configured to determine frame rate information of the source stream video before the logic predicting module 61 determines the predicted replacement logic according to the video quality evaluation information of the transcoded video, and judge whether the determination of the replacement logic is required according to the frame rate information.
In one possible embodiment, the video stream data processing apparatus further includes a duration judging module configured to determine a transcoding duration corresponding to the transcoded video obtained by transcoding the source stream video before the logic predicting module 61 determines the predicted replacement logic according to the video quality evaluation information of the transcoded video, and judge whether the replacement logic needs to be determined according to the transcoding duration.
It should be noted that, in the embodiment of the component rendering apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
The embodiment of the application also provides video stream data processing equipment which can integrate the video stream data processing device. Fig. 7 is a schematic structural diagram of a video stream data processing apparatus according to an embodiment of the present application. Referring to fig. 7, the video stream data processing apparatus includes: an input device 73, an output device 74, a memory 72, and one or more processors 71; a memory 72 for storing one or more programs; the one or more programs, when executed by the one or more processors 71, cause the one or more processors 71 to implement the video stream data processing method as provided in the above embodiments. The video stream data processing device, the video stream data processing equipment and the video stream data processing computer provided by the embodiment can be used for executing the video stream data processing method provided by any embodiment, and have corresponding functions and beneficial effects.
The present embodiments also provide a storage medium storing computer-executable instructions that, when executed by a computer processor, are configured to perform a video stream data processing method as provided by the above embodiments. Of course, the storage medium storing the computer executable instructions provided in the embodiments of the present application is not limited to the video stream data processing method provided above, and may also perform the related operations in the video stream data processing method provided in any embodiment of the present application. The video stream data processing apparatus, device and storage medium provided in the foregoing embodiments may perform the video stream data processing method provided in any embodiment of the present application, and technical details not described in detail in the foregoing embodiments may be referred to the video stream data processing method provided in any embodiment of the present application.
In some possible implementations, various aspects of the methods provided by the present disclosure may also be implemented in the form of a program product comprising program code for causing a computer device as described above to carry out the steps of the methods according to the various exemplary embodiments of the present disclosure, when the program product is run on the computer device, for example, the computer device may carry out the video stream data processing methods described in the embodiments of the present disclosure. Wherein the program product may employ any combination of one or more readable media.
Claims (11)
1. A method for processing video stream data, comprising:
determining estimated replacement logic according to video quality evaluation information of a transcoded video, wherein the transcoded video is obtained by transcoding a source stream video, and the estimated replacement logic comprises a replaced video and a non-replaced video;
judging whether the estimated replacement logic is consistent with the target replacement logic determined last time, and responding to the judgment result of the consistency of the replacement logic, and taking the target replacement logic determined last time as the current target replacement logic; responding to the judgment result of inconsistent replacement logic, judging whether the first difference between the video quality evaluation information and the set quality threshold is larger than a first set difference threshold; responding to the judgment result that the first difference is larger than the first set difference threshold value, and determining that the stability evaluation result is that the video quality evaluation information is stable; determining a stability evaluation result according to the weighted average evaluation information, the video quality evaluation information and the set quality threshold value which are determined last time in response to the judgment result that the first gap is smaller than or equal to the first set gap threshold value; determining current weighted average evaluation information based on a set weighting coefficient, the weighted average evaluation information determined last time and the video quality evaluation information; responding to a stability evaluation result of the video quality evaluation information stability, and taking the estimated replacement logic as a current target replacement logic; responding to the unstable stability evaluation result of the video quality evaluation information, and taking the last determined target replacement logic as the current target replacement logic;
And under the condition that the current target replacement logic is a replacement video, replacing the source stream video by the transcoding video, and performing video distribution on a second user end which originally receives the source stream video.
2. The method of claim 1, wherein determining the pre-estimated replacement logic based on video quality rating information of the transcoded video comprises:
acquiring a transcoding video in a set time period, and determining video quality evaluation information of the transcoding video;
comparing the video quality evaluation information with a set quality threshold;
determining that the estimated replacement logic is a replacement video in response to a comparison result that the video quality evaluation information is greater than or equal to the set quality threshold;
and determining that the estimated replacement logic does not replace the video in response to the comparison result that the video quality evaluation information is smaller than the set quality threshold.
3. The video stream data processing method according to claim 2, wherein before comparing the video quality evaluation information with a set quality threshold, further comprising:
and determining subjective evaluation information of the transcoding video, and determining a set quality threshold according to the subjective evaluation information.
4. The video stream data processing method according to claim 1, wherein the determining a stability evaluation result from the last determined weighted average evaluation information, the video quality evaluation information, and the set quality threshold value includes:
judging whether a second difference between the weighted average evaluation information determined last time and the set quality threshold is larger than a second set difference threshold, and judging whether the size of the video quality evaluation information and the set quality threshold is consistent with the size of the weighted average evaluation information determined last time and the set quality threshold;
responding to the judgment result that the second difference is larger than the second set difference threshold and the size judgment result is consistent, and determining that the stability evaluation result is stable in the video quality evaluation information;
and responding to the judgment result that the second difference is smaller than or equal to the second set difference threshold value and/or the size judgment result is inconsistent, and determining that the stability evaluation result is unstable in the video quality evaluation information.
5. The video stream data processing method according to claim 1, characterized in that the method further comprises:
And in the case that the current target replacement logic is not to replace the video, video issuing is carried out by utilizing the source stream video.
6. The method according to any one of claims 1 to 5, wherein before determining the pre-estimated replacement logic according to video quality evaluation information of the transcoded video, further comprising:
and determining frame rate information of the source stream video, and determining that estimated replacement logic is required to be determined according to video quality evaluation information of the transcoded video under the condition that the frame rate information of the source stream video reaches a set frame rate threshold.
7. The method according to any one of claims 1 to 5, wherein before determining the pre-estimated replacement logic according to video quality evaluation information of the transcoded video, further comprising:
and determining a transcoding time length corresponding to the transcoded video obtained by transcoding the source stream video, and determining that the estimated replacement logic is required to be determined according to video quality evaluation information of the transcoded video under the condition that the transcoding time length is smaller than a set time length threshold value.
8. The video stream data processing device is characterized by comprising a logic pre-estimating module, a logic determining module and a video replacing module, wherein:
The logic estimation module is configured to determine estimated replacement logic according to video quality evaluation information of a transcoded video, wherein the transcoded video is obtained by transcoding a source stream video, and the estimated replacement logic comprises a replaced video and a non-replaced video;
the logic determination module is configured to determine whether the estimated replacement logic is consistent with the target replacement logic determined last time, and respond to the determination result that the replacement logic is consistent, and take the target replacement logic determined last time as the current target replacement logic; responding to the judgment result of inconsistent replacement logic, judging whether the first difference between the video quality evaluation information and the set quality threshold is larger than a first set difference threshold; responding to the judgment result that the first difference is larger than the first set difference threshold value, and determining that the stability evaluation result is that the video quality evaluation information is stable; determining a stability evaluation result according to the weighted average evaluation information, the video quality evaluation information and the set quality threshold value which are determined last time in response to the judgment result that the first gap is smaller than or equal to the first set gap threshold value; determining current weighted average evaluation information based on a set weighting coefficient, the weighted average evaluation information determined last time and the video quality evaluation information; responding to a stability evaluation result of the video quality evaluation information stability, and taking the estimated replacement logic as a current target replacement logic; responding to the unstable stability evaluation result of the video quality evaluation information, and taking the last determined target replacement logic as the current target replacement logic;
The video replacing module is configured to replace the source stream video with the transcoding video and perform video distribution on a second user end which originally receives the source stream video when the current target replacing logic is the replacing video.
9. A video stream data processing apparatus, comprising: a memory and one or more processors;
the memory is used for storing one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the video stream data processing method of any of claims 1-7.
10. A storage medium storing computer executable instructions which, when executed by a computer processor, are for performing the video stream data processing method according to any one of claims 1 to 7.
11. A computer program product comprising a computer program, characterized in that the computer program, when executed by a processor, implements the video stream data processing method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210392401.0A CN115002520B (en) | 2022-04-14 | 2022-04-14 | Video stream data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210392401.0A CN115002520B (en) | 2022-04-14 | 2022-04-14 | Video stream data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115002520A CN115002520A (en) | 2022-09-02 |
| CN115002520B true CN115002520B (en) | 2024-04-02 |
Family
ID=83023643
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210392401.0A Active CN115002520B (en) | 2022-04-14 | 2022-04-14 | Video stream data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115002520B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107633030A (en) * | 2017-09-04 | 2018-01-26 | 深圳市华傲数据技术有限公司 | Credit estimation method and device based on data model |
| CN111107395A (en) * | 2019-12-31 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transcoding method, device, server and storage medium |
| CN111726656A (en) * | 2020-07-20 | 2020-09-29 | 有半岛(北京)信息科技有限公司 | Transcoding method, device, server and storage medium for live video |
| CN111970565A (en) * | 2020-09-21 | 2020-11-20 | Oppo广东移动通信有限公司 | Video data processing method and device, electronic equipment and storage medium |
| WO2021137856A1 (en) * | 2019-12-31 | 2021-07-08 | Google Llc | Optimal format selection for video players based on predicted visual quality using machine learning |
| CN113411643A (en) * | 2021-05-26 | 2021-09-17 | 中国人民解放军国防科技大学 | Video quality optimization method, system, electronic equipment and storage medium |
| WO2021236059A1 (en) * | 2020-05-19 | 2021-11-25 | Google Llc | Dynamic parameter selection for quality-normalized video transcoding |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113676754B (en) * | 2021-08-18 | 2023-08-29 | 上海哔哩哔哩科技有限公司 | Live video transcoding method and device |
-
2022
- 2022-04-14 CN CN202210392401.0A patent/CN115002520B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107633030A (en) * | 2017-09-04 | 2018-01-26 | 深圳市华傲数据技术有限公司 | Credit estimation method and device based on data model |
| CN111107395A (en) * | 2019-12-31 | 2020-05-05 | 广州市百果园网络科技有限公司 | Video transcoding method, device, server and storage medium |
| WO2021137856A1 (en) * | 2019-12-31 | 2021-07-08 | Google Llc | Optimal format selection for video players based on predicted visual quality using machine learning |
| WO2021236059A1 (en) * | 2020-05-19 | 2021-11-25 | Google Llc | Dynamic parameter selection for quality-normalized video transcoding |
| CN111726656A (en) * | 2020-07-20 | 2020-09-29 | 有半岛(北京)信息科技有限公司 | Transcoding method, device, server and storage medium for live video |
| CN111970565A (en) * | 2020-09-21 | 2020-11-20 | Oppo广东移动通信有限公司 | Video data processing method and device, electronic equipment and storage medium |
| CN113411643A (en) * | 2021-05-26 | 2021-09-17 | 中国人民解放军国防科技大学 | Video quality optimization method, system, electronic equipment and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| Hybrid transcoding for QoS adaptive video-on-demand services;Ilhoon Shin; Kern Koh;《IEEE Transactions on Consumer Electronics 》;第50卷(第2期);732-736 * |
| VoLTE码率基于云计算的直播流按需转码机制研究;石启森;《中国优秀硕士学位论文全文数据库 信息科技辑》(第02期);41-45 * |
| 网络化视频指挥调度系统中传输控制研究;王军明 ；陈勇;《软件》;第33卷(第11期);141-144 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115002520A (en) | 2022-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107211193B (en) | Intelligent adaptive video streaming method and system driven by perception experience quality estimation | |
| US8804815B2 (en) | Support vector regression based video quality prediction | |
| CN110149555B (en) | Video processing method and video receiving device | |
| US10362264B2 (en) | Profile for frame rate conversion | |
| JP2008504750A5 (en) | ||
| US10038898B2 (en) | Estimating quality of a video signal | |
| CN111182303A (en) | Encoding method and device for shared screen, computer readable medium and electronic equipment | |
| US10070136B2 (en) | Statistical multiplexing with heterogeneous encoder pool | |
| JP2008500752A (en) | Adaptive decoding of video data | |
| CN110166796B (en) | Video frame processing method and device, computer readable medium and electronic equipment | |
| CN111182300B (en) | Method, device and equipment for determining coding parameters and storage medium | |
| CN111263243B (en) | Video coding method and device, computer readable medium and electronic equipment | |
| CN111182352B (en) | Adaptive code stream control device and method for video playing | |
| CN109729353B (en) | Video coding method, device, system and medium | |
| CN114245209B (en) | Video resolution determination, model training and video coding method and device | |
| CN114584835B (en) | Video processing method, device, equipment and storage medium | |
| CN115002520B (en) | Video stream data processing method, device, equipment and storage medium | |
| KR20030024839A (en) | Method and system for displaying a video frame | |
| CN110891195B (en) | Method, device and equipment for generating screen image and storage medium | |
| CN109640094B (en) | Video decoding method and device and electronic equipment | |
| JP5471328B2 (en) | Moving picture playback apparatus, moving picture playback method, and program | |
| EP3264284B1 (en) | Data processing method and device | |
| Li et al. | Perceptual quality assessment of face video compression: A benchmark and an effective method | |
| Akramullah et al. | Video quality metrics | |
| CN115665485B (en) | Video picture optimization method and device, storage medium and video terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |