CN114584821A - Video processing method and device - Google Patents

Video processing method and device Download PDF

Info

Publication number
CN114584821A
CN114584821A CN202210200321.0A CN202210200321A CN114584821A CN 114584821 A CN114584821 A CN 114584821A CN 202210200321 A CN202210200321 A CN 202210200321A CN 114584821 A CN114584821 A CN 114584821A
Authority
CN
China
Prior art keywords
video
image frame
time stamp
current image
mask
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210200321.0A
Other languages
Chinese (zh)
Other versions
CN114584821B (en
Inventor
黄钊金
戴宇荣
陶鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN202210200321.0A priority Critical patent/CN114584821B/en
Publication of CN114584821A publication Critical patent/CN114584821A/en
Application granted granted Critical
Publication of CN114584821B publication Critical patent/CN114584821B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43074Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/854Content authoring
    • H04N21/8547Content authoring involving timestamps for synchronizing content

Abstract

The disclosure relates to a video processing method and device. The method comprises the following steps: acquiring a rendering time stamp of a current image frame in a video, wherein the rendering time stamp is used for indicating the time when a mask of the current image frame in the video is rendered, and the mask is a mask aiming at a preset object in the current image frame; acquiring a first playing time stamp of a current image frame in a video, wherein the first playing time stamp is used for indicating the time for starting playing the current image frame in the video; acquiring a second playing time stamp of a current image frame in a transcoded video corresponding to the video, wherein the second playing time stamp is used for indicating the time for starting playing the current image frame in the transcoded video; determining that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.

Description

Video processing method and device
Technical Field
The present disclosure relates to the field of video processing, and in particular, to a video processing method and apparatus.
Background
Barrage has become the indispensable way of communication for users to watch videos, and the barrage full of holes greatly enriches the watching experience and fun, however, the dense barrage often causes some other troubles, such as: the bullet screen blocking technology appears by blocking key people, key buildings and the like. Taking a bullet screen portrait as an example, the bullet screen portrait blocking technology uses a portrait segmentation algorithm to generate a mask for the portrait, and then the bullet screen only appears outside the mask. However, in an actual situation, a mask generated by the portrait segmentation algorithm may be delayed during playing, that is, slower than the playing of the video, for example, the problem of mask delay of the barrage barrier shown in fig. 1 occurs, the mask of the portrait in the left image of fig. 1 is delayed to the next image frame (that is, the right image of fig. 1), so that the portrait in the right image is blocked, and this problem of mask delay may bring a poor experience to the user, so that the user cannot well watch the video while watching the barrage. Furthermore, if the problem of mask delay occurs when the video enhancement is performed by masking, the video enhancement effect is not ideal.
Disclosure of Invention
The present disclosure provides a video processing method and apparatus, so as to at least solve the problem that the related art does not consider mask delay when a terminal plays a video.
According to a first aspect of the embodiments of the present disclosure, there is provided a video processing method, including: acquiring a rendering time stamp of a current image frame in a video, wherein the rendering time stamp is used for indicating the time when a mask of the current image frame in the video is rendered, and the mask is a mask aiming at a preset object in the current image frame; acquiring a first playing time stamp of a current image frame in a video, wherein the first playing time stamp is used for indicating the time for starting playing the current image frame in the video; acquiring a second playing time stamp of a current image frame in a transcoded video corresponding to the video, wherein the second playing time stamp is used for indicating the time for starting playing the current image frame in the transcoded video; determining that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.
Optionally, after determining that the masking delay occurs, further comprising: and in the case that the first playing time stamp and the second playing time stamp are inconsistent, adjusting transcoding parameters for transcoding the video to the transcoded video.
Optionally, adjusting transcoding parameters for transcoding video to transcoded video comprises: and adjusting the parameters used for changing the frame rate of the video in the transcoding parameters to target parameters, wherein the target parameters are used for controlling the interval of each image frame in the transcoded video to be in a preset time in the process of transcoding the video to the transcoded video.
Optionally, after adjusting the transcoding parameters for transcoding the video to the transcoded video, further comprising: transcoding the video into a new transcoded video again based on the adjusted transcoding parameters, wherein the interval of each image frame in the new transcoded video is preset time; and re-playing the new transcoded video and rendering the mask onto the current image frame in the new transcoded video through the player.
Optionally, the method further comprises: and under the condition that a barrage aiming at the new transcoded video is received, detecting a mask on a current image frame of the new transcoded video, and bypassing the mask to display the barrage on the current image frame.
Optionally, the method further comprises: and under the condition that the information for indicating the enhancement of the predetermined object is received, detecting a mask on a current image frame of the new transcoded video playing, and enhancing a region corresponding to the mask on the current image frame.
Optionally, after determining that the masking delay occurs, further comprising: adjusting player parameters for playing the video and/or transcoding the video if the first play timestamp or the second play timestamp is less than the rendering timestamp.
Optionally, adjusting player parameters for playing the video and/or transcoding the video includes at least one of: increasing the rendering frequency for rendering the mask onto the current image frame; and replacing the current rendering frame for rendering the mask on the current image frame with a target rendering frame with a rendering speed greater than that of the current rendering frame.
Optionally, after adjusting the player parameters for playing the transcoded video, the method further includes: and through the player corresponding to the increased rendering frequency and/or the target rendering frame, the video and/or the transcoded video is replayed, and the mask is rendered on the current image frame in the video and/or the transcoded video.
Optionally, the method further comprises: under the condition that a barrage aiming at the video and/or the transcoded video is received, detecting a mask on a current image frame of the video and/or the transcoded video, and bypassing the mask to display the barrage on the current image frame; in the case that the information for indicating the enhancement of the predetermined object is received, a mask on a current image frame of the video and/or the transcoded video playing is detected, and a region corresponding to the mask on the current image frame is enhanced.
According to a second aspect of the embodiments of the present disclosure, there is provided a video processing apparatus including: a rendering time stamp obtaining unit configured to obtain a rendering time stamp of a current image frame in the video, wherein the rendering time stamp is used for indicating a time when a mask of the current image frame in the video is rendered, and the mask is a mask for a predetermined object in the current image frame; the first playing time stamp acquiring unit is configured to acquire a first playing time stamp of a current image frame in the video, wherein the first playing time stamp is used for indicating the time when the current image frame in the video starts to be played; the second playing time stamp obtaining unit is configured to obtain a second playing time stamp of a current image frame in the transcoded video corresponding to the video, wherein the second playing time stamp is used for indicating the time for starting playing of the current image frame in the transcoded video; a determination unit configured to determine that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.
Optionally, the determining unit is further configured to, after determining that the masking delay occurs, adjust transcoding parameters for transcoding the video to the transcoded video if the first play timestamp and the second play timestamp do not coincide.
Optionally, the determining unit is further configured to adjust a parameter for changing a frame rate of the video in the transcoding parameters to a target parameter, wherein the target parameter is used for controlling an interval of each image frame in the transcoded video to be a predetermined time in the process of transcoding the video into the transcoded video.
Optionally, the determining unit is further configured to, after adjusting the transcoding parameters for transcoding the video to the transcoded video, re-transcode the video to a new transcoded video based on the adjusted transcoding parameters, wherein the interval of each image frame in the new transcoded video is a predetermined time; and re-playing the new transcoded video and rendering the mask onto the current image frame in the new transcoded video through the player.
Optionally, the processing unit is configured to, in a case that a barrage for a new transcoded video is received, detect a mask on a current image frame of the new transcoded video playing, and bypass the mask to display the barrage on the current image frame; and in the case of receiving the information for indicating the enhancement of the predetermined object, detecting a mask on a current image frame of the new transcoded video playing, and enhancing a region corresponding to the mask on the current image frame.
Optionally, the determining unit is further configured to, after determining that the masking delay occurs, adjust player parameters for playing the video and/or transcoding the video if the first play timestamp or the second play timestamp is less than the rendering timestamp.
Optionally, the determining unit is further configured to increase a rendering frequency for rendering the mask onto the current image frame; and replacing the current rendering frame for rendering the mask on the current image frame with a target rendering frame with a rendering speed greater than that of the current rendering frame.
Optionally, the determining unit is further configured to, after adjusting the transcoding parameters for transcoding the video to the transcoded video, replay the video and/or the transcoded video and render the mask onto the current image frame in the video and/or the transcoded video through the player corresponding to the increased rendering frequency and/or the target rendering frame.
Optionally, the processing unit is configured to, in a case where a barrage for the video and/or the transcoded video is received, detect a mask on a current image frame of the video and/or the transcoded video playing, and display the barrage on the current image frame by bypassing the mask.
Optionally, the processing unit is configured to, in a case where information indicating that the predetermined object is to be enhanced is received, detect a mask on a current image frame of the video and/or the transcoded video playing, and enhance a region corresponding to the mask on the current image frame.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the video processing method according to the present disclosure.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions, when executed by at least one processor, cause the at least one processor to perform a video processing method as described above according to the present disclosure.
According to a seventh aspect of embodiments of the present disclosure, there is provided a computer program product comprising computer instructions which, when executed by a processor, implement a video processing method according to the present disclosure.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
according to the video processing method and device, the playing time stamp of the current image frame in the video and the transcoded video for starting playing and the rendering time stamp of the mask rendering end in the current image frame in the video are monitored, when the playing time stamps of the current image frame in the video and the transcoded video are not consistent, because the masks are obtained based on the video, namely the playing time stamp of each mask is matched with the playing time stamp of the corresponding image frame in the video, if the playing time stamps of the current image frame in the video and the transcoded video are not consistent, the playing time stamp of the corresponding mask is not matched with the playing time stamp of the current image frame in the transcoded video, the mask which does not belong to the current image frame is rendered on the current image frame easily during rendering, and the problem of mask delay is caused; and when the timestamp of the beginning broadcast of video and transcoding video is less than the rendering timestamp of mask, namely the mask has not been rendered yet when playing current image frame, also can lead to the problem that the mask delays, consequently, this disclosure can effectually detect the problem that takes place the mask delay to follow-up can adjust to this problem, promotes user experience and feels. Therefore, the method and the device solve the problem that the masking delay existing when the terminal plays the video is not considered in the related art.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a diagram illustrating a related art problem of occurrence of a mask delay;
fig. 2 is an implementation scenario diagram illustrating a video processing method according to an exemplary embodiment of the present disclosure;
FIG. 3 is a flow diagram illustrating a video processing method according to an exemplary embodiment;
FIG. 4 is a business process diagram according to an exemplary embodiment;
FIG. 5 is a block diagram illustrating a video processing device according to an example embodiment;
fig. 6 is a block diagram of an electronic device 600 according to an embodiment of the disclosure.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
In this case, the phrase "at least one of the plurality of items" in the present disclosure means that the three parallel cases including "any one of the plurality of items", "a combination of any plurality of the plurality of items", and "the entirety of the plurality of items" are included. For example, "include at least one of a and B" includes the following three cases in parallel: (1) comprises A; (2) comprises B; (3) including a and B. For another example, "at least one of the first step and the second step is performed", which means that the following three cases are juxtaposed: (1) executing the step one; (2) executing the step two; (3) and executing the step one and the step two.
The present disclosure provides a video processing method, which can effectively detect the problem of mask delay, and the following description will take a video playing scene as an example.
Fig. 2 is a schematic diagram illustrating an implementation scenario of a video processing method according to an exemplary embodiment of the present disclosure, and as shown in fig. 2, the implementation scenario includes a server 100, a user terminal 110, and a user terminal 120, where the number of the user terminals is not limited to 2, and includes not limited to a mobile phone, a personal computer, and the like, the user terminal may play an application program of a video, and the server may be one server, or several servers may form a server cluster, or may be a cloud computing platform or a virtualization center.
The user terminal 110 or 120 acquires a video to be played from the server 100 and plays the video, and during the video playing process, the server 100 may acquire a rendering timestamp of a current image frame in the video in real time, where the rendering timestamp is used to indicate a time when a mask of the current image frame in the video is rendered, and the mask is a mask for a predetermined object in the current image frame; acquiring a first playing time stamp of a current image frame in a video, wherein the first playing time stamp is used for indicating the time for starting playing the current image frame in the video; acquiring a second playing time stamp of a current image frame in a transcoded video corresponding to the video, wherein the second playing time stamp is used for indicating the time for starting playing the current image frame in the transcoded video; determining that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp. At this time, the server may adjust for the mask delay problem, for example, adjust the transcoding parameters for transcoding the video to the transcoded video when the first playing timestamp and the second playing timestamp are not consistent; adjusting player parameters for playing the video and/or transcoding the video if the first play timestamp or the second play timestamp is less than the rendering timestamp. And after the adjustment is finished, sending the adjusted video to the user terminal 110 or 120, and playing the corresponding video by the user terminal 110 or 120 by using the adjusted player.
Hereinafter, a video processing method and apparatus according to an exemplary embodiment of the present disclosure will be described in detail with reference to the accompanying drawings.
Fig. 3 is a flow chart illustrating a video processing method according to an exemplary embodiment, as shown in fig. 3, the video processing method including the steps of:
in step S301, a rendering timestamp of a current image frame in the video is acquired, where the rendering timestamp is used to indicate a time when a mask of the current image frame in the video is rendered, and the mask is a mask for a predetermined object in the current image frame. The rendering time stamp can be acquired in real time so as to timely judge whether the masking delay occurs, and can also be acquired when the video is played completely, so that the next user can be ensured not to have the masking delay when watching the video.
In step S302, a first playing time stamp of a current image frame in the video is obtained, where the first playing time stamp is used to indicate a time when the current image frame in the video starts to be played. The first playing time stamp can be obtained in real time so as to judge whether mask delay occurs or not in time, and can also be obtained when the video is played completely, so that the next user can be ensured not to have mask delay when watching the video.
In step S303, a second playing time stamp of a current image frame in the transcoded video corresponding to the video is obtained, where the second playing time stamp is used to indicate a time when the current image frame in the transcoded video starts to be played. The second playing time stamp can be obtained in real time so as to timely judge whether the masking delay occurs, and can also be obtained when the video is played completely, so that the next user can be ensured not to have the masking delay when watching the video.
In step S304, it is determined that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp. Generally, when play timestamps of transcoded videos with different gears are not aligned with play timestamps of an original video, it is indicated that picture contents of the original video and the transcoded video are not consistent at the same time, and if a video for generating a mask is not consistent with a transcoded video played by a player, because masks are obtained based on videos, that is, a play timestamp of each mask corresponding to the video is matched with a play timestamp of a corresponding image frame in the video, and if the play timestamps of a current image frame in the video and the transcoded video are not consistent, the play timestamp of the corresponding mask is not matched with a play timestamp of the current image frame in the transcoded video, and a mask which does not belong to the current image frame is easily rendered onto the current image frame during rendering, so that a problem of mask delay occurs. In addition, under the condition that the play timestamps of the transcoded videos with different gears are aligned with the play timestamp of the original video, if the rendering speed of the player during rendering the mask is relatively slow, for example, the rendering timestamp is greater than the play timestamp, that is, the mask is not rendered yet when the current image frame is played, the problem of mask delay can also occur when the player plays the video.
According to an exemplary embodiment of the present disclosure, after determining that the mask delay occurs, further comprising: in case the first play timestamp and the second play timestamp do not coincide, adjusting transcoding parameters for transcoding the video to the transcoded video. According to the embodiment, through adjusting the transcoding parameters, the transcoding video can be guaranteed to be consistent with the playing time stamp of the video, and the playing time stamp of each mask is also guaranteed to be matched with the playing time stamp of the corresponding image frame in the video, so that the problem of mask delay can be solved, and the feeling of watching the video by a user is improved.
According to an exemplary embodiment of the present disclosure, adjusting transcoding parameters for transcoding video to transcoded video comprises: and adjusting the parameters used for changing the frame rate of the video in the transcoding parameters to target parameters, wherein the target parameters are used for controlling the interval of each image frame in the transcoded video to be in a preset time in the process of transcoding the video to the transcoded video. According to the embodiment, the parameter for changing the frame rate of the video in the transcoding parameters is adjusted to be the target parameter, so that the interval of each image frame in the transcoded video is controlled at the preset time to reach the frame rate required by the user, and the problem that the playing time stamps of the transcoded video and the video are inconsistent due to the fact that some image frames are lost or some repeated image frames are added in the transcoding process of the related art to reach the frame rate required by the user is avoided.
For example, assuming that the original transcoding parameter is ffmpeg-i input.mp4-r 30tmp.mp4, the adjusted transcoding parameter may be ffmpeg-i input.mp4-vf frame rate (fps) 30tmp.mp4, the adjusted transcoding parameter mainly uses frame rate (fps) 30 to change the frame rate of the video, and the frame rate (fps) 30 is not used to change the frame rate of the video, the former (fps) 30 strictly ensures the frame rate of the video to be 30, for example, the interval of each image frame is 1000/30-33 ms, that is, the frame rate of the video is ensured by the interval of each image frame being 33 ms; the latter (-r 30) is to achieve a specific frame rate 30 by dropping some image frames or adding some repeated image frames, rather than controlling the frame rate of the whole video at 30 by 33ms per image frame interval, at this time, the dropped image frames or added repeated image frames may cause the play time stamps of the transcoded video and the video to be inconsistent.
According to an exemplary embodiment of the present disclosure, after adjusting transcoding parameters for transcoding video to transcoded video, further comprising: transcoding the video into a new transcoded video again based on the adjusted transcoding parameters, wherein the interval of each image frame in the new transcoded video is preset time; and re-playing the new transcoded video and rendering the mask to the current image frame in the new transcoded video through the player. According to the embodiment, after the transcoding is carried out again based on the adjusted transcoding parameters, the playing time stamp of the new transcoded video and the time stamp of the video are kept consistent, and the problem of mask delay of the video seen by a user can be avoided.
For example, after the transcoding parameter is adjusted to ffmpeg-i input, where fps is 30tmp, mp4, the video may be transcoded again by using the adjusted transcoding parameter to obtain transcoded videos in different gears, the playing time stamps of the transcoded videos in different gears may be kept consistent with the time stamp of the video, and the content of the transcoded video and the content of the original video may be guaranteed to be consistent when the transcoded video is subsequently played, so that the playing time stamp of the mask is matched with the playing time stamp of the image frame of the transcoded video, thereby avoiding the problem of mask delay.
According to an exemplary embodiment of the present disclosure, the method further includes: and in the case of receiving a barrage aiming at the new transcoded video, detecting a mask on a current image frame played by the new transcoded video, and bypassing the mask to display the barrage on the current image frame. Through this embodiment, the bullet screen can be by the way of the corresponding predetermined object display of mask to promote the user and watch experience degree.
Specifically, the masking delay method of the present disclosure can be applied to bullet screen guard technology. If the mask is the mask for the face in the current image frame, after the bullet screen for the new transcoding video is received, the mask on the current image frame of the new transcoding video playing can be detected, and after the mask is detected, the bullet screen can be displayed on the current image frame by bypassing the mask. It should be noted that the above-mentioned mask is rendered before the play time stamp at which the current image frame starts to play, so that after receiving the bullet screen, the bullet screen can avoid the mask to be displayed on the current image frame by detecting the mask of the played current image frame.
According to an exemplary embodiment of the present disclosure, the method further includes: and in the case of receiving the information for indicating the enhancement of the predetermined object, detecting a mask on a current image frame of the new transcoded video playing, and enhancing a region corresponding to the mask on the current image frame. Through the embodiment, only the preset object corresponding to the mask can be enhanced, so that the watching experience of a user is improved.
In particular, the masking delay method of the present disclosure may also be applied to video enhancement techniques. If the mask is a mask for a face in the current image frame, for example, in the case that information indicating enhancement of a predetermined object is received, a mask on the current image frame of a new transcoded video playback may be detected, and after the mask is detected, a region corresponding to the mask on the current image frame may be enhanced, which is equivalent to enhancement of the face on the current image frame because the mask is for the face. It should be noted that, since the mask is rendered before the play time stamp at which the current image frame starts to be played, after receiving the enhancement information, only the region corresponding to the mask can be enhanced by detecting the mask of the played current image frame.
According to an exemplary embodiment of the present disclosure, after determining that the mask delay occurs, further comprising: adjusting player parameters for playing the video and/or transcoding the video if the first play timestamp or the second play timestamp is less than the rendering timestamp. According to the embodiment, the rendering time stamp can be guaranteed to be smaller than the playing time stamp by adjusting the transcoding parameters, so that the rendering finishing time is before the current image frame is played, the problem of mask delay can be solved, and the video watching experience of a user is improved.
According to an exemplary embodiment of the present disclosure, adjusting player parameters for playing video and/or transcoding video includes at least one of the following: increasing the rendering frequency for rendering the mask onto the current image frame; and replacing the current rendering frame for rendering the mask on the current image frame with a target rendering frame with a rendering speed greater than that of the current rendering frame. According to the embodiment, the problem of mask delay can be quickly solved by adjusting the rendering frequency and the rendering frame.
For example, when the video is played, a timestamp of starting playing of a current image frame is smaller than a timestamp of finishing rendering, that is, rendering time is slow, after the current image frame starts playing, a corresponding mask is not rendered on the current image frame, and at this time, a player parameter, such as a mask rendering frequency, may be adjusted, assuming that the previous rendering frequency is 30ms rendering, and may now be adjusted to 15ms rendering, so that the mask rendering may keep up with the video playing speed; for another example, the rendering framework is upgraded, that is, other rendering frameworks (the rendering speed is higher than the original rendering framework) such as surfaview are used, so that a fast rendering speed can be ensured, and the mask rendering can keep up with the video playing speed.
According to an exemplary embodiment of the present disclosure, after adjusting the player parameters for playing the transcoded video, the method further includes: and through the player corresponding to the increased rendering frequency and/or the target rendering frame, the video is replayed and/or the transcoded video is played again, and the mask is rendered on the current image frame in the video and/or the transcoded video. According to the embodiment, the mask rendering can keep up with the video playing speed through the adjusted player parameters, so that the transcoded video and the video are played again, and the problem of mask delay of the video seen by a user can be avoided.
For example, after the parameters of the player are adjusted, it is assumed that a new rendering frame surfeview (the speed of the rendering frame is greater than that of the original rendering frame) is adopted, and after various videos are played subsequently, the surfeview is adopted to perform mask rendering, so that it can be ensured that the time stamp of the playing of the current image frame of the played video is after the time stamp of the rendering end, that is, the playing time stamp is greater than the rendering time stamp, and the problem of mask delay is avoided. In addition, if in the process, the mask rendering frequency can be adjusted, assuming that the previous rendering frequency is 30ms rendering once, and can be adjusted to 15ms rendering once now, a new rendering frequency is adopted for rendering during rendering, so as to further ensure that the timestamp of the playing of the current image frame of the played video is after the timestamp of the rendering end, that is, the playing timestamp is greater than the rendering timestamp, so as to avoid the problem of mask delay.
According to an exemplary embodiment of the disclosure, the method further comprises: under the condition that a barrage aiming at the video and/or the transcoded video is received, detecting a mask on a current image frame played by the video and/or the transcoded video, and bypassing the mask to display the barrage on the current image frame; in the case that the information for indicating the enhancement of the predetermined object is received, a mask on a current image frame of the video and/or the transcoded video playing is detected, and a region corresponding to the mask on the current image frame is enhanced.
Specifically, the masking delay method disclosed by the disclosure can be applied to a bullet screen anti-blocking technology and can also be applied to a video enhancement technology. If the bullet screen anti-blocking technology is applied, after a bullet screen aiming at a new transcoded video is received, a mask on a current image frame of the new transcoded video playing can be detected, the bullet screen is displayed on the current image frame by bypassing the mask, and because the mask is rendered before a playing time stamp of the current image frame starting to play, the mask of the played current image frame can be detected after the bullet screen is received, so that the bullet screen can be displayed on the current image frame by avoiding the mask. For another example, when the video enhancement technology is applied, in the case that information indicating to enhance a predetermined object is received, a mask on a current image frame of a new transcoded video playback may be detected, and a region corresponding to the mask on the current image frame may be enhanced.
In order to verify the feasibility of the above embodiment, the present disclosure takes the business process shown in fig. 4 as an example for analysis, fig. 4 is a schematic diagram of a business process according to an exemplary embodiment, and as shown in fig. 4, the business process includes the following modules:
the server side: the video processing device is responsible for judging whether the input video needs the bullet screen blocking prevention function or not;
and (3) cloud seeding: managing videos of different gears, scheduling masks generated by a portrait segmentation algorithm and issuing the masks;
transcoding: transcoding the input video into different gears for playing by the client, and simultaneously transcoding the input video into 360p 30fps for an image segmentation algorithm;
the human image segmentation algorithm comprises the following steps: the system is responsible for carrying out portrait segmentation on the coded video and the input video and returning the mask to the on-demand cloud management;
a client: receiving a video for playing, wherein the video can be a transcoding video or an input video (as an original definition video);
the player: and playing videos (transcoding videos and input videos) with different gears, and rendering the mask to the played video to perform barrage blocking prevention.
When the masking delay phenomenon occurs in the business process, the following modules causing the masking delay are found through analyzing and verifying each module: 1) a portrait segmentation algorithm module; 2) a transcoding module; 3) a player module; and other modules in the business process are only responsible for scheduling and not changing the video or the mask, so that mask delay is not caused.
Firstly, the portrait segmentation algorithm module is verified, and the generated mask is found to have no delay phenomenon compared with the input video.
Secondly, the transcoding module is verified, videos in different gears generated by transcoding are analyzed, the phenomenon that timestamps of the videos in different gears generated by transcoding are not aligned compared with timestamps in input videos is found, namely, timestamps of corresponding image frames in the two videos which start to be played are not consistent, namely, picture contents of the input videos and the transcoded videos are not consistent in the same time, and when the timestamps of the input videos which generate masks and the transcoded videos which are played by a player are not consistent, the problem of mask delay occurs.
Finally, verifying the player module, and under the condition that the timestamps of the transcoded video and the input video are both guaranteed to be aligned, finding that when the player plays the video, the rendering speed of the player when rendering the mask is relatively slow, namely the rendering speed is slower than the video playing speed, the problem of mask delay can also be caused.
From the above analysis, there are generally two reasons for the mask delay problem: 1) transcoding to generate videos with different gears, wherein timestamps of starting playing of corresponding image frames in the input videos are not aligned; 2) the rendering speed of the player rendering the mask is slower than the video playing speed.
In conclusion, the method and the device mainly analyze the reason that the masking delay occurs in bullet screen blocking, and can ensure that timestamps of the transcoded video and corresponding image frames of the original video which are played are consistent by adjusting transcoding parameters during transcoding, so as to ensure that the video played by a player is matched with the masking consistently; furthermore, according to the method and the device, the mask rendering parameters and/or the rendering frame are/is adjusted when the mask is rendered, so that the mask rendering can keep up with the video playing speed, the mask can be ensured not to be delayed, and the mask rendering can keep up with the video picture content.
Fig. 5 is a block diagram illustrating a video processing device according to an example embodiment. Referring to fig. 5, the apparatus includes:
a rendering time stamp obtaining unit 50 configured to obtain a rendering time stamp of a current image frame in the video, wherein the rendering time stamp is used to indicate a time when a mask of the current image frame in the video is rendered, and the mask is a mask for a predetermined object in the current image frame; a first playing time stamp obtaining unit 52 configured to obtain a first playing time stamp of a current image frame in the video, where the first playing time stamp is used to indicate a time when the current image frame in the video starts playing; a second playing time stamp obtaining unit 54, configured to obtain a second playing time stamp of a current image frame in the transcoded video corresponding to the video, where the second playing time stamp is used to indicate a time when the current image frame in the transcoded video starts to be played; a determining unit 56 configured to determine that the masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to, after determining that the masking delay has occurred, adjust transcoding parameters for transcoding the video to the transcoded video in case the first play timestamp and the second play timestamp do not coincide.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to adjust a parameter for changing a frame rate of the video in the transcoding parameters to a target parameter, wherein the target parameter is used for controlling an interval of each image frame in the transcoded video to be a predetermined time in the process of transcoding the video to the transcoded video.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to, after adjusting the transcoding parameters for transcoding the video to the transcoded video, re-transcode the video to a new transcoded video based on the adjusted transcoding parameters, wherein an interval of each image frame in the new transcoded video is a predetermined time; and re-playing the new transcoded video and rendering the mask to the current image frame in the new transcoded video through the player.
According to an exemplary embodiment of the present disclosure, the processing unit 58 is configured to, in case a barrage for a new transcoded video is received, detect a mask on a current image frame of the new transcoded video playing and display the barrage on the current image frame bypassing the mask.
According to an exemplary embodiment of the present disclosure, the processing unit 58 is configured to, in a case where information indicating that the predetermined object is to be enhanced is received, detect a mask on a current image frame of the new transcoded video playback, and enhance a region corresponding to the mask on the current image frame.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to, after determining that the masking delay has occurred, adjust player parameters for playing the video and/or transcoding the video in case the first play timestamp or the second play timestamp is smaller than the rendering timestamp.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to increase a rendering frequency for rendering the mask onto the current image frame; and replacing the current rendering frame for rendering the mask on the current image frame with a target rendering frame with a rendering speed greater than that of the current rendering frame.
According to an exemplary embodiment of the present disclosure, the determining unit 56 is further configured to, after adjusting the transcoding parameters for transcoding the video to the transcoded video, replay the video and/or the transcoded video and render the mask onto the current image frame in the video and/or the transcoded video through the player corresponding to the increased rendering frequency and/or the target rendering frame.
According to an exemplary embodiment of the present disclosure, the processing unit 58 is configured to, in case a bullet screen for the video and/or the transcoded video is received, detect a mask on a current image frame of the video and/or the transcoded video playing and bypass the mask to display the bullet screen on the current image frame.
According to an exemplary embodiment of the present disclosure, the processing unit 58 is configured to, in case of receiving the information indicating to enhance the predetermined object, detect a mask on a current image frame of the video and/or the transcoded video playing, and enhance a region on the current image frame corresponding to the mask.
According to an embodiment of the present disclosure, an electronic device may be provided. Fig. 6 is a block diagram of an electronic device 600 including at least one memory 601 having a set of computer-executable instructions stored therein that, when executed by the at least one processor, perform a video processing method according to an embodiment of the disclosure and at least one processor 602, according to an embodiment of the disclosure.
By way of example, the electronic device 600 may be a PC computer, tablet device, personal digital assistant, smartphone, or other device capable of executing the set of instructions described above. The electronic device 1000 need not be a single electronic device, but can be any collection of devices or circuits that can execute the above instructions (or sets of instructions) individually or in combination. The electronic device 600 may also be part of an integrated control system or system manager, or may be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission).
In the electronic device 600, the processor 602 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a programmable logic device, a special purpose processor system, a microcontroller, or a microprocessor. By way of example, and not limitation, processor 602 may also include an analog processor, a digital processor, a microprocessor, a multi-core processor, a processor array, a network processor, or the like.
The processor 602 may execute instructions or code stored in memory, where the memory 601 may also store data. The instructions and data may also be transmitted or received over a network via a network interface device, which may employ any known transmission protocol.
The memory 601 may be integrated with the processor 602, for example, with RAM or flash memory disposed within an integrated circuit microprocessor or the like. Further, memory 601 may include a stand-alone device such as an external disk drive, storage array, or any other storage device usable by a database system. The memory 601 and the processor 602 may be operatively coupled or may communicate with each other, e.g., through I/O ports, network connections, etc., such that the processor 602 can read files stored in the memory 601.
Further, the electronic device 600 may also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, mouse, touch input device, etc.). All components of the electronic device may be connected to each other via a bus and/or a network.
According to an embodiment of the present disclosure, there may also be provided a computer-readable storage medium, wherein when executed by at least one processor, instructions in the computer-readable storage medium cause the at least one processor to perform the video processing method of the embodiment of the present disclosure. Examples of the computer-readable storage medium herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD + RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD + RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disk memory, Hard Disk Drive (HDD), solid-state disk drive (SSD), card-type memory (such as a multimedia card, a Secure Digital (SD) card or an extreme digital (XD) card), tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a magnetic tape, a magneto-optical data storage device, a hard disk, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic tape, a magnetic data storage device, a magnetic disk, a magnetic data storage device, a magnetic disk, A solid state disk, and any other device configured to store and provide a computer program and any associated data, data files, and data structures to a processor or computer in a non-transitory manner such that the processor or computer can execute the computer program. The computer program in the computer-readable storage medium described above can be run in an environment deployed in a computer apparatus, such as a client, a host, a proxy device, a server, and the like, and further, in one example, the computer program and any associated data, data files, and data structures are distributed across a networked computer system such that the computer program and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
According to an embodiment of the present disclosure, there is provided a computer program product comprising computer instructions which, when executed by a processor, implement the video processing method of the embodiment of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A video processing method, comprising:
acquiring a rendering time stamp of a current image frame in a video, wherein the rendering time stamp is used for indicating the time when a mask of the current image frame in the video is rendered, and the mask is a mask of a predetermined object in the current image frame;
acquiring a first playing time stamp of the current image frame in the video, wherein the first playing time stamp is used for indicating the time when the current image frame in the video starts to be played;
acquiring a second playing time stamp of the current image frame in the transcoded video corresponding to the video, wherein the second playing time stamp is used for indicating the time for starting playing the current image frame in the transcoded video;
determining that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.
2. The video processing method of claim 1, after determining that the masking delay occurred, further comprising:
adjusting transcoding parameters for transcoding the video to the transcoded video if the first playback timestamp and the second playback timestamp are not consistent.
3. The video processing method of claim 2, wherein said adjusting transcoding parameters for transcoding the video to the transcoded video comprises:
adjusting parameters used for changing the frame rate of the video in the transcoding parameters to target parameters, wherein the target parameters are used for controlling the interval of each image frame in the transcoded video to be in a preset time in the process of transcoding the video to the transcoded video.
4. The video processing method of claim 3, wherein after adjusting transcoding parameters for transcoding the video to the transcoded video, further comprising:
transcoding the video into a new transcoded video again based on the adjusted transcoding parameters, wherein the interval of each image frame in the new transcoded video is the preset time;
and re-playing the new transcoded video and rendering the mask onto the current image frame in the new transcoded video through a player.
5. The video processing method of claim 4, wherein the method further comprises:
and under the condition that a barrage aiming at the new transcoded video is received, detecting a mask on a current image frame played by the new transcoded video, and bypassing the mask to display the barrage on the current image frame.
6. The video processing method of claim 4, wherein the method further comprises:
and under the condition that the information for indicating the enhancement of the predetermined object is received, detecting a mask on a current image frame of the new transcoded video playing, and enhancing a region corresponding to the mask on the current image frame.
7. A video processing apparatus, comprising:
a rendering time stamp obtaining unit configured to obtain a rendering time stamp of a current image frame in a video, wherein the rendering time stamp is used for indicating a time when a mask of the current image frame in the video is rendered, and the mask is a mask for a predetermined object in the current image frame;
a first playing time stamp obtaining unit configured to obtain a first playing time stamp of the current image frame in the video, wherein the first playing time stamp is used for indicating a time when the current image frame in the video starts to be played;
a second playing time stamp obtaining unit, configured to obtain a second playing time stamp of the current image frame in a transcoded video corresponding to the video, where the second playing time stamp is used to indicate a time when the current image frame in the transcoded video starts to be played;
a determination unit configured to determine that a masking delay occurs in at least one of: the first playing time stamp and the second playing time stamp are not consistent, and the first playing time stamp or the second playing time stamp is smaller than the rendering time stamp.
8. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the video processing method of any of claims 1 to 6.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by at least one processor, cause the at least one processor to perform the video processing method of any of claims 1 to 6.
10. A computer program product comprising computer instructions, characterized in that the computer instructions, when executed by a processor, implement the video processing method according to any of claims 1 to 6.
CN202210200321.0A 2022-03-02 2022-03-02 Video processing method and device Active CN114584821B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210200321.0A CN114584821B (en) 2022-03-02 2022-03-02 Video processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210200321.0A CN114584821B (en) 2022-03-02 2022-03-02 Video processing method and device

Publications (2)

Publication Number Publication Date
CN114584821A true CN114584821A (en) 2022-06-03
CN114584821B CN114584821B (en) 2023-08-29

Family

ID=81771449

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210200321.0A Active CN114584821B (en) 2022-03-02 2022-03-02 Video processing method and device

Country Status (1)

Country Link
CN (1) CN114584821B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116055613A (en) * 2022-08-26 2023-05-02 荣耀终端有限公司 Screen projection method and device
CN116761018A (en) * 2023-08-18 2023-09-15 湖南马栏山视频先进技术研究院有限公司 Real-time rendering system based on cloud platform

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019109650A1 (en) * 2017-12-06 2019-06-13 香港乐蜜有限公司 Video playing method and apparatus, and electronic device
CN111882627A (en) * 2020-07-20 2020-11-03 广州市百果园信息技术有限公司 Image processing method, video processing method, device, equipment and storage medium
CN111954060A (en) * 2019-05-17 2020-11-17 上海哔哩哔哩科技有限公司 Barrage mask rendering method, computer device and readable storage medium
CN112118484A (en) * 2019-06-19 2020-12-22 上海哔哩哔哩科技有限公司 Video bullet screen display method and device, computer equipment and readable storage medium
US20220036499A1 (en) * 2020-07-30 2022-02-03 Arm Limited Graphics processing systems

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019109650A1 (en) * 2017-12-06 2019-06-13 香港乐蜜有限公司 Video playing method and apparatus, and electronic device
CN111954060A (en) * 2019-05-17 2020-11-17 上海哔哩哔哩科技有限公司 Barrage mask rendering method, computer device and readable storage medium
CN112118484A (en) * 2019-06-19 2020-12-22 上海哔哩哔哩科技有限公司 Video bullet screen display method and device, computer equipment and readable storage medium
CN111882627A (en) * 2020-07-20 2020-11-03 广州市百果园信息技术有限公司 Image processing method, video processing method, device, equipment and storage medium
US20220036499A1 (en) * 2020-07-30 2022-02-03 Arm Limited Graphics processing systems

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116055613A (en) * 2022-08-26 2023-05-02 荣耀终端有限公司 Screen projection method and device
CN116055613B (en) * 2022-08-26 2023-09-29 荣耀终端有限公司 Screen projection method and device
CN116761018A (en) * 2023-08-18 2023-09-15 湖南马栏山视频先进技术研究院有限公司 Real-time rendering system based on cloud platform
CN116761018B (en) * 2023-08-18 2023-10-17 湖南马栏山视频先进技术研究院有限公司 Real-time rendering system based on cloud platform

Also Published As

Publication number Publication date
CN114584821B (en) 2023-08-29

Similar Documents

Publication Publication Date Title
US10425679B2 (en) Method and device for displaying information on video image
CN114584821B (en) Video processing method and device
US8689255B1 (en) Synchronizing video content with extrinsic data
US10021433B1 (en) Video-production system with social-media features
WO2019114330A1 (en) Video playback method and apparatus, and terminal device
CN110602529B (en) Live broadcast monitoring method and device, electronic equipment and machine-readable storage medium
CN113766336B (en) Video playing control method and device, computer equipment and storage medium
US20170168660A1 (en) Voice bullet screen generation method and electronic device
WO2023104102A1 (en) Live broadcasting comment presentation method and apparatus, and device, program product and medium
CN111901695B (en) Video content interception method, device and equipment and computer storage medium
CN111726641A (en) Live video playing processing method and device and server
AU2019427824B2 (en) Interactive interface for identifying defects in video content
CN112770168B (en) Video playing method, related device and equipment
US11513937B2 (en) Method and device of displaying video comments, computing device, and readable storage medium
WO2019015411A1 (en) Screen recording method and apparatus, and electronic device
CN110300118B (en) Streaming media processing method, device and storage medium
CN111949512A (en) Application program jamming detection method and device, terminal and medium
CN114245036B (en) Video production method and device
CN108882004B (en) Video recording method, device, equipment and storage medium
CN107995538B (en) Video annotation method and system
CN112383831B (en) Method and equipment for generating bullet screen information
CN109194971A (en) A kind of generation method and device for multimedia file
CN108024121B (en) Voice barrage synchronization method and system
CN112423099A (en) Video loading method and device and electronic equipment
CN113691828B (en) Live broadcasting method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant