CN111083515B - Method, device and system for processing live broadcast content - Google Patents
Method, device and system for processing live broadcast content Download PDFInfo
- Publication number
- CN111083515B CN111083515B CN201911407509.7A CN201911407509A CN111083515B CN 111083515 B CN111083515 B CN 111083515B CN 201911407509 A CN201911407509 A CN 201911407509A CN 111083515 B CN111083515 B CN 111083515B
- Authority
- CN
- China
- Prior art keywords
- video stream
- live
- additional information
- original video
- live broadcast
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 238000012545 processing Methods 0.000 title claims abstract description 29
- 238000011156 evaluation Methods 0.000 claims abstract description 37
- 230000011664 signaling Effects 0.000 claims abstract description 24
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 15
- 230000000694 effects Effects 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000008447 perception Effects 0.000 abstract description 2
- 230000006399 behavior Effects 0.000 description 14
- 239000000203 mixture Substances 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 239000002131 composite material Substances 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000001680 brushing effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4383—Accessing a communication channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application provides a method for processing live content, which comprises the following steps: receiving an original video stream sent by a main broadcasting client through a video channel and live broadcasting additional information sent by a signaling channel; synthesizing the original video stream and the live additional information into a live video stream according to the live additional information, and sending the live video stream to a viewer client; and saving the designated image frame of the original video stream based on the evaluation index of the user behavior. The method and the system realize that the audience client side can watch the live video stream without perception, and can timely and conveniently share the original video stream to other video platforms.
Description
Technical Field
The present application relates to the field of live broadcast, and in particular, to a method, an apparatus, and a system for processing live broadcast content.
Background
At present, short videos appear and are integrated into lives of people, brushing of the short videos on each short video platform becomes one of entertainment and dull modes of people, the content of some short videos is some wonderful moments recorded by a main broadcast in a live broadcasting process, and the wonderful moments usually need to be screened by a live broadcasting platform to find out wonderful moments in a high-quality main broadcast live broadcasting process and then are released to a short video platform of a third party.
However, the live broadcast picture of the anchor on the live broadcast platform often includes not only the original picture of the anchor acquired by the camera of the anchor, but also some advertisements such as a sticker, a subtitle and the like added by the anchor or copyright identifiers of the live broadcast platform, and these advertisements and identifiers must appear in the live broadcast picture of the anchor on the live broadcast platform, but cannot appear in the short video picture of the highlight moment released to the short video platform of the third party, however, when the short video generated by selecting the live broadcast picture of the anchor is released to the short video platform of the third party, these advertisements and identifiers are usually carried in the generated short video picture, which results in that the advertisements and identifiers are also included in the short video picture of the highlight moment released to the short video platform of the third party, so that when the advertisements and identifiers exist in the live broadcast picture of the anchor on the live broadcast platform are retained, the problem that advertisements and identifications are carried in short video pictures of wonderful moments published on a short video platform of a third party is solved.
Disclosure of Invention
In view of the above, the present application provides a method, an apparatus, a live system, a device and a computer-readable storage medium for processing live content.
According to a first aspect of embodiments of the present application, there is provided a method for processing live content, the method including:
receiving an original video stream sent by a main broadcasting client through a video channel and live broadcasting additional information sent by a signaling channel;
synthesizing the original video stream and the live additional information into a live video stream according to the live additional information, and sending the live video stream to a viewer client; and
and saving the appointed image frame of the original video stream based on the evaluation index of the user behavior.
According to a second aspect of embodiments of the present application, there is provided a method of processing live content, the method including:
acquiring an original video stream;
the method comprises the steps of respectively sending an original video stream and live broadcast additional information to a server, enabling the server to synthesize the original video stream and the live broadcast additional information into a live broadcast video stream according to the live broadcast additional information, sending the live broadcast video stream to a client of a viewer, and storing a specified image frame of the original video stream based on an evaluation index of user behavior, wherein the original video stream is sent through a video channel, and the live broadcast additional information is sent through a signaling channel.
According to a third aspect of an embodiment of the present application, there is provided a live broadcast system, including a main broadcast client, a server, and a viewer client;
the anchor client is used for acquiring an original video stream;
respectively sending the original video stream and the live broadcast additional information to a server, wherein the original video stream is sent through a video channel, and the live broadcast additional information is sent through a signaling channel;
the server is used for synthesizing the original video stream and the live additional information into a live video stream and sending the live video stream to a viewer client; and
saving a designated image frame of the original video stream based on an evaluation index of user behavior;
and the audience client is used for receiving and displaying the live video stream.
According to a fourth aspect of embodiments of the present application, there is provided an apparatus for processing live content, the apparatus comprising:
the receiving module is used for receiving an original video stream sent by the anchor client through a video channel and live broadcast additional information sent by a signaling channel;
the synthesizing module is used for synthesizing the original video stream and the live broadcast additional information into a live broadcast video stream according to the live broadcast additional information;
a transmission module for transmitting the live video stream to a viewer client;
and the storage module is used for storing the specified image frame of the original video stream based on the evaluation index of the user behavior.
According to a fifth aspect of embodiments of the present application, there is provided an apparatus for processing live content, the apparatus comprising:
the acquisition module is used for acquiring an original video stream;
and the sending module is used for respectively sending the original video stream and the live additional information to a server so as to enable the server to synthesize the original video stream and the live additional information into a live video stream according to the live additional information signaling, send the live video stream to a client of a viewer, and store a specified image frame of the original video stream based on an evaluation index of user behavior, wherein the original video stream is sent through a video channel, and the live additional information is sent through a signaling channel.
According to the method, the anchor client sends the original video stream and the live additional information to the server through different transmission channels respectively, the server completes the action of synthesizing the live additional information and the original video stream into the live video stream instead of the anchor client during stream pushing, and the server can obtain the original video stream without the added live additional information, so that the method can not only enable the audience client to view the live video stream without perception, but also can timely and conveniently share the original video stream to other video platforms.
Drawings
FIG. 1a is a diagram illustrating a picture of an original video stream captured in a live scene according to an exemplary embodiment of the present application;
FIG. 1b is a diagram illustrating a synthesized live view according to an exemplary embodiment of the present application;
FIG. 2 is a flow chart illustrating a method of processing live content in accordance with an exemplary embodiment of the present application;
FIG. 3 is a flow diagram illustrating another method of processing live content in accordance with an exemplary embodiment of the present application;
FIG. 3a is an application example in an application scenario of the present application;
fig. 4 is a schematic diagram illustrating an apparatus for processing live content according to an exemplary embodiment of the present application;
fig. 5 is a schematic diagram of another apparatus for processing live content according to an exemplary embodiment of the present application;
fig. 6 is a schematic diagram of an electronic device shown in an exemplary embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
With the outbreak of short videos, nowadays, the short videos are completely integrated into lives of people, everyone can be a director at any time and any place, the moment of self or body delicacy is recorded through a camera, and the moment is shared by audiences at the other end of a screen, so that the short videos are brushed on a short video platform to become one of the most common modes of entertainment and attrition. And the contents of some short videos are usually some wonderful moments recorded by the anchor in the live broadcasting process, and the wonderful moments usually need to be found out by the live broadcasting platform through screening the live contents of the anchor, and then are released to a short video platform of a third party.
However, the live broadcast picture of the anchor on the live broadcast platform often includes not only the original picture of the anchor acquired by the camera of the anchor, or the original picture captured by the anchor on the terminal display interface, but also some advertisements such as a sticker and a subtitle added by the anchor itself or the copyright identifier of the live broadcast platform, as shown in fig. 1a, the picture is the original picture of the anchor acquired by the camera of the anchor, and the original picture of the anchor is not added with any live broadcast additional information, but only the picture of the anchor acquired by the camera of the anchor is displayed.
As shown in fig. 1b, the picture includes some information of advertisements of characters and pictures and copyright identification added by the anchor on the basis of the original picture acquired by the camera, and the anchor takes the picture as a live picture for the audience to watch, and the advertisements and identification in the live picture shown in fig. 1b are necessary for the live platform, so that the advertisements and identification must appear in the live picture of the anchor on the live platform, but cannot appear in the short video picture of the wonderful moment released to the short video platform of the third party.
The application provides a method for processing live broadcast content, which is characterized in that a server synthesizes an original video stream and live broadcast additional information sent by a main broadcast client into a live broadcast video stream, sends the live broadcast video stream to a spectator client, and stores a specified image frame of the original video stream based on an evaluation index of user behavior. The method and the device realize that the live video stream synthesized by the original video stream and the live additional information is used for live broadcasting, and the specified image frame of the original video stream is stored for being released to a third-party video platform.
Fig. 2 is a flowchart illustrating a method for processing live content according to an exemplary embodiment of the present application, where as shown in fig. 2, the method includes the following steps:
s201: receiving an original video stream sent by a main broadcasting client through a video channel and live broadcasting additional information sent by a signaling channel;
s202: synthesizing the original video stream and the live additional information into a live video stream according to the live additional information, and sending the live video stream to a viewer client;
s203: and saving the appointed image frame of the original video stream based on the evaluation index of the user behavior.
In S201, the original image frame sent by the anchor client may be an image frame of any picture captured in real time by the camera, and the picture may be a picture that the anchor wants to use for live broadcasting, for example, a picture of the anchor itself captured by the camera during live broadcasting, or some pictures of the surroundings of the anchor captured. The acquired original image frame can also be a picture captured by the anchor on a terminal display interface, for example, a game or a movie which is being live by the anchor, and the anchor can capture a game interface or a movie playing interface displayed on a mobile device or a fixed device as the original image frame.
The live broadcast additional information signaling carries live broadcast additional information, the live broadcast additional information can represent some subtitles added by the original image frame, copyright identifications or pictures of the original image, and the subtitles and the pictures of pictures can be some advertising information.
In S202, the live broadcast additional information includes attribute information and location information of the live broadcast additional information, where the attribute information is some fixed attributes of the live broadcast additional information, for example, when the live broadcast additional information is a subtitle, the attribute information may be a style of the subtitle, for example, a style of a text such as a font, a size, a color, a background color of the subtitle, and when the live broadcast additional information is related information for obtaining a picture, the attribute information may be one of two parameters, that is, a URL of the picture and a zoom factor of the picture, or both of the two parameters. The position information is a coordinate of the live broadcast additional information added on the image frame of the original video stream, and the original video stream and the live broadcast additional information are combined into the live broadcast video stream according to the live broadcast additional information signaling.
In S203, the image frame is designated as an original image frame determined by the server based on the evaluation index of the user behavior, and the evaluation index of the user behavior may include at least one of the gift sending amount and the public screen activity, and may be other evaluation indexes besides the two indexes. The specific parameter to be selected may be determined according to the characteristics of the designated image frame that needs to be selected by the person using the scheme, for example, only the gift offering amount or the fair activity may be used as the evaluation index, or other parameters may be used as the evaluation index.
For example, an example in which an image frame at a highlight moment is taken as a specified image frame is described below. Under the live scene, the server receives the live video stream sent by the anchor client and sends the live video stream to the audience client for the audience of the audience client to watch, the audience can enter a live broadcast room of the anchor who likes according to personal preference, the live broadcast of the audience can be sent to the anchor who likes or messages are left on a public screen of the live broadcast room, a barrage is sent to carry out communication interaction with the anchor or other audiences watching the live broadcast together, and along with the increase of the number of the barrages and the number of the delivered gifts, or the higher the value of the delivered courage is, the heat of the live broadcast room of the anchor can also rise. The server sends live broadcast video frames to the audience client, meanwhile, real-time audience barrage quantity, audience gift sending quantity, current live broadcast room heat and the like are used as evaluation indexes, the audience barrage quantity, the audience gift sending quantity, the current live broadcast room heat and the like of a main broadcast live broadcast room corresponding to the current live broadcast video frames are counted in real time, whether the current live broadcast video frames are video frames at a wonderful moment is determined according to the evaluation indexes, and if the audience barrage quantity, the audience gift sending quantity, the current live broadcast room heat and the like of the main broadcast live broadcast room in a period of time reach certain indexes, the live broadcast video frames in the period of time are determined to form a wonderful moment. The appointed image frame can be an original image frame corresponding to a live video frame included in the time period of the highlight moment, namely the original image frame of the highlight moment, because the server can judge whether the current moment is the highlight moment in real time, when the current moment is judged to be the highlight moment, the received original image frame is recorded, and when the current moment is judged to be the non-highlight moment, the recording is stopped, and the recorded file is stored as a video file, wherein the format of the video file can be, for example, an MP4 format, an AVI format and the like, meanwhile, the server can continuously judge whether the current moment is the highlight moment, and once the current moment is judged to be the highlight moment, the recording and the storage are carried out again. Because the original image frame at the wonderful moment does not carry some live broadcast additional information such as subtitles, copyright identifications or pictures of pictures manually added by a main broadcaster and the like, the original image frame can be used for being published to other video platforms.
As an example, the process of the server storing the specified file may refer to the following processes: the server can store the original video stream in segments according to the time sequence of the received original video stream, and judge whether the stored original video stream has the time of the appointed image frame, which can be performed in real time or asynchronously with the stored action. For example, when a file is saved, whether the time period includes a highlight moment or not may be queried, if the time period includes a highlight moment, the original image frame of the file having the highlight moment is determined, and the file and the files of other original image frames having the highlight moment are integrated and filed; if the time period to which the file belongs does not include the wonderful moment, the file is determined to have no original image frame at the wonderful moment, and the file can be directly deleted to avoid occupying the memory space of the equipment. Because the files which are uniformly sent to the server after being integrated and filed are all files comprising original image frames at wonderful moments, the server does not need to screen again, and a user can conveniently and directly share the files acquired by the server to other video platforms when needed.
In one embodiment, the specified image frames may be distributed to the current live platform or a third party video platform. The user can acquire the video files of the wonderful moments stored by the server from the server, edit the acquired video files, for example, appropriate clipping, special effect adding and the like can be performed, and then distribute the processed video files to a third-party video platform so that the wonderful moments can be watched by the audiences of the third-party video platform, or distribute the processed video files to a current live platform so that the wonderful moments can be watched by the audiences of the current live platform.
Fig. 3 is a flowchart illustrating a method for processing live content according to an exemplary embodiment of the present application, where as shown in fig. 3, the method includes the following steps:
s301: acquiring an original video stream;
s302: and respectively sending the original video stream and the live additional information signaling to a server so that the server synthesizes the original video stream and the live additional information into a live video stream according to the live additional information signaling, sends the live video stream to a viewer client, and stores a specified image frame of the original video stream based on an evaluation index of user behavior.
The application also provides a live broadcast system, which comprises a main broadcast client, a server and an audience client;
the anchor client is used for acquiring an original video stream;
respectively sending the original video stream and the live broadcast additional information signaling to a server; and the number of the first and second groups,
the server is used for synthesizing the original video stream and the live additional information into a live video stream and sending the live video stream to a viewer client; and
and saving the appointed image frame of the original video stream based on the evaluation index of the user behavior.
As an example, the anchor client may also locally combine the original image frame with the live additional information into a local live image frame for the anchor to locally view the live picture. In addition, the server can directly send the stored file of the specified image frame to the third-party video platform, or the file of the specified image frame acquired by the user from the server can be directly published or published after being edited to the third-party video platform for the audience of the third-party video platform to watch.
For a better understanding of the present solution, an application example is listed below. In the live environment as shown in fig. 3a, there is a main broadcast client 301a, several viewer clients 302a, a media server 303a, a composition server 304a, as well as a live video stream database 305a and an original video stream database 306a in the live system.
The anchor can enter the live broadcast room through the anchor client 301a, and when the anchor performs live broadcast, the anchor acquires an original video stream by using a camera, and pushes the acquired original video stream to the media server 303a in the form of streaming media data, and additionally, some live broadcast additional information to be presented to the audience is sent to the composition server 304a in the form of signaling (for example, through a channel for sending control signaling).
The media server 303a, upon receiving the original video stream, also sends the original video stream to the composition server 304 a.
The composition server 304a needs to perform composition processing on the original video stream and the live broadcast additional information to generate a live broadcast video stream for the viewer functional client to watch, where the live broadcast video stream seen by the viewer is a video frame appended with information such as subtitles and copyright identifiers. In addition, the composition server 304a stores the composed live video stream into the live video stream database 305a, and the original video stream into the original video stream database 306 a. When the original video stream is saved, the original video stream can be stored in a plurality of folders according to the time sequence of the received file.
The live video streams are distributed by composition server 304a to the various viewer clients 302a in real-time. For the video data stored in the original video stream database 306a, it can be determined whether the video data includes the image frame at the highlight moment in real time or at a suitable time according to different requirements, the determination mode can be implemented by means of AI image recognition and the like, and the determination basis can be some evaluation indexes capable of analyzing the user behavior. Filing the retrieved folder containing the image frames at the wonderful moment; and deleting the folder which does not contain the image frame of the wonderful moment.
The original video stream stored in the original video stream database 306a may be distributed to other video platforms at an appropriate time, or a user may obtain the original video stream from the composition server 304a by using a certain client and send the original video stream to the user, so as to meet the requirement of sharing the original video stream with other video platforms.
As can be seen from fig. 4, when the composite server 304a pushes the composite live video stream, it may not push the composite live video stream to the anchor client 301a, because the anchor client 301a may locally obtain both the original video stream collected by the anchor and the live additional information such as subtitles and pictures, and therefore the anchor client 301a also has the capability of compositing the live video stream. The anchor client 301a can preview the live broadcast effect locally after completing the synthesis of the local live broadcast video stream, so that the preview process is more efficient.
Corresponding to the embodiment of the method for processing the live content, the application also provides an embodiment of a device for processing the live content.
As shown in fig. 4, fig. 4 is a device 400 for processing live content according to an exemplary embodiment of the present application, including:
a receiving module 401, configured to receive an original video stream sent by a anchor client through a video channel and live broadcast additional information sent through a signaling channel;
a synthesizing module 402, configured to synthesize the original video stream and the live additional information into a live video stream according to the live additional information;
a transmission module 403, configured to send the live video stream to a viewer client;
a saving module 404, configured to save a specified image frame of the original video stream based on the evaluation index of the user behavior.
As shown in fig. 5, fig. 5 illustrates an apparatus 500 for processing live content according to an exemplary embodiment of the present application, including:
an obtaining module 501, configured to obtain an original video stream;
a sending module 502, configured to send the original video stream and the live additional information to a server, respectively, so that the server synthesizes the original video stream and the live additional information into a live video stream according to the live additional information signaling, sends the live video stream to a viewer client, and stores a specified image frame of the original video stream based on an evaluation index of a user behavior, where the original video stream is sent through a video channel, and the live additional information is sent through a signaling channel.
The embodiment of the device for processing the live content can be applied to equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. The software implementation is taken as an example, and is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for operation through the processor of the device where the software implementation is located as a logical means. From a hardware aspect, as shown in fig. 6, the apparatus for processing live content according to the present application is a hardware structure diagram of a device in which the apparatus is located, except for the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 6, the device in which the apparatus is located in the embodiment may also include other hardware according to an actual function of the device, which is not described again.
Wherein the non-volatile memory is configured to store processor-executable instructions, and the processor is configured to execute the instructions to implement the method for processing live content according to any of the above embodiments.
The present application further provides a computer-readable storage medium, on which a computer program is stored, which when executed by a processor implements the method for processing live content according to any of the embodiments described above.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the application. One of ordinary skill in the art can understand and implement it without inventive effort.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (9)
1. A method of processing live content, the method comprising:
receiving an original video stream sent by a main broadcasting client through a video channel and live broadcasting additional information sent by a signaling channel; the live broadcast additional information comprises at least one of subtitles, related information for acquiring pictures and copyright identification, and the live broadcast additional information is not added in the original video stream;
synthesizing the original video stream and the live additional information into a live video stream according to the live additional information, and sending the live video stream to a viewer client; and
saving the designated image frames of the original video stream based on the evaluation index of the user behavior, comprising: taking the gift sending quantity and/or the public screen activity as an evaluation index, counting the gift sending quantity and/or the public screen activity of a main broadcast live broadcast room corresponding to the current live broadcast video stream in real time, starting to record the received image frame of the original video stream when the current moment is determined to be a wonderful moment according to the evaluation index, and stopping recording and storing the recorded file when the current moment is determined to be a non-wonderful moment.
2. The method of claim 1, wherein the live additional information further comprises attribute information and location information of the live additional information.
3. The method according to claim 2, wherein the step of composing the live video stream specifically comprises:
and synthesizing the original video stream and the live broadcast additional information into a live broadcast video stream according to the attribute information and the position information.
4. The method according to claim 3, wherein the attribute information comprises a style of the subtitle, a URL of the picture, and/or a zoom factor of the picture;
the position information comprises coordinates of the subtitles and/or the pictures added on the image frames of the original video stream.
5. A method of processing live content, the method comprising:
acquiring an original video stream;
respectively sending an original video stream and live additional information to a server so that the server synthesizes the original video stream and the live additional information into a live video stream according to the live additional information, sending the live video stream to a viewer client, and storing a specified image frame of the original video stream based on an evaluation index of user behavior, wherein the original video stream is sent through a video channel, and the live additional information is sent through a signaling channel; the live broadcast additional information comprises at least one of subtitles, related information for acquiring pictures and copyright identification, and the live broadcast additional information is not added in the original video stream;
the user behavior-based evaluation index saves a specified image frame of the original video stream, and comprises the following steps: taking the gift sending quantity and/or the public screen activity as an evaluation index, counting the gift sending quantity and/or the public screen activity of a main broadcast live broadcast room corresponding to the current live broadcast video stream in real time, starting to record the received image frame of the original video stream when the current moment is determined to be a wonderful moment according to the evaluation index, and stopping recording and storing the recorded file when the current moment is determined to be a non-wonderful moment.
6. The method of claim 5, wherein the method is performed by an anchor client, the method further comprising:
and locally synthesizing the original video stream and the live broadcast additional information into a live broadcast video stream, and locally playing the live broadcast video stream.
7. A live broadcast system is characterized in that the live broadcast system comprises a main broadcast client, a server and an audience client;
the anchor client is used for acquiring an original video stream;
respectively sending the original video stream and the live broadcast additional information to a server, wherein the original video stream is sent through a video channel, and the live broadcast additional information is sent through a signaling channel; the live broadcast additional information comprises at least one of subtitles, related information for acquiring pictures and copyright identification, and the live broadcast additional information is not added in the original video stream;
the server is used for synthesizing the original video stream and the live additional information into a live video stream and sending the live video stream to a viewer client; and
saving the designated image frames of the original video stream based on the evaluation index of the user behavior, comprising: taking the gift sending quantity and/or the public screen activity as an evaluation index, counting the gift sending quantity and/or the public screen activity of a main broadcast live broadcast room corresponding to the current live broadcast video stream in real time, starting to record the image frame of the received original video stream when the current moment is determined to be a wonderful moment according to the evaluation index, and stopping recording and storing the recorded file when the current moment is determined to be a non-wonderful moment;
and the audience client is used for receiving and displaying the live video stream.
8. An apparatus for processing live content, the apparatus comprising:
the receiving module is used for receiving an original video stream sent by the anchor client through a video channel and live broadcast additional information sent by a signaling channel; the live broadcast additional information comprises at least one of subtitles, related information for acquiring pictures and copyright identification, and the live broadcast additional information is not added in the original video stream;
the synthesizing module is used for synthesizing the original video stream and the live broadcast additional information into a live broadcast video stream according to the live broadcast additional information;
a transmission module for transmitting the live video stream to a viewer client;
the storage module is used for storing the appointed image frame of the original video stream based on the evaluation index of the user behavior, and comprises: taking the gift sending quantity and/or the public screen activity as an evaluation index, counting the gift sending quantity and/or the public screen activity of a main broadcast live broadcast room corresponding to the current live broadcast video stream in real time, starting to record the received image frame of the original video stream when the current moment is determined to be a wonderful moment according to the evaluation index, and stopping recording and storing the recorded file when the current moment is determined to be a non-wonderful moment.
9. An apparatus for processing live content, the apparatus comprising:
the acquisition module is used for acquiring an original video stream;
the sending module is used for respectively sending the original video stream and the live additional information to a server so that the server synthesizes the original video stream and the live additional information into a live video stream according to the live additional information signaling, sends the live video stream to a viewer client, and stores a specified image frame of the original video stream based on an evaluation index of user behavior, wherein the original video stream is sent through a video channel, and the live additional information is sent through a signaling channel; the live broadcast additional information comprises at least one of subtitles, related information for acquiring pictures and copyright identification, and the live broadcast additional information is not added in the original video stream;
the user behavior-based evaluation index saves a specified image frame of the original video stream, and comprises the following steps: taking the gift sending quantity and/or the public screen activity as an evaluation index, counting the gift sending quantity and/or the public screen activity of a main broadcast live broadcast room corresponding to the current live broadcast video stream in real time, starting to record the received image frame of the original video stream when the current moment is determined to be a wonderful moment according to the evaluation index, and stopping recording and storing the recorded file when the current moment is determined to be a non-wonderful moment.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911407509.7A CN111083515B (en) | 2019-12-31 | 2019-12-31 | Method, device and system for processing live broadcast content |
| PCT/CN2020/112856 WO2021135334A1 (en) | 2019-12-31 | 2020-09-01 | Method and apparatus for processing live streaming content, and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911407509.7A CN111083515B (en) | 2019-12-31 | 2019-12-31 | Method, device and system for processing live broadcast content |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111083515A CN111083515A (en) | 2020-04-28 |
| CN111083515B true CN111083515B (en) | 2021-07-23 |
Family
ID=70320557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911407509.7A Active CN111083515B (en) | 2019-12-31 | 2019-12-31 | Method, device and system for processing live broadcast content |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111083515B (en) |
| WO (1) | WO2021135334A1 (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111083515B (en) * | 2019-12-31 | 2021-07-23 | 广州华多网络科技有限公司 | Method, device and system for processing live broadcast content |
| CN112084369A (en) * | 2020-08-03 | 2020-12-15 | 广州数说故事信息科技有限公司 | Highlight moment mining method and model based on video live broadcast |
| CN112087669B (en) * | 2020-08-07 | 2023-03-10 | 广州方硅信息技术有限公司 | Method and device for presenting virtual gift and electronic equipment |
| CN113490001A (en) * | 2020-11-28 | 2021-10-08 | 青岛海信电子产业控股股份有限公司 | Audio and video data sharing method, server, device and medium |
| CN112954374B (en) * | 2021-01-28 | 2023-05-23 | 广州虎牙科技有限公司 | Video data processing method and device, electronic equipment and storage medium |
| CN113691877A (en) * | 2021-08-27 | 2021-11-23 | 余浪 | Live broadcasting method and device |
| CN113873296A (en) * | 2021-09-24 | 2021-12-31 | 上海哔哩哔哩科技有限公司 | Video stream processing method and device |
| CN115022654B (en) * | 2022-05-18 | 2024-01-19 | 北京达佳互联信息技术有限公司 | Video editing method and device in live broadcast scene |
| CN115348459A (en) * | 2022-08-16 | 2022-11-15 | 支付宝(杭州)信息技术有限公司 | Short video processing method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105245801A (en) * | 2015-09-24 | 2016-01-13 | 天脉聚源（北京）科技有限公司 | Method for transmitting interactive signals of interactive television system |
| CN108521584A (en) * | 2018-04-20 | 2018-09-11 | 广州虎牙信息科技有限公司 | Interactive information processing method, device, main broadcaster's side apparatus and medium |
| CN108696474A (en) * | 2017-04-05 | 2018-10-23 | 杭州登虹科技有限公司 | The communication means of multimedia transmission |
| CN110198456A (en) * | 2019-04-26 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Video pushing method, device and computer readable storage medium based on live streaming |
| CN110392226A (en) * | 2019-06-19 | 2019-10-29 | 视联动力信息技术股份有限公司 | A kind of live streaming implementation method and device |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050232610A1 (en) * | 2004-04-16 | 2005-10-20 | Gateway, Inc. | User automated content deletion |
| US9681160B2 (en) * | 2011-06-22 | 2017-06-13 | Tout Inc. | Method and apparatus for automatically associating media segments with broadcast media streams |
| CN103686450A (en) * | 2013-12-31 | 2014-03-26 | 广州华多网络科技有限公司 | Video processing method and system |
| CN105282617A (en) * | 2014-06-12 | 2016-01-27 | 李英元 | Video-on-demand system capable of realizing picture identification differentiation |
| US20170134595A1 (en) * | 2015-11-11 | 2017-05-11 | Vivint, Inc. | Automated image album |
| CN105872580B (en) * | 2016-04-15 | 2019-08-13 | 广州酷狗计算机科技有限公司 | The recording method and device of live video |
| CN106131591B (en) * | 2016-06-30 | 2019-08-06 | 广州华多网络科技有限公司 | Live broadcasting method, device and terminal |
| CN106792122A (en) * | 2017-02-20 | 2017-05-31 | 北京金山安全软件有限公司 | Automatic video recording method and device and terminal |
| CN108289159B (en) * | 2017-05-25 | 2020-12-04 | 广州华多网络科技有限公司 | Terminal live broadcast special effect adding system and method and terminal live broadcast system |
| CN111083515B (en) * | 2019-12-31 | 2021-07-23 | 广州华多网络科技有限公司 | Method, device and system for processing live broadcast content |
-
2019
- 2019-12-31 CN CN201911407509.7A patent/CN111083515B/en active Active
-
2020
- 2020-09-01 WO PCT/CN2020/112856 patent/WO2021135334A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105245801A (en) * | 2015-09-24 | 2016-01-13 | 天脉聚源（北京）科技有限公司 | Method for transmitting interactive signals of interactive television system |
| CN108696474A (en) * | 2017-04-05 | 2018-10-23 | 杭州登虹科技有限公司 | The communication means of multimedia transmission |
| CN108521584A (en) * | 2018-04-20 | 2018-09-11 | 广州虎牙信息科技有限公司 | Interactive information processing method, device, main broadcaster's side apparatus and medium |
| CN110198456A (en) * | 2019-04-26 | 2019-09-03 | 腾讯科技（深圳）有限公司 | Video pushing method, device and computer readable storage medium based on live streaming |
| CN110392226A (en) * | 2019-06-19 | 2019-10-29 | 视联动力信息技术股份有限公司 | A kind of live streaming implementation method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021135334A1 (en) | 2021-07-08 |
| CN111083515A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111083515B (en) | Method, device and system for processing live broadcast content | |
| US11937010B2 (en) | Data segment service | |
| US11871093B2 (en) | Socially annotated audiovisual content | |
| US8601506B2 (en) | Content creation and distribution system | |
| CN108989830A (en) | A kind of live broadcasting method, device, electronic equipment and storage medium | |
| US20100158391A1 (en) | Identification and transfer of a media object segment from one communications network to another | |
| US20130219425A1 (en) | Method and apparatus for streaming advertisements concurrently with requested video | |
| US20120192225A1 (en) | Administration of Content Creation and Distribution System | |
| CN106713942B (en) | Video processing method and device | |
| US9824722B2 (en) | Method to mark and exploit at least one sequence record of a video presentation | |
| CN111432284B (en) | Bullet screen interaction method of multimedia terminal and multimedia terminal | |
| CN111050204A (en) | Video clipping method and device, electronic equipment and storage medium | |
| CN115004713A (en) | Video distribution device, video distribution method, and video distribution program | |
| KR102163695B1 (en) | Method for providing real-time engaging streaming service over internet and apparatus therefor | |
| CN109874024A (en) | A kind of barrage processing method, system and storage medium based on dynamic video poster | |
| KR102069897B1 (en) | Method for generating user video and Apparatus therefor | |
| CN111107388A (en) | Method, device, system, equipment and storage medium for processing live broadcast content | |
| CN111107293B (en) | 360-degree video recording method and device, electronic equipment and storage medium | |
| CN109862385B (en) | Live broadcast method and device, computer readable storage medium and terminal equipment | |
| JP4946433B2 (en) | Information distribution apparatus and program | |
| CN110662082A (en) | Data processing method, device, system, mobile terminal and storage medium | |
| KR102659489B1 (en) | Information processing devices, information processing devices and programs | |
| US10008241B2 (en) | Method to mark and exploit at least one sequence record of a video presentation | |
| CN114071215A (en) | Video playing method, device, system and storage medium | |
| CN112019866A (en) | Multi-camera image selection audio-visual service system for consumers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20200428 Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. Contract record no.: X2021440000030 Denomination of invention: Method, device and system for processing live broadcast content License type: Common License Record date: 20210125 |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |